2023-10-06T01:24:19.229 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-06T01:24:19.229 DEBUG:teuthology.run:Teuthology command: teuthology --name yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/auto-repair} --archive /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412092 --owner scheduled_yuriw@teuthology --verbose -- /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412092/orig.config.yaml 2023-10-06T01:24:19.273 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T01:24:19.372 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412092 branch: wip-yuri-testing-2023-10-05-0730-quincy description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/auto-repair} email: yweinste@redhat.com first_in_suite: false job_id: '7412092' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.4' overrides: admin_socket: branch: wip-yuri-testing-2023-10-05-0730-quincy ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - force file system read-only - bad backtrace - MDS in read-only mode - \(MDS_READ_ONLY\) sha1: 736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri-testing-2023-10-05-0730-quincy sha1: f1e315a9732d36c05ec316678e2397dc58561c7f owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 7519 sha1: 736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 sleep_before_teardown: 0 subset: 111/12000 suite: fs suite_branch: wip-yuri-testing-2023-10-05-0730-quincy suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_f1e315a9732d36c05ec316678e2397dc58561c7f/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: f1e315a9732d36c05ec316678e2397dc58561c7f targets: smithi071.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOARrpVsuelpPHrKQz9fgxjsSMLYVQZw9/j/SJSe42xtgeMSaokhcXmBhEqsLpgD7mrfjvBYaajAwxC9YbyrVCo= smithi072.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKAOUnKDmq8dM80lRaXjuGcm/tuYAcwg0zb0tU+4ZiSl9leZ0oV3Z9l2uUo7fyq2Bii/XYSJgbx9T/lUp4hASiI= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - ceph-fuse: null - cephfs_test_runner: modules: - tasks.cephfs.test_auto_repair teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 54e62bcbac4e53d9685e08328b790d3b20d71cae timestamp: 2023-10-05_23:52:50 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-06T01:24:19.372 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_f1e315a9732d36c05ec316678e2397dc58561c7f/qa; will attempt to use it 2023-10-06T01:24:19.373 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_f1e315a9732d36c05ec316678e2397dc58561c7f/qa/tasks 2023-10-06T01:24:19.373 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-06T01:24:19.374 INFO:teuthology.task.internal:Checking packages... 2023-10-06T01:24:19.399 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2' 2023-10-06T01:24:19.399 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-06T01:24:19.399 INFO:teuthology.packaging:ref: None 2023-10-06T01:24:19.399 INFO:teuthology.packaging:tag: None 2023-10-06T01:24:19.399 INFO:teuthology.packaging:branch: wip-yuri-testing-2023-10-05-0730-quincy 2023-10-06T01:24:19.399 INFO:teuthology.packaging:sha1: 736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 2023-10-06T01:24:19.400 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-yuri-testing-2023-10-05-0730-quincy 2023-10-06T01:24:19.623 INFO:teuthology.task.internal:Found packages for ceph version 17.2.6-1296.g736ac5ba 2023-10-06T01:24:19.623 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-06T01:24:19.629 INFO:teuthology.task.internal:no buildpackages task found 2023-10-06T01:24:19.629 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-06T01:24:19.635 INFO:teuthology.task.internal:Saving configuration 2023-10-06T01:24:19.651 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-06T01:24:19.656 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T01:24:19.679 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi071.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412092', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 01:18:43.447708', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOARrpVsuelpPHrKQz9fgxjsSMLYVQZw9/j/SJSe42xtgeMSaokhcXmBhEqsLpgD7mrfjvBYaajAwxC9YbyrVCo='} 2023-10-06T01:24:19.699 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi072.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412092', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 01:18:43.449718', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKAOUnKDmq8dM80lRaXjuGcm/tuYAcwg0zb0tU+4ZiSl9leZ0oV3Z9l2uUo7fyq2Bii/XYSJgbx9T/lUp4hASiI='} 2023-10-06T01:24:19.700 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-06T01:24:19.705 INFO:teuthology.task.internal:roles: ubuntu@smithi071.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-10-06T01:24:19.705 INFO:teuthology.task.internal:roles: ubuntu@smithi072.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-10-06T01:24:19.705 INFO:teuthology.run_tasks:Running task console_log... 2023-10-06T01:24:19.876 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe2710f9b80>, signals=[15]) 2023-10-06T01:24:19.876 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-06T01:24:19.884 INFO:teuthology.task.internal:Opening connections... 2023-10-06T01:24:19.884 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi071.front.sepia.ceph.com 2023-10-06T01:24:19.886 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T01:24:19.956 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi072.front.sepia.ceph.com 2023-10-06T01:24:19.956 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T01:24:20.021 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-06T01:24:20.027 DEBUG:teuthology.orchestra.run.smithi071:> uname -m 2023-10-06T01:24:20.043 INFO:teuthology.orchestra.run.smithi071.stdout:x86_64 2023-10-06T01:24:20.044 DEBUG:teuthology.orchestra.run.smithi071:> cat /etc/os-release 2023-10-06T01:24:20.099 INFO:teuthology.orchestra.run.smithi071.stdout:NAME="Red Hat Enterprise Linux" 2023-10-06T01:24:20.099 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION="8.4 (Ootpa)" 2023-10-06T01:24:20.099 INFO:teuthology.orchestra.run.smithi071.stdout:ID="rhel" 2023-10-06T01:24:20.099 INFO:teuthology.orchestra.run.smithi071.stdout:ID_LIKE="fedora" 2023-10-06T01:24:20.100 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION_ID="8.4" 2023-10-06T01:24:20.100 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM_ID="platform:el8" 2023-10-06T01:24:20.100 INFO:teuthology.orchestra.run.smithi071.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-06T01:24:20.100 INFO:teuthology.orchestra.run.smithi071.stdout:ANSI_COLOR="0;31" 2023-10-06T01:24:20.100 INFO:teuthology.orchestra.run.smithi071.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-06T01:24:20.100 INFO:teuthology.orchestra.run.smithi071.stdout:HOME_URL="https://www.redhat.com/" 2023-10-06T01:24:20.100 INFO:teuthology.orchestra.run.smithi071.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-06T01:24:20.100 INFO:teuthology.orchestra.run.smithi071.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-06T01:24:20.100 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:24:20.100 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-06T01:24:20.100 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-06T01:24:20.101 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-06T01:24:20.101 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-06T01:24:20.101 INFO:teuthology.lock.ops:Updating smithi071.front.sepia.ceph.com on lock server 2023-10-06T01:24:20.133 DEBUG:teuthology.orchestra.run.smithi072:> uname -m 2023-10-06T01:24:20.148 INFO:teuthology.orchestra.run.smithi072.stdout:x86_64 2023-10-06T01:24:20.148 DEBUG:teuthology.orchestra.run.smithi072:> cat /etc/os-release 2023-10-06T01:24:20.201 INFO:teuthology.orchestra.run.smithi072.stdout:NAME="Red Hat Enterprise Linux" 2023-10-06T01:24:20.201 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION="8.4 (Ootpa)" 2023-10-06T01:24:20.201 INFO:teuthology.orchestra.run.smithi072.stdout:ID="rhel" 2023-10-06T01:24:20.201 INFO:teuthology.orchestra.run.smithi072.stdout:ID_LIKE="fedora" 2023-10-06T01:24:20.202 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION_ID="8.4" 2023-10-06T01:24:20.202 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM_ID="platform:el8" 2023-10-06T01:24:20.202 INFO:teuthology.orchestra.run.smithi072.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-06T01:24:20.202 INFO:teuthology.orchestra.run.smithi072.stdout:ANSI_COLOR="0;31" 2023-10-06T01:24:20.202 INFO:teuthology.orchestra.run.smithi072.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-06T01:24:20.202 INFO:teuthology.orchestra.run.smithi072.stdout:HOME_URL="https://www.redhat.com/" 2023-10-06T01:24:20.202 INFO:teuthology.orchestra.run.smithi072.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-06T01:24:20.202 INFO:teuthology.orchestra.run.smithi072.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-06T01:24:20.202 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-06T01:24:20.202 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-06T01:24:20.202 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-06T01:24:20.203 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-06T01:24:20.203 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-06T01:24:20.203 INFO:teuthology.lock.ops:Updating smithi072.front.sepia.ceph.com on lock server 2023-10-06T01:24:20.233 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-06T01:24:20.242 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-06T01:24:20.246 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-06T01:24:20.246 DEBUG:teuthology.orchestra.run.smithi071:> test '!' -e /home/ubuntu/cephtest 2023-10-06T01:24:20.249 DEBUG:teuthology.orchestra.run.smithi072:> test '!' -e /home/ubuntu/cephtest 2023-10-06T01:24:20.262 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-06T01:24:20.268 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-06T01:24:20.268 DEBUG:teuthology.orchestra.run.smithi071:> test -z $(ls -A /var/lib/ceph) 2023-10-06T01:24:20.305 DEBUG:teuthology.orchestra.run.smithi072:> test -z $(ls -A /var/lib/ceph) 2023-10-06T01:24:20.319 INFO:teuthology.orchestra.run.smithi072.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2023-10-06T01:24:20.320 INFO:teuthology.orchestra.run.smithi071.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2023-10-06T01:24:20.320 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-06T01:24:20.376 INFO:teuthology.run_tasks:Running task kernel... 2023-10-06T01:24:20.393 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-10-06T01:24:20.393 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-10-06T01:24:20.393 DEBUG:teuthology.orchestra.run.smithi071:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-06T01:24:20.394 DEBUG:teuthology.orchestra.run.smithi072:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-06T01:24:20.406 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T01:24:20.407 DEBUG:teuthology.orchestra.run.smithi072:> uname -r 2023-10-06T01:24:20.409 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T01:24:20.409 DEBUG:teuthology.orchestra.run.smithi071:> uname -r 2023-10-06T01:24:20.461 INFO:teuthology.orchestra.run.smithi072.stdout:4.18.0-305.25.1.el8_4.x86_64 2023-10-06T01:24:20.462 INFO:teuthology.task.kernel:Running kernel on smithi072: 4.18.0-305.25.1.el8_4.x86_64 2023-10-06T01:24:20.462 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum install -y kernel 2023-10-06T01:24:20.465 INFO:teuthology.orchestra.run.smithi071.stdout:4.18.0-305.25.1.el8_4.x86_64 2023-10-06T01:24:20.466 INFO:teuthology.task.kernel:Running kernel on smithi071: 4.18.0-305.25.1.el8_4.x86_64 2023-10-06T01:24:20.466 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum install -y kernel 2023-10-06T01:24:21.966 INFO:teuthology.orchestra.run.smithi071.stdout:Updating Subscription Management repositories. 2023-10-06T01:24:21.967 INFO:teuthology.orchestra.run.smithi071.stdout:Unable to read consumer identity 2023-10-06T01:24:22.700 INFO:teuthology.orchestra.run.smithi072.stdout:Updating Subscription Management repositories. 2023-10-06T01:24:22.701 INFO:teuthology.orchestra.run.smithi072.stdout:Unable to read consumer identity 2023-10-06T01:24:23.380 INFO:teuthology.orchestra.run.smithi071.stdout:Copr repo for python3-asyncssh owned by ceph 21 kB/s | 3.5 kB 00:00 2023-10-06T01:24:23.896 INFO:teuthology.orchestra.run.smithi071.stdout:Extra Packages for Enterprise Linux 33 MB/s | 16 MB 00:00 2023-10-06T01:24:25.348 INFO:teuthology.orchestra.run.smithi072.stdout:Copr repo for python3-asyncssh owned by ceph 35 kB/s | 3.5 kB 00:00 2023-10-06T01:24:25.949 INFO:teuthology.orchestra.run.smithi072.stdout:Extra Packages for Enterprise Linux 28 MB/s | 16 MB 00:00 2023-10-06T01:24:27.260 INFO:teuthology.orchestra.run.smithi071.stdout:lab-extras 4.8 MB/s | 24 kB 00:00 2023-10-06T01:24:28.007 INFO:teuthology.orchestra.run.smithi071.stdout:Package kernel-4.18.0-80.el8.x86_64 is already installed. 2023-10-06T01:24:28.007 INFO:teuthology.orchestra.run.smithi071.stdout:Package kernel-4.18.0-425.3.1.el8.x86_64 is already installed. 2023-10-06T01:24:28.007 INFO:teuthology.orchestra.run.smithi071.stdout:Package kernel-4.18.0-305.25.1.el8_4.x86_64 is already installed. 2023-10-06T01:24:28.160 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2023-10-06T01:24:28.161 INFO:teuthology.orchestra.run.smithi071.stdout:Nothing to do. 2023-10-06T01:24:28.161 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2023-10-06T01:24:28.286 DEBUG:teuthology.orchestra.run.smithi071:> echo no | sudo yum reinstall kernel || true 2023-10-06T01:24:28.629 INFO:teuthology.orchestra.run.smithi071.stdout:Updating Subscription Management repositories. 2023-10-06T01:24:28.630 INFO:teuthology.orchestra.run.smithi071.stdout:Unable to read consumer identity 2023-10-06T01:24:28.920 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:00:01 ago on Fri 06 Oct 2023 01:24:27 AM UTC. 2023-10-06T01:24:29.052 INFO:teuthology.orchestra.run.smithi071.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-06T01:24:29.052 INFO:teuthology.orchestra.run.smithi071.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T01:24:29.052 INFO:teuthology.orchestra.run.smithi071.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T01:24:29.074 INFO:teuthology.orchestra.run.smithi071.stderr:Error: No packages marked for reinstall. 2023-10-06T01:24:29.123 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum reinstall -y kernel || true 2023-10-06T01:24:29.237 INFO:teuthology.orchestra.run.smithi072.stdout:lab-extras 4.4 MB/s | 24 kB 00:00 2023-10-06T01:24:29.465 INFO:teuthology.orchestra.run.smithi071.stdout:Updating Subscription Management repositories. 2023-10-06T01:24:29.465 INFO:teuthology.orchestra.run.smithi071.stdout:Unable to read consumer identity 2023-10-06T01:24:29.742 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:00:02 ago on Fri 06 Oct 2023 01:24:27 AM UTC. 2023-10-06T01:24:29.867 INFO:teuthology.orchestra.run.smithi071.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-06T01:24:29.868 INFO:teuthology.orchestra.run.smithi071.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T01:24:29.868 INFO:teuthology.orchestra.run.smithi071.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T01:24:29.880 INFO:teuthology.orchestra.run.smithi071.stderr:Error: No packages marked for reinstall. 2023-10-06T01:24:29.928 DEBUG:teuthology.orchestra.run.smithi071:> rpm -q kernel | sort -rV | head -n 1 2023-10-06T01:24:29.974 INFO:teuthology.orchestra.run.smithi072.stdout:Package kernel-4.18.0-80.el8.x86_64 is already installed. 2023-10-06T01:24:29.975 INFO:teuthology.orchestra.run.smithi072.stdout:Package kernel-4.18.0-425.3.1.el8.x86_64 is already installed. 2023-10-06T01:24:29.975 INFO:teuthology.orchestra.run.smithi072.stdout:Package kernel-4.18.0-305.25.1.el8_4.x86_64 is already installed. 2023-10-06T01:24:30.053 INFO:teuthology.orchestra.run.smithi071.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-06T01:24:30.053 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-06T01:24:30.053 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-305.25.1.el8_4.x86_64 Expected: 4.18.0-425.3.1.el8.x86_64 2023-10-06T01:24:30.053 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-06T01:24:30.053 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-06T01:24:30.053 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-10-06T01:24:30.053 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi071.front.sepia.ceph.com, path=None, version=distro) 2023-10-06T01:24:30.054 DEBUG:teuthology.orchestra.run.smithi071:> rpm -q kernel | sort -rV | head -n 1 2023-10-06T01:24:30.139 INFO:teuthology.orchestra.run.smithi072.stdout:Dependencies resolved. 2023-10-06T01:24:30.140 INFO:teuthology.orchestra.run.smithi072.stdout:Nothing to do. 2023-10-06T01:24:30.140 INFO:teuthology.orchestra.run.smithi072.stdout:Complete! 2023-10-06T01:24:30.178 INFO:teuthology.orchestra.run.smithi071.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-06T01:24:30.178 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-06T01:24:30.178 DEBUG:teuthology.orchestra.run.smithi071:> sudo rpm -qi grub2-tools 2023-10-06T01:24:30.204 INFO:teuthology.orchestra.run.smithi071.stdout:Name : grub2-tools 2023-10-06T01:24:30.205 INFO:teuthology.orchestra.run.smithi071.stdout:Epoch : 1 2023-10-06T01:24:30.205 INFO:teuthology.orchestra.run.smithi071.stdout:Version : 2.02 2023-10-06T01:24:30.205 INFO:teuthology.orchestra.run.smithi071.stdout:Release : 99.el8_4.1 2023-10-06T01:24:30.205 INFO:teuthology.orchestra.run.smithi071.stdout:Architecture: x86_64 2023-10-06T01:24:30.205 INFO:teuthology.orchestra.run.smithi071.stdout:Install Date: Wed 21 Dec 2022 01:02:32 PM UTC 2023-10-06T01:24:30.205 INFO:teuthology.orchestra.run.smithi071.stdout:Group : System Environment/Base 2023-10-06T01:24:30.205 INFO:teuthology.orchestra.run.smithi071.stdout:Size : 9264631 2023-10-06T01:24:30.205 INFO:teuthology.orchestra.run.smithi071.stdout:License : GPLv3+ 2023-10-06T01:24:30.205 INFO:teuthology.orchestra.run.smithi071.stdout:Signature : RSA/SHA256, Thu 09 Sep 2021 09:41:55 AM UTC, Key ID 199e2f91fd431d51 2023-10-06T01:24:30.205 INFO:teuthology.orchestra.run.smithi071.stdout:Source RPM : grub2-2.02-99.el8_4.1.src.rpm 2023-10-06T01:24:30.205 INFO:teuthology.orchestra.run.smithi071.stdout:Build Date : Tue 18 May 2021 07:46:34 AM UTC 2023-10-06T01:24:30.206 INFO:teuthology.orchestra.run.smithi071.stdout:Build Host : x86-vm-07.build.eng.bos.redhat.com 2023-10-06T01:24:30.206 INFO:teuthology.orchestra.run.smithi071.stdout:Relocations : (not relocatable) 2023-10-06T01:24:30.206 INFO:teuthology.orchestra.run.smithi071.stdout:Packager : Red Hat, Inc. 2023-10-06T01:24:30.206 INFO:teuthology.orchestra.run.smithi071.stdout:Vendor : Red Hat, Inc. 2023-10-06T01:24:30.206 INFO:teuthology.orchestra.run.smithi071.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-06T01:24:30.206 INFO:teuthology.orchestra.run.smithi071.stdout:Summary : Support tools for GRUB. 2023-10-06T01:24:30.206 INFO:teuthology.orchestra.run.smithi071.stdout:Description : 2023-10-06T01:24:30.206 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:24:30.206 INFO:teuthology.orchestra.run.smithi071.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-06T01:24:30.206 INFO:teuthology.orchestra.run.smithi071.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-06T01:24:30.206 INFO:teuthology.orchestra.run.smithi071.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-06T01:24:30.206 INFO:teuthology.orchestra.run.smithi071.stdout:hardware devices. 2023-10-06T01:24:30.207 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:24:30.207 INFO:teuthology.orchestra.run.smithi071.stdout:This subpackage provides tools for support of all platforms. 2023-10-06T01:24:30.207 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-06T01:24:30.207 INFO:teuthology.task.kernel:Updating grub on smithi071 to boot 4.18.0-425.3.1.el8.x86_64 2023-10-06T01:24:30.208 DEBUG:teuthology.orchestra.run.smithi071:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-06T01:24:30.254 DEBUG:teuthology.orchestra.run.smithi072:> echo no | sudo yum reinstall kernel || true 2023-10-06T01:24:30.594 INFO:teuthology.orchestra.run.smithi072.stdout:Updating Subscription Management repositories. 2023-10-06T01:24:30.595 INFO:teuthology.orchestra.run.smithi072.stdout:Unable to read consumer identity 2023-10-06T01:24:30.884 INFO:teuthology.orchestra.run.smithi072.stdout:Last metadata expiration check: 0:00:01 ago on Fri 06 Oct 2023 01:24:29 AM UTC. 2023-10-06T01:24:31.034 INFO:teuthology.orchestra.run.smithi072.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-06T01:24:31.034 INFO:teuthology.orchestra.run.smithi072.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T01:24:31.034 INFO:teuthology.orchestra.run.smithi072.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T01:24:31.072 INFO:teuthology.orchestra.run.smithi072.stderr:Error: No packages marked for reinstall. 2023-10-06T01:24:31.122 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum reinstall -y kernel || true 2023-10-06T01:24:31.463 INFO:teuthology.orchestra.run.smithi072.stdout:Updating Subscription Management repositories. 2023-10-06T01:24:31.463 INFO:teuthology.orchestra.run.smithi072.stdout:Unable to read consumer identity 2023-10-06T01:24:31.497 INFO:teuthology.orchestra.run.smithi071.stderr:Generating grub configuration file ... 2023-10-06T01:24:31.752 INFO:teuthology.orchestra.run.smithi072.stdout:Last metadata expiration check: 0:00:02 ago on Fri 06 Oct 2023 01:24:29 AM UTC. 2023-10-06T01:24:31.900 INFO:teuthology.orchestra.run.smithi072.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-06T01:24:31.900 INFO:teuthology.orchestra.run.smithi072.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T01:24:31.900 INFO:teuthology.orchestra.run.smithi072.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T01:24:31.922 INFO:teuthology.orchestra.run.smithi072.stderr:Error: No packages marked for reinstall. 2023-10-06T01:24:31.977 DEBUG:teuthology.orchestra.run.smithi072:> rpm -q kernel | sort -rV | head -n 1 2023-10-06T01:24:32.100 INFO:teuthology.orchestra.run.smithi072.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-06T01:24:32.101 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-06T01:24:32.101 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-305.25.1.el8_4.x86_64 Expected: 4.18.0-425.3.1.el8.x86_64 2023-10-06T01:24:32.101 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-06T01:24:32.101 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-06T01:24:32.101 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2023-10-06T01:24:32.101 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi072.front.sepia.ceph.com, path=None, version=distro) 2023-10-06T01:24:32.101 DEBUG:teuthology.orchestra.run.smithi072:> rpm -q kernel | sort -rV | head -n 1 2023-10-06T01:24:32.224 INFO:teuthology.orchestra.run.smithi072.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-06T01:24:32.225 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-06T01:24:32.225 DEBUG:teuthology.orchestra.run.smithi072:> sudo rpm -qi grub2-tools 2023-10-06T01:24:32.251 INFO:teuthology.orchestra.run.smithi072.stdout:Name : grub2-tools 2023-10-06T01:24:32.251 INFO:teuthology.orchestra.run.smithi072.stdout:Epoch : 1 2023-10-06T01:24:32.251 INFO:teuthology.orchestra.run.smithi072.stdout:Version : 2.02 2023-10-06T01:24:32.251 INFO:teuthology.orchestra.run.smithi072.stdout:Release : 99.el8_4.1 2023-10-06T01:24:32.251 INFO:teuthology.orchestra.run.smithi072.stdout:Architecture: x86_64 2023-10-06T01:24:32.252 INFO:teuthology.orchestra.run.smithi072.stdout:Install Date: Wed 21 Dec 2022 01:02:32 PM UTC 2023-10-06T01:24:32.252 INFO:teuthology.orchestra.run.smithi072.stdout:Group : System Environment/Base 2023-10-06T01:24:32.252 INFO:teuthology.orchestra.run.smithi072.stdout:Size : 9264631 2023-10-06T01:24:32.252 INFO:teuthology.orchestra.run.smithi072.stdout:License : GPLv3+ 2023-10-06T01:24:32.252 INFO:teuthology.orchestra.run.smithi072.stdout:Signature : RSA/SHA256, Thu 09 Sep 2021 09:41:55 AM UTC, Key ID 199e2f91fd431d51 2023-10-06T01:24:32.252 INFO:teuthology.orchestra.run.smithi072.stdout:Source RPM : grub2-2.02-99.el8_4.1.src.rpm 2023-10-06T01:24:32.252 INFO:teuthology.orchestra.run.smithi072.stdout:Build Date : Tue 18 May 2021 07:46:34 AM UTC 2023-10-06T01:24:32.252 INFO:teuthology.orchestra.run.smithi072.stdout:Build Host : x86-vm-07.build.eng.bos.redhat.com 2023-10-06T01:24:32.252 INFO:teuthology.orchestra.run.smithi072.stdout:Relocations : (not relocatable) 2023-10-06T01:24:32.252 INFO:teuthology.orchestra.run.smithi072.stdout:Packager : Red Hat, Inc. 2023-10-06T01:24:32.252 INFO:teuthology.orchestra.run.smithi072.stdout:Vendor : Red Hat, Inc. 2023-10-06T01:24:32.252 INFO:teuthology.orchestra.run.smithi072.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-06T01:24:32.253 INFO:teuthology.orchestra.run.smithi072.stdout:Summary : Support tools for GRUB. 2023-10-06T01:24:32.253 INFO:teuthology.orchestra.run.smithi072.stdout:Description : 2023-10-06T01:24:32.253 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-06T01:24:32.253 INFO:teuthology.orchestra.run.smithi072.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-06T01:24:32.253 INFO:teuthology.orchestra.run.smithi072.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-06T01:24:32.253 INFO:teuthology.orchestra.run.smithi072.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-06T01:24:32.253 INFO:teuthology.orchestra.run.smithi072.stdout:hardware devices. 2023-10-06T01:24:32.253 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-06T01:24:32.253 INFO:teuthology.orchestra.run.smithi072.stdout:This subpackage provides tools for support of all platforms. 2023-10-06T01:24:32.254 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-06T01:24:32.254 INFO:teuthology.task.kernel:Updating grub on smithi072 to boot 4.18.0-425.3.1.el8.x86_64 2023-10-06T01:24:32.254 DEBUG:teuthology.orchestra.run.smithi072:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-06T01:24:33.697 INFO:teuthology.orchestra.run.smithi071.stderr:done 2023-10-06T01:24:33.699 DEBUG:teuthology.orchestra.run.smithi071:> mktemp 2023-10-06T01:24:33.722 INFO:teuthology.orchestra.run.smithi071.stdout:/tmp/tmp.Vov5ogHKKs 2023-10-06T01:24:33.722 DEBUG:teuthology.orchestra.run.smithi071:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.Vov5ogHKKs 2023-10-06T01:24:33.801 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 0666 /tmp/tmp.Vov5ogHKKs 2023-10-06T01:24:33.954 DEBUG:teuthology.orchestra.remote:smithi071:/tmp/tmp.Vov5ogHKKs is 6KB 2023-10-06T01:24:34.002 DEBUG:teuthology.orchestra.run.smithi071:> rm -fr /tmp/tmp.Vov5ogHKKs 2023-10-06T01:24:34.016 DEBUG:teuthology.orchestra.run.smithi071:> sudo /bin/ls /boot/loader/entries || true 2023-10-06T01:24:34.025 INFO:teuthology.orchestra.run.smithi072.stderr:Generating grub configuration file ... 2023-10-06T01:24:34.085 INFO:teuthology.orchestra.run.smithi071.stdout:298e228f3b5e401e8ac0f5ae159a2e06-0-rescue.conf 2023-10-06T01:24:34.085 INFO:teuthology.orchestra.run.smithi071.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-305.25.1.el8_4.x86_64.conf 2023-10-06T01:24:34.085 INFO:teuthology.orchestra.run.smithi071.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64.conf 2023-10-06T01:24:34.085 INFO:teuthology.orchestra.run.smithi071.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-80.el8.x86_64.conf 2023-10-06T01:24:34.086 DEBUG:teuthology.orchestra.run.smithi071:> sudo grub2-set-default 298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64 2023-10-06T01:24:34.265 DEBUG:teuthology.orchestra.run.smithi071:> sudo shutdown -r now 2023-10-06T01:24:36.541 INFO:teuthology.orchestra.run.smithi072.stderr:done 2023-10-06T01:24:36.543 DEBUG:teuthology.orchestra.run.smithi072:> mktemp 2023-10-06T01:24:36.574 INFO:teuthology.orchestra.run.smithi072.stdout:/tmp/tmp.V3txCaN2x6 2023-10-06T01:24:36.574 DEBUG:teuthology.orchestra.run.smithi072:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.V3txCaN2x6 2023-10-06T01:24:36.650 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 0666 /tmp/tmp.V3txCaN2x6 2023-10-06T01:24:36.807 DEBUG:teuthology.orchestra.remote:smithi072:/tmp/tmp.V3txCaN2x6 is 6KB 2023-10-06T01:24:36.825 DEBUG:teuthology.orchestra.run.smithi072:> rm -fr /tmp/tmp.V3txCaN2x6 2023-10-06T01:24:36.839 DEBUG:teuthology.orchestra.run.smithi072:> sudo /bin/ls /boot/loader/entries || true 2023-10-06T01:24:36.900 INFO:teuthology.orchestra.run.smithi072.stdout:298e228f3b5e401e8ac0f5ae159a2e06-0-rescue.conf 2023-10-06T01:24:36.900 INFO:teuthology.orchestra.run.smithi072.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-305.25.1.el8_4.x86_64.conf 2023-10-06T01:24:36.900 INFO:teuthology.orchestra.run.smithi072.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64.conf 2023-10-06T01:24:36.901 INFO:teuthology.orchestra.run.smithi072.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-80.el8.x86_64.conf 2023-10-06T01:24:36.901 DEBUG:teuthology.orchestra.run.smithi072:> sudo grub2-set-default 298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64 2023-10-06T01:24:37.068 DEBUG:teuthology.orchestra.run.smithi072:> sudo shutdown -r now 2023-10-06T01:25:04.292 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-10-06T01:25:04.292 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2023-10-06T01:25:04.293 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T01:25:07.073 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-10-06T01:25:07.074 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2023-10-06T01:25:07.074 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T01:25:22.683 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.71 2023-10-06T01:25:25.498 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-10-06T01:25:31.689 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2023-10-06T01:25:31.689 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T01:25:34.502 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2023-10-06T01:25:34.502 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T01:25:34.746 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.71 2023-10-06T01:25:37.562 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-10-06T01:25:46.757 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2023-10-06T01:25:46.757 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T01:25:49.566 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2023-10-06T01:25:49.566 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T01:26:05.178 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.71 2023-10-06T01:26:07.994 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-10-06T01:26:20.186 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2023-10-06T01:26:20.187 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T01:26:20.656 DEBUG:teuthology.orchestra.run.smithi071:> true 2023-10-06T01:26:20.984 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi071.front.sepia.ceph.com' 2023-10-06T01:26:20.984 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "4.18.0-425.3.1.el8.x86_64"... 2023-10-06T01:26:20.984 DEBUG:teuthology.orchestra.run.smithi071:> uname -r 2023-10-06T01:26:20.998 INFO:teuthology.orchestra.run.smithi071.stdout:4.18.0-425.3.1.el8.x86_64 2023-10-06T01:26:20.998 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-425.3.1.el8.x86_64 vs 4.18.0-425.3.1.el8.x86_64 2023-10-06T01:26:20.998 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-06T01:26:20.998 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-10-06T01:26:21.999 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-10-06T01:26:21.999 DEBUG:teuthology.orchestra.run.smithi071:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-06T01:26:22.104 INFO:teuthology.orchestra.run.smithi071.stdout:ttyS1 2023-10-06T01:26:22.118 DEBUG:teuthology.parallel:result is None 2023-10-06T01:26:22.995 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2023-10-06T01:26:22.996 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T01:26:24.259 DEBUG:teuthology.orchestra.run.smithi072:> true 2023-10-06T01:26:24.576 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi072.front.sepia.ceph.com' 2023-10-06T01:26:24.577 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "4.18.0-425.3.1.el8.x86_64"... 2023-10-06T01:26:24.577 DEBUG:teuthology.orchestra.run.smithi072:> uname -r 2023-10-06T01:26:24.592 INFO:teuthology.orchestra.run.smithi072.stdout:4.18.0-425.3.1.el8.x86_64 2023-10-06T01:26:24.592 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-425.3.1.el8.x86_64 vs 4.18.0-425.3.1.el8.x86_64 2023-10-06T01:26:24.592 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-06T01:26:24.593 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-10-06T01:26:25.593 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-10-06T01:26:25.594 DEBUG:teuthology.orchestra.run.smithi072:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-06T01:26:25.729 INFO:teuthology.orchestra.run.smithi072.stdout:ttyS1 2023-10-06T01:26:25.749 DEBUG:teuthology.parallel:result is None 2023-10-06T01:26:25.750 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-06T01:26:25.757 INFO:teuthology.task.internal:Creating test directory... 2023-10-06T01:26:25.757 DEBUG:teuthology.orchestra.run.smithi071:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-06T01:26:25.793 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-06T01:26:26.048 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-06T01:26:26.054 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-06T01:26:26.137 INFO:teuthology.task.internal:Creating archive directory... 2023-10-06T01:26:26.137 DEBUG:teuthology.orchestra.run.smithi071:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-06T01:26:26.140 DEBUG:teuthology.orchestra.run.smithi072:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-06T01:26:26.188 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-06T01:26:26.195 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-06T01:26:26.195 DEBUG:teuthology.orchestra.run.smithi071:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-06T01:26:26.205 DEBUG:teuthology.orchestra.run.smithi072:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-06T01:26:26.359 INFO:teuthology.orchestra.run.smithi072.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T01:26:26.373 INFO:teuthology.orchestra.run.smithi072.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T01:26:26.449 INFO:teuthology.orchestra.run.smithi071.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T01:26:26.461 INFO:teuthology.orchestra.run.smithi071.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T01:26:26.463 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-06T01:26:26.470 INFO:teuthology.task.internal:Configuring sudo... 2023-10-06T01:26:26.470 DEBUG:teuthology.orchestra.run.smithi071:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-06T01:26:26.472 DEBUG:teuthology.orchestra.run.smithi072:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-06T01:26:26.498 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-06T01:26:26.507 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-06T01:26:26.507 DEBUG:teuthology.orchestra.run.smithi071:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-06T01:26:26.539 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-06T01:26:26.555 DEBUG:teuthology.orchestra.run.smithi071:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T01:26:26.632 DEBUG:teuthology.orchestra.run.smithi071:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T01:26:26.802 DEBUG:teuthology.orchestra.run.smithi071:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T01:26:26.908 DEBUG:teuthology.orchestra.run.smithi071:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T01:26:26.931 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-10-06T01:26:26.931 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-06T01:26:26.995 DEBUG:teuthology.orchestra.run.smithi072:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T01:26:27.036 DEBUG:teuthology.orchestra.run.smithi072:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T01:26:27.114 DEBUG:teuthology.orchestra.run.smithi072:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T01:26:27.154 DEBUG:teuthology.orchestra.run.smithi072:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T01:26:27.194 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-06T01:26:27.194 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-06T01:26:27.286 DEBUG:teuthology.orchestra.run.smithi071:> sudo service rsyslog restart 2023-10-06T01:26:27.289 DEBUG:teuthology.orchestra.run.smithi072:> sudo service rsyslog restart 2023-10-06T01:26:27.346 INFO:teuthology.orchestra.run.smithi071.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-06T01:26:27.430 INFO:teuthology.orchestra.run.smithi072.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-06T01:26:27.690 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-06T01:26:27.698 INFO:teuthology.task.internal:Starting timer... 2023-10-06T01:26:27.699 INFO:teuthology.run_tasks:Running task pcp... 2023-10-06T01:26:27.708 INFO:teuthology.run_tasks:Running task selinux... 2023-10-06T01:26:27.717 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-10-06T01:26:27.717 DEBUG:teuthology.orchestra.run.smithi071:> sudo service auditd rotate 2023-10-06T01:26:27.797 INFO:teuthology.orchestra.run.smithi071.stdout:Rotating logs: [ OK ] 2023-10-06T01:26:27.799 DEBUG:teuthology.orchestra.run.smithi072:> sudo service auditd rotate 2023-10-06T01:26:27.923 INFO:teuthology.orchestra.run.smithi072.stdout:Rotating logs: [ OK ] 2023-10-06T01:26:27.924 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-06T01:26:27.925 DEBUG:teuthology.orchestra.run.smithi071:> /usr/sbin/getenforce 2023-10-06T01:26:27.944 INFO:teuthology.orchestra.run.smithi071.stdout:Permissive 2023-10-06T01:26:27.945 DEBUG:teuthology.orchestra.run.smithi072:> /usr/sbin/getenforce 2023-10-06T01:26:27.974 INFO:teuthology.orchestra.run.smithi072.stdout:Permissive 2023-10-06T01:26:27.974 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi071.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi072.front.sepia.ceph.com': 'permissive'} 2023-10-06T01:26:27.974 DEBUG:teuthology.orchestra.run.smithi071:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-06T01:26:28.010 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T01:26:28.010 DEBUG:teuthology.orchestra.run.smithi072:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-06T01:26:28.038 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T01:26:28.039 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-06T01:26:28.039 DEBUG:teuthology.orchestra.run.smithi071:> sudo /usr/sbin/setenforce permissive 2023-10-06T01:26:28.075 DEBUG:teuthology.orchestra.run.smithi072:> sudo /usr/sbin/setenforce permissive 2023-10-06T01:26:28.109 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-06T01:26:28.119 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-10-06T01:26:28.123 INFO:teuthology.repo_utils:Fetching main from origin 2023-10-06T01:26:28.230 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-06T01:26:28.245 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-06T01:26:28.246 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi071.front.sepia.ceph.com,smithi072.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-06T01:37:01.010 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi071.front.sepia.ceph.com'), Remote(name='ubuntu@smithi072.front.sepia.ceph.com')] 2023-10-06T01:37:01.011 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2023-10-06T01:37:01.012 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T01:37:01.082 DEBUG:teuthology.orchestra.run.smithi071:> true 2023-10-06T01:37:01.149 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi071.front.sepia.ceph.com' 2023-10-06T01:37:01.149 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2023-10-06T01:37:01.150 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T01:37:01.217 DEBUG:teuthology.orchestra.run.smithi072:> true 2023-10-06T01:37:01.281 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi072.front.sepia.ceph.com' 2023-10-06T01:37:01.282 INFO:teuthology.run_tasks:Running task clock... 2023-10-06T01:37:01.292 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-06T01:37:01.293 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-06T01:37:01.293 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T01:37:01.295 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-06T01:37:01.295 DEBUG:teuthology.orchestra.run.smithi072:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T01:37:01.322 INFO:teuthology.orchestra.run.smithi071.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-06T01:37:01.336 INFO:teuthology.orchestra.run.smithi071.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-06T01:37:01.350 INFO:teuthology.orchestra.run.smithi072.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-06T01:37:01.364 INFO:teuthology.orchestra.run.smithi072.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-06T01:37:01.368 INFO:teuthology.orchestra.run.smithi071.stderr:sudo: ntpd: command not found 2023-10-06T01:37:01.378 INFO:teuthology.orchestra.run.smithi071.stdout:506 Cannot talk to daemon 2023-10-06T01:37:01.392 INFO:teuthology.orchestra.run.smithi071.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-06T01:37:01.398 INFO:teuthology.orchestra.run.smithi072.stderr:sudo: ntpd: command not found 2023-10-06T01:37:01.405 INFO:teuthology.orchestra.run.smithi071.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-06T01:37:01.408 INFO:teuthology.orchestra.run.smithi072.stdout:506 Cannot talk to daemon 2023-10-06T01:37:01.421 INFO:teuthology.orchestra.run.smithi072.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-06T01:37:01.435 INFO:teuthology.orchestra.run.smithi072.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-06T01:37:01.482 INFO:teuthology.orchestra.run.smithi071.stderr:bash: ntpq: command not found 2023-10-06T01:37:01.485 INFO:teuthology.orchestra.run.smithi071.stdout:210 Number of sources = 4 2023-10-06T01:37:01.485 INFO:teuthology.orchestra.run.smithi071.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-06T01:37:01.485 INFO:teuthology.orchestra.run.smithi071.stdout:=============================================================================== 2023-10-06T01:37:01.486 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T01:37:01.486 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T01:37:01.486 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T01:37:01.486 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T01:37:01.501 INFO:teuthology.orchestra.run.smithi072.stderr:bash: ntpq: command not found 2023-10-06T01:37:01.503 INFO:teuthology.orchestra.run.smithi072.stdout:210 Number of sources = 4 2023-10-06T01:37:01.503 INFO:teuthology.orchestra.run.smithi072.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-06T01:37:01.503 INFO:teuthology.orchestra.run.smithi072.stdout:=============================================================================== 2023-10-06T01:37:01.504 INFO:teuthology.orchestra.run.smithi072.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T01:37:01.504 INFO:teuthology.orchestra.run.smithi072.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T01:37:01.504 INFO:teuthology.orchestra.run.smithi072.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T01:37:01.504 INFO:teuthology.orchestra.run.smithi072.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T01:37:01.505 INFO:teuthology.run_tasks:Running task install... 2023-10-06T01:37:01.513 DEBUG:teuthology.task.install:project ceph 2023-10-06T01:37:01.513 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2'}} 2023-10-06T01:37:01.513 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2'} 2023-10-06T01:37:01.513 INFO:teuthology.task.install:Using flavor: default 2023-10-06T01:37:01.519 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-06T01:37:01.519 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-10-06T01:37:01.519 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2', 'tag': None, 'wait_for_package': False} 2023-10-06T01:37:01.520 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 2023-10-06T01:37:01.521 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2', 'tag': None, 'wait_for_package': False} 2023-10-06T01:37:01.521 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 2023-10-06T01:37:01.773 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/ 2023-10-06T01:37:01.773 INFO:teuthology.task.install.rpm:Package version is 17.2.6-1296.g736ac5ba 2023-10-06T01:37:01.794 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/ 2023-10-06T01:37:01.795 INFO:teuthology.task.install.rpm:Package version is 17.2.6-1296.g736ac5ba 2023-10-06T01:37:02.073 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-06T01:37:02.073 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-06T01:37:02.073 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-06T01:37:02.100 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-10-06T01:37:02.100 DEBUG:teuthology.orchestra.run.smithi072:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-06T01:37:02.135 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-06T01:37:02.135 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-10-06T01:37:02.135 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-06T01:37:02.160 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-10-06T01:37:02.161 DEBUG:teuthology.orchestra.run.smithi071:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-06T01:37:02.166 DEBUG:teuthology.orchestra.run.smithi072:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-06T01:37:02.225 DEBUG:teuthology.orchestra.run.smithi071:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-06T01:37:02.242 DEBUG:teuthology.orchestra.run.smithi072:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-06T01:37:02.299 DEBUG:teuthology.orchestra.run.smithi071:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-06T01:37:02.305 INFO:teuthology.orchestra.run.smithi072.stdout:check_obsoletes = 1 2023-10-06T01:37:02.306 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum clean all 2023-10-06T01:37:02.363 INFO:teuthology.orchestra.run.smithi071.stdout:check_obsoletes = 1 2023-10-06T01:37:02.364 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum clean all 2023-10-06T01:37:02.694 INFO:teuthology.orchestra.run.smithi072.stdout:Updating Subscription Management repositories. 2023-10-06T01:37:02.750 INFO:teuthology.orchestra.run.smithi071.stdout:Updating Subscription Management repositories. 2023-10-06T01:37:03.137 INFO:teuthology.orchestra.run.smithi072.stdout:44 files removed 2023-10-06T01:37:03.187 INFO:teuthology.orchestra.run.smithi071.stdout:44 files removed 2023-10-06T01:37:03.194 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-10-06T01:37:03.243 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-10-06T01:37:03.541 INFO:teuthology.orchestra.run.smithi072.stdout:Updating Subscription Management repositories. 2023-10-06T01:37:03.592 INFO:teuthology.orchestra.run.smithi071.stdout:Updating Subscription Management repositories. 2023-10-06T01:37:04.725 INFO:teuthology.orchestra.run.smithi072.stdout:ceph packages for x86_64 117 kB/s | 78 kB 00:00 2023-10-06T01:37:04.940 INFO:teuthology.orchestra.run.smithi071.stdout:ceph packages for x86_64 96 kB/s | 78 kB 00:00 2023-10-06T01:37:05.473 INFO:teuthology.orchestra.run.smithi072.stdout:ceph noarch packages 13 kB/s | 9.2 kB 00:00 2023-10-06T01:37:05.689 INFO:teuthology.orchestra.run.smithi071.stdout:ceph noarch packages 13 kB/s | 9.2 kB 00:00 2023-10-06T01:37:06.118 INFO:teuthology.orchestra.run.smithi072.stdout:ceph source packages 2.4 kB/s | 1.4 kB 00:00 2023-10-06T01:37:06.140 INFO:teuthology.orchestra.run.smithi071.stdout:ceph source packages 3.4 kB/s | 1.4 kB 00:00 2023-10-06T01:37:06.315 INFO:teuthology.orchestra.run.smithi072.stdout:Copr repo for python3-asyncssh owned by ceph 21 kB/s | 3.5 kB 00:00 2023-10-06T01:37:06.321 INFO:teuthology.orchestra.run.smithi071.stdout:Copr repo for python3-asyncssh owned by ceph 23 kB/s | 3.5 kB 00:00 2023-10-06T01:37:08.630 INFO:teuthology.orchestra.run.smithi071.stdout:Extra Packages for Enterprise Linux 7.0 MB/s | 16 MB 00:02 2023-10-06T01:37:09.038 INFO:teuthology.orchestra.run.smithi072.stdout:Extra Packages for Enterprise Linux 5.9 MB/s | 16 MB 00:02 2023-10-06T01:37:11.858 INFO:teuthology.orchestra.run.smithi071.stdout:lab-extras 4.1 MB/s | 24 kB 00:00 2023-10-06T01:37:12.256 INFO:teuthology.orchestra.run.smithi071.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 104 MB/s | 33 MB 00:00 2023-10-06T01:37:12.269 INFO:teuthology.orchestra.run.smithi072.stdout:lab-extras 4.1 MB/s | 24 kB 00:00 2023-10-06T01:37:12.674 INFO:teuthology.orchestra.run.smithi072.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 118 MB/s | 38 MB 00:00 2023-10-06T01:37:17.391 INFO:teuthology.orchestra.run.smithi071.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 123 MB/s | 38 MB 00:00 2023-10-06T01:37:18.327 INFO:teuthology.orchestra.run.smithi072.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 119 MB/s | 33 MB 00:00 2023-10-06T01:37:25.675 INFO:teuthology.orchestra.run.smithi071.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-06T01:37:25.676 INFO:teuthology.orchestra.run.smithi071.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-06T01:37:25.687 INFO:teuthology.orchestra.run.smithi071.stdout:Package NetworkManager-1:1.30.0-13.el8_4.x86_64 is already installed. 2023-10-06T01:37:25.688 INFO:teuthology.orchestra.run.smithi071.stdout:Package iproute-5.9.0-4.el8.x86_64 is already installed. 2023-10-06T01:37:25.688 INFO:teuthology.orchestra.run.smithi071.stdout:Package util-linux-2.32.1-27.el8.x86_64 is already installed. 2023-10-06T01:37:25.689 INFO:teuthology.orchestra.run.smithi071.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-06T01:37:25.691 INFO:teuthology.orchestra.run.smithi071.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-06T01:37:25.694 INFO:teuthology.orchestra.run.smithi071.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2023-10-06T01:37:25.694 INFO:teuthology.orchestra.run.smithi071.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2023-10-06T01:37:26.171 INFO:teuthology.orchestra.run.smithi072.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-06T01:37:26.171 INFO:teuthology.orchestra.run.smithi072.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-06T01:37:26.182 INFO:teuthology.orchestra.run.smithi072.stdout:Package NetworkManager-1:1.30.0-13.el8_4.x86_64 is already installed. 2023-10-06T01:37:26.183 INFO:teuthology.orchestra.run.smithi072.stdout:Package iproute-5.9.0-4.el8.x86_64 is already installed. 2023-10-06T01:37:26.183 INFO:teuthology.orchestra.run.smithi072.stdout:Package util-linux-2.32.1-27.el8.x86_64 is already installed. 2023-10-06T01:37:26.184 INFO:teuthology.orchestra.run.smithi072.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-06T01:37:26.186 INFO:teuthology.orchestra.run.smithi072.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-06T01:37:26.188 INFO:teuthology.orchestra.run.smithi072.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2023-10-06T01:37:26.189 INFO:teuthology.orchestra.run.smithi072.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2023-10-06T01:37:26.190 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2023-10-06T01:37:26.201 INFO:teuthology.orchestra.run.smithi071.stdout:====================================================================================================================== 2023-10-06T01:37:26.201 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repository Size 2023-10-06T01:37:26.202 INFO:teuthology.orchestra.run.smithi071.stdout:====================================================================================================================== 2023-10-06T01:37:26.202 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2023-10-06T01:37:26.202 INFO:teuthology.orchestra.run.smithi071.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-06T01:37:26.202 INFO:teuthology.orchestra.run.smithi071.stdout: ceph x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 6.4 k 2023-10-06T01:37:26.202 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-base x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 5.2 M 2023-10-06T01:37:26.202 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-fuse x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 876 k 2023-10-06T01:37:26.202 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-immutable-object-cache x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 162 k 2023-10-06T01:37:26.202 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 1.6 M 2023-10-06T01:37:26.202 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-cephadm noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 121 k 2023-10-06T01:37:26.202 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-dashboard noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 1.7 M 2023-10-06T01:37:26.202 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 7.4 M 2023-10-06T01:37:26.203 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-rook noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 47 k 2023-10-06T01:37:26.203 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-radosgw x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 17 M 2023-10-06T01:37:26.203 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-test x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 52 M 2023-10-06T01:37:26.203 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-volume noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 267 k 2023-10-06T01:37:26.203 INFO:teuthology.orchestra.run.smithi071.stdout: cephadm noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 80 k 2023-10-06T01:37:26.203 INFO:teuthology.orchestra.run.smithi071.stdout: cephfs-mirror x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 255 k 2023-10-06T01:37:26.203 INFO:teuthology.orchestra.run.smithi071.stdout: cephfs-top noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 18 k 2023-10-06T01:37:26.203 INFO:teuthology.orchestra.run.smithi071.stdout: elfutils-libelf-devel x86_64 0.182-3.el8 rhel-8-for-x86_64-baseos-rpms 59 k 2023-10-06T01:37:26.203 INFO:teuthology.orchestra.run.smithi071.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-06T01:37:26.203 INFO:teuthology.orchestra.run.smithi071.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-06T01:37:26.203 INFO:teuthology.orchestra.run.smithi071.stdout: libcephfs-devel x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 25 k 2023-10-06T01:37:26.203 INFO:teuthology.orchestra.run.smithi071.stdout: libcephfs2 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 797 k 2023-10-06T01:37:26.204 INFO:teuthology.orchestra.run.smithi071.stdout: librados-devel x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 130 k 2023-10-06T01:37:26.204 INFO:teuthology.orchestra.run.smithi071.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-06T01:37:26.204 INFO:teuthology.orchestra.run.smithi071.stdout: libuuid-devel x86_64 2.32.1-27.el8 rhel-8-for-x86_64-baseos-rpms 97 k 2023-10-06T01:37:26.204 INFO:teuthology.orchestra.run.smithi071.stdout: openssl-devel x86_64 1:1.1.1g-15.el8_3 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-06T01:37:26.204 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cephfs x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 190 k 2023-10-06T01:37:26.204 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rados x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 371 k 2023-10-06T01:37:26.204 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rbd x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 358 k 2023-10-06T01:37:26.204 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rgw x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 107 k 2023-10-06T01:37:26.204 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-fuse x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 90 k 2023-10-06T01:37:26.204 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-mirror x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.5 M 2023-10-06T01:37:26.204 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-nbd x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 173 k 2023-10-06T01:37:26.205 INFO:teuthology.orchestra.run.smithi071.stdout: xfsprogs-devel x86_64 5.0.0-8.el8 rhel-8-for-x86_64-baseos-rpms 70 k 2023-10-06T01:37:26.205 INFO:teuthology.orchestra.run.smithi071.stdout:Upgrading: 2023-10-06T01:37:26.205 INFO:teuthology.orchestra.run.smithi071.stdout: librados2 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.5 M 2023-10-06T01:37:26.205 INFO:teuthology.orchestra.run.smithi071.stdout: librbd1 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.6 M 2023-10-06T01:37:26.205 INFO:teuthology.orchestra.run.smithi071.stdout:Installing dependencies: 2023-10-06T01:37:26.205 INFO:teuthology.orchestra.run.smithi071.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-06T01:37:26.205 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-common x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 23 M 2023-10-06T01:37:26.205 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-grafana-dashboards noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 23 k 2023-10-06T01:37:26.205 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mds x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 2.3 M 2023-10-06T01:37:26.205 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-modules-core noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 238 k 2023-10-06T01:37:26.205 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mon x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.9 M 2023-10-06T01:37:26.206 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-osd x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 17 M 2023-10-06T01:37:26.206 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-prometheus-alerts noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 14 k 2023-10-06T01:37:26.206 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-selinux x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 24 k 2023-10-06T01:37:26.206 INFO:teuthology.orchestra.run.smithi071.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-06T01:37:26.206 INFO:teuthology.orchestra.run.smithi071.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-06T01:37:26.206 INFO:teuthology.orchestra.run.smithi071.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2023-10-06T01:37:26.206 INFO:teuthology.orchestra.run.smithi071.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-06T01:37:26.206 INFO:teuthology.orchestra.run.smithi071.stdout: krb5-devel x86_64 1.18.2-8.3.el8_4 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-06T01:37:26.206 INFO:teuthology.orchestra.run.smithi071.stdout: libcephsqlite x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 174 k 2023-10-06T01:37:26.206 INFO:teuthology.orchestra.run.smithi071.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2023-10-06T01:37:26.206 INFO:teuthology.orchestra.run.smithi071.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2023-10-06T01:37:26.207 INFO:teuthology.orchestra.run.smithi071.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-06T01:37:26.207 INFO:teuthology.orchestra.run.smithi071.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2023-10-06T01:37:26.207 INFO:teuthology.orchestra.run.smithi071.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-06T01:37:26.207 INFO:teuthology.orchestra.run.smithi071.stdout: libradosstriper1 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 507 k 2023-10-06T01:37:26.207 INFO:teuthology.orchestra.run.smithi071.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2023-10-06T01:37:26.207 INFO:teuthology.orchestra.run.smithi071.stdout: librgw2 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 5.6 M 2023-10-06T01:37:26.207 INFO:teuthology.orchestra.run.smithi071.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-06T01:37:26.207 INFO:teuthology.orchestra.run.smithi071.stdout: libsepol-devel x86_64 2.9-2.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2023-10-06T01:37:26.207 INFO:teuthology.orchestra.run.smithi071.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-06T01:37:26.207 INFO:teuthology.orchestra.run.smithi071.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-06T01:37:26.207 INFO:teuthology.orchestra.run.smithi071.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-06T01:37:26.207 INFO:teuthology.orchestra.run.smithi071.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-06T01:37:26.208 INFO:teuthology.orchestra.run.smithi071.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2023-10-06T01:37:26.208 INFO:teuthology.orchestra.run.smithi071.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-06T01:37:26.208 INFO:teuthology.orchestra.run.smithi071.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-06T01:37:26.208 INFO:teuthology.orchestra.run.smithi071.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-06T01:37:26.208 INFO:teuthology.orchestra.run.smithi071.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-06T01:37:26.208 INFO:teuthology.orchestra.run.smithi071.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-06T01:37:26.208 INFO:teuthology.orchestra.run.smithi071.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-06T01:37:26.208 INFO:teuthology.orchestra.run.smithi071.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-06T01:37:26.208 INFO:teuthology.orchestra.run.smithi071.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-06T01:37:26.208 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-06T01:37:26.208 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ceph-argparse x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 45 k 2023-10-06T01:37:26.209 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ceph-common x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 115 k 2023-10-06T01:37:26.209 INFO:teuthology.orchestra.run.smithi071.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-06T01:37:26.209 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-06T01:37:26.209 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-06T01:37:26.209 INFO:teuthology.orchestra.run.smithi071.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-06T01:37:26.209 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-06T01:37:26.209 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-06T01:37:26.209 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-06T01:37:26.209 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-06T01:37:26.209 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-06T01:37:26.209 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-06T01:37:26.210 INFO:teuthology.orchestra.run.smithi071.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-06T01:37:26.210 INFO:teuthology.orchestra.run.smithi071.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-06T01:37:26.210 INFO:teuthology.orchestra.run.smithi071.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-06T01:37:26.210 INFO:teuthology.orchestra.run.smithi071.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-06T01:37:26.210 INFO:teuthology.orchestra.run.smithi071.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-06T01:37:26.210 INFO:teuthology.orchestra.run.smithi071.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-06T01:37:26.210 INFO:teuthology.orchestra.run.smithi071.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-06T01:37:26.210 INFO:teuthology.orchestra.run.smithi071.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-06T01:37:26.210 INFO:teuthology.orchestra.run.smithi071.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-06T01:37:26.210 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-06T01:37:26.210 INFO:teuthology.orchestra.run.smithi071.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-06T01:37:26.210 INFO:teuthology.orchestra.run.smithi071.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-06T01:37:26.211 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-06T01:37:26.211 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-06T01:37:26.211 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-06T01:37:26.211 INFO:teuthology.orchestra.run.smithi071.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-06T01:37:26.211 INFO:teuthology.orchestra.run.smithi071.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-06T01:37:26.211 INFO:teuthology.orchestra.run.smithi071.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-06T01:37:26.211 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-06T01:37:26.211 INFO:teuthology.orchestra.run.smithi071.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2023-10-06T01:37:26.211 INFO:teuthology.orchestra.run.smithi071.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-06T01:37:26.211 INFO:teuthology.orchestra.run.smithi071.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-06T01:37:26.211 INFO:teuthology.orchestra.run.smithi071.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-06T01:37:26.211 INFO:teuthology.orchestra.run.smithi071.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-06T01:37:26.212 INFO:teuthology.orchestra.run.smithi071.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-06T01:37:26.212 INFO:teuthology.orchestra.run.smithi071.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-06T01:37:26.212 INFO:teuthology.orchestra.run.smithi071.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-06T01:37:26.212 INFO:teuthology.orchestra.run.smithi071.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-06T01:37:26.212 INFO:teuthology.orchestra.run.smithi071.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-06T01:37:26.212 INFO:teuthology.orchestra.run.smithi071.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-06T01:37:26.212 INFO:teuthology.orchestra.run.smithi071.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2023-10-06T01:37:26.212 INFO:teuthology.orchestra.run.smithi071.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-06T01:37:26.212 INFO:teuthology.orchestra.run.smithi071.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-06T01:37:26.212 INFO:teuthology.orchestra.run.smithi071.stdout: zlib-devel x86_64 1.2.11-17.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-06T01:37:26.212 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:37:26.213 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2023-10-06T01:37:26.213 INFO:teuthology.orchestra.run.smithi071.stdout:====================================================================================================================== 2023-10-06T01:37:26.213 INFO:teuthology.orchestra.run.smithi071.stdout:Install 118 Packages 2023-10-06T01:37:26.213 INFO:teuthology.orchestra.run.smithi071.stdout:Upgrade 2 Packages 2023-10-06T01:37:26.213 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:37:26.213 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 201 M 2023-10-06T01:37:26.214 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2023-10-06T01:37:26.670 INFO:teuthology.orchestra.run.smithi072.stdout:Dependencies resolved. 2023-10-06T01:37:26.681 INFO:teuthology.orchestra.run.smithi072.stdout:====================================================================================================================== 2023-10-06T01:37:26.681 INFO:teuthology.orchestra.run.smithi072.stdout: Package Arch Version Repository Size 2023-10-06T01:37:26.682 INFO:teuthology.orchestra.run.smithi072.stdout:====================================================================================================================== 2023-10-06T01:37:26.682 INFO:teuthology.orchestra.run.smithi072.stdout:Installing: 2023-10-06T01:37:26.682 INFO:teuthology.orchestra.run.smithi072.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-06T01:37:26.682 INFO:teuthology.orchestra.run.smithi072.stdout: ceph x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 6.4 k 2023-10-06T01:37:26.682 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-base x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 5.2 M 2023-10-06T01:37:26.682 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-fuse x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 876 k 2023-10-06T01:37:26.682 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-immutable-object-cache x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 162 k 2023-10-06T01:37:26.682 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 1.6 M 2023-10-06T01:37:26.682 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-cephadm noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 121 k 2023-10-06T01:37:26.682 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-dashboard noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 1.7 M 2023-10-06T01:37:26.682 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 7.4 M 2023-10-06T01:37:26.683 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-rook noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 47 k 2023-10-06T01:37:26.683 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-radosgw x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 17 M 2023-10-06T01:37:26.683 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-test x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 52 M 2023-10-06T01:37:26.683 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-volume noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 267 k 2023-10-06T01:37:26.683 INFO:teuthology.orchestra.run.smithi072.stdout: cephadm noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 80 k 2023-10-06T01:37:26.683 INFO:teuthology.orchestra.run.smithi072.stdout: cephfs-mirror x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 255 k 2023-10-06T01:37:26.683 INFO:teuthology.orchestra.run.smithi072.stdout: cephfs-top noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 18 k 2023-10-06T01:37:26.683 INFO:teuthology.orchestra.run.smithi072.stdout: elfutils-libelf-devel x86_64 0.182-3.el8 rhel-8-for-x86_64-baseos-rpms 59 k 2023-10-06T01:37:26.683 INFO:teuthology.orchestra.run.smithi072.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-06T01:37:26.683 INFO:teuthology.orchestra.run.smithi072.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-06T01:37:26.683 INFO:teuthology.orchestra.run.smithi072.stdout: libcephfs-devel x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 25 k 2023-10-06T01:37:26.683 INFO:teuthology.orchestra.run.smithi072.stdout: libcephfs2 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 797 k 2023-10-06T01:37:26.684 INFO:teuthology.orchestra.run.smithi072.stdout: librados-devel x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 130 k 2023-10-06T01:37:26.684 INFO:teuthology.orchestra.run.smithi072.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-06T01:37:26.684 INFO:teuthology.orchestra.run.smithi072.stdout: libuuid-devel x86_64 2.32.1-27.el8 rhel-8-for-x86_64-baseos-rpms 97 k 2023-10-06T01:37:26.684 INFO:teuthology.orchestra.run.smithi072.stdout: openssl-devel x86_64 1:1.1.1g-15.el8_3 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-06T01:37:26.684 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cephfs x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 190 k 2023-10-06T01:37:26.684 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rados x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 371 k 2023-10-06T01:37:26.684 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rbd x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 358 k 2023-10-06T01:37:26.684 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rgw x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 107 k 2023-10-06T01:37:26.684 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-fuse x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 90 k 2023-10-06T01:37:26.684 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-mirror x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.5 M 2023-10-06T01:37:26.684 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-nbd x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 173 k 2023-10-06T01:37:26.685 INFO:teuthology.orchestra.run.smithi072.stdout: xfsprogs-devel x86_64 5.0.0-8.el8 rhel-8-for-x86_64-baseos-rpms 70 k 2023-10-06T01:37:26.685 INFO:teuthology.orchestra.run.smithi072.stdout:Upgrading: 2023-10-06T01:37:26.685 INFO:teuthology.orchestra.run.smithi072.stdout: librados2 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.5 M 2023-10-06T01:37:26.685 INFO:teuthology.orchestra.run.smithi072.stdout: librbd1 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.6 M 2023-10-06T01:37:26.685 INFO:teuthology.orchestra.run.smithi072.stdout:Installing dependencies: 2023-10-06T01:37:26.685 INFO:teuthology.orchestra.run.smithi072.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-06T01:37:26.685 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-common x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 23 M 2023-10-06T01:37:26.685 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-grafana-dashboards noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 23 k 2023-10-06T01:37:26.686 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mds x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 2.3 M 2023-10-06T01:37:26.686 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-modules-core noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 238 k 2023-10-06T01:37:26.686 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mon x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.9 M 2023-10-06T01:37:26.686 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-osd x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 17 M 2023-10-06T01:37:26.686 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-prometheus-alerts noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 14 k 2023-10-06T01:37:26.686 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-selinux x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 24 k 2023-10-06T01:37:26.686 INFO:teuthology.orchestra.run.smithi072.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-06T01:37:26.686 INFO:teuthology.orchestra.run.smithi072.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-06T01:37:26.686 INFO:teuthology.orchestra.run.smithi072.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2023-10-06T01:37:26.686 INFO:teuthology.orchestra.run.smithi072.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-06T01:37:26.686 INFO:teuthology.orchestra.run.smithi072.stdout: krb5-devel x86_64 1.18.2-8.3.el8_4 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-06T01:37:26.687 INFO:teuthology.orchestra.run.smithi072.stdout: libcephsqlite x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 174 k 2023-10-06T01:37:26.687 INFO:teuthology.orchestra.run.smithi072.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2023-10-06T01:37:26.687 INFO:teuthology.orchestra.run.smithi072.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2023-10-06T01:37:26.687 INFO:teuthology.orchestra.run.smithi072.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-06T01:37:26.687 INFO:teuthology.orchestra.run.smithi072.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2023-10-06T01:37:26.687 INFO:teuthology.orchestra.run.smithi072.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-06T01:37:26.687 INFO:teuthology.orchestra.run.smithi072.stdout: libradosstriper1 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 507 k 2023-10-06T01:37:26.687 INFO:teuthology.orchestra.run.smithi072.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2023-10-06T01:37:26.687 INFO:teuthology.orchestra.run.smithi072.stdout: librgw2 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 5.6 M 2023-10-06T01:37:26.687 INFO:teuthology.orchestra.run.smithi072.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-06T01:37:26.687 INFO:teuthology.orchestra.run.smithi072.stdout: libsepol-devel x86_64 2.9-2.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2023-10-06T01:37:26.687 INFO:teuthology.orchestra.run.smithi072.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-06T01:37:26.688 INFO:teuthology.orchestra.run.smithi072.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-06T01:37:26.688 INFO:teuthology.orchestra.run.smithi072.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-06T01:37:26.688 INFO:teuthology.orchestra.run.smithi072.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-06T01:37:26.688 INFO:teuthology.orchestra.run.smithi072.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2023-10-06T01:37:26.688 INFO:teuthology.orchestra.run.smithi072.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-06T01:37:26.688 INFO:teuthology.orchestra.run.smithi072.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-06T01:37:26.688 INFO:teuthology.orchestra.run.smithi072.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-06T01:37:26.688 INFO:teuthology.orchestra.run.smithi072.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-06T01:37:26.688 INFO:teuthology.orchestra.run.smithi072.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-06T01:37:26.688 INFO:teuthology.orchestra.run.smithi072.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-06T01:37:26.688 INFO:teuthology.orchestra.run.smithi072.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-06T01:37:26.689 INFO:teuthology.orchestra.run.smithi072.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-06T01:37:26.689 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-06T01:37:26.689 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ceph-argparse x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 45 k 2023-10-06T01:37:26.689 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ceph-common x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 115 k 2023-10-06T01:37:26.689 INFO:teuthology.orchestra.run.smithi072.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-06T01:37:26.689 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-06T01:37:26.689 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-06T01:37:26.689 INFO:teuthology.orchestra.run.smithi072.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-06T01:37:26.689 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-06T01:37:26.689 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-06T01:37:26.690 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-06T01:37:26.690 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-06T01:37:26.690 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-06T01:37:26.690 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-06T01:37:26.690 INFO:teuthology.orchestra.run.smithi072.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-06T01:37:26.690 INFO:teuthology.orchestra.run.smithi072.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-06T01:37:26.690 INFO:teuthology.orchestra.run.smithi072.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-06T01:37:26.690 INFO:teuthology.orchestra.run.smithi072.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-06T01:37:26.690 INFO:teuthology.orchestra.run.smithi072.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-06T01:37:26.690 INFO:teuthology.orchestra.run.smithi072.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-06T01:37:26.690 INFO:teuthology.orchestra.run.smithi072.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-06T01:37:26.691 INFO:teuthology.orchestra.run.smithi072.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-06T01:37:26.691 INFO:teuthology.orchestra.run.smithi072.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-06T01:37:26.691 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-06T01:37:26.691 INFO:teuthology.orchestra.run.smithi072.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-06T01:37:26.691 INFO:teuthology.orchestra.run.smithi072.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-06T01:37:26.691 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-06T01:37:26.691 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-06T01:37:26.691 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-06T01:37:26.691 INFO:teuthology.orchestra.run.smithi072.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-06T01:37:26.691 INFO:teuthology.orchestra.run.smithi072.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-06T01:37:26.692 INFO:teuthology.orchestra.run.smithi072.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-06T01:37:26.692 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-06T01:37:26.692 INFO:teuthology.orchestra.run.smithi072.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2023-10-06T01:37:26.692 INFO:teuthology.orchestra.run.smithi072.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-06T01:37:26.692 INFO:teuthology.orchestra.run.smithi072.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-06T01:37:26.692 INFO:teuthology.orchestra.run.smithi072.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-06T01:37:26.692 INFO:teuthology.orchestra.run.smithi072.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-06T01:37:26.692 INFO:teuthology.orchestra.run.smithi072.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-06T01:37:26.692 INFO:teuthology.orchestra.run.smithi072.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-06T01:37:26.692 INFO:teuthology.orchestra.run.smithi072.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-06T01:37:26.692 INFO:teuthology.orchestra.run.smithi072.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-06T01:37:26.692 INFO:teuthology.orchestra.run.smithi072.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-06T01:37:26.693 INFO:teuthology.orchestra.run.smithi072.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-06T01:37:26.693 INFO:teuthology.orchestra.run.smithi072.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2023-10-06T01:37:26.693 INFO:teuthology.orchestra.run.smithi072.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-06T01:37:26.693 INFO:teuthology.orchestra.run.smithi072.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-06T01:37:26.693 INFO:teuthology.orchestra.run.smithi072.stdout: zlib-devel x86_64 1.2.11-17.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-06T01:37:26.693 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-06T01:37:26.693 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction Summary 2023-10-06T01:37:26.693 INFO:teuthology.orchestra.run.smithi072.stdout:====================================================================================================================== 2023-10-06T01:37:26.693 INFO:teuthology.orchestra.run.smithi072.stdout:Install 118 Packages 2023-10-06T01:37:26.693 INFO:teuthology.orchestra.run.smithi072.stdout:Upgrade 2 Packages 2023-10-06T01:37:26.693 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-06T01:37:26.694 INFO:teuthology.orchestra.run.smithi072.stdout:Total download size: 201 M 2023-10-06T01:37:26.694 INFO:teuthology.orchestra.run.smithi072.stdout:Downloading Packages: 2023-10-06T01:37:26.841 INFO:teuthology.orchestra.run.smithi071.stdout:(1/120): ceph-17.2.6-1296.g736ac5ba.el8.x86_64. 37 kB/s | 6.4 kB 00:00 2023-10-06T01:37:26.902 INFO:teuthology.orchestra.run.smithi072.stdout:(1/120): ceph-17.2.6-1296.g736ac5ba.el8.x86_64. 36 kB/s | 6.4 kB 00:00 2023-10-06T01:37:27.623 INFO:teuthology.orchestra.run.smithi071.stdout:(2/120): ceph-fuse-17.2.6-1296.g736ac5ba.el8.x8 1.1 MB/s | 876 kB 00:00 2023-10-06T01:37:27.754 INFO:teuthology.orchestra.run.smithi072.stdout:(2/120): ceph-fuse-17.2.6-1296.g736ac5ba.el8.x8 1.0 MB/s | 876 kB 00:00 2023-10-06T01:37:27.764 INFO:teuthology.orchestra.run.smithi071.stdout:(3/120): ceph-immutable-object-cache-17.2.6-129 1.1 MB/s | 162 kB 00:00 2023-10-06T01:37:28.165 INFO:teuthology.orchestra.run.smithi072.stdout:(3/120): ceph-immutable-object-cache-17.2.6-129 393 kB/s | 162 kB 00:00 2023-10-06T01:37:28.797 INFO:teuthology.orchestra.run.smithi071.stdout:(4/120): ceph-mds-17.2.6-1296.g736ac5ba.el8.x86 2.2 MB/s | 2.3 MB 00:01 2023-10-06T01:37:29.292 INFO:teuthology.orchestra.run.smithi071.stdout:(5/120): ceph-mgr-17.2.6-1296.g736ac5ba.el8.x86 3.2 MB/s | 1.6 MB 00:00 2023-10-06T01:37:29.327 INFO:teuthology.orchestra.run.smithi072.stdout:(4/120): ceph-base-17.2.6-1296.g736ac5ba.el8.x8 2.0 MB/s | 5.2 MB 00:02 2023-10-06T01:37:29.849 INFO:teuthology.orchestra.run.smithi072.stdout:(5/120): ceph-mgr-17.2.6-1296.g736ac5ba.el8.x86 3.0 MB/s | 1.6 MB 00:00 2023-10-06T01:37:29.856 INFO:teuthology.orchestra.run.smithi072.stdout:(6/120): ceph-mds-17.2.6-1296.g736ac5ba.el8.x86 1.4 MB/s | 2.3 MB 00:01 2023-10-06T01:37:30.008 INFO:teuthology.orchestra.run.smithi071.stdout:(6/120): ceph-mon-17.2.6-1296.g736ac5ba.el8.x86 5.5 MB/s | 3.9 MB 00:00 2023-10-06T01:37:30.977 INFO:teuthology.orchestra.run.smithi072.stdout:(7/120): ceph-mon-17.2.6-1296.g736ac5ba.el8.x86 3.5 MB/s | 3.9 MB 00:01 2023-10-06T01:37:32.666 INFO:teuthology.orchestra.run.smithi071.stdout:(7/120): ceph-osd-17.2.6-1296.g736ac5ba.el8.x86 6.3 MB/s | 17 MB 00:02 2023-10-06T01:37:34.300 INFO:teuthology.orchestra.run.smithi071.stdout:(8/120): ceph-base-17.2.6-1296.g736ac5ba.el8.x8 693 kB/s | 5.2 MB 00:07 2023-10-06T01:37:34.392 INFO:teuthology.orchestra.run.smithi071.stdout:(9/120): ceph-selinux-17.2.6-1296.g736ac5ba.el8 263 kB/s | 24 kB 00:00 2023-10-06T01:37:35.636 INFO:teuthology.orchestra.run.smithi072.stdout:(8/120): ceph-radosgw-17.2.6-1296.g736ac5ba.el8 3.6 MB/s | 17 MB 00:04 2023-10-06T01:37:35.685 INFO:teuthology.orchestra.run.smithi072.stdout:(9/120): ceph-selinux-17.2.6-1296.g736ac5ba.el8 493 kB/s | 24 kB 00:00 2023-10-06T01:37:36.040 INFO:teuthology.orchestra.run.smithi071.stdout:(10/120): ceph-radosgw-17.2.6-1296.g736ac5ba.el 5.0 MB/s | 17 MB 00:03 2023-10-06T01:37:36.087 INFO:teuthology.orchestra.run.smithi071.stdout:(11/120): cephfs-mirror-17.2.6-1296.g736ac5ba.e 5.4 MB/s | 255 kB 00:00 2023-10-06T01:37:36.122 INFO:teuthology.orchestra.run.smithi071.stdout:(12/120): libcephfs-devel-17.2.6-1296.g736ac5ba 717 kB/s | 25 kB 00:00 2023-10-06T01:37:36.257 INFO:teuthology.orchestra.run.smithi071.stdout:(13/120): libcephfs2-17.2.6-1296.g736ac5ba.el8. 5.8 MB/s | 797 kB 00:00 2023-10-06T01:37:36.300 INFO:teuthology.orchestra.run.smithi071.stdout:(14/120): libcephsqlite-17.2.6-1296.g736ac5ba.e 4.0 MB/s | 174 kB 00:00 2023-10-06T01:37:36.341 INFO:teuthology.orchestra.run.smithi071.stdout:(15/120): librados-devel-17.2.6-1296.g736ac5ba. 3.2 MB/s | 130 kB 00:00 2023-10-06T01:37:36.431 INFO:teuthology.orchestra.run.smithi071.stdout:(16/120): libradosstriper1-17.2.6-1296.g736ac5b 5.5 MB/s | 507 kB 00:00 2023-10-06T01:37:37.285 INFO:teuthology.orchestra.run.smithi071.stdout:(17/120): librgw2-17.2.6-1296.g736ac5ba.el8.x86 6.5 MB/s | 5.6 MB 00:00 2023-10-06T01:37:37.325 INFO:teuthology.orchestra.run.smithi071.stdout:(18/120): python3-ceph-argparse-17.2.6-1296.g73 1.1 MB/s | 45 kB 00:00 2023-10-06T01:37:37.370 INFO:teuthology.orchestra.run.smithi071.stdout:(19/120): python3-ceph-common-17.2.6-1296.g736a 2.5 MB/s | 115 kB 00:00 2023-10-06T01:37:37.420 INFO:teuthology.orchestra.run.smithi071.stdout:(20/120): python3-cephfs-17.2.6-1296.g736ac5ba. 3.7 MB/s | 190 kB 00:00 2023-10-06T01:37:37.519 INFO:teuthology.orchestra.run.smithi071.stdout:(21/120): python3-rados-17.2.6-1296.g736ac5ba.e 3.7 MB/s | 371 kB 00:00 2023-10-06T01:37:37.621 INFO:teuthology.orchestra.run.smithi071.stdout:(22/120): python3-rbd-17.2.6-1296.g736ac5ba.el8 3.5 MB/s | 358 kB 00:00 2023-10-06T01:37:37.666 INFO:teuthology.orchestra.run.smithi071.stdout:(23/120): python3-rgw-17.2.6-1296.g736ac5ba.el8 2.3 MB/s | 107 kB 00:00 2023-10-06T01:37:37.716 INFO:teuthology.orchestra.run.smithi071.stdout:(24/120): rbd-fuse-17.2.6-1296.g736ac5ba.el8.x8 1.8 MB/s | 90 kB 00:00 2023-10-06T01:37:38.420 INFO:teuthology.orchestra.run.smithi071.stdout:(25/120): rbd-mirror-17.2.6-1296.g736ac5ba.el8. 4.9 MB/s | 3.5 MB 00:00 2023-10-06T01:37:38.487 INFO:teuthology.orchestra.run.smithi071.stdout:(26/120): rbd-nbd-17.2.6-1296.g736ac5ba.el8.x86 2.6 MB/s | 173 kB 00:00 2023-10-06T01:37:38.551 INFO:teuthology.orchestra.run.smithi071.stdout:(27/120): ceph-grafana-dashboards-17.2.6-1296.g 362 kB/s | 23 kB 00:00 2023-10-06T01:37:38.620 INFO:teuthology.orchestra.run.smithi071.stdout:(28/120): ceph-mgr-cephadm-17.2.6-1296.g736ac5b 1.7 MB/s | 121 kB 00:00 2023-10-06T01:37:39.054 INFO:teuthology.orchestra.run.smithi071.stdout:(29/120): ceph-mgr-dashboard-17.2.6-1296.g736ac 3.9 MB/s | 1.7 MB 00:00 2023-10-06T01:37:39.312 INFO:teuthology.orchestra.run.smithi071.stdout:(30/120): ceph-common-17.2.6-1296.g736ac5ba.el8 1.9 MB/s | 23 MB 00:12 2023-10-06T01:37:39.421 INFO:teuthology.orchestra.run.smithi071.stdout:(31/120): ceph-mgr-modules-core-17.2.6-1296.g73 2.2 MB/s | 238 kB 00:00 2023-10-06T01:37:39.477 INFO:teuthology.orchestra.run.smithi071.stdout:(32/120): ceph-mgr-rook-17.2.6-1296.g736ac5ba.e 849 kB/s | 47 kB 00:00 2023-10-06T01:37:39.489 INFO:teuthology.orchestra.run.smithi072.stdout:(10/120): ceph-osd-17.2.6-1296.g736ac5ba.el8.x8 1.7 MB/s | 17 MB 00:09 2023-10-06T01:37:39.522 INFO:teuthology.orchestra.run.smithi071.stdout:(33/120): ceph-prometheus-alerts-17.2.6-1296.g7 320 kB/s | 14 kB 00:00 2023-10-06T01:37:39.611 INFO:teuthology.orchestra.run.smithi072.stdout:(11/120): cephfs-mirror-17.2.6-1296.g736ac5ba.e 2.1 MB/s | 255 kB 00:00 2023-10-06T01:37:39.641 INFO:teuthology.orchestra.run.smithi071.stdout:(34/120): ceph-volume-17.2.6-1296.g736ac5ba.el8 2.2 MB/s | 267 kB 00:00 2023-10-06T01:37:39.665 INFO:teuthology.orchestra.run.smithi072.stdout:(12/120): libcephfs-devel-17.2.6-1296.g736ac5ba 467 kB/s | 25 kB 00:00 2023-10-06T01:37:39.695 INFO:teuthology.orchestra.run.smithi071.stdout:(35/120): cephadm-17.2.6-1296.g736ac5ba.el8.noa 1.5 MB/s | 80 kB 00:00 2023-10-06T01:37:39.755 INFO:teuthology.orchestra.run.smithi071.stdout:(36/120): cephfs-top-17.2.6-1296.g736ac5ba.el8. 300 kB/s | 18 kB 00:00 2023-10-06T01:37:40.016 INFO:teuthology.orchestra.run.smithi072.stdout:(13/120): libcephfs2-17.2.6-1296.g736ac5ba.el8. 2.2 MB/s | 797 kB 00:00 2023-10-06T01:37:40.130 INFO:teuthology.orchestra.run.smithi072.stdout:(14/120): libcephsqlite-17.2.6-1296.g736ac5ba.e 1.5 MB/s | 174 kB 00:00 2023-10-06T01:37:40.192 INFO:teuthology.orchestra.run.smithi072.stdout:(15/120): librados-devel-17.2.6-1296.g736ac5ba. 2.1 MB/s | 130 kB 00:00 2023-10-06T01:37:40.358 INFO:teuthology.orchestra.run.smithi071.stdout:(37/120): gperftools-libs-2.7-9.el8.x86_64.rpm 508 kB/s | 306 kB 00:00 2023-10-06T01:37:40.378 INFO:teuthology.orchestra.run.smithi071.stdout:(38/120): ceph-mgr-diskprediction-local-17.2.6- 5.6 MB/s | 7.4 MB 00:01 2023-10-06T01:37:40.435 INFO:teuthology.orchestra.run.smithi072.stdout:(16/120): libradosstriper1-17.2.6-1296.g736ac5b 2.0 MB/s | 507 kB 00:00 2023-10-06T01:37:40.455 INFO:teuthology.orchestra.run.smithi071.stdout:(39/120): liboath-2.6.2-3.el8.x86_64.rpm 610 kB/s | 59 kB 00:00 2023-10-06T01:37:40.645 INFO:teuthology.orchestra.run.smithi071.stdout:(40/120): python3-asyncssh-2.7.0-2.el8.noarch.r 2.4 MB/s | 476 kB 00:00 2023-10-06T01:37:40.734 INFO:teuthology.orchestra.run.smithi071.stdout:(41/120): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 496 kB/s | 44 kB 00:00 2023-10-06T01:37:40.780 INFO:teuthology.orchestra.run.smithi071.stdout:(42/120): libunwind-1.3.1-3.el8.x86_64.rpm 187 kB/s | 75 kB 00:00 2023-10-06T01:37:40.831 INFO:teuthology.orchestra.run.smithi071.stdout:(43/120): python3-beautifulsoup4-4.6.3-2.el8.1. 1.9 MB/s | 185 kB 00:00 2023-10-06T01:37:40.896 INFO:teuthology.orchestra.run.smithi071.stdout:(44/120): python3-cachetools-3.1.1-4.el8.noarch 286 kB/s | 33 kB 00:00 2023-10-06T01:37:40.917 INFO:teuthology.orchestra.run.smithi071.stdout:(45/120): python3-certifi-2018.10.15-7.el8.noar 191 kB/s | 16 kB 00:00 2023-10-06T01:37:41.033 INFO:teuthology.orchestra.run.smithi071.stdout:(46/120): python3-cherrypy-18.4.0-1.el8.noarch. 3.2 MB/s | 384 kB 00:00 2023-10-06T01:37:41.123 INFO:teuthology.orchestra.run.smithi071.stdout:(47/120): python3-google-auth-1.1.1-10.el8.noar 896 kB/s | 81 kB 00:00 2023-10-06T01:37:41.140 INFO:teuthology.orchestra.run.smithi071.stdout:(48/120): python3-cheroot-8.5.2-1.el8.noarch.rp 706 kB/s | 173 kB 00:00 2023-10-06T01:37:41.209 INFO:teuthology.orchestra.run.smithi071.stdout:(49/120): python3-jaraco-6.2-6.el8.noarch.rpm 130 kB/s | 11 kB 00:00 2023-10-06T01:37:41.231 INFO:teuthology.orchestra.run.smithi071.stdout:(50/120): python3-jaraco-functools-2.0-4.el8.no 195 kB/s | 18 kB 00:00 2023-10-06T01:37:41.333 INFO:teuthology.orchestra.run.smithi071.stdout:(51/120): python3-logutils-0.3.5-11.el8.noarch. 476 kB/s | 49 kB 00:00 2023-10-06T01:37:41.392 INFO:teuthology.orchestra.run.smithi071.stdout:(52/120): python3-kubernetes-11.0.0-6.el8.noarc 6.4 MB/s | 1.2 MB 00:00 2023-10-06T01:37:41.436 INFO:teuthology.orchestra.run.smithi071.stdout:(53/120): python3-more-itertools-7.2.0-3.el8.no 573 kB/s | 59 kB 00:00 2023-10-06T01:37:41.477 INFO:teuthology.orchestra.run.smithi071.stdout:(54/120): python3-natsort-7.1.1-2.el8.noarch.rp 713 kB/s | 60 kB 00:00 2023-10-06T01:37:41.562 INFO:teuthology.orchestra.run.smithi071.stdout:(55/120): python3-portend-2.6-1.el8.noarch.rpm 183 kB/s | 16 kB 00:00 2023-10-06T01:37:41.611 INFO:teuthology.orchestra.run.smithi071.stdout:(56/120): python3-pecan-1.3.2-9.el8.noarch.rpm 1.6 MB/s | 283 kB 00:00 2023-10-06T01:37:41.648 INFO:teuthology.orchestra.run.smithi071.stdout:(57/120): python3-repoze-lru-0.7-6.el8.noarch.r 394 kB/s | 34 kB 00:00 2023-10-06T01:37:41.716 INFO:teuthology.orchestra.run.smithi072.stdout:(17/120): ceph-common-17.2.6-1296.g736ac5ba.el8 1.6 MB/s | 23 MB 00:14 2023-10-06T01:37:41.719 INFO:teuthology.orchestra.run.smithi071.stdout:(58/120): python3-routes-2.4.1-12.el8.noarch.rp 1.8 MB/s | 196 kB 00:00 2023-10-06T01:37:41.734 INFO:teuthology.orchestra.run.smithi071.stdout:(59/120): python3-rsa-4.9-2.el8.noarch.rpm 744 kB/s | 64 kB 00:00 2023-10-06T01:37:41.786 INFO:teuthology.orchestra.run.smithi072.stdout:(18/120): python3-ceph-argparse-17.2.6-1296.g73 642 kB/s | 45 kB 00:00 2023-10-06T01:37:41.808 INFO:teuthology.orchestra.run.smithi071.stdout:(60/120): python3-simplegeneric-0.8.1-17.el8.no 211 kB/s | 19 kB 00:00 2023-10-06T01:37:41.820 INFO:teuthology.orchestra.run.smithi071.stdout:(61/120): python3-singledispatch-3.4.0.3-18.el8 281 kB/s | 24 kB 00:00 2023-10-06T01:37:41.860 INFO:teuthology.orchestra.run.smithi072.stdout:(19/120): python3-ceph-common-17.2.6-1296.g736a 1.5 MB/s | 115 kB 00:00 2023-10-06T01:37:41.898 INFO:teuthology.orchestra.run.smithi071.stdout:(62/120): python3-tempora-1.14.1-5.el8.noarch.r 325 kB/s | 29 kB 00:00 2023-10-06T01:37:41.907 INFO:teuthology.orchestra.run.smithi071.stdout:(63/120): python3-trustme-0.6.0-4.el8.noarch.rp 314 kB/s | 27 kB 00:00 2023-10-06T01:37:41.939 INFO:teuthology.orchestra.run.smithi072.stdout:(20/120): python3-cephfs-17.2.6-1296.g736ac5ba. 2.3 MB/s | 190 kB 00:00 2023-10-06T01:37:42.002 INFO:teuthology.orchestra.run.smithi071.stdout:(64/120): python3-webob-1.8.5-1.el8.1.noarch.rp 2.6 MB/s | 251 kB 00:00 2023-10-06T01:37:42.014 INFO:teuthology.orchestra.run.smithi071.stdout:(65/120): python3-waitress-1.4.3-1.el8.noarch.r 2.2 MB/s | 255 kB 00:00 2023-10-06T01:37:42.088 INFO:teuthology.orchestra.run.smithi071.stdout:(66/120): python3-websocket-client-0.56.0-5.el8 713 kB/s | 61 kB 00:00 2023-10-06T01:37:42.096 INFO:teuthology.orchestra.run.smithi072.stdout:(21/120): python3-rados-17.2.6-1296.g736ac5ba.e 2.3 MB/s | 371 kB 00:00 2023-10-06T01:37:42.107 INFO:teuthology.orchestra.run.smithi071.stdout:(67/120): python3-webtest-2.0.33-1.el8.noarch.r 920 kB/s | 85 kB 00:00 2023-10-06T01:37:42.172 INFO:teuthology.orchestra.run.smithi071.stdout:(68/120): python3-zc-lockfile-2.0-2.el8.noarch. 272 kB/s | 23 kB 00:00 2023-10-06T01:37:42.177 INFO:teuthology.orchestra.run.smithi071.stdout:(69/120): xmlstarlet-1.6.1-20.el8.x86_64.rpm 15 MB/s | 70 kB 00:00 2023-10-06T01:37:42.186 INFO:teuthology.orchestra.run.smithi072.stdout:(22/120): python3-rbd-17.2.6-1296.g736ac5ba.el8 3.9 MB/s | 358 kB 00:00 2023-10-06T01:37:42.266 INFO:teuthology.orchestra.run.smithi072.stdout:(23/120): python3-rgw-17.2.6-1296.g736ac5ba.el8 1.3 MB/s | 107 kB 00:00 2023-10-06T01:37:42.346 INFO:teuthology.orchestra.run.smithi072.stdout:(24/120): rbd-fuse-17.2.6-1296.g736ac5ba.el8.x8 1.1 MB/s | 90 kB 00:00 2023-10-06T01:37:42.441 INFO:teuthology.orchestra.run.smithi072.stdout:(25/120): librgw2-17.2.6-1296.g736ac5ba.el8.x86 2.8 MB/s | 5.6 MB 00:02 2023-10-06T01:37:42.451 INFO:teuthology.orchestra.run.smithi071.stdout:(70/120): python3-scipy-1.0.0-20.module+el8.1.0 53 MB/s | 15 MB 00:00 2023-10-06T01:37:42.458 INFO:teuthology.orchestra.run.smithi071.stdout:(71/120): thrift-0.13.0-2.el8.x86_64.rpm 5.0 MB/s | 1.7 MB 00:00 2023-10-06T01:37:42.472 INFO:teuthology.orchestra.run.smithi071.stdout:(72/120): python3-prettytable-0.7.2-14.el8.noar 2.2 MB/s | 44 kB 00:00 2023-10-06T01:37:42.488 INFO:teuthology.orchestra.run.smithi071.stdout:(73/120): python3-jsonpatch-1.21-2.el8.noarch.r 883 kB/s | 27 kB 00:00 2023-10-06T01:37:42.490 INFO:teuthology.orchestra.run.smithi071.stdout:(74/120): jq-1.5-12.el8.x86_64.rpm 8.6 MB/s | 161 kB 00:00 2023-10-06T01:37:42.508 INFO:teuthology.orchestra.run.smithi071.stdout:(75/120): flex-2.6.1-9.el8.x86_64.rpm 16 MB/s | 320 kB 00:00 2023-10-06T01:37:42.512 INFO:teuthology.orchestra.run.smithi071.stdout:(76/120): python3-werkzeug-0.12.2-4.el8.noarch. 21 MB/s | 457 kB 00:00 2023-10-06T01:37:42.512 INFO:teuthology.orchestra.run.smithi072.stdout:(26/120): rbd-nbd-17.2.6-1296.g736ac5ba.el8.x86 2.4 MB/s | 173 kB 00:00 2023-10-06T01:37:42.526 INFO:teuthology.orchestra.run.smithi071.stdout:(77/120): python3-markupsafe-0.23-19.el8.x86_64 2.7 MB/s | 39 kB 00:00 2023-10-06T01:37:42.548 INFO:teuthology.orchestra.run.smithi071.stdout:(78/120): bison-3.0.4-10.el8.x86_64.rpm 31 MB/s | 688 kB 00:00 2023-10-06T01:37:42.567 INFO:teuthology.orchestra.run.smithi071.stdout:(79/120): lttng-ust-2.8.1-11.el8.x86_64.rpm 14 MB/s | 259 kB 00:00 2023-10-06T01:37:42.578 INFO:teuthology.orchestra.run.smithi072.stdout:(27/120): ceph-grafana-dashboards-17.2.6-1296.g 354 kB/s | 23 kB 00:00 2023-10-06T01:37:42.580 INFO:teuthology.orchestra.run.smithi071.stdout:(80/120): python3-babel-2.5.1-5.el8.noarch.rpm 66 MB/s | 4.8 MB 00:00 2023-10-06T01:37:42.583 INFO:teuthology.orchestra.run.smithi071.stdout:(81/120): python3-numpy-f2py-1.14.3-9.el8.x86_6 14 MB/s | 225 kB 00:00 2023-10-06T01:37:42.595 INFO:teuthology.orchestra.run.smithi071.stdout:(82/120): python3-pyasn1-0.3.7-6.el8.noarch.rpm 8.4 MB/s | 126 kB 00:00 2023-10-06T01:37:42.610 INFO:teuthology.orchestra.run.smithi071.stdout:(83/120): oniguruma-6.8.2-2.el8.x86_64.rpm 13 MB/s | 187 kB 00:00 2023-10-06T01:37:42.629 INFO:teuthology.orchestra.run.smithi071.stdout:(84/120): python3-jinja2-2.10.1-2.el8_0.noarch. 29 MB/s | 538 kB 00:00 2023-10-06T01:37:42.642 INFO:teuthology.orchestra.run.smithi071.stdout:(85/120): python3-numpy-1.14.3-9.el8.x86_64.rpm 63 MB/s | 3.7 MB 00:00 2023-10-06T01:37:42.644 INFO:teuthology.orchestra.run.smithi072.stdout:(28/120): ceph-mgr-cephadm-17.2.6-1296.g736ac5b 1.8 MB/s | 121 kB 00:00 2023-10-06T01:37:42.646 INFO:teuthology.orchestra.run.smithi071.stdout:(86/120): socat-1.7.3.3-2.el8.x86_64.rpm 17 MB/s | 302 kB 00:00 2023-10-06T01:37:42.656 INFO:teuthology.orchestra.run.smithi071.stdout:(87/120): python3-mako-1.0.6-13.el8.noarch.rpm 12 MB/s | 157 kB 00:00 2023-10-06T01:37:42.660 INFO:teuthology.orchestra.run.smithi071.stdout:(88/120): python3-pyasn1-modules-0.3.7-6.el8.no 7.7 MB/s | 110 kB 00:00 2023-10-06T01:37:42.672 INFO:teuthology.orchestra.run.smithi071.stdout:(89/120): librdkafka-0.11.4-1.el8.x86_64.rpm 21 MB/s | 353 kB 00:00 2023-10-06T01:37:42.673 INFO:teuthology.orchestra.run.smithi071.stdout:(90/120): python3-jsonpointer-1.10-11.el8.noarc 1.6 MB/s | 20 kB 00:00 2023-10-06T01:37:42.686 INFO:teuthology.orchestra.run.smithi071.stdout:(91/120): python3-pytz-2017.2-9.el8.noarch.rpm 4.0 MB/s | 54 kB 00:00 2023-10-06T01:37:42.694 INFO:teuthology.orchestra.run.smithi071.stdout:(92/120): libtool-2.4.6-25.el8.x86_64.rpm 33 MB/s | 709 kB 00:00 2023-10-06T01:37:42.761 INFO:teuthology.orchestra.run.smithi071.stdout:(93/120): openblas-threads-0.3.12-1.el8.x86_64. 64 MB/s | 4.7 MB 00:00 2023-10-06T01:37:42.779 INFO:teuthology.orchestra.run.smithi071.stdout:(94/120): openblas-0.3.12-1.el8.x86_64.rpm 54 MB/s | 4.6 MB 00:00 2023-10-06T01:37:42.787 INFO:teuthology.orchestra.run.smithi071.stdout:(95/120): automake-1.16.1-7.el8.noarch.rpm 27 MB/s | 713 kB 00:00 2023-10-06T01:37:42.792 INFO:teuthology.orchestra.run.smithi071.stdout:(96/120): libaio-devel-0.3.112-1.el8.x86_64.rpm 1.4 MB/s | 19 kB 00:00 2023-10-06T01:37:42.801 INFO:teuthology.orchestra.run.smithi071.stdout:(97/120): python3-jwt-1.6.1-2.el8.noarch.rpm 3.0 MB/s | 43 kB 00:00 2023-10-06T01:37:42.807 INFO:teuthology.orchestra.run.smithi071.stdout:(98/120): python3-oauthlib-2.1.0-1.el8.noarch.r 10 MB/s | 155 kB 00:00 2023-10-06T01:37:42.817 INFO:teuthology.orchestra.run.smithi071.stdout:(99/120): pcre2-utf32-10.32-2.el8.x86_64.rpm 14 MB/s | 220 kB 00:00 2023-10-06T01:37:42.822 INFO:teuthology.orchestra.run.smithi071.stdout:(100/120): keyutils-libs-devel-1.5.10-6.el8.x86 3.3 MB/s | 48 kB 00:00 2023-10-06T01:37:42.834 INFO:teuthology.orchestra.run.smithi071.stdout:(101/120): pcre2-utf16-10.32-2.el8.x86_64.rpm 13 MB/s | 229 kB 00:00 2023-10-06T01:37:42.836 INFO:teuthology.orchestra.run.smithi071.stdout:(102/120): python3-requests-oauthlib-1.0.0-1.el 3.0 MB/s | 43 kB 00:00 2023-10-06T01:37:42.850 INFO:teuthology.orchestra.run.smithi071.stdout:(103/120): libverto-devel-0.3.0-5.el8.x86_64.rp 1.2 MB/s | 18 kB 00:00 2023-10-06T01:37:42.870 INFO:teuthology.orchestra.run.smithi071.stdout:(104/120): pcre2-devel-10.32-2.el8.x86_64.rpm 30 MB/s | 605 kB 00:00 2023-10-06T01:37:42.878 INFO:teuthology.orchestra.run.smithi071.stdout:(105/120): openssl-devel-1.1.1g-15.el8_3.x86_64 53 MB/s | 2.3 MB 00:00 2023-10-06T01:37:42.883 INFO:teuthology.orchestra.run.smithi071.stdout:(106/120): fuse-2.9.7-12.el8.x86_64.rpm 6.1 MB/s | 83 kB 00:00 2023-10-06T01:37:42.892 INFO:teuthology.orchestra.run.smithi071.stdout:(107/120): elfutils-libelf-devel-0.182-3.el8.x8 4.0 MB/s | 59 kB 00:00 2023-10-06T01:37:42.898 INFO:teuthology.orchestra.run.smithi071.stdout:(108/120): libquadmath-8.4.1-1.el8.x86_64.rpm 11 MB/s | 169 kB 00:00 2023-10-06T01:37:42.908 INFO:teuthology.orchestra.run.smithi071.stdout:(109/120): libcom_err-devel-1.45.6-1.el8.x86_64 2.5 MB/s | 38 kB 00:00 2023-10-06T01:37:42.917 INFO:teuthology.orchestra.run.smithi071.stdout:(110/120): libsepol-devel-2.9-2.el8.x86_64.rpm 4.5 MB/s | 86 kB 00:00 2023-10-06T01:37:42.921 INFO:teuthology.orchestra.run.smithi071.stdout:(111/120): zlib-devel-1.2.11-17.el8.x86_64.rpm 4.1 MB/s | 58 kB 00:00 2023-10-06T01:37:42.930 INFO:teuthology.orchestra.run.smithi071.stdout:(112/120): librabbitmq-0.9.0-3.el8.x86_64.rpm 3.5 MB/s | 47 kB 00:00 2023-10-06T01:37:42.940 INFO:teuthology.orchestra.run.smithi071.stdout:(113/120): krb5-devel-1.18.2-8.3.el8_4.x86_64.r 29 MB/s | 559 kB 00:00 2023-10-06T01:37:42.950 INFO:teuthology.orchestra.run.smithi071.stdout:(114/120): libgfortran-8.4.1-1.el8.x86_64.rpm 32 MB/s | 639 kB 00:00 2023-10-06T01:37:42.954 INFO:teuthology.orchestra.run.smithi071.stdout:(115/120): xfsprogs-devel-5.0.0-8.el8.x86_64.rp 5.2 MB/s | 70 kB 00:00 2023-10-06T01:37:42.967 INFO:teuthology.orchestra.run.smithi071.stdout:(116/120): libselinux-devel-2.9-5.el8.x86_64.rp 12 MB/s | 200 kB 00:00 2023-10-06T01:37:42.972 INFO:teuthology.orchestra.run.smithi071.stdout:(117/120): libuuid-devel-2.32.1-27.el8.x86_64.r 5.2 MB/s | 97 kB 00:00 2023-10-06T01:37:43.011 INFO:teuthology.orchestra.run.smithi072.stdout:(29/120): rbd-mirror-17.2.6-1296.g736ac5ba.el8. 5.2 MB/s | 3.5 MB 00:00 2023-10-06T01:37:43.384 INFO:teuthology.orchestra.run.smithi072.stdout:(30/120): ceph-mgr-dashboard-17.2.6-1296.g736ac 2.3 MB/s | 1.7 MB 00:00 2023-10-06T01:37:43.518 INFO:teuthology.orchestra.run.smithi072.stdout:(31/120): ceph-mgr-modules-core-17.2.6-1296.g73 1.7 MB/s | 238 kB 00:00 2023-10-06T01:37:43.582 INFO:teuthology.orchestra.run.smithi072.stdout:(32/120): ceph-mgr-rook-17.2.6-1296.g736ac5ba.e 746 kB/s | 47 kB 00:00 2023-10-06T01:37:43.645 INFO:teuthology.orchestra.run.smithi072.stdout:(33/120): ceph-prometheus-alerts-17.2.6-1296.g7 231 kB/s | 14 kB 00:00 2023-10-06T01:37:43.768 INFO:teuthology.orchestra.run.smithi072.stdout:(34/120): ceph-volume-17.2.6-1296.g736ac5ba.el8 2.1 MB/s | 267 kB 00:00 2023-10-06T01:37:43.832 INFO:teuthology.orchestra.run.smithi072.stdout:(35/120): cephadm-17.2.6-1296.g736ac5ba.el8.noa 1.2 MB/s | 80 kB 00:00 2023-10-06T01:37:43.891 INFO:teuthology.orchestra.run.smithi072.stdout:(36/120): cephfs-top-17.2.6-1296.g736ac5ba.el8. 307 kB/s | 18 kB 00:00 2023-10-06T01:37:44.242 INFO:teuthology.orchestra.run.smithi071.stdout:(118/120): librados2-17.2.6-1296.g736ac5ba.el8. 2.7 MB/s | 3.5 MB 00:01 2023-10-06T01:37:44.296 INFO:teuthology.orchestra.run.smithi072.stdout:(37/120): gperftools-libs-2.7-9.el8.x86_64.rpm 757 kB/s | 306 kB 00:00 2023-10-06T01:37:44.348 INFO:teuthology.orchestra.run.smithi072.stdout:(38/120): liboath-2.6.2-3.el8.x86_64.rpm 1.1 MB/s | 59 kB 00:00 2023-10-06T01:37:44.389 INFO:teuthology.orchestra.run.smithi072.stdout:(39/120): ceph-mgr-diskprediction-local-17.2.6- 5.4 MB/s | 7.4 MB 00:01 2023-10-06T01:37:44.417 INFO:teuthology.orchestra.run.smithi072.stdout:(40/120): libunwind-1.3.1-3.el8.x86_64.rpm 1.1 MB/s | 75 kB 00:00 2023-10-06T01:37:44.489 INFO:teuthology.orchestra.run.smithi072.stdout:(41/120): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 607 kB/s | 44 kB 00:00 2023-10-06T01:37:44.624 INFO:teuthology.orchestra.run.smithi072.stdout:(42/120): python3-beautifulsoup4-4.6.3-2.el8.1. 1.3 MB/s | 185 kB 00:00 2023-10-06T01:37:44.665 INFO:teuthology.orchestra.run.smithi071.stdout:(119/120): librbd1-17.2.6-1296.g736ac5ba.el8.x8 2.1 MB/s | 3.6 MB 00:01 2023-10-06T01:37:44.677 INFO:teuthology.orchestra.run.smithi072.stdout:(43/120): python3-cachetools-3.1.1-4.el8.noarch 626 kB/s | 33 kB 00:00 2023-10-06T01:37:44.763 INFO:teuthology.orchestra.run.smithi072.stdout:(44/120): python3-certifi-2018.10.15-7.el8.noar 190 kB/s | 16 kB 00:00 2023-10-06T01:37:44.801 INFO:teuthology.orchestra.run.smithi072.stdout:(45/120): python3-asyncssh-2.7.0-2.el8.noarch.r 1.1 MB/s | 476 kB 00:00 2023-10-06T01:37:44.818 INFO:teuthology.orchestra.run.smithi072.stdout:(46/120): python3-cheroot-8.5.2-1.el8.noarch.rp 3.0 MB/s | 173 kB 00:00 2023-10-06T01:37:44.872 INFO:teuthology.orchestra.run.smithi072.stdout:(47/120): python3-google-auth-1.1.1-10.el8.noar 1.5 MB/s | 81 kB 00:00 2023-10-06T01:37:44.946 INFO:teuthology.orchestra.run.smithi072.stdout:(48/120): python3-jaraco-6.2-6.el8.noarch.rpm 151 kB/s | 11 kB 00:00 2023-10-06T01:37:44.998 INFO:teuthology.orchestra.run.smithi072.stdout:(49/120): python3-jaraco-functools-2.0-4.el8.no 341 kB/s | 18 kB 00:00 2023-10-06T01:37:45.038 INFO:teuthology.orchestra.run.smithi072.stdout:(50/120): python3-cherrypy-18.4.0-1.el8.noarch. 1.6 MB/s | 384 kB 00:00 2023-10-06T01:37:45.093 INFO:teuthology.orchestra.run.smithi072.stdout:(51/120): python3-logutils-0.3.5-11.el8.noarch. 885 kB/s | 49 kB 00:00 2023-10-06T01:37:45.152 INFO:teuthology.orchestra.run.smithi072.stdout:(52/120): python3-more-itertools-7.2.0-3.el8.no 1.0 MB/s | 59 kB 00:00 2023-10-06T01:37:45.266 INFO:teuthology.orchestra.run.smithi072.stdout:(53/120): python3-natsort-7.1.1-2.el8.noarch.rp 527 kB/s | 60 kB 00:00 2023-10-06T01:37:45.270 INFO:teuthology.orchestra.run.smithi072.stdout:(54/120): python3-kubernetes-11.0.0-6.el8.noarc 4.3 MB/s | 1.2 MB 00:00 2023-10-06T01:37:45.326 INFO:teuthology.orchestra.run.smithi072.stdout:(55/120): python3-portend-2.6-1.el8.noarch.rpm 279 kB/s | 16 kB 00:00 2023-10-06T01:37:45.410 INFO:teuthology.orchestra.run.smithi072.stdout:(56/120): python3-repoze-lru-0.7-6.el8.noarch.r 400 kB/s | 34 kB 00:00 2023-10-06T01:37:45.536 INFO:teuthology.orchestra.run.smithi072.stdout:(57/120): python3-pecan-1.3.2-9.el8.noarch.rpm 1.0 MB/s | 283 kB 00:00 2023-10-06T01:37:45.547 INFO:teuthology.orchestra.run.smithi072.stdout:(58/120): python3-routes-2.4.1-12.el8.noarch.rp 1.4 MB/s | 196 kB 00:00 2023-10-06T01:37:45.588 INFO:teuthology.orchestra.run.smithi072.stdout:(59/120): python3-rsa-4.9-2.el8.noarch.rpm 1.2 MB/s | 64 kB 00:00 2023-10-06T01:37:45.615 INFO:teuthology.orchestra.run.smithi072.stdout:(60/120): python3-simplegeneric-0.8.1-17.el8.no 277 kB/s | 19 kB 00:00 2023-10-06T01:37:45.639 INFO:teuthology.orchestra.run.smithi072.stdout:(61/120): python3-singledispatch-3.4.0.3-18.el8 473 kB/s | 24 kB 00:00 2023-10-06T01:37:45.691 INFO:teuthology.orchestra.run.smithi072.stdout:(62/120): python3-tempora-1.14.1-5.el8.noarch.r 388 kB/s | 29 kB 00:00 2023-10-06T01:37:45.714 INFO:teuthology.orchestra.run.smithi072.stdout:(63/120): python3-trustme-0.6.0-4.el8.noarch.rp 371 kB/s | 27 kB 00:00 2023-10-06T01:37:46.331 INFO:teuthology.orchestra.run.smithi072.stdout:(64/120): ceph-test-17.2.6-1296.g736ac5ba.el8.x 4.8 MB/s | 52 MB 00:10 2023-10-06T01:37:46.333 INFO:teuthology.orchestra.run.smithi072.stdout:(65/120): python3-waitress-1.4.3-1.el8.noarch.r 397 kB/s | 255 kB 00:00 2023-10-06T01:37:46.334 INFO:teuthology.orchestra.run.smithi072.stdout:(66/120): python3-webob-1.8.5-1.el8.1.noarch.rp 405 kB/s | 251 kB 00:00 2023-10-06T01:37:46.417 INFO:teuthology.orchestra.run.smithi072.stdout:(67/120): python3-zc-lockfile-2.0-2.el8.noarch. 276 kB/s | 23 kB 00:00 2023-10-06T01:37:46.570 INFO:teuthology.orchestra.run.smithi072.stdout:(68/120): python3-websocket-client-0.56.0-5.el8 256 kB/s | 61 kB 00:00 2023-10-06T01:37:46.574 INFO:teuthology.orchestra.run.smithi072.stdout:(69/120): xmlstarlet-1.6.1-20.el8.x86_64.rpm 15 MB/s | 70 kB 00:00 2023-10-06T01:37:46.576 INFO:teuthology.orchestra.run.smithi072.stdout:(70/120): python3-webtest-2.0.33-1.el8.noarch.r 352 kB/s | 85 kB 00:00 2023-10-06T01:37:46.604 INFO:teuthology.orchestra.run.smithi072.stdout:(71/120): libaio-devel-0.3.112-1.el8.x86_64.rpm 642 kB/s | 19 kB 00:00 2023-10-06T01:37:46.609 INFO:teuthology.orchestra.run.smithi072.stdout:(72/120): python3-jwt-1.6.1-2.el8.noarch.rpm 1.3 MB/s | 43 kB 00:00 2023-10-06T01:37:46.623 INFO:teuthology.orchestra.run.smithi072.stdout:(73/120): python3-oauthlib-2.1.0-1.el8.noarch.r 8.3 MB/s | 155 kB 00:00 2023-10-06T01:37:46.631 INFO:teuthology.orchestra.run.smithi072.stdout:(74/120): pcre2-utf32-10.32-2.el8.x86_64.rpm 10 MB/s | 220 kB 00:00 2023-10-06T01:37:46.638 INFO:teuthology.orchestra.run.smithi072.stdout:(75/120): keyutils-libs-devel-1.5.10-6.el8.x86_ 3.1 MB/s | 48 kB 00:00 2023-10-06T01:37:46.648 INFO:teuthology.orchestra.run.smithi072.stdout:(76/120): pcre2-utf16-10.32-2.el8.x86_64.rpm 13 MB/s | 229 kB 00:00 2023-10-06T01:37:46.652 INFO:teuthology.orchestra.run.smithi072.stdout:(77/120): python3-requests-oauthlib-1.0.0-1.el8 3.1 MB/s | 43 kB 00:00 2023-10-06T01:37:46.666 INFO:teuthology.orchestra.run.smithi072.stdout:(78/120): libverto-devel-0.3.0-5.el8.x86_64.rpm 1.2 MB/s | 18 kB 00:00 2023-10-06T01:37:46.687 INFO:teuthology.orchestra.run.smithi072.stdout:(79/120): pcre2-devel-10.32-2.el8.x86_64.rpm 29 MB/s | 605 kB 00:00 2023-10-06T01:37:46.695 INFO:teuthology.orchestra.run.smithi072.stdout:(80/120): openssl-devel-1.1.1g-15.el8_3.x86_64. 50 MB/s | 2.3 MB 00:00 2023-10-06T01:37:46.702 INFO:teuthology.orchestra.run.smithi072.stdout:(81/120): fuse-2.9.7-12.el8.x86_64.rpm 5.5 MB/s | 83 kB 00:00 2023-10-06T01:37:46.712 INFO:teuthology.orchestra.run.smithi072.stdout:(82/120): elfutils-libelf-devel-0.182-3.el8.x86 3.6 MB/s | 59 kB 00:00 2023-10-06T01:37:46.718 INFO:teuthology.orchestra.run.smithi072.stdout:(83/120): libquadmath-8.4.1-1.el8.x86_64.rpm 10 MB/s | 169 kB 00:00 2023-10-06T01:37:46.726 INFO:teuthology.orchestra.run.smithi072.stdout:(84/120): libcom_err-devel-1.45.6-1.el8.x86_64. 2.6 MB/s | 38 kB 00:00 2023-10-06T01:37:46.735 INFO:teuthology.orchestra.run.smithi072.stdout:(85/120): libsepol-devel-2.9-2.el8.x86_64.rpm 5.1 MB/s | 86 kB 00:00 2023-10-06T01:37:46.742 INFO:teuthology.orchestra.run.smithi072.stdout:(86/120): zlib-devel-1.2.11-17.el8.x86_64.rpm 3.5 MB/s | 58 kB 00:00 2023-10-06T01:37:46.750 INFO:teuthology.orchestra.run.smithi072.stdout:(87/120): librabbitmq-0.9.0-3.el8.x86_64.rpm 3.1 MB/s | 47 kB 00:00 2023-10-06T01:37:46.762 INFO:teuthology.orchestra.run.smithi072.stdout:(88/120): krb5-devel-1.18.2-8.3.el8_4.x86_64.rp 27 MB/s | 559 kB 00:00 2023-10-06T01:37:46.771 INFO:teuthology.orchestra.run.smithi072.stdout:(89/120): libgfortran-8.4.1-1.el8.x86_64.rpm 31 MB/s | 639 kB 00:00 2023-10-06T01:37:46.776 INFO:teuthology.orchestra.run.smithi072.stdout:(90/120): xfsprogs-devel-5.0.0-8.el8.x86_64.rpm 5.0 MB/s | 70 kB 00:00 2023-10-06T01:37:46.786 INFO:teuthology.orchestra.run.smithi072.stdout:(91/120): libselinux-devel-2.9-5.el8.x86_64.rpm 13 MB/s | 200 kB 00:00 2023-10-06T01:37:46.790 INFO:teuthology.orchestra.run.smithi072.stdout:(92/120): libuuid-devel-2.32.1-27.el8.x86_64.rp 7.1 MB/s | 97 kB 00:00 2023-10-06T01:37:46.804 INFO:teuthology.orchestra.run.smithi072.stdout:(93/120): python3-prettytable-0.7.2-14.el8.noar 3.1 MB/s | 44 kB 00:00 2023-10-06T01:37:46.816 INFO:teuthology.orchestra.run.smithi072.stdout:(94/120): python3-jsonpatch-1.21-2.el8.noarch.r 2.3 MB/s | 27 kB 00:00 2023-10-06T01:37:46.829 INFO:teuthology.orchestra.run.smithi072.stdout:(95/120): jq-1.5-12.el8.x86_64.rpm 12 MB/s | 161 kB 00:00 2023-10-06T01:37:46.846 INFO:teuthology.orchestra.run.smithi072.stdout:(96/120): flex-2.6.1-9.el8.x86_64.rpm 19 MB/s | 320 kB 00:00 2023-10-06T01:37:46.864 INFO:teuthology.orchestra.run.smithi072.stdout:(97/120): python3-werkzeug-0.12.2-4.el8.noarch. 26 MB/s | 457 kB 00:00 2023-10-06T01:37:46.939 INFO:teuthology.orchestra.run.smithi072.stdout:(98/120): python3-babel-2.5.1-5.el8.noarch.rpm 64 MB/s | 4.8 MB 00:00 2023-10-06T01:37:46.952 INFO:teuthology.orchestra.run.smithi072.stdout:(99/120): python3-markupsafe-0.23-19.el8.x86_64 3.0 MB/s | 39 kB 00:00 2023-10-06T01:37:47.064 INFO:teuthology.orchestra.run.smithi072.stdout:(100/120): python3-scipy-1.0.0-20.module+el8.1. 52 MB/s | 15 MB 00:00 2023-10-06T01:37:47.072 INFO:teuthology.orchestra.run.smithi072.stdout:(101/120): bison-3.0.4-10.el8.x86_64.rpm 5.6 MB/s | 688 kB 00:00 2023-10-06T01:37:47.081 INFO:teuthology.orchestra.run.smithi072.stdout:(102/120): lttng-ust-2.8.1-11.el8.x86_64.rpm 16 MB/s | 259 kB 00:00 2023-10-06T01:37:47.088 INFO:teuthology.orchestra.run.smithi072.stdout:(103/120): python3-numpy-f2py-1.14.3-9.el8.x86_ 14 MB/s | 225 kB 00:00 2023-10-06T01:37:47.095 INFO:teuthology.orchestra.run.smithi072.stdout:(104/120): python3-pyasn1-0.3.7-6.el8.noarch.rp 8.5 MB/s | 126 kB 00:00 2023-10-06T01:37:47.113 INFO:teuthology.orchestra.run.smithi072.stdout:(105/120): oniguruma-6.8.2-2.el8.x86_64.rpm 11 MB/s | 187 kB 00:00 2023-10-06T01:37:47.131 INFO:teuthology.orchestra.run.smithi072.stdout:(106/120): python3-jinja2-2.10.1-2.el8_0.noarch 29 MB/s | 538 kB 00:00 2023-10-06T01:37:47.146 INFO:teuthology.orchestra.run.smithi072.stdout:(107/120): python3-numpy-1.14.3-9.el8.x86_64.rp 64 MB/s | 3.7 MB 00:00 2023-10-06T01:37:47.150 INFO:teuthology.orchestra.run.smithi072.stdout:(108/120): socat-1.7.3.3-2.el8.x86_64.rpm 16 MB/s | 302 kB 00:00 2023-10-06T01:37:47.162 INFO:teuthology.orchestra.run.smithi072.stdout:(109/120): python3-mako-1.0.6-13.el8.noarch.rpm 10 MB/s | 157 kB 00:00 2023-10-06T01:37:47.165 INFO:teuthology.orchestra.run.smithi072.stdout:(110/120): python3-pyasn1-modules-0.3.7-6.el8.n 7.2 MB/s | 110 kB 00:00 2023-10-06T01:37:47.178 INFO:teuthology.orchestra.run.smithi072.stdout:(111/120): librdkafka-0.11.4-1.el8.x86_64.rpm 22 MB/s | 353 kB 00:00 2023-10-06T01:37:47.178 INFO:teuthology.orchestra.run.smithi072.stdout:(112/120): python3-jsonpointer-1.10-11.el8.noar 1.5 MB/s | 20 kB 00:00 2023-10-06T01:37:47.192 INFO:teuthology.orchestra.run.smithi072.stdout:(113/120): python3-pytz-2017.2-9.el8.noarch.rpm 4.0 MB/s | 54 kB 00:00 2023-10-06T01:37:47.198 INFO:teuthology.orchestra.run.smithi072.stdout:(114/120): libtool-2.4.6-25.el8.x86_64.rpm 34 MB/s | 709 kB 00:00 2023-10-06T01:37:47.263 INFO:teuthology.orchestra.run.smithi072.stdout:(115/120): openblas-threads-0.3.12-1.el8.x86_64 66 MB/s | 4.7 MB 00:00 2023-10-06T01:37:47.413 INFO:teuthology.orchestra.run.smithi072.stdout:(116/120): openblas-0.3.12-1.el8.x86_64.rpm 21 MB/s | 4.6 MB 00:00 2023-10-06T01:37:47.420 INFO:teuthology.orchestra.run.smithi072.stdout:(117/120): automake-1.16.1-7.el8.noarch.rpm 4.4 MB/s | 713 kB 00:00 2023-10-06T01:37:47.781 INFO:teuthology.orchestra.run.smithi072.stdout:(118/120): librbd1-17.2.6-1296.g736ac5ba.el8.x8 9.9 MB/s | 3.6 MB 00:00 2023-10-06T01:37:47.837 INFO:teuthology.orchestra.run.smithi072.stdout:(119/120): librados2-17.2.6-1296.g736ac5ba.el8. 8.2 MB/s | 3.5 MB 00:00 2023-10-06T01:37:48.707 INFO:teuthology.orchestra.run.smithi072.stdout:(120/120): thrift-0.13.0-2.el8.x86_64.rpm 776 kB/s | 1.7 MB 00:02 2023-10-06T01:37:48.711 INFO:teuthology.orchestra.run.smithi072.stdout:-------------------------------------------------------------------------------- 2023-10-06T01:37:48.712 INFO:teuthology.orchestra.run.smithi072.stdout:Total 9.1 MB/s | 201 MB 00:22 2023-10-06T01:37:48.764 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction check 2023-10-06T01:37:48.879 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction check succeeded. 2023-10-06T01:37:48.880 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction test 2023-10-06T01:37:51.215 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction test succeeded. 2023-10-06T01:37:51.219 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction 2023-10-06T01:37:52.281 INFO:teuthology.orchestra.run.smithi071.stdout:(120/120): ceph-test-17.2.6-1296.g736ac5ba.el8. 2.9 MB/s | 52 MB 00:17 2023-10-06T01:37:52.286 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2023-10-06T01:37:52.286 INFO:teuthology.orchestra.run.smithi071.stdout:Total 7.7 MB/s | 201 MB 00:26 2023-10-06T01:37:52.340 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2023-10-06T01:37:52.455 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2023-10-06T01:37:52.456 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2023-10-06T01:37:54.210 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2023-10-06T01:37:54.214 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2023-10-06T01:37:55.947 INFO:teuthology.orchestra.run.smithi072.stdout: Preparing : 1/1 2023-10-06T01:37:56.231 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/122 2023-10-06T01:37:56.440 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 2/122 2023-10-06T01:37:56.600 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 2/122 2023-10-06T01:37:56.848 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/122 2023-10-06T01:37:57.226 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/122 2023-10-06T01:37:57.473 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 4/122 2023-10-06T01:37:57.921 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 4/122 2023-10-06T01:37:58.131 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 5/122 2023-10-06T01:37:58.259 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 5/122 2023-10-06T01:37:58.507 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 6/122 2023-10-06T01:37:58.610 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 6/122 2023-10-06T01:37:58.802 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-rados-2:17.2.6-1296.g736ac5ba.el8.x86_64 7/122 2023-10-06T01:37:59.152 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2023-10-06T01:37:59.162 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 8/122 2023-10-06T01:37:59.383 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/122 2023-10-06T01:37:59.628 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 2/122 2023-10-06T01:37:59.804 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 3/122 2023-10-06T01:37:59.860 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : thrift-0.13.0-2.el8.x86_64 9/122 2023-10-06T01:37:59.953 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 3/122 2023-10-06T01:38:00.032 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 10/122 2023-10-06T01:38:00.140 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 10/122 2023-10-06T01:38:00.377 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/122 2023-10-06T01:38:00.396 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/122 2023-10-06T01:38:00.558 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/122 2023-10-06T01:38:00.806 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 13/122 2023-10-06T01:38:00.822 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/122 2023-10-06T01:38:00.917 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 13/122 2023-10-06T01:38:01.062 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 5/122 2023-10-06T01:38:01.098 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86 14/122 2023-10-06T01:38:01.175 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86 14/122 2023-10-06T01:38:01.352 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 15/122 2023-10-06T01:38:01.445 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 5/122 2023-10-06T01:38:01.652 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 16/122 2023-10-06T01:38:01.695 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 6/122 2023-10-06T01:38:01.826 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 6/122 2023-10-06T01:38:01.887 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 17/122 2023-10-06T01:38:02.046 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 7/122 2023-10-06T01:38:02.048 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 18/122 2023-10-06T01:38:02.145 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 7/122 2023-10-06T01:38:02.239 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 19/122 2023-10-06T01:38:02.405 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 19/122 2023-10-06T01:38:02.525 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-rados-2:17.2.6-1296.g736ac5ba.el8.x86_64 8/122 2023-10-06T01:38:02.589 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 20/122 2023-10-06T01:38:03.151 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 20/122 2023-10-06T01:38:03.253 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : thrift-0.13.0-2.el8.x86_64 9/122 2023-10-06T01:38:03.331 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-10-06T01:38:03.420 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 10/122 2023-10-06T01:38:03.560 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 10/122 2023-10-06T01:38:03.823 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/122 2023-10-06T01:38:03.873 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-10-06T01:38:03.994 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/122 2023-10-06T01:38:04.072 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : openblas-0.3.12-1.el8.x86_64 22/122 2023-10-06T01:38:04.211 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 13/122 2023-10-06T01:38:04.310 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 13/122 2023-10-06T01:38:04.523 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86 14/122 2023-10-06T01:38:04.573 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86 14/122 2023-10-06T01:38:04.783 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 15/122 2023-10-06T01:38:04.792 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 22/122 2023-10-06T01:38:04.953 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 16/122 2023-10-06T01:38:05.042 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 23/122 2023-10-06T01:38:05.120 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 16/122 2023-10-06T01:38:05.311 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 17/122 2023-10-06T01:38:05.331 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 24/122 2023-10-06T01:38:05.550 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/122 2023-10-06T01:38:05.720 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-ceph-common-2:17.2.6-1296.g736ac5ba.el8. 26/122 2023-10-06T01:38:05.865 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 17/122 2023-10-06T01:38:05.871 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-ceph-argparse-2:17.2.6-1296.g736ac5ba.el 27/122 2023-10-06T01:38:06.045 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 18/122 2023-10-06T01:38:06.161 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cephfs-2:17.2.6-1296.g736ac5ba.el8.x86_6 28/122 2023-10-06T01:38:06.386 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 29/122 2023-10-06T01:38:06.572 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 18/122 2023-10-06T01:38:06.645 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 30/122 2023-10-06T01:38:06.753 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : openblas-0.3.12-1.el8.x86_64 19/122 2023-10-06T01:38:06.922 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-10-06T01:38:07.515 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 19/122 2023-10-06T01:38:07.806 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 20/122 2023-10-06T01:38:08.026 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 21/122 2023-10-06T01:38:08.206 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 22/122 2023-10-06T01:38:08.482 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/122 2023-10-06T01:38:08.795 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 24/122 2023-10-06T01:38:09.024 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-10-06T01:38:09.072 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/122 2023-10-06T01:38:09.267 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-ceph-common-2:17.2.6-1296.g736ac5ba.el8. 26/122 2023-10-06T01:38:09.405 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-ceph-argparse-2:17.2.6-1296.g736ac5ba.el 27/122 2023-10-06T01:38:09.422 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 32/122 2023-10-06T01:38:09.675 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cephfs-2:17.2.6-1296.g736ac5ba.el8.x86_6 28/122 2023-10-06T01:38:10.384 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/122 2023-10-06T01:38:10.687 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 29/122 2023-10-06T01:38:10.734 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 34/122 2023-10-06T01:38:10.982 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 35/122 2023-10-06T01:38:11.048 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 30/122 2023-10-06T01:38:11.218 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-rsa-4.9-2.el8.noarch 36/122 2023-10-06T01:38:11.334 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 31/122 2023-10-06T01:38:11.447 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/122 2023-10-06T01:38:11.583 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 32/122 2023-10-06T01:38:11.639 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-rgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 38/122 2023-10-06T01:38:11.816 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-rbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 39/122 2023-10-06T01:38:11.867 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 33/122 2023-10-06T01:38:12.095 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : librados-devel-2:17.2.6-1296.g736ac5ba.el8.x86_6 40/122 2023-10-06T01:38:12.135 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 34/122 2023-10-06T01:38:12.354 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : automake-1.16.1-7.el8.noarch 41/122 2023-10-06T01:38:12.554 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 42/122 2023-10-06T01:38:12.772 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 43/122 2023-10-06T01:38:12.999 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 44/122 2023-10-06T01:38:13.171 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 45/122 2023-10-06T01:38:13.253 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 45/122 2023-10-06T01:38:13.438 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : jq-1.5-12.el8.x86_64 46/122 2023-10-06T01:38:13.624 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 47/122 2023-10-06T01:38:13.854 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libuuid-devel-2.32.1-27.el8.x86_64 48/122 2023-10-06T01:38:14.034 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libsepol-devel-2.9-2.el8.x86_64 49/122 2023-10-06T01:38:14.206 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 50/122 2023-10-06T01:38:14.220 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 34/122 2023-10-06T01:38:14.390 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : fuse-2.9.7-12.el8.x86_64 51/122 2023-10-06T01:38:14.570 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 35/122 2023-10-06T01:38:14.592 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 52/122 2023-10-06T01:38:14.814 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 53/122 2023-10-06T01:38:14.840 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-rsa-4.9-2.el8.noarch 36/122 2023-10-06T01:38:15.000 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 54/122 2023-10-06T01:38:15.026 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/122 2023-10-06T01:38:15.275 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-rgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 38/122 2023-10-06T01:38:15.377 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/122 2023-10-06T01:38:15.490 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-rbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 39/122 2023-10-06T01:38:15.650 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/122 2023-10-06T01:38:15.735 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : librados-devel-2:17.2.6-1296.g736ac5ba.el8.x86_6 40/122 2023-10-06T01:38:15.920 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/122 2023-10-06T01:38:15.940 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libuuid-devel-2.32.1-27.el8.x86_64 41/122 2023-10-06T01:38:16.134 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libsepol-devel-2.9-2.el8.x86_64 42/122 2023-10-06T01:38:16.239 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : krb5-devel-1.18.2-8.3.el8_4.x86_64 58/122 2023-10-06T01:38:16.335 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 43/122 2023-10-06T01:38:16.405 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 59/122 2023-10-06T01:38:16.503 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : fuse-2.9.7-12.el8.x86_64 44/122 2023-10-06T01:38:16.575 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 60/122 2023-10-06T01:38:16.688 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 45/122 2023-10-06T01:38:16.875 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 61/122 2023-10-06T01:38:16.909 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 46/122 2023-10-06T01:38:17.078 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 47/122 2023-10-06T01:38:17.096 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 62/122 2023-10-06T01:38:17.294 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/122 2023-10-06T01:38:17.425 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 48/122 2023-10-06T01:38:17.470 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 64/122 2023-10-06T01:38:17.666 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 65/122 2023-10-06T01:38:17.714 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 49/122 2023-10-06T01:38:17.859 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 66/122 2023-10-06T01:38:18.009 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 50/122 2023-10-06T01:38:18.069 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 67/122 2023-10-06T01:38:18.336 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 68/122 2023-10-06T01:38:18.404 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : krb5-devel-1.18.2-8.3.el8_4.x86_64 51/122 2023-10-06T01:38:18.549 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 69/122 2023-10-06T01:38:18.634 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : automake-1.16.1-7.el8.noarch 52/122 2023-10-06T01:38:18.736 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 70/122 2023-10-06T01:38:18.849 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 53/122 2023-10-06T01:38:18.978 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 71/122 2023-10-06T01:38:19.041 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 54/122 2023-10-06T01:38:19.261 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 72/122 2023-10-06T01:38:19.261 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 55/122 2023-10-06T01:38:19.450 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 56/122 2023-10-06T01:38:19.486 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 73/122 2023-10-06T01:38:19.515 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 56/122 2023-10-06T01:38:19.717 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : jq-1.5-12.el8.x86_64 57/122 2023-10-06T01:38:19.785 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-portend-2.6-1.el8.noarch 74/122 2023-10-06T01:38:19.885 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 58/122 2023-10-06T01:38:20.028 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 75/122 2023-10-06T01:38:20.083 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 59/122 2023-10-06T01:38:20.220 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 76/122 2023-10-06T01:38:20.262 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 60/122 2023-10-06T01:38:20.489 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 77/122 2023-10-06T01:38:20.546 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 61/122 2023-10-06T01:38:20.783 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 62/122 2023-10-06T01:38:21.007 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/122 2023-10-06T01:38:21.185 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 64/122 2023-10-06T01:38:21.369 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 65/122 2023-10-06T01:38:21.576 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 66/122 2023-10-06T01:38:21.675 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 78/122 2023-10-06T01:38:21.811 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 67/122 2023-10-06T01:38:22.053 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 68/122 2023-10-06T01:38:22.169 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/122 2023-10-06T01:38:22.278 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 69/122 2023-10-06T01:38:22.413 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 80/122 2023-10-06T01:38:22.439 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 70/122 2023-10-06T01:38:22.695 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 71/122 2023-10-06T01:38:22.745 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 81/122 2023-10-06T01:38:22.944 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 72/122 2023-10-06T01:38:23.037 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 82/122 2023-10-06T01:38:23.205 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 73/122 2023-10-06T01:38:23.351 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/122 2023-10-06T01:38:23.477 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-portend-2.6-1.el8.noarch 74/122 2023-10-06T01:38:23.562 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 84/122 2023-10-06T01:38:23.773 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 75/122 2023-10-06T01:38:23.803 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 85/122 2023-10-06T01:38:23.964 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 76/122 2023-10-06T01:38:24.037 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 86/122 2023-10-06T01:38:24.231 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 77/122 2023-10-06T01:38:25.395 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 78/122 2023-10-06T01:38:25.704 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/122 2023-10-06T01:38:25.967 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 80/122 2023-10-06T01:38:26.311 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 81/122 2023-10-06T01:38:26.606 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 82/122 2023-10-06T01:38:26.963 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/122 2023-10-06T01:38:27.210 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 84/122 2023-10-06T01:38:27.407 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 85/122 2023-10-06T01:38:27.649 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 86/122 2023-10-06T01:38:29.119 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 87/122 2023-10-06T01:38:29.345 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 87/122 2023-10-06T01:38:29.944 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 87/122 2023-10-06T01:38:30.252 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 88/122 2023-10-06T01:38:30.343 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 88/122 2023-10-06T01:38:30.544 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 89/122 2023-10-06T01:38:32.830 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 87/122 2023-10-06T01:38:33.081 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 87/122 2023-10-06T01:38:33.697 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 87/122 2023-10-06T01:38:34.002 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 88/122 2023-10-06T01:38:34.107 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 88/122 2023-10-06T01:38:34.238 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 89/122 2023-10-06T01:38:50.096 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 89/122 2023-10-06T01:38:50.096 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /sys 2023-10-06T01:38:50.096 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /proc 2023-10-06T01:38:50.097 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /dev 2023-10-06T01:38:50.097 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /run 2023-10-06T01:38:50.097 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /mnt 2023-10-06T01:38:50.097 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /var/tmp 2023-10-06T01:38:50.097 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /home 2023-10-06T01:38:50.097 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /tmp 2023-10-06T01:38:50.097 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /dev 2023-10-06T01:38:50.097 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-06T01:38:50.467 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 90/122 2023-10-06T01:38:51.952 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 90/122 2023-10-06T01:38:52.141 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 91/122 2023-10-06T01:38:52.160 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 89/122 2023-10-06T01:38:52.160 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /sys 2023-10-06T01:38:52.160 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /proc 2023-10-06T01:38:52.160 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /dev 2023-10-06T01:38:52.160 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /run 2023-10-06T01:38:52.160 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /mnt 2023-10-06T01:38:52.160 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /var/tmp 2023-10-06T01:38:52.160 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /home 2023-10-06T01:38:52.160 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /tmp 2023-10-06T01:38:52.161 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /dev 2023-10-06T01:38:52.161 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:38:52.363 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 91/122 2023-10-06T01:38:52.542 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 92/122 2023-10-06T01:38:52.668 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 90/122 2023-10-06T01:38:52.937 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 92/122 2023-10-06T01:38:53.150 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 93/122 2023-10-06T01:38:53.167 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 93/122 2023-10-06T01:38:54.154 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 90/122 2023-10-06T01:38:54.348 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 91/122 2023-10-06T01:38:54.577 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 91/122 2023-10-06T01:38:54.768 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 92/122 2023-10-06T01:38:55.168 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 92/122 2023-10-06T01:38:55.353 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 93/122 2023-10-06T01:38:55.370 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 93/122 2023-10-06T01:38:56.135 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 94/122 2023-10-06T01:38:56.394 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 94/122 2023-10-06T01:38:56.539 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-prometheus-alerts-2:17.2.6-1296.g736ac5ba.e 95/122 2023-10-06T01:38:56.731 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-grafana-dashboards-2:17.2.6-1296.g736ac5ba. 96/122 2023-10-06T01:38:56.965 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noa 97/122 2023-10-06T01:38:57.180 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noa 97/122 2023-10-06T01:38:57.399 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.n 98/122 2023-10-06T01:38:58.367 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.n 98/122 2023-10-06T01:38:58.386 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 94/122 2023-10-06T01:38:58.516 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 94/122 2023-10-06T01:38:58.574 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.6-1296.g736 99/122 2023-10-06T01:38:58.672 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.6-1296.g736 99/122 2023-10-06T01:38:58.756 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-prometheus-alerts-2:17.2.6-1296.g736ac5ba.e 95/122 2023-10-06T01:38:59.003 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-grafana-dashboards-2:17.2.6-1296.g736ac5ba. 96/122 2023-10-06T01:38:59.054 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-modules-core-2:17.2.6-1296.g736ac5ba.el 100/122 2023-10-06T01:38:59.235 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noa 97/122 2023-10-06T01:38:59.282 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 101/122 2023-10-06T01:38:59.320 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 101/122 2023-10-06T01:38:59.449 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noa 97/122 2023-10-06T01:38:59.482 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 102/122 2023-10-06T01:38:59.493 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 102/122 2023-10-06T01:38:59.688 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.n 98/122 2023-10-06T01:39:00.659 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.n 98/122 2023-10-06T01:39:00.874 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.6-1296.g736 99/122 2023-10-06T01:39:00.972 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.6-1296.g736 99/122 2023-10-06T01:39:01.087 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-2:17.2.6-1296.g736ac5ba.el8.x86_64 103/122 2023-10-06T01:39:01.349 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 104/122 2023-10-06T01:39:01.360 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-modules-core-2:17.2.6-1296.g736ac5ba.el 100/122 2023-10-06T01:39:01.434 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 104/122 2023-10-06T01:39:01.538 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 101/122 2023-10-06T01:39:01.575 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 101/122 2023-10-06T01:39:01.649 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-immutable-object-cache-2:17.2.6-1296.g736ac 105/122 2023-10-06T01:39:01.698 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-1296.g736ac 105/122 2023-10-06T01:39:01.774 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 102/122 2023-10-06T01:39:01.786 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 102/122 2023-10-06T01:39:01.865 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 106/122 2023-10-06T01:39:02.212 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 106/122 2023-10-06T01:39:02.432 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 107/122 2023-10-06T01:39:03.374 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-2:17.2.6-1296.g736ac5ba.el8.x86_64 103/122 2023-10-06T01:39:03.663 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 104/122 2023-10-06T01:39:03.755 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 104/122 2023-10-06T01:39:03.916 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-immutable-object-cache-2:17.2.6-1296.g736ac 105/122 2023-10-06T01:39:03.959 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-1296.g736ac 105/122 2023-10-06T01:39:04.141 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 106/122 2023-10-06T01:39:04.488 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 106/122 2023-10-06T01:39:04.699 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 107/122 2023-10-06T01:39:07.363 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 107/122 2023-10-06T01:39:08.343 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-test-2:17.2.6-1296.g736ac5ba.el8.x86_64 108/122 2023-10-06T01:39:08.765 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : openssl-devel-1:1.1.1g-15.el8_3.x86_64 109/122 2023-10-06T01:39:08.974 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 110/122 2023-10-06T01:39:09.247 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : xfsprogs-devel-5.0.0-8.el8.x86_64 111/122 2023-10-06T01:39:09.422 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libtool-2.4.6-25.el8.x86_64 112/122 2023-10-06T01:39:09.434 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 112/122 2023-10-06T01:39:09.593 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libcephfs-devel-2:17.2.6-1296.g736ac5ba.el8.x86_ 113/122 2023-10-06T01:39:09.658 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 107/122 2023-10-06T01:39:09.736 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : elfutils-libelf-devel-0.182-3.el8.x86_64 114/122 2023-10-06T01:39:09.906 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : cephfs-top-2:17.2.6-1296.g736ac5ba.el8.noarch 115/122 2023-10-06T01:39:09.970 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-test-2:17.2.6-1296.g736ac5ba.el8.x86_64 108/122 2023-10-06T01:39:10.130 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : rbd-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 116/122 2023-10-06T01:39:10.156 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libtool-2.4.6-25.el8.x86_64 109/122 2023-10-06T01:39:10.404 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : rbd-nbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 117/122 2023-10-06T01:39:10.589 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : bison-3.0.4-10.el8.x86_64 118/122 2023-10-06T01:39:10.639 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 118/122 2023-10-06T01:39:10.862 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 109/122 2023-10-06T01:39:10.881 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : flex-2.6.1-9.el8.x86_64 119/122 2023-10-06T01:39:10.890 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 119/122 2023-10-06T01:39:11.025 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 120/122 2023-10-06T01:39:11.025 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-06T01:39:11.242 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-06T01:39:11.242 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T01:39:11.249 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : openssl-devel-1:1.1.1g-15.el8_3.x86_64 110/122 2023-10-06T01:39:11.447 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 111/122 2023-10-06T01:39:11.634 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : xfsprogs-devel-5.0.0-8.el8.x86_64 112/122 2023-10-06T01:39:11.776 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libcephfs-devel-2:17.2.6-1296.g736ac5ba.el8.x86_ 113/122 2023-10-06T01:39:11.977 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : elfutils-libelf-devel-0.182-3.el8.x86_64 114/122 2023-10-06T01:39:12.130 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : cephfs-top-2:17.2.6-1296.g736ac5ba.el8.noarch 115/122 2023-10-06T01:39:12.156 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T01:39:12.156 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-2:17.2.6-1296.g736ac5ba.el8.x86_64 1/122 2023-10-06T01:39:12.156 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 2/122 2023-10-06T01:39:12.156 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 3/122 2023-10-06T01:39:12.156 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 4/122 2023-10-06T01:39:12.156 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-immutable-object-cache-2:17.2.6-1296.g736ac 5/122 2023-10-06T01:39:12.156 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 6/122 2023-10-06T01:39:12.156 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 7/122 2023-10-06T01:39:12.156 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 8/122 2023-10-06T01:39:12.156 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 9/122 2023-10-06T01:39:12.157 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 10/122 2023-10-06T01:39:12.157 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 11/122 2023-10-06T01:39:12.157 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-test-2:17.2.6-1296.g736ac5ba.el8.x86_64 12/122 2023-10-06T01:39:12.157 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 13/122 2023-10-06T01:39:12.157 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libcephfs-devel-2:17.2.6-1296.g736ac5ba.el8.x86_ 14/122 2023-10-06T01:39:12.157 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 15/122 2023-10-06T01:39:12.157 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 16/122 2023-10-06T01:39:12.157 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librados-devel-2:17.2.6-1296.g736ac5ba.el8.x86_6 17/122 2023-10-06T01:39:12.157 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86 18/122 2023-10-06T01:39:12.157 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 19/122 2023-10-06T01:39:12.157 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-ceph-argparse-2:17.2.6-1296.g736ac5ba.el 20/122 2023-10-06T01:39:12.157 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-ceph-common-2:17.2.6-1296.g736ac5ba.el8. 21/122 2023-10-06T01:39:12.158 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cephfs-2:17.2.6-1296.g736ac5ba.el8.x86_6 22/122 2023-10-06T01:39:12.158 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-rados-2:17.2.6-1296.g736ac5ba.el8.x86_64 23/122 2023-10-06T01:39:12.158 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-rbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 24/122 2023-10-06T01:39:12.158 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-rgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 25/122 2023-10-06T01:39:12.158 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : rbd-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 26/122 2023-10-06T01:39:12.158 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 27/122 2023-10-06T01:39:12.158 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : rbd-nbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 28/122 2023-10-06T01:39:12.158 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-grafana-dashboards-2:17.2.6-1296.g736ac5ba. 29/122 2023-10-06T01:39:12.158 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noa 30/122 2023-10-06T01:39:12.158 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.n 31/122 2023-10-06T01:39:12.166 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.6-1296.g736 32/122 2023-10-06T01:39:12.166 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-modules-core-2:17.2.6-1296.g736ac5ba.el 33/122 2023-10-06T01:39:12.166 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 34/122 2023-10-06T01:39:12.166 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-prometheus-alerts-2:17.2.6-1296.g736ac5ba.e 35/122 2023-10-06T01:39:12.166 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 36/122 2023-10-06T01:39:12.167 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 37/122 2023-10-06T01:39:12.167 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : cephfs-top-2:17.2.6-1296.g736ac5ba.el8.noarch 38/122 2023-10-06T01:39:12.167 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/122 2023-10-06T01:39:12.167 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/122 2023-10-06T01:39:12.167 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/122 2023-10-06T01:39:12.167 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/122 2023-10-06T01:39:12.167 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/122 2023-10-06T01:39:12.167 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/122 2023-10-06T01:39:12.167 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/122 2023-10-06T01:39:12.167 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/122 2023-10-06T01:39:12.167 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/122 2023-10-06T01:39:12.167 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/122 2023-10-06T01:39:12.168 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/122 2023-10-06T01:39:12.168 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/122 2023-10-06T01:39:12.168 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/122 2023-10-06T01:39:12.168 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/122 2023-10-06T01:39:12.168 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/122 2023-10-06T01:39:12.168 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/122 2023-10-06T01:39:12.168 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/122 2023-10-06T01:39:12.168 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/122 2023-10-06T01:39:12.168 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/122 2023-10-06T01:39:12.168 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/122 2023-10-06T01:39:12.168 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/122 2023-10-06T01:39:12.168 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/122 2023-10-06T01:39:12.169 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/122 2023-10-06T01:39:12.169 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/122 2023-10-06T01:39:12.169 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/122 2023-10-06T01:39:12.169 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/122 2023-10-06T01:39:12.169 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/122 2023-10-06T01:39:12.169 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/122 2023-10-06T01:39:12.169 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/122 2023-10-06T01:39:12.169 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/122 2023-10-06T01:39:12.169 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/122 2023-10-06T01:39:12.169 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/122 2023-10-06T01:39:12.169 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/122 2023-10-06T01:39:12.170 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 72/122 2023-10-06T01:39:12.170 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 73/122 2023-10-06T01:39:12.170 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 74/122 2023-10-06T01:39:12.170 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/122 2023-10-06T01:39:12.170 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 76/122 2023-10-06T01:39:12.170 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 77/122 2023-10-06T01:39:12.170 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/122 2023-10-06T01:39:12.170 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : openssl-devel-1:1.1.1g-15.el8_3.x86_64 79/122 2023-10-06T01:39:12.170 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 80/122 2023-10-06T01:39:12.170 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 81/122 2023-10-06T01:39:12.170 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 82/122 2023-10-06T01:39:12.170 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : elfutils-libelf-devel-0.182-3.el8.x86_64 83/122 2023-10-06T01:39:12.171 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 84/122 2023-10-06T01:39:12.171 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 85/122 2023-10-06T01:39:12.171 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libsepol-devel-2.9-2.el8.x86_64 86/122 2023-10-06T01:39:12.171 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 87/122 2023-10-06T01:39:12.171 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 88/122 2023-10-06T01:39:12.171 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : krb5-devel-1.18.2-8.3.el8_4.x86_64 89/122 2023-10-06T01:39:12.171 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 90/122 2023-10-06T01:39:12.171 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : xfsprogs-devel-5.0.0-8.el8.x86_64 91/122 2023-10-06T01:39:12.171 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 92/122 2023-10-06T01:39:12.171 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libuuid-devel-2.32.1-27.el8.x86_64 93/122 2023-10-06T01:39:12.171 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 94/122 2023-10-06T01:39:12.172 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 95/122 2023-10-06T01:39:12.172 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 96/122 2023-10-06T01:39:12.172 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : jq-1.5-12.el8.x86_64 97/122 2023-10-06T01:39:12.172 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : flex-2.6.1-9.el8.x86_64 98/122 2023-10-06T01:39:12.172 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 99/122 2023-10-06T01:39:12.172 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 100/122 2023-10-06T01:39:12.172 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 101/122 2023-10-06T01:39:12.172 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : bison-3.0.4-10.el8.x86_64 102/122 2023-10-06T01:39:12.172 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 103/122 2023-10-06T01:39:12.172 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 104/122 2023-10-06T01:39:12.172 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 105/122 2023-10-06T01:39:12.173 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 106/122 2023-10-06T01:39:12.173 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/122 2023-10-06T01:39:12.173 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 108/122 2023-10-06T01:39:12.173 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 109/122 2023-10-06T01:39:12.173 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 110/122 2023-10-06T01:39:12.173 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 111/122 2023-10-06T01:39:12.173 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 112/122 2023-10-06T01:39:12.173 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 113/122 2023-10-06T01:39:12.173 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 114/122 2023-10-06T01:39:12.173 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 115/122 2023-10-06T01:39:12.173 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 116/122 2023-10-06T01:39:12.173 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 117/122 2023-10-06T01:39:12.174 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : automake-1.16.1-7.el8.noarch 118/122 2023-10-06T01:39:12.174 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 119/122 2023-10-06T01:39:12.174 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 120/122 2023-10-06T01:39:12.174 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 121/122 2023-10-06T01:39:12.346 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : rbd-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 116/122 2023-10-06T01:39:12.540 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : rbd-nbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 117/122 2023-10-06T01:39:12.773 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 118/122 2023-10-06T01:39:13.013 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : bison-3.0.4-10.el8.x86_64 119/122 2023-10-06T01:39:13.077 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 119/122 2023-10-06T01:39:13.280 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : flex-2.6.1-9.el8.x86_64 120/122 2023-10-06T01:39:13.290 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 120/122 2023-10-06T01:39:13.290 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-06T01:39:13.533 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-06T01:39:13.533 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T01:39:14.315 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T01:39:14.316 INFO:teuthology.orchestra.run.smithi072.stdout:Last metadata expiration check: 0:01:56 ago on Fri 06 Oct 2023 01:37:18 AM UTC. 2023-10-06T01:39:14.435 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T01:39:14.436 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-2:17.2.6-1296.g736ac5ba.el8.x86_64 1/122 2023-10-06T01:39:14.436 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 2/122 2023-10-06T01:39:14.436 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 3/122 2023-10-06T01:39:14.436 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 4/122 2023-10-06T01:39:14.436 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-immutable-object-cache-2:17.2.6-1296.g736ac 5/122 2023-10-06T01:39:14.436 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 6/122 2023-10-06T01:39:14.436 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 7/122 2023-10-06T01:39:14.436 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 8/122 2023-10-06T01:39:14.436 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 9/122 2023-10-06T01:39:14.436 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 10/122 2023-10-06T01:39:14.437 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 11/122 2023-10-06T01:39:14.437 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-test-2:17.2.6-1296.g736ac5ba.el8.x86_64 12/122 2023-10-06T01:39:14.437 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 13/122 2023-10-06T01:39:14.437 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libcephfs-devel-2:17.2.6-1296.g736ac5ba.el8.x86_ 14/122 2023-10-06T01:39:14.437 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 15/122 2023-10-06T01:39:14.437 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 16/122 2023-10-06T01:39:14.437 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librados-devel-2:17.2.6-1296.g736ac5ba.el8.x86_6 17/122 2023-10-06T01:39:14.437 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86 18/122 2023-10-06T01:39:14.437 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 19/122 2023-10-06T01:39:14.437 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-ceph-argparse-2:17.2.6-1296.g736ac5ba.el 20/122 2023-10-06T01:39:14.437 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-ceph-common-2:17.2.6-1296.g736ac5ba.el8. 21/122 2023-10-06T01:39:14.438 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cephfs-2:17.2.6-1296.g736ac5ba.el8.x86_6 22/122 2023-10-06T01:39:14.438 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-rados-2:17.2.6-1296.g736ac5ba.el8.x86_64 23/122 2023-10-06T01:39:14.438 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-rbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 24/122 2023-10-06T01:39:14.438 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-rgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 25/122 2023-10-06T01:39:14.438 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : rbd-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 26/122 2023-10-06T01:39:14.438 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 27/122 2023-10-06T01:39:14.438 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : rbd-nbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 28/122 2023-10-06T01:39:14.438 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-grafana-dashboards-2:17.2.6-1296.g736ac5ba. 29/122 2023-10-06T01:39:14.438 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noa 30/122 2023-10-06T01:39:14.446 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.n 31/122 2023-10-06T01:39:14.446 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.6-1296.g736 32/122 2023-10-06T01:39:14.446 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-modules-core-2:17.2.6-1296.g736ac5ba.el 33/122 2023-10-06T01:39:14.446 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 34/122 2023-10-06T01:39:14.446 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-prometheus-alerts-2:17.2.6-1296.g736ac5ba.e 35/122 2023-10-06T01:39:14.447 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 36/122 2023-10-06T01:39:14.447 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 37/122 2023-10-06T01:39:14.447 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : cephfs-top-2:17.2.6-1296.g736ac5ba.el8.noarch 38/122 2023-10-06T01:39:14.447 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/122 2023-10-06T01:39:14.447 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/122 2023-10-06T01:39:14.447 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/122 2023-10-06T01:39:14.447 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/122 2023-10-06T01:39:14.447 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/122 2023-10-06T01:39:14.447 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/122 2023-10-06T01:39:14.447 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/122 2023-10-06T01:39:14.447 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/122 2023-10-06T01:39:14.448 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/122 2023-10-06T01:39:14.448 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/122 2023-10-06T01:39:14.448 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/122 2023-10-06T01:39:14.448 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/122 2023-10-06T01:39:14.448 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/122 2023-10-06T01:39:14.448 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/122 2023-10-06T01:39:14.448 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/122 2023-10-06T01:39:14.448 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/122 2023-10-06T01:39:14.448 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/122 2023-10-06T01:39:14.448 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/122 2023-10-06T01:39:14.448 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/122 2023-10-06T01:39:14.449 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/122 2023-10-06T01:39:14.449 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/122 2023-10-06T01:39:14.449 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/122 2023-10-06T01:39:14.449 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/122 2023-10-06T01:39:14.449 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/122 2023-10-06T01:39:14.449 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/122 2023-10-06T01:39:14.449 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/122 2023-10-06T01:39:14.449 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/122 2023-10-06T01:39:14.449 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/122 2023-10-06T01:39:14.449 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/122 2023-10-06T01:39:14.449 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/122 2023-10-06T01:39:14.450 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/122 2023-10-06T01:39:14.450 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/122 2023-10-06T01:39:14.450 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/122 2023-10-06T01:39:14.450 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 72/122 2023-10-06T01:39:14.450 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 73/122 2023-10-06T01:39:14.451 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 74/122 2023-10-06T01:39:14.451 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : jq-1.5-12.el8.x86_64 75/122 2023-10-06T01:39:14.451 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : flex-2.6.1-9.el8.x86_64 76/122 2023-10-06T01:39:14.451 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 77/122 2023-10-06T01:39:14.451 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 78/122 2023-10-06T01:39:14.451 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 79/122 2023-10-06T01:39:14.451 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : bison-3.0.4-10.el8.x86_64 80/122 2023-10-06T01:39:14.451 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 81/122 2023-10-06T01:39:14.451 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 82/122 2023-10-06T01:39:14.451 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 83/122 2023-10-06T01:39:14.451 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 84/122 2023-10-06T01:39:14.452 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 85/122 2023-10-06T01:39:14.452 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 86/122 2023-10-06T01:39:14.452 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 87/122 2023-10-06T01:39:14.452 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 88/122 2023-10-06T01:39:14.452 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 89/122 2023-10-06T01:39:14.452 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 90/122 2023-10-06T01:39:14.452 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 91/122 2023-10-06T01:39:14.452 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 92/122 2023-10-06T01:39:14.452 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 93/122 2023-10-06T01:39:14.453 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 94/122 2023-10-06T01:39:14.453 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 95/122 2023-10-06T01:39:14.453 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : automake-1.16.1-7.el8.noarch 96/122 2023-10-06T01:39:14.453 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 97/122 2023-10-06T01:39:14.453 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 98/122 2023-10-06T01:39:14.453 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 99/122 2023-10-06T01:39:14.453 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 100/122 2023-10-06T01:39:14.453 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 101/122 2023-10-06T01:39:14.453 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 102/122 2023-10-06T01:39:14.453 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 103/122 2023-10-06T01:39:14.453 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : openssl-devel-1:1.1.1g-15.el8_3.x86_64 104/122 2023-10-06T01:39:14.454 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 105/122 2023-10-06T01:39:14.454 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 106/122 2023-10-06T01:39:14.454 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 107/122 2023-10-06T01:39:14.454 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : elfutils-libelf-devel-0.182-3.el8.x86_64 108/122 2023-10-06T01:39:14.454 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 109/122 2023-10-06T01:39:14.454 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 110/122 2023-10-06T01:39:14.454 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libsepol-devel-2.9-2.el8.x86_64 111/122 2023-10-06T01:39:14.454 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 112/122 2023-10-06T01:39:14.454 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 113/122 2023-10-06T01:39:14.454 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : krb5-devel-1.18.2-8.3.el8_4.x86_64 114/122 2023-10-06T01:39:14.454 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 115/122 2023-10-06T01:39:14.455 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : xfsprogs-devel-5.0.0-8.el8.x86_64 116/122 2023-10-06T01:39:14.455 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 117/122 2023-10-06T01:39:14.455 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libuuid-devel-2.32.1-27.el8.x86_64 118/122 2023-10-06T01:39:14.455 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 119/122 2023-10-06T01:39:14.455 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 120/122 2023-10-06T01:39:14.455 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 121/122 2023-10-06T01:39:16.484 INFO:teuthology.orchestra.run.smithi072.stdout:Installed products updated. 2023-10-06T01:39:16.636 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-06T01:39:16.636 INFO:teuthology.orchestra.run.smithi072.stdout:Upgraded: 2023-10-06T01:39:16.636 INFO:teuthology.orchestra.run.smithi072.stdout: librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:39:16.636 INFO:teuthology.orchestra.run.smithi072.stdout: librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:39:16.637 INFO:teuthology.orchestra.run.smithi072.stdout:Installed: 2023-10-06T01:39:16.637 INFO:teuthology.orchestra.run.smithi072.stdout: automake-1.16.1-7.el8.noarch 2023-10-06T01:39:16.637 INFO:teuthology.orchestra.run.smithi072.stdout: bison-3.0.4-10.el8.x86_64 2023-10-06T01:39:16.637 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:39:16.637 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:39:16.637 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:39:16.637 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:39:16.637 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-grafana-dashboards-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T01:39:16.637 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-immutable-object-cache-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:39:16.637 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:39:16.637 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:39:16.637 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T01:39:16.638 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T01:39:16.638 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-diskprediction-local-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T01:39:16.638 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-modules-core-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T01:39:16.638 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T01:39:16.638 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:39:16.638 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:39:16.638 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-prometheus-alerts-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T01:39:16.638 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:39:16.638 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:39:16.638 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-test-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:39:16.638 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T01:39:16.639 INFO:teuthology.orchestra.run.smithi072.stdout: cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T01:39:16.639 INFO:teuthology.orchestra.run.smithi072.stdout: cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:39:16.639 INFO:teuthology.orchestra.run.smithi072.stdout: cephfs-top-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T01:39:16.639 INFO:teuthology.orchestra.run.smithi072.stdout: elfutils-libelf-devel-0.182-3.el8.x86_64 2023-10-06T01:39:16.639 INFO:teuthology.orchestra.run.smithi072.stdout: flex-2.6.1-9.el8.x86_64 2023-10-06T01:39:16.639 INFO:teuthology.orchestra.run.smithi072.stdout: fuse-2.9.7-12.el8.x86_64 2023-10-06T01:39:16.639 INFO:teuthology.orchestra.run.smithi072.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-06T01:39:16.639 INFO:teuthology.orchestra.run.smithi072.stdout: jq-1.5-12.el8.x86_64 2023-10-06T01:39:16.639 INFO:teuthology.orchestra.run.smithi072.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2023-10-06T01:39:16.639 INFO:teuthology.orchestra.run.smithi072.stdout: krb5-devel-1.18.2-8.3.el8_4.x86_64 2023-10-06T01:39:16.639 INFO:teuthology.orchestra.run.smithi072.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-06T01:39:16.640 INFO:teuthology.orchestra.run.smithi072.stdout: libcephfs-devel-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:39:16.640 INFO:teuthology.orchestra.run.smithi072.stdout: libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:39:16.640 INFO:teuthology.orchestra.run.smithi072.stdout: libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:39:16.640 INFO:teuthology.orchestra.run.smithi072.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2023-10-06T01:39:16.640 INFO:teuthology.orchestra.run.smithi072.stdout: libgfortran-8.4.1-1.el8.x86_64 2023-10-06T01:39:16.640 INFO:teuthology.orchestra.run.smithi072.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-06T01:39:16.640 INFO:teuthology.orchestra.run.smithi072.stdout: libquadmath-8.4.1-1.el8.x86_64 2023-10-06T01:39:16.640 INFO:teuthology.orchestra.run.smithi072.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-06T01:39:16.640 INFO:teuthology.orchestra.run.smithi072.stdout: librados-devel-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:39:16.640 INFO:teuthology.orchestra.run.smithi072.stdout: libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:39:16.640 INFO:teuthology.orchestra.run.smithi072.stdout: librdkafka-0.11.4-1.el8.x86_64 2023-10-06T01:39:16.640 INFO:teuthology.orchestra.run.smithi072.stdout: librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:39:16.641 INFO:teuthology.orchestra.run.smithi072.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-06T01:39:16.641 INFO:teuthology.orchestra.run.smithi072.stdout: libsepol-devel-2.9-2.el8.x86_64 2023-10-06T01:39:16.641 INFO:teuthology.orchestra.run.smithi072.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-06T01:39:16.641 INFO:teuthology.orchestra.run.smithi072.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-06T01:39:16.641 INFO:teuthology.orchestra.run.smithi072.stdout: libuuid-devel-2.32.1-27.el8.x86_64 2023-10-06T01:39:16.641 INFO:teuthology.orchestra.run.smithi072.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-06T01:39:16.641 INFO:teuthology.orchestra.run.smithi072.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-06T01:39:16.641 INFO:teuthology.orchestra.run.smithi072.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-06T01:39:16.641 INFO:teuthology.orchestra.run.smithi072.stdout: openblas-0.3.12-1.el8.x86_64 2023-10-06T01:39:16.641 INFO:teuthology.orchestra.run.smithi072.stdout: openblas-threads-0.3.12-1.el8.x86_64 2023-10-06T01:39:16.641 INFO:teuthology.orchestra.run.smithi072.stdout: openssl-devel-1:1.1.1g-15.el8_3.x86_64 2023-10-06T01:39:16.641 INFO:teuthology.orchestra.run.smithi072.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-06T01:39:16.642 INFO:teuthology.orchestra.run.smithi072.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-06T01:39:16.642 INFO:teuthology.orchestra.run.smithi072.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-06T01:39:16.642 INFO:teuthology.orchestra.run.smithi072.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-06T01:39:16.642 INFO:teuthology.orchestra.run.smithi072.stdout: python3-babel-2.5.1-5.el8.noarch 2023-10-06T01:39:16.642 INFO:teuthology.orchestra.run.smithi072.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-06T01:39:16.642 INFO:teuthology.orchestra.run.smithi072.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-06T01:39:16.642 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-06T01:39:16.642 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ceph-argparse-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:39:16.642 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:39:16.642 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cephfs-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:39:16.642 INFO:teuthology.orchestra.run.smithi072.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-06T01:39:16.643 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-06T01:39:16.643 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-06T01:39:16.643 INFO:teuthology.orchestra.run.smithi072.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-06T01:39:16.643 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-06T01:39:16.643 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-06T01:39:16.643 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2023-10-06T01:39:16.643 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-06T01:39:16.643 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-06T01:39:16.643 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-06T01:39:16.643 INFO:teuthology.orchestra.run.smithi072.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-06T01:39:16.643 INFO:teuthology.orchestra.run.smithi072.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-06T01:39:16.643 INFO:teuthology.orchestra.run.smithi072.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-06T01:39:16.644 INFO:teuthology.orchestra.run.smithi072.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-06T01:39:16.644 INFO:teuthology.orchestra.run.smithi072.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-06T01:39:16.644 INFO:teuthology.orchestra.run.smithi072.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-06T01:39:16.644 INFO:teuthology.orchestra.run.smithi072.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2023-10-06T01:39:16.644 INFO:teuthology.orchestra.run.smithi072.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2023-10-06T01:39:16.644 INFO:teuthology.orchestra.run.smithi072.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-06T01:39:16.644 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-06T01:39:16.644 INFO:teuthology.orchestra.run.smithi072.stdout: python3-portend-2.6-1.el8.noarch 2023-10-06T01:39:16.644 INFO:teuthology.orchestra.run.smithi072.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-06T01:39:16.644 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-06T01:39:16.645 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-06T01:39:16.645 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-06T01:39:16.645 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rados-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:39:16.645 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:39:16.645 INFO:teuthology.orchestra.run.smithi072.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-06T01:39:16.645 INFO:teuthology.orchestra.run.smithi072.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-06T01:39:16.645 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:39:16.645 INFO:teuthology.orchestra.run.smithi072.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-06T01:39:16.645 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-06T01:39:16.645 INFO:teuthology.orchestra.run.smithi072.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2023-10-06T01:39:16.646 INFO:teuthology.orchestra.run.smithi072.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-06T01:39:16.646 INFO:teuthology.orchestra.run.smithi072.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-06T01:39:16.646 INFO:teuthology.orchestra.run.smithi072.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-06T01:39:16.646 INFO:teuthology.orchestra.run.smithi072.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-06T01:39:16.646 INFO:teuthology.orchestra.run.smithi072.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-06T01:39:16.646 INFO:teuthology.orchestra.run.smithi072.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-06T01:39:16.646 INFO:teuthology.orchestra.run.smithi072.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-06T01:39:16.646 INFO:teuthology.orchestra.run.smithi072.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-06T01:39:16.646 INFO:teuthology.orchestra.run.smithi072.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-06T01:39:16.646 INFO:teuthology.orchestra.run.smithi072.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-06T01:39:16.646 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:39:16.646 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:39:16.647 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-nbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:39:16.647 INFO:teuthology.orchestra.run.smithi072.stdout: socat-1.7.3.3-2.el8.x86_64 2023-10-06T01:39:16.647 INFO:teuthology.orchestra.run.smithi072.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-06T01:39:16.647 INFO:teuthology.orchestra.run.smithi072.stdout: xfsprogs-devel-5.0.0-8.el8.x86_64 2023-10-06T01:39:16.647 INFO:teuthology.orchestra.run.smithi072.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-06T01:39:16.647 INFO:teuthology.orchestra.run.smithi072.stdout: zlib-devel-1.2.11-17.el8.x86_64 2023-10-06T01:39:16.647 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-06T01:39:16.648 INFO:teuthology.orchestra.run.smithi072.stdout:Complete! 2023-10-06T01:39:16.797 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T01:39:16.798 INFO:teuthology.orchestra.run.smithi071.stdout:Last metadata expiration check: 0:01:59 ago on Fri 06 Oct 2023 01:37:17 AM UTC. 2023-10-06T01:39:16.960 DEBUG:teuthology.parallel:result is None 2023-10-06T01:39:19.038 INFO:teuthology.orchestra.run.smithi071.stdout:Installed products updated. 2023-10-06T01:39:19.186 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:39:19.186 INFO:teuthology.orchestra.run.smithi071.stdout:Upgraded: 2023-10-06T01:39:19.186 INFO:teuthology.orchestra.run.smithi071.stdout: librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:39:19.186 INFO:teuthology.orchestra.run.smithi071.stdout: librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:39:19.186 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2023-10-06T01:39:19.186 INFO:teuthology.orchestra.run.smithi071.stdout: automake-1.16.1-7.el8.noarch 2023-10-06T01:39:19.186 INFO:teuthology.orchestra.run.smithi071.stdout: bison-3.0.4-10.el8.x86_64 2023-10-06T01:39:19.186 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:39:19.186 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:39:19.187 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:39:19.187 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:39:19.187 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-grafana-dashboards-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T01:39:19.187 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-immutable-object-cache-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:39:19.187 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:39:19.187 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:39:19.187 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T01:39:19.187 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T01:39:19.187 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-diskprediction-local-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T01:39:19.187 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-modules-core-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T01:39:19.187 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T01:39:19.187 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:39:19.188 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:39:19.188 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-prometheus-alerts-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T01:39:19.188 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:39:19.188 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:39:19.188 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-test-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:39:19.188 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T01:39:19.188 INFO:teuthology.orchestra.run.smithi071.stdout: cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T01:39:19.188 INFO:teuthology.orchestra.run.smithi071.stdout: cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:39:19.188 INFO:teuthology.orchestra.run.smithi071.stdout: cephfs-top-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T01:39:19.188 INFO:teuthology.orchestra.run.smithi071.stdout: elfutils-libelf-devel-0.182-3.el8.x86_64 2023-10-06T01:39:19.188 INFO:teuthology.orchestra.run.smithi071.stdout: flex-2.6.1-9.el8.x86_64 2023-10-06T01:39:19.188 INFO:teuthology.orchestra.run.smithi071.stdout: fuse-2.9.7-12.el8.x86_64 2023-10-06T01:39:19.189 INFO:teuthology.orchestra.run.smithi071.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-06T01:39:19.189 INFO:teuthology.orchestra.run.smithi071.stdout: jq-1.5-12.el8.x86_64 2023-10-06T01:39:19.189 INFO:teuthology.orchestra.run.smithi071.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2023-10-06T01:39:19.189 INFO:teuthology.orchestra.run.smithi071.stdout: krb5-devel-1.18.2-8.3.el8_4.x86_64 2023-10-06T01:39:19.189 INFO:teuthology.orchestra.run.smithi071.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-06T01:39:19.189 INFO:teuthology.orchestra.run.smithi071.stdout: libcephfs-devel-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:39:19.189 INFO:teuthology.orchestra.run.smithi071.stdout: libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:39:19.189 INFO:teuthology.orchestra.run.smithi071.stdout: libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:39:19.189 INFO:teuthology.orchestra.run.smithi071.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2023-10-06T01:39:19.189 INFO:teuthology.orchestra.run.smithi071.stdout: libgfortran-8.4.1-1.el8.x86_64 2023-10-06T01:39:19.189 INFO:teuthology.orchestra.run.smithi071.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-06T01:39:19.190 INFO:teuthology.orchestra.run.smithi071.stdout: libquadmath-8.4.1-1.el8.x86_64 2023-10-06T01:39:19.190 INFO:teuthology.orchestra.run.smithi071.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-06T01:39:19.190 INFO:teuthology.orchestra.run.smithi071.stdout: librados-devel-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:39:19.190 INFO:teuthology.orchestra.run.smithi071.stdout: libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:39:19.190 INFO:teuthology.orchestra.run.smithi071.stdout: librdkafka-0.11.4-1.el8.x86_64 2023-10-06T01:39:19.190 INFO:teuthology.orchestra.run.smithi071.stdout: librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:39:19.190 INFO:teuthology.orchestra.run.smithi071.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-06T01:39:19.190 INFO:teuthology.orchestra.run.smithi071.stdout: libsepol-devel-2.9-2.el8.x86_64 2023-10-06T01:39:19.190 INFO:teuthology.orchestra.run.smithi071.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-06T01:39:19.190 INFO:teuthology.orchestra.run.smithi071.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-06T01:39:19.191 INFO:teuthology.orchestra.run.smithi071.stdout: libuuid-devel-2.32.1-27.el8.x86_64 2023-10-06T01:39:19.191 INFO:teuthology.orchestra.run.smithi071.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-06T01:39:19.191 INFO:teuthology.orchestra.run.smithi071.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-06T01:39:19.191 INFO:teuthology.orchestra.run.smithi071.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-06T01:39:19.191 INFO:teuthology.orchestra.run.smithi071.stdout: openblas-0.3.12-1.el8.x86_64 2023-10-06T01:39:19.191 INFO:teuthology.orchestra.run.smithi071.stdout: openblas-threads-0.3.12-1.el8.x86_64 2023-10-06T01:39:19.191 INFO:teuthology.orchestra.run.smithi071.stdout: openssl-devel-1:1.1.1g-15.el8_3.x86_64 2023-10-06T01:39:19.191 INFO:teuthology.orchestra.run.smithi071.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-06T01:39:19.191 INFO:teuthology.orchestra.run.smithi071.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-06T01:39:19.191 INFO:teuthology.orchestra.run.smithi071.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-06T01:39:19.192 INFO:teuthology.orchestra.run.smithi071.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-06T01:39:19.192 INFO:teuthology.orchestra.run.smithi071.stdout: python3-babel-2.5.1-5.el8.noarch 2023-10-06T01:39:19.192 INFO:teuthology.orchestra.run.smithi071.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-06T01:39:19.192 INFO:teuthology.orchestra.run.smithi071.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-06T01:39:19.192 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-06T01:39:19.192 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ceph-argparse-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:39:19.192 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:39:19.192 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cephfs-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:39:19.192 INFO:teuthology.orchestra.run.smithi071.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-06T01:39:19.193 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-06T01:39:19.193 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-06T01:39:19.193 INFO:teuthology.orchestra.run.smithi071.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-06T01:39:19.193 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-06T01:39:19.193 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-06T01:39:19.193 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2023-10-06T01:39:19.193 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-06T01:39:19.193 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-06T01:39:19.193 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-06T01:39:19.193 INFO:teuthology.orchestra.run.smithi071.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-06T01:39:19.193 INFO:teuthology.orchestra.run.smithi071.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-06T01:39:19.193 INFO:teuthology.orchestra.run.smithi071.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-06T01:39:19.194 INFO:teuthology.orchestra.run.smithi071.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-06T01:39:19.194 INFO:teuthology.orchestra.run.smithi071.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-06T01:39:19.194 INFO:teuthology.orchestra.run.smithi071.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-06T01:39:19.194 INFO:teuthology.orchestra.run.smithi071.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2023-10-06T01:39:19.194 INFO:teuthology.orchestra.run.smithi071.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2023-10-06T01:39:19.194 INFO:teuthology.orchestra.run.smithi071.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-06T01:39:19.195 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-06T01:39:19.195 INFO:teuthology.orchestra.run.smithi071.stdout: python3-portend-2.6-1.el8.noarch 2023-10-06T01:39:19.195 INFO:teuthology.orchestra.run.smithi071.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-06T01:39:19.195 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-06T01:39:19.195 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-06T01:39:19.195 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-06T01:39:19.195 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rados-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:39:19.195 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:39:19.195 INFO:teuthology.orchestra.run.smithi071.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-06T01:39:19.195 INFO:teuthology.orchestra.run.smithi071.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-06T01:39:19.195 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:39:19.196 INFO:teuthology.orchestra.run.smithi071.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-06T01:39:19.196 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-06T01:39:19.196 INFO:teuthology.orchestra.run.smithi071.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2023-10-06T01:39:19.196 INFO:teuthology.orchestra.run.smithi071.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-06T01:39:19.196 INFO:teuthology.orchestra.run.smithi071.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-06T01:39:19.196 INFO:teuthology.orchestra.run.smithi071.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-06T01:39:19.196 INFO:teuthology.orchestra.run.smithi071.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-06T01:39:19.196 INFO:teuthology.orchestra.run.smithi071.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-06T01:39:19.196 INFO:teuthology.orchestra.run.smithi071.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-06T01:39:19.196 INFO:teuthology.orchestra.run.smithi071.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-06T01:39:19.196 INFO:teuthology.orchestra.run.smithi071.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-06T01:39:19.197 INFO:teuthology.orchestra.run.smithi071.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-06T01:39:19.197 INFO:teuthology.orchestra.run.smithi071.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-06T01:39:19.197 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:39:19.197 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:39:19.197 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-nbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:39:19.197 INFO:teuthology.orchestra.run.smithi071.stdout: socat-1.7.3.3-2.el8.x86_64 2023-10-06T01:39:19.197 INFO:teuthology.orchestra.run.smithi071.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-06T01:39:19.197 INFO:teuthology.orchestra.run.smithi071.stdout: xfsprogs-devel-5.0.0-8.el8.x86_64 2023-10-06T01:39:19.197 INFO:teuthology.orchestra.run.smithi071.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-06T01:39:19.198 INFO:teuthology.orchestra.run.smithi071.stdout: zlib-devel-1.2.11-17.el8.x86_64 2023-10-06T01:39:19.198 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:39:19.198 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2023-10-06T01:39:19.429 DEBUG:teuthology.parallel:result is None 2023-10-06T01:39:19.430 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 2023-10-06T01:39:19.743 DEBUG:teuthology.orchestra.run.smithi071:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-06T01:39:19.765 INFO:teuthology.orchestra.run.smithi071.stdout:17.2.6-1296.g736ac5ba.el8 2023-10-06T01:39:19.765 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1296.g736ac5ba.el8 2023-10-06T01:39:19.766 INFO:teuthology.task.install:The correct ceph version 17.2.6-1296.g736ac5ba is installed. 2023-10-06T01:39:19.766 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 2023-10-06T01:39:19.905 DEBUG:teuthology.orchestra.run.smithi072:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-06T01:39:19.929 INFO:teuthology.orchestra.run.smithi072.stdout:17.2.6-1296.g736ac5ba.el8 2023-10-06T01:39:19.930 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1296.g736ac5ba.el8 2023-10-06T01:39:19.930 INFO:teuthology.task.install:The correct ceph version 17.2.6-1296.g736ac5ba is installed. 2023-10-06T01:39:19.930 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-06T01:39:19.930 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-10-06T01:39:19.930 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-06T01:39:19.968 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-06T01:39:19.969 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-06T01:39:20.009 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-06T01:39:20.009 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-10-06T01:39:20.010 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/usr/bin/daemon-helper 2023-10-06T01:39:20.034 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-06T01:39:20.098 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-06T01:39:20.098 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/usr/bin/daemon-helper 2023-10-06T01:39:20.124 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-06T01:39:20.190 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-06T01:39:20.190 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-10-06T01:39:20.191 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-06T01:39:20.215 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-06T01:39:20.279 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-06T01:39:20.279 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-06T01:39:20.305 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-06T01:39:20.370 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-06T01:39:20.371 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-10-06T01:39:20.371 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/usr/bin/stdin-killer 2023-10-06T01:39:20.395 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-06T01:39:20.459 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-06T01:39:20.459 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/usr/bin/stdin-killer 2023-10-06T01:39:20.485 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-06T01:39:20.549 INFO:teuthology.run_tasks:Running task ceph... 2023-10-06T01:39:20.621 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-10-06T01:39:20.621 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 777 /var/log/ceph 2023-10-06T01:39:20.624 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 777 /var/log/ceph 2023-10-06T01:39:20.648 INFO:tasks.ceph:Disabling ceph logrotate... 2023-10-06T01:39:20.648 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-06T01:39:20.688 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-06T01:39:20.712 INFO:tasks.ceph:Creating extra log directories... 2023-10-06T01:39:20.713 DEBUG:teuthology.orchestra.run.smithi071:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-06T01:39:20.751 DEBUG:teuthology.orchestra.run.smithi072:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-06T01:39:20.783 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-10-06T01:39:20.783 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-10-06T01:39:20.783 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-10-06T01:39:20.784 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-10-06T01:39:20.784 DEBUG:teuthology.orchestra.run.smithi071:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-06T01:39:20.827 DEBUG:teuthology.orchestra.run.smithi071:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-06T01:39:20.936 DEBUG:teuthology.orchestra.run.smithi071:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-06T01:39:20.959 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-06T01:39:20.960 DEBUG:teuthology.orchestra.run.smithi072:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-06T01:39:20.974 DEBUG:teuthology.orchestra.run.smithi072:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-06T01:39:21.084 DEBUG:teuthology.orchestra.run.smithi072:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-06T01:39:21.129 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-10-06T01:39:21.129 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'force file system read-only', 'bad backtrace', 'MDS in read-only mode', '\\(MDS_READ_ONLY\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-10-06T01:39:21.129 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412092', 'branch': 'wip-yuri-testing-2023-10-05-0730-quincy', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/auto-repair}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7412092', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.4', 'overrides': {'admin_socket': {'branch': 'wip-yuri-testing-2023-10-05-0730-quincy'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'force file system read-only', 'bad backtrace', 'MDS in read-only mode', '\\(MDS_READ_ONLY\\)'], 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri-testing-2023-10-05-0730-quincy', 'sha1': 'f1e315a9732d36c05ec316678e2397dc58561c7f'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 7519, 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2', 'sleep_before_teardown': 0, 'subset': '111/12000', 'suite': 'fs', 'suite_branch': 'wip-yuri-testing-2023-10-05-0730-quincy', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_f1e315a9732d36c05ec316678e2397dc58561c7f/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': 'f1e315a9732d36c05ec316678e2397dc58561c7f', 'targets': {'smithi071.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOARrpVsuelpPHrKQz9fgxjsSMLYVQZw9/j/SJSe42xtgeMSaokhcXmBhEqsLpgD7mrfjvBYaajAwxC9YbyrVCo=', 'smithi072.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKAOUnKDmq8dM80lRaXjuGcm/tuYAcwg0zb0tU+4ZiSl9leZ0oV3Z9l2uUo7fyq2Bii/XYSJgbx9T/lUp4hASiI='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2'}}, {'ceph': None}, {'ceph-fuse': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_auto_repair']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '54e62bcbac4e53d9685e08328b790d3b20d71cae', 'timestamp': '2023-10-05_23:52:50', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-10-06T01:39:21.130 DEBUG:teuthology.orchestra.run.smithi071:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-06T01:39:21.132 DEBUG:teuthology.orchestra.run.smithi072:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-06T01:39:21.178 DEBUG:teuthology.orchestra.run.smithi071:> sudo install -d -m0777 -- /var/run/ceph 2023-10-06T01:39:21.187 DEBUG:teuthology.orchestra.run.smithi072:> sudo install -d -m0777 -- /var/run/ceph 2023-10-06T01:39:21.241 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-10-06T01:39:21.241 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/scratch_devs of=/dev/stdout 2023-10-06T01:39:21.264 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-06T01:39:21.264 DEBUG:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_1 2023-10-06T01:39:21.319 INFO:teuthology.orchestra.run.smithi071.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-06T01:39:21.319 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T01:39:21.319 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 6h/6d Inode: 216686 Links: 1 2023-10-06T01:39:21.319 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T01:39:21.319 INFO:teuthology.orchestra.run.smithi071.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T01:39:21.319 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2023-10-06 01:39:14.027392600 +0000 2023-10-06T01:39:21.319 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2023-10-06 01:34:16.296878871 +0000 2023-10-06T01:39:21.319 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2023-10-06 01:34:16.296878871 +0000 2023-10-06T01:39:21.320 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: - 2023-10-06T01:39:21.320 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-06T01:39:21.382 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2023-10-06T01:39:21.382 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2023-10-06T01:39:21.382 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes copied, 0.000230492 s, 2.2 MB/s 2023-10-06T01:39:21.383 DEBUG:teuthology.orchestra.run.smithi071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-06T01:39:21.439 DEBUG:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_2 2023-10-06T01:39:21.494 INFO:teuthology.orchestra.run.smithi071.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-06T01:39:21.494 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T01:39:21.494 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 6h/6d Inode: 216749 Links: 1 2023-10-06T01:39:21.494 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T01:39:21.494 INFO:teuthology.orchestra.run.smithi071.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T01:39:21.495 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2023-10-06 01:39:14.027392600 +0000 2023-10-06T01:39:21.495 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2023-10-06 01:34:16.772870915 +0000 2023-10-06T01:39:21.495 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2023-10-06 01:34:16.772870915 +0000 2023-10-06T01:39:21.495 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: - 2023-10-06T01:39:21.495 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-06T01:39:21.557 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2023-10-06T01:39:21.557 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2023-10-06T01:39:21.557 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes copied, 0.000224453 s, 2.3 MB/s 2023-10-06T01:39:21.558 DEBUG:teuthology.orchestra.run.smithi071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-06T01:39:21.614 DEBUG:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_3 2023-10-06T01:39:21.668 INFO:teuthology.orchestra.run.smithi071.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-06T01:39:21.668 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T01:39:21.668 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 6h/6d Inode: 218595 Links: 1 2023-10-06T01:39:21.668 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T01:39:21.669 INFO:teuthology.orchestra.run.smithi071.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T01:39:21.669 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2023-10-06 01:39:14.027392600 +0000 2023-10-06T01:39:21.669 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2023-10-06 01:34:17.265862677 +0000 2023-10-06T01:39:21.669 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2023-10-06 01:34:17.265862677 +0000 2023-10-06T01:39:21.669 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: - 2023-10-06T01:39:21.669 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-06T01:39:21.731 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2023-10-06T01:39:21.731 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2023-10-06T01:39:21.731 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes copied, 0.000265753 s, 1.9 MB/s 2023-10-06T01:39:21.732 DEBUG:teuthology.orchestra.run.smithi071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-06T01:39:21.788 DEBUG:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_4 2023-10-06T01:39:21.843 INFO:teuthology.orchestra.run.smithi071.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-06T01:39:21.843 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T01:39:21.843 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 6h/6d Inode: 222365 Links: 1 2023-10-06T01:39:21.843 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T01:39:21.843 INFO:teuthology.orchestra.run.smithi071.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T01:39:21.843 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2023-10-06 01:39:14.027392600 +0000 2023-10-06T01:39:21.843 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2023-10-06 01:34:17.747854622 +0000 2023-10-06T01:39:21.844 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2023-10-06 01:34:17.747854622 +0000 2023-10-06T01:39:21.844 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: - 2023-10-06T01:39:21.844 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-06T01:39:21.906 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2023-10-06T01:39:21.906 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2023-10-06T01:39:21.906 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes copied, 0.000204913 s, 2.5 MB/s 2023-10-06T01:39:21.907 DEBUG:teuthology.orchestra.run.smithi071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-06T01:39:21.963 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T01:39:21.963 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-06T01:39:21.964 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/scratch_devs of=/dev/stdout 2023-10-06T01:39:21.980 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-06T01:39:21.980 DEBUG:teuthology.orchestra.run.smithi072:> stat /dev/vg_nvme/lv_1 2023-10-06T01:39:22.035 INFO:teuthology.orchestra.run.smithi072.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-06T01:39:22.035 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T01:39:22.035 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 6h/6d Inode: 217611 Links: 1 2023-10-06T01:39:22.035 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T01:39:22.035 INFO:teuthology.orchestra.run.smithi072.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T01:39:22.035 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 2023-10-06 01:39:11.752154519 +0000 2023-10-06T01:39:22.036 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2023-10-06 01:36:32.561608633 +0000 2023-10-06T01:39:22.036 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2023-10-06 01:36:32.561608633 +0000 2023-10-06T01:39:22.036 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: - 2023-10-06T01:39:22.036 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-06T01:39:22.099 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records in 2023-10-06T01:39:22.099 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records out 2023-10-06T01:39:22.099 INFO:teuthology.orchestra.run.smithi072.stderr:512 bytes copied, 0.000266114 s, 1.9 MB/s 2023-10-06T01:39:22.100 DEBUG:teuthology.orchestra.run.smithi072:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-06T01:39:22.157 DEBUG:teuthology.orchestra.run.smithi072:> stat /dev/vg_nvme/lv_2 2023-10-06T01:39:22.213 INFO:teuthology.orchestra.run.smithi072.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-06T01:39:22.213 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T01:39:22.213 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 6h/6d Inode: 220282 Links: 1 2023-10-06T01:39:22.213 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T01:39:22.213 INFO:teuthology.orchestra.run.smithi072.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T01:39:22.213 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 2023-10-06 01:39:11.752154519 +0000 2023-10-06T01:39:22.213 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2023-10-06 01:36:33.072598425 +0000 2023-10-06T01:39:22.213 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2023-10-06 01:36:33.072598425 +0000 2023-10-06T01:39:22.214 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: - 2023-10-06T01:39:22.214 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-06T01:39:22.276 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records in 2023-10-06T01:39:22.276 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records out 2023-10-06T01:39:22.276 INFO:teuthology.orchestra.run.smithi072.stderr:512 bytes copied, 0.000206919 s, 2.5 MB/s 2023-10-06T01:39:22.277 DEBUG:teuthology.orchestra.run.smithi072:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-06T01:39:22.333 DEBUG:teuthology.orchestra.run.smithi072:> stat /dev/vg_nvme/lv_3 2023-10-06T01:39:22.388 INFO:teuthology.orchestra.run.smithi072.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-06T01:39:22.388 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T01:39:22.388 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 6h/6d Inode: 220030 Links: 1 2023-10-06T01:39:22.388 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T01:39:22.389 INFO:teuthology.orchestra.run.smithi072.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T01:39:22.389 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 2023-10-06 01:39:11.752154519 +0000 2023-10-06T01:39:22.389 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2023-10-06 01:36:33.547588937 +0000 2023-10-06T01:39:22.389 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2023-10-06 01:36:33.547588937 +0000 2023-10-06T01:39:22.389 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: - 2023-10-06T01:39:22.389 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-06T01:39:22.450 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records in 2023-10-06T01:39:22.450 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records out 2023-10-06T01:39:22.451 INFO:teuthology.orchestra.run.smithi072.stderr:512 bytes copied, 0.0002028 s, 2.5 MB/s 2023-10-06T01:39:22.451 DEBUG:teuthology.orchestra.run.smithi072:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-06T01:39:22.507 DEBUG:teuthology.orchestra.run.smithi072:> stat /dev/vg_nvme/lv_4 2023-10-06T01:39:22.562 INFO:teuthology.orchestra.run.smithi072.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-06T01:39:22.562 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T01:39:22.562 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 6h/6d Inode: 220440 Links: 1 2023-10-06T01:39:22.563 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T01:39:22.563 INFO:teuthology.orchestra.run.smithi072.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T01:39:22.563 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 2023-10-06 01:39:11.752154519 +0000 2023-10-06T01:39:22.563 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2023-10-06 01:36:34.098577932 +0000 2023-10-06T01:39:22.563 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2023-10-06 01:36:34.098577932 +0000 2023-10-06T01:39:22.563 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: - 2023-10-06T01:39:22.563 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-06T01:39:22.625 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records in 2023-10-06T01:39:22.625 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records out 2023-10-06T01:39:22.626 INFO:teuthology.orchestra.run.smithi072.stderr:512 bytes copied, 0.00018923 s, 2.7 MB/s 2023-10-06T01:39:22.626 DEBUG:teuthology.orchestra.run.smithi072:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-06T01:39:22.682 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T01:39:22.682 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi071.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi072.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-06T01:39:22.682 INFO:tasks.ceph:Generating config... 2023-10-06T01:39:22.683 INFO:tasks.ceph:[client] client mount timeout = 600 2023-10-06T01:39:22.683 INFO:tasks.ceph:[client] debug client = 20 2023-10-06T01:39:22.683 INFO:tasks.ceph:[client] debug ms = 1 2023-10-06T01:39:22.684 INFO:tasks.ceph:[client] pid file = 2023-10-06T01:39:22.684 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-10-06T01:39:22.684 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-10-06T01:39:22.684 INFO:tasks.ceph:[mds] debug mds = 20 2023-10-06T01:39:22.684 INFO:tasks.ceph:[mds] debug ms = 1 2023-10-06T01:39:22.684 INFO:tasks.ceph:[mds] mds debug frag = True 2023-10-06T01:39:22.684 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-10-06T01:39:22.684 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-10-06T01:39:22.684 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-10-06T01:39:22.684 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-10-06T01:39:22.684 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-10-06T01:39:22.684 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-10-06T01:39:22.685 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-10-06T01:39:22.685 INFO:tasks.ceph:[mgr] debug ms = 1 2023-10-06T01:39:22.685 INFO:tasks.ceph:[mon] debug mon = 20 2023-10-06T01:39:22.685 INFO:tasks.ceph:[mon] debug ms = 1 2023-10-06T01:39:22.685 INFO:tasks.ceph:[mon] debug paxos = 20 2023-10-06T01:39:22.685 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-10-06T01:39:22.685 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-10-06T01:39:22.685 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-10-06T01:39:22.685 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-10-06T01:39:22.685 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-10-06T01:39:22.685 INFO:tasks.ceph:[osd] debug ms = 1 2023-10-06T01:39:22.685 INFO:tasks.ceph:[osd] debug osd = 20 2023-10-06T01:39:22.685 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-10-06T01:39:22.686 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-10-06T01:39:22.686 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-10-06T01:39:22.686 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-10-06T01:39:22.686 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-10-06T01:39:22.686 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-10-06T01:39:22.686 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-10-06T01:39:22.686 INFO:tasks.ceph:Setting up mon.a... 2023-10-06T01:39:22.686 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-10-06T01:39:22.741 INFO:teuthology.orchestra.run.smithi071.stdout:creating /etc/ceph/ceph.keyring 2023-10-06T01:39:22.744 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-10-06T01:39:22.784 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-06T01:39:22.849 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.71'), ('mon.b', '172.21.15.72'), ('mon.c', '[v2:172.21.15.72:3301,v1:172.21.15.72:6790]')] 2023-10-06T01:39:22.849 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.71,172.21.15.72,[v2:172.21.15.72:3301,v1:172.21.15.72:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-10-06T01:39:22.850 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-10-06T01:39:22.850 DEBUG:teuthology.orchestra.run.smithi071:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-10-06T01:39:22.904 DEBUG:teuthology.orchestra.run.smithi071:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.71 --add b 172.21.15.72 --addv c '[v2:172.21.15.72:3301,v1:172.21.15.72:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-10-06T01:39:22.986 INFO:teuthology.orchestra.run.smithi071.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-10-06T01:39:22.986 INFO:teuthology.orchestra.run.smithi071.stdout:monmaptool: generated fsid 1fbf1bd2-f9b4-4599-bea2-f4aa920e9a56 2023-10-06T01:39:22.986 INFO:teuthology.orchestra.run.smithi071.stdout:setting min_mon_release = octopus 2023-10-06T01:39:22.986 INFO:teuthology.orchestra.run.smithi071.stdout:epoch 0 2023-10-06T01:39:22.986 INFO:teuthology.orchestra.run.smithi071.stdout:fsid 1fbf1bd2-f9b4-4599-bea2-f4aa920e9a56 2023-10-06T01:39:22.987 INFO:teuthology.orchestra.run.smithi071.stdout:last_changed 2023-10-06T01:39:22.986599+0000 2023-10-06T01:39:22.987 INFO:teuthology.orchestra.run.smithi071.stdout:created 2023-10-06T01:39:22.986599+0000 2023-10-06T01:39:22.987 INFO:teuthology.orchestra.run.smithi071.stdout:min_mon_release 15 (octopus) 2023-10-06T01:39:22.987 INFO:teuthology.orchestra.run.smithi071.stdout:election_strategy: 1 2023-10-06T01:39:22.987 INFO:teuthology.orchestra.run.smithi071.stdout:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2023-10-06T01:39:22.987 INFO:teuthology.orchestra.run.smithi071.stdout:1: [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] mon.b 2023-10-06T01:39:22.987 INFO:teuthology.orchestra.run.smithi071.stdout:2: [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] mon.c 2023-10-06T01:39:22.988 INFO:teuthology.orchestra.run.smithi071.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-10-06T01:39:22.989 DEBUG:teuthology.orchestra.run.smithi071:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-10-06T01:39:23.043 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 1fbf1bd2-f9b4-4599-bea2-f4aa920e9a56... 2023-10-06T01:39:23.044 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T01:39:23.084 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T01:39:23.124 INFO:teuthology.orchestra.run.smithi071.stdout:[global] 2023-10-06T01:39:23.124 INFO:teuthology.orchestra.run.smithi071.stdout: chdir = "" 2023-10-06T01:39:23.124 INFO:teuthology.orchestra.run.smithi071.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T01:39:23.124 INFO:teuthology.orchestra.run.smithi071.stdout: auth supported = cephx 2023-10-06T01:39:23.124 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:39:23.124 INFO:teuthology.orchestra.run.smithi071.stdout: filestore xattr use omap = true 2023-10-06T01:39:23.124 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:39:23.124 INFO:teuthology.orchestra.run.smithi071.stdout: mon clock drift allowed = 1.000 2023-10-06T01:39:23.124 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:39:23.125 INFO:teuthology.orchestra.run.smithi071.stdout: osd crush chooseleaf type = 0 2023-10-06T01:39:23.125 INFO:teuthology.orchestra.run.smithi071.stdout: auth debug = true 2023-10-06T01:39:23.125 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:39:23.125 INFO:teuthology.orchestra.run.smithi071.stdout: ms die on old message = true 2023-10-06T01:39:23.125 INFO:teuthology.orchestra.run.smithi071.stdout: ms die on bug = true 2023-10-06T01:39:23.125 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:39:23.125 INFO:teuthology.orchestra.run.smithi071.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T01:39:23.125 INFO:teuthology.orchestra.run.smithi071.stdout: mon pg warn max object skew = 0 2023-10-06T01:39:23.125 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:39:23.125 INFO:teuthology.orchestra.run.smithi071.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T01:39:23.125 INFO:teuthology.orchestra.run.smithi071.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T01:39:23.126 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:39:23.126 INFO:teuthology.orchestra.run.smithi071.stdout: osd pool default size = 2 2023-10-06T01:39:23.126 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:39:23.126 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd allow primary affinity = true 2023-10-06T01:39:23.126 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd allow pg remap = true 2023-10-06T01:39:23.126 INFO:teuthology.orchestra.run.smithi071.stdout: mon warn on legacy crush tunables = false 2023-10-06T01:39:23.126 INFO:teuthology.orchestra.run.smithi071.stdout: mon warn on crush straw calc version zero = false 2023-10-06T01:39:23.126 INFO:teuthology.orchestra.run.smithi071.stdout: mon warn on no sortbitwise = false 2023-10-06T01:39:23.126 INFO:teuthology.orchestra.run.smithi071.stdout: mon warn on osd down out interval zero = false 2023-10-06T01:39:23.126 INFO:teuthology.orchestra.run.smithi071.stdout: mon warn on too few osds = false 2023-10-06T01:39:23.126 INFO:teuthology.orchestra.run.smithi071.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T01:39:23.127 INFO:teuthology.orchestra.run.smithi071.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T01:39:23.127 INFO:teuthology.orchestra.run.smithi071.stdout: mon_allow_pool_size_one = true 2023-10-06T01:39:23.127 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:39:23.127 INFO:teuthology.orchestra.run.smithi071.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T01:39:23.127 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:39:23.127 INFO:teuthology.orchestra.run.smithi071.stdout: osd default data pool replay window = 5 2023-10-06T01:39:23.127 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:39:23.127 INFO:teuthology.orchestra.run.smithi071.stdout: mon allow pool delete = true 2023-10-06T01:39:23.127 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:39:23.127 INFO:teuthology.orchestra.run.smithi071.stdout: mon cluster log file level = debug 2023-10-06T01:39:23.128 INFO:teuthology.orchestra.run.smithi071.stdout: debug asserts on shutdown = true 2023-10-06T01:39:23.128 INFO:teuthology.orchestra.run.smithi071.stdout: mon health detail to clog = false 2023-10-06T01:39:23.128 INFO:teuthology.orchestra.run.smithi071.stdout: mon host = "172.21.15.71,172.21.15.72,[v2:172.21.15.72:3301,v1:172.21.15.72:6790]" 2023-10-06T01:39:23.128 INFO:teuthology.orchestra.run.smithi071.stdout: fsid = 1fbf1bd2-f9b4-4599-bea2-f4aa920e9a56 2023-10-06T01:39:23.128 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:39:23.128 INFO:teuthology.orchestra.run.smithi071.stdout:[osd] 2023-10-06T01:39:23.128 INFO:teuthology.orchestra.run.smithi071.stdout: osd journal size = 100 2023-10-06T01:39:23.128 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:39:23.128 INFO:teuthology.orchestra.run.smithi071.stdout: osd scrub load threshold = 5.0 2023-10-06T01:39:23.129 INFO:teuthology.orchestra.run.smithi071.stdout: osd scrub max interval = 600 2023-10-06T01:39:23.129 INFO:teuthology.orchestra.run.smithi071.stdout: osd mclock profile = high_recovery_ops 2023-10-06T01:39:23.129 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:39:23.129 INFO:teuthology.orchestra.run.smithi071.stdout: osd recover clone overlap = true 2023-10-06T01:39:23.129 INFO:teuthology.orchestra.run.smithi071.stdout: osd recovery max chunk = 1048576 2023-10-06T01:39:23.129 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:39:23.129 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug shutdown = true 2023-10-06T01:39:23.129 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug op order = true 2023-10-06T01:39:23.129 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug verify stray on activate = true 2023-10-06T01:39:23.129 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:39:23.130 INFO:teuthology.orchestra.run.smithi071.stdout: osd open classes on start = true 2023-10-06T01:39:23.130 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug pg log writeout = true 2023-10-06T01:39:23.130 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:39:23.130 INFO:teuthology.orchestra.run.smithi071.stdout: osd deep scrub update digest min age = 30 2023-10-06T01:39:23.130 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:39:23.130 INFO:teuthology.orchestra.run.smithi071.stdout: osd map max advance = 10 2023-10-06T01:39:23.130 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:39:23.130 INFO:teuthology.orchestra.run.smithi071.stdout: journal zero on create = true 2023-10-06T01:39:23.130 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:39:23.130 INFO:teuthology.orchestra.run.smithi071.stdout: filestore ondisk finisher threads = 3 2023-10-06T01:39:23.131 INFO:teuthology.orchestra.run.smithi071.stdout: filestore apply finisher threads = 3 2023-10-06T01:39:23.131 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:39:23.131 INFO:teuthology.orchestra.run.smithi071.stdout: bdev debug aio = true 2023-10-06T01:39:23.131 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug misdirected ops = true 2023-10-06T01:39:23.131 INFO:teuthology.orchestra.run.smithi071.stdout: bluestore block size = 96636764160 2023-10-06T01:39:23.131 INFO:teuthology.orchestra.run.smithi071.stdout: bluestore fsck on mount = True 2023-10-06T01:39:23.131 INFO:teuthology.orchestra.run.smithi071.stdout: debug bluefs = 20 2023-10-06T01:39:23.131 INFO:teuthology.orchestra.run.smithi071.stdout: debug bluestore = 20 2023-10-06T01:39:23.131 INFO:teuthology.orchestra.run.smithi071.stdout: debug ms = 1 2023-10-06T01:39:23.131 INFO:teuthology.orchestra.run.smithi071.stdout: debug osd = 20 2023-10-06T01:39:23.131 INFO:teuthology.orchestra.run.smithi071.stdout: debug rocksdb = 10 2023-10-06T01:39:23.132 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T01:39:23.132 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd full ratio = 0.9 2023-10-06T01:39:23.132 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd nearfull ratio = 0.8 2023-10-06T01:39:23.132 INFO:teuthology.orchestra.run.smithi071.stdout: osd failsafe full ratio = 0.95 2023-10-06T01:39:23.132 INFO:teuthology.orchestra.run.smithi071.stdout: osd objectstore = bluestore 2023-10-06T01:39:23.132 INFO:teuthology.orchestra.run.smithi071.stdout: osd op complaint time = 180 2023-10-06T01:39:23.132 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:39:23.132 INFO:teuthology.orchestra.run.smithi071.stdout:[mgr] 2023-10-06T01:39:23.132 INFO:teuthology.orchestra.run.smithi071.stdout: debug ms = 1 2023-10-06T01:39:23.132 INFO:teuthology.orchestra.run.smithi071.stdout: debug mgr = 20 2023-10-06T01:39:23.132 INFO:teuthology.orchestra.run.smithi071.stdout: debug mon = 20 2023-10-06T01:39:23.132 INFO:teuthology.orchestra.run.smithi071.stdout: debug auth = 20 2023-10-06T01:39:23.133 INFO:teuthology.orchestra.run.smithi071.stdout: mon reweight min pgs per osd = 4 2023-10-06T01:39:23.133 INFO:teuthology.orchestra.run.smithi071.stdout: mon reweight min bytes per osd = 10 2023-10-06T01:39:23.133 INFO:teuthology.orchestra.run.smithi071.stdout: mgr/telemetry/nag = false 2023-10-06T01:39:23.133 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:39:23.133 INFO:teuthology.orchestra.run.smithi071.stdout:[mon] 2023-10-06T01:39:23.133 INFO:teuthology.orchestra.run.smithi071.stdout: debug ms = 1 2023-10-06T01:39:23.133 INFO:teuthology.orchestra.run.smithi071.stdout: debug mon = 20 2023-10-06T01:39:23.133 INFO:teuthology.orchestra.run.smithi071.stdout: debug paxos = 20 2023-10-06T01:39:23.133 INFO:teuthology.orchestra.run.smithi071.stdout: debug auth = 20 2023-10-06T01:39:23.133 INFO:teuthology.orchestra.run.smithi071.stdout: mon data avail warn = 5 2023-10-06T01:39:23.133 INFO:teuthology.orchestra.run.smithi071.stdout: mon mgr mkfs grace = 240 2023-10-06T01:39:23.133 INFO:teuthology.orchestra.run.smithi071.stdout: mon reweight min pgs per osd = 4 2023-10-06T01:39:23.134 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd reporter subtree level = osd 2023-10-06T01:39:23.134 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd prime pg temp = true 2023-10-06T01:39:23.134 INFO:teuthology.orchestra.run.smithi071.stdout: mon reweight min bytes per osd = 10 2023-10-06T01:39:23.134 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:39:23.134 INFO:teuthology.orchestra.run.smithi071.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T01:39:23.134 INFO:teuthology.orchestra.run.smithi071.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T01:39:23.134 INFO:teuthology.orchestra.run.smithi071.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T01:39:23.134 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:39:23.134 INFO:teuthology.orchestra.run.smithi071.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T01:39:23.134 INFO:teuthology.orchestra.run.smithi071.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T01:39:23.134 INFO:teuthology.orchestra.run.smithi071.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T01:39:23.135 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:39:23.135 INFO:teuthology.orchestra.run.smithi071.stdout: # 1m isn't quite enough 2023-10-06T01:39:23.135 INFO:teuthology.orchestra.run.smithi071.stdout: mon_down_mkfs_grace = 2m 2023-10-06T01:39:23.135 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:39:23.135 INFO:teuthology.orchestra.run.smithi071.stdout: mon_warn_on_filestore_osds = false 2023-10-06T01:39:23.135 INFO:teuthology.orchestra.run.smithi071.stdout: mon op complaint time = 120 2023-10-06T01:39:23.135 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:39:23.135 INFO:teuthology.orchestra.run.smithi071.stdout:[client] 2023-10-06T01:39:23.135 INFO:teuthology.orchestra.run.smithi071.stdout: rgw cache enabled = true 2023-10-06T01:39:23.135 INFO:teuthology.orchestra.run.smithi071.stdout: rgw enable ops log = true 2023-10-06T01:39:23.135 INFO:teuthology.orchestra.run.smithi071.stdout: rgw enable usage log = true 2023-10-06T01:39:23.135 INFO:teuthology.orchestra.run.smithi071.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T01:39:23.136 INFO:teuthology.orchestra.run.smithi071.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T01:39:23.136 INFO:teuthology.orchestra.run.smithi071.stdout: client mount timeout = 600 2023-10-06T01:39:23.136 INFO:teuthology.orchestra.run.smithi071.stdout: debug client = 20 2023-10-06T01:39:23.136 INFO:teuthology.orchestra.run.smithi071.stdout: debug ms = 1 2023-10-06T01:39:23.136 INFO:teuthology.orchestra.run.smithi071.stdout: pid file = "" 2023-10-06T01:39:23.136 INFO:teuthology.orchestra.run.smithi071.stdout: rados mon op timeout = 900 2023-10-06T01:39:23.136 INFO:teuthology.orchestra.run.smithi071.stdout: rados osd op timeout = 900 2023-10-06T01:39:23.136 INFO:teuthology.orchestra.run.smithi071.stdout:[mon.a] 2023-10-06T01:39:23.136 INFO:teuthology.orchestra.run.smithi071.stdout:[mon.b] 2023-10-06T01:39:23.136 INFO:teuthology.orchestra.run.smithi071.stdout:[mon.c] 2023-10-06T01:39:23.136 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.a] 2023-10-06T01:39:23.137 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.c] 2023-10-06T01:39:23.137 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.b] 2023-10-06T01:39:23.137 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.d] 2023-10-06T01:39:23.137 INFO:teuthology.orchestra.run.smithi071.stdout:[mds] 2023-10-06T01:39:23.137 INFO:teuthology.orchestra.run.smithi071.stdout: debug mds = 20 2023-10-06T01:39:23.137 INFO:teuthology.orchestra.run.smithi071.stdout: debug ms = 1 2023-10-06T01:39:23.137 INFO:teuthology.orchestra.run.smithi071.stdout: mds debug frag = True 2023-10-06T01:39:23.137 INFO:teuthology.orchestra.run.smithi071.stdout: mds debug scatterstat = True 2023-10-06T01:39:23.137 INFO:teuthology.orchestra.run.smithi071.stdout: mds op complaint time = 180 2023-10-06T01:39:23.137 INFO:teuthology.orchestra.run.smithi071.stdout: mds verify scatter = True 2023-10-06T01:39:23.137 INFO:teuthology.orchestra.run.smithi071.stdout: osd op complaint time = 180 2023-10-06T01:39:23.137 INFO:teuthology.orchestra.run.smithi071.stdout: rados mon op timeout = 900 2023-10-06T01:39:23.137 INFO:teuthology.orchestra.run.smithi071.stdout: rados osd op timeout = 900 2023-10-06T01:39:23.139 INFO:teuthology.orchestra.run.smithi072.stdout:[global] 2023-10-06T01:39:23.139 INFO:teuthology.orchestra.run.smithi072.stdout: chdir = "" 2023-10-06T01:39:23.139 INFO:teuthology.orchestra.run.smithi072.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T01:39:23.139 INFO:teuthology.orchestra.run.smithi072.stdout: auth supported = cephx 2023-10-06T01:39:23.139 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-06T01:39:23.139 INFO:teuthology.orchestra.run.smithi072.stdout: filestore xattr use omap = true 2023-10-06T01:39:23.139 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-06T01:39:23.140 INFO:teuthology.orchestra.run.smithi072.stdout: mon clock drift allowed = 1.000 2023-10-06T01:39:23.140 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-06T01:39:23.140 INFO:teuthology.orchestra.run.smithi072.stdout: osd crush chooseleaf type = 0 2023-10-06T01:39:23.140 INFO:teuthology.orchestra.run.smithi072.stdout: auth debug = true 2023-10-06T01:39:23.140 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-06T01:39:23.140 INFO:teuthology.orchestra.run.smithi072.stdout: ms die on old message = true 2023-10-06T01:39:23.140 INFO:teuthology.orchestra.run.smithi072.stdout: ms die on bug = true 2023-10-06T01:39:23.140 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-06T01:39:23.140 INFO:teuthology.orchestra.run.smithi072.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T01:39:23.140 INFO:teuthology.orchestra.run.smithi072.stdout: mon pg warn max object skew = 0 2023-10-06T01:39:23.140 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-06T01:39:23.141 INFO:teuthology.orchestra.run.smithi072.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T01:39:23.141 INFO:teuthology.orchestra.run.smithi072.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T01:39:23.141 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-06T01:39:23.141 INFO:teuthology.orchestra.run.smithi072.stdout: osd pool default size = 2 2023-10-06T01:39:23.141 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-06T01:39:23.141 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd allow primary affinity = true 2023-10-06T01:39:23.141 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd allow pg remap = true 2023-10-06T01:39:23.141 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on legacy crush tunables = false 2023-10-06T01:39:23.141 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on crush straw calc version zero = false 2023-10-06T01:39:23.141 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on no sortbitwise = false 2023-10-06T01:39:23.141 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on osd down out interval zero = false 2023-10-06T01:39:23.141 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on too few osds = false 2023-10-06T01:39:23.142 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T01:39:23.142 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T01:39:23.142 INFO:teuthology.orchestra.run.smithi072.stdout: mon_allow_pool_size_one = true 2023-10-06T01:39:23.142 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-06T01:39:23.142 INFO:teuthology.orchestra.run.smithi072.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T01:39:23.142 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-06T01:39:23.142 INFO:teuthology.orchestra.run.smithi072.stdout: osd default data pool replay window = 5 2023-10-06T01:39:23.142 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-06T01:39:23.142 INFO:teuthology.orchestra.run.smithi072.stdout: mon allow pool delete = true 2023-10-06T01:39:23.142 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-06T01:39:23.142 INFO:teuthology.orchestra.run.smithi072.stdout: mon cluster log file level = debug 2023-10-06T01:39:23.143 INFO:teuthology.orchestra.run.smithi072.stdout: debug asserts on shutdown = true 2023-10-06T01:39:23.143 INFO:teuthology.orchestra.run.smithi072.stdout: mon health detail to clog = false 2023-10-06T01:39:23.143 INFO:teuthology.orchestra.run.smithi072.stdout: mon host = "172.21.15.71,172.21.15.72,[v2:172.21.15.72:3301,v1:172.21.15.72:6790]" 2023-10-06T01:39:23.143 INFO:teuthology.orchestra.run.smithi072.stdout: fsid = 1fbf1bd2-f9b4-4599-bea2-f4aa920e9a56 2023-10-06T01:39:23.143 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-06T01:39:23.143 INFO:teuthology.orchestra.run.smithi072.stdout:[osd] 2023-10-06T01:39:23.143 INFO:teuthology.orchestra.run.smithi072.stdout: osd journal size = 100 2023-10-06T01:39:23.143 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-06T01:39:23.143 INFO:teuthology.orchestra.run.smithi072.stdout: osd scrub load threshold = 5.0 2023-10-06T01:39:23.143 INFO:teuthology.orchestra.run.smithi072.stdout: osd scrub max interval = 600 2023-10-06T01:39:23.143 INFO:teuthology.orchestra.run.smithi072.stdout: osd mclock profile = high_recovery_ops 2023-10-06T01:39:23.144 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-06T01:39:23.144 INFO:teuthology.orchestra.run.smithi072.stdout: osd recover clone overlap = true 2023-10-06T01:39:23.144 INFO:teuthology.orchestra.run.smithi072.stdout: osd recovery max chunk = 1048576 2023-10-06T01:39:23.144 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-06T01:39:23.144 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug shutdown = true 2023-10-06T01:39:23.144 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug op order = true 2023-10-06T01:39:23.144 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug verify stray on activate = true 2023-10-06T01:39:23.144 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-06T01:39:23.144 INFO:teuthology.orchestra.run.smithi072.stdout: osd open classes on start = true 2023-10-06T01:39:23.144 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug pg log writeout = true 2023-10-06T01:39:23.144 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-06T01:39:23.144 INFO:teuthology.orchestra.run.smithi072.stdout: osd deep scrub update digest min age = 30 2023-10-06T01:39:23.145 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-06T01:39:23.145 INFO:teuthology.orchestra.run.smithi072.stdout: osd map max advance = 10 2023-10-06T01:39:23.145 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-06T01:39:23.145 INFO:teuthology.orchestra.run.smithi072.stdout: journal zero on create = true 2023-10-06T01:39:23.145 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-06T01:39:23.145 INFO:teuthology.orchestra.run.smithi072.stdout: filestore ondisk finisher threads = 3 2023-10-06T01:39:23.145 INFO:teuthology.orchestra.run.smithi072.stdout: filestore apply finisher threads = 3 2023-10-06T01:39:23.145 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-06T01:39:23.145 INFO:teuthology.orchestra.run.smithi072.stdout: bdev debug aio = true 2023-10-06T01:39:23.145 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug misdirected ops = true 2023-10-06T01:39:23.145 INFO:teuthology.orchestra.run.smithi072.stdout: bluestore block size = 96636764160 2023-10-06T01:39:23.145 INFO:teuthology.orchestra.run.smithi072.stdout: bluestore fsck on mount = True 2023-10-06T01:39:23.146 INFO:teuthology.orchestra.run.smithi072.stdout: debug bluefs = 20 2023-10-06T01:39:23.146 INFO:teuthology.orchestra.run.smithi072.stdout: debug bluestore = 20 2023-10-06T01:39:23.146 INFO:teuthology.orchestra.run.smithi072.stdout: debug ms = 1 2023-10-06T01:39:23.146 INFO:teuthology.orchestra.run.smithi072.stdout: debug osd = 20 2023-10-06T01:39:23.146 INFO:teuthology.orchestra.run.smithi072.stdout: debug rocksdb = 10 2023-10-06T01:39:23.146 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T01:39:23.146 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd full ratio = 0.9 2023-10-06T01:39:23.146 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd nearfull ratio = 0.8 2023-10-06T01:39:23.146 INFO:teuthology.orchestra.run.smithi072.stdout: osd failsafe full ratio = 0.95 2023-10-06T01:39:23.146 INFO:teuthology.orchestra.run.smithi072.stdout: osd objectstore = bluestore 2023-10-06T01:39:23.146 INFO:teuthology.orchestra.run.smithi072.stdout: osd op complaint time = 180 2023-10-06T01:39:23.146 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-06T01:39:23.147 INFO:teuthology.orchestra.run.smithi072.stdout:[mgr] 2023-10-06T01:39:23.147 INFO:teuthology.orchestra.run.smithi072.stdout: debug ms = 1 2023-10-06T01:39:23.147 INFO:teuthology.orchestra.run.smithi072.stdout: debug mgr = 20 2023-10-06T01:39:23.147 INFO:teuthology.orchestra.run.smithi072.stdout: debug mon = 20 2023-10-06T01:39:23.147 INFO:teuthology.orchestra.run.smithi072.stdout: debug auth = 20 2023-10-06T01:39:23.147 INFO:teuthology.orchestra.run.smithi072.stdout: mon reweight min pgs per osd = 4 2023-10-06T01:39:23.147 INFO:teuthology.orchestra.run.smithi072.stdout: mon reweight min bytes per osd = 10 2023-10-06T01:39:23.147 INFO:teuthology.orchestra.run.smithi072.stdout: mgr/telemetry/nag = false 2023-10-06T01:39:23.147 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-06T01:39:23.147 INFO:teuthology.orchestra.run.smithi072.stdout:[mon] 2023-10-06T01:39:23.147 INFO:teuthology.orchestra.run.smithi072.stdout: debug ms = 1 2023-10-06T01:39:23.148 INFO:teuthology.orchestra.run.smithi072.stdout: debug mon = 20 2023-10-06T01:39:23.148 INFO:teuthology.orchestra.run.smithi072.stdout: debug paxos = 20 2023-10-06T01:39:23.148 INFO:teuthology.orchestra.run.smithi072.stdout: debug auth = 20 2023-10-06T01:39:23.148 INFO:teuthology.orchestra.run.smithi072.stdout: mon data avail warn = 5 2023-10-06T01:39:23.148 INFO:teuthology.orchestra.run.smithi072.stdout: mon mgr mkfs grace = 240 2023-10-06T01:39:23.148 INFO:teuthology.orchestra.run.smithi072.stdout: mon reweight min pgs per osd = 4 2023-10-06T01:39:23.148 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd reporter subtree level = osd 2023-10-06T01:39:23.148 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd prime pg temp = true 2023-10-06T01:39:23.148 INFO:teuthology.orchestra.run.smithi072.stdout: mon reweight min bytes per osd = 10 2023-10-06T01:39:23.148 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-06T01:39:23.148 INFO:teuthology.orchestra.run.smithi072.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T01:39:23.148 INFO:teuthology.orchestra.run.smithi072.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T01:39:23.148 INFO:teuthology.orchestra.run.smithi072.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T01:39:23.149 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-06T01:39:23.149 INFO:teuthology.orchestra.run.smithi072.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T01:39:23.149 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T01:39:23.149 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T01:39:23.149 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-06T01:39:23.149 INFO:teuthology.orchestra.run.smithi072.stdout: # 1m isn't quite enough 2023-10-06T01:39:23.149 INFO:teuthology.orchestra.run.smithi072.stdout: mon_down_mkfs_grace = 2m 2023-10-06T01:39:23.149 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-06T01:39:23.149 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_filestore_osds = false 2023-10-06T01:39:23.149 INFO:teuthology.orchestra.run.smithi072.stdout: mon op complaint time = 120 2023-10-06T01:39:23.149 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-06T01:39:23.149 INFO:teuthology.orchestra.run.smithi072.stdout:[client] 2023-10-06T01:39:23.150 INFO:teuthology.orchestra.run.smithi072.stdout: rgw cache enabled = true 2023-10-06T01:39:23.150 INFO:teuthology.orchestra.run.smithi072.stdout: rgw enable ops log = true 2023-10-06T01:39:23.150 INFO:teuthology.orchestra.run.smithi072.stdout: rgw enable usage log = true 2023-10-06T01:39:23.150 INFO:teuthology.orchestra.run.smithi072.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T01:39:23.150 INFO:teuthology.orchestra.run.smithi072.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T01:39:23.150 INFO:teuthology.orchestra.run.smithi072.stdout: client mount timeout = 600 2023-10-06T01:39:23.150 INFO:teuthology.orchestra.run.smithi072.stdout: debug client = 20 2023-10-06T01:39:23.150 INFO:teuthology.orchestra.run.smithi072.stdout: debug ms = 1 2023-10-06T01:39:23.150 INFO:teuthology.orchestra.run.smithi072.stdout: pid file = "" 2023-10-06T01:39:23.150 INFO:teuthology.orchestra.run.smithi072.stdout: rados mon op timeout = 900 2023-10-06T01:39:23.150 INFO:teuthology.orchestra.run.smithi072.stdout: rados osd op timeout = 900 2023-10-06T01:39:23.150 INFO:teuthology.orchestra.run.smithi072.stdout:[mon.a] 2023-10-06T01:39:23.151 INFO:teuthology.orchestra.run.smithi072.stdout:[mon.b] 2023-10-06T01:39:23.151 INFO:teuthology.orchestra.run.smithi072.stdout:[mon.c] 2023-10-06T01:39:23.151 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.a] 2023-10-06T01:39:23.151 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.c] 2023-10-06T01:39:23.151 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.b] 2023-10-06T01:39:23.151 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.d] 2023-10-06T01:39:23.151 INFO:teuthology.orchestra.run.smithi072.stdout:[mds] 2023-10-06T01:39:23.151 INFO:teuthology.orchestra.run.smithi072.stdout: debug mds = 20 2023-10-06T01:39:23.151 INFO:teuthology.orchestra.run.smithi072.stdout: debug ms = 1 2023-10-06T01:39:23.151 INFO:teuthology.orchestra.run.smithi072.stdout: mds debug frag = True 2023-10-06T01:39:23.151 INFO:teuthology.orchestra.run.smithi072.stdout: mds debug scatterstat = True 2023-10-06T01:39:23.151 INFO:teuthology.orchestra.run.smithi072.stdout: mds op complaint time = 180 2023-10-06T01:39:23.152 INFO:teuthology.orchestra.run.smithi072.stdout: mds verify scatter = True 2023-10-06T01:39:23.152 INFO:teuthology.orchestra.run.smithi072.stdout: osd op complaint time = 180 2023-10-06T01:39:23.152 INFO:teuthology.orchestra.run.smithi072.stdout: rados mon op timeout = 900 2023-10-06T01:39:23.152 INFO:teuthology.orchestra.run.smithi072.stdout: rados osd op timeout = 900 2023-10-06T01:39:23.152 INFO:tasks.ceph:Creating admin key on mon.a... 2023-10-06T01:39:23.152 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-10-06T01:39:23.229 INFO:tasks.ceph:Copying monmap to all nodes... 2023-10-06T01:39:23.230 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-10-06T01:39:23.230 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-10-06T01:39:23.244 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-10-06T01:39:23.244 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-10-06T01:39:23.299 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi071.front.sepia.ceph.com 2023-10-06T01:39:23.299 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-10-06T01:39:23.299 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-06T01:39:23.299 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-06T01:39:23.373 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-10-06T01:39:23.373 DEBUG:teuthology.orchestra.run.smithi071:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-06T01:39:23.427 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi072.front.sepia.ceph.com 2023-10-06T01:39:23.428 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-06T01:39:23.428 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-06T01:39:23.428 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-06T01:39:23.462 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-06T01:39:23.462 DEBUG:teuthology.orchestra.run.smithi072:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-06T01:39:23.517 INFO:tasks.ceph:Setting up mon nodes... 2023-10-06T01:39:23.517 INFO:tasks.ceph:Setting up mgr nodes... 2023-10-06T01:39:23.517 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-10-06T01:39:23.564 INFO:teuthology.orchestra.run.smithi071.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-10-06T01:39:23.567 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-10-06T01:39:23.625 INFO:teuthology.orchestra.run.smithi072.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-10-06T01:39:23.627 INFO:tasks.ceph:Setting up mds nodes... 2023-10-06T01:39:23.628 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-10-06T01:39:23.675 INFO:teuthology.orchestra.run.smithi071.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-10-06T01:39:23.677 DEBUG:teuthology.orchestra.run.smithi071:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-10-06T01:39:23.701 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-10-06T01:39:23.789 INFO:teuthology.orchestra.run.smithi071.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-10-06T01:39:23.791 DEBUG:teuthology.orchestra.run.smithi071:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-10-06T01:39:23.815 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-10-06T01:39:23.862 INFO:teuthology.orchestra.run.smithi072.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-10-06T01:39:23.864 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-10-06T01:39:23.888 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-10-06T01:39:23.976 INFO:teuthology.orchestra.run.smithi072.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-10-06T01:39:23.979 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-10-06T01:39:24.002 INFO:tasks.ceph_client:Setting up client nodes... 2023-10-06T01:39:24.003 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-06T01:39:24.040 INFO:teuthology.orchestra.run.smithi071.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-10-06T01:39:24.052 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-10-06T01:39:24.130 INFO:teuthology.orchestra.run.smithi071.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-10-06T01:39:24.142 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-10-06T01:39:24.180 INFO:teuthology.orchestra.run.smithi072.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-10-06T01:39:24.192 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-10-06T01:39:24.269 INFO:teuthology.orchestra.run.smithi072.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-10-06T01:39:24.281 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-10-06T01:39:24.281 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi071.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi072.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-06T01:39:24.282 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-10-06T01:39:24.306 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T01:39:24.306 INFO:tasks.ceph:role: osd.0 2023-10-06T01:39:24.306 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi071.front.sepia.ceph.com 2023-10-06T01:39:24.306 DEBUG:teuthology.orchestra.run.smithi071:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-06T01:39:24.378 INFO:teuthology.orchestra.run.smithi071.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T01:39:24.378 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T01:39:24.378 INFO:teuthology.orchestra.run.smithi071.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T01:39:24.378 INFO:teuthology.orchestra.run.smithi071.stdout: = reflink=1 2023-10-06T01:39:24.378 INFO:teuthology.orchestra.run.smithi071.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T01:39:24.378 INFO:teuthology.orchestra.run.smithi071.stdout: = sunit=0 swidth=0 blks 2023-10-06T01:39:24.378 INFO:teuthology.orchestra.run.smithi071.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T01:39:24.378 INFO:teuthology.orchestra.run.smithi071.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T01:39:24.378 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T01:39:24.378 INFO:teuthology.orchestra.run.smithi071.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T01:39:24.807 INFO:teuthology.orchestra.run.smithi071.stdout:Discarding blocks...Done. 2023-10-06T01:39:24.809 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi071.front.sepia.ceph.com -o noatime 2023-10-06T01:39:24.809 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-10-06T01:39:24.984 DEBUG:teuthology.orchestra.run.smithi071:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-10-06T01:39:25.013 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-10-06T01:39:25.077 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T01:39:25.078 INFO:tasks.ceph:role: osd.1 2023-10-06T01:39:25.078 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi071.front.sepia.ceph.com 2023-10-06T01:39:25.078 DEBUG:teuthology.orchestra.run.smithi071:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-06T01:39:25.148 INFO:teuthology.orchestra.run.smithi071.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T01:39:25.149 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T01:39:25.149 INFO:teuthology.orchestra.run.smithi071.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T01:39:25.149 INFO:teuthology.orchestra.run.smithi071.stdout: = reflink=1 2023-10-06T01:39:25.149 INFO:teuthology.orchestra.run.smithi071.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T01:39:25.149 INFO:teuthology.orchestra.run.smithi071.stdout: = sunit=0 swidth=0 blks 2023-10-06T01:39:25.149 INFO:teuthology.orchestra.run.smithi071.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T01:39:25.149 INFO:teuthology.orchestra.run.smithi071.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T01:39:25.149 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T01:39:25.149 INFO:teuthology.orchestra.run.smithi071.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T01:39:25.567 INFO:teuthology.orchestra.run.smithi071.stdout:Discarding blocks...Done. 2023-10-06T01:39:25.569 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi071.front.sepia.ceph.com -o noatime 2023-10-06T01:39:25.569 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-10-06T01:39:25.682 DEBUG:teuthology.orchestra.run.smithi071:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-10-06T01:39:25.709 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-10-06T01:39:25.773 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T01:39:25.773 INFO:tasks.ceph:role: osd.2 2023-10-06T01:39:25.774 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi071.front.sepia.ceph.com 2023-10-06T01:39:25.774 DEBUG:teuthology.orchestra.run.smithi071:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-06T01:39:25.845 INFO:teuthology.orchestra.run.smithi071.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T01:39:25.845 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T01:39:25.845 INFO:teuthology.orchestra.run.smithi071.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T01:39:25.845 INFO:teuthology.orchestra.run.smithi071.stdout: = reflink=1 2023-10-06T01:39:25.845 INFO:teuthology.orchestra.run.smithi071.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T01:39:25.845 INFO:teuthology.orchestra.run.smithi071.stdout: = sunit=0 swidth=0 blks 2023-10-06T01:39:25.845 INFO:teuthology.orchestra.run.smithi071.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T01:39:25.845 INFO:teuthology.orchestra.run.smithi071.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T01:39:25.845 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T01:39:25.846 INFO:teuthology.orchestra.run.smithi071.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T01:39:26.290 INFO:teuthology.orchestra.run.smithi071.stdout:Discarding blocks...Done. 2023-10-06T01:39:26.292 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi071.front.sepia.ceph.com -o noatime 2023-10-06T01:39:26.292 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-10-06T01:39:26.474 DEBUG:teuthology.orchestra.run.smithi071:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-10-06T01:39:26.502 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-10-06T01:39:26.567 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T01:39:26.567 INFO:tasks.ceph:role: osd.3 2023-10-06T01:39:26.567 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi071.front.sepia.ceph.com 2023-10-06T01:39:26.567 DEBUG:teuthology.orchestra.run.smithi071:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-06T01:39:26.641 INFO:teuthology.orchestra.run.smithi071.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T01:39:26.641 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T01:39:26.642 INFO:teuthology.orchestra.run.smithi071.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T01:39:26.642 INFO:teuthology.orchestra.run.smithi071.stdout: = reflink=1 2023-10-06T01:39:26.642 INFO:teuthology.orchestra.run.smithi071.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T01:39:26.642 INFO:teuthology.orchestra.run.smithi071.stdout: = sunit=0 swidth=0 blks 2023-10-06T01:39:26.642 INFO:teuthology.orchestra.run.smithi071.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T01:39:26.642 INFO:teuthology.orchestra.run.smithi071.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T01:39:26.642 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T01:39:26.642 INFO:teuthology.orchestra.run.smithi071.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T01:39:27.084 INFO:teuthology.orchestra.run.smithi071.stdout:Discarding blocks...Done. 2023-10-06T01:39:27.085 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi071.front.sepia.ceph.com -o noatime 2023-10-06T01:39:27.085 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-10-06T01:39:27.239 DEBUG:teuthology.orchestra.run.smithi071:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-10-06T01:39:27.268 DEBUG:teuthology.orchestra.run.smithi071:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T01:39:27.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:27.391+0000 7f6f1236b540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-10-06T01:39:27.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:27.391+0000 7f6f1236b540 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-10-06T01:39:27.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:27.391+0000 7f6f1236b540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-06T01:39:27.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:27.391+0000 7f6f1236b540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-06T01:39:27.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:27.391+0000 7f6f1236b540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-06T01:39:27.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:27.392+0000 7f6f1236b540 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-10-06T01:39:27.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:27.914+0000 7f6f1236b540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T01:39:28.677 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:28.676+0000 7f6f1236b540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T01:39:29.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:29.439+0000 7f6f1236b540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T01:39:30.231 DEBUG:teuthology.orchestra.run.smithi071:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-10-06T01:39:30.259 DEBUG:teuthology.orchestra.run.smithi071:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T01:39:30.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:30.342+0000 7fd3d0236540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-10-06T01:39:30.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:30.343+0000 7fd3d0236540 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-10-06T01:39:30.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:30.343+0000 7fd3d0236540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-06T01:39:30.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:30.343+0000 7fd3d0236540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-06T01:39:30.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:30.343+0000 7fd3d0236540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-06T01:39:30.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:30.343+0000 7fd3d0236540 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-10-06T01:39:30.873 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:30.873+0000 7fd3d0236540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T01:39:31.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:31.644+0000 7fd3d0236540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T01:39:32.412 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:32.411+0000 7fd3d0236540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T01:39:33.217 DEBUG:teuthology.orchestra.run.smithi071:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-10-06T01:39:33.245 DEBUG:teuthology.orchestra.run.smithi071:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T01:39:33.330 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:33.329+0000 7f6efda3b540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-10-06T01:39:33.330 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:33.329+0000 7f6efda3b540 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-10-06T01:39:33.331 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:33.329+0000 7f6efda3b540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-06T01:39:33.331 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:33.329+0000 7f6efda3b540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-06T01:39:33.331 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:33.329+0000 7f6efda3b540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-06T01:39:33.331 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:33.330+0000 7f6efda3b540 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-10-06T01:39:33.855 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:33.855+0000 7f6efda3b540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T01:39:34.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:34.616+0000 7f6efda3b540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T01:39:35.379 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:35.378+0000 7f6efda3b540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T01:39:36.175 DEBUG:teuthology.orchestra.run.smithi071:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-10-06T01:39:36.241 DEBUG:teuthology.orchestra.run.smithi071:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T01:39:36.324 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:36.322+0000 7f114de82540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-10-06T01:39:36.324 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:36.323+0000 7f114de82540 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-10-06T01:39:36.324 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:36.323+0000 7f114de82540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-06T01:39:36.324 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:36.323+0000 7f114de82540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-06T01:39:36.324 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:36.323+0000 7f114de82540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-06T01:39:36.324 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:36.323+0000 7f114de82540 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-10-06T01:39:36.848 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:36.847+0000 7f114de82540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T01:39:37.613 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:37.611+0000 7f114de82540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T01:39:38.380 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:38.378+0000 7f114de82540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T01:39:39.175 DEBUG:teuthology.orchestra.run.smithi071:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-10-06T01:39:39.245 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-10-06T01:39:39.273 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T01:39:39.273 INFO:tasks.ceph:role: osd.4 2023-10-06T01:39:39.273 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi072.front.sepia.ceph.com 2023-10-06T01:39:39.273 DEBUG:teuthology.orchestra.run.smithi072:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-06T01:39:39.346 INFO:teuthology.orchestra.run.smithi072.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T01:39:39.346 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T01:39:39.346 INFO:teuthology.orchestra.run.smithi072.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T01:39:39.346 INFO:teuthology.orchestra.run.smithi072.stdout: = reflink=1 2023-10-06T01:39:39.346 INFO:teuthology.orchestra.run.smithi072.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T01:39:39.346 INFO:teuthology.orchestra.run.smithi072.stdout: = sunit=0 swidth=0 blks 2023-10-06T01:39:39.347 INFO:teuthology.orchestra.run.smithi072.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T01:39:39.347 INFO:teuthology.orchestra.run.smithi072.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T01:39:39.347 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T01:39:39.347 INFO:teuthology.orchestra.run.smithi072.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T01:39:39.777 INFO:teuthology.orchestra.run.smithi072.stdout:Discarding blocks...Done. 2023-10-06T01:39:39.778 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi072.front.sepia.ceph.com -o noatime 2023-10-06T01:39:39.779 DEBUG:teuthology.orchestra.run.smithi072:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-10-06T01:39:39.921 DEBUG:teuthology.orchestra.run.smithi072:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-10-06T01:39:39.954 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-10-06T01:39:40.020 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T01:39:40.020 INFO:tasks.ceph:role: osd.5 2023-10-06T01:39:40.020 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi072.front.sepia.ceph.com 2023-10-06T01:39:40.021 DEBUG:teuthology.orchestra.run.smithi072:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-06T01:39:40.093 INFO:teuthology.orchestra.run.smithi072.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T01:39:40.093 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T01:39:40.093 INFO:teuthology.orchestra.run.smithi072.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T01:39:40.093 INFO:teuthology.orchestra.run.smithi072.stdout: = reflink=1 2023-10-06T01:39:40.093 INFO:teuthology.orchestra.run.smithi072.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T01:39:40.093 INFO:teuthology.orchestra.run.smithi072.stdout: = sunit=0 swidth=0 blks 2023-10-06T01:39:40.093 INFO:teuthology.orchestra.run.smithi072.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T01:39:40.094 INFO:teuthology.orchestra.run.smithi072.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T01:39:40.094 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T01:39:40.094 INFO:teuthology.orchestra.run.smithi072.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T01:39:40.511 INFO:teuthology.orchestra.run.smithi072.stdout:Discarding blocks...Done. 2023-10-06T01:39:40.513 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi072.front.sepia.ceph.com -o noatime 2023-10-06T01:39:40.513 DEBUG:teuthology.orchestra.run.smithi072:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-10-06T01:39:40.595 DEBUG:teuthology.orchestra.run.smithi072:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-10-06T01:39:40.665 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-10-06T01:39:40.729 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T01:39:40.729 INFO:tasks.ceph:role: osd.6 2023-10-06T01:39:40.729 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi072.front.sepia.ceph.com 2023-10-06T01:39:40.729 DEBUG:teuthology.orchestra.run.smithi072:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-06T01:39:40.800 INFO:teuthology.orchestra.run.smithi072.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T01:39:40.800 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T01:39:40.800 INFO:teuthology.orchestra.run.smithi072.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T01:39:40.800 INFO:teuthology.orchestra.run.smithi072.stdout: = reflink=1 2023-10-06T01:39:40.800 INFO:teuthology.orchestra.run.smithi072.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T01:39:40.800 INFO:teuthology.orchestra.run.smithi072.stdout: = sunit=0 swidth=0 blks 2023-10-06T01:39:40.800 INFO:teuthology.orchestra.run.smithi072.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T01:39:40.800 INFO:teuthology.orchestra.run.smithi072.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T01:39:40.800 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T01:39:40.801 INFO:teuthology.orchestra.run.smithi072.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T01:39:41.246 INFO:teuthology.orchestra.run.smithi072.stdout:Discarding blocks...Done. 2023-10-06T01:39:41.248 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi072.front.sepia.ceph.com -o noatime 2023-10-06T01:39:41.248 DEBUG:teuthology.orchestra.run.smithi072:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-10-06T01:39:41.364 DEBUG:teuthology.orchestra.run.smithi072:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-10-06T01:39:41.394 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-10-06T01:39:41.458 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T01:39:41.458 INFO:tasks.ceph:role: osd.7 2023-10-06T01:39:41.458 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi072.front.sepia.ceph.com 2023-10-06T01:39:41.458 DEBUG:teuthology.orchestra.run.smithi072:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-06T01:39:41.531 INFO:teuthology.orchestra.run.smithi072.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T01:39:41.531 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T01:39:41.531 INFO:teuthology.orchestra.run.smithi072.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T01:39:41.531 INFO:teuthology.orchestra.run.smithi072.stdout: = reflink=1 2023-10-06T01:39:41.531 INFO:teuthology.orchestra.run.smithi072.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T01:39:41.531 INFO:teuthology.orchestra.run.smithi072.stdout: = sunit=0 swidth=0 blks 2023-10-06T01:39:41.531 INFO:teuthology.orchestra.run.smithi072.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T01:39:41.531 INFO:teuthology.orchestra.run.smithi072.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T01:39:41.532 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T01:39:41.532 INFO:teuthology.orchestra.run.smithi072.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T01:39:41.970 INFO:teuthology.orchestra.run.smithi072.stdout:Discarding blocks...Done. 2023-10-06T01:39:41.972 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi072.front.sepia.ceph.com -o noatime 2023-10-06T01:39:41.972 DEBUG:teuthology.orchestra.run.smithi072:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-10-06T01:39:42.157 DEBUG:teuthology.orchestra.run.smithi072:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-10-06T01:39:42.187 DEBUG:teuthology.orchestra.run.smithi072:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T01:39:42.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:42.279+0000 7f15cb33d540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-10-06T01:39:42.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:42.282+0000 7f15cb33d540 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-10-06T01:39:42.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:42.282+0000 7f15cb33d540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-06T01:39:42.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:42.282+0000 7f15cb33d540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-06T01:39:42.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:42.282+0000 7f15cb33d540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-06T01:39:42.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:42.286+0000 7f15cb33d540 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-10-06T01:39:42.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:42.814+0000 7f15cb33d540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T01:39:43.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:43.581+0000 7f15cb33d540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T01:39:44.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:44.344+0000 7f15cb33d540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T01:39:45.138 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-10-06T01:39:45.165 DEBUG:teuthology.orchestra.run.smithi072:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T01:39:45.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:45.247+0000 7ff06562a540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-10-06T01:39:45.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:45.247+0000 7ff06562a540 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-10-06T01:39:45.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:45.247+0000 7ff06562a540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-06T01:39:45.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:45.247+0000 7ff06562a540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-06T01:39:45.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:45.247+0000 7ff06562a540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-06T01:39:45.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:45.248+0000 7ff06562a540 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-10-06T01:39:45.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:45.769+0000 7ff06562a540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T01:39:46.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:46.533+0000 7ff06562a540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T01:39:47.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:47.295+0000 7ff06562a540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T01:39:48.097 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-10-06T01:39:48.162 DEBUG:teuthology.orchestra.run.smithi072:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T01:39:48.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:48.243+0000 7fa4457c5540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-10-06T01:39:48.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:48.243+0000 7fa4457c5540 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-10-06T01:39:48.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:48.243+0000 7fa4457c5540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-06T01:39:48.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:48.243+0000 7fa4457c5540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-06T01:39:48.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:48.243+0000 7fa4457c5540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-06T01:39:48.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:48.244+0000 7fa4457c5540 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-10-06T01:39:48.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:48.771+0000 7fa4457c5540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T01:39:49.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:49.536+0000 7fa4457c5540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T01:39:50.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:50.298+0000 7fa4457c5540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T01:39:51.101 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-10-06T01:39:51.131 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T01:39:51.134 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T01:39:51.170 DEBUG:teuthology.orchestra.run.smithi072:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T01:39:51.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:51.251+0000 7fd0cdf12540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-10-06T01:39:51.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:51.252+0000 7fd0cdf12540 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-10-06T01:39:51.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:51.252+0000 7fd0cdf12540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-06T01:39:51.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:51.252+0000 7fd0cdf12540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-06T01:39:51.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:51.252+0000 7fd0cdf12540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-06T01:39:51.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:51.252+0000 7fd0cdf12540 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-10-06T01:39:51.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:51.779+0000 7fd0cdf12540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T01:39:52.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:52.544+0000 7fd0cdf12540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T01:39:53.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:53.305+0000 7fd0cdf12540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T01:39:54.109 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-10-06T01:39:54.176 INFO:tasks.ceph:Reading keys from all nodes... 2023-10-06T01:39:54.176 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-10-06T01:39:54.176 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-10-06T01:39:54.204 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-10-06T01:39:54.204 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-10-06T01:39:54.270 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-10-06T01:39:54.270 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-10-06T01:39:54.336 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-10-06T01:39:54.336 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-10-06T01:39:54.401 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-10-06T01:39:54.401 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-10-06T01:39:54.465 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-10-06T01:39:54.466 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-10-06T01:39:54.529 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-10-06T01:39:54.529 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-10-06T01:39:54.593 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-06T01:39:54.593 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-10-06T01:39:54.620 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-06T01:39:54.620 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-10-06T01:39:54.685 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-06T01:39:54.685 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-10-06T01:39:54.749 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-06T01:39:54.749 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-10-06T01:39:54.813 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-06T01:39:54.813 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-10-06T01:39:54.876 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-06T01:39:54.876 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-10-06T01:39:54.941 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-06T01:39:54.941 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-10-06T01:39:55.005 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-10-06T01:39:55.006 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-10-06T01:39:55.021 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-10-06T01:39:55.021 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-10-06T01:39:55.076 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-06T01:39:55.076 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-10-06T01:39:55.090 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-06T01:39:55.091 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-10-06T01:39:55.145 INFO:tasks.ceph:Adding keys to all mons... 2023-10-06T01:39:55.145 DEBUG:teuthology.orchestra.run.smithi071:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-06T01:39:55.147 DEBUG:teuthology.orchestra.run.smithi072:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-06T01:39:55.187 INFO:teuthology.orchestra.run.smithi071.stdout:[mgr.y] 2023-10-06T01:39:55.187 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQBLZR9lp02wIRAAyzu2xX+9mB6LzZ5qLF8c7w== 2023-10-06T01:39:55.188 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.a] 2023-10-06T01:39:55.188 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQBLZR9lcoBDKBAAuqBFOnzb876BazeC2Cbhzw== 2023-10-06T01:39:55.188 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.c] 2023-10-06T01:39:55.188 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQBLZR9lC30MLxAAVjECkWzmVuCjwmfytprvTw== 2023-10-06T01:39:55.188 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.0] 2023-10-06T01:39:55.188 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQBPZR9lT45fFxAAviTkT2FYL+NLj6FNrCE5Ng== 2023-10-06T01:39:55.188 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.1] 2023-10-06T01:39:55.188 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQBSZR9lWpR+FBAA0WaTKl/H0wwNPPPqS1ju3w== 2023-10-06T01:39:55.188 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.2] 2023-10-06T01:39:55.188 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQBVZR9lFrqxExAABQRNP/VF7HBY7D8WBia/CA== 2023-10-06T01:39:55.188 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.3] 2023-10-06T01:39:55.189 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQBYZR9lmNBKExAAi3WvWiyerLluzlqwcVv6CA== 2023-10-06T01:39:55.189 INFO:teuthology.orchestra.run.smithi071.stdout:[mgr.x] 2023-10-06T01:39:55.189 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQBLZR9lcCNIJRAAreWP16OjllwbkDLHYn36tA== 2023-10-06T01:39:55.189 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.b] 2023-10-06T01:39:55.189 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQBLZR9lE79sMxAAm8IQLgkFMY+nP5YQcCZeZg== 2023-10-06T01:39:55.189 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.d] 2023-10-06T01:39:55.189 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQBLZR9loz09OhAAy7MxAbp7ihZerFQfSqBglw== 2023-10-06T01:39:55.189 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.4] 2023-10-06T01:39:55.189 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQBeZR9lwv27EBAAX3IDzrKCSWlivcjt4tn+9A== 2023-10-06T01:39:55.189 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.5] 2023-10-06T01:39:55.189 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQBhZR9lhqzQDhAASmhyOln1kgXSDwK+7YZJyQ== 2023-10-06T01:39:55.189 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.6] 2023-10-06T01:39:55.190 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQBkZR9lLimVDhAAV8pqtb5zp49hl4HAJM0tfA== 2023-10-06T01:39:55.190 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.7] 2023-10-06T01:39:55.190 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQBnZR9lDwURDxAABbfmEhouaGSV3tByZdRKKw== 2023-10-06T01:39:55.190 INFO:teuthology.orchestra.run.smithi071.stdout:[client.0] 2023-10-06T01:39:55.190 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQBMZR9lFadqAhAAjrNmQYFfd+qw3Vup+6+B+Q== 2023-10-06T01:39:55.190 INFO:teuthology.orchestra.run.smithi071.stdout:[client.2] 2023-10-06T01:39:55.190 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQBMZR9lfIDHBxAAPZRU1OPQtHEJ2+ozcMF5pA== 2023-10-06T01:39:55.190 INFO:teuthology.orchestra.run.smithi071.stdout:[client.1] 2023-10-06T01:39:55.190 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQBMZR9l8Jy+ChAAtqx+Fz4onmRzILbFxuZ5lg== 2023-10-06T01:39:55.190 INFO:teuthology.orchestra.run.smithi071.stdout:[client.3] 2023-10-06T01:39:55.190 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQBMZR9lC2QVEBAAJiILvy19TnhA32dUBUiWJw== 2023-10-06T01:39:55.207 INFO:teuthology.orchestra.run.smithi072.stdout:[mgr.y] 2023-10-06T01:39:55.207 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQBLZR9lp02wIRAAyzu2xX+9mB6LzZ5qLF8c7w== 2023-10-06T01:39:55.207 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.a] 2023-10-06T01:39:55.207 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQBLZR9lcoBDKBAAuqBFOnzb876BazeC2Cbhzw== 2023-10-06T01:39:55.207 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.c] 2023-10-06T01:39:55.207 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQBLZR9lC30MLxAAVjECkWzmVuCjwmfytprvTw== 2023-10-06T01:39:55.207 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.0] 2023-10-06T01:39:55.207 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQBPZR9lT45fFxAAviTkT2FYL+NLj6FNrCE5Ng== 2023-10-06T01:39:55.208 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.1] 2023-10-06T01:39:55.208 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQBSZR9lWpR+FBAA0WaTKl/H0wwNPPPqS1ju3w== 2023-10-06T01:39:55.208 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.2] 2023-10-06T01:39:55.208 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQBVZR9lFrqxExAABQRNP/VF7HBY7D8WBia/CA== 2023-10-06T01:39:55.208 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.3] 2023-10-06T01:39:55.208 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQBYZR9lmNBKExAAi3WvWiyerLluzlqwcVv6CA== 2023-10-06T01:39:55.208 INFO:teuthology.orchestra.run.smithi072.stdout:[mgr.x] 2023-10-06T01:39:55.208 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQBLZR9lcCNIJRAAreWP16OjllwbkDLHYn36tA== 2023-10-06T01:39:55.208 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.b] 2023-10-06T01:39:55.208 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQBLZR9lE79sMxAAm8IQLgkFMY+nP5YQcCZeZg== 2023-10-06T01:39:55.208 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.d] 2023-10-06T01:39:55.208 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQBLZR9loz09OhAAy7MxAbp7ihZerFQfSqBglw== 2023-10-06T01:39:55.209 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.4] 2023-10-06T01:39:55.209 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQBeZR9lwv27EBAAX3IDzrKCSWlivcjt4tn+9A== 2023-10-06T01:39:55.209 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.5] 2023-10-06T01:39:55.209 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQBhZR9lhqzQDhAASmhyOln1kgXSDwK+7YZJyQ== 2023-10-06T01:39:55.209 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.6] 2023-10-06T01:39:55.209 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQBkZR9lLimVDhAAV8pqtb5zp49hl4HAJM0tfA== 2023-10-06T01:39:55.209 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.7] 2023-10-06T01:39:55.209 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQBnZR9lDwURDxAABbfmEhouaGSV3tByZdRKKw== 2023-10-06T01:39:55.209 INFO:teuthology.orchestra.run.smithi072.stdout:[client.0] 2023-10-06T01:39:55.209 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQBMZR9lFadqAhAAjrNmQYFfd+qw3Vup+6+B+Q== 2023-10-06T01:39:55.209 INFO:teuthology.orchestra.run.smithi072.stdout:[client.2] 2023-10-06T01:39:55.209 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQBMZR9lfIDHBxAAPZRU1OPQtHEJ2+ozcMF5pA== 2023-10-06T01:39:55.210 INFO:teuthology.orchestra.run.smithi072.stdout:[client.1] 2023-10-06T01:39:55.210 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQBMZR9l8Jy+ChAAtqx+Fz4onmRzILbFxuZ5lg== 2023-10-06T01:39:55.210 INFO:teuthology.orchestra.run.smithi072.stdout:[client.3] 2023-10-06T01:39:55.210 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQBMZR9lC2QVEBAAJiILvy19TnhA32dUBUiWJw== 2023-10-06T01:39:55.211 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T01:39:55.234 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T01:39:55.297 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T01:39:55.300 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T01:39:55.349 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T01:39:55.351 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T01:39:55.401 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T01:39:55.403 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T01:39:55.450 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T01:39:55.452 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T01:39:55.499 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T01:39:55.501 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T01:39:55.549 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T01:39:55.551 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T01:39:55.597 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T01:39:55.600 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T01:39:55.646 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T01:39:55.649 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T01:39:55.698 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T01:39:55.700 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T01:39:55.750 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T01:39:55.752 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T01:39:55.798 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T01:39:55.801 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T01:39:55.847 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T01:39:55.850 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T01:39:55.896 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T01:39:55.898 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T01:39:55.945 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T01:39:55.948 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T01:39:55.997 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T01:39:55.999 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T01:39:56.049 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T01:39:56.051 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T01:39:56.101 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T01:39:56.103 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T01:39:56.153 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-10-06T01:39:56.154 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-10-06T01:39:56.177 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-06T01:39:56.268 DEBUG:teuthology.orchestra.run.smithi071:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-10-06T01:39:56.292 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-10-06T01:39:56.316 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-06T01:39:56.407 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-10-06T01:39:56.431 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-10-06T01:39:56.494 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-06T01:39:56.585 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-10-06T01:39:56.609 DEBUG:teuthology.orchestra.run.smithi071:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-06T01:39:56.612 DEBUG:teuthology.orchestra.run.smithi072:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-06T01:39:56.664 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-10-06T01:39:56.664 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-06T01:39:56.665 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-10-06T01:39:56.666 INFO:tasks.ceph.mon.a:Started 2023-10-06T01:39:56.667 INFO:tasks.ceph.mon.b:Restarting daemon 2023-10-06T01:39:56.667 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-10-06T01:39:56.707 INFO:tasks.ceph.mon.b:Started 2023-10-06T01:39:56.707 INFO:tasks.ceph.mon.c:Restarting daemon 2023-10-06T01:39:56.707 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-10-06T01:39:56.709 INFO:tasks.ceph.mon.c:Started 2023-10-06T01:39:56.709 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-10-06T01:39:56.709 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-10-06T01:39:56.709 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-10-06T01:39:56.711 INFO:tasks.ceph.mgr.y:Started 2023-10-06T01:39:56.711 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-06T01:39:56.712 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-06T01:39:56.713 INFO:tasks.ceph.mgr.x:Started 2023-10-06T01:39:56.714 INFO:tasks.ceph:Setting crush tunables to default 2023-10-06T01:39:56.714 DEBUG:teuthology.orchestra.run.smithi071:> sudo ceph --cluster ceph osd crush tunables default 2023-10-06T01:39:56.835 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:56.834+0000 7f2f8bd86700 1 Processor -- start 2023-10-06T01:39:56.835 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:56.834+0000 7f2f8bd86700 1 -- start start 2023-10-06T01:39:56.836 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:56.835+0000 7f2f8bd86700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f2f840c3fd0 0x7f2f840c4440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:56.836 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:56.835+0000 7f2f8bd86700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f840c3b40 con 0x7f2f840cbcc0 2023-10-06T01:39:56.836 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:56.835+0000 7f2f8bd86700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f840c2f30 con 0x7f2f841574b0 2023-10-06T01:39:56.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:56.835+0000 7f2f8bd86700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f840c4980 con 0x7f2f840c3fd0 2023-10-06T01:39:56.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:56.835+0000 7f2f89321700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f2f840c3fd0 0x7f2f840c4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:56.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:56.835+0000 7f2f89321700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f2f840c3fd0 0x7f2f840c4440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41936/0 (socket says 172.21.15.71:41936) 2023-10-06T01:39:56.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:56.835+0000 7f2f89321700 1 -- 172.21.15.71:0/3018775461 learned_addr learned my addr 172.21.15.71:0/3018775461 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:39:56.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:56.835+0000 7f2f89321700 1 -- 172.21.15.71:0/3018775461 >> v2:172.21.15.71:3300/0 conn(0x7f2f840c3fd0 msgr2=0x7f2f840c4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-06T01:39:56.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:56.835+0000 7f2f89321700 1 -- 172.21.15.71:0/3018775461 >> v2:172.21.15.71:3300/0 conn(0x7f2f840c3fd0 msgr2=0x7f2f840c4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T01:39:56.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:56.835+0000 7f2f89321700 1 --2- 172.21.15.71:0/3018775461 >> v2:172.21.15.71:3300/0 conn(0x7f2f840c3fd0 0x7f2f840c4440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T01:39:56.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:56.835+0000 7f2f89321700 1 --2- 172.21.15.71:0/3018775461 >> v2:172.21.15.71:3300/0 conn(0x7f2f840c3fd0 0x7f2f840c4440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-06T01:39:57.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:57.036+0000 7f2f89321700 1 --2- 172.21.15.71:0/3018775461 >> v2:172.21.15.71:3300/0 conn(0x7f2f840c3fd0 0x7f2f840c4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:57.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:57.036+0000 7f2f89321700 1 -- 172.21.15.71:0/3018775461 >> v2:172.21.15.71:3300/0 conn(0x7f2f840c3fd0 msgr2=0x7f2f840c4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-06T01:39:57.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:57.036+0000 7f2f89321700 1 -- 172.21.15.71:0/3018775461 >> v2:172.21.15.71:3300/0 conn(0x7f2f840c3fd0 msgr2=0x7f2f840c4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T01:39:57.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:57.036+0000 7f2f89321700 1 --2- 172.21.15.71:0/3018775461 >> v2:172.21.15.71:3300/0 conn(0x7f2f840c3fd0 0x7f2f840c4440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T01:39:57.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:57.036+0000 7f2f89321700 1 --2- 172.21.15.71:0/3018775461 >> v2:172.21.15.71:3300/0 conn(0x7f2f840c3fd0 0x7f2f840c4440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-06T01:39:57.044 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:57.040+0000 7f2f88b20700 1 -- 172.21.15.71:0/3018775461 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 190199218 0 0) 0x7f2f840c3b40 con 0x7f2f840cbcc0 2023-10-06T01:39:57.044 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:57.040+0000 7f2f88b20700 1 -- 172.21.15.71:0/3018775461 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f70003570 con 0x7f2f840cbcc0 2023-10-06T01:39:57.044 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:57.040+0000 7f2f88b20700 1 -- 172.21.15.71:0/3018775461 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1671385424 0 0) 0x7f2f840c2f30 con 0x7f2f841574b0 2023-10-06T01:39:57.044 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:57.040+0000 7f2f88b20700 1 -- 172.21.15.71:0/3018775461 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f840c3b40 con 0x7f2f841574b0 2023-10-06T01:39:57.044 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:57.041+0000 7f2f88b20700 1 -- 172.21.15.71:0/3018775461 <== mon.1 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 155650967 0 0) 0x7f2f840c3b40 con 0x7f2f841574b0 2023-10-06T01:39:57.044 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:57.041+0000 7f2f88b20700 1 -- 172.21.15.71:0/3018775461 >> v2:172.21.15.71:3300/0 conn(0x7f2f840c3fd0 msgr2=0x7f2f840c4440 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T01:39:57.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:57.041+0000 7f2f88b20700 1 --2- 172.21.15.71:0/3018775461 >> v2:172.21.15.71:3300/0 conn(0x7f2f840c3fd0 0x7f2f840c4440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:57.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:57.041+0000 7f2f88b20700 1 -- 172.21.15.71:0/3018775461 >> v1:172.21.15.71:6789/0 conn(0x7f2f840cbcc0 legacy=0x7f2f840c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:57.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:57.041+0000 7f2f88b20700 1 -- 172.21.15.71:0/3018775461 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f840c3210 con 0x7f2f841574b0 2023-10-06T01:39:57.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:57.041+0000 7f2f88b20700 1 -- 172.21.15.71:0/3018775461 <== mon.1 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1184243524 0 0) 0x7f2f80001880 con 0x7f2f841574b0 2023-10-06T01:39:57.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:57.041+0000 7f2f88b20700 1 -- 172.21.15.71:0/3018775461 >> v1:172.21.15.72:6789/0 conn(0x7f2f841574b0 legacy=0x7f2f840b0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:57.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:57.041+0000 7f2f88b20700 1 --2- 172.21.15.71:0/3018775461 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2f70003bf0 0x7f2f70003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:57.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:57.041+0000 7f2f88b20700 1 --2- 172.21.15.71:0/3018775461 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f70004810 0x7f2f70004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:57.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:57.041+0000 7f2f88b20700 1 --2- 172.21.15.71:0/3018775461 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2f70005230 0x7f2f7000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:57.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:57.041+0000 7f2f88b20700 1 -- 172.21.15.71:0/3018775461 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f840c4980 con 0x7f2f70005230 2023-10-06T01:39:57.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:57.041+0000 7f2f88b20700 1 -- 172.21.15.71:0/3018775461 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7000c160 con 0x7f2f70004810 2023-10-06T01:39:57.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:57.041+0000 7f2f88b20700 1 -- 172.21.15.71:0/3018775461 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7000c320 con 0x7f2f70003bf0 2023-10-06T01:39:57.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:57.041+0000 7f2f89321700 1 --2- 172.21.15.71:0/3018775461 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f70004810 0x7f2f70004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:57.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:57.041+0000 7f2f89b22700 1 --2- 172.21.15.71:0/3018775461 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2f70003bf0 0x7f2f70003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:57.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:57.041+0000 7f2f8a323700 1 --2- 172.21.15.71:0/3018775461 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2f70005230 0x7f2f7000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:57.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:57.041+0000 7f2f89321700 1 -- 172.21.15.71:0/3018775461 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2f70003bf0 msgr2=0x7f2f70003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:57.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:57.041+0000 7f2f89321700 1 --2- 172.21.15.71:0/3018775461 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2f70003bf0 0x7f2f70003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:57.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:57.041+0000 7f2f89321700 1 -- 172.21.15.71:0/3018775461 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2f70005230 msgr2=0x7f2f7000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:57.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:57.041+0000 7f2f89321700 1 --2- 172.21.15.71:0/3018775461 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2f70005230 0x7f2f7000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:57.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:57.041+0000 7f2f89321700 1 -- 172.21.15.71:0/3018775461 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f840c3b40 con 0x7f2f70004810 2023-10-06T01:39:57.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:57.041+0000 7f2f89b22700 1 --2- 172.21.15.71:0/3018775461 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2f70003bf0 0x7f2f70003fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:39:57.047 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:57.042+0000 7f2f8a323700 1 -- 172.21.15.71:0/3018775461 reap_dead start 2023-10-06T01:39:57.047 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:57.042+0000 7f2f89321700 1 --2- 172.21.15.71:0/3018775461 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f70004810 0x7f2f70004c80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2f74009060 tx=0x7f2f74008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ecf0bf4e2f7ffbb9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:57.047 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:57.042+0000 7f2f88b20700 1 -- 172.21.15.71:0/3018775461 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7400e590 con 0x7f2f70004810 2023-10-06T01:39:57.047 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:57.042+0000 7f2f88b20700 1 -- 172.21.15.71:0/3018775461 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f7400c050 con 0x7f2f70004810 2023-10-06T01:39:57.047 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:57.042+0000 7f2f88b20700 1 -- 172.21.15.71:0/3018775461 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f74010980 con 0x7f2f70004810 2023-10-06T01:39:57.047 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:57.043+0000 7f2f8bd86700 1 -- 172.21.15.71:0/3018775461 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f70004810 msgr2=0x7f2f70004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:57.047 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:57.043+0000 7f2f8bd86700 1 --2- 172.21.15.71:0/3018775461 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f70004810 0x7f2f70004c80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2f74009060 tx=0x7f2f74008040 comp rx=0 tx=0).stop 2023-10-06T01:39:57.047 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:57.043+0000 7f2f8bd86700 1 -- 172.21.15.71:0/3018775461 shutdown_connections 2023-10-06T01:39:57.047 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:57.043+0000 7f2f8bd86700 1 --2- 172.21.15.71:0/3018775461 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f70004810 0x7f2f70004c80 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:57.047 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:57.043+0000 7f2f8bd86700 1 -- 172.21.15.71:0/3018775461 >> 172.21.15.71:0/3018775461 conn(0x7f2f84067910 msgr2=0x7f2f840ce0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:57.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:57.043+0000 7f2f8bd86700 1 -- 172.21.15.71:0/3018775461 shutdown_connections 2023-10-06T01:39:57.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:57.043+0000 7f2f8bd86700 1 -- 172.21.15.71:0/3018775461 wait complete. 2023-10-06T01:39:57.050 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:57.044+0000 7f2f8bd86700 1 Processor -- start 2023-10-06T01:39:57.050 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:57.044+0000 7f2f8bd86700 1 -- start start 2023-10-06T01:39:57.050 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:57.045+0000 7f2f8bd86700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2f70004810 0x7f2f84144d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:57.050 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:57.045+0000 7f2f8bd86700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f84168b00 0x7f2f84158c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:57.050 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:57.045+0000 7f2f8bd86700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2f840b1c80 0x7f2f840b20f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:57.050 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:57.045+0000 7f2f8bd86700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f84168820 con 0x7f2f840b1c80 2023-10-06T01:39:57.051 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:57.045+0000 7f2f8bd86700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f840b2630 con 0x7f2f84168b00 2023-10-06T01:39:57.051 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:57.045+0000 7f2f8bd86700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f84145250 con 0x7f2f70004810 2023-10-06T01:39:57.051 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:57.045+0000 7f2f89b22700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2f70004810 0x7f2f84144d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:57.051 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:57.045+0000 7f2f8a323700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2f840b1c80 0x7f2f840b20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:57.051 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:57.045+0000 7f2f89b22700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2f70004810 0x7f2f84144d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.71:54250/0 (socket says 172.21.15.71:54250) 2023-10-06T01:39:57.051 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:57.045+0000 7f2f8a323700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2f840b1c80 0x7f2f840b20f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:42004/0 (socket says 172.21.15.71:42004) 2023-10-06T01:39:57.051 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:57.045+0000 7f2f89321700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f84168b00 0x7f2f84158c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:57.051 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:57.045+0000 7f2f89b22700 1 -- 172.21.15.71:0/1093681501 learned_addr learned my addr 172.21.15.71:0/1093681501 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:39:57.051 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:57.045+0000 7f2f8a323700 1 -- 172.21.15.71:0/1093681501 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2f70004810 msgr2=0x7f2f84144d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:57.051 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:57.046+0000 7f2f8a323700 1 --2- 172.21.15.71:0/1093681501 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2f70004810 0x7f2f84144d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:57.051 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:57.046+0000 7f2f8a323700 1 -- 172.21.15.71:0/1093681501 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f84168b00 msgr2=0x7f2f84158c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:57.051 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:57.046+0000 7f2f8a323700 1 --2- 172.21.15.71:0/1093681501 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f84168b00 0x7f2f84158c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:57.052 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:57.046+0000 7f2f8a323700 1 -- 172.21.15.71:0/1093681501 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f84167950 con 0x7f2f840b1c80 2023-10-06T01:39:57.052 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:57.046+0000 7f2f8a323700 1 --2- 172.21.15.71:0/1093681501 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2f840b1c80 0x7f2f840b20f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2f840870d0 tx=0x7f2f7c007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:57.052 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:57.048+0000 7f2f79ffb700 1 -- 172.21.15.71:0/1093681501 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7c006a30 con 0x7f2f840b1c80 2023-10-06T01:39:57.052 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:57.048+0000 7f2f8bd86700 1 -- 172.21.15.71:0/1093681501 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f84167c10 con 0x7f2f840b1c80 2023-10-06T01:39:57.052 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:57.048+0000 7f2f79ffb700 1 -- 172.21.15.71:0/1093681501 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f7c006bb0 con 0x7f2f840b1c80 2023-10-06T01:39:57.052 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:57.048+0000 7f2f79ffb700 1 -- 172.21.15.71:0/1093681501 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7c007030 con 0x7f2f840b1c80 2023-10-06T01:39:57.052 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:57.048+0000 7f2f79ffb700 1 -- 172.21.15.71:0/1093681501 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f2f7c007620 con 0x7f2f840b1c80 2023-10-06T01:39:57.052 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:57.049+0000 7f2f8bd86700 1 -- 172.21.15.71:0/1093681501 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f841681d0 con 0x7f2f840b1c80 2023-10-06T01:39:57.052 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:57.049+0000 7f2f79ffb700 1 -- 172.21.15.71:0/1093681501 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f2f7c0149f0 con 0x7f2f840b1c80 2023-10-06T01:39:57.053 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:57.050+0000 7f2f8bd86700 1 -- 172.21.15.71:0/1093681501 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f8406e590 con 0x7f2f840b1c80 2023-10-06T01:39:57.053 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:57.052+0000 7f2f79ffb700 1 -- 172.21.15.71:0/1093681501 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f2f7c019070 con 0x7f2f840b1c80 2023-10-06T01:39:57.127 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:57.126+0000 7f2f8bd86700 1 -- 172.21.15.71:0/1093681501 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f2f84068420 con 0x7f2f840b1c80 2023-10-06T01:39:57.134 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:57.133+0000 7f2f79ffb700 1 -- 172.21.15.71:0/1093681501 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f2f7c014c30 con 0x7f2f840b1c80 2023-10-06T01:39:57.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:57.134+0000 7f2f8bd86700 1 -- 172.21.15.71:0/1093681501 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2f840b1c80 msgr2=0x7f2f840b20f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:57.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:57.134+0000 7f2f8bd86700 1 --2- 172.21.15.71:0/1093681501 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2f840b1c80 0x7f2f840b20f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2f840870d0 tx=0x7f2f7c007d30 comp rx=0 tx=0).stop 2023-10-06T01:39:57.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:57.134+0000 7f2f8bd86700 1 -- 172.21.15.71:0/1093681501 shutdown_connections 2023-10-06T01:39:57.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:57.134+0000 7f2f8bd86700 1 --2- 172.21.15.71:0/1093681501 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2f840b1c80 0x7f2f840b20f0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:57.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:57.134+0000 7f2f8bd86700 1 --2- 172.21.15.71:0/1093681501 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2f70004810 0x7f2f84144d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:57.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:57.134+0000 7f2f8bd86700 1 --2- 172.21.15.71:0/1093681501 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f84168b00 0x7f2f84158c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:57.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:57.134+0000 7f2f8bd86700 1 -- 172.21.15.71:0/1093681501 >> 172.21.15.71:0/1093681501 conn(0x7f2f84067910 msgr2=0x7f2f84152c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:57.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:57.134+0000 7f2f8bd86700 1 -- 172.21.15.71:0/1093681501 shutdown_connections 2023-10-06T01:39:57.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:57.134+0000 7f2f8bd86700 1 -- 172.21.15.71:0/1093681501 wait complete. 2023-10-06T01:39:57.136 INFO:teuthology.orchestra.run.smithi071.stderr:adjusted tunables profile to default 2023-10-06T01:39:57.146 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-10-06T01:39:57.147 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-10-06T01:39:57.147 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-10-06T01:39:57.172 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-10-06T01:39:57.172 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-10-06T01:39:57.238 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-10-06T01:39:57.238 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-10-06T01:39:57.304 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2023-10-06T01:39:57.304 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-10-06T01:39:57.369 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-06T01:39:57.369 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-10-06T01:39:57.393 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-06T01:39:57.394 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-10-06T01:39:57.457 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-06T01:39:57.458 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-10-06T01:39:57.521 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-06T01:39:57.521 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-10-06T01:39:57.585 DEBUG:teuthology.orchestra.run.smithi072:> sudo ceph --cluster ceph osd new cf059188-fb20-4dbf-95db-dcf57b213d03 0 2023-10-06T01:39:57.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.740+0000 7f20d31da700 1 Processor -- start 2023-10-06T01:39:57.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.740+0000 7f20d31da700 1 -- start start 2023-10-06T01:39:57.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.741+0000 7f20d31da700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f20cc0a89c0 0x7f20cc0aeaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:57.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.741+0000 7f20d31da700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f20cc0a8d90 0x7f20cc0af030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:57.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.741+0000 7f20d31da700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20cc06b030 con 0x7f20cc0af570 2023-10-06T01:39:57.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.741+0000 7f20d31da700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20cc0b1ab0 con 0x7f20cc0a89c0 2023-10-06T01:39:57.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.741+0000 7f20d31da700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20cc06ad50 con 0x7f20cc0a8d90 2023-10-06T01:39:57.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.741+0000 7f20d0f76700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f20cc0a89c0 0x7f20cc0aeaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:57.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.741+0000 7f20cbfff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f20cc0a8d90 0x7f20cc0af030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:57.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.741+0000 7f20d1777700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f20cc0af570 0x7f20cc0b2810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:38366/0 (socket says 172.21.15.72:38366) 2023-10-06T01:39:57.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.741+0000 7f20cbfff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f20cc0a8d90 0x7f20cc0af030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:48804/0 (socket says 172.21.15.72:48804) 2023-10-06T01:39:57.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.741+0000 7f20d0f76700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f20cc0a89c0 0x7f20cc0aeaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54612/0 (socket says 172.21.15.72:54612) 2023-10-06T01:39:57.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.741+0000 7f20d1777700 1 -- 172.21.15.72:0/481743754 learned_addr learned my addr 172.21.15.72:0/481743754 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-06T01:39:57.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.741+0000 7f20d0f76700 1 -- 172.21.15.72:0/481743754 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f20cc0a8d90 msgr2=0x7f20cc0af030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:57.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.741+0000 7f20d0f76700 1 --2- 172.21.15.72:0/481743754 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f20cc0a8d90 0x7f20cc0af030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:57.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.741+0000 7f20d0f76700 1 -- 172.21.15.72:0/481743754 >> v1:172.21.15.72:6789/0 conn(0x7f20cc0af570 legacy=0x7f20cc0b2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:57.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.741+0000 7f20cb7fe700 1 -- 172.21.15.72:0/481743754 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4195540913 0 0) 0x7f20cc06b030 con 0x7f20cc0af570 2023-10-06T01:39:57.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.741+0000 7f20d0f76700 1 -- 172.21.15.72:0/481743754 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20cc0b1d30 con 0x7f20cc0a89c0 2023-10-06T01:39:57.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.741+0000 7f20cbfff700 1 --2- 172.21.15.72:0/481743754 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f20cc0a8d90 0x7f20cc0af030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:39:57.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.741+0000 7f20d0f76700 1 --2- 172.21.15.72:0/481743754 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20cc0a89c0 0x7f20cc0aeaf0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f20c00098d0 tx=0x7f20c0009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6e89d1567a3381e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:57.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.742+0000 7f20cb7fe700 1 -- 172.21.15.72:0/481743754 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c0005c10 con 0x7f20cc0a89c0 2023-10-06T01:39:57.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.742+0000 7f20cb7fe700 1 -- 172.21.15.72:0/481743754 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20c0005d70 con 0x7f20cc0a89c0 2023-10-06T01:39:57.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.742+0000 7f20cb7fe700 1 -- 172.21.15.72:0/481743754 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c0006280 con 0x7f20cc0a89c0 2023-10-06T01:39:57.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.742+0000 7f20d31da700 1 -- 172.21.15.72:0/481743754 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20cc0a89c0 msgr2=0x7f20cc0aeaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:57.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.742+0000 7f20d31da700 1 --2- 172.21.15.72:0/481743754 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20cc0a89c0 0x7f20cc0aeaf0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f20c00098d0 tx=0x7f20c0009120 comp rx=0 tx=0).stop 2023-10-06T01:39:57.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.742+0000 7f20d31da700 1 -- 172.21.15.72:0/481743754 shutdown_connections 2023-10-06T01:39:57.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.742+0000 7f20d31da700 1 --2- 172.21.15.72:0/481743754 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20cc0a89c0 0x7f20cc0aeaf0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:57.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.742+0000 7f20d31da700 1 --2- 172.21.15.72:0/481743754 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f20cc0a8d90 0x7f20cc0af030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:57.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.742+0000 7f20d31da700 1 -- 172.21.15.72:0/481743754 >> 172.21.15.72:0/481743754 conn(0x7f20cc067910 msgr2=0x7f20cc0ce120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:57.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.742+0000 7f20d31da700 1 -- 172.21.15.72:0/481743754 shutdown_connections 2023-10-06T01:39:57.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.742+0000 7f20d31da700 1 -- 172.21.15.72:0/481743754 wait complete. 2023-10-06T01:39:57.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.743+0000 7f20d31da700 1 Processor -- start 2023-10-06T01:39:57.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.744+0000 7f20d31da700 1 -- start start 2023-10-06T01:39:57.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.744+0000 7f20d31da700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f20cc0a89c0 0x7f20cc1575f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:57.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.744+0000 7f20d31da700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f20cc0a8d90 0x7f20cc0cc7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:57.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.744+0000 7f20d31da700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20cc0af570 0x7f20cc0c3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:57.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.744+0000 7f20d31da700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20cc0c4760 con 0x7f20cc0a89c0 2023-10-06T01:39:57.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.744+0000 7f20d31da700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20cc0c2ec0 con 0x7f20cc0af570 2023-10-06T01:39:57.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.744+0000 7f20d31da700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20cc098300 con 0x7f20cc0a8d90 2023-10-06T01:39:57.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.745+0000 7f20d1777700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20cc0af570 0x7f20cc0c3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:57.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.745+0000 7f20cbfff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f20cc0a8d90 0x7f20cc0cc7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:57.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.745+0000 7f20cbfff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f20cc0a8d90 0x7f20cc0cc7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:48806/0 (socket says 172.21.15.72:48806) 2023-10-06T01:39:57.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.745+0000 7f20cbfff700 1 -- 172.21.15.72:0/3508442045 learned_addr learned my addr 172.21.15.72:0/3508442045 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-06T01:39:57.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.745+0000 7f20d1777700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20cc0af570 0x7f20cc0c3ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54628/0 (socket says 172.21.15.72:54628) 2023-10-06T01:39:57.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.745+0000 7f20d0f76700 1 --2- 172.21.15.72:0/3508442045 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f20cc0a89c0 0x7f20cc1575f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:57.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.745+0000 7f20d1777700 1 -- 172.21.15.72:0/3508442045 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f20cc0a8d90 msgr2=0x7f20cc0cc7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:57.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.745+0000 7f20d1777700 1 --2- 172.21.15.72:0/3508442045 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f20cc0a8d90 0x7f20cc0cc7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:57.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.745+0000 7f20d1777700 1 -- 172.21.15.72:0/3508442045 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f20cc0a89c0 msgr2=0x7f20cc1575f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:57.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.745+0000 7f20d1777700 1 --2- 172.21.15.72:0/3508442045 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f20cc0a89c0 0x7f20cc1575f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:57.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.745+0000 7f20d1777700 1 -- 172.21.15.72:0/3508442045 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20b8009420 con 0x7f20cc0af570 2023-10-06T01:39:57.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.745+0000 7f20cbfff700 1 --2- 172.21.15.72:0/3508442045 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f20cc0a8d90 0x7f20cc0cc7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:39:57.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.745+0000 7f20d1777700 1 --2- 172.21.15.72:0/3508442045 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20cc0af570 0x7f20cc0c3ae0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f20c400cb90 tx=0x7f20c40018f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:57.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.745+0000 7f20c8ff9700 1 -- 172.21.15.72:0/3508442045 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c400a780 con 0x7f20cc0af570 2023-10-06T01:39:57.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.745+0000 7f20c8ff9700 1 -- 172.21.15.72:0/3508442045 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20c400a8e0 con 0x7f20cc0af570 2023-10-06T01:39:57.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.745+0000 7f20c8ff9700 1 -- 172.21.15.72:0/3508442045 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c400aca0 con 0x7f20cc0af570 2023-10-06T01:39:57.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.745+0000 7f20d31da700 1 -- 172.21.15.72:0/3508442045 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20c00093c0 con 0x7f20cc0af570 2023-10-06T01:39:57.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.745+0000 7f20d31da700 1 -- 172.21.15.72:0/3508442045 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20cc157b30 con 0x7f20cc0af570 2023-10-06T01:39:57.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.745+0000 7f20c8ff9700 1 -- 172.21.15.72:0/3508442045 <== mon.1 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f20c4007300 con 0x7f20cc0af570 2023-10-06T01:39:57.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.745+0000 7f20c8ff9700 1 -- 172.21.15.72:0/3508442045 <== mon.1 v2:172.21.15.72:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7f20c401b750 con 0x7f20cc0af570 2023-10-06T01:39:57.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.746+0000 7f20d31da700 1 -- 172.21.15.72:0/3508442045 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20cc087170 con 0x7f20cc0af570 2023-10-06T01:39:57.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.750+0000 7f20c8ff9700 1 -- 172.21.15.72:0/3508442045 <== mon.1 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f20c4007740 con 0x7f20cc0af570 2023-10-06T01:39:57.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.832+0000 7f20d31da700 1 -- 172.21.15.72:0/3508442045 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd new", "uuid": "cf059188-fb20-4dbf-95db-dcf57b213d03", "id": 0} v 0) v1 -- 0x7f20cc06e5d0 con 0x7f20cc0af570 2023-10-06T01:39:57.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.836+0000 7f20c8ff9700 1 -- 172.21.15.72:0/3508442045 <== mon.1 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "cf059188-fb20-4dbf-95db-dcf57b213d03", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f20c40078e0 con 0x7f20cc0af570 2023-10-06T01:39:57.836 INFO:teuthology.orchestra.run.smithi072.stdout:0 2023-10-06T01:39:57.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.837+0000 7f20d31da700 1 -- 172.21.15.72:0/3508442045 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20cc0af570 msgr2=0x7f20cc0c3ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:57.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.837+0000 7f20d31da700 1 --2- 172.21.15.72:0/3508442045 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20cc0af570 0x7f20cc0c3ae0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f20c400cb90 tx=0x7f20c40018f0 comp rx=0 tx=0).stop 2023-10-06T01:39:57.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.837+0000 7f20d31da700 1 -- 172.21.15.72:0/3508442045 shutdown_connections 2023-10-06T01:39:57.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.837+0000 7f20d31da700 1 --2- 172.21.15.72:0/3508442045 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20cc0af570 0x7f20cc0c3ae0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:57.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.837+0000 7f20d31da700 1 --2- 172.21.15.72:0/3508442045 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f20cc0a89c0 0x7f20cc1575f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:57.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.837+0000 7f20d31da700 1 --2- 172.21.15.72:0/3508442045 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f20cc0a8d90 0x7f20cc0cc7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:57.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.837+0000 7f20d31da700 1 -- 172.21.15.72:0/3508442045 >> 172.21.15.72:0/3508442045 conn(0x7f20cc067910 msgr2=0x7f20cc06c580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:57.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.837+0000 7f20d31da700 1 -- 172.21.15.72:0/3508442045 shutdown_connections 2023-10-06T01:39:57.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.837+0000 7f20d31da700 1 -- 172.21.15.72:0/3508442045 wait complete. 2023-10-06T01:39:57.849 DEBUG:teuthology.orchestra.run.smithi072:> sudo ceph --cluster ceph osd new 0cff0aae-1799-4fe0-b610-54cf0813c0e1 1 2023-10-06T01:39:57.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.962+0000 7f73ea65a700 1 Processor -- start 2023-10-06T01:39:57.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.962+0000 7f73ea65a700 1 -- start start 2023-10-06T01:39:57.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.963+0000 7f73ea65a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f73e415a030 0x7f73e415a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:57.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.963+0000 7f73ea65a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f73e4087700 0x7f73e40b21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:57.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.963+0000 7f73ea65a700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73e40afc50 con 0x7f73e415a940 2023-10-06T01:39:57.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.963+0000 7f73ea65a700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73e40b0cf0 con 0x7f73e4087700 2023-10-06T01:39:57.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.963+0000 7f73ea65a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73e40aff30 con 0x7f73e415a030 2023-10-06T01:39:57.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.963+0000 7f73e3fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f73e415a030 0x7f73e415a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:57.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.963+0000 7f73e37fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f73e415a940 0x7f73e4086ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:38380/0 (socket says 172.21.15.72:38380) 2023-10-06T01:39:57.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.963+0000 7f73e37fe700 1 -- 172.21.15.72:0/821460153 learned_addr learned my addr 172.21.15.72:0/821460153 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-06T01:39:57.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.963+0000 7f73e8bf7700 1 --2- 172.21.15.72:0/821460153 >> v2:172.21.15.71:3300/0 conn(0x7f73e4087700 0x7f73e40b21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:57.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.963+0000 7f73e2ffd700 1 -- 172.21.15.72:0/821460153 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2520154036 0 0) 0x7f73e40afc50 con 0x7f73e415a940 2023-10-06T01:39:57.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.963+0000 7f73e3fff700 1 -- 172.21.15.72:0/821460153 >> v2:172.21.15.71:3300/0 conn(0x7f73e4087700 msgr2=0x7f73e40b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:57.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.963+0000 7f73e3fff700 1 --2- 172.21.15.72:0/821460153 >> v2:172.21.15.71:3300/0 conn(0x7f73e4087700 0x7f73e40b21b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:57.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.963+0000 7f73e3fff700 1 -- 172.21.15.72:0/821460153 >> v1:172.21.15.72:6789/0 conn(0x7f73e415a940 legacy=0x7f73e4086ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:57.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.963+0000 7f73e3fff700 1 -- 172.21.15.72:0/821460153 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73e40b0210 con 0x7f73e415a030 2023-10-06T01:39:57.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.963+0000 7f73e3fff700 1 --2- 172.21.15.72:0/821460153 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f73e415a030 0x7f73e415a400 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f73d40098e0 tx=0x7f73d40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c30dc1466bfe30f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:57.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.963+0000 7f73e2ffd700 1 -- 172.21.15.72:0/821460153 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d400b640 con 0x7f73e415a030 2023-10-06T01:39:57.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.963+0000 7f73e2ffd700 1 -- 172.21.15.72:0/821460153 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73d400b7a0 con 0x7f73e415a030 2023-10-06T01:39:57.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.963+0000 7f73e2ffd700 1 -- 172.21.15.72:0/821460153 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d400bb40 con 0x7f73e415a030 2023-10-06T01:39:57.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.964+0000 7f73ea65a700 1 -- 172.21.15.72:0/821460153 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f73e415a030 msgr2=0x7f73e415a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:57.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.964+0000 7f73ea65a700 1 --2- 172.21.15.72:0/821460153 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f73e415a030 0x7f73e415a400 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f73d40098e0 tx=0x7f73d40091a0 comp rx=0 tx=0).stop 2023-10-06T01:39:57.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.964+0000 7f73ea65a700 1 -- 172.21.15.72:0/821460153 shutdown_connections 2023-10-06T01:39:57.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.964+0000 7f73ea65a700 1 --2- 172.21.15.72:0/821460153 >> v2:172.21.15.71:3300/0 conn(0x7f73e4087700 0x7f73e40b21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:57.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.964+0000 7f73ea65a700 1 --2- 172.21.15.72:0/821460153 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f73e415a030 0x7f73e415a400 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:57.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.964+0000 7f73ea65a700 1 -- 172.21.15.72:0/821460153 >> 172.21.15.72:0/821460153 conn(0x7f73e4068680 msgr2=0x7f73e4068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:57.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.964+0000 7f73ea65a700 1 -- 172.21.15.72:0/821460153 shutdown_connections 2023-10-06T01:39:57.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.964+0000 7f73ea65a700 1 -- 172.21.15.72:0/821460153 wait complete. 2023-10-06T01:39:57.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.965+0000 7f73ea65a700 1 Processor -- start 2023-10-06T01:39:57.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.966+0000 7f73ea65a700 1 -- start start 2023-10-06T01:39:57.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.966+0000 7f73ea65a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f73e4087700 0x7f73e415b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:57.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.966+0000 7f73ea65a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f73e415a030 0x7f73e415b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:57.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.966+0000 7f73ea65a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f73e415a940 0x7f73e415bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:57.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.966+0000 7f73ea65a700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73e40c6360 con 0x7f73e415a030 2023-10-06T01:39:57.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.966+0000 7f73ea65a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73e40c67f0 con 0x7f73e415a940 2023-10-06T01:39:57.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.966+0000 7f73ea65a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73e40c5750 con 0x7f73e4087700 2023-10-06T01:39:57.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.966+0000 7f73e3fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f73e4087700 0x7f73e415b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:57.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.966+0000 7f73e8bf7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f73e415a940 0x7f73e415bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:57.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.966+0000 7f73e3fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f73e4087700 0x7f73e415b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:48828/0 (socket says 172.21.15.72:48828) 2023-10-06T01:39:57.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.966+0000 7f73e3fff700 1 -- 172.21.15.72:0/2146349314 learned_addr learned my addr 172.21.15.72:0/2146349314 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-06T01:39:57.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.966+0000 7f73e37fe700 1 --2- 172.21.15.72:0/2146349314 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f73e415a030 0x7f73e415b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:57.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.967+0000 7f73e37fe700 1 -- 172.21.15.72:0/2146349314 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f73e4087700 msgr2=0x7f73e415b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:57.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.967+0000 7f73e37fe700 1 --2- 172.21.15.72:0/2146349314 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f73e4087700 0x7f73e415b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:57.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.967+0000 7f73e37fe700 1 -- 172.21.15.72:0/2146349314 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f73e415a940 msgr2=0x7f73e415bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:57.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.967+0000 7f73e37fe700 1 --2- 172.21.15.72:0/2146349314 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f73e415a940 0x7f73e415bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:57.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.967+0000 7f73e37fe700 1 -- 172.21.15.72:0/2146349314 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73d4009420 con 0x7f73e415a030 2023-10-06T01:39:57.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.967+0000 7f73e8bf7700 1 --2- 172.21.15.72:0/2146349314 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f73e415a940 0x7f73e415bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:39:57.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.967+0000 7f73e3fff700 1 --2- 172.21.15.72:0/2146349314 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f73e4087700 0x7f73e415b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:39:57.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.967+0000 7f73e37fe700 1 --2- 172.21.15.72:0/2146349314 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f73e415a030 0x7f73e415b860 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f73d800c4c0 tx=0x7f73d8007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:57.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.967+0000 7f73cbfff700 1 -- 172.21.15.72:0/2146349314 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d800ce70 con 0x7f73e415a030 2023-10-06T01:39:57.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.967+0000 7f73cbfff700 1 -- 172.21.15.72:0/2146349314 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73d8005b30 con 0x7f73e415a030 2023-10-06T01:39:57.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.967+0000 7f73ea65a700 1 -- 172.21.15.72:0/2146349314 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73e40c5a30 con 0x7f73e415a030 2023-10-06T01:39:57.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.967+0000 7f73cbfff700 1 -- 172.21.15.72:0/2146349314 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d80070d0 con 0x7f73e415a030 2023-10-06T01:39:57.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.967+0000 7f73ea65a700 1 -- 172.21.15.72:0/2146349314 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73e40c5ff0 con 0x7f73e415a030 2023-10-06T01:39:57.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.967+0000 7f73cbfff700 1 -- 172.21.15.72:0/2146349314 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f73d801c440 con 0x7f73e415a030 2023-10-06T01:39:57.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.967+0000 7f73cbfff700 1 -- 172.21.15.72:0/2146349314 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7f73d80127c0 con 0x7f73e415a030 2023-10-06T01:39:57.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.968+0000 7f73ea65a700 1 -- 172.21.15.72:0/2146349314 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73e40c64d0 con 0x7f73e415a030 2023-10-06T01:39:57.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:57.970+0000 7f73cbfff700 1 -- 172.21.15.72:0/2146349314 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f73d8017070 con 0x7f73e415a030 2023-10-06T01:39:58.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.053+0000 7f73ea65a700 1 -- 172.21.15.72:0/2146349314 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd new", "uuid": "0cff0aae-1799-4fe0-b610-54cf0813c0e1", "id": 1} v 0) v1 -- 0x7f73e40b04f0 con 0x7f73e415a030 2023-10-06T01:39:58.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.057+0000 7f73cbfff700 1 -- 172.21.15.72:0/2146349314 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0cff0aae-1799-4fe0-b610-54cf0813c0e1", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f73d8007740 con 0x7f73e415a030 2023-10-06T01:39:58.057 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-06T01:39:58.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.057+0000 7f73ea65a700 1 -- 172.21.15.72:0/2146349314 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f73e415a030 msgr2=0x7f73e415b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:58.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.057+0000 7f73ea65a700 1 --2- 172.21.15.72:0/2146349314 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f73e415a030 0x7f73e415b860 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f73d800c4c0 tx=0x7f73d8007f50 comp rx=0 tx=0).stop 2023-10-06T01:39:58.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.058+0000 7f73ea65a700 1 -- 172.21.15.72:0/2146349314 shutdown_connections 2023-10-06T01:39:58.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.058+0000 7f73ea65a700 1 --2- 172.21.15.72:0/2146349314 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f73e415a940 0x7f73e415bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:58.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.058+0000 7f73ea65a700 1 --2- 172.21.15.72:0/2146349314 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f73e4087700 0x7f73e415b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:58.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.058+0000 7f73ea65a700 1 --2- 172.21.15.72:0/2146349314 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f73e415a030 0x7f73e415b860 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:58.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.058+0000 7f73ea65a700 1 -- 172.21.15.72:0/2146349314 >> 172.21.15.72:0/2146349314 conn(0x7f73e4068680 msgr2=0x7f73e40b50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:58.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.058+0000 7f73ea65a700 1 -- 172.21.15.72:0/2146349314 shutdown_connections 2023-10-06T01:39:58.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.058+0000 7f73ea65a700 1 -- 172.21.15.72:0/2146349314 wait complete. 2023-10-06T01:39:58.070 DEBUG:teuthology.orchestra.run.smithi072:> sudo ceph --cluster ceph osd new 88d61ddc-9031-44e1-ba8c-546a41e7c8ce 2 2023-10-06T01:39:58.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.185+0000 7f0e266a6700 1 Processor -- start 2023-10-06T01:39:58.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.185+0000 7f0e266a6700 1 -- start start 2023-10-06T01:39:58.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.186+0000 7f0e266a6700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0e2006a380 0x7f0e200cb310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:58.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.186+0000 7f0e266a6700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f0e2006a750 0x7f0e2015d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:58.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.186+0000 7f0e266a6700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e200cae80 con 0x7f0e2015d770 2023-10-06T01:39:58.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.186+0000 7f0e266a6700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e200cc3d0 con 0x7f0e2006a750 2023-10-06T01:39:58.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.186+0000 7f0e266a6700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e2015dcd0 con 0x7f0e2006a380 2023-10-06T01:39:58.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.186+0000 7f0e1ffff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0e2006a380 0x7f0e200cb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:58.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.186+0000 7f0e1ffff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0e2006a380 0x7f0e200cb310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54654/0 (socket says 172.21.15.72:54654) 2023-10-06T01:39:58.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.186+0000 7f0e1ffff700 1 -- 172.21.15.72:0/1745839779 learned_addr learned my addr 172.21.15.72:0/1745839779 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-06T01:39:58.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.186+0000 7f0e1f7fe700 1 --2- 172.21.15.72:0/1745839779 >> v2:172.21.15.71:3300/0 conn(0x7f0e2006a750 0x7f0e2015d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:58.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.186+0000 7f0e1ffff700 1 -- 172.21.15.72:0/1745839779 >> v2:172.21.15.71:3300/0 conn(0x7f0e2006a750 msgr2=0x7f0e2015d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:58.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.186+0000 7f0e1ffff700 1 --2- 172.21.15.72:0/1745839779 >> v2:172.21.15.71:3300/0 conn(0x7f0e2006a750 0x7f0e2015d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:58.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.186+0000 7f0e1ffff700 1 -- 172.21.15.72:0/1745839779 >> v1:172.21.15.71:6789/0 conn(0x7f0e2015d770 legacy=0x7f0e20159170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:58.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.186+0000 7f0e1ffff700 1 -- 172.21.15.72:0/1745839779 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e2015dfb0 con 0x7f0e2006a380 2023-10-06T01:39:58.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.186+0000 7f0e1ffff700 1 --2- 172.21.15.72:0/1745839779 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0e2006a380 0x7f0e200cb310 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0e200d0320 tx=0x7f0e14009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=353f0d48a806aa5f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:58.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.186+0000 7f0e1effd700 1 -- 172.21.15.72:0/1745839779 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e14009e70 con 0x7f0e2006a380 2023-10-06T01:39:58.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.187+0000 7f0e1effd700 1 -- 172.21.15.72:0/1745839779 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e1400b860 con 0x7f0e2006a380 2023-10-06T01:39:58.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.187+0000 7f0e1effd700 1 -- 172.21.15.72:0/1745839779 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e1400bc00 con 0x7f0e2006a380 2023-10-06T01:39:58.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.187+0000 7f0e266a6700 1 -- 172.21.15.72:0/1745839779 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0e2006a380 msgr2=0x7f0e200cb310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:58.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.187+0000 7f0e266a6700 1 --2- 172.21.15.72:0/1745839779 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0e2006a380 0x7f0e200cb310 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0e200d0320 tx=0x7f0e14009250 comp rx=0 tx=0).stop 2023-10-06T01:39:58.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.187+0000 7f0e266a6700 1 -- 172.21.15.72:0/1745839779 shutdown_connections 2023-10-06T01:39:58.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.187+0000 7f0e266a6700 1 --2- 172.21.15.72:0/1745839779 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0e2006a380 0x7f0e200cb310 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:58.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.187+0000 7f0e266a6700 1 --2- 172.21.15.72:0/1745839779 >> v2:172.21.15.71:3300/0 conn(0x7f0e2006a750 0x7f0e2015d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:58.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.187+0000 7f0e266a6700 1 -- 172.21.15.72:0/1745839779 >> 172.21.15.72:0/1745839779 conn(0x7f0e200d0350 msgr2=0x7f0e200d0750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:58.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.187+0000 7f0e266a6700 1 -- 172.21.15.72:0/1745839779 shutdown_connections 2023-10-06T01:39:58.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.187+0000 7f0e266a6700 1 -- 172.21.15.72:0/1745839779 wait complete. 2023-10-06T01:39:58.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.188+0000 7f0e266a6700 1 Processor -- start 2023-10-06T01:39:58.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.189+0000 7f0e266a6700 1 -- start start 2023-10-06T01:39:58.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.189+0000 7f0e266a6700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0e2006a380 0x7f0e20169de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:58.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.189+0000 7f0e266a6700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0e2006a750 0x7f0e20144ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:58.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.189+0000 7f0e266a6700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0e2015d770 0x7f0e200b42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:58.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.189+0000 7f0e266a6700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e200b3320 con 0x7f0e2006a380 2023-10-06T01:39:58.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.189+0000 7f0e266a6700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e2016a320 con 0x7f0e2015d770 2023-10-06T01:39:58.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.189+0000 7f0e266a6700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e2016a5c0 con 0x7f0e2006a750 2023-10-06T01:39:58.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.189+0000 7f0e1f7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0e2006a750 0x7f0e20144ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:58.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.189+0000 7f0e24c43700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0e2015d770 0x7f0e200b42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:58.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.189+0000 7f0e1ffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0e2006a380 0x7f0e20169de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:58.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.189+0000 7f0e1f7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0e2006a750 0x7f0e20144ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:48834/0 (socket says 172.21.15.72:48834) 2023-10-06T01:39:58.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.189+0000 7f0e24c43700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0e2015d770 0x7f0e200b42d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54664/0 (socket says 172.21.15.72:54664) 2023-10-06T01:39:58.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.189+0000 7f0e1ffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0e2006a380 0x7f0e20169de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.72:55196/0 (socket says 172.21.15.72:55196) 2023-10-06T01:39:58.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.189+0000 7f0e1f7fe700 1 -- 172.21.15.72:0/2482807612 learned_addr learned my addr 172.21.15.72:0/2482807612 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-06T01:39:58.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.190+0000 7f0e1ffff700 1 -- 172.21.15.72:0/2482807612 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0e2006a750 msgr2=0x7f0e20144ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:58.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.190+0000 7f0e1ffff700 1 --2- 172.21.15.72:0/2482807612 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0e2006a750 0x7f0e20144ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:58.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.190+0000 7f0e1ffff700 1 -- 172.21.15.72:0/2482807612 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0e2015d770 msgr2=0x7f0e200b42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:58.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.190+0000 7f0e1ffff700 1 --2- 172.21.15.72:0/2482807612 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0e2015d770 0x7f0e200b42d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:58.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.190+0000 7f0e1ffff700 1 -- 172.21.15.72:0/2482807612 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e140094f0 con 0x7f0e2006a380 2023-10-06T01:39:58.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.190+0000 7f0e1ffff700 1 --2- 172.21.15.72:0/2482807612 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0e2006a380 0x7f0e20169de0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0e2015d190 tx=0x7f0e14017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:58.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.190+0000 7f0e07fff700 1 -- 172.21.15.72:0/2482807612 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e1400bbe0 con 0x7f0e2006a380 2023-10-06T01:39:58.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.190+0000 7f0e07fff700 1 -- 172.21.15.72:0/2482807612 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e14000c90 con 0x7f0e2006a380 2023-10-06T01:39:58.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.190+0000 7f0e266a6700 1 -- 172.21.15.72:0/2482807612 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e2016a8a0 con 0x7f0e2006a380 2023-10-06T01:39:58.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.190+0000 7f0e07fff700 1 -- 172.21.15.72:0/2482807612 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e14011650 con 0x7f0e2006a380 2023-10-06T01:39:58.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.190+0000 7f0e266a6700 1 -- 172.21.15.72:0/2482807612 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e201453e0 con 0x7f0e2006a380 2023-10-06T01:39:58.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.190+0000 7f0e07fff700 1 -- 172.21.15.72:0/2482807612 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f0e14011d00 con 0x7f0e2006a380 2023-10-06T01:39:58.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.190+0000 7f0e07fff700 1 -- 172.21.15.72:0/2482807612 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7f0e1402ebf0 con 0x7f0e2006a380 2023-10-06T01:39:58.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.191+0000 7f0e266a6700 1 -- 172.21.15.72:0/2482807612 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e200b30f0 con 0x7f0e2006a380 2023-10-06T01:39:58.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.193+0000 7f0e07fff700 1 -- 172.21.15.72:0/2482807612 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f0e14015020 con 0x7f0e2006a380 2023-10-06T01:39:58.216 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-06T01:39:58.215+0000 7f9794faa180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-06T01:39:58.231 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-06T01:39:58.230+0000 7f97a28b6180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-06T01:39:58.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.275+0000 7f0e266a6700 1 -- 172.21.15.72:0/2482807612 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd new", "uuid": "88d61ddc-9031-44e1-ba8c-546a41e7c8ce", "id": 2} v 0) v1 -- 0x7f0e2016ad40 con 0x7f0e2006a380 2023-10-06T01:39:58.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.279+0000 7f0e07fff700 1 -- 172.21.15.72:0/2482807612 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "88d61ddc-9031-44e1-ba8c-546a41e7c8ce", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0e1402e7c0 con 0x7f0e2006a380 2023-10-06T01:39:58.279 INFO:teuthology.orchestra.run.smithi072.stdout:2 2023-10-06T01:39:58.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.279+0000 7f0e266a6700 1 -- 172.21.15.72:0/2482807612 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0e2006a380 msgr2=0x7f0e20169de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:58.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.279+0000 7f0e266a6700 1 --2- 172.21.15.72:0/2482807612 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0e2006a380 0x7f0e20169de0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0e2015d190 tx=0x7f0e14017000 comp rx=0 tx=0).stop 2023-10-06T01:39:58.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.280+0000 7f0e266a6700 1 -- 172.21.15.72:0/2482807612 shutdown_connections 2023-10-06T01:39:58.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.280+0000 7f0e266a6700 1 --2- 172.21.15.72:0/2482807612 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0e2015d770 0x7f0e200b42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:58.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.280+0000 7f0e266a6700 1 --2- 172.21.15.72:0/2482807612 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0e2006a380 0x7f0e20169de0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:58.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.280+0000 7f0e266a6700 1 --2- 172.21.15.72:0/2482807612 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0e2006a750 0x7f0e20144ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:58.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.280+0000 7f0e266a6700 1 -- 172.21.15.72:0/2482807612 >> 172.21.15.72:0/2482807612 conn(0x7f0e200d0350 msgr2=0x7f0e200c6300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:58.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.280+0000 7f0e266a6700 1 -- 172.21.15.72:0/2482807612 shutdown_connections 2023-10-06T01:39:58.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.280+0000 7f0e266a6700 1 -- 172.21.15.72:0/2482807612 wait complete. 2023-10-06T01:39:58.292 DEBUG:teuthology.orchestra.run.smithi072:> sudo ceph --cluster ceph osd new 11ed92b7-960b-4a30-a889-a61d3eeb86f0 3 2023-10-06T01:39:58.347 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-06T01:39:58.346+0000 7f9794faa180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-06T01:39:58.370 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-06T01:39:58.369+0000 7f97a28b6180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-06T01:39:58.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.407+0000 7f9cfd6b6700 1 Processor -- start 2023-10-06T01:39:58.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.407+0000 7f9cfd6b6700 1 -- start start 2023-10-06T01:39:58.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.408+0000 7f9cfd6b6700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9cf80d0400 0x7f9cf80b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:58.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.408+0000 7f9cfd6b6700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9cf80d07d0 0x7f9cf80b3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:58.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.408+0000 7f9cfd6b6700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cf80b6170 con 0x7f9cf80ccd40 2023-10-06T01:39:58.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.408+0000 7f9cfd6b6700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cf815dd40 con 0x7f9cf80d0400 2023-10-06T01:39:58.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.408+0000 7f9cfd6b6700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf815e020 con 0x7f9cf80d07d0 2023-10-06T01:39:58.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.408+0000 7f9cf6ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9cf80d0400 0x7f9cf80b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:58.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.408+0000 7f9cf77fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9cf80d07d0 0x7f9cf80b3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:58.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.408+0000 7f9cf6ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9cf80d0400 0x7f9cf80b5c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54672/0 (socket says 172.21.15.72:54672) 2023-10-06T01:39:58.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.408+0000 7f9cf77fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9cf80d07d0 0x7f9cf80b3aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:48838/0 (socket says 172.21.15.72:48838) 2023-10-06T01:39:58.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.408+0000 7f9cf6ffd700 1 -- 172.21.15.72:0/837862866 learned_addr learned my addr 172.21.15.72:0/837862866 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-06T01:39:58.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.408+0000 7f9cf6ffd700 1 -- 172.21.15.72:0/837862866 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9cf80d07d0 msgr2=0x7f9cf80b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:58.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.408+0000 7f9cf6ffd700 1 --2- 172.21.15.72:0/837862866 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9cf80d07d0 0x7f9cf80b3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:58.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.408+0000 7f9cf6ffd700 1 -- 172.21.15.72:0/837862866 >> v1:172.21.15.71:6789/0 conn(0x7f9cf80ccd40 legacy=0x7f9cf80cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:58.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.408+0000 7f9cf6ffd700 1 -- 172.21.15.72:0/837862866 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cf80ceaa0 con 0x7f9cf80d0400 2023-10-06T01:39:58.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.408+0000 7f9cf77fe700 1 --2- 172.21.15.72:0/837862866 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9cf80d07d0 0x7f9cf80b3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:39:58.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.408+0000 7f9cf6ffd700 1 --2- 172.21.15.72:0/837862866 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9cf80d0400 0x7f9cf80b5c30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9cec009990 tx=0x7f9cec009220 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c4d7ddf35d1daeb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:58.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.409+0000 7f9cf5ffb700 1 -- 172.21.15.72:0/837862866 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cec009e80 con 0x7f9cf80d0400 2023-10-06T01:39:58.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.409+0000 7f9cf5ffb700 1 -- 172.21.15.72:0/837862866 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cec005c10 con 0x7f9cf80d0400 2023-10-06T01:39:58.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.409+0000 7f9cf5ffb700 1 -- 172.21.15.72:0/837862866 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cec00b650 con 0x7f9cf80d0400 2023-10-06T01:39:58.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.409+0000 7f9cfd6b6700 1 -- 172.21.15.72:0/837862866 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9cf80d0400 msgr2=0x7f9cf80b5c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:58.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.409+0000 7f9cfd6b6700 1 --2- 172.21.15.72:0/837862866 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9cf80d0400 0x7f9cf80b5c30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9cec009990 tx=0x7f9cec009220 comp rx=0 tx=0).stop 2023-10-06T01:39:58.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.409+0000 7f9cfd6b6700 1 -- 172.21.15.72:0/837862866 shutdown_connections 2023-10-06T01:39:58.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.409+0000 7f9cfd6b6700 1 --2- 172.21.15.72:0/837862866 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9cf80d07d0 0x7f9cf80b3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:58.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.409+0000 7f9cfd6b6700 1 --2- 172.21.15.72:0/837862866 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9cf80d0400 0x7f9cf80b5c30 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:58.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.409+0000 7f9cfd6b6700 1 -- 172.21.15.72:0/837862866 >> 172.21.15.72:0/837862866 conn(0x7f9cf806a220 msgr2=0x7f9cf806a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:58.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.409+0000 7f9cfd6b6700 1 -- 172.21.15.72:0/837862866 shutdown_connections 2023-10-06T01:39:58.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.409+0000 7f9cfd6b6700 1 -- 172.21.15.72:0/837862866 wait complete. 2023-10-06T01:39:58.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.410+0000 7f9cfd6b6700 1 Processor -- start 2023-10-06T01:39:58.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.410+0000 7f9cfd6b6700 1 -- start start 2023-10-06T01:39:58.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.411+0000 7f9cfd6b6700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9cf80ccd40 0x7f9cf8169980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:58.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.411+0000 7f9cfd6b6700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9cf80d0400 0x7f9cf8158e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:58.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.411+0000 7f9cfd6b6700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9cf80d07d0 0x7f9cf8159380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:58.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.411+0000 7f9cfd6b6700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf8150660 con 0x7f9cf80d0400 2023-10-06T01:39:58.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.411+0000 7f9cfd6b6700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf8152860 con 0x7f9cf80ccd40 2023-10-06T01:39:58.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.411+0000 7f9cfd6b6700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf8152b00 con 0x7f9cf80d07d0 2023-10-06T01:39:58.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.411+0000 7f9cf77fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9cf80d07d0 0x7f9cf8159380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:58.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.411+0000 7f9cf6ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9cf80ccd40 0x7f9cf8169980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:58.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.411+0000 7f9cf6ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9cf80ccd40 0x7f9cf8169980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54676/0 (socket says 172.21.15.72:54676) 2023-10-06T01:39:58.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.411+0000 7f9cf77fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9cf80d07d0 0x7f9cf8159380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:48846/0 (socket says 172.21.15.72:48846) 2023-10-06T01:39:58.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.411+0000 7f9cf67fc700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9cf80d0400 0x7f9cf8158e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:58.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.411+0000 7f9cf6ffd700 1 -- 172.21.15.72:0/3285535520 learned_addr learned my addr 172.21.15.72:0/3285535520 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-06T01:39:58.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.412+0000 7f9cf77fe700 1 -- 172.21.15.72:0/3285535520 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9cf80ccd40 msgr2=0x7f9cf8169980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:58.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.412+0000 7f9cf77fe700 1 --2- 172.21.15.72:0/3285535520 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9cf80ccd40 0x7f9cf8169980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:58.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.412+0000 7f9cf77fe700 1 -- 172.21.15.72:0/3285535520 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9cf80d0400 msgr2=0x7f9cf8158e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:58.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.412+0000 7f9cf77fe700 1 --2- 172.21.15.72:0/3285535520 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9cf80d0400 0x7f9cf8158e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:58.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.412+0000 7f9cf77fe700 1 -- 172.21.15.72:0/3285535520 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cf0009a20 con 0x7f9cf80d07d0 2023-10-06T01:39:58.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.412+0000 7f9cf6ffd700 1 --2- 172.21.15.72:0/3285535520 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9cf80ccd40 0x7f9cf8169980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:39:58.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.412+0000 7f9cf67fc700 1 --2- 172.21.15.72:0/3285535520 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9cf80d0400 0x7f9cf8158e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:39:58.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.412+0000 7f9cf77fe700 1 --2- 172.21.15.72:0/3285535520 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9cf80d07d0 0x7f9cf8159380 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9cf0009e70 tx=0x7f9cf000b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:58.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.412+0000 7f9cdeffd700 1 -- 172.21.15.72:0/3285535520 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf000caa0 con 0x7f9cf80d07d0 2023-10-06T01:39:58.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.412+0000 7f9cdeffd700 1 -- 172.21.15.72:0/3285535520 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cf000f040 con 0x7f9cf80d07d0 2023-10-06T01:39:58.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.412+0000 7f9cfd6b6700 1 -- 172.21.15.72:0/3285535520 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cec009480 con 0x7f9cf80d07d0 2023-10-06T01:39:58.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.412+0000 7f9cdeffd700 1 -- 172.21.15.72:0/3285535520 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf000ce90 con 0x7f9cf80d07d0 2023-10-06T01:39:58.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.412+0000 7f9cfd6b6700 1 -- 172.21.15.72:0/3285535520 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cf81530c0 con 0x7f9cf80d07d0 2023-10-06T01:39:58.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.412+0000 7f9cdeffd700 1 -- 172.21.15.72:0/3285535520 <== mon.2 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f9cf0003020 con 0x7f9cf80d07d0 2023-10-06T01:39:58.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.412+0000 7f9cdeffd700 1 -- 172.21.15.72:0/3285535520 <== mon.2 v2:172.21.15.72:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7f9cf0013880 con 0x7f9cf80d07d0 2023-10-06T01:39:58.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.413+0000 7f9cfd6b6700 1 -- 172.21.15.72:0/3285535520 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cf8088760 con 0x7f9cf80d07d0 2023-10-06T01:39:58.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.415+0000 7f9cdeffd700 1 -- 172.21.15.72:0/3285535520 <== mon.2 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f9cf0018030 con 0x7f9cf80d07d0 2023-10-06T01:39:58.421 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-06T01:39:58.421+0000 7f9794faa180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-06T01:39:58.449 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-06T01:39:58.448+0000 7f97a28b6180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-06T01:39:58.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.498+0000 7f9cfd6b6700 1 -- 172.21.15.72:0/3285535520 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd new", "uuid": "11ed92b7-960b-4a30-a889-a61d3eeb86f0", "id": 3} v 0) v1 -- 0x7f9cf80ced80 con 0x7f9cf80d07d0 2023-10-06T01:39:58.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.502+0000 7f9cdeffd700 1 -- 172.21.15.72:0/3285535520 <== mon.2 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "11ed92b7-960b-4a30-a889-a61d3eeb86f0", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9cf0014870 con 0x7f9cf80d07d0 2023-10-06T01:39:58.503 INFO:teuthology.orchestra.run.smithi072.stdout:3 2023-10-06T01:39:58.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.503+0000 7f9cfd6b6700 1 -- 172.21.15.72:0/3285535520 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9cf80d07d0 msgr2=0x7f9cf8159380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:58.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.503+0000 7f9cfd6b6700 1 --2- 172.21.15.72:0/3285535520 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9cf80d07d0 0x7f9cf8159380 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9cf0009e70 tx=0x7f9cf000b040 comp rx=0 tx=0).stop 2023-10-06T01:39:58.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.503+0000 7f9cfd6b6700 1 -- 172.21.15.72:0/3285535520 shutdown_connections 2023-10-06T01:39:58.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.503+0000 7f9cfd6b6700 1 --2- 172.21.15.72:0/3285535520 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9cf80d07d0 0x7f9cf8159380 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:58.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.503+0000 7f9cfd6b6700 1 --2- 172.21.15.72:0/3285535520 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9cf80ccd40 0x7f9cf8169980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:58.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.503+0000 7f9cfd6b6700 1 --2- 172.21.15.72:0/3285535520 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9cf80d0400 0x7f9cf8158e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:58.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.503+0000 7f9cfd6b6700 1 -- 172.21.15.72:0/3285535520 >> 172.21.15.72:0/3285535520 conn(0x7f9cf806a220 msgr2=0x7f9cf80b2390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:58.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.503+0000 7f9cfd6b6700 1 -- 172.21.15.72:0/3285535520 shutdown_connections 2023-10-06T01:39:58.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.503+0000 7f9cfd6b6700 1 -- 172.21.15.72:0/3285535520 wait complete. 2023-10-06T01:39:58.516 DEBUG:teuthology.orchestra.run.smithi072:> sudo ceph --cluster ceph osd new ae4df784-abdf-4ddf-aefa-780f3ddafef3 4 2023-10-06T01:39:58.605 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-06T01:39:58.605+0000 7f9794faa180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-06T01:39:58.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.629+0000 7fecdba11700 1 Processor -- start 2023-10-06T01:39:58.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.630+0000 7fecdba11700 1 -- start start 2023-10-06T01:39:58.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.630+0000 7fecdba11700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fecd415e030 0x7fecd40c4350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:58.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.630+0000 7fecdba11700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fecd415cf70 0x7fecd40cec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:58.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.631+0000 7fecdba11700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecd40c3900 con 0x7fecd415d6d0 2023-10-06T01:39:58.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.631+0000 7fecdba11700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecd40c3ec0 con 0x7fecd415cf70 2023-10-06T01:39:58.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.631+0000 7fecdba11700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecd40cdaf0 con 0x7fecd415e030 2023-10-06T01:39:58.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.631+0000 7fecd8fac700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fecd415e030 0x7fecd40c4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:58.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.631+0000 7fecd97ad700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fecd415d6d0 0x7fecd415c860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:38394/0 (socket says 172.21.15.72:38394) 2023-10-06T01:39:58.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.631+0000 7fecd97ad700 1 -- 172.21.15.72:0/1146150421 learned_addr learned my addr 172.21.15.72:0/1146150421 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-06T01:39:58.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.631+0000 7fecd9fae700 1 --2- 172.21.15.72:0/1146150421 >> v2:172.21.15.71:3300/0 conn(0x7fecd415cf70 0x7fecd40cec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:58.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.631+0000 7fecd8fac700 1 -- 172.21.15.72:0/1146150421 >> v2:172.21.15.71:3300/0 conn(0x7fecd415cf70 msgr2=0x7fecd40cec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:58.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.631+0000 7fecd8fac700 1 --2- 172.21.15.72:0/1146150421 >> v2:172.21.15.71:3300/0 conn(0x7fecd415cf70 0x7fecd40cec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:58.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.631+0000 7fecd8fac700 1 -- 172.21.15.72:0/1146150421 >> v1:172.21.15.72:6789/0 conn(0x7fecd415d6d0 legacy=0x7fecd415c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:58.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.631+0000 7feccbfff700 1 -- 172.21.15.72:0/1146150421 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4265671260 0 0) 0x7fecd40c3900 con 0x7fecd415d6d0 2023-10-06T01:39:58.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.631+0000 7fecd8fac700 1 -- 172.21.15.72:0/1146150421 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecd40cddd0 con 0x7fecd415e030 2023-10-06T01:39:58.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.631+0000 7fecd8fac700 1 --2- 172.21.15.72:0/1146150421 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecd415e030 0x7fecd40c4350 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fecd406b3c0 tx=0x7fecd00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4405b6c2162d6673 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:58.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.631+0000 7feccbfff700 1 -- 172.21.15.72:0/1146150421 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd000b690 con 0x7fecd415e030 2023-10-06T01:39:58.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.631+0000 7feccbfff700 1 -- 172.21.15.72:0/1146150421 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecd000b7f0 con 0x7fecd415e030 2023-10-06T01:39:58.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.631+0000 7feccbfff700 1 -- 172.21.15.72:0/1146150421 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd000bb90 con 0x7fecd415e030 2023-10-06T01:39:58.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.632+0000 7fecdba11700 1 -- 172.21.15.72:0/1146150421 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecd415e030 msgr2=0x7fecd40c4350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:58.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.632+0000 7fecdba11700 1 --2- 172.21.15.72:0/1146150421 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecd415e030 0x7fecd40c4350 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fecd406b3c0 tx=0x7fecd00091a0 comp rx=0 tx=0).stop 2023-10-06T01:39:58.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.632+0000 7fecdba11700 1 -- 172.21.15.72:0/1146150421 shutdown_connections 2023-10-06T01:39:58.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.632+0000 7fecdba11700 1 --2- 172.21.15.72:0/1146150421 >> v2:172.21.15.71:3300/0 conn(0x7fecd415cf70 0x7fecd40cec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:58.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.632+0000 7fecdba11700 1 --2- 172.21.15.72:0/1146150421 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecd415e030 0x7fecd40c4350 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:58.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.632+0000 7fecdba11700 1 -- 172.21.15.72:0/1146150421 >> 172.21.15.72:0/1146150421 conn(0x7fecd4067910 msgr2=0x7fecd40ce150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:58.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.632+0000 7fecdba11700 1 -- 172.21.15.72:0/1146150421 shutdown_connections 2023-10-06T01:39:58.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.632+0000 7fecdba11700 1 -- 172.21.15.72:0/1146150421 wait complete. 2023-10-06T01:39:58.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.633+0000 7fecdba11700 1 Processor -- start 2023-10-06T01:39:58.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.633+0000 7fecdba11700 1 -- start start 2023-10-06T01:39:58.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.634+0000 7fecdba11700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fecd415cf70 0x7fecd40c5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:58.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.634+0000 7fecdba11700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fecd415d6d0 0x7fecd4153ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:58.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.634+0000 7fecdba11700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecd415e030 0x7fecd40cb330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:58.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.634+0000 7fecdba11700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd40c6cc0 con 0x7fecd415cf70 2023-10-06T01:39:58.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.634+0000 7fecdba11700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd414cd20 con 0x7fecd415e030 2023-10-06T01:39:58.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.634+0000 7fecdba11700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecd4154010 con 0x7fecd415d6d0 2023-10-06T01:39:58.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.634+0000 7fecd9fae700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecd415e030 0x7fecd40cb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:58.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.634+0000 7fecd8fac700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fecd415d6d0 0x7fecd4153ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:58.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.634+0000 7fecd97ad700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fecd415cf70 0x7fecd40c5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:58.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.634+0000 7fecd9fae700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecd415e030 0x7fecd40cb330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54692/0 (socket says 172.21.15.72:54692) 2023-10-06T01:39:58.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.634+0000 7fecd9fae700 1 -- 172.21.15.72:0/3505696910 learned_addr learned my addr 172.21.15.72:0/3505696910 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-06T01:39:58.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.634+0000 7fecd9fae700 1 -- 172.21.15.72:0/3505696910 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fecd415d6d0 msgr2=0x7fecd4153ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:58.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.634+0000 7fecd9fae700 1 --2- 172.21.15.72:0/3505696910 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fecd415d6d0 0x7fecd4153ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:58.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.634+0000 7fecd9fae700 1 -- 172.21.15.72:0/3505696910 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fecd415cf70 msgr2=0x7fecd40c5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:58.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.634+0000 7fecd9fae700 1 --2- 172.21.15.72:0/3505696910 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fecd415cf70 0x7fecd40c5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:58.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.634+0000 7fecd9fae700 1 -- 172.21.15.72:0/3505696910 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecd0009420 con 0x7fecd415e030 2023-10-06T01:39:58.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.634+0000 7fecd97ad700 1 --2- 172.21.15.72:0/3505696910 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fecd415cf70 0x7fecd40c5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:39:58.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.635+0000 7fecd9fae700 1 --2- 172.21.15.72:0/3505696910 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecd415e030 0x7fecd40cb330 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7feccc009e90 tx=0x7feccc00b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:58.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.635+0000 7fecc97fa700 1 -- 172.21.15.72:0/3505696910 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feccc00cb10 con 0x7fecd415e030 2023-10-06T01:39:58.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.635+0000 7fecc97fa700 1 -- 172.21.15.72:0/3505696910 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feccc00f040 con 0x7fecd415e030 2023-10-06T01:39:58.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.635+0000 7fecdba11700 1 -- 172.21.15.72:0/3505696910 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecd40c5980 con 0x7fecd415e030 2023-10-06T01:39:58.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.635+0000 7fecc97fa700 1 -- 172.21.15.72:0/3505696910 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feccc00cee0 con 0x7fecd415e030 2023-10-06T01:39:58.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.635+0000 7fecdba11700 1 -- 172.21.15.72:0/3505696910 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecd40c5330 con 0x7fecd415e030 2023-10-06T01:39:58.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.635+0000 7fecc97fa700 1 -- 172.21.15.72:0/3505696910 <== mon.1 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7feccc014690 con 0x7fecd415e030 2023-10-06T01:39:58.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.635+0000 7fecc97fa700 1 -- 172.21.15.72:0/3505696910 <== mon.1 v2:172.21.15.72:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7feccc0133e0 con 0x7fecd415e030 2023-10-06T01:39:58.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.636+0000 7fecdba11700 1 -- 172.21.15.72:0/3505696910 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecd40c5b10 con 0x7fecd415e030 2023-10-06T01:39:58.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.639+0000 7fecc97fa700 1 -- 172.21.15.72:0/3505696910 <== mon.1 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7feccc018020 con 0x7fecd415e030 2023-10-06T01:39:58.643 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-06T01:39:58.643+0000 7f97a28b6180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-06T01:39:58.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.720+0000 7fecdba11700 1 -- 172.21.15.72:0/3505696910 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ae4df784-abdf-4ddf-aefa-780f3ddafef3", "id": 4} v 0) v1 -- 0x7fecd406e920 con 0x7fecd415e030 2023-10-06T01:39:58.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.724+0000 7fecc97fa700 1 -- 172.21.15.72:0/3505696910 <== mon.1 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ae4df784-abdf-4ddf-aefa-780f3ddafef3", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7feccc0149a0 con 0x7fecd415e030 2023-10-06T01:39:58.725 INFO:teuthology.orchestra.run.smithi072.stdout:4 2023-10-06T01:39:58.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.725+0000 7fecdba11700 1 -- 172.21.15.72:0/3505696910 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecd415e030 msgr2=0x7fecd40cb330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:58.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.725+0000 7fecdba11700 1 --2- 172.21.15.72:0/3505696910 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecd415e030 0x7fecd40cb330 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7feccc009e90 tx=0x7feccc00b040 comp rx=0 tx=0).stop 2023-10-06T01:39:58.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.725+0000 7fecdba11700 1 -- 172.21.15.72:0/3505696910 shutdown_connections 2023-10-06T01:39:58.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.725+0000 7fecdba11700 1 --2- 172.21.15.72:0/3505696910 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecd415e030 0x7fecd40cb330 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:58.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.725+0000 7fecdba11700 1 --2- 172.21.15.72:0/3505696910 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fecd415cf70 0x7fecd40c5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:58.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.725+0000 7fecdba11700 1 --2- 172.21.15.72:0/3505696910 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fecd415d6d0 0x7fecd4153ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:58.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.725+0000 7fecdba11700 1 -- 172.21.15.72:0/3505696910 >> 172.21.15.72:0/3505696910 conn(0x7fecd4067910 msgr2=0x7fecd414d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:58.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.725+0000 7fecdba11700 1 -- 172.21.15.72:0/3505696910 shutdown_connections 2023-10-06T01:39:58.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.725+0000 7fecdba11700 1 -- 172.21.15.72:0/3505696910 wait complete. 2023-10-06T01:39:58.737 DEBUG:teuthology.orchestra.run.smithi072:> sudo ceph --cluster ceph osd new 5ef0790f-001e-458f-a05b-efae216cf435 5 2023-10-06T01:39:58.777 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-06T01:39:58.776+0000 7f9794faa180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-06T01:39:58.824 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-06T01:39:58.823+0000 7f97a28b6180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-06T01:39:58.853 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-06T01:39:58.852+0000 7f9794faa180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-06T01:39:58.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.852+0000 7f9a2927e700 1 Processor -- start 2023-10-06T01:39:58.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.852+0000 7f9a2927e700 1 -- start start 2023-10-06T01:39:58.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.853+0000 7f9a2927e700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9a240cd400 0x7f9a240b1f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:58.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.853+0000 7f9a2927e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9a240cd7d0 0x7f9a240b2460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:58.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.853+0000 7f9a2927e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9a240b0810 0x7f9a240d01a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:58.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.853+0000 7f9a2927e700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a240b29a0 con 0x7f9a240cd400 2023-10-06T01:39:58.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.853+0000 7f9a2927e700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a240af770 con 0x7f9a240b0810 2023-10-06T01:39:58.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.853+0000 7f9a2927e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a240afa50 con 0x7f9a240cd7d0 2023-10-06T01:39:58.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.853+0000 7f9a237fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9a240cd7d0 0x7f9a240b2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:58.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.853+0000 7f9a28a7d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9a240b0810 0x7f9a240d01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:58.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.853+0000 7f9a237fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9a240cd7d0 0x7f9a240b2460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:48862/0 (socket says 172.21.15.72:48862) 2023-10-06T01:39:58.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.853+0000 7f9a28a7d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9a240b0810 0x7f9a240d01a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54702/0 (socket says 172.21.15.72:54702) 2023-10-06T01:39:58.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.853+0000 7f9a237fe700 1 -- 172.21.15.72:0/398144591 learned_addr learned my addr 172.21.15.72:0/398144591 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-06T01:39:58.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.853+0000 7f9a23fff700 1 --2- 172.21.15.72:0/398144591 >> v2:172.21.15.71:3300/0 conn(0x7f9a240cd400 0x7f9a240b1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:58.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.853+0000 7f9a237fe700 1 -- 172.21.15.72:0/398144591 >> v2:172.21.15.72:3300/0 conn(0x7f9a240b0810 msgr2=0x7f9a240d01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:58.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.853+0000 7f9a237fe700 1 --2- 172.21.15.72:0/398144591 >> v2:172.21.15.72:3300/0 conn(0x7f9a240b0810 0x7f9a240d01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:58.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.853+0000 7f9a237fe700 1 -- 172.21.15.72:0/398144591 >> v2:172.21.15.71:3300/0 conn(0x7f9a240cd400 msgr2=0x7f9a240b1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:58.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.853+0000 7f9a237fe700 1 --2- 172.21.15.72:0/398144591 >> v2:172.21.15.71:3300/0 conn(0x7f9a240cd400 0x7f9a240b1f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:58.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.853+0000 7f9a237fe700 1 -- 172.21.15.72:0/398144591 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a240afd30 con 0x7f9a240cd7d0 2023-10-06T01:39:58.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.854+0000 7f9a237fe700 1 --2- 172.21.15.72:0/398144591 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9a240cd7d0 0x7f9a240b2460 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9a241572f0 tx=0x7f9a14009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79588e92648ff290 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:58.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.854+0000 7f9a22ffd700 1 -- 172.21.15.72:0/398144591 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1400b640 con 0x7f9a240cd7d0 2023-10-06T01:39:58.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.854+0000 7f9a22ffd700 1 -- 172.21.15.72:0/398144591 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a1400b7a0 con 0x7f9a240cd7d0 2023-10-06T01:39:58.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.854+0000 7f9a22ffd700 1 -- 172.21.15.72:0/398144591 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1400bb40 con 0x7f9a240cd7d0 2023-10-06T01:39:58.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.854+0000 7f9a2927e700 1 -- 172.21.15.72:0/398144591 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9a240cd7d0 msgr2=0x7f9a240b2460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:58.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.854+0000 7f9a2927e700 1 --2- 172.21.15.72:0/398144591 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9a240cd7d0 0x7f9a240b2460 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9a241572f0 tx=0x7f9a14009250 comp rx=0 tx=0).stop 2023-10-06T01:39:58.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.854+0000 7f9a2927e700 1 -- 172.21.15.72:0/398144591 shutdown_connections 2023-10-06T01:39:58.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.854+0000 7f9a2927e700 1 --2- 172.21.15.72:0/398144591 >> v2:172.21.15.71:3300/0 conn(0x7f9a240cd400 0x7f9a240b1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:58.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.854+0000 7f9a2927e700 1 --2- 172.21.15.72:0/398144591 >> v2:172.21.15.72:3300/0 conn(0x7f9a240b0810 0x7f9a240d01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:58.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.854+0000 7f9a2927e700 1 --2- 172.21.15.72:0/398144591 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9a240cd7d0 0x7f9a240b2460 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:58.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.854+0000 7f9a2927e700 1 -- 172.21.15.72:0/398144591 >> 172.21.15.72:0/398144591 conn(0x7f9a2406a110 msgr2=0x7f9a2406a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:58.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.854+0000 7f9a2927e700 1 -- 172.21.15.72:0/398144591 shutdown_connections 2023-10-06T01:39:58.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.854+0000 7f9a2927e700 1 -- 172.21.15.72:0/398144591 wait complete. 2023-10-06T01:39:58.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.855+0000 7f9a2927e700 1 Processor -- start 2023-10-06T01:39:58.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.856+0000 7f9a2927e700 1 -- start start 2023-10-06T01:39:58.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.856+0000 7f9a2927e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9a240b0810 0x7f9a24155600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:58.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.856+0000 7f9a2927e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a240cd400 0x7f9a2415b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:58.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.856+0000 7f9a2927e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9a2415b6b0 0x7f9a240c7300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:58.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.856+0000 7f9a2927e700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a240c8c80 con 0x7f9a2415b6b0 2023-10-06T01:39:58.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.856+0000 7f9a2927e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2415bb50 con 0x7f9a240cd400 2023-10-06T01:39:58.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.856+0000 7f9a2927e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a240c3ff0 con 0x7f9a240b0810 2023-10-06T01:39:58.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.856+0000 7f9a237fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a240cd400 0x7f9a2415b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:58.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.856+0000 7f9a237fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a240cd400 0x7f9a2415b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54710/0 (socket says 172.21.15.72:54710) 2023-10-06T01:39:58.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.856+0000 7f9a237fe700 1 -- 172.21.15.72:0/2592355094 learned_addr learned my addr 172.21.15.72:0/2592355094 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-06T01:39:58.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.856+0000 7f9a23fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9a240b0810 0x7f9a24155600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:58.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.857+0000 7f9a28a7d700 1 --2- 172.21.15.72:0/2592355094 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9a2415b6b0 0x7f9a240c7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:58.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.857+0000 7f9a237fe700 1 -- 172.21.15.72:0/2592355094 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9a240b0810 msgr2=0x7f9a24155600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:58.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.857+0000 7f9a237fe700 1 --2- 172.21.15.72:0/2592355094 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9a240b0810 0x7f9a24155600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:58.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.857+0000 7f9a237fe700 1 -- 172.21.15.72:0/2592355094 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9a2415b6b0 msgr2=0x7f9a240c7300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:58.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.857+0000 7f9a237fe700 1 --2- 172.21.15.72:0/2592355094 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9a2415b6b0 0x7f9a240c7300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:58.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.857+0000 7f9a237fe700 1 -- 172.21.15.72:0/2592355094 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a140094f0 con 0x7f9a240cd400 2023-10-06T01:39:58.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.857+0000 7f9a237fe700 1 --2- 172.21.15.72:0/2592355094 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a240cd400 0x7f9a2415b170 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9a14009f70 tx=0x7f9a14017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:58.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.857+0000 7f9a0bfff700 1 -- 172.21.15.72:0/2592355094 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a14006af0 con 0x7f9a240cd400 2023-10-06T01:39:58.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.857+0000 7f9a0bfff700 1 -- 172.21.15.72:0/2592355094 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a1400b910 con 0x7f9a240cd400 2023-10-06T01:39:58.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.857+0000 7f9a2927e700 1 -- 172.21.15.72:0/2592355094 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a240c8070 con 0x7f9a240cd400 2023-10-06T01:39:58.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.857+0000 7f9a0bfff700 1 -- 172.21.15.72:0/2592355094 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1401a450 con 0x7f9a240cd400 2023-10-06T01:39:58.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.857+0000 7f9a2927e700 1 -- 172.21.15.72:0/2592355094 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a240c8630 con 0x7f9a240cd400 2023-10-06T01:39:58.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.857+0000 7f9a0bfff700 1 -- 172.21.15.72:0/2592355094 <== mon.1 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f9a1401a820 con 0x7f9a240cd400 2023-10-06T01:39:58.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.857+0000 7f9a0bfff700 1 -- 172.21.15.72:0/2592355094 <== mon.1 v2:172.21.15.72:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1296+0+0 (secure 0 0 0) 0x7f9a140119a0 con 0x7f9a240cd400 2023-10-06T01:39:58.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.858+0000 7f9a2927e700 1 -- 172.21.15.72:0/2592355094 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a24064aa0 con 0x7f9a240cd400 2023-10-06T01:39:58.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.860+0000 7f9a0bfff700 1 -- 172.21.15.72:0/2592355094 <== mon.1 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f9a14032060 con 0x7f9a240cd400 2023-10-06T01:39:58.905 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-06T01:39:58.904+0000 7f97a28b6180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-06T01:39:58.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.942+0000 7f9a2927e700 1 -- 172.21.15.72:0/2592355094 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd new", "uuid": "5ef0790f-001e-458f-a05b-efae216cf435", "id": 5} v 0) v1 -- 0x7f9a240b0010 con 0x7f9a240cd400 2023-10-06T01:39:58.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.946+0000 7f9a0bfff700 1 -- 172.21.15.72:0/2592355094 <== mon.1 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5ef0790f-001e-458f-a05b-efae216cf435", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9a1403b0b0 con 0x7f9a240cd400 2023-10-06T01:39:58.947 INFO:teuthology.orchestra.run.smithi072.stdout:5 2023-10-06T01:39:58.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.947+0000 7f9a2927e700 1 -- 172.21.15.72:0/2592355094 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a240cd400 msgr2=0x7f9a2415b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:58.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.947+0000 7f9a2927e700 1 --2- 172.21.15.72:0/2592355094 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a240cd400 0x7f9a2415b170 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9a14009f70 tx=0x7f9a14017000 comp rx=0 tx=0).stop 2023-10-06T01:39:58.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.947+0000 7f9a2927e700 1 -- 172.21.15.72:0/2592355094 shutdown_connections 2023-10-06T01:39:58.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.947+0000 7f9a2927e700 1 --2- 172.21.15.72:0/2592355094 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9a2415b6b0 0x7f9a240c7300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:58.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.947+0000 7f9a2927e700 1 --2- 172.21.15.72:0/2592355094 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9a240b0810 0x7f9a24155600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:58.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.947+0000 7f9a2927e700 1 --2- 172.21.15.72:0/2592355094 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a240cd400 0x7f9a2415b170 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:58.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.947+0000 7f9a2927e700 1 -- 172.21.15.72:0/2592355094 >> 172.21.15.72:0/2592355094 conn(0x7f9a2406a110 msgr2=0x7f9a240b4aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:58.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.947+0000 7f9a2927e700 1 -- 172.21.15.72:0/2592355094 shutdown_connections 2023-10-06T01:39:58.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:58.947+0000 7f9a2927e700 1 -- 172.21.15.72:0/2592355094 wait complete. 2023-10-06T01:39:58.960 DEBUG:teuthology.orchestra.run.smithi072:> sudo ceph --cluster ceph osd new 8705aef1-9ae8-4e54-a3c4-c2909fa0ceb6 6 2023-10-06T01:39:58.987 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-06T01:39:58.987+0000 7f9794faa180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-06T01:39:59.046 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-06T01:39:59.046+0000 7f97a28b6180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-06T01:39:59.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.075+0000 7fd0c39b2700 1 Processor -- start 2023-10-06T01:39:59.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.075+0000 7fd0c39b2700 1 -- start start 2023-10-06T01:39:59.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.076+0000 7fd0c39b2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd0bc0c7e20 0x7fd0bc06c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:59.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.076+0000 7fd0c39b2700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd0bc0c8480 0x7fd0bc15a550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:59.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.076+0000 7fd0c39b2700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd0bc0cd180 0x7fd0bc0cd600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:59.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.076+0000 7fd0c39b2700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0bc0c9150 con 0x7fd0bc0cd180 2023-10-06T01:39:59.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.076+0000 7fd0c39b2700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0bc0cdb40 con 0x7fd0bc0c8480 2023-10-06T01:39:59.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.076+0000 7fd0c39b2700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0bc15a0c0 con 0x7fd0bc0c7e20 2023-10-06T01:39:59.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.076+0000 7fd0c174e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd0bc0c7e20 0x7fd0bc06c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:59.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.076+0000 7fd0c0f4d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd0bc0c8480 0x7fd0bc15a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:59.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.076+0000 7fd0c174e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd0bc0c7e20 0x7fd0bc06c350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:48888/0 (socket says 172.21.15.72:48888) 2023-10-06T01:39:59.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.076+0000 7fd0c0f4d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd0bc0c8480 0x7fd0bc15a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54726/0 (socket says 172.21.15.72:54726) 2023-10-06T01:39:59.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.076+0000 7fd0c174e700 1 -- 172.21.15.72:0/213326453 learned_addr learned my addr 172.21.15.72:0/213326453 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-06T01:39:59.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.076+0000 7fd0c1f4f700 1 --2- 172.21.15.72:0/213326453 >> v2:172.21.15.71:3300/0 conn(0x7fd0bc0cd180 0x7fd0bc0cd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:59.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.076+0000 7fd0c174e700 1 -- 172.21.15.72:0/213326453 >> v2:172.21.15.72:3300/0 conn(0x7fd0bc0c8480 msgr2=0x7fd0bc15a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:59.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.076+0000 7fd0c174e700 1 --2- 172.21.15.72:0/213326453 >> v2:172.21.15.72:3300/0 conn(0x7fd0bc0c8480 0x7fd0bc15a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:59.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.076+0000 7fd0c174e700 1 -- 172.21.15.72:0/213326453 >> v2:172.21.15.71:3300/0 conn(0x7fd0bc0cd180 msgr2=0x7fd0bc0cd600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:59.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.076+0000 7fd0c174e700 1 --2- 172.21.15.72:0/213326453 >> v2:172.21.15.71:3300/0 conn(0x7fd0bc0cd180 0x7fd0bc0cd600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:59.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.076+0000 7fd0c174e700 1 -- 172.21.15.72:0/213326453 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0bc0c88f0 con 0x7fd0bc0c7e20 2023-10-06T01:39:59.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.076+0000 7fd0c0f4d700 1 --2- 172.21.15.72:0/213326453 >> v2:172.21.15.72:3300/0 conn(0x7fd0bc0c8480 0x7fd0bc15a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:39:59.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.076+0000 7fd0c174e700 1 --2- 172.21.15.72:0/213326453 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd0bc0c7e20 0x7fd0bc06c350 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc067c40 tx=0x7fd0b8009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a24f5081813a16f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:59.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.076+0000 7fd0b3fff700 1 -- 172.21.15.72:0/213326453 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b8009e70 con 0x7fd0bc0c7e20 2023-10-06T01:39:59.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.076+0000 7fd0b3fff700 1 -- 172.21.15.72:0/213326453 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0b800b860 con 0x7fd0bc0c7e20 2023-10-06T01:39:59.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.076+0000 7fd0b3fff700 1 -- 172.21.15.72:0/213326453 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b800bc00 con 0x7fd0bc0c7e20 2023-10-06T01:39:59.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.077+0000 7fd0c39b2700 1 -- 172.21.15.72:0/213326453 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd0bc0c7e20 msgr2=0x7fd0bc06c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:59.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.077+0000 7fd0c39b2700 1 --2- 172.21.15.72:0/213326453 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd0bc0c7e20 0x7fd0bc06c350 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc067c40 tx=0x7fd0b8009250 comp rx=0 tx=0).stop 2023-10-06T01:39:59.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.077+0000 7fd0c39b2700 1 -- 172.21.15.72:0/213326453 shutdown_connections 2023-10-06T01:39:59.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.077+0000 7fd0c39b2700 1 --2- 172.21.15.72:0/213326453 >> v2:172.21.15.71:3300/0 conn(0x7fd0bc0cd180 0x7fd0bc0cd600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:59.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.077+0000 7fd0c39b2700 1 --2- 172.21.15.72:0/213326453 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd0bc0c7e20 0x7fd0bc06c350 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:59.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.077+0000 7fd0c39b2700 1 --2- 172.21.15.72:0/213326453 >> v2:172.21.15.72:3300/0 conn(0x7fd0bc0c8480 0x7fd0bc15a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:59.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.077+0000 7fd0c39b2700 1 -- 172.21.15.72:0/213326453 >> 172.21.15.72:0/213326453 conn(0x7fd0bc067130 msgr2=0x7fd0bc067530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:59.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.077+0000 7fd0c39b2700 1 -- 172.21.15.72:0/213326453 shutdown_connections 2023-10-06T01:39:59.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.077+0000 7fd0c39b2700 1 -- 172.21.15.72:0/213326453 wait complete. 2023-10-06T01:39:59.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.078+0000 7fd0c39b2700 1 Processor -- start 2023-10-06T01:39:59.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.078+0000 7fd0c39b2700 1 -- start start 2023-10-06T01:39:59.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.079+0000 7fd0c39b2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0bc0c7e20 0x7fd0bc1507c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:59.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.079+0000 7fd0c39b2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd0bc0c8480 0x7fd0bc0c6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:59.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.079+0000 7fd0c39b2700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd0bc0cd180 0x7fd0bc0b20f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:59.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.079+0000 7fd0c39b2700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0bc0c2520 con 0x7fd0bc0cd180 2023-10-06T01:39:59.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.079+0000 7fd0c39b2700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0bc0c1910 con 0x7fd0bc0c7e20 2023-10-06T01:39:59.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.079+0000 7fd0c39b2700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0bc0c1bf0 con 0x7fd0bc0c8480 2023-10-06T01:39:59.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.079+0000 7fd0c174e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0bc0c7e20 0x7fd0bc1507c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:59.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.079+0000 7fd0c174e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0bc0c7e20 0x7fd0bc1507c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:54742/0 (socket says 172.21.15.72:54742) 2023-10-06T01:39:59.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.079+0000 7fd0c174e700 1 -- 172.21.15.72:0/1017396152 learned_addr learned my addr 172.21.15.72:0/1017396152 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-06T01:39:59.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.079+0000 7fd0c0f4d700 1 --2- 172.21.15.72:0/1017396152 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd0bc0c8480 0x7fd0bc0c6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:59.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.079+0000 7fd0c1f4f700 1 --2- 172.21.15.72:0/1017396152 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd0bc0cd180 0x7fd0bc0b20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:59.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.080+0000 7fd0c174e700 1 -- 172.21.15.72:0/1017396152 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd0bc0c8480 msgr2=0x7fd0bc0c6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:59.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.080+0000 7fd0c174e700 1 --2- 172.21.15.72:0/1017396152 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd0bc0c8480 0x7fd0bc0c6390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:59.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.080+0000 7fd0c174e700 1 -- 172.21.15.72:0/1017396152 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd0bc0cd180 msgr2=0x7fd0bc0b20f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:59.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.080+0000 7fd0c174e700 1 --2- 172.21.15.72:0/1017396152 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd0bc0cd180 0x7fd0bc0b20f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:59.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.080+0000 7fd0c174e700 1 -- 172.21.15.72:0/1017396152 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0ac009420 con 0x7fd0bc0c7e20 2023-10-06T01:39:59.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.080+0000 7fd0c0f4d700 1 --2- 172.21.15.72:0/1017396152 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd0bc0c8480 0x7fd0bc0c6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:39:59.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.080+0000 7fd0c174e700 1 --2- 172.21.15.72:0/1017396152 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0bc0c7e20 0x7fd0bc1507c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc15a200 tx=0x7fd0b8017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:59.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.080+0000 7fd0b17fa700 1 -- 172.21.15.72:0/1017396152 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b800bbe0 con 0x7fd0bc0c7e20 2023-10-06T01:39:59.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.080+0000 7fd0b17fa700 1 -- 172.21.15.72:0/1017396152 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0b8000c90 con 0x7fd0bc0c7e20 2023-10-06T01:39:59.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.080+0000 7fd0c39b2700 1 -- 172.21.15.72:0/1017396152 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0b80094f0 con 0x7fd0bc0c7e20 2023-10-06T01:39:59.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.080+0000 7fd0b17fa700 1 -- 172.21.15.72:0/1017396152 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b8011650 con 0x7fd0bc0c7e20 2023-10-06T01:39:59.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.080+0000 7fd0c39b2700 1 -- 172.21.15.72:0/1017396152 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0bc0c21b0 con 0x7fd0bc0c7e20 2023-10-06T01:39:59.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.080+0000 7fd0b17fa700 1 -- 172.21.15.72:0/1017396152 <== mon.1 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fd0b8011a80 con 0x7fd0bc0c7e20 2023-10-06T01:39:59.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.080+0000 7fd0b17fa700 1 -- 172.21.15.72:0/1017396152 <== mon.1 v2:172.21.15.72:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1411+0+0 (secure 0 0 0) 0x7fd0b80239f0 con 0x7fd0bc0c7e20 2023-10-06T01:39:59.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.081+0000 7fd0c39b2700 1 -- 172.21.15.72:0/1017396152 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0bc06eb00 con 0x7fd0bc0c7e20 2023-10-06T01:39:59.087 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-06T01:39:59.082+0000 7f9794faa180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-06T01:39:59.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.083+0000 7fd0b17fa700 1 -- 172.21.15.72:0/1017396152 <== mon.1 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fd0b8028070 con 0x7fd0bc0c7e20 2023-10-06T01:39:59.184 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-06T01:39:59.183+0000 7f97a28b6180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-06T01:39:59.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.239+0000 7fd0c39b2700 1 -- 172.21.15.72:0/1017396152 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8705aef1-9ae8-4e54-a3c4-c2909fa0ceb6", "id": 6} v 0) v1 -- 0x7fd0bc0cd920 con 0x7fd0bc0c7e20 2023-10-06T01:39:59.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.243+0000 7fd0b17fa700 1 -- 172.21.15.72:0/1017396152 <== mon.1 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8705aef1-9ae8-4e54-a3c4-c2909fa0ceb6", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd0b8015020 con 0x7fd0bc0c7e20 2023-10-06T01:39:59.244 INFO:teuthology.orchestra.run.smithi072.stdout:6 2023-10-06T01:39:59.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.244+0000 7fd0c39b2700 1 -- 172.21.15.72:0/1017396152 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0bc0c7e20 msgr2=0x7fd0bc1507c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:59.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.244+0000 7fd0c39b2700 1 --2- 172.21.15.72:0/1017396152 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0bc0c7e20 0x7fd0bc1507c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc15a200 tx=0x7fd0b8017000 comp rx=0 tx=0).stop 2023-10-06T01:39:59.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.245+0000 7fd0c39b2700 1 -- 172.21.15.72:0/1017396152 shutdown_connections 2023-10-06T01:39:59.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.245+0000 7fd0c39b2700 1 --2- 172.21.15.72:0/1017396152 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd0bc0cd180 0x7fd0bc0b20f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:59.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.245+0000 7fd0c39b2700 1 --2- 172.21.15.72:0/1017396152 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0bc0c7e20 0x7fd0bc1507c0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:59.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.245+0000 7fd0c39b2700 1 --2- 172.21.15.72:0/1017396152 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd0bc0c8480 0x7fd0bc0c6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:59.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.245+0000 7fd0c39b2700 1 -- 172.21.15.72:0/1017396152 >> 172.21.15.72:0/1017396152 conn(0x7fd0bc067130 msgr2=0x7fd0bc1536a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:59.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.245+0000 7fd0c39b2700 1 -- 172.21.15.72:0/1017396152 shutdown_connections 2023-10-06T01:39:59.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.245+0000 7fd0c39b2700 1 -- 172.21.15.72:0/1017396152 wait complete. 2023-10-06T01:39:59.257 DEBUG:teuthology.orchestra.run.smithi072:> sudo ceph --cluster ceph osd new 364c5119-6b13-4c75-b3f0-15e165eff86a 7 2023-10-06T01:39:59.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.372+0000 7fdd4347c700 1 Processor -- start 2023-10-06T01:39:59.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.372+0000 7fdd4347c700 1 -- start start 2023-10-06T01:39:59.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.373+0000 7fdd4347c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd3c1574b0 0x7fdd3c0b0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:59.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.373+0000 7fdd4347c700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd3c0c3b40 con 0x7fdd3c0b13f0 2023-10-06T01:39:59.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.373+0000 7fdd4347c700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd3c0c2f30 con 0x7fdd3c0c46e0 2023-10-06T01:39:59.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.373+0000 7fdd4347c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd3c0c3210 con 0x7fdd3c1574b0 2023-10-06T01:39:59.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.373+0000 7fdd41218700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd3c1574b0 0x7fdd3c0b0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:59.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.373+0000 7fdd41a19700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fdd3c0c46e0 0x7fdd3c0cbcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:38406/0 (socket says 172.21.15.72:38406) 2023-10-06T01:39:59.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.373+0000 7fdd41a19700 1 -- 172.21.15.72:0/3955973178 learned_addr learned my addr 172.21.15.72:0/3955973178 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-06T01:39:59.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.373+0000 7fdd33fff700 1 -- 172.21.15.72:0/3955973178 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1528389174 0 0) 0x7fdd3c0c2f30 con 0x7fdd3c0c46e0 2023-10-06T01:39:59.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.373+0000 7fdd41218700 1 -- 172.21.15.72:0/3955973178 >> v1:172.21.15.72:6789/0 conn(0x7fdd3c0c46e0 legacy=0x7fdd3c0cbcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:59.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.373+0000 7fdd41218700 1 -- 172.21.15.72:0/3955973178 >> v1:172.21.15.71:6789/0 conn(0x7fdd3c0b13f0 legacy=0x7fdd3c0c3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:59.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.373+0000 7fdd41218700 1 -- 172.21.15.72:0/3955973178 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd3c0c34f0 con 0x7fdd3c1574b0 2023-10-06T01:39:59.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.373+0000 7fdd41218700 1 --2- 172.21.15.72:0/3955973178 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd3c1574b0 0x7fdd3c0b0eb0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fdd38009900 tx=0x7fdd38009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b26e9ca62e2e399 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:59.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.373+0000 7fdd33fff700 1 -- 172.21.15.72:0/3955973178 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd38009ea0 con 0x7fdd3c1574b0 2023-10-06T01:39:59.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.373+0000 7fdd33fff700 1 -- 172.21.15.72:0/3955973178 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd38005c10 con 0x7fdd3c1574b0 2023-10-06T01:39:59.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.374+0000 7fdd33fff700 1 -- 172.21.15.72:0/3955973178 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd3800b650 con 0x7fdd3c1574b0 2023-10-06T01:39:59.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.374+0000 7fdd4347c700 1 -- 172.21.15.72:0/3955973178 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd3c1574b0 msgr2=0x7fdd3c0b0eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:59.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.374+0000 7fdd4347c700 1 --2- 172.21.15.72:0/3955973178 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd3c1574b0 0x7fdd3c0b0eb0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fdd38009900 tx=0x7fdd38009120 comp rx=0 tx=0).stop 2023-10-06T01:39:59.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.374+0000 7fdd4347c700 1 -- 172.21.15.72:0/3955973178 shutdown_connections 2023-10-06T01:39:59.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.374+0000 7fdd4347c700 1 --2- 172.21.15.72:0/3955973178 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd3c1574b0 0x7fdd3c0b0eb0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:59.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.374+0000 7fdd4347c700 1 -- 172.21.15.72:0/3955973178 >> 172.21.15.72:0/3955973178 conn(0x7fdd3c067910 msgr2=0x7fdd3c0ce0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:59.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.374+0000 7fdd4347c700 1 -- 172.21.15.72:0/3955973178 shutdown_connections 2023-10-06T01:39:59.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.374+0000 7fdd4347c700 1 -- 172.21.15.72:0/3955973178 wait complete. 2023-10-06T01:39:59.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.375+0000 7fdd4347c700 1 Processor -- start 2023-10-06T01:39:59.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.375+0000 7fdd4347c700 1 -- start start 2023-10-06T01:39:59.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.376+0000 7fdd4347c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd3c0b13f0 0x7fdd3c1529f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:59.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.376+0000 7fdd4347c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd3c0c46e0 0x7fdd3c149cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:59.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.376+0000 7fdd4347c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd3c1574b0 0x7fdd3c1684b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:59.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.376+0000 7fdd4347c700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd3c152560 con 0x7fdd3c0b13f0 2023-10-06T01:39:59.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.376+0000 7fdd4347c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd3c14a200 con 0x7fdd3c0c46e0 2023-10-06T01:39:59.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.376+0000 7fdd4347c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd3c151950 con 0x7fdd3c1574b0 2023-10-06T01:39:59.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.376+0000 7fdd41a19700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd3c1574b0 0x7fdd3c1684b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:59.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.376+0000 7fdd40a17700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd3c0c46e0 0x7fdd3c149cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:59.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.376+0000 7fdd41a19700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd3c1574b0 0x7fdd3c1684b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:48912/0 (socket says 172.21.15.72:48912) 2023-10-06T01:39:59.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.376+0000 7fdd41a19700 1 -- 172.21.15.72:0/1053949685 learned_addr learned my addr 172.21.15.72:0/1053949685 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-06T01:39:59.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.376+0000 7fdd41218700 1 --2- 172.21.15.72:0/1053949685 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd3c0b13f0 0x7fdd3c1529f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:59.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.376+0000 7fdd41a19700 1 -- 172.21.15.72:0/1053949685 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd3c0c46e0 msgr2=0x7fdd3c149cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:59.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.376+0000 7fdd41a19700 1 --2- 172.21.15.72:0/1053949685 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd3c0c46e0 0x7fdd3c149cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:59.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.376+0000 7fdd41a19700 1 -- 172.21.15.72:0/1053949685 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd3c0b13f0 msgr2=0x7fdd3c1529f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:59.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.376+0000 7fdd41a19700 1 --2- 172.21.15.72:0/1053949685 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd3c0b13f0 0x7fdd3c1529f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:59.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.376+0000 7fdd41a19700 1 -- 172.21.15.72:0/1053949685 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd380093c0 con 0x7fdd3c1574b0 2023-10-06T01:39:59.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.376+0000 7fdd40a17700 1 --2- 172.21.15.72:0/1053949685 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd3c0c46e0 0x7fdd3c149cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:39:59.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.377+0000 7fdd41a19700 1 --2- 172.21.15.72:0/1053949685 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd3c1574b0 0x7fdd3c1684b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fdd3400cc90 tx=0x7fdd34001a00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:59.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.377+0000 7fdd317fa700 1 -- 172.21.15.72:0/1053949685 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd3400a850 con 0x7fdd3c1574b0 2023-10-06T01:39:59.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.377+0000 7fdd317fa700 1 -- 172.21.15.72:0/1053949685 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd3400a9b0 con 0x7fdd3c1574b0 2023-10-06T01:39:59.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.377+0000 7fdd4347c700 1 -- 172.21.15.72:0/1053949685 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd3c151c30 con 0x7fdd3c1574b0 2023-10-06T01:39:59.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.377+0000 7fdd317fa700 1 -- 172.21.15.72:0/1053949685 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd3400ad70 con 0x7fdd3c1574b0 2023-10-06T01:39:59.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.377+0000 7fdd4347c700 1 -- 172.21.15.72:0/1053949685 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd3c1521f0 con 0x7fdd3c1574b0 2023-10-06T01:39:59.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.377+0000 7fdd317fa700 1 -- 172.21.15.72:0/1053949685 <== mon.2 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fdd34007300 con 0x7fdd3c1574b0 2023-10-06T01:39:59.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.377+0000 7fdd317fa700 1 -- 172.21.15.72:0/1053949685 <== mon.2 v2:172.21.15.72:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1526+0+0 (secure 0 0 0) 0x7fdd34012a70 con 0x7fdd3c1574b0 2023-10-06T01:39:59.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.378+0000 7fdd4347c700 1 -- 172.21.15.72:0/1053949685 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd3c06e590 con 0x7fdd3c1574b0 2023-10-06T01:39:59.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.380+0000 7fdd317fa700 1 -- 172.21.15.72:0/1053949685 <== mon.2 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fdd34012d50 con 0x7fdd3c1574b0 2023-10-06T01:39:59.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.460+0000 7fdd4347c700 1 -- 172.21.15.72:0/1053949685 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd new", "uuid": "364c5119-6b13-4c75-b3f0-15e165eff86a", "id": 7} v 0) v1 -- 0x7fdd3c0c37d0 con 0x7fdd3c1574b0 2023-10-06T01:39:59.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.469+0000 7fdd317fa700 1 -- 172.21.15.72:0/1053949685 <== mon.2 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "364c5119-6b13-4c75-b3f0-15e165eff86a", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fdd340075b0 con 0x7fdd3c1574b0 2023-10-06T01:39:59.470 INFO:teuthology.orchestra.run.smithi072.stdout:7 2023-10-06T01:39:59.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.470+0000 7fdd4347c700 1 -- 172.21.15.72:0/1053949685 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd3c1574b0 msgr2=0x7fdd3c1684b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:59.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.470+0000 7fdd4347c700 1 --2- 172.21.15.72:0/1053949685 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd3c1574b0 0x7fdd3c1684b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fdd3400cc90 tx=0x7fdd34001a00 comp rx=0 tx=0).stop 2023-10-06T01:39:59.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.470+0000 7fdd4347c700 1 -- 172.21.15.72:0/1053949685 shutdown_connections 2023-10-06T01:39:59.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.470+0000 7fdd4347c700 1 --2- 172.21.15.72:0/1053949685 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd3c1574b0 0x7fdd3c1684b0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:59.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.470+0000 7fdd4347c700 1 --2- 172.21.15.72:0/1053949685 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd3c0b13f0 0x7fdd3c1529f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:59.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.470+0000 7fdd4347c700 1 --2- 172.21.15.72:0/1053949685 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd3c0c46e0 0x7fdd3c149cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:59.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.470+0000 7fdd4347c700 1 -- 172.21.15.72:0/1053949685 >> 172.21.15.72:0/1053949685 conn(0x7fdd3c067910 msgr2=0x7fdd3c15c570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:59.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.470+0000 7fdd4347c700 1 -- 172.21.15.72:0/1053949685 shutdown_connections 2023-10-06T01:39:59.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-06T01:39:59.470+0000 7fdd4347c700 1 -- 172.21.15.72:0/1053949685 wait complete. 2023-10-06T01:39:59.483 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-06T01:39:59.483 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-10-06T01:39:59.485 INFO:tasks.ceph.osd.0:Started 2023-10-06T01:39:59.485 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-06T01:39:59.485 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-10-06T01:39:59.487 INFO:tasks.ceph.osd.1:Started 2023-10-06T01:39:59.487 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-06T01:39:59.487 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-10-06T01:39:59.489 INFO:tasks.ceph.osd.2:Started 2023-10-06T01:39:59.489 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-06T01:39:59.489 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-10-06T01:39:59.492 INFO:tasks.ceph.osd.3:Started 2023-10-06T01:39:59.492 INFO:tasks.ceph.osd.4:Restarting daemon 2023-10-06T01:39:59.492 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-10-06T01:39:59.494 INFO:tasks.ceph.osd.4:Started 2023-10-06T01:39:59.495 INFO:tasks.ceph.osd.5:Restarting daemon 2023-10-06T01:39:59.495 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-10-06T01:39:59.497 INFO:tasks.ceph.osd.5:Started 2023-10-06T01:39:59.497 INFO:tasks.ceph.osd.6:Restarting daemon 2023-10-06T01:39:59.497 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-10-06T01:39:59.499 INFO:tasks.ceph.osd.6:Started 2023-10-06T01:39:59.499 INFO:tasks.ceph.osd.7:Restarting daemon 2023-10-06T01:39:59.499 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-10-06T01:39:59.501 INFO:tasks.ceph.osd.7:Started 2023-10-06T01:39:59.502 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:39:59.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:59.633+0000 7ff2ffb09700 1 Processor -- start 2023-10-06T01:39:59.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:59.633+0000 7ff2ffb09700 1 -- start start 2023-10-06T01:39:59.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:59.634+0000 7ff2ffb09700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff2f80af4e0 0x7ff2f80b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:59.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:59.634+0000 7ff2ffb09700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2f815e190 con 0x7ff2f815db70 2023-10-06T01:39:59.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:59.634+0000 7ff2ffb09700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2f80cb650 con 0x7ff2f80af8b0 2023-10-06T01:39:59.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:59.634+0000 7ff2ffb09700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2f80b1910 con 0x7ff2f80af4e0 2023-10-06T01:39:59.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:59.634+0000 7ff2fe0a6700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7ff2f815db70 0x7ff2f80cbae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:50414/0 (socket says 172.21.15.71:50414) 2023-10-06T01:39:59.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:59.634+0000 7ff2fe0a6700 1 -- 172.21.15.71:0/3026570189 learned_addr learned my addr 172.21.15.71:0/3026570189 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:39:59.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:59.634+0000 7ff2fd8a5700 1 --2- 172.21.15.71:0/3026570189 >> v2:172.21.15.72:3300/0 conn(0x7ff2f80af4e0 0x7ff2f80b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:59.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:59.634+0000 7ff2fc8a3700 1 -- 172.21.15.71:0/3026570189 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 605476951 0 0) 0x7ff2f815e190 con 0x7ff2f815db70 2023-10-06T01:39:59.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:59.634+0000 7ff2fc8a3700 1 -- 172.21.15.71:0/3026570189 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2e4003570 con 0x7ff2f815db70 2023-10-06T01:39:59.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:59.634+0000 7ff2fc8a3700 1 -- 172.21.15.71:0/3026570189 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3431342978 0 0) 0x7ff2f80cb650 con 0x7ff2f80af8b0 2023-10-06T01:39:59.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:59.634+0000 7ff2fc8a3700 1 -- 172.21.15.71:0/3026570189 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2f815e190 con 0x7ff2f80af8b0 2023-10-06T01:39:59.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:59.634+0000 7ff2fd8a5700 1 -- 172.21.15.71:0/3026570189 >> v1:172.21.15.72:6789/0 conn(0x7ff2f80af8b0 legacy=0x7ff2f815d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:59.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:59.634+0000 7ff2fd8a5700 1 -- 172.21.15.71:0/3026570189 >> v1:172.21.15.71:6789/0 conn(0x7ff2f815db70 legacy=0x7ff2f80cbae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:59.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:59.634+0000 7ff2fd8a5700 1 -- 172.21.15.71:0/3026570189 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2f80cad20 con 0x7ff2f80af4e0 2023-10-06T01:39:59.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:59.634+0000 7ff2fd8a5700 1 --2- 172.21.15.71:0/3026570189 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2f80af4e0 0x7ff2f80b20e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff2f40098e0 tx=0x7ff2f40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6303762f647be464 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:59.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:59.634+0000 7ff2fc8a3700 1 -- 172.21.15.71:0/3026570189 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2f4011630 con 0x7ff2f80af4e0 2023-10-06T01:39:59.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:59.635+0000 7ff2fc8a3700 1 -- 172.21.15.71:0/3026570189 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2f4011790 con 0x7ff2f80af4e0 2023-10-06T01:39:59.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:59.635+0000 7ff2fc8a3700 1 -- 172.21.15.71:0/3026570189 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2f4011b30 con 0x7ff2f80af4e0 2023-10-06T01:39:59.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:59.635+0000 7ff2ffb09700 1 -- 172.21.15.71:0/3026570189 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2f80af4e0 msgr2=0x7ff2f80b20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:59.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:59.635+0000 7ff2ffb09700 1 --2- 172.21.15.71:0/3026570189 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2f80af4e0 0x7ff2f80b20e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff2f40098e0 tx=0x7ff2f40091a0 comp rx=0 tx=0).stop 2023-10-06T01:39:59.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:59.635+0000 7ff2ffb09700 1 -- 172.21.15.71:0/3026570189 shutdown_connections 2023-10-06T01:39:59.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:59.635+0000 7ff2ffb09700 1 --2- 172.21.15.71:0/3026570189 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2f80af4e0 0x7ff2f80b20e0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:59.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:59.635+0000 7ff2ffb09700 1 -- 172.21.15.71:0/3026570189 >> 172.21.15.71:0/3026570189 conn(0x7ff2f8068680 msgr2=0x7ff2f8068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:59.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:59.635+0000 7ff2ffb09700 1 -- 172.21.15.71:0/3026570189 shutdown_connections 2023-10-06T01:39:59.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:59.635+0000 7ff2ffb09700 1 -- 172.21.15.71:0/3026570189 wait complete. 2023-10-06T01:39:59.638 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-06T01:39:59.636+0000 7f9794faa180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-06T01:39:59.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:59.636+0000 7ff2ffb09700 1 Processor -- start 2023-10-06T01:39:59.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:59.636+0000 7ff2ffb09700 1 -- start start 2023-10-06T01:39:59.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:59.637+0000 7ff2ffb09700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2f80af4e0 0x7ff2f816d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:59.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:59.637+0000 7ff2ffb09700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2f80af8b0 0x7ff2f816dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:59.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:59.637+0000 7ff2ffb09700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff2f815db70 0x7ff2f81564a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:59.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:59.637+0000 7ff2ffb09700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f80d0070 con 0x7ff2f80af8b0 2023-10-06T01:39:59.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:59.637+0000 7ff2ffb09700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f80cf460 con 0x7ff2f80af4e0 2023-10-06T01:39:59.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:59.637+0000 7ff2ffb09700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f80cf740 con 0x7ff2f815db70 2023-10-06T01:39:59.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:59.637+0000 7ff2fd0a4700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2f80af8b0 0x7ff2f816dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:59.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:59.637+0000 7ff2fd0a4700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2f80af8b0 0x7ff2f816dcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:54890/0 (socket says 172.21.15.71:54890) 2023-10-06T01:39:59.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:59.637+0000 7ff2fd0a4700 1 -- 172.21.15.71:0/1059931510 learned_addr learned my addr 172.21.15.71:0/1059931510 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:39:59.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:59.637+0000 7ff2fe0a6700 1 --2- 172.21.15.71:0/1059931510 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff2f815db70 0x7ff2f81564a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:59.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:59.637+0000 7ff2fd8a5700 1 --2- 172.21.15.71:0/1059931510 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2f80af4e0 0x7ff2f816d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:59.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:59.637+0000 7ff2fd0a4700 1 -- 172.21.15.71:0/1059931510 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff2f815db70 msgr2=0x7ff2f81564a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:59.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:59.637+0000 7ff2fd0a4700 1 --2- 172.21.15.71:0/1059931510 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff2f815db70 0x7ff2f81564a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:59.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:59.637+0000 7ff2fd0a4700 1 -- 172.21.15.71:0/1059931510 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2f80af4e0 msgr2=0x7ff2f816d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:59.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:59.637+0000 7ff2fd0a4700 1 --2- 172.21.15.71:0/1059931510 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2f80af4e0 0x7ff2f816d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:59.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:59.637+0000 7ff2fd0a4700 1 -- 172.21.15.71:0/1059931510 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2f4009420 con 0x7ff2f80af8b0 2023-10-06T01:39:59.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:59.637+0000 7ff2fd0a4700 1 --2- 172.21.15.71:0/1059931510 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2f80af8b0 0x7ff2f816dcc0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ff2e800c7c0 tx=0x7ff2e8007de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:59.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:59.638+0000 7ff2edffb700 1 -- 172.21.15.71:0/1059931510 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e8010510 con 0x7ff2f80af8b0 2023-10-06T01:39:59.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:59.638+0000 7ff2edffb700 1 -- 172.21.15.71:0/1059931510 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2e80106b0 con 0x7ff2f80af8b0 2023-10-06T01:39:59.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:59.638+0000 7ff2ffb09700 1 -- 172.21.15.71:0/1059931510 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2f80cfa20 con 0x7ff2f80af8b0 2023-10-06T01:39:59.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:59.638+0000 7ff2edffb700 1 -- 172.21.15.71:0/1059931510 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e8010a70 con 0x7ff2f80af8b0 2023-10-06T01:39:59.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:59.638+0000 7ff2edffb700 1 -- 172.21.15.71:0/1059931510 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7ff2e80126c0 con 0x7ff2f80af8b0 2023-10-06T01:39:59.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:59.638+0000 7ff2ffb09700 1 -- 172.21.15.71:0/1059931510 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2f80d0500 con 0x7ff2f80af8b0 2023-10-06T01:39:59.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:59.638+0000 7ff2edffb700 1 -- 172.21.15.71:0/1059931510 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7ff2e8012970 con 0x7ff2f80af8b0 2023-10-06T01:39:59.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:59.639+0000 7ff2ffb09700 1 -- 172.21.15.71:0/1059931510 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2f8088aa0 con 0x7ff2f80af8b0 2023-10-06T01:39:59.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:59.641+0000 7ff2edffb700 1 -- 172.21.15.71:0/1059931510 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7ff2e8017070 con 0x7ff2f80af8b0 2023-10-06T01:39:59.727 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:59.726+0000 7ff2ffb09700 1 -- 172.21.15.71:0/1059931510 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff2f80b5c40 con 0x7ff2f80af8b0 2023-10-06T01:39:59.728 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:59.727+0000 7ff2edffb700 1 -- 172.21.15.71:0/1059931510 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7ff2e8012b30 con 0x7ff2f80af8b0 2023-10-06T01:39:59.728 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:39:59.729 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":10,"fsid":"1fbf1bd2-f9b4-4599-bea2-f4aa920e9a56","created":"2023-10-06T01:39:57.016957+0000","modified":"2023-10-06T01:39:59.462741+0000","last_up_change":"0.000000","last_in_change":"2023-10-06T01:39:59.462741+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"cf059188-fb20-4dbf-95db-dcf57b213d03","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"0cff0aae-1799-4fe0-b610-54cf0813c0e1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"88d61ddc-9031-44e1-ba8c-546a41e7c8ce","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"11ed92b7-960b-4a30-a889-a61d3eeb86f0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"ae4df784-abdf-4ddf-aefa-780f3ddafef3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"5ef0790f-001e-458f-a05b-efae216cf435","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"8705aef1-9ae8-4e54-a3c4-c2909fa0ceb6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"364c5119-6b13-4c75-b3f0-15e165eff86a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:39:59.729 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:59.728+0000 7ff2ffb09700 1 -- 172.21.15.71:0/1059931510 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2f80af8b0 msgr2=0x7ff2f816dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:59.729 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:59.728+0000 7ff2ffb09700 1 --2- 172.21.15.71:0/1059931510 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2f80af8b0 0x7ff2f816dcc0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ff2e800c7c0 tx=0x7ff2e8007de0 comp rx=0 tx=0).stop 2023-10-06T01:39:59.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:59.728+0000 7ff2ffb09700 1 -- 172.21.15.71:0/1059931510 shutdown_connections 2023-10-06T01:39:59.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:59.728+0000 7ff2ffb09700 1 --2- 172.21.15.71:0/1059931510 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff2f815db70 0x7ff2f81564a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:59.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:59.728+0000 7ff2ffb09700 1 --2- 172.21.15.71:0/1059931510 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2f80af4e0 0x7ff2f816d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:59.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:59.728+0000 7ff2ffb09700 1 --2- 172.21.15.71:0/1059931510 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff2f80af8b0 0x7ff2f816dcc0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:59.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:59.728+0000 7ff2ffb09700 1 -- 172.21.15.71:0/1059931510 >> 172.21.15.71:0/1059931510 conn(0x7ff2f8068680 msgr2=0x7ff2f80b20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:59.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:59.728+0000 7ff2ffb09700 1 -- 172.21.15.71:0/1059931510 shutdown_connections 2023-10-06T01:39:59.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:39:59.728+0000 7ff2ffb09700 1 -- 172.21.15.71:0/1059931510 wait complete. 2023-10-06T01:39:59.730 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-06T01:39:59.729+0000 7f9794faa180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-06T01:39:59.741 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-10-06T01:39:59.741 INFO:tasks.ceph:Waiting for OSDs to come up 2023-10-06T01:39:59.753 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-06T01:39:59.752+0000 7f97a28b6180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-06T01:39:59.809 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-06T01:39:59.809+0000 7f9794faa180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-06T01:39:59.831 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-06T01:39:59.829+0000 7f97a28b6180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-06T01:39:59.909 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-06T01:39:59.908+0000 7f97a28b6180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-06T01:40:00.093 INFO:tasks.ceph.osd.4.smithi072.stderr:2023-10-06T01:40:00.092+0000 7fc69e22c540 -1 Falling back to public interface 2023-10-06T01:40:00.094 INFO:tasks.ceph.osd.3.smithi071.stderr:2023-10-06T01:40:00.093+0000 7f6cba587540 -1 Falling back to public interface 2023-10-06T01:40:00.099 INFO:tasks.ceph.osd.6.smithi072.stderr:2023-10-06T01:40:00.098+0000 7f6b62769540 -1 Falling back to public interface 2023-10-06T01:40:00.101 INFO:tasks.ceph.osd.1.smithi071.stderr:2023-10-06T01:40:00.100+0000 7feb0cac9540 -1 Falling back to public interface 2023-10-06T01:40:00.105 INFO:tasks.ceph.osd.0.smithi071.stderr:2023-10-06T01:40:00.104+0000 7faab87da540 -1 Falling back to public interface 2023-10-06T01:40:00.110 INFO:tasks.ceph.osd.2.smithi071.stderr:2023-10-06T01:40:00.109+0000 7fb49c4f2540 -1 Falling back to public interface 2023-10-06T01:40:00.116 INFO:tasks.ceph.osd.5.smithi072.stderr:2023-10-06T01:40:00.115+0000 7f99bcbd1540 -1 Falling back to public interface 2023-10-06T01:40:00.117 INFO:tasks.ceph.osd.7.smithi072.stderr:2023-10-06T01:40:00.116+0000 7ff42ca49540 -1 Falling back to public interface 2023-10-06T01:40:00.392 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-06T01:40:00.391+0000 7f9794faa180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-06T01:40:00.479 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-06T01:40:00.478+0000 7f97a28b6180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-06T01:40:00.529 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-06T01:40:00.529+0000 7f9794faa180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-06T01:40:00.548 DEBUG:teuthology.orchestra.run.smithi071:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-06T01:40:00.615 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-06T01:40:00.614+0000 7f97a28b6180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-06T01:40:00.628 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-06T01:40:00.628+0000 7f9794faa180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-06T01:40:00.659 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:00.656+0000 7fa1d9161700 1 Processor -- start 2023-10-06T01:40:00.659 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:00.656+0000 7fa1d9161700 1 -- start start 2023-10-06T01:40:00.660 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:00.657+0000 7fa1d9161700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa1d40ac340 0x7fa1d40acaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:00.660 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:00.657+0000 7fa1d9161700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1d4068840 con 0x7fa1d41595a0 2023-10-06T01:40:00.660 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:00.657+0000 7fa1d9161700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1d40693c0 con 0x7fa1d41591d0 2023-10-06T01:40:00.660 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:00.657+0000 7fa1d9161700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1d4068a90 con 0x7fa1d40ac340 2023-10-06T01:40:00.660 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:00.657+0000 7fa1d8960700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fa1d41595a0 0x7fa1d40a9a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:50418/0 (socket says 172.21.15.71:50418) 2023-10-06T01:40:00.660 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:00.657+0000 7fa1d8960700 1 -- 172.21.15.71:0/1685389511 learned_addr learned my addr 172.21.15.71:0/1685389511 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:40:00.660 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:00.657+0000 7fa1d37fe700 1 --2- 172.21.15.71:0/1685389511 >> v2:172.21.15.72:3300/0 conn(0x7fa1d40ac340 0x7fa1d40acaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:00.660 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:00.657+0000 7fa1d2ffd700 1 -- 172.21.15.71:0/1685389511 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3924120269 0 0) 0x7fa1d4068840 con 0x7fa1d41595a0 2023-10-06T01:40:00.660 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:00.657+0000 7fa1d2ffd700 1 -- 172.21.15.71:0/1685389511 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1bc003570 con 0x7fa1d41595a0 2023-10-06T01:40:00.660 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:00.657+0000 7fa1d37fe700 1 -- 172.21.15.71:0/1685389511 >> v1:172.21.15.72:6789/0 conn(0x7fa1d41591d0 legacy=0x7fa1d40abc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:00.660 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:00.657+0000 7fa1d37fe700 1 -- 172.21.15.71:0/1685389511 >> v1:172.21.15.71:6789/0 conn(0x7fa1d41595a0 legacy=0x7fa1d40a9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:00.660 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:00.657+0000 7fa1d37fe700 1 -- 172.21.15.71:0/1685389511 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1d4068d70 con 0x7fa1d40ac340 2023-10-06T01:40:00.661 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:00.658+0000 7fa1d37fe700 1 --2- 172.21.15.71:0/1685389511 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1d40ac340 0x7fa1d40acaa0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa1c40098e0 tx=0x7fa1c40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f10d5c4d041bdea7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:00.661 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:00.658+0000 7fa1d2ffd700 1 -- 172.21.15.71:0/1685389511 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1c400b640 con 0x7fa1d40ac340 2023-10-06T01:40:00.661 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:00.658+0000 7fa1d2ffd700 1 -- 172.21.15.71:0/1685389511 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1c400b7a0 con 0x7fa1d40ac340 2023-10-06T01:40:00.661 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:00.658+0000 7fa1d2ffd700 1 -- 172.21.15.71:0/1685389511 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1c400bb40 con 0x7fa1d40ac340 2023-10-06T01:40:00.661 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:00.658+0000 7fa1d9161700 1 -- 172.21.15.71:0/1685389511 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1d40ac340 msgr2=0x7fa1d40acaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:00.661 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:00.658+0000 7fa1d9161700 1 --2- 172.21.15.71:0/1685389511 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1d40ac340 0x7fa1d40acaa0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa1c40098e0 tx=0x7fa1c40091a0 comp rx=0 tx=0).stop 2023-10-06T01:40:00.661 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:00.658+0000 7fa1d9161700 1 -- 172.21.15.71:0/1685389511 shutdown_connections 2023-10-06T01:40:00.661 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:00.658+0000 7fa1d9161700 1 --2- 172.21.15.71:0/1685389511 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1d40ac340 0x7fa1d40acaa0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:00.661 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:00.658+0000 7fa1d9161700 1 -- 172.21.15.71:0/1685389511 >> 172.21.15.71:0/1685389511 conn(0x7fa1d4096190 msgr2=0x7fa1d406a130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:00.661 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:00.659+0000 7fa1d9161700 1 -- 172.21.15.71:0/1685389511 shutdown_connections 2023-10-06T01:40:00.661 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:00.659+0000 7fa1d9161700 1 -- 172.21.15.71:0/1685389511 wait complete. 2023-10-06T01:40:00.664 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:00.660+0000 7fa1d9161700 1 Processor -- start 2023-10-06T01:40:00.664 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:00.660+0000 7fa1d9161700 1 -- start start 2023-10-06T01:40:00.665 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:00.660+0000 7fa1d9161700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1d40ac340 0x7fa1d4146100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:00.665 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:00.660+0000 7fa1d9161700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa1d41591d0 0x7fa1d4097760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:00.665 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:00.660+0000 7fa1d9161700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa1d41595a0 0x7fa1d40b1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:00.665 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:00.660+0000 7fa1d9161700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d4098df0 con 0x7fa1d41591d0 2023-10-06T01:40:00.665 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:00.661+0000 7fa1d9161700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d40981e0 con 0x7fa1d40ac340 2023-10-06T01:40:00.665 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:00.661+0000 7fa1d9161700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d40984c0 con 0x7fa1d41595a0 2023-10-06T01:40:00.665 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:00.661+0000 7fa1d37fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa1d41591d0 0x7fa1d4097760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:00.665 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:00.661+0000 7fa1d37fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa1d41591d0 0x7fa1d4097760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:54892/0 (socket says 172.21.15.71:54892) 2023-10-06T01:40:00.665 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:00.661+0000 7fa1d37fe700 1 -- 172.21.15.71:0/2979855037 learned_addr learned my addr 172.21.15.71:0/2979855037 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:00.665 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:00.661+0000 7fa1d3fff700 1 --2- 172.21.15.71:0/2979855037 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1d40ac340 0x7fa1d4146100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:00.665 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:00.661+0000 7fa1d8960700 1 --2- 172.21.15.71:0/2979855037 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa1d41595a0 0x7fa1d40b1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:00.665 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:00.661+0000 7fa1d37fe700 1 -- 172.21.15.71:0/2979855037 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa1d41595a0 msgr2=0x7fa1d40b1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:00.666 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:00.661+0000 7fa1d37fe700 1 --2- 172.21.15.71:0/2979855037 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa1d41595a0 0x7fa1d40b1f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:00.666 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:00.661+0000 7fa1d37fe700 1 -- 172.21.15.71:0/2979855037 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1d40ac340 msgr2=0x7fa1d4146100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:00.666 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:00.661+0000 7fa1d37fe700 1 --2- 172.21.15.71:0/2979855037 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1d40ac340 0x7fa1d4146100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:00.666 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:00.661+0000 7fa1d37fe700 1 -- 172.21.15.71:0/2979855037 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1c4009420 con 0x7fa1d41591d0 2023-10-06T01:40:00.666 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:00.661+0000 7fa1d37fe700 1 --2- 172.21.15.71:0/2979855037 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa1d41591d0 0x7fa1d4097760 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa1d406a890 tx=0x7fa1c4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:00.666 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:00.661+0000 7fa1bbfff700 1 -- 172.21.15.71:0/2979855037 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1c4000d10 con 0x7fa1d41591d0 2023-10-06T01:40:00.666 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:00.661+0000 7fa1bbfff700 1 -- 172.21.15.71:0/2979855037 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1c400bb20 con 0x7fa1d41591d0 2023-10-06T01:40:00.666 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:00.661+0000 7fa1bbfff700 1 -- 172.21.15.71:0/2979855037 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1c4011670 con 0x7fa1d41591d0 2023-10-06T01:40:00.666 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:00.661+0000 7fa1d9161700 1 -- 172.21.15.71:0/2979855037 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1d40987a0 con 0x7fa1d41591d0 2023-10-06T01:40:00.666 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:00.661+0000 7fa1d9161700 1 -- 172.21.15.71:0/2979855037 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1d4146640 con 0x7fa1d41591d0 2023-10-06T01:40:00.666 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:00.661+0000 7fa1bbfff700 1 -- 172.21.15.71:0/2979855037 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fa1c4011c60 con 0x7fa1d41591d0 2023-10-06T01:40:00.666 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:00.661+0000 7fa1bbfff700 1 -- 172.21.15.71:0/2979855037 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7fa1c402d3f0 con 0x7fa1d41591d0 2023-10-06T01:40:00.667 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:00.662+0000 7fa1d9161700 1 -- 172.21.15.71:0/2979855037 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1d4098f60 con 0x7fa1d41591d0 2023-10-06T01:40:00.667 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:00.665+0000 7fa1bbfff700 1 -- 172.21.15.71:0/2979855037 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fa1c40436d0 con 0x7fa1d41591d0 2023-10-06T01:40:00.702 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-06T01:40:00.701+0000 7f97a28b6180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-06T01:40:00.734 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:00.733+0000 7fa1d9161700 1 -- 172.21.15.71:0/2979855037 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa1d40704c0 con 0x7fa1d41591d0 2023-10-06T01:40:00.734 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:00.734+0000 7fa1bbfff700 1 -- 172.21.15.71:0/2979855037 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7fa1c4032070 con 0x7fa1d41591d0 2023-10-06T01:40:00.734 INFO:teuthology.misc.health.smithi071.stdout: 2023-10-06T01:40:00.735 INFO:teuthology.misc.health.smithi071.stdout:{"epoch":10,"fsid":"1fbf1bd2-f9b4-4599-bea2-f4aa920e9a56","created":"2023-10-06T01:39:57.016957+0000","modified":"2023-10-06T01:39:59.462741+0000","last_up_change":"0.000000","last_in_change":"2023-10-06T01:39:59.462741+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"cf059188-fb20-4dbf-95db-dcf57b213d03","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"0cff0aae-1799-4fe0-b610-54cf0813c0e1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"88d61ddc-9031-44e1-ba8c-546a41e7c8ce","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"11ed92b7-960b-4a30-a889-a61d3eeb86f0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"ae4df784-abdf-4ddf-aefa-780f3ddafef3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"5ef0790f-001e-458f-a05b-efae216cf435","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"8705aef1-9ae8-4e54-a3c4-c2909fa0ceb6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"364c5119-6b13-4c75-b3f0-15e165eff86a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:40:00.736 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:00.735+0000 7fa1d9161700 1 -- 172.21.15.71:0/2979855037 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa1d41591d0 msgr2=0x7fa1d4097760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:00.736 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:00.735+0000 7fa1d9161700 1 --2- 172.21.15.71:0/2979855037 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa1d41591d0 0x7fa1d4097760 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa1d406a890 tx=0x7fa1c4017000 comp rx=0 tx=0).stop 2023-10-06T01:40:00.736 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:00.735+0000 7fa1d9161700 1 -- 172.21.15.71:0/2979855037 shutdown_connections 2023-10-06T01:40:00.736 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:00.735+0000 7fa1d9161700 1 --2- 172.21.15.71:0/2979855037 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa1d41595a0 0x7fa1d40b1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:00.736 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:00.735+0000 7fa1d9161700 1 --2- 172.21.15.71:0/2979855037 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1d40ac340 0x7fa1d4146100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:00.736 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:00.735+0000 7fa1d9161700 1 --2- 172.21.15.71:0/2979855037 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa1d41591d0 0x7fa1d4097760 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:00.736 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:00.735+0000 7fa1d9161700 1 -- 172.21.15.71:0/2979855037 >> 172.21.15.71:0/2979855037 conn(0x7fa1d4096190 msgr2=0x7fa1d40afc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:00.736 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:00.735+0000 7fa1d9161700 1 -- 172.21.15.71:0/2979855037 shutdown_connections 2023-10-06T01:40:00.736 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:00.735+0000 7fa1d9161700 1 -- 172.21.15.71:0/2979855037 wait complete. 2023-10-06T01:40:00.747 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-06T01:40:00.878 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-06T01:40:00.877+0000 7f9794faa180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-06T01:40:00.949 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-06T01:40:00.948+0000 7f97a28b6180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-06T01:40:00.955 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-06T01:40:00.955+0000 7f9794faa180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-06T01:40:01.027 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-06T01:40:01.026+0000 7f97a28b6180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-06T01:40:01.801 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-06T01:40:01.800+0000 7f9794faa180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-06T01:40:01.851 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-06T01:40:01.850+0000 7f97a28b6180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-06T01:40:01.874 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-06T01:40:01.873+0000 7f9794faa180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-06T01:40:01.923 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-06T01:40:01.923+0000 7f97a28b6180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-06T01:40:01.948 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-06T01:40:01.948+0000 7f9794faa180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-06T01:40:01.997 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-06T01:40:01.996+0000 7f97a28b6180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-06T01:40:02.081 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-06T01:40:02.080+0000 7f9794faa180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-06T01:40:02.132 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-06T01:40:02.131+0000 7f97a28b6180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-06T01:40:02.164 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-06T01:40:02.164+0000 7f9794faa180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-06T01:40:02.215 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-06T01:40:02.215+0000 7f97a28b6180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-06T01:40:02.316 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-06T01:40:02.315+0000 7f9794faa180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-06T01:40:02.367 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-06T01:40:02.367+0000 7f97a28b6180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-06T01:40:02.391 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-06T01:40:02.390+0000 7f9794faa180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-06T01:40:02.442 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-06T01:40:02.442+0000 7f97a28b6180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-06T01:40:02.465 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-06T01:40:02.464+0000 7f9794faa180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-06T01:40:02.517 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-06T01:40:02.516+0000 7f97a28b6180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-06T01:40:02.539 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-06T01:40:02.538+0000 7f9794faa180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-06T01:40:02.600 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-06T01:40:02.599+0000 7f97a28b6180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-06T01:40:03.562 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-06T01:40:03.561+0000 7f974e3ab700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-10-06T01:40:03.566 INFO:tasks.ceph.mgr.y.smithi071.stderr:2023-10-06T01:40:03.566+0000 7f974e3ab700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-10-06T01:40:03.588 INFO:tasks.ceph.osd.6.smithi072.stderr:2023-10-06T01:40:03.588+0000 7f6b62769540 -1 osd.6 0 log_to_monitors true 2023-10-06T01:40:03.603 INFO:tasks.ceph.osd.0.smithi071.stderr:2023-10-06T01:40:03.602+0000 7faab87da540 -1 osd.0 0 log_to_monitors true 2023-10-06T01:40:03.620 INFO:tasks.ceph.osd.1.smithi071.stderr:2023-10-06T01:40:03.620+0000 7feb0cac9540 -1 osd.1 0 log_to_monitors true 2023-10-06T01:40:03.626 INFO:tasks.ceph.osd.3.smithi071.stderr:2023-10-06T01:40:03.626+0000 7f6cba587540 -1 osd.3 0 log_to_monitors true 2023-10-06T01:40:03.632 INFO:tasks.ceph.osd.2.smithi071.stderr:2023-10-06T01:40:03.631+0000 7fb49c4f2540 -1 osd.2 0 log_to_monitors true 2023-10-06T01:40:03.635 INFO:tasks.ceph.osd.4.smithi072.stderr:2023-10-06T01:40:03.635+0000 7fc69e22c540 -1 osd.4 0 log_to_monitors true 2023-10-06T01:40:03.658 INFO:tasks.ceph.osd.5.smithi072.stderr:2023-10-06T01:40:03.657+0000 7f99bcbd1540 -1 osd.5 0 log_to_monitors true 2023-10-06T01:40:03.658 INFO:tasks.ceph.osd.7.smithi072.stderr:2023-10-06T01:40:03.657+0000 7ff42ca49540 -1 osd.7 0 log_to_monitors true 2023-10-06T01:40:07.552 DEBUG:teuthology.orchestra.run.smithi071:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-06T01:40:07.566 INFO:tasks.ceph.osd.6.smithi072.stderr:2023-10-06T01:40:07.565+0000 7f6b5938b700 -1 osd.6 0 waiting for initial osdmap 2023-10-06T01:40:07.577 INFO:tasks.ceph.osd.6.smithi072.stderr:2023-10-06T01:40:07.576+0000 7f6b52182700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T01:40:07.608 INFO:tasks.ceph.osd.2.smithi071.stderr:2023-10-06T01:40:07.607+0000 7fb493114700 -1 osd.2 0 waiting for initial osdmap 2023-10-06T01:40:07.614 INFO:tasks.ceph.osd.7.smithi072.stderr:2023-10-06T01:40:07.613+0000 7ff42366b700 -1 osd.7 0 waiting for initial osdmap 2023-10-06T01:40:07.615 INFO:tasks.ceph.osd.2.smithi071.stderr:2023-10-06T01:40:07.615+0000 7fb48bf0b700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T01:40:07.623 INFO:tasks.ceph.osd.7.smithi072.stderr:2023-10-06T01:40:07.622+0000 7ff41c462700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T01:40:07.631 INFO:tasks.ceph.osd.1.smithi071.stderr:2023-10-06T01:40:07.630+0000 7feb036eb700 -1 osd.1 0 waiting for initial osdmap 2023-10-06T01:40:07.635 INFO:tasks.ceph.osd.4.smithi072.stderr:2023-10-06T01:40:07.635+0000 7fc694e4e700 -1 osd.4 0 waiting for initial osdmap 2023-10-06T01:40:07.638 INFO:tasks.ceph.osd.1.smithi071.stderr:2023-10-06T01:40:07.637+0000 7feafc4e2700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T01:40:07.639 INFO:tasks.ceph.osd.4.smithi072.stderr:2023-10-06T01:40:07.639+0000 7fc68dc45700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T01:40:07.641 INFO:tasks.ceph.osd.3.smithi071.stderr:2023-10-06T01:40:07.641+0000 7f6cb11a9700 -1 osd.3 0 waiting for initial osdmap 2023-10-06T01:40:07.646 INFO:tasks.ceph.osd.0.smithi071.stderr:2023-10-06T01:40:07.644+0000 7faaaf3fc700 -1 osd.0 0 waiting for initial osdmap 2023-10-06T01:40:07.646 INFO:tasks.ceph.osd.3.smithi071.stderr:2023-10-06T01:40:07.646+0000 7f6ca9fa0700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T01:40:07.649 INFO:tasks.ceph.osd.0.smithi071.stderr:2023-10-06T01:40:07.649+0000 7faaa81f3700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T01:40:07.724 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:07.723+0000 7fa8d5756700 1 Processor -- start 2023-10-06T01:40:07.724 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:07.723+0000 7fa8d5756700 1 -- start start 2023-10-06T01:40:07.726 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:07.724+0000 7fa8d5756700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa8d00caa30 0x7fa8d00cb130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:07.726 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:07.724+0000 7fa8d5756700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fa8d01566a0 0x7fa8d00cb670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:07.726 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:07.724+0000 7fa8d5756700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8d00c8460 con 0x7fa8d01562d0 2023-10-06T01:40:07.727 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:07.724+0000 7fa8d5756700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8d00ab2b0 con 0x7fa8d01566a0 2023-10-06T01:40:07.727 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:07.724+0000 7fa8d5756700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8d00ad220 con 0x7fa8d00caa30 2023-10-06T01:40:07.727 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:07.724+0000 7fa8d4f55700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fa8d01566a0 0x7fa8d00cb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:07.727 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:07.724+0000 7fa8d4f55700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fa8d01566a0 0x7fa8d00cb670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:54992/0 (socket says 172.21.15.71:54992) 2023-10-06T01:40:07.727 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:07.724+0000 7fa8d4f55700 1 -- 172.21.15.71:0/2592568409 learned_addr learned my addr 172.21.15.71:0/2592568409 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:07.727 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:07.724+0000 7fa8cf7fe700 1 --2- 172.21.15.71:0/2592568409 >> v2:172.21.15.72:3300/0 conn(0x7fa8d00caa30 0x7fa8d00cb130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:07.728 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:07.724+0000 7fa8d4f55700 1 -- 172.21.15.71:0/2592568409 >> v2:172.21.15.72:3300/0 conn(0x7fa8d00caa30 msgr2=0x7fa8d00cb130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:07.728 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:07.724+0000 7fa8d4f55700 1 --2- 172.21.15.71:0/2592568409 >> v2:172.21.15.72:3300/0 conn(0x7fa8d00caa30 0x7fa8d00cb130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:07.728 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:07.724+0000 7fa8d4f55700 1 -- 172.21.15.71:0/2592568409 >> v1:172.21.15.72:6789/0 conn(0x7fa8d01562d0 legacy=0x7fa8d00c7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:07.728 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:07.724+0000 7fa8d4f55700 1 -- 172.21.15.71:0/2592568409 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8d00ad500 con 0x7fa8d01566a0 2023-10-06T01:40:07.728 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:07.725+0000 7fa8d4f55700 1 --2- 172.21.15.71:0/2592568409 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8d01566a0 0x7fa8d00cb670 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa8d006f980 tx=0x7fa8c8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c917ad2e3e79f80e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:07.729 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:07.725+0000 7fa8ceffd700 1 -- 172.21.15.71:0/2592568409 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c800e070 con 0x7fa8d01566a0 2023-10-06T01:40:07.729 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:07.725+0000 7fa8ceffd700 1 -- 172.21.15.71:0/2592568409 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8c800ba20 con 0x7fa8d01566a0 2023-10-06T01:40:07.729 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:07.725+0000 7fa8ceffd700 1 -- 172.21.15.71:0/2592568409 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c80092e0 con 0x7fa8d01566a0 2023-10-06T01:40:07.729 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:07.725+0000 7fa8d5756700 1 -- 172.21.15.71:0/2592568409 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8d01566a0 msgr2=0x7fa8d00cb670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:07.729 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:07.725+0000 7fa8d5756700 1 --2- 172.21.15.71:0/2592568409 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8d01566a0 0x7fa8d00cb670 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa8d006f980 tx=0x7fa8c8009840 comp rx=0 tx=0).stop 2023-10-06T01:40:07.729 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:07.725+0000 7fa8d5756700 1 -- 172.21.15.71:0/2592568409 shutdown_connections 2023-10-06T01:40:07.729 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:07.725+0000 7fa8d5756700 1 --2- 172.21.15.71:0/2592568409 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8d01566a0 0x7fa8d00cb670 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:07.729 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:07.725+0000 7fa8d5756700 1 --2- 172.21.15.71:0/2592568409 >> v2:172.21.15.72:3300/0 conn(0x7fa8d00caa30 0x7fa8d00cb130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:07.729 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:07.725+0000 7fa8d5756700 1 -- 172.21.15.71:0/2592568409 >> 172.21.15.71:0/2592568409 conn(0x7fa8d00cbd90 msgr2=0x7fa8d00cc190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:07.729 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:07.725+0000 7fa8d5756700 1 -- 172.21.15.71:0/2592568409 shutdown_connections 2023-10-06T01:40:07.730 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:07.725+0000 7fa8d5756700 1 -- 172.21.15.71:0/2592568409 wait complete. 2023-10-06T01:40:07.732 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:07.726+0000 7fa8d5756700 1 Processor -- start 2023-10-06T01:40:07.732 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:07.726+0000 7fa8d5756700 1 -- start start 2023-10-06T01:40:07.732 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:07.727+0000 7fa8d5756700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa8d00caa30 0x7fa8d00afd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:07.733 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:07.727+0000 7fa8d5756700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8d01562d0 0x7fa8d0156b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:07.733 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:07.727+0000 7fa8d5756700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8d01566a0 0x7fa8d014fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:07.733 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:07.727+0000 7fa8d5756700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d0150ab0 con 0x7fa8d01566a0 2023-10-06T01:40:07.733 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:07.727+0000 7fa8d5756700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d0150480 con 0x7fa8d01562d0 2023-10-06T01:40:07.733 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:07.727+0000 7fa8d5756700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d00b0320 con 0x7fa8d00caa30 2023-10-06T01:40:07.733 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:07.727+0000 7fa8d4f55700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8d01566a0 0x7fa8d014fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:07.733 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:07.727+0000 7fa8d4f55700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8d01566a0 0x7fa8d014fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:55008/0 (socket says 172.21.15.71:55008) 2023-10-06T01:40:07.734 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:07.727+0000 7fa8d4f55700 1 -- 172.21.15.71:0/731775962 learned_addr learned my addr 172.21.15.71:0/731775962 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:07.734 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:07.727+0000 7fa8cffff700 1 --2- 172.21.15.71:0/731775962 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa8d00caa30 0x7fa8d00afd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:07.734 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:07.727+0000 7fa8cf7fe700 1 --2- 172.21.15.71:0/731775962 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8d01562d0 0x7fa8d0156b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:07.734 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:07.728+0000 7fa8d4f55700 1 -- 172.21.15.71:0/731775962 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa8d00caa30 msgr2=0x7fa8d00afd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:07.734 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:07.728+0000 7fa8d4f55700 1 --2- 172.21.15.71:0/731775962 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa8d00caa30 0x7fa8d00afd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:07.734 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:07.728+0000 7fa8d4f55700 1 -- 172.21.15.71:0/731775962 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8d01562d0 msgr2=0x7fa8d0156b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:07.734 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:07.728+0000 7fa8d4f55700 1 --2- 172.21.15.71:0/731775962 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8d01562d0 0x7fa8d0156b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:07.734 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:07.728+0000 7fa8d4f55700 1 -- 172.21.15.71:0/731775962 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8c8009ae0 con 0x7fa8d01566a0 2023-10-06T01:40:07.734 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:07.728+0000 7fa8d4f55700 1 --2- 172.21.15.71:0/731775962 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8d01566a0 0x7fa8d014fbb0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa8c80072f0 tx=0x7fa8c8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:07.734 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:07.728+0000 7fa8b7fff700 1 -- 172.21.15.71:0/731775962 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c8008a30 con 0x7fa8d01566a0 2023-10-06T01:40:07.734 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:07.728+0000 7fa8b7fff700 1 -- 172.21.15.71:0/731775962 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8c8008b90 con 0x7fa8d01566a0 2023-10-06T01:40:07.734 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:07.728+0000 7fa8d5756700 1 -- 172.21.15.71:0/731775962 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8d00b0600 con 0x7fa8d01566a0 2023-10-06T01:40:07.735 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:07.728+0000 7fa8b7fff700 1 -- 172.21.15.71:0/731775962 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c8025460 con 0x7fa8d01566a0 2023-10-06T01:40:07.735 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:07.728+0000 7fa8d5756700 1 -- 172.21.15.71:0/731775962 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8d0157090 con 0x7fa8d01566a0 2023-10-06T01:40:07.735 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:07.729+0000 7fa8d5756700 1 -- 172.21.15.71:0/731775962 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8d006fcb0 con 0x7fa8d01566a0 2023-10-06T01:40:07.735 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:07.729+0000 7fa8b7fff700 1 -- 172.21.15.71:0/731775962 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7fa8c8003040 con 0x7fa8d01566a0 2023-10-06T01:40:07.735 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:07.729+0000 7fa8b7fff700 1 --2- 172.21.15.71:0/731775962 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fa8bc066ea0 0x7fa8bc069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:07.735 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:07.730+0000 7fa8b7fff700 1 -- 172.21.15.71:0/731775962 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2227+0+0 (secure 0 0 0) 0x7fa8c80851d0 con 0x7fa8d01566a0 2023-10-06T01:40:07.735 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:07.730+0000 7fa8cffff700 1 --2- 172.21.15.71:0/731775962 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fa8bc066ea0 0x7fa8bc069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:07.735 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:07.730+0000 7fa8cffff700 1 --2- 172.21.15.71:0/731775962 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fa8bc066ea0 0x7fa8bc069350 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa8c0003a80 tx=0x7fa8c0007ec0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:07.736 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:07.734+0000 7fa8b7fff700 1 -- 172.21.15.71:0/731775962 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa8c80532b0 con 0x7fa8d01566a0 2023-10-06T01:40:07.759 INFO:tasks.ceph.osd.5.smithi072.stderr:2023-10-06T01:40:07.759+0000 7f99b4ff6700 -1 osd.5 0 waiting for initial osdmap 2023-10-06T01:40:07.764 INFO:tasks.ceph.osd.5.smithi072.stderr:2023-10-06T01:40:07.762+0000 7f99ac5ea700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T01:40:07.919 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:07.919+0000 7fa8d5756700 1 -- 172.21.15.71:0/731775962 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa8d0064ee0 con 0x7fa8d01566a0 2023-10-06T01:40:07.920 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:07.919+0000 7fa8b7fff700 1 -- 172.21.15.71:0/731775962 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7013 (secure 0 0 0) 0x7fa8c8008f30 con 0x7fa8d01566a0 2023-10-06T01:40:07.920 INFO:teuthology.misc.health.smithi071.stdout: 2023-10-06T01:40:07.920 INFO:teuthology.misc.health.smithi071.stdout:{"epoch":12,"fsid":"1fbf1bd2-f9b4-4599-bea2-f4aa920e9a56","created":"2023-10-06T01:39:57.016957+0000","modified":"2023-10-06T01:40:05.559886+0000","last_up_change":"0.000000","last_in_change":"2023-10-06T01:39:59.462741+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"cf059188-fb20-4dbf-95db-dcf57b213d03","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"0cff0aae-1799-4fe0-b610-54cf0813c0e1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"88d61ddc-9031-44e1-ba8c-546a41e7c8ce","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"11ed92b7-960b-4a30-a889-a61d3eeb86f0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"ae4df784-abdf-4ddf-aefa-780f3ddafef3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"5ef0790f-001e-458f-a05b-efae216cf435","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"8705aef1-9ae8-4e54-a3c4-c2909fa0ceb6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"364c5119-6b13-4c75-b3f0-15e165eff86a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:40:07.922 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:07.921+0000 7fa8d5756700 1 -- 172.21.15.71:0/731775962 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fa8bc066ea0 msgr2=0x7fa8bc069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:07.922 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:07.921+0000 7fa8d5756700 1 --2- 172.21.15.71:0/731775962 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fa8bc066ea0 0x7fa8bc069350 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa8c0003a80 tx=0x7fa8c0007ec0 comp rx=0 tx=0).stop 2023-10-06T01:40:07.922 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:07.921+0000 7fa8d5756700 1 -- 172.21.15.71:0/731775962 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8d01566a0 msgr2=0x7fa8d014fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:07.923 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:07.921+0000 7fa8d5756700 1 --2- 172.21.15.71:0/731775962 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8d01566a0 0x7fa8d014fbb0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa8c80072f0 tx=0x7fa8c8018000 comp rx=0 tx=0).stop 2023-10-06T01:40:07.923 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:07.921+0000 7fa8d5756700 1 -- 172.21.15.71:0/731775962 shutdown_connections 2023-10-06T01:40:07.923 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:07.921+0000 7fa8d5756700 1 --2- 172.21.15.71:0/731775962 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8d01566a0 0x7fa8d014fbb0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:07.923 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:07.921+0000 7fa8d5756700 1 --2- 172.21.15.71:0/731775962 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa8d00caa30 0x7fa8d00afd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:07.923 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:07.921+0000 7fa8d5756700 1 --2- 172.21.15.71:0/731775962 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fa8bc066ea0 0x7fa8bc069350 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:07.923 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:07.921+0000 7fa8d5756700 1 --2- 172.21.15.71:0/731775962 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8d01562d0 0x7fa8d0156b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:07.923 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:07.921+0000 7fa8d5756700 1 -- 172.21.15.71:0/731775962 >> 172.21.15.71:0/731775962 conn(0x7fa8d00cbd90 msgr2=0x7fa8d006e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:07.923 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:07.921+0000 7fa8d5756700 1 -- 172.21.15.71:0/731775962 shutdown_connections 2023-10-06T01:40:07.923 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:07.921+0000 7fa8d5756700 1 -- 172.21.15.71:0/731775962 wait complete. 2023-10-06T01:40:07.933 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-06T01:40:14.739 DEBUG:teuthology.orchestra.run.smithi071:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-06T01:40:14.856 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:14.855+0000 7f6cd189f700 1 Processor -- start 2023-10-06T01:40:14.856 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:14.855+0000 7f6cd189f700 1 -- start start 2023-10-06T01:40:14.858 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:14.856+0000 7f6cd189f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6ccc1556c0 0x7f6ccc155a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:14.858 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:14.856+0000 7f6cd189f700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f6ccc06b660 0x7f6ccc1594f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:14.859 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:14.856+0000 7f6cd189f700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ccc159a30 con 0x7f6ccc0c9b30 2023-10-06T01:40:14.859 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:14.856+0000 7f6cd189f700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ccc06bad0 con 0x7f6ccc06b660 2023-10-06T01:40:14.859 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:14.856+0000 7f6cd189f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ccc06a4f0 con 0x7f6ccc1556c0 2023-10-06T01:40:14.859 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:14.856+0000 7f6cca7fc700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f6ccc06b660 0x7f6ccc1594f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:14.859 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:14.856+0000 7f6cca7fc700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f6ccc06b660 0x7f6ccc1594f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:49394/0 (socket says 172.21.15.71:49394) 2023-10-06T01:40:14.859 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:14.856+0000 7f6cca7fc700 1 -- 172.21.15.71:0/1340762429 learned_addr learned my addr 172.21.15.71:0/1340762429 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:14.859 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:14.856+0000 7f6ccaffd700 1 --2- 172.21.15.71:0/1340762429 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6ccc1556c0 0x7f6ccc155a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:14.859 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:14.856+0000 7f6cca7fc700 1 -- 172.21.15.71:0/1340762429 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6ccc1556c0 msgr2=0x7f6ccc155a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:14.859 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:14.856+0000 7f6cca7fc700 1 --2- 172.21.15.71:0/1340762429 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6ccc1556c0 0x7f6ccc155a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:14.860 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:14.856+0000 7f6cca7fc700 1 -- 172.21.15.71:0/1340762429 >> v1:172.21.15.72:6789/0 conn(0x7f6ccc0c9b30 legacy=0x7f6ccc06a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:14.860 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:14.856+0000 7f6cca7fc700 1 -- 172.21.15.71:0/1340762429 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ccc159c60 con 0x7f6ccc06b660 2023-10-06T01:40:14.860 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:14.856+0000 7f6cca7fc700 1 --2- 172.21.15.71:0/1340762429 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ccc06b660 0x7f6ccc1594f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6cc00099b0 tx=0x7f6cc0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9cb752971c779fa server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:14.860 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:14.857+0000 7f6cc9ffb700 1 -- 172.21.15.71:0/1340762429 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc000b860 con 0x7f6ccc06b660 2023-10-06T01:40:14.860 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:14.857+0000 7f6cc9ffb700 1 -- 172.21.15.71:0/1340762429 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cc000b9c0 con 0x7f6ccc06b660 2023-10-06T01:40:14.860 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:14.857+0000 7f6cc9ffb700 1 -- 172.21.15.71:0/1340762429 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc000bd60 con 0x7f6ccc06b660 2023-10-06T01:40:14.860 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:14.857+0000 7f6cd189f700 1 -- 172.21.15.71:0/1340762429 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ccc06b660 msgr2=0x7f6ccc1594f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:14.860 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:14.857+0000 7f6cd189f700 1 --2- 172.21.15.71:0/1340762429 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ccc06b660 0x7f6ccc1594f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6cc00099b0 tx=0x7f6cc0009250 comp rx=0 tx=0).stop 2023-10-06T01:40:14.860 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:14.857+0000 7f6cd189f700 1 -- 172.21.15.71:0/1340762429 shutdown_connections 2023-10-06T01:40:14.861 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:14.857+0000 7f6cd189f700 1 --2- 172.21.15.71:0/1340762429 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6ccc1556c0 0x7f6ccc155a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:14.861 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:14.857+0000 7f6cd189f700 1 --2- 172.21.15.71:0/1340762429 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ccc06b660 0x7f6ccc1594f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:14.861 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:14.857+0000 7f6cd189f700 1 -- 172.21.15.71:0/1340762429 >> 172.21.15.71:0/1340762429 conn(0x7f6ccc069310 msgr2=0x7f6ccc0cbf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:14.861 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:14.857+0000 7f6cd189f700 1 -- 172.21.15.71:0/1340762429 shutdown_connections 2023-10-06T01:40:14.861 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:14.857+0000 7f6cd189f700 1 -- 172.21.15.71:0/1340762429 wait complete. 2023-10-06T01:40:14.864 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:14.858+0000 7f6cd189f700 1 Processor -- start 2023-10-06T01:40:14.864 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:14.858+0000 7f6cd189f700 1 -- start start 2023-10-06T01:40:14.864 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:14.859+0000 7f6cd189f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6ccc06b660 0x7f6ccc0c3010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:14.864 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:14.859+0000 7f6cd189f700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ccc0c9b30 0x7f6ccc168b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:14.865 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:14.859+0000 7f6cd189f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ccc1556c0 0x7f6ccc169070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:14.865 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:14.859+0000 7f6cd189f700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ccc0af050 con 0x7f6ccc0c9b30 2023-10-06T01:40:14.865 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:14.859+0000 7f6cd189f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ccc0c38b0 con 0x7f6ccc1556c0 2023-10-06T01:40:14.865 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:14.859+0000 7f6cd189f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ccc0b1550 con 0x7f6ccc06b660 2023-10-06T01:40:14.865 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:14.859+0000 7f6cca7fc700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ccc0c9b30 0x7f6ccc168b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:14.865 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:14.859+0000 7f6cca7fc700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ccc0c9b30 0x7f6ccc168b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:49396/0 (socket says 172.21.15.71:49396) 2023-10-06T01:40:14.865 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:14.859+0000 7f6cca7fc700 1 -- 172.21.15.71:0/1375097606 learned_addr learned my addr 172.21.15.71:0/1375097606 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:14.865 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:14.859+0000 7f6ccaffd700 1 --2- 172.21.15.71:0/1375097606 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6ccc06b660 0x7f6ccc0c3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:14.865 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:14.859+0000 7f6ccb7fe700 1 --2- 172.21.15.71:0/1375097606 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ccc1556c0 0x7f6ccc169070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:14.865 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:14.860+0000 7f6cca7fc700 1 -- 172.21.15.71:0/1375097606 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6ccc06b660 msgr2=0x7f6ccc0c3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:14.866 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:14.860+0000 7f6cca7fc700 1 --2- 172.21.15.71:0/1375097606 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6ccc06b660 0x7f6ccc0c3010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:14.866 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:14.860+0000 7f6cca7fc700 1 -- 172.21.15.71:0/1375097606 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ccc1556c0 msgr2=0x7f6ccc169070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:14.866 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:14.860+0000 7f6cca7fc700 1 --2- 172.21.15.71:0/1375097606 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ccc1556c0 0x7f6ccc169070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:14.866 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:14.860+0000 7f6cca7fc700 1 -- 172.21.15.71:0/1375097606 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cc00094f0 con 0x7f6ccc0c9b30 2023-10-06T01:40:14.866 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:14.860+0000 7f6cca7fc700 1 --2- 172.21.15.71:0/1375097606 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ccc0c9b30 0x7f6ccc168b30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc06d8b0 tx=0x7f6cc0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:14.866 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:14.860+0000 7f6cb2ffd700 1 -- 172.21.15.71:0/1375097606 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc0011e40 con 0x7f6ccc0c9b30 2023-10-06T01:40:14.866 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:14.860+0000 7f6cb2ffd700 1 -- 172.21.15.71:0/1375097606 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cc0024440 con 0x7f6ccc0c9b30 2023-10-06T01:40:14.866 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:14.860+0000 7f6cd189f700 1 -- 172.21.15.71:0/1375097606 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ccc0b1830 con 0x7f6ccc0c9b30 2023-10-06T01:40:14.866 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:14.860+0000 7f6cb2ffd700 1 -- 172.21.15.71:0/1375097606 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc0024800 con 0x7f6ccc0c9b30 2023-10-06T01:40:14.867 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:14.860+0000 7f6cd189f700 1 -- 172.21.15.71:0/1375097606 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ccc152760 con 0x7f6ccc0c9b30 2023-10-06T01:40:14.867 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:14.861+0000 7f6cd189f700 1 -- 172.21.15.71:0/1375097606 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ccc04c3c0 con 0x7f6ccc0c9b30 2023-10-06T01:40:14.867 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:14.861+0000 7f6cb2ffd700 1 -- 172.21.15.71:0/1375097606 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6cc001a420 con 0x7f6ccc0c9b30 2023-10-06T01:40:14.867 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:14.862+0000 7f6cb2ffd700 1 --2- 172.21.15.71:0/1375097606 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f6cb8066f30 0x7f6cb80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:14.867 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:14.862+0000 7f6cb2ffd700 1 -- 172.21.15.71:0/1375097606 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f6cc0086020 con 0x7f6ccc0c9b30 2023-10-06T01:40:14.867 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:14.862+0000 7f6ccaffd700 1 --2- 172.21.15.71:0/1375097606 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f6cb8066f30 0x7f6cb80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:14.867 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:14.862+0000 7f6ccaffd700 1 --2- 172.21.15.71:0/1375097606 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f6cb8066f30 0x7f6cb80693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc0075a0 tx=0x7f6cbc0097e0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:14.868 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:14.866+0000 7f6cb2ffd700 1 -- 172.21.15.71:0/1375097606 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6cc00535e0 con 0x7f6ccc0c9b30 2023-10-06T01:40:15.051 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:15.050+0000 7f6cd189f700 1 -- 172.21.15.71:0/1375097606 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6ccc159f40 con 0x7f6ccc0c9b30 2023-10-06T01:40:15.052 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:15.051+0000 7f6cb2ffd700 1 -- 172.21.15.71:0/1375097606 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12079 (secure 0 0 0) 0x7f6cc0056c00 con 0x7f6ccc0c9b30 2023-10-06T01:40:15.052 INFO:teuthology.misc.health.smithi071.stdout: 2023-10-06T01:40:15.052 INFO:teuthology.misc.health.smithi071.stdout:{"epoch":16,"fsid":"1fbf1bd2-f9b4-4599-bea2-f4aa920e9a56","created":"2023-10-06T01:39:57.016957+0000","modified":"2023-10-06T01:40:11.599188+0000","last_up_change":"2023-10-06T01:40:08.571643+0000","last_in_change":"2023-10-06T01:39:59.462741+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T01:40:08.610349+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"cf059188-fb20-4dbf-95db-dcf57b213d03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":90670},{"type":"v1","addr":"172.21.15.71:6817","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":90670},{"type":"v1","addr":"172.21.15.71:6819","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":90670},{"type":"v1","addr":"172.21.15.71:6823","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":90670},{"type":"v1","addr":"172.21.15.71:6821","nonce":90670}]},"public_addr":"172.21.15.71:6817/90670","cluster_addr":"172.21.15.71:6819/90670","heartbeat_back_addr":"172.21.15.71:6823/90670","heartbeat_front_addr":"172.21.15.71:6821/90670","state":["exists","up"]},{"osd":1,"uuid":"0cff0aae-1799-4fe0-b610-54cf0813c0e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":90669},{"type":"v1","addr":"172.21.15.71:6809","nonce":90669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":90669},{"type":"v1","addr":"172.21.15.71:6811","nonce":90669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":90669},{"type":"v1","addr":"172.21.15.71:6815","nonce":90669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":90669},{"type":"v1","addr":"172.21.15.71:6813","nonce":90669}]},"public_addr":"172.21.15.71:6809/90669","cluster_addr":"172.21.15.71:6811/90669","heartbeat_back_addr":"172.21.15.71:6815/90669","heartbeat_front_addr":"172.21.15.71:6813/90669","state":["exists","up"]},{"osd":2,"uuid":"88d61ddc-9031-44e1-ba8c-546a41e7c8ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":90679},{"type":"v1","addr":"172.21.15.71:6825","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":90679},{"type":"v1","addr":"172.21.15.71:6827","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":90679},{"type":"v1","addr":"172.21.15.71:6831","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":90679},{"type":"v1","addr":"172.21.15.71:6829","nonce":90679}]},"public_addr":"172.21.15.71:6825/90679","cluster_addr":"172.21.15.71:6827/90679","heartbeat_back_addr":"172.21.15.71:6831/90679","heartbeat_front_addr":"172.21.15.71:6829/90679","state":["exists","up"]},{"osd":3,"uuid":"11ed92b7-960b-4a30-a889-a61d3eeb86f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":90668},{"type":"v1","addr":"172.21.15.71:6801","nonce":90668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":90668},{"type":"v1","addr":"172.21.15.71:6803","nonce":90668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":90668},{"type":"v1","addr":"172.21.15.71:6807","nonce":90668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":90668},{"type":"v1","addr":"172.21.15.71:6805","nonce":90668}]},"public_addr":"172.21.15.71:6801/90668","cluster_addr":"172.21.15.71:6803/90668","heartbeat_back_addr":"172.21.15.71:6807/90668","heartbeat_front_addr":"172.21.15.71:6805/90668","state":["exists","up"]},{"osd":4,"uuid":"ae4df784-abdf-4ddf-aefa-780f3ddafef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":90917},{"type":"v1","addr":"172.21.15.72:6801","nonce":90917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":90917},{"type":"v1","addr":"172.21.15.72:6803","nonce":90917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":90917},{"type":"v1","addr":"172.21.15.72:6807","nonce":90917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":90917},{"type":"v1","addr":"172.21.15.72:6805","nonce":90917}]},"public_addr":"172.21.15.72:6801/90917","cluster_addr":"172.21.15.72:6803/90917","heartbeat_back_addr":"172.21.15.72:6807/90917","heartbeat_front_addr":"172.21.15.72:6805/90917","state":["exists","up"]},{"osd":5,"uuid":"5ef0790f-001e-458f-a05b-efae216cf435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":90941},{"type":"v1","addr":"172.21.15.72:6817","nonce":90941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":90941},{"type":"v1","addr":"172.21.15.72:6819","nonce":90941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":90941},{"type":"v1","addr":"172.21.15.72:6827","nonce":90941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":90941},{"type":"v1","addr":"172.21.15.72:6823","nonce":90941}]},"public_addr":"172.21.15.72:6817/90941","cluster_addr":"172.21.15.72:6819/90941","heartbeat_back_addr":"172.21.15.72:6827/90941","heartbeat_front_addr":"172.21.15.72:6823/90941","state":["exists","up"]},{"osd":6,"uuid":"8705aef1-9ae8-4e54-a3c4-c2909fa0ceb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":90918},{"type":"v1","addr":"172.21.15.72:6809","nonce":90918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":90918},{"type":"v1","addr":"172.21.15.72:6811","nonce":90918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":90918},{"type":"v1","addr":"172.21.15.72:6815","nonce":90918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":90918},{"type":"v1","addr":"172.21.15.72:6813","nonce":90918}]},"public_addr":"172.21.15.72:6809/90918","cluster_addr":"172.21.15.72:6811/90918","heartbeat_back_addr":"172.21.15.72:6815/90918","heartbeat_front_addr":"172.21.15.72:6813/90918","state":["exists","up"]},{"osd":7,"uuid":"364c5119-6b13-4c75-b3f0-15e165eff86a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":90948},{"type":"v1","addr":"172.21.15.72:6822","nonce":90948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":90948},{"type":"v1","addr":"172.21.15.72:6826","nonce":90948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":90948},{"type":"v1","addr":"172.21.15.72:6831","nonce":90948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":90948},{"type":"v1","addr":"172.21.15.72:6829","nonce":90948}]},"public_addr":"172.21.15.72:6822/90948","cluster_addr":"172.21.15.72:6826/90948","heartbeat_back_addr":"172.21.15.72:6831/90948","heartbeat_front_addr":"172.21.15.72:6829/90948","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.642976+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.645372+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.619116+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.663042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.599163+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.646411+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.631545+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.669821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:40:15.055 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:15.053+0000 7f6cd189f700 1 -- 172.21.15.71:0/1375097606 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f6cb8066f30 msgr2=0x7f6cb80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:15.055 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:15.053+0000 7f6cd189f700 1 --2- 172.21.15.71:0/1375097606 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f6cb8066f30 0x7f6cb80693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc0075a0 tx=0x7f6cbc0097e0 comp rx=0 tx=0).stop 2023-10-06T01:40:15.055 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:15.053+0000 7f6cd189f700 1 -- 172.21.15.71:0/1375097606 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ccc0c9b30 msgr2=0x7f6ccc168b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:15.055 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:15.053+0000 7f6cd189f700 1 --2- 172.21.15.71:0/1375097606 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ccc0c9b30 0x7f6ccc168b30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc06d8b0 tx=0x7f6cc0017000 comp rx=0 tx=0).stop 2023-10-06T01:40:15.055 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:15.053+0000 7f6cd189f700 1 -- 172.21.15.71:0/1375097606 shutdown_connections 2023-10-06T01:40:15.055 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:15.053+0000 7f6cd189f700 1 --2- 172.21.15.71:0/1375097606 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f6cb8066f30 0x7f6cb80693e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:15.055 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:15.053+0000 7f6cd189f700 1 --2- 172.21.15.71:0/1375097606 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ccc1556c0 0x7f6ccc169070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:15.056 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:15.053+0000 7f6cd189f700 1 --2- 172.21.15.71:0/1375097606 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6ccc06b660 0x7f6ccc0c3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:15.056 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:15.053+0000 7f6cd189f700 1 --2- 172.21.15.71:0/1375097606 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ccc0c9b30 0x7f6ccc168b30 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:15.056 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:15.053+0000 7f6cd189f700 1 -- 172.21.15.71:0/1375097606 >> 172.21.15.71:0/1375097606 conn(0x7f6ccc069310 msgr2=0x7f6ccc0cace0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:15.056 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:15.053+0000 7f6cd189f700 1 -- 172.21.15.71:0/1375097606 shutdown_connections 2023-10-06T01:40:15.056 INFO:teuthology.misc.health.smithi071.stderr:2023-10-06T01:40:15.053+0000 7f6cd189f700 1 -- 172.21.15.71:0/1375097606 wait complete. 2023-10-06T01:40:15.065 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-10-06T01:40:15.065 INFO:tasks.ceph:Creating RBD pool 2023-10-06T01:40:15.065 DEBUG:teuthology.orchestra.run.smithi071:> sudo ceph --cluster ceph osd pool create rbd 8 2023-10-06T01:40:15.180 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.179+0000 7fb726ad0700 1 Processor -- start 2023-10-06T01:40:15.180 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.179+0000 7fb726ad0700 1 -- start start 2023-10-06T01:40:15.182 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.180+0000 7fb726ad0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb7200afc10 0x7fb7200aea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:15.182 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.180+0000 7fb726ad0700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb720157380 0x7fb7200aef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:15.182 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.180+0000 7fb726ad0700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7200c9940 con 0x7fb720156fb0 2023-10-06T01:40:15.183 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.180+0000 7fb726ad0700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7200b0140 con 0x7fb720157380 2023-10-06T01:40:15.183 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.180+0000 7fb726ad0700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7200b0420 con 0x7fb7200afc10 2023-10-06T01:40:15.183 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.180+0000 7fb7252cd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb7200afc10 0x7fb7200aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:15.183 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.180+0000 7fb7262cf700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb720157380 0x7fb7200aef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:15.183 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.180+0000 7fb7252cd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb7200afc10 0x7fb7200aea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.71:42226/0 (socket says 172.21.15.71:42226) 2023-10-06T01:40:15.183 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.180+0000 7fb7262cf700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb720157380 0x7fb7200aef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:55184/0 (socket says 172.21.15.71:55184) 2023-10-06T01:40:15.183 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.180+0000 7fb7252cd700 1 -- 172.21.15.71:0/3172564669 learned_addr learned my addr 172.21.15.71:0/3172564669 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:15.183 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.180+0000 7fb725ace700 1 --1- 172.21.15.71:0/3172564669 >> v1:172.21.15.72:6789/0 conn(0x7fb720156fb0 0x7fb7200c9230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.71:39610/0 (socket says 172.21.15.71:39610) 2023-10-06T01:40:15.183 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.181+0000 7fb7252cd700 1 -- 172.21.15.71:0/3172564669 >> v2:172.21.15.72:3300/0 conn(0x7fb720157380 msgr2=0x7fb7200aef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:15.183 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.181+0000 7fb7252cd700 1 --2- 172.21.15.71:0/3172564669 >> v2:172.21.15.72:3300/0 conn(0x7fb720157380 0x7fb7200aef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:15.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.181+0000 7fb7252cd700 1 -- 172.21.15.71:0/3172564669 >> v1:172.21.15.72:6789/0 conn(0x7fb720156fb0 legacy=0x7fb7200c9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:15.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.181+0000 7fb7252cd700 1 -- 172.21.15.71:0/3172564669 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7200b0700 con 0x7fb7200afc10 2023-10-06T01:40:15.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.181+0000 7fb7262cf700 1 --2- 172.21.15.71:0/3172564669 >> v2:172.21.15.72:3300/0 conn(0x7fb720157380 0x7fb7200aef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:40:15.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.181+0000 7fb7252cd700 1 --2- 172.21.15.71:0/3172564669 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb7200afc10 0x7fb7200aea20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb7100099b0 tx=0x7fb710009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e04f8d658c76a9a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:15.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.181+0000 7fb724acc700 1 -- 172.21.15.71:0/3172564669 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb710009ea0 con 0x7fb7200afc10 2023-10-06T01:40:15.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.181+0000 7fb724acc700 1 -- 172.21.15.71:0/3172564669 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb71000b860 con 0x7fb7200afc10 2023-10-06T01:40:15.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.181+0000 7fb724acc700 1 -- 172.21.15.71:0/3172564669 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb71000bc00 con 0x7fb7200afc10 2023-10-06T01:40:15.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.181+0000 7fb726ad0700 1 -- 172.21.15.71:0/3172564669 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb7200afc10 msgr2=0x7fb7200aea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:15.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.181+0000 7fb726ad0700 1 --2- 172.21.15.71:0/3172564669 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb7200afc10 0x7fb7200aea20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb7100099b0 tx=0x7fb710009250 comp rx=0 tx=0).stop 2023-10-06T01:40:15.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.181+0000 7fb726ad0700 1 -- 172.21.15.71:0/3172564669 shutdown_connections 2023-10-06T01:40:15.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.181+0000 7fb726ad0700 1 --2- 172.21.15.71:0/3172564669 >> v2:172.21.15.72:3300/0 conn(0x7fb720157380 0x7fb7200aef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:15.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.181+0000 7fb726ad0700 1 --2- 172.21.15.71:0/3172564669 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb7200afc10 0x7fb7200aea20 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:15.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.181+0000 7fb726ad0700 1 -- 172.21.15.71:0/3172564669 >> 172.21.15.71:0/3172564669 conn(0x7fb720096200 msgr2=0x7fb720069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:15.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.182+0000 7fb726ad0700 1 -- 172.21.15.71:0/3172564669 shutdown_connections 2023-10-06T01:40:15.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.182+0000 7fb726ad0700 1 -- 172.21.15.71:0/3172564669 wait complete. 2023-10-06T01:40:15.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.183+0000 7fb726ad0700 1 Processor -- start 2023-10-06T01:40:15.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.183+0000 7fb726ad0700 1 -- start start 2023-10-06T01:40:15.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.183+0000 7fb726ad0700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb7200afc10 0x7fb720153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:15.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.183+0000 7fb726ad0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb720156fb0 0x7fb7200cc7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:15.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.183+0000 7fb726ad0700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb720157380 0x7fb7200a7d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:15.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.183+0000 7fb726ad0700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7200cb4c0 con 0x7fb7200afc10 2023-10-06T01:40:15.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.183+0000 7fb726ad0700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7200cc320 con 0x7fb720157380 2023-10-06T01:40:15.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.183+0000 7fb726ad0700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb720154870 con 0x7fb720156fb0 2023-10-06T01:40:15.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.183+0000 7fb725ace700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb7200afc10 0x7fb720153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:15.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.183+0000 7fb725ace700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb7200afc10 0x7fb720153cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:49410/0 (socket says 172.21.15.71:49410) 2023-10-06T01:40:15.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.183+0000 7fb725ace700 1 -- 172.21.15.71:0/1320888620 learned_addr learned my addr 172.21.15.71:0/1320888620 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:15.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.184+0000 7fb7252cd700 1 --2- 172.21.15.71:0/1320888620 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb720156fb0 0x7fb7200cc7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:15.189 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.184+0000 7fb7262cf700 1 --2- 172.21.15.71:0/1320888620 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb720157380 0x7fb7200a7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:15.189 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.184+0000 7fb725ace700 1 -- 172.21.15.71:0/1320888620 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb720156fb0 msgr2=0x7fb7200cc7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:15.189 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.184+0000 7fb725ace700 1 --2- 172.21.15.71:0/1320888620 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb720156fb0 0x7fb7200cc7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:15.189 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.184+0000 7fb725ace700 1 -- 172.21.15.71:0/1320888620 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb720157380 msgr2=0x7fb7200a7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:15.189 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.184+0000 7fb725ace700 1 --2- 172.21.15.71:0/1320888620 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb720157380 0x7fb7200a7d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:15.189 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.184+0000 7fb725ace700 1 -- 172.21.15.71:0/1320888620 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb718009a20 con 0x7fb7200afc10 2023-10-06T01:40:15.189 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.184+0000 7fb725ace700 1 --2- 172.21.15.71:0/1320888620 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb7200afc10 0x7fb720153cd0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb71c00c7f0 tx=0x7fb71c007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:15.189 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.184+0000 7fb715ffb700 1 -- 172.21.15.71:0/1320888620 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb71c005a70 con 0x7fb7200afc10 2023-10-06T01:40:15.189 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.184+0000 7fb715ffb700 1 -- 172.21.15.71:0/1320888620 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb71c005bf0 con 0x7fb7200afc10 2023-10-06T01:40:15.189 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.184+0000 7fb726ad0700 1 -- 172.21.15.71:0/1320888620 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7100094f0 con 0x7fb7200afc10 2023-10-06T01:40:15.189 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.184+0000 7fb715ffb700 1 -- 172.21.15.71:0/1320888620 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb71c0070f0 con 0x7fb7200afc10 2023-10-06T01:40:15.189 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.184+0000 7fb726ad0700 1 -- 172.21.15.71:0/1320888620 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7200cba70 con 0x7fb7200afc10 2023-10-06T01:40:15.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.185+0000 7fb726ad0700 1 -- 172.21.15.71:0/1320888620 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7200cc600 con 0x7fb7200afc10 2023-10-06T01:40:15.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.186+0000 7fb715ffb700 1 -- 172.21.15.71:0/1320888620 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb71c0074a0 con 0x7fb7200afc10 2023-10-06T01:40:15.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.186+0000 7fb715ffb700 1 --2- 172.21.15.71:0/1320888620 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fb704066fb0 0x7fb704069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:15.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.186+0000 7fb715ffb700 1 -- 172.21.15.71:0/1320888620 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fb71c083cd0 con 0x7fb7200afc10 2023-10-06T01:40:15.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.186+0000 7fb7252cd700 1 --2- 172.21.15.71:0/1320888620 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fb704066fb0 0x7fb704069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:15.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.187+0000 7fb7252cd700 1 --2- 172.21.15.71:0/1320888620 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fb704066fb0 0x7fb704069460 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb7100099b0 tx=0x7fb710017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:15.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.190+0000 7fb715ffb700 1 -- 172.21.15.71:0/1320888620 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb71c089020 con 0x7fb7200afc10 2023-10-06T01:40:15.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.370+0000 7fb726ad0700 1 -- 172.21.15.71:0/1320888620 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7fb720064ad0 con 0x7fb7200afc10 2023-10-06T01:40:15.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.636+0000 7fb715ffb700 1 -- 172.21.15.71:0/1320888620 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v17) v1 ==== 109+0+0 (secure 0 0 0) 0x7fb71c051270 con 0x7fb7200afc10 2023-10-06T01:40:15.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.639+0000 7fb726ad0700 1 -- 172.21.15.71:0/1320888620 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fb704066fb0 msgr2=0x7fb704069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:15.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.639+0000 7fb726ad0700 1 --2- 172.21.15.71:0/1320888620 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fb704066fb0 0x7fb704069460 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb7100099b0 tx=0x7fb710017000 comp rx=0 tx=0).stop 2023-10-06T01:40:15.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.639+0000 7fb726ad0700 1 -- 172.21.15.71:0/1320888620 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb7200afc10 msgr2=0x7fb720153cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:15.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.639+0000 7fb726ad0700 1 --2- 172.21.15.71:0/1320888620 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb7200afc10 0x7fb720153cd0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb71c00c7f0 tx=0x7fb71c007f70 comp rx=0 tx=0).stop 2023-10-06T01:40:15.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.639+0000 7fb726ad0700 1 -- 172.21.15.71:0/1320888620 shutdown_connections 2023-10-06T01:40:15.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.639+0000 7fb726ad0700 1 --2- 172.21.15.71:0/1320888620 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fb704066fb0 0x7fb704069460 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:15.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.639+0000 7fb726ad0700 1 --2- 172.21.15.71:0/1320888620 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb720157380 0x7fb7200a7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:15.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.639+0000 7fb726ad0700 1 --2- 172.21.15.71:0/1320888620 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb7200afc10 0x7fb720153cd0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:15.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.639+0000 7fb726ad0700 1 --2- 172.21.15.71:0/1320888620 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb720156fb0 0x7fb7200cc7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:15.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.639+0000 7fb726ad0700 1 -- 172.21.15.71:0/1320888620 >> 172.21.15.71:0/1320888620 conn(0x7fb720096200 msgr2=0x7fb720159f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:15.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.640+0000 7fb726ad0700 1 -- 172.21.15.71:0/1320888620 shutdown_connections 2023-10-06T01:40:15.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.640+0000 7fb726ad0700 1 -- 172.21.15.71:0/1320888620 wait complete. 2023-10-06T01:40:15.642 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'rbd' created 2023-10-06T01:40:15.652 DEBUG:teuthology.orchestra.run.smithi071:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-10-06T01:40:15.767 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.766+0000 7fd68cca2700 1 Processor -- start 2023-10-06T01:40:15.767 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.766+0000 7fd68cca2700 1 -- start start 2023-10-06T01:40:15.770 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.767+0000 7fd68cca2700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd68815ab20 0x7fd6880b1590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:15.770 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.767+0000 7fd68cca2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd6880b1ad0 0x7fd6880aea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:15.770 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.767+0000 7fd68cca2700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd688067fa0 con 0x7fd68815a750 2023-10-06T01:40:15.770 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.767+0000 7fd68cca2700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd688097f20 con 0x7fd68815ab20 2023-10-06T01:40:15.771 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.767+0000 7fd68cca2700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6880b0a40 con 0x7fd6880b1ad0 2023-10-06T01:40:15.771 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.767+0000 7fd68659c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fd68815a750 0x7fd6880b0e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:54572/0 (socket says 172.21.15.71:54572) 2023-10-06T01:40:15.771 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.767+0000 7fd67dd9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd68815ab20 0x7fd6880b1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:15.771 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.767+0000 7fd68659c700 1 -- 172.21.15.71:0/3267653787 learned_addr learned my addr 172.21.15.71:0/3267653787 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:40:15.771 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.768+0000 7fd686d9d700 1 --2- 172.21.15.71:0/3267653787 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd6880b1ad0 0x7fd6880aea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:15.771 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.768+0000 7fd67dd9b700 1 -- 172.21.15.71:0/3267653787 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd6880b1ad0 msgr2=0x7fd6880aea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:15.771 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.768+0000 7fd67dd9b700 1 --2- 172.21.15.71:0/3267653787 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd6880b1ad0 0x7fd6880aea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:15.771 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.768+0000 7fd67dd9b700 1 -- 172.21.15.71:0/3267653787 >> v1:172.21.15.71:6789/0 conn(0x7fd68815a750 legacy=0x7fd6880b0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:15.771 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.768+0000 7fd685d9b700 1 -- 172.21.15.71:0/3267653787 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1196368331 0 0) 0x7fd688067fa0 con 0x7fd68815a750 2023-10-06T01:40:15.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.768+0000 7fd67dd9b700 1 -- 172.21.15.71:0/3267653787 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6880b01a0 con 0x7fd68815ab20 2023-10-06T01:40:15.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.768+0000 7fd67dd9b700 1 --2- 172.21.15.71:0/3267653787 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd68815ab20 0x7fd6880b1590 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd6700098e0 tx=0x7fd6700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11c8f7bb7adce298 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:15.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.768+0000 7fd685d9b700 1 -- 172.21.15.71:0/3267653787 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd670009e80 con 0x7fd68815ab20 2023-10-06T01:40:15.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.768+0000 7fd685d9b700 1 -- 172.21.15.71:0/3267653787 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd67000b860 con 0x7fd68815ab20 2023-10-06T01:40:15.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.768+0000 7fd685d9b700 1 -- 172.21.15.71:0/3267653787 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd67000bbe0 con 0x7fd68815ab20 2023-10-06T01:40:15.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.768+0000 7fd68cca2700 1 -- 172.21.15.71:0/3267653787 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd68815ab20 msgr2=0x7fd6880b1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:15.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.768+0000 7fd68cca2700 1 --2- 172.21.15.71:0/3267653787 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd68815ab20 0x7fd6880b1590 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd6700098e0 tx=0x7fd6700091a0 comp rx=0 tx=0).stop 2023-10-06T01:40:15.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.768+0000 7fd68cca2700 1 -- 172.21.15.71:0/3267653787 shutdown_connections 2023-10-06T01:40:15.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.768+0000 7fd68cca2700 1 --2- 172.21.15.71:0/3267653787 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd6880b1ad0 0x7fd6880aea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:15.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.768+0000 7fd68cca2700 1 --2- 172.21.15.71:0/3267653787 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd68815ab20 0x7fd6880b1590 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:15.773 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.768+0000 7fd68cca2700 1 -- 172.21.15.71:0/3267653787 >> 172.21.15.71:0/3267653787 conn(0x7fd688067910 msgr2=0x7fd6880ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:15.773 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.769+0000 7fd68cca2700 1 -- 172.21.15.71:0/3267653787 shutdown_connections 2023-10-06T01:40:15.773 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.769+0000 7fd68cca2700 1 -- 172.21.15.71:0/3267653787 wait complete. 2023-10-06T01:40:15.773 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.770+0000 7fd68cca2700 1 Processor -- start 2023-10-06T01:40:15.773 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.770+0000 7fd68cca2700 1 -- start start 2023-10-06T01:40:15.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.770+0000 7fd68cca2700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6880b1ad0 0x7fd6881513d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:15.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.770+0000 7fd68cca2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd68815a750 0x7fd688153a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:15.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.770+0000 7fd68cca2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd68815ab20 0x7fd68809a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:15.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.770+0000 7fd68cca2700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd688151910 con 0x7fd6880b1ad0 2023-10-06T01:40:15.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.770+0000 7fd68cca2700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6881674f0 con 0x7fd68815ab20 2023-10-06T01:40:15.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.770+0000 7fd68cca2700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd68815b540 con 0x7fd68815a750 2023-10-06T01:40:15.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.771+0000 7fd68659c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6880b1ad0 0x7fd6881513d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:15.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.771+0000 7fd68659c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6880b1ad0 0x7fd6881513d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:49430/0 (socket says 172.21.15.71:49430) 2023-10-06T01:40:15.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.771+0000 7fd68659c700 1 -- 172.21.15.71:0/1128576082 learned_addr learned my addr 172.21.15.71:0/1128576082 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:15.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.771+0000 7fd67dd9b700 1 --2- 172.21.15.71:0/1128576082 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd68815a750 0x7fd688153a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:15.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.771+0000 7fd686d9d700 1 --2- 172.21.15.71:0/1128576082 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd68815ab20 0x7fd68809a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:15.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.771+0000 7fd68659c700 1 -- 172.21.15.71:0/1128576082 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd68815a750 msgr2=0x7fd688153a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:15.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.771+0000 7fd68659c700 1 --2- 172.21.15.71:0/1128576082 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd68815a750 0x7fd688153a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:15.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.771+0000 7fd68659c700 1 -- 172.21.15.71:0/1128576082 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd68815ab20 msgr2=0x7fd68809a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:15.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.771+0000 7fd68659c700 1 --2- 172.21.15.71:0/1128576082 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd68815ab20 0x7fd68809a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:15.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.771+0000 7fd68659c700 1 -- 172.21.15.71:0/1128576082 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd670009420 con 0x7fd6880b1ad0 2023-10-06T01:40:15.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.771+0000 7fd68659c700 1 --2- 172.21.15.71:0/1128576082 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6880b1ad0 0x7fd6881513d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd67800c7e0 tx=0x7fd678007c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:15.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.771+0000 7fd67effd700 1 -- 172.21.15.71:0/1128576082 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6780072e0 con 0x7fd6880b1ad0 2023-10-06T01:40:15.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.771+0000 7fd67effd700 1 -- 172.21.15.71:0/1128576082 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd678007460 con 0x7fd6880b1ad0 2023-10-06T01:40:15.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.771+0000 7fd68cca2700 1 -- 172.21.15.71:0/1128576082 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd68815b820 con 0x7fd6880b1ad0 2023-10-06T01:40:15.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.771+0000 7fd67effd700 1 -- 172.21.15.71:0/1128576082 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6780057f0 con 0x7fd6880b1ad0 2023-10-06T01:40:15.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.771+0000 7fd68cca2700 1 -- 172.21.15.71:0/1128576082 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd68815bde0 con 0x7fd6880b1ad0 2023-10-06T01:40:15.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.772+0000 7fd68cca2700 1 -- 172.21.15.71:0/1128576082 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6880b0480 con 0x7fd6880b1ad0 2023-10-06T01:40:15.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.772+0000 7fd67effd700 1 -- 172.21.15.71:0/1128576082 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd678005b60 con 0x7fd6880b1ad0 2023-10-06T01:40:15.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.773+0000 7fd67effd700 1 --2- 172.21.15.71:0/1128576082 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fd668066f30 0x7fd6680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:15.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.773+0000 7fd67effd700 1 -- 172.21.15.71:0/1128576082 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5195+0+0 (secure 0 0 0) 0x7fd678001e40 con 0x7fd6880b1ad0 2023-10-06T01:40:15.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.773+0000 7fd67dd9b700 1 --2- 172.21.15.71:0/1128576082 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fd668066f30 0x7fd6680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:15.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.773+0000 7fd67dd9b700 1 --2- 172.21.15.71:0/1128576082 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fd668066f30 0x7fd6680693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd68815afa0 tx=0x7fd670017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:15.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.777+0000 7fd67effd700 1 -- 172.21.15.71:0/1128576082 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd67804b5a0 con 0x7fd6880b1ad0 2023-10-06T01:40:15.961 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:15.961+0000 7fd68cca2700 1 -- 172.21.15.71:0/1128576082 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fd68815bfd0 con 0x7fd6880b1ad0 2023-10-06T01:40:16.646 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:16.645+0000 7fd67effd700 1 -- 172.21.15.71:0/1128576082 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v18) v1 ==== 173+0+0 (secure 0 0 0) 0x7fd68815bfd0 con 0x7fd6880b1ad0 2023-10-06T01:40:16.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:16.648+0000 7fd68cca2700 1 -- 172.21.15.71:0/1128576082 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fd668066f30 msgr2=0x7fd6680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:16.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:16.648+0000 7fd68cca2700 1 --2- 172.21.15.71:0/1128576082 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fd668066f30 0x7fd6680693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd68815afa0 tx=0x7fd670017000 comp rx=0 tx=0).stop 2023-10-06T01:40:16.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:16.648+0000 7fd68cca2700 1 -- 172.21.15.71:0/1128576082 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6880b1ad0 msgr2=0x7fd6881513d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:16.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:16.648+0000 7fd68cca2700 1 --2- 172.21.15.71:0/1128576082 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6880b1ad0 0x7fd6881513d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd67800c7e0 tx=0x7fd678007c80 comp rx=0 tx=0).stop 2023-10-06T01:40:16.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:16.648+0000 7fd68cca2700 1 -- 172.21.15.71:0/1128576082 shutdown_connections 2023-10-06T01:40:16.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:16.648+0000 7fd68cca2700 1 --2- 172.21.15.71:0/1128576082 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fd668066f30 0x7fd6680693e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:16.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:16.648+0000 7fd68cca2700 1 --2- 172.21.15.71:0/1128576082 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd68815ab20 0x7fd68809a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:16.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:16.648+0000 7fd68cca2700 1 --2- 172.21.15.71:0/1128576082 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6880b1ad0 0x7fd6881513d0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:16.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:16.648+0000 7fd68cca2700 1 --2- 172.21.15.71:0/1128576082 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd68815a750 0x7fd688153a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:16.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:16.648+0000 7fd68cca2700 1 -- 172.21.15.71:0/1128576082 >> 172.21.15.71:0/1128576082 conn(0x7fd688067910 msgr2=0x7fd688098370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:16.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:16.648+0000 7fd68cca2700 1 -- 172.21.15.71:0/1128576082 shutdown_connections 2023-10-06T01:40:16.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:16.648+0000 7fd68cca2700 1 -- 172.21.15.71:0/1128576082 wait complete. 2023-10-06T01:40:16.650 INFO:teuthology.orchestra.run.smithi071.stderr:enabled application 'rbd' on pool 'rbd' 2023-10-06T01:40:16.661 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-10-06T01:40:16.662 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T01:40:16.662 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T01:40:16.664 INFO:tasks.ceph.mds.a:Started 2023-10-06T01:40:16.664 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T01:40:16.664 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T01:40:16.666 INFO:tasks.ceph.mds.c:Started 2023-10-06T01:40:16.667 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T01:40:16.667 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T01:40:16.670 INFO:tasks.ceph.mds.b:Started 2023-10-06T01:40:16.670 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T01:40:16.670 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T01:40:16.672 INFO:tasks.ceph.mds.d:Started 2023-10-06T01:40:16.672 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-10-06T01:40:16.673 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:40:16.737 INFO:tasks.ceph.mds.a.smithi071.stdout:starting mds.a at 2023-10-06T01:40:16.738 INFO:tasks.ceph.mds.c.smithi071.stdout:starting mds.c at 2023-10-06T01:40:16.752 INFO:tasks.ceph.mds.d.smithi072.stdout:starting mds.d at 2023-10-06T01:40:16.752 INFO:tasks.ceph.mds.b.smithi072.stdout:starting mds.b at 2023-10-06T01:40:16.793 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:16.792+0000 7efd8a751700 1 Processor -- start 2023-10-06T01:40:16.793 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:16.792+0000 7efd8a751700 1 -- start start 2023-10-06T01:40:16.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:16.793+0000 7efd8a751700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7efd84159420 0x7efd840aeaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:16.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:16.793+0000 7efd8a751700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7efd841597f0 0x7efd840ac050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:16.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:16.793+0000 7efd8a751700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efd840aca00 0x7efd840ace80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:16.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:16.793+0000 7efd8a751700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd840b0920 con 0x7efd841597f0 2023-10-06T01:40:16.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:16.793+0000 7efd8a751700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd840af180 con 0x7efd84159420 2023-10-06T01:40:16.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:16.793+0000 7efd8a751700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd840ad3c0 con 0x7efd840aca00 2023-10-06T01:40:16.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:16.793+0000 7efd837fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7efd841597f0 0x7efd840ac050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:16.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:16.793+0000 7efd837fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7efd841597f0 0x7efd840ac050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:49486/0 (socket says 172.21.15.71:49486) 2023-10-06T01:40:16.796 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:16.793+0000 7efd837fe700 1 -- 172.21.15.71:0/3006923384 learned_addr learned my addr 172.21.15.71:0/3006923384 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:16.796 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:16.793+0000 7efd88cee700 1 --2- 172.21.15.71:0/3006923384 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efd840aca00 0x7efd840ace80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:16.796 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:16.793+0000 7efd83fff700 1 --2- 172.21.15.71:0/3006923384 >> v2:172.21.15.72:3300/0 conn(0x7efd84159420 0x7efd840aeaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:16.796 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:16.793+0000 7efd837fe700 1 -- 172.21.15.71:0/3006923384 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efd840aca00 msgr2=0x7efd840ace80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:16.796 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:16.793+0000 7efd837fe700 1 --2- 172.21.15.71:0/3006923384 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efd840aca00 0x7efd840ace80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:16.796 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:16.793+0000 7efd837fe700 1 -- 172.21.15.71:0/3006923384 >> v2:172.21.15.72:3300/0 conn(0x7efd84159420 msgr2=0x7efd840aeaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:16.796 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:16.793+0000 7efd837fe700 1 --2- 172.21.15.71:0/3006923384 >> v2:172.21.15.72:3300/0 conn(0x7efd84159420 0x7efd840aeaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:16.796 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:16.793+0000 7efd837fe700 1 -- 172.21.15.71:0/3006923384 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd840cc430 con 0x7efd841597f0 2023-10-06T01:40:16.796 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:16.793+0000 7efd837fe700 1 --2- 172.21.15.71:0/3006923384 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efd841597f0 0x7efd840ac050 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7efd8406a700 tx=0x7efd78009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caf9a19869de689 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:16.796 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:16.794+0000 7efd82ffd700 1 -- 172.21.15.71:0/3006923384 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd7800b640 con 0x7efd841597f0 2023-10-06T01:40:16.796 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:16.794+0000 7efd82ffd700 1 -- 172.21.15.71:0/3006923384 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd7800b7a0 con 0x7efd841597f0 2023-10-06T01:40:16.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:16.794+0000 7efd82ffd700 1 -- 172.21.15.71:0/3006923384 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd7800bb40 con 0x7efd841597f0 2023-10-06T01:40:16.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:16.794+0000 7efd8a751700 1 -- 172.21.15.71:0/3006923384 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efd841597f0 msgr2=0x7efd840ac050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:16.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:16.794+0000 7efd8a751700 1 --2- 172.21.15.71:0/3006923384 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efd841597f0 0x7efd840ac050 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7efd8406a700 tx=0x7efd78009250 comp rx=0 tx=0).stop 2023-10-06T01:40:16.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:16.794+0000 7efd8a751700 1 -- 172.21.15.71:0/3006923384 shutdown_connections 2023-10-06T01:40:16.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:16.794+0000 7efd8a751700 1 --2- 172.21.15.71:0/3006923384 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efd840aca00 0x7efd840ace80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:16.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:16.794+0000 7efd8a751700 1 --2- 172.21.15.71:0/3006923384 >> v2:172.21.15.72:3300/0 conn(0x7efd84159420 0x7efd840aeaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:16.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:16.794+0000 7efd8a751700 1 --2- 172.21.15.71:0/3006923384 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efd841597f0 0x7efd840ac050 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:16.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:16.794+0000 7efd8a751700 1 -- 172.21.15.71:0/3006923384 >> 172.21.15.71:0/3006923384 conn(0x7efd840cc790 msgr2=0x7efd840ccb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:16.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:16.794+0000 7efd8a751700 1 -- 172.21.15.71:0/3006923384 shutdown_connections 2023-10-06T01:40:16.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:16.794+0000 7efd8a751700 1 -- 172.21.15.71:0/3006923384 wait complete. 2023-10-06T01:40:16.800 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:16.795+0000 7efd8a751700 1 Processor -- start 2023-10-06T01:40:16.800 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:16.796+0000 7efd8a751700 1 -- start start 2023-10-06T01:40:16.800 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:16.796+0000 7efd8a751700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd840aca00 0x7efd84144520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:16.800 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:16.796+0000 7efd8a751700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efd84159420 0x7efd840997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:16.800 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:16.796+0000 7efd8a751700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efd841597f0 0x7efd84097e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:16.800 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:16.796+0000 7efd8a751700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd84099360 con 0x7efd84159420 2023-10-06T01:40:16.801 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:16.796+0000 7efd8a751700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd84098750 con 0x7efd840aca00 2023-10-06T01:40:16.801 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:16.796+0000 7efd8a751700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd84098a30 con 0x7efd841597f0 2023-10-06T01:40:16.801 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:16.797+0000 7efd837fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efd84159420 0x7efd840997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:16.801 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:16.797+0000 7efd83fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd840aca00 0x7efd84144520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:16.801 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:16.797+0000 7efd83fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd840aca00 0x7efd84144520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:55256/0 (socket says 172.21.15.71:55256) 2023-10-06T01:40:16.801 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:16.797+0000 7efd83fff700 1 -- 172.21.15.71:0/1448178400 learned_addr learned my addr 172.21.15.71:0/1448178400 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:16.801 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:16.797+0000 7efd837fe700 1 --2- 172.21.15.71:0/1448178400 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efd84159420 0x7efd840997f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:49496/0 (socket says 172.21.15.71:49496) 2023-10-06T01:40:16.801 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:16.797+0000 7efd88cee700 1 --2- 172.21.15.71:0/1448178400 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efd841597f0 0x7efd84097e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:16.801 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:16.797+0000 7efd837fe700 1 -- 172.21.15.71:0/1448178400 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efd841597f0 msgr2=0x7efd84097e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:16.802 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:16.797+0000 7efd837fe700 1 --2- 172.21.15.71:0/1448178400 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efd841597f0 0x7efd84097e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:16.802 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:16.797+0000 7efd837fe700 1 -- 172.21.15.71:0/1448178400 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd840aca00 msgr2=0x7efd84144520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:16.802 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:16.797+0000 7efd837fe700 1 --2- 172.21.15.71:0/1448178400 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd840aca00 0x7efd84144520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:16.802 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:16.797+0000 7efd837fe700 1 -- 172.21.15.71:0/1448178400 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd780094f0 con 0x7efd84159420 2023-10-06T01:40:16.802 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:16.797+0000 7efd837fe700 1 --2- 172.21.15.71:0/1448178400 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efd84159420 0x7efd840997f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7efd840af930 tx=0x7efd78017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:16.802 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:16.797+0000 7efd6bfff700 1 -- 172.21.15.71:0/1448178400 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd78000c90 con 0x7efd84159420 2023-10-06T01:40:16.802 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:16.797+0000 7efd6bfff700 1 -- 172.21.15.71:0/1448178400 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd7800b910 con 0x7efd84159420 2023-10-06T01:40:16.802 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:16.797+0000 7efd8a751700 1 -- 172.21.15.71:0/1448178400 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd84098d10 con 0x7efd84159420 2023-10-06T01:40:16.802 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:16.797+0000 7efd6bfff700 1 -- 172.21.15.71:0/1448178400 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd78026430 con 0x7efd84159420 2023-10-06T01:40:16.802 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:16.797+0000 7efd8a751700 1 -- 172.21.15.71:0/1448178400 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd84099d30 con 0x7efd84159420 2023-10-06T01:40:16.802 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:16.798+0000 7efd8a751700 1 -- 172.21.15.71:0/1448178400 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd840994d0 con 0x7efd84159420 2023-10-06T01:40:16.803 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:16.798+0000 7efd6bfff700 1 -- 172.21.15.71:0/1448178400 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efd78023030 con 0x7efd84159420 2023-10-06T01:40:16.803 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:16.799+0000 7efd6bfff700 1 --2- 172.21.15.71:0/1448178400 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7efd70066f30 0x7efd700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:16.803 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:16.799+0000 7efd6bfff700 1 -- 172.21.15.71:0/1448178400 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5206+0+0 (secure 0 0 0) 0x7efd78085a00 con 0x7efd84159420 2023-10-06T01:40:16.803 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:16.799+0000 7efd83fff700 1 --2- 172.21.15.71:0/1448178400 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7efd70066f30 0x7efd700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:16.803 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:16.799+0000 7efd83fff700 1 --2- 172.21.15.71:0/1448178400 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7efd70066f30 0x7efd700693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7efd74009e70 tx=0x7efd740091a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:16.805 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:16.803+0000 7efd6bfff700 1 -- 172.21.15.71:0/1448178400 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efd78052e60 con 0x7efd84159420 2023-10-06T01:40:16.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:16.989+0000 7efd8a751700 1 -- 172.21.15.71:0/1448178400 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efd840ac350 con 0x7efd84159420 2023-10-06T01:40:16.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:16.990+0000 7efd6bfff700 1 -- 172.21.15.71:0/1448178400 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+13612 (secure 0 0 0) 0x7efd78015090 con 0x7efd84159420 2023-10-06T01:40:16.991 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:40:16.991 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":18,"fsid":"1fbf1bd2-f9b4-4599-bea2-f4aa920e9a56","created":"2023-10-06T01:39:57.016957+0000","modified":"2023-10-06T01:40:16.639417+0000","last_up_change":"2023-10-06T01:40:08.571643+0000","last_in_change":"2023-10-06T01:39:59.462741+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T01:40:08.610349+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T01:40:15.387434+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"cf059188-fb20-4dbf-95db-dcf57b213d03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":90670},{"type":"v1","addr":"172.21.15.71:6817","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":90670},{"type":"v1","addr":"172.21.15.71:6819","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":90670},{"type":"v1","addr":"172.21.15.71:6823","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":90670},{"type":"v1","addr":"172.21.15.71:6821","nonce":90670}]},"public_addr":"172.21.15.71:6817/90670","cluster_addr":"172.21.15.71:6819/90670","heartbeat_back_addr":"172.21.15.71:6823/90670","heartbeat_front_addr":"172.21.15.71:6821/90670","state":["exists","up"]},{"osd":1,"uuid":"0cff0aae-1799-4fe0-b610-54cf0813c0e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":90669},{"type":"v1","addr":"172.21.15.71:6809","nonce":90669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":90669},{"type":"v1","addr":"172.21.15.71:6811","nonce":90669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":90669},{"type":"v1","addr":"172.21.15.71:6815","nonce":90669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":90669},{"type":"v1","addr":"172.21.15.71:6813","nonce":90669}]},"public_addr":"172.21.15.71:6809/90669","cluster_addr":"172.21.15.71:6811/90669","heartbeat_back_addr":"172.21.15.71:6815/90669","heartbeat_front_addr":"172.21.15.71:6813/90669","state":["exists","up"]},{"osd":2,"uuid":"88d61ddc-9031-44e1-ba8c-546a41e7c8ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":90679},{"type":"v1","addr":"172.21.15.71:6825","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":90679},{"type":"v1","addr":"172.21.15.71:6827","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":90679},{"type":"v1","addr":"172.21.15.71:6831","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":90679},{"type":"v1","addr":"172.21.15.71:6829","nonce":90679}]},"public_addr":"172.21.15.71:6825/90679","cluster_addr":"172.21.15.71:6827/90679","heartbeat_back_addr":"172.21.15.71:6831/90679","heartbeat_front_addr":"172.21.15.71:6829/90679","state":["exists","up"]},{"osd":3,"uuid":"11ed92b7-960b-4a30-a889-a61d3eeb86f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":90668},{"type":"v1","addr":"172.21.15.71:6801","nonce":90668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":90668},{"type":"v1","addr":"172.21.15.71:6803","nonce":90668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":90668},{"type":"v1","addr":"172.21.15.71:6807","nonce":90668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":90668},{"type":"v1","addr":"172.21.15.71:6805","nonce":90668}]},"public_addr":"172.21.15.71:6801/90668","cluster_addr":"172.21.15.71:6803/90668","heartbeat_back_addr":"172.21.15.71:6807/90668","heartbeat_front_addr":"172.21.15.71:6805/90668","state":["exists","up"]},{"osd":4,"uuid":"ae4df784-abdf-4ddf-aefa-780f3ddafef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":90917},{"type":"v1","addr":"172.21.15.72:6801","nonce":90917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":90917},{"type":"v1","addr":"172.21.15.72:6803","nonce":90917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":90917},{"type":"v1","addr":"172.21.15.72:6807","nonce":90917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":90917},{"type":"v1","addr":"172.21.15.72:6805","nonce":90917}]},"public_addr":"172.21.15.72:6801/90917","cluster_addr":"172.21.15.72:6803/90917","heartbeat_back_addr":"172.21.15.72:6807/90917","heartbeat_front_addr":"172.21.15.72:6805/90917","state":["exists","up"]},{"osd":5,"uuid":"5ef0790f-001e-458f-a05b-efae216cf435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":90941},{"type":"v1","addr":"172.21.15.72:6817","nonce":90941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":90941},{"type":"v1","addr":"172.21.15.72:6819","nonce":90941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":90941},{"type":"v1","addr":"172.21.15.72:6827","nonce":90941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":90941},{"type":"v1","addr":"172.21.15.72:6823","nonce":90941}]},"public_addr":"172.21.15.72:6817/90941","cluster_addr":"172.21.15.72:6819/90941","heartbeat_back_addr":"172.21.15.72:6827/90941","heartbeat_front_addr":"172.21.15.72:6823/90941","state":["exists","up"]},{"osd":6,"uuid":"8705aef1-9ae8-4e54-a3c4-c2909fa0ceb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":90918},{"type":"v1","addr":"172.21.15.72:6809","nonce":90918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":90918},{"type":"v1","addr":"172.21.15.72:6811","nonce":90918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":90918},{"type":"v1","addr":"172.21.15.72:6815","nonce":90918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":90918},{"type":"v1","addr":"172.21.15.72:6813","nonce":90918}]},"public_addr":"172.21.15.72:6809/90918","cluster_addr":"172.21.15.72:6811/90918","heartbeat_back_addr":"172.21.15.72:6815/90918","heartbeat_front_addr":"172.21.15.72:6813/90918","state":["exists","up"]},{"osd":7,"uuid":"364c5119-6b13-4c75-b3f0-15e165eff86a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":90948},{"type":"v1","addr":"172.21.15.72:6822","nonce":90948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":90948},{"type":"v1","addr":"172.21.15.72:6826","nonce":90948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":90948},{"type":"v1","addr":"172.21.15.72:6831","nonce":90948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":90948},{"type":"v1","addr":"172.21.15.72:6829","nonce":90948}]},"public_addr":"172.21.15.72:6822/90948","cluster_addr":"172.21.15.72:6826/90948","heartbeat_back_addr":"172.21.15.72:6831/90948","heartbeat_front_addr":"172.21.15.72:6829/90948","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.642976+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.645372+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.619116+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.663042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.599163+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.646411+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.631545+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.669821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:40:16.993 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:16.992+0000 7efd8a751700 1 -- 172.21.15.71:0/1448178400 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7efd70066f30 msgr2=0x7efd700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:16.993 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:16.992+0000 7efd8a751700 1 --2- 172.21.15.71:0/1448178400 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7efd70066f30 0x7efd700693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7efd74009e70 tx=0x7efd740091a0 comp rx=0 tx=0).stop 2023-10-06T01:40:16.993 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:16.992+0000 7efd8a751700 1 -- 172.21.15.71:0/1448178400 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efd84159420 msgr2=0x7efd840997f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:16.993 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:16.992+0000 7efd8a751700 1 --2- 172.21.15.71:0/1448178400 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efd84159420 0x7efd840997f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7efd840af930 tx=0x7efd78017000 comp rx=0 tx=0).stop 2023-10-06T01:40:16.993 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:16.992+0000 7efd8a751700 1 -- 172.21.15.71:0/1448178400 shutdown_connections 2023-10-06T01:40:16.993 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:16.992+0000 7efd8a751700 1 --2- 172.21.15.71:0/1448178400 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efd841597f0 0x7efd84097e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:16.994 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:16.992+0000 7efd8a751700 1 --2- 172.21.15.71:0/1448178400 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7efd70066f30 0x7efd700693e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:16.994 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:16.992+0000 7efd8a751700 1 --2- 172.21.15.71:0/1448178400 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efd840aca00 0x7efd84144520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:16.994 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:16.992+0000 7efd8a751700 1 --2- 172.21.15.71:0/1448178400 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efd84159420 0x7efd840997f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:16.994 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:16.992+0000 7efd8a751700 1 -- 172.21.15.71:0/1448178400 >> 172.21.15.71:0/1448178400 conn(0x7efd840cc790 msgr2=0x7efd8415d120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:16.994 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:16.992+0000 7efd8a751700 1 -- 172.21.15.71:0/1448178400 shutdown_connections 2023-10-06T01:40:16.994 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:16.992+0000 7efd8a751700 1 -- 172.21.15.71:0/1448178400 wait complete. 2023-10-06T01:40:17.004 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T01:40:08.610349+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T01:40:15.387434+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-10-06T01:40:17.005 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T01:40:17.122 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.121+0000 7fbefd9d1700 1 Processor -- start 2023-10-06T01:40:17.122 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.121+0000 7fbefd9d1700 1 -- start start 2023-10-06T01:40:17.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.122+0000 7fbefd9d1700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbef806e8a0 0x7fbef81584e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:17.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.122+0000 7fbefd9d1700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fbef81574c0 0x7fbef806d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:17.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.122+0000 7fbefd9d1700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbef8158050 con 0x7fbef81570f0 2023-10-06T01:40:17.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.122+0000 7fbefd9d1700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbef80c9940 con 0x7fbef81574c0 2023-10-06T01:40:17.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.122+0000 7fbefd9d1700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbef80c9660 con 0x7fbef806e8a0 2023-10-06T01:40:17.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.122+0000 7fbefd1d0700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fbef81574c0 0x7fbef806d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:17.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.122+0000 7fbefd1d0700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fbef81574c0 0x7fbef806d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:49504/0 (socket says 172.21.15.71:49504) 2023-10-06T01:40:17.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.122+0000 7fbefd1d0700 1 -- 172.21.15.71:0/2734903903 learned_addr learned my addr 172.21.15.71:0/2734903903 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:17.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.122+0000 7fbef7fff700 1 --2- 172.21.15.71:0/2734903903 >> v2:172.21.15.72:3300/0 conn(0x7fbef806e8a0 0x7fbef81584e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:17.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.122+0000 7fbefd1d0700 1 -- 172.21.15.71:0/2734903903 >> v2:172.21.15.72:3300/0 conn(0x7fbef806e8a0 msgr2=0x7fbef81584e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:17.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.122+0000 7fbefd1d0700 1 --2- 172.21.15.71:0/2734903903 >> v2:172.21.15.72:3300/0 conn(0x7fbef806e8a0 0x7fbef81584e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:17.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.122+0000 7fbefd1d0700 1 -- 172.21.15.71:0/2734903903 >> v1:172.21.15.72:6789/0 conn(0x7fbef81570f0 legacy=0x7fbef80c8ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:17.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.122+0000 7fbefd1d0700 1 -- 172.21.15.71:0/2734903903 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbef8157a00 con 0x7fbef81574c0 2023-10-06T01:40:17.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.122+0000 7fbefd1d0700 1 --2- 172.21.15.71:0/2734903903 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbef81574c0 0x7fbef806d9b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fbee80099b0 tx=0x7fbee8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24a22614105be6a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:17.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.122+0000 7fbef77fe700 1 -- 172.21.15.71:0/2734903903 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee800b7e0 con 0x7fbef81574c0 2023-10-06T01:40:17.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.122+0000 7fbef77fe700 1 -- 172.21.15.71:0/2734903903 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbee800b940 con 0x7fbef81574c0 2023-10-06T01:40:17.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.122+0000 7fbef77fe700 1 -- 172.21.15.71:0/2734903903 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee800bce0 con 0x7fbef81574c0 2023-10-06T01:40:17.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.123+0000 7fbefd9d1700 1 -- 172.21.15.71:0/2734903903 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbef81574c0 msgr2=0x7fbef806d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:17.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.123+0000 7fbefd9d1700 1 --2- 172.21.15.71:0/2734903903 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbef81574c0 0x7fbef806d9b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fbee80099b0 tx=0x7fbee8009250 comp rx=0 tx=0).stop 2023-10-06T01:40:17.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.123+0000 7fbefd9d1700 1 -- 172.21.15.71:0/2734903903 shutdown_connections 2023-10-06T01:40:17.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.123+0000 7fbefd9d1700 1 --2- 172.21.15.71:0/2734903903 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbef81574c0 0x7fbef806d9b0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:17.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.123+0000 7fbefd9d1700 1 --2- 172.21.15.71:0/2734903903 >> v2:172.21.15.72:3300/0 conn(0x7fbef806e8a0 0x7fbef81584e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:17.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.123+0000 7fbefd9d1700 1 -- 172.21.15.71:0/2734903903 >> 172.21.15.71:0/2734903903 conn(0x7fbef80cea20 msgr2=0x7fbef806c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:17.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.123+0000 7fbefd9d1700 1 -- 172.21.15.71:0/2734903903 shutdown_connections 2023-10-06T01:40:17.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.123+0000 7fbefd9d1700 1 -- 172.21.15.71:0/2734903903 wait complete. 2023-10-06T01:40:17.128 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.124+0000 7fbefd9d1700 1 Processor -- start 2023-10-06T01:40:17.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.124+0000 7fbefd9d1700 1 -- start start 2023-10-06T01:40:17.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.125+0000 7fbefd9d1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbef806e8a0 0x7fbef81535e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:17.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.125+0000 7fbefd9d1700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbef81570f0 0x7fbef80c7620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:17.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.125+0000 7fbefd9d1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbef81574c0 0x7fbef816af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:17.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.125+0000 7fbefd9d1700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbef8154ad0 con 0x7fbef81570f0 2023-10-06T01:40:17.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.125+0000 7fbefd9d1700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbef8153ec0 con 0x7fbef81574c0 2023-10-06T01:40:17.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.125+0000 7fbefd9d1700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbef81541a0 con 0x7fbef806e8a0 2023-10-06T01:40:17.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.125+0000 7fbef7fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbef81570f0 0x7fbef80c7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:17.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.125+0000 7fbef7fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbef81570f0 0x7fbef80c7620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:49514/0 (socket says 172.21.15.71:49514) 2023-10-06T01:40:17.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.125+0000 7fbef7fff700 1 -- 172.21.15.71:0/997912182 learned_addr learned my addr 172.21.15.71:0/997912182 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:17.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.125+0000 7fbefd1d0700 1 --2- 172.21.15.71:0/997912182 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbef81574c0 0x7fbef816af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:17.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.125+0000 7fbefc9cf700 1 --2- 172.21.15.71:0/997912182 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbef806e8a0 0x7fbef81535e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:17.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.125+0000 7fbef7fff700 1 -- 172.21.15.71:0/997912182 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbef806e8a0 msgr2=0x7fbef81535e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:17.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.125+0000 7fbef7fff700 1 --2- 172.21.15.71:0/997912182 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbef806e8a0 0x7fbef81535e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:17.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.125+0000 7fbef7fff700 1 -- 172.21.15.71:0/997912182 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbef81574c0 msgr2=0x7fbef816af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:17.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.125+0000 7fbef7fff700 1 --2- 172.21.15.71:0/997912182 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbef81574c0 0x7fbef816af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:17.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.125+0000 7fbef7fff700 1 -- 172.21.15.71:0/997912182 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbee80094f0 con 0x7fbef81570f0 2023-10-06T01:40:17.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.126+0000 7fbef7fff700 1 --2- 172.21.15.71:0/997912182 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbef81570f0 0x7fbef80c7620 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fbeec00d860 tx=0x7fbeec008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:17.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.126+0000 7fbef4ff9700 1 -- 172.21.15.71:0/997912182 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeec0125f0 con 0x7fbef81570f0 2023-10-06T01:40:17.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.126+0000 7fbef4ff9700 1 -- 172.21.15.71:0/997912182 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbeec012750 con 0x7fbef81570f0 2023-10-06T01:40:17.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.126+0000 7fbef4ff9700 1 -- 172.21.15.71:0/997912182 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeec012b10 con 0x7fbef81570f0 2023-10-06T01:40:17.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.126+0000 7fbefd9d1700 1 -- 172.21.15.71:0/997912182 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbef8154480 con 0x7fbef81570f0 2023-10-06T01:40:17.131 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.126+0000 7fbefd9d1700 1 -- 172.21.15.71:0/997912182 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbef8153b20 con 0x7fbef81570f0 2023-10-06T01:40:17.131 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.127+0000 7fbefd9d1700 1 -- 172.21.15.71:0/997912182 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbef8064ee0 con 0x7fbef81570f0 2023-10-06T01:40:17.131 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.127+0000 7fbef4ff9700 1 -- 172.21.15.71:0/997912182 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbeec01e460 con 0x7fbef81570f0 2023-10-06T01:40:17.131 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.127+0000 7fbef4ff9700 1 --2- 172.21.15.71:0/997912182 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fbee4066f60 0x7fbee4069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:17.131 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.127+0000 7fbef4ff9700 1 -- 172.21.15.71:0/997912182 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fbeec084830 con 0x7fbef81570f0 2023-10-06T01:40:17.131 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.127+0000 7fbefc9cf700 1 --2- 172.21.15.71:0/997912182 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fbee4066f60 0x7fbee4069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:17.131 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.128+0000 7fbefc9cf700 1 --2- 172.21.15.71:0/997912182 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fbee4066f60 0x7fbee4069410 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fbef0007fd0 tx=0x7fbef00026a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:17.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.131+0000 7fbef4ff9700 1 -- 172.21.15.71:0/997912182 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbeec055720 con 0x7fbef81570f0 2023-10-06T01:40:17.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.312+0000 7fbefd9d1700 1 -- 172.21.15.71:0/997912182 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbef8064aa0 con 0x7fbef81570f0 2023-10-06T01:40:17.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.313+0000 7fbef4ff9700 1 -- 172.21.15.71:0/997912182 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbeec0552b0 con 0x7fbef81570f0 2023-10-06T01:40:17.314 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 1 2023-10-06T01:40:17.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.315+0000 7fbefd9d1700 1 -- 172.21.15.71:0/997912182 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fbee4066f60 msgr2=0x7fbee4069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:17.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.315+0000 7fbefd9d1700 1 --2- 172.21.15.71:0/997912182 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fbee4066f60 0x7fbee4069410 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fbef0007fd0 tx=0x7fbef00026a0 comp rx=0 tx=0).stop 2023-10-06T01:40:17.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.315+0000 7fbefd9d1700 1 -- 172.21.15.71:0/997912182 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbef81570f0 msgr2=0x7fbef80c7620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:17.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.315+0000 7fbefd9d1700 1 --2- 172.21.15.71:0/997912182 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbef81570f0 0x7fbef80c7620 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fbeec00d860 tx=0x7fbeec008040 comp rx=0 tx=0).stop 2023-10-06T01:40:17.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.315+0000 7fbefd9d1700 1 -- 172.21.15.71:0/997912182 shutdown_connections 2023-10-06T01:40:17.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.315+0000 7fbefd9d1700 1 --2- 172.21.15.71:0/997912182 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fbee4066f60 0x7fbee4069410 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:17.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.315+0000 7fbefd9d1700 1 --2- 172.21.15.71:0/997912182 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbef81574c0 0x7fbef816af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:17.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.315+0000 7fbefd9d1700 1 --2- 172.21.15.71:0/997912182 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbef806e8a0 0x7fbef81535e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:17.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.315+0000 7fbefd9d1700 1 --2- 172.21.15.71:0/997912182 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbef81570f0 0x7fbef80c7620 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:17.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.315+0000 7fbefd9d1700 1 -- 172.21.15.71:0/997912182 >> 172.21.15.71:0/997912182 conn(0x7fbef80cea20 msgr2=0x7fbef806d9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:17.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.315+0000 7fbefd9d1700 1 -- 172.21.15.71:0/997912182 shutdown_connections 2023-10-06T01:40:17.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.315+0000 7fbefd9d1700 1 -- 172.21.15.71:0/997912182 wait complete. 2023-10-06T01:40:17.327 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T01:40:17.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.443+0000 7f4ab6173700 1 Processor -- start 2023-10-06T01:40:17.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.443+0000 7f4ab6173700 1 -- start start 2023-10-06T01:40:17.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.444+0000 7f4ab6173700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4ab00cc3d0 0x7f4ab00c4440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:17.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.444+0000 7f4ab6173700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ab00c3b40 con 0x7f4ab01574b0 2023-10-06T01:40:17.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.444+0000 7f4ab6173700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ab00c2f30 con 0x7f4ab00c3fd0 2023-10-06T01:40:17.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.444+0000 7f4ab6173700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab00c4980 con 0x7f4ab00cc3d0 2023-10-06T01:40:17.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.444+0000 7f4aaf7fe700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f4ab01574b0 0x7f4ab00b0eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:54600/0 (socket says 172.21.15.71:54600) 2023-10-06T01:40:17.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.444+0000 7f4aaf7fe700 1 -- 172.21.15.71:0/42816966 learned_addr learned my addr 172.21.15.71:0/42816966 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:40:17.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.444+0000 7f4aaffff700 1 --2- 172.21.15.71:0/42816966 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4ab00cc3d0 0x7f4ab00c4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:17.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.444+0000 7f4aae7fc700 1 -- 172.21.15.71:0/42816966 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3856635455 0 0) 0x7f4ab00c3b40 con 0x7f4ab01574b0 2023-10-06T01:40:17.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.444+0000 7f4aae7fc700 1 -- 172.21.15.71:0/42816966 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a98003570 con 0x7f4ab01574b0 2023-10-06T01:40:17.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.444+0000 7f4aae7fc700 1 -- 172.21.15.71:0/42816966 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 398401878 0 0) 0x7f4ab00c2f30 con 0x7f4ab00c3fd0 2023-10-06T01:40:17.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.444+0000 7f4aae7fc700 1 -- 172.21.15.71:0/42816966 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ab00c3b40 con 0x7f4ab00c3fd0 2023-10-06T01:40:17.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.444+0000 7f4aaffff700 1 -- 172.21.15.71:0/42816966 >> v1:172.21.15.72:6789/0 conn(0x7f4ab00c3fd0 legacy=0x7f4ab00cbcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:17.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.444+0000 7f4aaffff700 1 -- 172.21.15.71:0/42816966 >> v1:172.21.15.71:6789/0 conn(0x7f4ab01574b0 legacy=0x7f4ab00b0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:17.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.444+0000 7f4aaffff700 1 -- 172.21.15.71:0/42816966 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ab00c3210 con 0x7f4ab00cc3d0 2023-10-06T01:40:17.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.444+0000 7f4aaffff700 1 --2- 172.21.15.71:0/42816966 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4ab00cc3d0 0x7f4ab00c4440 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4aa8009910 tx=0x7f4aa80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26c776c7c771173e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:17.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.445+0000 7f4aae7fc700 1 -- 172.21.15.71:0/42816966 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa8011630 con 0x7f4ab00cc3d0 2023-10-06T01:40:17.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.445+0000 7f4aae7fc700 1 -- 172.21.15.71:0/42816966 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aa8011790 con 0x7f4ab00cc3d0 2023-10-06T01:40:17.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.445+0000 7f4aae7fc700 1 -- 172.21.15.71:0/42816966 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa8011b30 con 0x7f4ab00cc3d0 2023-10-06T01:40:17.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.445+0000 7f4ab6173700 1 -- 172.21.15.71:0/42816966 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4ab00cc3d0 msgr2=0x7f4ab00c4440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:17.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.445+0000 7f4ab6173700 1 --2- 172.21.15.71:0/42816966 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4ab00cc3d0 0x7f4ab00c4440 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4aa8009910 tx=0x7f4aa80091a0 comp rx=0 tx=0).stop 2023-10-06T01:40:17.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.445+0000 7f4ab6173700 1 -- 172.21.15.71:0/42816966 shutdown_connections 2023-10-06T01:40:17.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.445+0000 7f4ab6173700 1 --2- 172.21.15.71:0/42816966 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4ab00cc3d0 0x7f4ab00c4440 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:17.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.445+0000 7f4ab6173700 1 -- 172.21.15.71:0/42816966 >> 172.21.15.71:0/42816966 conn(0x7f4ab0067910 msgr2=0x7f4ab00ce0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:17.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.445+0000 7f4ab6173700 1 -- 172.21.15.71:0/42816966 shutdown_connections 2023-10-06T01:40:17.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.445+0000 7f4ab6173700 1 -- 172.21.15.71:0/42816966 wait complete. 2023-10-06T01:40:17.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.446+0000 7f4ab6173700 1 Processor -- start 2023-10-06T01:40:17.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.446+0000 7f4ab6173700 1 -- start start 2023-10-06T01:40:17.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.447+0000 7f4ab6173700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4ab00c3fd0 0x7f4ab0151e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:17.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.447+0000 7f4ab6173700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4ab00cc3d0 0x7f4ab0152390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:17.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.447+0000 7f4ab6173700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ab01574b0 0x7f4ab01556f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:17.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.447+0000 7f4ab6173700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab0157880 con 0x7f4ab00c3fd0 2023-10-06T01:40:17.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.447+0000 7f4ab6173700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab0152aa0 con 0x7f4ab01574b0 2023-10-06T01:40:17.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.447+0000 7f4ab6173700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab0152d80 con 0x7f4ab00cc3d0 2023-10-06T01:40:17.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.447+0000 7f4aaf7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4ab00c3fd0 0x7f4ab0151e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:17.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.447+0000 7f4aaf7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4ab00c3fd0 0x7f4ab0151e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:49524/0 (socket says 172.21.15.71:49524) 2023-10-06T01:40:17.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.447+0000 7f4aaf7fe700 1 -- 172.21.15.71:0/1742402254 learned_addr learned my addr 172.21.15.71:0/1742402254 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:17.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.447+0000 7f4aaeffd700 1 --2- 172.21.15.71:0/1742402254 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4ab00cc3d0 0x7f4ab0152390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:17.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.447+0000 7f4aaffff700 1 --2- 172.21.15.71:0/1742402254 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ab01574b0 0x7f4ab01556f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:17.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.447+0000 7f4aaf7fe700 1 -- 172.21.15.71:0/1742402254 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4ab00cc3d0 msgr2=0x7f4ab0152390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:17.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.447+0000 7f4aaf7fe700 1 --2- 172.21.15.71:0/1742402254 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4ab00cc3d0 0x7f4ab0152390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:17.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.448+0000 7f4aaf7fe700 1 -- 172.21.15.71:0/1742402254 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ab01574b0 msgr2=0x7f4ab01556f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:17.453 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.448+0000 7f4aaf7fe700 1 --2- 172.21.15.71:0/1742402254 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ab01574b0 0x7f4ab01556f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:17.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.448+0000 7f4aaf7fe700 1 -- 172.21.15.71:0/1742402254 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aa8009420 con 0x7f4ab00c3fd0 2023-10-06T01:40:17.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.448+0000 7f4aaffff700 1 --2- 172.21.15.71:0/1742402254 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ab01574b0 0x7f4ab01556f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:40:17.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.448+0000 7f4aaf7fe700 1 --2- 172.21.15.71:0/1742402254 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4ab00c3fd0 0x7f4ab0151e50 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4aa00016e0 tx=0x7f4aa00027d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:17.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.448+0000 7f4a977fe700 1 -- 172.21.15.71:0/1742402254 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa00030c0 con 0x7f4ab00c3fd0 2023-10-06T01:40:17.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.448+0000 7f4a977fe700 1 -- 172.21.15.71:0/1742402254 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aa0005d80 con 0x7f4ab00c3fd0 2023-10-06T01:40:17.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.448+0000 7f4ab6173700 1 -- 172.21.15.71:0/1742402254 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ab0157b40 con 0x7f4ab00c3fd0 2023-10-06T01:40:17.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.448+0000 7f4a977fe700 1 -- 172.21.15.71:0/1742402254 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa000a820 con 0x7f4ab00c3fd0 2023-10-06T01:40:17.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.448+0000 7f4ab6173700 1 -- 172.21.15.71:0/1742402254 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ab00c51a0 con 0x7f4ab00c3fd0 2023-10-06T01:40:17.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.449+0000 7f4ab6173700 1 -- 172.21.15.71:0/1742402254 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ab006e590 con 0x7f4ab00c3fd0 2023-10-06T01:40:17.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.449+0000 7f4a977fe700 1 -- 172.21.15.71:0/1742402254 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4aa000ac10 con 0x7f4ab00c3fd0 2023-10-06T01:40:17.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.449+0000 7f4a977fe700 1 --2- 172.21.15.71:0/1742402254 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f4a9c066f30 0x7f4a9c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:17.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.450+0000 7f4a977fe700 1 -- 172.21.15.71:0/1742402254 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f4aa00840a0 con 0x7f4ab00c3fd0 2023-10-06T01:40:17.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.450+0000 7f4aaeffd700 1 --2- 172.21.15.71:0/1742402254 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f4a9c066f30 0x7f4a9c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:17.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.450+0000 7f4aaeffd700 1 --2- 172.21.15.71:0/1742402254 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f4a9c066f30 0x7f4a9c0693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4aa4007fd0 tx=0x7f4aa4007d10 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:17.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.454+0000 7f4a977fe700 1 -- 172.21.15.71:0/1742402254 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4aa0051580 con 0x7f4ab00c3fd0 2023-10-06T01:40:17.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.637+0000 7f4ab6173700 1 -- 172.21.15.71:0/1742402254 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4ab00c34f0 con 0x7f4ab00c3fd0 2023-10-06T01:40:17.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.637+0000 7f4a977fe700 1 -- 172.21.15.71:0/1742402254 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v18) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4aa0054ba0 con 0x7f4ab00c3fd0 2023-10-06T01:40:17.638 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 8 2023-10-06T01:40:17.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.639+0000 7f4ab6173700 1 -- 172.21.15.71:0/1742402254 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f4a9c066f30 msgr2=0x7f4a9c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:17.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.639+0000 7f4ab6173700 1 --2- 172.21.15.71:0/1742402254 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f4a9c066f30 0x7f4a9c0693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4aa4007fd0 tx=0x7f4aa4007d10 comp rx=0 tx=0).stop 2023-10-06T01:40:17.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.639+0000 7f4ab6173700 1 -- 172.21.15.71:0/1742402254 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4ab00c3fd0 msgr2=0x7f4ab0151e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:17.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.639+0000 7f4ab6173700 1 --2- 172.21.15.71:0/1742402254 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4ab00c3fd0 0x7f4ab0151e50 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4aa00016e0 tx=0x7f4aa00027d0 comp rx=0 tx=0).stop 2023-10-06T01:40:17.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.639+0000 7f4ab6173700 1 -- 172.21.15.71:0/1742402254 shutdown_connections 2023-10-06T01:40:17.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.639+0000 7f4ab6173700 1 --2- 172.21.15.71:0/1742402254 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f4a9c066f30 0x7f4a9c0693e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:17.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.639+0000 7f4ab6173700 1 --2- 172.21.15.71:0/1742402254 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ab01574b0 0x7f4ab01556f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:17.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.639+0000 7f4ab6173700 1 --2- 172.21.15.71:0/1742402254 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4ab00c3fd0 0x7f4ab0151e50 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:17.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.639+0000 7f4ab6173700 1 --2- 172.21.15.71:0/1742402254 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4ab00cc3d0 0x7f4ab0152390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:17.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.639+0000 7f4ab6173700 1 -- 172.21.15.71:0/1742402254 >> 172.21.15.71:0/1742402254 conn(0x7f4ab0067910 msgr2=0x7f4ab0149a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:17.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.639+0000 7f4ab6173700 1 -- 172.21.15.71:0/1742402254 shutdown_connections 2023-10-06T01:40:17.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.639+0000 7f4ab6173700 1 -- 172.21.15.71:0/1742402254 wait complete. 2023-10-06T01:40:17.652 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T01:40:17.766 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.765+0000 7fa27759e700 1 Processor -- start 2023-10-06T01:40:17.766 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.765+0000 7fa27759e700 1 -- start start 2023-10-06T01:40:17.768 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.766+0000 7fa27759e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa278159400 0x7fa2780ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:17.769 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.766+0000 7fa27759e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa2780d05d0 0x7fa2780b39f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:17.769 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.766+0000 7fa27759e700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2780b3560 con 0x7fa2780cd030 2023-10-06T01:40:17.769 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.766+0000 7fa27759e700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2780cf6f0 con 0x7fa278159400 2023-10-06T01:40:17.769 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.766+0000 7fa27759e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2780cf9d0 con 0x7fa2780d05d0 2023-10-06T01:40:17.769 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.767+0000 7fa27659c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa278159400 0x7fa2780ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:17.769 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.767+0000 7fa276d9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa2780d05d0 0x7fa2780b39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:17.769 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.767+0000 7fa276d9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa2780d05d0 0x7fa2780b39f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.71:42320/0 (socket says 172.21.15.71:42320) 2023-10-06T01:40:17.769 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.767+0000 7fa26dd9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fa2780cd030 0x7fa2780cfec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.71:39656/0 (socket says 172.21.15.71:39656) 2023-10-06T01:40:17.769 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.767+0000 7fa27659c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa278159400 0x7fa2780ccaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:55294/0 (socket says 172.21.15.71:55294) 2023-10-06T01:40:17.769 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.767+0000 7fa276d9d700 1 -- 172.21.15.71:0/3763204415 learned_addr learned my addr 172.21.15.71:0/3763204415 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:17.770 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.767+0000 7fa27659c700 1 -- 172.21.15.71:0/3763204415 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa2780d05d0 msgr2=0x7fa2780b39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:17.770 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.767+0000 7fa27659c700 1 --2- 172.21.15.71:0/3763204415 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa2780d05d0 0x7fa2780b39f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:17.770 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.767+0000 7fa27659c700 1 -- 172.21.15.71:0/3763204415 >> v1:172.21.15.72:6789/0 conn(0x7fa2780cd030 legacy=0x7fa2780cfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:17.770 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.767+0000 7fa27659c700 1 -- 172.21.15.71:0/3763204415 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2780b2f10 con 0x7fa278159400 2023-10-06T01:40:17.770 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.767+0000 7fa27659c700 1 --2- 172.21.15.71:0/3763204415 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa278159400 0x7fa2780ccaf0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa2680098d0 tx=0x7fa268009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=290f06430e8cc5c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:17.770 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.767+0000 7fa275d9b700 1 -- 172.21.15.71:0/3763204415 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa268005c10 con 0x7fa278159400 2023-10-06T01:40:17.770 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.767+0000 7fa275d9b700 1 -- 172.21.15.71:0/3763204415 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa268005d70 con 0x7fa278159400 2023-10-06T01:40:17.770 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.767+0000 7fa275d9b700 1 -- 172.21.15.71:0/3763204415 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa268006280 con 0x7fa278159400 2023-10-06T01:40:17.770 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.768+0000 7fa27759e700 1 -- 172.21.15.71:0/3763204415 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa278159400 msgr2=0x7fa2780ccaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:17.770 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.768+0000 7fa27759e700 1 --2- 172.21.15.71:0/3763204415 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa278159400 0x7fa2780ccaf0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa2680098d0 tx=0x7fa268009120 comp rx=0 tx=0).stop 2023-10-06T01:40:17.770 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.768+0000 7fa27759e700 1 -- 172.21.15.71:0/3763204415 shutdown_connections 2023-10-06T01:40:17.771 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.768+0000 7fa27759e700 1 --2- 172.21.15.71:0/3763204415 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa2780d05d0 0x7fa2780b39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:17.771 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.768+0000 7fa27759e700 1 --2- 172.21.15.71:0/3763204415 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa278159400 0x7fa2780ccaf0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:17.771 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.768+0000 7fa27759e700 1 -- 172.21.15.71:0/3763204415 >> 172.21.15.71:0/3763204415 conn(0x7fa27806ac10 msgr2=0x7fa278068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:17.771 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.768+0000 7fa27759e700 1 -- 172.21.15.71:0/3763204415 shutdown_connections 2023-10-06T01:40:17.771 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.768+0000 7fa27759e700 1 -- 172.21.15.71:0/3763204415 wait complete. 2023-10-06T01:40:17.773 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.769+0000 7fa27759e700 1 Processor -- start 2023-10-06T01:40:17.774 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.769+0000 7fa27759e700 1 -- start start 2023-10-06T01:40:17.774 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.770+0000 7fa27759e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa2780cd030 0x7fa27814ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:17.774 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.770+0000 7fa27759e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa2780d05d0 0x7fa27814bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:17.774 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.770+0000 7fa27759e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa278159400 0x7fa2781542b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:17.774 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.770+0000 7fa27759e700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa27814da20 con 0x7fa2780cd030 2023-10-06T01:40:17.774 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.770+0000 7fa27759e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa27814f460 con 0x7fa278159400 2023-10-06T01:40:17.774 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.770+0000 7fa27759e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa27814ce10 con 0x7fa2780d05d0 2023-10-06T01:40:17.774 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.770+0000 7fa27659c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa2780cd030 0x7fa27814ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:17.774 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.770+0000 7fa27659c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa2780cd030 0x7fa27814ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:49540/0 (socket says 172.21.15.71:49540) 2023-10-06T01:40:17.774 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.770+0000 7fa27659c700 1 -- 172.21.15.71:0/855829520 learned_addr learned my addr 172.21.15.71:0/855829520 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:17.774 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.770+0000 7fa276d9d700 1 --2- 172.21.15.71:0/855829520 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa278159400 0x7fa2781542b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:17.775 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.770+0000 7fa26dd9b700 1 --2- 172.21.15.71:0/855829520 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa2780d05d0 0x7fa27814bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:17.775 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.770+0000 7fa27659c700 1 -- 172.21.15.71:0/855829520 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa2780d05d0 msgr2=0x7fa27814bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:17.775 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.770+0000 7fa27659c700 1 --2- 172.21.15.71:0/855829520 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa2780d05d0 0x7fa27814bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:17.775 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.770+0000 7fa27659c700 1 -- 172.21.15.71:0/855829520 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa278159400 msgr2=0x7fa2781542b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:17.775 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.770+0000 7fa27659c700 1 --2- 172.21.15.71:0/855829520 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa278159400 0x7fa2781542b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:17.775 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.770+0000 7fa27659c700 1 -- 172.21.15.71:0/855829520 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2680093c0 con 0x7fa2780cd030 2023-10-06T01:40:17.775 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.770+0000 7fa27659c700 1 --2- 172.21.15.71:0/855829520 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa2780cd030 0x7fa27814ef20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa268006210 tx=0x7fa268016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:17.775 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.770+0000 7fa26effd700 1 -- 172.21.15.71:0/855829520 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa26801b760 con 0x7fa2780cd030 2023-10-06T01:40:17.775 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.770+0000 7fa26effd700 1 -- 172.21.15.71:0/855829520 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa26801b8c0 con 0x7fa2780cd030 2023-10-06T01:40:17.775 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.770+0000 7fa26effd700 1 -- 172.21.15.71:0/855829520 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa26801bc60 con 0x7fa2780cd030 2023-10-06T01:40:17.775 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.770+0000 7fa27759e700 1 -- 172.21.15.71:0/855829520 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa27814d0f0 con 0x7fa2780cd030 2023-10-06T01:40:17.775 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.771+0000 7fa27759e700 1 -- 172.21.15.71:0/855829520 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa27814d6b0 con 0x7fa2780cd030 2023-10-06T01:40:17.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.771+0000 7fa27759e700 1 -- 172.21.15.71:0/855829520 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2780cf230 con 0x7fa2780cd030 2023-10-06T01:40:17.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.772+0000 7fa26effd700 1 -- 172.21.15.71:0/855829520 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa268011630 con 0x7fa2780cd030 2023-10-06T01:40:17.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.772+0000 7fa26effd700 1 --2- 172.21.15.71:0/855829520 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fa258066f30 0x7fa2580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:17.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.772+0000 7fa26dd9b700 1 --2- 172.21.15.71:0/855829520 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fa258066f30 0x7fa2580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:17.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.772+0000 7fa26effd700 1 -- 172.21.15.71:0/855829520 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fa268085f40 con 0x7fa2780cd030 2023-10-06T01:40:17.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.773+0000 7fa26dd9b700 1 --2- 172.21.15.71:0/855829520 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fa258066f30 0x7fa2580693e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa2780b28d0 tx=0x7fa260007eb0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:17.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:17.776+0000 7fa26effd700 1 -- 172.21.15.71:0/855829520 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa2680533a0 con 0x7fa2780cd030 2023-10-06T01:40:18.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.002+0000 7fa27759e700 1 -- 172.21.15.71:0/855829520 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa2780b31f0 con 0x7fa2780cd030 2023-10-06T01:40:18.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.003+0000 7fa26effd700 1 -- 172.21.15.71:0/855829520 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3521 (secure 0 0 0) 0x7fa2680569c0 con 0x7fa2780cd030 2023-10-06T01:40:18.004 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:40:18.004 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6836/274053969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":274053969},{"type":"v1","addr":"172.21.15.71:6836","nonce":274053969}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/4158221694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6835","nonce":4158221694},{"type":"v1","addr":"172.21.15.71:6837","nonce":4158221694}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/1094581488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":1094581488},{"type":"v1","addr":"172.21.15.72:6835","nonce":1094581488}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4315,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6834/2361644634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6833","nonce":2361644634},{"type":"v1","addr":"172.21.15.72:6834","nonce":2361644634}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-10-06T01:40:18.006 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.005+0000 7fa27759e700 1 -- 172.21.15.71:0/855829520 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fa258066f30 msgr2=0x7fa2580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:18.006 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.005+0000 7fa27759e700 1 --2- 172.21.15.71:0/855829520 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fa258066f30 0x7fa2580693e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa2780b28d0 tx=0x7fa260007eb0 comp rx=0 tx=0).stop 2023-10-06T01:40:18.006 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.005+0000 7fa27759e700 1 -- 172.21.15.71:0/855829520 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa2780cd030 msgr2=0x7fa27814ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:18.006 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.005+0000 7fa27759e700 1 --2- 172.21.15.71:0/855829520 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa2780cd030 0x7fa27814ef20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa268006210 tx=0x7fa268016000 comp rx=0 tx=0).stop 2023-10-06T01:40:18.006 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.005+0000 7fa27759e700 1 -- 172.21.15.71:0/855829520 shutdown_connections 2023-10-06T01:40:18.006 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.005+0000 7fa27759e700 1 --2- 172.21.15.71:0/855829520 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fa258066f30 0x7fa2580693e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:18.006 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.005+0000 7fa27759e700 1 --2- 172.21.15.71:0/855829520 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa278159400 0x7fa2781542b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:18.006 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.005+0000 7fa27759e700 1 --2- 172.21.15.71:0/855829520 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa2780cd030 0x7fa27814ef20 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:18.007 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.005+0000 7fa27759e700 1 --2- 172.21.15.71:0/855829520 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa2780d05d0 0x7fa27814bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:18.007 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.005+0000 7fa27759e700 1 -- 172.21.15.71:0/855829520 >> 172.21.15.71:0/855829520 conn(0x7fa27806ac10 msgr2=0x7fa2780cfec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:18.007 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.005+0000 7fa27759e700 1 -- 172.21.15.71:0/855829520 shutdown_connections 2023-10-06T01:40:18.007 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.005+0000 7fa27759e700 1 -- 172.21.15.71:0/855829520 wait complete. 2023-10-06T01:40:18.007 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 3 2023-10-06T01:40:18.018 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:40:18.131 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.131+0000 7f21ef92b700 1 Processor -- start 2023-10-06T01:40:18.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.131+0000 7f21ef92b700 1 -- start start 2023-10-06T01:40:18.134 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.132+0000 7f21ef92b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f21e80abd80 0x7f21e815a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:18.134 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.132+0000 7f21ef92b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f21e80ac150 0x7f21e8157bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:18.134 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.132+0000 7f21ef92b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21e80c1de0 0x7f21e8068680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:18.134 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.132+0000 7f21ef92b700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21e80c3220 con 0x7f21e80ac150 2023-10-06T01:40:18.134 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.132+0000 7f21ef92b700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21e815aed0 con 0x7f21e80abd80 2023-10-06T01:40:18.134 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.132+0000 7f21ef92b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21e8159dd0 con 0x7f21e80c1de0 2023-10-06T01:40:18.134 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.132+0000 7f21ecec6700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f21e80ac150 0x7f21e8157bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:18.134 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.132+0000 7f21ecec6700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f21e80ac150 0x7f21e8157bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:49552/0 (socket says 172.21.15.71:49552) 2023-10-06T01:40:18.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.132+0000 7f21ecec6700 1 -- 172.21.15.71:0/1411388897 learned_addr learned my addr 172.21.15.71:0/1411388897 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:18.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.132+0000 7f21ed6c7700 1 --2- 172.21.15.71:0/1411388897 >> v2:172.21.15.72:3300/0 conn(0x7f21e80abd80 0x7f21e815a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:18.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.132+0000 7f21edec8700 1 --2- 172.21.15.71:0/1411388897 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21e80c1de0 0x7f21e8068680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:18.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.132+0000 7f21ecec6700 1 -- 172.21.15.71:0/1411388897 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21e80c1de0 msgr2=0x7f21e8068680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:18.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.132+0000 7f21ecec6700 1 --2- 172.21.15.71:0/1411388897 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21e80c1de0 0x7f21e8068680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:18.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.132+0000 7f21ecec6700 1 -- 172.21.15.71:0/1411388897 >> v2:172.21.15.72:3300/0 conn(0x7f21e80abd80 msgr2=0x7f21e815a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:18.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.132+0000 7f21ecec6700 1 --2- 172.21.15.71:0/1411388897 >> v2:172.21.15.72:3300/0 conn(0x7f21e80abd80 0x7f21e815a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:18.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.132+0000 7f21ecec6700 1 -- 172.21.15.71:0/1411388897 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21e80ccfd0 con 0x7f21e80ac150 2023-10-06T01:40:18.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.132+0000 7f21ecec6700 1 --2- 172.21.15.71:0/1411388897 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21e80ac150 0x7f21e8157bb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f21e8063ba0 tx=0x7f21dc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b56df147b44a92e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:18.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.132+0000 7f21e7fff700 1 -- 172.21.15.71:0/1411388897 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21dc00b640 con 0x7f21e80ac150 2023-10-06T01:40:18.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.132+0000 7f21e7fff700 1 -- 172.21.15.71:0/1411388897 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21dc00b7a0 con 0x7f21e80ac150 2023-10-06T01:40:18.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.132+0000 7f21e7fff700 1 -- 172.21.15.71:0/1411388897 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21dc00bb60 con 0x7f21e80ac150 2023-10-06T01:40:18.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.133+0000 7f21ef92b700 1 -- 172.21.15.71:0/1411388897 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21e80ac150 msgr2=0x7f21e8157bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:18.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.133+0000 7f21ef92b700 1 --2- 172.21.15.71:0/1411388897 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21e80ac150 0x7f21e8157bb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f21e8063ba0 tx=0x7f21dc009250 comp rx=0 tx=0).stop 2023-10-06T01:40:18.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.133+0000 7f21ef92b700 1 -- 172.21.15.71:0/1411388897 shutdown_connections 2023-10-06T01:40:18.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.133+0000 7f21ef92b700 1 --2- 172.21.15.71:0/1411388897 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21e80c1de0 0x7f21e8068680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:18.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.133+0000 7f21ef92b700 1 --2- 172.21.15.71:0/1411388897 >> v2:172.21.15.72:3300/0 conn(0x7f21e80abd80 0x7f21e815a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:18.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.133+0000 7f21ef92b700 1 --2- 172.21.15.71:0/1411388897 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21e80ac150 0x7f21e8157bb0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:18.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.133+0000 7f21ef92b700 1 -- 172.21.15.71:0/1411388897 >> 172.21.15.71:0/1411388897 conn(0x7f21e8069790 msgr2=0x7f21e8069b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:18.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.133+0000 7f21ef92b700 1 -- 172.21.15.71:0/1411388897 shutdown_connections 2023-10-06T01:40:18.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.133+0000 7f21ef92b700 1 -- 172.21.15.71:0/1411388897 wait complete. 2023-10-06T01:40:18.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.134+0000 7f21ef92b700 1 Processor -- start 2023-10-06T01:40:18.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.134+0000 7f21ef92b700 1 -- start start 2023-10-06T01:40:18.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.135+0000 7f21ef92b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21e80abd80 0x7f21e813fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:18.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.135+0000 7f21ef92b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21e80ac150 0x7f21e80c9540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:18.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.135+0000 7f21ef92b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21e80c1de0 0x7f21e80c9a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:18.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.135+0000 7f21ef92b700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21e80c69b0 con 0x7f21e80abd80 2023-10-06T01:40:18.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.135+0000 7f21ef92b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21e80c5da0 con 0x7f21e80ac150 2023-10-06T01:40:18.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.135+0000 7f21ef92b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21e80c6080 con 0x7f21e80c1de0 2023-10-06T01:40:18.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.135+0000 7f21ed6c7700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21e80abd80 0x7f21e813fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:18.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.135+0000 7f21ed6c7700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21e80abd80 0x7f21e813fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:49564/0 (socket says 172.21.15.71:49564) 2023-10-06T01:40:18.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.135+0000 7f21ed6c7700 1 -- 172.21.15.71:0/1608394217 learned_addr learned my addr 172.21.15.71:0/1608394217 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:18.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.135+0000 7f21ecec6700 1 --2- 172.21.15.71:0/1608394217 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21e80ac150 0x7f21e80c9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:18.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.135+0000 7f21edec8700 1 --2- 172.21.15.71:0/1608394217 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21e80c1de0 0x7f21e80c9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:18.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.135+0000 7f21ed6c7700 1 -- 172.21.15.71:0/1608394217 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21e80c1de0 msgr2=0x7f21e80c9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:18.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.135+0000 7f21ed6c7700 1 --2- 172.21.15.71:0/1608394217 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21e80c1de0 0x7f21e80c9a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:18.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.135+0000 7f21ed6c7700 1 -- 172.21.15.71:0/1608394217 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21e80ac150 msgr2=0x7f21e80c9540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:18.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.135+0000 7f21ed6c7700 1 --2- 172.21.15.71:0/1608394217 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21e80ac150 0x7f21e80c9540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:18.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.135+0000 7f21ed6c7700 1 -- 172.21.15.71:0/1608394217 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21dc0094f0 con 0x7f21e80abd80 2023-10-06T01:40:18.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.135+0000 7f21ecec6700 1 --2- 172.21.15.71:0/1608394217 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21e80ac150 0x7f21e80c9540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:40:18.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.135+0000 7f21ed6c7700 1 --2- 172.21.15.71:0/1608394217 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21e80abd80 0x7f21e813fda0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f21e000ec80 tx=0x7f21e00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:18.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.136+0000 7f21e57fa700 1 -- 172.21.15.71:0/1608394217 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e000c9d0 con 0x7f21e80abd80 2023-10-06T01:40:18.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.136+0000 7f21e57fa700 1 -- 172.21.15.71:0/1608394217 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21e000cb30 con 0x7f21e80abd80 2023-10-06T01:40:18.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.136+0000 7f21e57fa700 1 -- 172.21.15.71:0/1608394217 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e0013470 con 0x7f21e80abd80 2023-10-06T01:40:18.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.136+0000 7f21ef92b700 1 -- 172.21.15.71:0/1608394217 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21e80c6360 con 0x7f21e80abd80 2023-10-06T01:40:18.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.136+0000 7f21ef92b700 1 -- 172.21.15.71:0/1608394217 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21e81402e0 con 0x7f21e80abd80 2023-10-06T01:40:18.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.137+0000 7f21ef92b700 1 -- 172.21.15.71:0/1608394217 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21e804bb80 con 0x7f21e80abd80 2023-10-06T01:40:18.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.137+0000 7f21e57fa700 1 -- 172.21.15.71:0/1608394217 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f21e0013820 con 0x7f21e80abd80 2023-10-06T01:40:18.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.137+0000 7f21e57fa700 1 --2- 172.21.15.71:0/1608394217 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f21d4066f30 0x7f21d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:18.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.137+0000 7f21e57fa700 1 -- 172.21.15.71:0/1608394217 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f21e00846d0 con 0x7f21e80abd80 2023-10-06T01:40:18.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.137+0000 7f21ecec6700 1 --2- 172.21.15.71:0/1608394217 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f21d4066f30 0x7f21d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:18.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.138+0000 7f21ecec6700 1 --2- 172.21.15.71:0/1608394217 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f21d4066f30 0x7f21d40693e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f21e8063ba0 tx=0x7f21dc017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:18.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.142+0000 7f21e57fa700 1 -- 172.21.15.71:0/1608394217 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f21e0051b30 con 0x7f21e80abd80 2023-10-06T01:40:18.325 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.325+0000 7f21ef92b700 1 -- 172.21.15.71:0/1608394217 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f21e80691c0 con 0x7f21e80abd80 2023-10-06T01:40:18.326 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.326+0000 7f21e57fa700 1 -- 172.21.15.71:0/1608394217 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+13599 (secure 0 0 0) 0x7f21e0055150 con 0x7f21e80abd80 2023-10-06T01:40:18.326 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:40:18.327 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":19,"fsid":"1fbf1bd2-f9b4-4599-bea2-f4aa920e9a56","created":"2023-10-06T01:39:57.016957+0000","modified":"2023-10-06T01:40:17.643717+0000","last_up_change":"2023-10-06T01:40:08.571643+0000","last_in_change":"2023-10-06T01:39:59.462741+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T01:40:08.610349+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T01:40:15.387434+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"cf059188-fb20-4dbf-95db-dcf57b213d03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":90670},{"type":"v1","addr":"172.21.15.71:6817","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":90670},{"type":"v1","addr":"172.21.15.71:6819","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":90670},{"type":"v1","addr":"172.21.15.71:6823","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":90670},{"type":"v1","addr":"172.21.15.71:6821","nonce":90670}]},"public_addr":"172.21.15.71:6817/90670","cluster_addr":"172.21.15.71:6819/90670","heartbeat_back_addr":"172.21.15.71:6823/90670","heartbeat_front_addr":"172.21.15.71:6821/90670","state":["exists","up"]},{"osd":1,"uuid":"0cff0aae-1799-4fe0-b610-54cf0813c0e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":90669},{"type":"v1","addr":"172.21.15.71:6809","nonce":90669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":90669},{"type":"v1","addr":"172.21.15.71:6811","nonce":90669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":90669},{"type":"v1","addr":"172.21.15.71:6815","nonce":90669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":90669},{"type":"v1","addr":"172.21.15.71:6813","nonce":90669}]},"public_addr":"172.21.15.71:6809/90669","cluster_addr":"172.21.15.71:6811/90669","heartbeat_back_addr":"172.21.15.71:6815/90669","heartbeat_front_addr":"172.21.15.71:6813/90669","state":["exists","up"]},{"osd":2,"uuid":"88d61ddc-9031-44e1-ba8c-546a41e7c8ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":90679},{"type":"v1","addr":"172.21.15.71:6825","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":90679},{"type":"v1","addr":"172.21.15.71:6827","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":90679},{"type":"v1","addr":"172.21.15.71:6831","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":90679},{"type":"v1","addr":"172.21.15.71:6829","nonce":90679}]},"public_addr":"172.21.15.71:6825/90679","cluster_addr":"172.21.15.71:6827/90679","heartbeat_back_addr":"172.21.15.71:6831/90679","heartbeat_front_addr":"172.21.15.71:6829/90679","state":["exists","up"]},{"osd":3,"uuid":"11ed92b7-960b-4a30-a889-a61d3eeb86f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":90668},{"type":"v1","addr":"172.21.15.71:6801","nonce":90668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":90668},{"type":"v1","addr":"172.21.15.71:6803","nonce":90668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":90668},{"type":"v1","addr":"172.21.15.71:6807","nonce":90668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":90668},{"type":"v1","addr":"172.21.15.71:6805","nonce":90668}]},"public_addr":"172.21.15.71:6801/90668","cluster_addr":"172.21.15.71:6803/90668","heartbeat_back_addr":"172.21.15.71:6807/90668","heartbeat_front_addr":"172.21.15.71:6805/90668","state":["exists","up"]},{"osd":4,"uuid":"ae4df784-abdf-4ddf-aefa-780f3ddafef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":90917},{"type":"v1","addr":"172.21.15.72:6801","nonce":90917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":90917},{"type":"v1","addr":"172.21.15.72:6803","nonce":90917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":90917},{"type":"v1","addr":"172.21.15.72:6807","nonce":90917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":90917},{"type":"v1","addr":"172.21.15.72:6805","nonce":90917}]},"public_addr":"172.21.15.72:6801/90917","cluster_addr":"172.21.15.72:6803/90917","heartbeat_back_addr":"172.21.15.72:6807/90917","heartbeat_front_addr":"172.21.15.72:6805/90917","state":["exists","up"]},{"osd":5,"uuid":"5ef0790f-001e-458f-a05b-efae216cf435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":90941},{"type":"v1","addr":"172.21.15.72:6817","nonce":90941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":90941},{"type":"v1","addr":"172.21.15.72:6819","nonce":90941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":90941},{"type":"v1","addr":"172.21.15.72:6827","nonce":90941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":90941},{"type":"v1","addr":"172.21.15.72:6823","nonce":90941}]},"public_addr":"172.21.15.72:6817/90941","cluster_addr":"172.21.15.72:6819/90941","heartbeat_back_addr":"172.21.15.72:6827/90941","heartbeat_front_addr":"172.21.15.72:6823/90941","state":["exists","up"]},{"osd":6,"uuid":"8705aef1-9ae8-4e54-a3c4-c2909fa0ceb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":90918},{"type":"v1","addr":"172.21.15.72:6809","nonce":90918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":90918},{"type":"v1","addr":"172.21.15.72:6811","nonce":90918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":90918},{"type":"v1","addr":"172.21.15.72:6815","nonce":90918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":90918},{"type":"v1","addr":"172.21.15.72:6813","nonce":90918}]},"public_addr":"172.21.15.72:6809/90918","cluster_addr":"172.21.15.72:6811/90918","heartbeat_back_addr":"172.21.15.72:6815/90918","heartbeat_front_addr":"172.21.15.72:6813/90918","state":["exists","up"]},{"osd":7,"uuid":"364c5119-6b13-4c75-b3f0-15e165eff86a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":90948},{"type":"v1","addr":"172.21.15.72:6822","nonce":90948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":90948},{"type":"v1","addr":"172.21.15.72:6826","nonce":90948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":90948},{"type":"v1","addr":"172.21.15.72:6831","nonce":90948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":90948},{"type":"v1","addr":"172.21.15.72:6829","nonce":90948}]},"public_addr":"172.21.15.72:6822/90948","cluster_addr":"172.21.15.72:6826/90948","heartbeat_back_addr":"172.21.15.72:6831/90948","heartbeat_front_addr":"172.21.15.72:6829/90948","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.642976+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.645372+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.619116+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.663042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.599163+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.646411+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.631545+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.669821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:40:18.328 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.328+0000 7f21ef92b700 1 -- 172.21.15.71:0/1608394217 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f21d4066f30 msgr2=0x7f21d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:18.329 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.328+0000 7f21ef92b700 1 --2- 172.21.15.71:0/1608394217 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f21d4066f30 0x7f21d40693e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f21e8063ba0 tx=0x7f21dc017000 comp rx=0 tx=0).stop 2023-10-06T01:40:18.329 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.328+0000 7f21ef92b700 1 -- 172.21.15.71:0/1608394217 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21e80abd80 msgr2=0x7f21e813fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:18.329 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.328+0000 7f21ef92b700 1 --2- 172.21.15.71:0/1608394217 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21e80abd80 0x7f21e813fda0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f21e000ec80 tx=0x7f21e00091a0 comp rx=0 tx=0).stop 2023-10-06T01:40:18.329 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.328+0000 7f21ef92b700 1 -- 172.21.15.71:0/1608394217 shutdown_connections 2023-10-06T01:40:18.329 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.328+0000 7f21ef92b700 1 --2- 172.21.15.71:0/1608394217 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21e80c1de0 0x7f21e80c9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:18.329 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.328+0000 7f21ef92b700 1 --2- 172.21.15.71:0/1608394217 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21e80abd80 0x7f21e813fda0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:18.329 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.328+0000 7f21ef92b700 1 --2- 172.21.15.71:0/1608394217 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f21d4066f30 0x7f21d40693e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:18.329 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.328+0000 7f21ef92b700 1 --2- 172.21.15.71:0/1608394217 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21e80ac150 0x7f21e80c9540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:18.329 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.328+0000 7f21ef92b700 1 -- 172.21.15.71:0/1608394217 >> 172.21.15.71:0/1608394217 conn(0x7f21e8069790 msgr2=0x7f21e8140690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:18.329 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.328+0000 7f21ef92b700 1 -- 172.21.15.71:0/1608394217 shutdown_connections 2023-10-06T01:40:18.330 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.328+0000 7f21ef92b700 1 -- 172.21.15.71:0/1608394217 wait complete. 2023-10-06T01:40:18.340 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T01:40:08.610349+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T01:40:15.387434+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-10-06T01:40:18.341 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T01:40:18.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.456+0000 7f0aeae19700 1 Processor -- start 2023-10-06T01:40:18.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.456+0000 7f0aeae19700 1 -- start start 2023-10-06T01:40:18.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.457+0000 7f0aeae19700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ae40cd7d0 0x7f0ae40d01a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:18.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.457+0000 7f0aeae19700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f0ae40b0810 0x7f0ae40d06e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:18.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.457+0000 7f0aeae19700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ae40d0c20 con 0x7f0ae40cd400 2023-10-06T01:40:18.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.457+0000 7f0aeae19700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ae40af770 con 0x7f0ae40b0810 2023-10-06T01:40:18.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.457+0000 7f0aeae19700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae40afa50 con 0x7f0ae40cd7d0 2023-10-06T01:40:18.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.457+0000 7f0aea618700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f0ae40b0810 0x7f0ae40d06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:18.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.457+0000 7f0aea618700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f0ae40b0810 0x7f0ae40d06e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:49568/0 (socket says 172.21.15.71:49568) 2023-10-06T01:40:18.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.457+0000 7f0aea618700 1 -- 172.21.15.71:0/1596169776 learned_addr learned my addr 172.21.15.71:0/1596169776 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:18.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.457+0000 7f0ae9616700 1 --2- 172.21.15.71:0/1596169776 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ae40cd7d0 0x7f0ae40d01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:18.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.457+0000 7f0aea618700 1 -- 172.21.15.71:0/1596169776 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ae40cd7d0 msgr2=0x7f0ae40d01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:18.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.457+0000 7f0aea618700 1 --2- 172.21.15.71:0/1596169776 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ae40cd7d0 0x7f0ae40d01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:18.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.457+0000 7f0aea618700 1 -- 172.21.15.71:0/1596169776 >> v1:172.21.15.72:6789/0 conn(0x7f0ae40cd400 legacy=0x7f0ae40b1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:18.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.457+0000 7f0aea618700 1 -- 172.21.15.71:0/1596169776 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ae40afd30 con 0x7f0ae40b0810 2023-10-06T01:40:18.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.457+0000 7f0ae8e15700 1 -- 172.21.15.71:0/1596169776 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1477547057 0 0) 0x7f0ae40d0c20 con 0x7f0ae40cd400 2023-10-06T01:40:18.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.457+0000 7f0aea618700 1 --2- 172.21.15.71:0/1596169776 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ae40b0810 0x7f0ae40d06e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0adc009f20 tx=0x7f0adc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcb20f0a292d8748 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:18.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.457+0000 7f0ae8e15700 1 -- 172.21.15.71:0/1596169776 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0adc00e070 con 0x7f0ae40b0810 2023-10-06T01:40:18.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.457+0000 7f0ae8e15700 1 -- 172.21.15.71:0/1596169776 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0adc00b9d0 con 0x7f0ae40b0810 2023-10-06T01:40:18.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.457+0000 7f0ae8e15700 1 -- 172.21.15.71:0/1596169776 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0adc0092e0 con 0x7f0ae40b0810 2023-10-06T01:40:18.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.458+0000 7f0aeae19700 1 -- 172.21.15.71:0/1596169776 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ae40b0810 msgr2=0x7f0ae40d06e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:18.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.458+0000 7f0aeae19700 1 --2- 172.21.15.71:0/1596169776 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ae40b0810 0x7f0ae40d06e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0adc009f20 tx=0x7f0adc009840 comp rx=0 tx=0).stop 2023-10-06T01:40:18.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.458+0000 7f0aeae19700 1 -- 172.21.15.71:0/1596169776 shutdown_connections 2023-10-06T01:40:18.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.458+0000 7f0aeae19700 1 --2- 172.21.15.71:0/1596169776 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ae40b0810 0x7f0ae40d06e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:18.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.458+0000 7f0aeae19700 1 --2- 172.21.15.71:0/1596169776 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ae40cd7d0 0x7f0ae40d01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:18.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.458+0000 7f0aeae19700 1 -- 172.21.15.71:0/1596169776 >> 172.21.15.71:0/1596169776 conn(0x7f0ae406a110 msgr2=0x7f0ae406a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:18.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.458+0000 7f0aeae19700 1 -- 172.21.15.71:0/1596169776 shutdown_connections 2023-10-06T01:40:18.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.458+0000 7f0aeae19700 1 -- 172.21.15.71:0/1596169776 wait complete. 2023-10-06T01:40:18.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.459+0000 7f0aeae19700 1 Processor -- start 2023-10-06T01:40:18.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.459+0000 7f0aeae19700 1 -- start start 2023-10-06T01:40:18.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.460+0000 7f0aeae19700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ae40b0810 0x7f0ae41588c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:18.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.460+0000 7f0aeae19700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ae40cd400 0x7f0ae4155f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:18.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.460+0000 7f0aeae19700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ae4156490 0x7f0ae4152650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:18.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.460+0000 7f0aeae19700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae414ae60 con 0x7f0ae40cd400 2023-10-06T01:40:18.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.460+0000 7f0aeae19700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae4156930 con 0x7f0ae40b0810 2023-10-06T01:40:18.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.460+0000 7f0aeae19700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae40c7bc0 con 0x7f0ae4156490 2023-10-06T01:40:18.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.460+0000 7f0ae9616700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ae40cd400 0x7f0ae4155f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:18.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.460+0000 7f0ae9616700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ae40cd400 0x7f0ae4155f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:49580/0 (socket says 172.21.15.71:49580) 2023-10-06T01:40:18.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.460+0000 7f0ae9616700 1 -- 172.21.15.71:0/631316186 learned_addr learned my addr 172.21.15.71:0/631316186 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:18.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.460+0000 7f0aea618700 1 --2- 172.21.15.71:0/631316186 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ae4156490 0x7f0ae4152650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:18.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.460+0000 7f0ae9e17700 1 --2- 172.21.15.71:0/631316186 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ae40b0810 0x7f0ae41588c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:18.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.460+0000 7f0ae9616700 1 -- 172.21.15.71:0/631316186 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ae4156490 msgr2=0x7f0ae4152650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:18.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.460+0000 7f0ae9616700 1 --2- 172.21.15.71:0/631316186 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ae4156490 0x7f0ae4152650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:18.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.460+0000 7f0ae9616700 1 -- 172.21.15.71:0/631316186 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ae40b0810 msgr2=0x7f0ae41588c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:18.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.460+0000 7f0ae9616700 1 --2- 172.21.15.71:0/631316186 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ae40b0810 0x7f0ae41588c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:18.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.460+0000 7f0ae9616700 1 -- 172.21.15.71:0/631316186 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0adc009ae0 con 0x7f0ae40cd400 2023-10-06T01:40:18.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.460+0000 7f0ae9e17700 1 --2- 172.21.15.71:0/631316186 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ae40b0810 0x7f0ae41588c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:40:18.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.460+0000 7f0ae9616700 1 --2- 172.21.15.71:0/631316186 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ae40cd400 0x7f0ae4155f50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0ad400ec80 tx=0x7f0ad40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:18.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.461+0000 7f0ad9ffb700 1 -- 172.21.15.71:0/631316186 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad400c850 con 0x7f0ae40cd400 2023-10-06T01:40:18.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.461+0000 7f0ad9ffb700 1 -- 172.21.15.71:0/631316186 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ad400c9b0 con 0x7f0ae40cd400 2023-10-06T01:40:18.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.461+0000 7f0aeae19700 1 -- 172.21.15.71:0/631316186 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ae40c7d50 con 0x7f0ae40cd400 2023-10-06T01:40:18.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.461+0000 7f0ad9ffb700 1 -- 172.21.15.71:0/631316186 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad400cd50 con 0x7f0ae40cd400 2023-10-06T01:40:18.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.461+0000 7f0aeae19700 1 -- 172.21.15.71:0/631316186 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ae4153690 con 0x7f0ae40cd400 2023-10-06T01:40:18.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.462+0000 7f0aeae19700 1 -- 172.21.15.71:0/631316186 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ae40c7ee0 con 0x7f0ae40cd400 2023-10-06T01:40:18.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.462+0000 7f0ad9ffb700 1 -- 172.21.15.71:0/631316186 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0ad4013680 con 0x7f0ae40cd400 2023-10-06T01:40:18.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.462+0000 7f0ad9ffb700 1 --2- 172.21.15.71:0/631316186 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f0ac8066f30 0x7f0ac80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:18.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.463+0000 7f0ad9ffb700 1 -- 172.21.15.71:0/631316186 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f0ad4084600 con 0x7f0ae40cd400 2023-10-06T01:40:18.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.463+0000 7f0ae9e17700 1 --2- 172.21.15.71:0/631316186 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f0ac8066f30 0x7f0ac80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:18.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.463+0000 7f0ae9e17700 1 --2- 172.21.15.71:0/631316186 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f0ac8066f30 0x7f0ac80693e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0ae0001860 tx=0x7f0ae0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:18.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.467+0000 7f0ad9ffb700 1 -- 172.21.15.71:0/631316186 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0ad4051a60 con 0x7f0ae40cd400 2023-10-06T01:40:18.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.649+0000 7f0aeae19700 1 -- 172.21.15.71:0/631316186 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0ae40c3970 con 0x7f0ae40cd400 2023-10-06T01:40:18.651 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.650+0000 7f0ad9ffb700 1 -- 172.21.15.71:0/631316186 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0ad4055080 con 0x7f0ae40cd400 2023-10-06T01:40:18.651 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 1 2023-10-06T01:40:18.653 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.652+0000 7f0aeae19700 1 -- 172.21.15.71:0/631316186 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f0ac8066f30 msgr2=0x7f0ac80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:18.653 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.652+0000 7f0aeae19700 1 --2- 172.21.15.71:0/631316186 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f0ac8066f30 0x7f0ac80693e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0ae0001860 tx=0x7f0ae0009040 comp rx=0 tx=0).stop 2023-10-06T01:40:18.653 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.652+0000 7f0aeae19700 1 -- 172.21.15.71:0/631316186 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ae40cd400 msgr2=0x7f0ae4155f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:18.653 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.652+0000 7f0aeae19700 1 --2- 172.21.15.71:0/631316186 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ae40cd400 0x7f0ae4155f50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0ad400ec80 tx=0x7f0ad40091a0 comp rx=0 tx=0).stop 2023-10-06T01:40:18.653 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.652+0000 7f0aeae19700 1 -- 172.21.15.71:0/631316186 shutdown_connections 2023-10-06T01:40:18.653 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.652+0000 7f0aeae19700 1 --2- 172.21.15.71:0/631316186 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0ae4156490 0x7f0ae4152650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:18.653 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.652+0000 7f0aeae19700 1 --2- 172.21.15.71:0/631316186 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f0ac8066f30 0x7f0ac80693e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:18.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.652+0000 7f0aeae19700 1 --2- 172.21.15.71:0/631316186 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ae40b0810 0x7f0ae41588c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:18.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.652+0000 7f0aeae19700 1 --2- 172.21.15.71:0/631316186 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ae40cd400 0x7f0ae4155f50 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:18.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.652+0000 7f0aeae19700 1 -- 172.21.15.71:0/631316186 >> 172.21.15.71:0/631316186 conn(0x7f0ae406a110 msgr2=0x7f0ae40b2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:18.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.652+0000 7f0aeae19700 1 -- 172.21.15.71:0/631316186 shutdown_connections 2023-10-06T01:40:18.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.652+0000 7f0aeae19700 1 -- 172.21.15.71:0/631316186 wait complete. 2023-10-06T01:40:18.664 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T01:40:18.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.782+0000 7f36b33f2700 1 Processor -- start 2023-10-06T01:40:18.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.783+0000 7f36b33f2700 1 -- start start 2023-10-06T01:40:18.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.783+0000 7f36b33f2700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f36ac0d0400 0x7f36ac0b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:18.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.783+0000 7f36b33f2700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f36ac0ccd40 0x7f36ac0cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:18.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.783+0000 7f36b33f2700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36ac0b6170 con 0x7f36ac0cf7e0 2023-10-06T01:40:18.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.783+0000 7f36b33f2700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36ac15dd40 con 0x7f36ac0ccd40 2023-10-06T01:40:18.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.783+0000 7f36b33f2700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36ac15e020 con 0x7f36ac0d0400 2023-10-06T01:40:18.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.784+0000 7f36b098d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f36ac0ccd40 0x7f36ac0cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:18.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.784+0000 7f36b198f700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f36ac0cf7e0 0x7f36ac0b3aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:54608/0 (socket says 172.21.15.71:54608) 2023-10-06T01:40:18.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.784+0000 7f36b198f700 1 -- 172.21.15.71:0/3322578411 learned_addr learned my addr 172.21.15.71:0/3322578411 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:40:18.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.784+0000 7f36b118e700 1 --2- 172.21.15.71:0/3322578411 >> v2:172.21.15.72:3300/0 conn(0x7f36ac0d0400 0x7f36ac0b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:18.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.784+0000 7f36b098d700 1 -- 172.21.15.71:0/3322578411 >> v2:172.21.15.72:3300/0 conn(0x7f36ac0d0400 msgr2=0x7f36ac0b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:18.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.784+0000 7f36b098d700 1 --2- 172.21.15.71:0/3322578411 >> v2:172.21.15.72:3300/0 conn(0x7f36ac0d0400 0x7f36ac0b5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:18.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.784+0000 7f36a3fff700 1 -- 172.21.15.71:0/3322578411 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4290686959 0 0) 0x7f36ac0b6170 con 0x7f36ac0cf7e0 2023-10-06T01:40:18.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.784+0000 7f36b098d700 1 -- 172.21.15.71:0/3322578411 >> v1:172.21.15.71:6789/0 conn(0x7f36ac0cf7e0 legacy=0x7f36ac0b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:18.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.784+0000 7f36b098d700 1 -- 172.21.15.71:0/3322578411 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36ac0ceaa0 con 0x7f36ac0ccd40 2023-10-06T01:40:18.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.784+0000 7f36b118e700 1 --2- 172.21.15.71:0/3322578411 >> v2:172.21.15.72:3300/0 conn(0x7f36ac0d0400 0x7f36ac0b5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:40:18.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.784+0000 7f36b098d700 1 --2- 172.21.15.71:0/3322578411 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36ac0ccd40 0x7f36ac0cf2a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f36ac088f30 tx=0x7f369c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86d44d761d041bf4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:18.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.784+0000 7f36a3fff700 1 -- 172.21.15.71:0/3322578411 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369c00b6b0 con 0x7f36ac0ccd40 2023-10-06T01:40:18.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.784+0000 7f36a3fff700 1 -- 172.21.15.71:0/3322578411 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f369c00b810 con 0x7f36ac0ccd40 2023-10-06T01:40:18.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.784+0000 7f36a3fff700 1 -- 172.21.15.71:0/3322578411 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369c00bbb0 con 0x7f36ac0ccd40 2023-10-06T01:40:18.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.785+0000 7f36b33f2700 1 -- 172.21.15.71:0/3322578411 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36ac0ccd40 msgr2=0x7f36ac0cf2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:18.788 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.785+0000 7f36b33f2700 1 --2- 172.21.15.71:0/3322578411 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36ac0ccd40 0x7f36ac0cf2a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f36ac088f30 tx=0x7f369c0091a0 comp rx=0 tx=0).stop 2023-10-06T01:40:18.788 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.785+0000 7f36b33f2700 1 -- 172.21.15.71:0/3322578411 shutdown_connections 2023-10-06T01:40:18.788 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.785+0000 7f36b33f2700 1 --2- 172.21.15.71:0/3322578411 >> v2:172.21.15.72:3300/0 conn(0x7f36ac0d0400 0x7f36ac0b5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:18.788 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.785+0000 7f36b33f2700 1 --2- 172.21.15.71:0/3322578411 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36ac0ccd40 0x7f36ac0cf2a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:18.788 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.785+0000 7f36b33f2700 1 -- 172.21.15.71:0/3322578411 >> 172.21.15.71:0/3322578411 conn(0x7f36ac06a220 msgr2=0x7f36ac06a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:18.788 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.785+0000 7f36b33f2700 1 -- 172.21.15.71:0/3322578411 shutdown_connections 2023-10-06T01:40:18.788 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.785+0000 7f36b33f2700 1 -- 172.21.15.71:0/3322578411 wait complete. 2023-10-06T01:40:18.791 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.786+0000 7f36b33f2700 1 Processor -- start 2023-10-06T01:40:18.791 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.786+0000 7f36b33f2700 1 -- start start 2023-10-06T01:40:18.791 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.787+0000 7f36b33f2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36ac0ccd40 0x7f36ac146190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:18.791 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.787+0000 7f36b33f2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36ac0cf7e0 0x7f36ac15bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:18.792 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.787+0000 7f36b33f2700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36ac0d0400 0x7f36ac0c6b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:18.792 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.787+0000 7f36b33f2700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36ac0c5c90 con 0x7f36ac0d0400 2023-10-06T01:40:18.792 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.787+0000 7f36b33f2700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36ac0c5f70 con 0x7f36ac0ccd40 2023-10-06T01:40:18.792 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.787+0000 7f36b33f2700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36ac0c6250 con 0x7f36ac0cf7e0 2023-10-06T01:40:18.792 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.787+0000 7f36b198f700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36ac0d0400 0x7f36ac0c6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:18.792 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.787+0000 7f36b198f700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36ac0d0400 0x7f36ac0c6b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:49590/0 (socket says 172.21.15.71:49590) 2023-10-06T01:40:18.792 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.787+0000 7f36b198f700 1 -- 172.21.15.71:0/442088103 learned_addr learned my addr 172.21.15.71:0/442088103 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:18.792 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.787+0000 7f36b118e700 1 --2- 172.21.15.71:0/442088103 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36ac0ccd40 0x7f36ac146190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:18.792 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.787+0000 7f36b098d700 1 --2- 172.21.15.71:0/442088103 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36ac0cf7e0 0x7f36ac15bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:18.792 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.787+0000 7f36b198f700 1 -- 172.21.15.71:0/442088103 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36ac0cf7e0 msgr2=0x7f36ac15bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:18.792 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.787+0000 7f36b198f700 1 --2- 172.21.15.71:0/442088103 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36ac0cf7e0 0x7f36ac15bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:18.793 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.787+0000 7f36b198f700 1 -- 172.21.15.71:0/442088103 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36ac0ccd40 msgr2=0x7f36ac146190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:18.793 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.787+0000 7f36b198f700 1 --2- 172.21.15.71:0/442088103 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36ac0ccd40 0x7f36ac146190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:18.793 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.787+0000 7f36b198f700 1 -- 172.21.15.71:0/442088103 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f369c009420 con 0x7f36ac0d0400 2023-10-06T01:40:18.793 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.787+0000 7f36b198f700 1 --2- 172.21.15.71:0/442088103 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36ac0d0400 0x7f36ac0c6b40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f36a400cc90 tx=0x7f36a4001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:18.793 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.787+0000 7f36a17fa700 1 -- 172.21.15.71:0/442088103 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a400a8b0 con 0x7f36ac0d0400 2023-10-06T01:40:18.793 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.787+0000 7f36a17fa700 1 -- 172.21.15.71:0/442088103 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36a400aa10 con 0x7f36ac0d0400 2023-10-06T01:40:18.793 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.787+0000 7f36b33f2700 1 -- 172.21.15.71:0/442088103 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36ac159f90 con 0x7f36ac0d0400 2023-10-06T01:40:18.793 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.787+0000 7f36a17fa700 1 -- 172.21.15.71:0/442088103 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a400add0 con 0x7f36ac0d0400 2023-10-06T01:40:18.793 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.787+0000 7f36b33f2700 1 -- 172.21.15.71:0/442088103 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36ac154600 con 0x7f36ac0d0400 2023-10-06T01:40:18.793 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.788+0000 7f36b33f2700 1 -- 172.21.15.71:0/442088103 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36ac0c5a50 con 0x7f36ac0d0400 2023-10-06T01:40:18.793 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.789+0000 7f36a17fa700 1 -- 172.21.15.71:0/442088103 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f36a4007300 con 0x7f36ac0d0400 2023-10-06T01:40:18.793 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.789+0000 7f36a17fa700 1 --2- 172.21.15.71:0/442088103 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f3690066f30 0x7f36900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:18.794 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.789+0000 7f36a17fa700 1 -- 172.21.15.71:0/442088103 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f36a4084660 con 0x7f36ac0d0400 2023-10-06T01:40:18.794 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.789+0000 7f36b118e700 1 --2- 172.21.15.71:0/442088103 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f3690066f30 0x7f36900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:18.794 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.789+0000 7f36b118e700 1 --2- 172.21.15.71:0/442088103 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f3690066f30 0x7f36900693e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f36a800aca0 tx=0x7f36a8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:18.794 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.793+0000 7f36a17fa700 1 -- 172.21.15.71:0/442088103 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f36ac0c5a50 con 0x7f36ac0d0400 2023-10-06T01:40:18.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.975+0000 7f36b33f2700 1 -- 172.21.15.71:0/442088103 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f36ac0c5a50 con 0x7f36ac0d0400 2023-10-06T01:40:18.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.975+0000 7f36a17fa700 1 -- 172.21.15.71:0/442088103 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) v1 ==== 92+0+10 (secure 0 0 0) 0x7f36ac0c5a50 con 0x7f36ac0d0400 2023-10-06T01:40:18.976 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 8 2023-10-06T01:40:18.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.977+0000 7f36b33f2700 1 -- 172.21.15.71:0/442088103 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f3690066f30 msgr2=0x7f36900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:18.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.977+0000 7f36b33f2700 1 --2- 172.21.15.71:0/442088103 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f3690066f30 0x7f36900693e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f36a800aca0 tx=0x7f36a8008040 comp rx=0 tx=0).stop 2023-10-06T01:40:18.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.977+0000 7f36b33f2700 1 -- 172.21.15.71:0/442088103 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36ac0d0400 msgr2=0x7f36ac0c6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:18.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.977+0000 7f36b33f2700 1 --2- 172.21.15.71:0/442088103 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36ac0d0400 0x7f36ac0c6b40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f36a400cc90 tx=0x7f36a4001a80 comp rx=0 tx=0).stop 2023-10-06T01:40:18.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.978+0000 7f36b33f2700 1 -- 172.21.15.71:0/442088103 shutdown_connections 2023-10-06T01:40:18.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.978+0000 7f36b33f2700 1 --2- 172.21.15.71:0/442088103 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f36ac0d0400 0x7f36ac0c6b40 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:18.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.978+0000 7f36b33f2700 1 --2- 172.21.15.71:0/442088103 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f3690066f30 0x7f36900693e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:18.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.978+0000 7f36b33f2700 1 --2- 172.21.15.71:0/442088103 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36ac0ccd40 0x7f36ac146190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:18.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.978+0000 7f36b33f2700 1 --2- 172.21.15.71:0/442088103 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f36ac0cf7e0 0x7f36ac15bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:18.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.978+0000 7f36b33f2700 1 -- 172.21.15.71:0/442088103 >> 172.21.15.71:0/442088103 conn(0x7f36ac06a220 msgr2=0x7f36ac1555f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:18.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.978+0000 7f36b33f2700 1 -- 172.21.15.71:0/442088103 shutdown_connections 2023-10-06T01:40:18.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:18.978+0000 7f36b33f2700 1 -- 172.21.15.71:0/442088103 wait complete. 2023-10-06T01:40:18.990 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T01:40:19.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.103+0000 7f75a1428700 1 Processor -- start 2023-10-06T01:40:19.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.103+0000 7f75a1428700 1 -- start start 2023-10-06T01:40:19.106 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.104+0000 7f75a1428700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f759c15c900 0x7f759c0b5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:19.106 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.104+0000 7f75a1428700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f759c068d90 0x7f759c15abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:19.106 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.104+0000 7f75a1428700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f759c0ce640 con 0x7f759c0cfe20 2023-10-06T01:40:19.106 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.104+0000 7f75a1428700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f759c15a440 con 0x7f759c15c900 2023-10-06T01:40:19.106 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.104+0000 7f75a1428700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f759c15a9c0 con 0x7f759c068d90 2023-10-06T01:40:19.107 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.104+0000 7f759bfff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f759c15c900 0x7f759c0b5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:19.107 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.104+0000 7f75a0c27700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f759c0cfe20 0x7f759c0d0240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:54624/0 (socket says 172.21.15.71:54624) 2023-10-06T01:40:19.107 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.104+0000 7f75a0c27700 1 -- 172.21.15.71:0/2014703850 learned_addr learned my addr 172.21.15.71:0/2014703850 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:40:19.107 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.104+0000 7f759b7fe700 1 --2- 172.21.15.71:0/2014703850 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f759c068d90 0x7f759c15abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:19.107 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.104+0000 7f759bfff700 1 -- 172.21.15.71:0/2014703850 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f759c068d90 msgr2=0x7f759c15abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:19.107 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.104+0000 7f759bfff700 1 --2- 172.21.15.71:0/2014703850 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f759c068d90 0x7f759c15abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:19.107 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.104+0000 7f759bfff700 1 -- 172.21.15.71:0/2014703850 >> v1:172.21.15.71:6789/0 conn(0x7f759c0cfe20 legacy=0x7f759c0d0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:19.107 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.104+0000 7f759bfff700 1 -- 172.21.15.71:0/2014703850 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f759c0cccf0 con 0x7f759c15c900 2023-10-06T01:40:19.107 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.104+0000 7f759affd700 1 -- 172.21.15.71:0/2014703850 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2226920150 0 0) 0x7f759c0ce640 con 0x7f759c0cfe20 2023-10-06T01:40:19.107 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.104+0000 7f759b7fe700 1 --2- 172.21.15.71:0/2014703850 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f759c068d90 0x7f759c15abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:40:19.107 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.104+0000 7f759bfff700 1 --2- 172.21.15.71:0/2014703850 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f759c15c900 0x7f759c0b5c00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f758c0098e0 tx=0x7f758c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a09e334a61fc6355 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:19.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.104+0000 7f759affd700 1 -- 172.21.15.71:0/2014703850 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f758c009e80 con 0x7f759c15c900 2023-10-06T01:40:19.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.105+0000 7f759affd700 1 -- 172.21.15.71:0/2014703850 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f758c00b860 con 0x7f759c15c900 2023-10-06T01:40:19.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.105+0000 7f759affd700 1 -- 172.21.15.71:0/2014703850 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f758c00bbe0 con 0x7f759c15c900 2023-10-06T01:40:19.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.105+0000 7f75a1428700 1 -- 172.21.15.71:0/2014703850 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f759c15c900 msgr2=0x7f759c0b5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:19.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.105+0000 7f75a1428700 1 --2- 172.21.15.71:0/2014703850 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f759c15c900 0x7f759c0b5c00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f758c0098e0 tx=0x7f758c0091a0 comp rx=0 tx=0).stop 2023-10-06T01:40:19.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.105+0000 7f75a1428700 1 -- 172.21.15.71:0/2014703850 shutdown_connections 2023-10-06T01:40:19.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.105+0000 7f75a1428700 1 --2- 172.21.15.71:0/2014703850 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f759c15c900 0x7f759c0b5c00 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:19.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.105+0000 7f75a1428700 1 --2- 172.21.15.71:0/2014703850 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f759c068d90 0x7f759c15abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:19.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.105+0000 7f75a1428700 1 -- 172.21.15.71:0/2014703850 >> 172.21.15.71:0/2014703850 conn(0x7f759c06ac00 msgr2=0x7f759c068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:19.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.105+0000 7f75a1428700 1 -- 172.21.15.71:0/2014703850 shutdown_connections 2023-10-06T01:40:19.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.105+0000 7f75a1428700 1 -- 172.21.15.71:0/2014703850 wait complete. 2023-10-06T01:40:19.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.106+0000 7f75a1428700 1 Processor -- start 2023-10-06T01:40:19.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.106+0000 7f75a1428700 1 -- start start 2023-10-06T01:40:19.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.107+0000 7f75a1428700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f759c068d90 0x7f759c0c9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:19.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.107+0000 7f75a1428700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f759c0cfe20 0x7f759c0b4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:19.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.107+0000 7f75a1428700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f759c15c900 0x7f759c0b4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:19.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.107+0000 7f75a1428700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f759c0c5ff0 con 0x7f759c068d90 2023-10-06T01:40:19.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.107+0000 7f75a1428700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f759c0c6290 con 0x7f759c0cfe20 2023-10-06T01:40:19.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.107+0000 7f75a1428700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f759c0c6570 con 0x7f759c15c900 2023-10-06T01:40:19.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.107+0000 7f759bfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f759c068d90 0x7f759c0c9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:19.112 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.107+0000 7f759bfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f759c068d90 0x7f759c0c9720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:49604/0 (socket says 172.21.15.71:49604) 2023-10-06T01:40:19.112 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.107+0000 7f759bfff700 1 -- 172.21.15.71:0/2471261213 learned_addr learned my addr 172.21.15.71:0/2471261213 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:19.112 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.107+0000 7f759b7fe700 1 --2- 172.21.15.71:0/2471261213 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f759c0cfe20 0x7f759c0b4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:19.112 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.107+0000 7f75a0c27700 1 --2- 172.21.15.71:0/2471261213 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f759c15c900 0x7f759c0b4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:19.112 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.107+0000 7f759bfff700 1 -- 172.21.15.71:0/2471261213 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f759c15c900 msgr2=0x7f759c0b4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:19.112 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.107+0000 7f759bfff700 1 --2- 172.21.15.71:0/2471261213 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f759c15c900 0x7f759c0b4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:19.112 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.107+0000 7f759bfff700 1 -- 172.21.15.71:0/2471261213 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f759c0cfe20 msgr2=0x7f759c0b4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:19.112 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.107+0000 7f759bfff700 1 --2- 172.21.15.71:0/2471261213 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f759c0cfe20 0x7f759c0b4300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:19.112 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.107+0000 7f759bfff700 1 -- 172.21.15.71:0/2471261213 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f758c009420 con 0x7f759c068d90 2023-10-06T01:40:19.112 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.108+0000 7f759bfff700 1 --2- 172.21.15.71:0/2471261213 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f759c068d90 0x7f759c0c9720 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f759c06b050 tx=0x7f758c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:19.112 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.108+0000 7f7583fff700 1 -- 172.21.15.71:0/2471261213 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f758c00bbe0 con 0x7f759c068d90 2023-10-06T01:40:19.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.108+0000 7f7583fff700 1 -- 172.21.15.71:0/2471261213 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f758c011420 con 0x7f759c068d90 2023-10-06T01:40:19.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.108+0000 7f75a1428700 1 -- 172.21.15.71:0/2471261213 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f759c0c6850 con 0x7f759c068d90 2023-10-06T01:40:19.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.108+0000 7f7583fff700 1 -- 172.21.15.71:0/2471261213 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f758c0117a0 con 0x7f759c068d90 2023-10-06T01:40:19.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.108+0000 7f75a1428700 1 -- 172.21.15.71:0/2471261213 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f759c0c9c60 con 0x7f759c068d90 2023-10-06T01:40:19.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.109+0000 7f75a1428700 1 -- 172.21.15.71:0/2471261213 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f759c0c6d70 con 0x7f759c068d90 2023-10-06T01:40:19.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.109+0000 7f7583fff700 1 -- 172.21.15.71:0/2471261213 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f758c011bd0 con 0x7f759c068d90 2023-10-06T01:40:19.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.109+0000 7f7583fff700 1 --2- 172.21.15.71:0/2471261213 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7588066f30 0x7f75880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:19.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.109+0000 7f7583fff700 1 -- 172.21.15.71:0/2471261213 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f758c0858d0 con 0x7f759c068d90 2023-10-06T01:40:19.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.109+0000 7f759b7fe700 1 --2- 172.21.15.71:0/2471261213 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7588066f30 0x7f75880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:19.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.110+0000 7f759b7fe700 1 --2- 172.21.15.71:0/2471261213 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7588066f30 0x7f75880693e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7590006f00 tx=0x7f7590008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:19.114 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.114+0000 7f7583fff700 1 -- 172.21.15.71:0/2471261213 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f759c0c6d70 con 0x7f759c068d90 2023-10-06T01:40:19.297 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.297+0000 7f75a1428700 1 -- 172.21.15.71:0/2471261213 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f759c0ce870 con 0x7f759c068d90 2023-10-06T01:40:19.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.297+0000 7f7583fff700 1 -- 172.21.15.71:0/2471261213 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v19) v1 ==== 84+0+126 (secure 0 0 0) 0x7f758c015090 con 0x7f759c068d90 2023-10-06T01:40:19.298 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:40:19.298 INFO:teuthology.orchestra.run.smithi071.stdout:[ 2023-10-06T01:40:19.299 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-06T01:40:19.299 INFO:teuthology.orchestra.run.smithi071.stdout: "poolnum": 1, 2023-10-06T01:40:19.299 INFO:teuthology.orchestra.run.smithi071.stdout: "poolname": ".mgr" 2023-10-06T01:40:19.299 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-06T01:40:19.299 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-06T01:40:19.299 INFO:teuthology.orchestra.run.smithi071.stdout: "poolnum": 2, 2023-10-06T01:40:19.299 INFO:teuthology.orchestra.run.smithi071.stdout: "poolname": "rbd" 2023-10-06T01:40:19.299 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-06T01:40:19.299 INFO:teuthology.orchestra.run.smithi071.stdout:] 2023-10-06T01:40:19.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.299+0000 7f75a1428700 1 -- 172.21.15.71:0/2471261213 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7588066f30 msgr2=0x7f75880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:19.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.299+0000 7f75a1428700 1 --2- 172.21.15.71:0/2471261213 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7588066f30 0x7f75880693e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7590006f00 tx=0x7f7590008040 comp rx=0 tx=0).stop 2023-10-06T01:40:19.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.299+0000 7f75a1428700 1 -- 172.21.15.71:0/2471261213 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f759c068d90 msgr2=0x7f759c0c9720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:19.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.299+0000 7f75a1428700 1 --2- 172.21.15.71:0/2471261213 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f759c068d90 0x7f759c0c9720 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f759c06b050 tx=0x7f758c017000 comp rx=0 tx=0).stop 2023-10-06T01:40:19.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.299+0000 7f75a1428700 1 -- 172.21.15.71:0/2471261213 shutdown_connections 2023-10-06T01:40:19.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.299+0000 7f75a1428700 1 --2- 172.21.15.71:0/2471261213 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f759c15c900 0x7f759c0b4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:19.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.299+0000 7f75a1428700 1 --2- 172.21.15.71:0/2471261213 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f759c068d90 0x7f759c0c9720 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:19.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.299+0000 7f75a1428700 1 --2- 172.21.15.71:0/2471261213 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7588066f30 0x7f75880693e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:19.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.299+0000 7f75a1428700 1 --2- 172.21.15.71:0/2471261213 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f759c0cfe20 0x7f759c0b4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:19.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.299+0000 7f75a1428700 1 -- 172.21.15.71:0/2471261213 >> 172.21.15.71:0/2471261213 conn(0x7f759c06ac00 msgr2=0x7f759c15bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:19.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.299+0000 7f75a1428700 1 -- 172.21.15.71:0/2471261213 shutdown_connections 2023-10-06T01:40:19.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.299+0000 7f75a1428700 1 -- 172.21.15.71:0/2471261213 wait complete. 2023-10-06T01:40:19.312 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T01:40:19.312 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T01:40:19.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.429+0000 7ff28205a700 1 Processor -- start 2023-10-06T01:40:19.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.429+0000 7ff28205a700 1 -- start start 2023-10-06T01:40:19.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.430+0000 7ff28205a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff27c0cfa90 0x7ff27c0d0260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:19.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.430+0000 7ff28205a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff27c0d07a0 0x7ff27c163060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:19.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.430+0000 7ff28205a700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff27c15a710 con 0x7ff27c142df0 2023-10-06T01:40:19.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.430+0000 7ff28205a700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff27c0d0c20 con 0x7ff27c0d07a0 2023-10-06T01:40:19.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.430+0000 7ff28205a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff27c159b40 con 0x7ff27c0cfa90 2023-10-06T01:40:19.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.431+0000 7ff27affd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff27c0cfa90 0x7ff27c0d0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:19.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.431+0000 7ff27bfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff27c0d07a0 0x7ff27c163060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:19.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.431+0000 7ff27affd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff27c0cfa90 0x7ff27c0d0260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.71:42026/0 (socket says 172.21.15.71:42026) 2023-10-06T01:40:19.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.431+0000 7ff27affd700 1 -- 172.21.15.71:0/52681980 learned_addr learned my addr 172.21.15.71:0/52681980 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:19.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.431+0000 7ff27affd700 1 -- 172.21.15.71:0/52681980 >> v2:172.21.15.72:3300/0 conn(0x7ff27c0d07a0 msgr2=0x7ff27c163060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:19.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.431+0000 7ff27affd700 1 --2- 172.21.15.71:0/52681980 >> v2:172.21.15.72:3300/0 conn(0x7ff27c0d07a0 0x7ff27c163060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:19.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.431+0000 7ff27affd700 1 -- 172.21.15.71:0/52681980 >> v1:172.21.15.72:6789/0 conn(0x7ff27c142df0 legacy=0x7ff27c0cc350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:19.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.431+0000 7ff27affd700 1 -- 172.21.15.71:0/52681980 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff27c159de0 con 0x7ff27c0cfa90 2023-10-06T01:40:19.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.431+0000 7ff27affd700 1 --2- 172.21.15.71:0/52681980 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff27c0cfa90 0x7ff27c0d0260 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff2700099b0 tx=0x7ff270009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a18409a5413d3b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:19.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.431+0000 7ff27a7fc700 1 -- 172.21.15.71:0/52681980 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff270009ea0 con 0x7ff27c0cfa90 2023-10-06T01:40:19.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.431+0000 7ff27a7fc700 1 -- 172.21.15.71:0/52681980 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff27000b860 con 0x7ff27c0cfa90 2023-10-06T01:40:19.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.431+0000 7ff27a7fc700 1 -- 172.21.15.71:0/52681980 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff27000bc00 con 0x7ff27c0cfa90 2023-10-06T01:40:19.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.432+0000 7ff28205a700 1 -- 172.21.15.71:0/52681980 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff27c0cfa90 msgr2=0x7ff27c0d0260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:19.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.432+0000 7ff28205a700 1 --2- 172.21.15.71:0/52681980 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff27c0cfa90 0x7ff27c0d0260 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff2700099b0 tx=0x7ff270009250 comp rx=0 tx=0).stop 2023-10-06T01:40:19.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.432+0000 7ff28205a700 1 -- 172.21.15.71:0/52681980 shutdown_connections 2023-10-06T01:40:19.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.432+0000 7ff28205a700 1 --2- 172.21.15.71:0/52681980 >> v2:172.21.15.72:3300/0 conn(0x7ff27c0d07a0 0x7ff27c163060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:19.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.432+0000 7ff28205a700 1 --2- 172.21.15.71:0/52681980 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff27c0cfa90 0x7ff27c0d0260 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:19.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.432+0000 7ff28205a700 1 -- 172.21.15.71:0/52681980 >> 172.21.15.71:0/52681980 conn(0x7ff27c0690f0 msgr2=0x7ff27c06a340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:19.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.432+0000 7ff28205a700 1 -- 172.21.15.71:0/52681980 shutdown_connections 2023-10-06T01:40:19.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.432+0000 7ff28205a700 1 -- 172.21.15.71:0/52681980 wait complete. 2023-10-06T01:40:19.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.433+0000 7ff28205a700 1 Processor -- start 2023-10-06T01:40:19.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.433+0000 7ff28205a700 1 -- start start 2023-10-06T01:40:19.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.434+0000 7ff28205a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff27c0cfa90 0x7ff27c16a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:19.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.434+0000 7ff28205a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff27c0d07a0 0x7ff27c0b11e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:19.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.434+0000 7ff28205a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff27c142df0 0x7ff27c141b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:19.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.434+0000 7ff28205a700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff27c0b0d50 con 0x7ff27c0cfa90 2023-10-06T01:40:19.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.434+0000 7ff28205a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff27c16ad30 con 0x7ff27c0d07a0 2023-10-06T01:40:19.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.434+0000 7ff28205a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff27c0b1720 con 0x7ff27c142df0 2023-10-06T01:40:19.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.434+0000 7ff27b7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff27c0cfa90 0x7ff27c16a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:19.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.434+0000 7ff27b7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff27c0cfa90 0x7ff27c16a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39872/0 (socket says 172.21.15.71:39872) 2023-10-06T01:40:19.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.434+0000 7ff27b7fe700 1 -- 172.21.15.71:0/634143661 learned_addr learned my addr 172.21.15.71:0/634143661 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:19.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.434+0000 7ff27bfff700 1 --2- 172.21.15.71:0/634143661 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff27c142df0 0x7ff27c141b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:19.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.434+0000 7ff27affd700 1 --2- 172.21.15.71:0/634143661 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff27c0d07a0 0x7ff27c0b11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:19.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.434+0000 7ff27b7fe700 1 -- 172.21.15.71:0/634143661 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff27c142df0 msgr2=0x7ff27c141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:19.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.434+0000 7ff27b7fe700 1 --2- 172.21.15.71:0/634143661 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff27c142df0 0x7ff27c141b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:19.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.434+0000 7ff27b7fe700 1 -- 172.21.15.71:0/634143661 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff27c0d07a0 msgr2=0x7ff27c0b11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:19.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.434+0000 7ff27b7fe700 1 --2- 172.21.15.71:0/634143661 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff27c0d07a0 0x7ff27c0b11e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:19.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.434+0000 7ff27b7fe700 1 -- 172.21.15.71:0/634143661 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2700094f0 con 0x7ff27c0cfa90 2023-10-06T01:40:19.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.434+0000 7ff27b7fe700 1 --2- 172.21.15.71:0/634143661 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff27c0cfa90 0x7ff27c16a7f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff26c00cb10 tx=0x7ff26c0017b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:19.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.435+0000 7ff2637fe700 1 -- 172.21.15.71:0/634143661 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff26c00ce20 con 0x7ff27c0cfa90 2023-10-06T01:40:19.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.435+0000 7ff2637fe700 1 -- 172.21.15.71:0/634143661 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff26c00a7e0 con 0x7ff27c0cfa90 2023-10-06T01:40:19.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.435+0000 7ff2637fe700 1 -- 172.21.15.71:0/634143661 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff26c00aba0 con 0x7ff27c0cfa90 2023-10-06T01:40:19.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.435+0000 7ff28205a700 1 -- 172.21.15.71:0/634143661 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff27c0b0140 con 0x7ff27c0cfa90 2023-10-06T01:40:19.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.435+0000 7ff28205a700 1 -- 172.21.15.71:0/634143661 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff27c0b0700 con 0x7ff27c0cfa90 2023-10-06T01:40:19.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.436+0000 7ff28205a700 1 -- 172.21.15.71:0/634143661 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff27c0b1030 con 0x7ff27c0cfa90 2023-10-06T01:40:19.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.436+0000 7ff2637fe700 1 -- 172.21.15.71:0/634143661 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff26c003030 con 0x7ff27c0cfa90 2023-10-06T01:40:19.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.436+0000 7ff2637fe700 1 --2- 172.21.15.71:0/634143661 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7ff268066f30 0x7ff2680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:19.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.436+0000 7ff2637fe700 1 -- 172.21.15.71:0/634143661 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5206+0+0 (secure 0 0 0) 0x7ff26c084320 con 0x7ff27c0cfa90 2023-10-06T01:40:19.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.436+0000 7ff27affd700 1 --2- 172.21.15.71:0/634143661 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7ff268066f30 0x7ff2680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:19.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.437+0000 7ff27affd700 1 --2- 172.21.15.71:0/634143661 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7ff268066f30 0x7ff2680693e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff2700099b0 tx=0x7ff270017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:19.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.440+0000 7ff2637fe700 1 -- 172.21.15.71:0/634143661 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff26c051780 con 0x7ff27c0cfa90 2023-10-06T01:40:19.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.623+0000 7ff28205a700 1 -- 172.21.15.71:0/634143661 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7ff27c087360 con 0x7ff27c0cfa90 2023-10-06T01:40:19.766 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.765+0000 7ff2637fe700 1 -- 172.21.15.71:0/634143661 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v20) v1 ==== 138+0+0 (secure 0 0 0) 0x7ff26c054da0 con 0x7ff27c0cfa90 2023-10-06T01:40:19.770 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.770+0000 7ff28205a700 1 -- 172.21.15.71:0/634143661 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7ff268066f30 msgr2=0x7ff2680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:19.770 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.770+0000 7ff28205a700 1 --2- 172.21.15.71:0/634143661 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7ff268066f30 0x7ff2680693e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff2700099b0 tx=0x7ff270017000 comp rx=0 tx=0).stop 2023-10-06T01:40:19.770 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.770+0000 7ff28205a700 1 -- 172.21.15.71:0/634143661 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff27c0cfa90 msgr2=0x7ff27c16a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:19.771 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.770+0000 7ff28205a700 1 --2- 172.21.15.71:0/634143661 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff27c0cfa90 0x7ff27c16a7f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff26c00cb10 tx=0x7ff26c0017b0 comp rx=0 tx=0).stop 2023-10-06T01:40:19.771 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.770+0000 7ff28205a700 1 -- 172.21.15.71:0/634143661 shutdown_connections 2023-10-06T01:40:19.771 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.770+0000 7ff28205a700 1 --2- 172.21.15.71:0/634143661 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff27c142df0 0x7ff27c141b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:19.771 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.770+0000 7ff28205a700 1 --2- 172.21.15.71:0/634143661 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff27c0cfa90 0x7ff27c16a7f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:19.771 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.770+0000 7ff28205a700 1 --2- 172.21.15.71:0/634143661 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7ff268066f30 0x7ff2680693e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:19.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.770+0000 7ff28205a700 1 --2- 172.21.15.71:0/634143661 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff27c0d07a0 0x7ff27c0b11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:19.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.770+0000 7ff28205a700 1 -- 172.21.15.71:0/634143661 >> 172.21.15.71:0/634143661 conn(0x7ff27c0690f0 msgr2=0x7ff27c0ccbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:19.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.770+0000 7ff28205a700 1 -- 172.21.15.71:0/634143661 shutdown_connections 2023-10-06T01:40:19.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.770+0000 7ff28205a700 1 -- 172.21.15.71:0/634143661 wait complete. 2023-10-06T01:40:19.772 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'cephfs_metadata' created 2023-10-06T01:40:19.784 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-10-06T01:40:19.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.905+0000 7f3ec7fff700 1 Processor -- start 2023-10-06T01:40:19.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.905+0000 7f3ec7fff700 1 -- start start 2023-10-06T01:40:19.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.906+0000 7f3ec7fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3ec80cc210 0x7f3ec80cd7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:19.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.906+0000 7f3ec7fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f3ec806df90 0x7f3ec815a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:19.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.906+0000 7f3ec7fff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ec80cd360 con 0x7f3ec806dbc0 2023-10-06T01:40:19.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.906+0000 7f3ec7fff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ec806ea50 con 0x7f3ec806df90 2023-10-06T01:40:19.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.906+0000 7f3ec7fff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ec80cdd30 con 0x7f3ec80cc210 2023-10-06T01:40:19.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.906+0000 7f3ec77fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f3ec806df90 0x7f3ec815a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:19.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.906+0000 7f3ec77fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f3ec806df90 0x7f3ec815a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39874/0 (socket says 172.21.15.71:39874) 2023-10-06T01:40:19.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.906+0000 7f3ec77fe700 1 -- 172.21.15.71:0/2516424951 learned_addr learned my addr 172.21.15.71:0/2516424951 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:19.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.906+0000 7f3ebe7fc700 1 --2- 172.21.15.71:0/2516424951 >> v2:172.21.15.72:3300/0 conn(0x7f3ec80cc210 0x7f3ec80cd7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:19.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.906+0000 7f3ec77fe700 1 -- 172.21.15.71:0/2516424951 >> v2:172.21.15.72:3300/0 conn(0x7f3ec80cc210 msgr2=0x7f3ec80cd7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:19.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.906+0000 7f3ec77fe700 1 --2- 172.21.15.71:0/2516424951 >> v2:172.21.15.72:3300/0 conn(0x7f3ec80cc210 0x7f3ec80cd7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:19.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.906+0000 7f3ec77fe700 1 -- 172.21.15.71:0/2516424951 >> v1:172.21.15.72:6789/0 conn(0x7f3ec806dbc0 legacy=0x7f3ec80cbb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:19.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.906+0000 7f3ec77fe700 1 -- 172.21.15.71:0/2516424951 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ec80cc750 con 0x7f3ec806df90 2023-10-06T01:40:19.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.906+0000 7f3ebe7fc700 1 --2- 172.21.15.71:0/2516424951 >> v2:172.21.15.72:3300/0 conn(0x7f3ec80cc210 0x7f3ec80cd7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:40:19.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.906+0000 7f3ec77fe700 1 --2- 172.21.15.71:0/2516424951 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ec806df90 0x7f3ec815a0c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3ec00099e0 tx=0x7f3ec0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee4433fac653fc72 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:19.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.907+0000 7f3ec67fc700 1 -- 172.21.15.71:0/2516424951 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec000b7e0 con 0x7f3ec806df90 2023-10-06T01:40:19.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.907+0000 7f3ec67fc700 1 -- 172.21.15.71:0/2516424951 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ec000b940 con 0x7f3ec806df90 2023-10-06T01:40:19.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.907+0000 7f3ec67fc700 1 -- 172.21.15.71:0/2516424951 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec000bce0 con 0x7f3ec806df90 2023-10-06T01:40:19.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.907+0000 7f3ec7fff700 1 -- 172.21.15.71:0/2516424951 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ec806df90 msgr2=0x7f3ec815a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:19.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.907+0000 7f3ec7fff700 1 --2- 172.21.15.71:0/2516424951 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ec806df90 0x7f3ec815a0c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3ec00099e0 tx=0x7f3ec0009250 comp rx=0 tx=0).stop 2023-10-06T01:40:19.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.907+0000 7f3ec7fff700 1 -- 172.21.15.71:0/2516424951 shutdown_connections 2023-10-06T01:40:19.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.907+0000 7f3ec7fff700 1 --2- 172.21.15.71:0/2516424951 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ec806df90 0x7f3ec815a0c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:19.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.907+0000 7f3ec7fff700 1 --2- 172.21.15.71:0/2516424951 >> v2:172.21.15.72:3300/0 conn(0x7f3ec80cc210 0x7f3ec80cd7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:19.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.907+0000 7f3ec7fff700 1 -- 172.21.15.71:0/2516424951 >> 172.21.15.71:0/2516424951 conn(0x7f3ec806ce40 msgr2=0x7f3ec80cdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:19.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.907+0000 7f3ec7fff700 1 -- 172.21.15.71:0/2516424951 shutdown_connections 2023-10-06T01:40:19.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.907+0000 7f3ec7fff700 1 -- 172.21.15.71:0/2516424951 wait complete. 2023-10-06T01:40:19.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.908+0000 7f3ec7fff700 1 Processor -- start 2023-10-06T01:40:19.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.908+0000 7f3ec7fff700 1 -- start start 2023-10-06T01:40:19.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.909+0000 7f3ec7fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3ec806dbc0 0x7f3ec8144af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:19.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.909+0000 7f3ec7fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ec806df90 0x7f3ec80c79b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:19.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.909+0000 7f3ec7fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ec80cc210 0x7f3ec80c7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:19.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.909+0000 7f3ec7fff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec80c8fa0 con 0x7f3ec806df90 2023-10-06T01:40:19.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.909+0000 7f3ec7fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec80c51a0 con 0x7f3ec80cc210 2023-10-06T01:40:19.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.909+0000 7f3ec7fff700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec80c8430 con 0x7f3ec806dbc0 2023-10-06T01:40:19.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.909+0000 7f3ebe7fc700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ec806df90 0x7f3ec80c79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:19.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.909+0000 7f3ebe7fc700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ec806df90 0x7f3ec80c79b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39890/0 (socket says 172.21.15.71:39890) 2023-10-06T01:40:19.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.909+0000 7f3ebe7fc700 1 -- 172.21.15.71:0/1956826211 learned_addr learned my addr 172.21.15.71:0/1956826211 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:19.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.909+0000 7f3ec77fe700 1 --2- 172.21.15.71:0/1956826211 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ec80cc210 0x7f3ec80c7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:19.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.909+0000 7f3ec6ffd700 1 --2- 172.21.15.71:0/1956826211 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3ec806dbc0 0x7f3ec8144af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:19.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.909+0000 7f3ebe7fc700 1 -- 172.21.15.71:0/1956826211 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3ec806dbc0 msgr2=0x7f3ec8144af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:19.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.909+0000 7f3ebe7fc700 1 --2- 172.21.15.71:0/1956826211 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3ec806dbc0 0x7f3ec8144af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:19.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.909+0000 7f3ebe7fc700 1 -- 172.21.15.71:0/1956826211 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ec80cc210 msgr2=0x7f3ec80c7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:19.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.909+0000 7f3ebe7fc700 1 --2- 172.21.15.71:0/1956826211 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ec80cc210 0x7f3ec80c7ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:19.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.909+0000 7f3ebe7fc700 1 -- 172.21.15.71:0/1956826211 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ec00094f0 con 0x7f3ec806df90 2023-10-06T01:40:19.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.910+0000 7f3ebe7fc700 1 --2- 172.21.15.71:0/1956826211 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ec806df90 0x7f3ec80c79b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3eb000c8b0 tx=0x7f3eb0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:19.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.910+0000 7f3ebf7fe700 1 -- 172.21.15.71:0/1956826211 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb0011600 con 0x7f3ec806df90 2023-10-06T01:40:19.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.910+0000 7f3ebf7fe700 1 -- 172.21.15.71:0/1956826211 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eb0011760 con 0x7f3ec806df90 2023-10-06T01:40:19.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.910+0000 7f3ec7fff700 1 -- 172.21.15.71:0/1956826211 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ec80c8700 con 0x7f3ec806df90 2023-10-06T01:40:19.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.910+0000 7f3ebf7fe700 1 -- 172.21.15.71:0/1956826211 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb0011b20 con 0x7f3ec806df90 2023-10-06T01:40:19.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.910+0000 7f3ec7fff700 1 -- 172.21.15.71:0/1956826211 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ec80c8cc0 con 0x7f3ec806df90 2023-10-06T01:40:19.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.911+0000 7f3ec7fff700 1 -- 172.21.15.71:0/1956826211 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ec80c5330 con 0x7f3ec806df90 2023-10-06T01:40:19.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.911+0000 7f3ebf7fe700 1 -- 172.21.15.71:0/1956826211 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3eb00193b0 con 0x7f3ec806df90 2023-10-06T01:40:19.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.911+0000 7f3ebf7fe700 1 --2- 172.21.15.71:0/1956826211 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f3ea8066f30 0x7f3ea80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:19.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.911+0000 7f3ebf7fe700 1 -- 172.21.15.71:0/1956826211 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5576+0+0 (secure 0 0 0) 0x7f3eb0084240 con 0x7f3ec806df90 2023-10-06T01:40:19.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.912+0000 7f3ec6ffd700 1 --2- 172.21.15.71:0/1956826211 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f3ea8066f30 0x7f3ea80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:19.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.912+0000 7f3ec6ffd700 1 --2- 172.21.15.71:0/1956826211 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f3ea8066f30 0x7f3ea80693e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3eb8007fd0 tx=0x7f3eb8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:19.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:19.916+0000 7f3ebf7fe700 1 -- 172.21.15.71:0/1956826211 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3eb0051530 con 0x7f3ec806df90 2023-10-06T01:40:20.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:20.099+0000 7f3ec7fff700 1 -- 172.21.15.71:0/1956826211 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f3ec8064aa0 con 0x7f3ec806df90 2023-10-06T01:40:20.771 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:20.771+0000 7f3ebf7fe700 1 -- 172.21.15.71:0/1956826211 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v21) v1 ==== 171+0+0 (secure 0 0 0) 0x7f3eb0054b50 con 0x7f3ec806df90 2023-10-06T01:40:20.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:20.775+0000 7f3ec7fff700 1 -- 172.21.15.71:0/1956826211 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f3ea8066f30 msgr2=0x7f3ea80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:20.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:20.775+0000 7f3ec7fff700 1 --2- 172.21.15.71:0/1956826211 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f3ea8066f30 0x7f3ea80693e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3eb8007fd0 tx=0x7f3eb8009040 comp rx=0 tx=0).stop 2023-10-06T01:40:20.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:20.775+0000 7f3ec7fff700 1 -- 172.21.15.71:0/1956826211 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ec806df90 msgr2=0x7f3ec80c79b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:20.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:20.775+0000 7f3ec7fff700 1 --2- 172.21.15.71:0/1956826211 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ec806df90 0x7f3ec80c79b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3eb000c8b0 tx=0x7f3eb0008040 comp rx=0 tx=0).stop 2023-10-06T01:40:20.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:20.775+0000 7f3ec7fff700 1 -- 172.21.15.71:0/1956826211 shutdown_connections 2023-10-06T01:40:20.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:20.775+0000 7f3ec7fff700 1 --2- 172.21.15.71:0/1956826211 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f3ea8066f30 0x7f3ea80693e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:20.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:20.775+0000 7f3ec7fff700 1 --2- 172.21.15.71:0/1956826211 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ec80cc210 0x7f3ec80c7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:20.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:20.775+0000 7f3ec7fff700 1 --2- 172.21.15.71:0/1956826211 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3ec806dbc0 0x7f3ec8144af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:20.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:20.775+0000 7f3ec7fff700 1 --2- 172.21.15.71:0/1956826211 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ec806df90 0x7f3ec80c79b0 secure :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3eb000c8b0 tx=0x7f3eb0008040 comp rx=0 tx=0).stop 2023-10-06T01:40:20.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:20.775+0000 7f3ec7fff700 1 -- 172.21.15.71:0/1956826211 >> 172.21.15.71:0/1956826211 conn(0x7f3ec806ce40 msgr2=0x7f3ec8159130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:20.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:20.776+0000 7f3ec7fff700 1 -- 172.21.15.71:0/1956826211 shutdown_connections 2023-10-06T01:40:20.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:20.777+0000 7f3ec7fff700 1 -- 172.21.15.71:0/1956826211 wait complete. 2023-10-06T01:40:20.779 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'cephfs_data' created 2023-10-06T01:40:20.798 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T01:40:20.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:20.914+0000 7f2311bc0700 1 Processor -- start 2023-10-06T01:40:20.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:20.914+0000 7f2311bc0700 1 -- start start 2023-10-06T01:40:20.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:20.915+0000 7f2311bc0700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f230c1574b0 0x7f230c0b0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:20.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:20.915+0000 7f2311bc0700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f230c0c46e0 0x7f230c0cbcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:20.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:20.915+0000 7f2311bc0700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f230c0c3b40 con 0x7f230c0b13f0 2023-10-06T01:40:20.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:20.915+0000 7f2311bc0700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f230c0c2f30 con 0x7f230c1574b0 2023-10-06T01:40:20.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:20.915+0000 7f2311bc0700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f230c0c3210 con 0x7f230c0c46e0 2023-10-06T01:40:20.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:20.915+0000 7f230b7fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f230c1574b0 0x7f230c0b0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:20.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:20.915+0000 7f230b7fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f230c1574b0 0x7f230c0b0eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39906/0 (socket says 172.21.15.71:39906) 2023-10-06T01:40:20.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:20.915+0000 7f230b7fe700 1 -- 172.21.15.71:0/1870973360 learned_addr learned my addr 172.21.15.71:0/1870973360 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:20.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:20.915+0000 7f230bfff700 1 --2- 172.21.15.71:0/1870973360 >> v2:172.21.15.72:3300/0 conn(0x7f230c0c46e0 0x7f230c0cbcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:20.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:20.915+0000 7f230b7fe700 1 -- 172.21.15.71:0/1870973360 >> v2:172.21.15.72:3300/0 conn(0x7f230c0c46e0 msgr2=0x7f230c0cbcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:20.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:20.915+0000 7f230b7fe700 1 --2- 172.21.15.71:0/1870973360 >> v2:172.21.15.72:3300/0 conn(0x7f230c0c46e0 0x7f230c0cbcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:20.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:20.915+0000 7f230b7fe700 1 -- 172.21.15.71:0/1870973360 >> v1:172.21.15.72:6789/0 conn(0x7f230c0b13f0 legacy=0x7f230c0c3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:20.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:20.916+0000 7f230b7fe700 1 -- 172.21.15.71:0/1870973360 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f230c0c34f0 con 0x7f230c1574b0 2023-10-06T01:40:20.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:20.916+0000 7f230bfff700 1 --2- 172.21.15.71:0/1870973360 >> v2:172.21.15.72:3300/0 conn(0x7f230c0c46e0 0x7f230c0cbcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:40:20.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:20.916+0000 7f230b7fe700 1 --2- 172.21.15.71:0/1870973360 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f230c1574b0 0x7f230c0b0eb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f230c06be40 tx=0x7f22fc009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4557e07a03469efe server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:20.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:20.916+0000 7f230a7fc700 1 -- 172.21.15.71:0/1870973360 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22fc005c10 con 0x7f230c1574b0 2023-10-06T01:40:20.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:20.916+0000 7f230a7fc700 1 -- 172.21.15.71:0/1870973360 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22fc005d70 con 0x7f230c1574b0 2023-10-06T01:40:20.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:20.916+0000 7f230a7fc700 1 -- 172.21.15.71:0/1870973360 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22fc00b840 con 0x7f230c1574b0 2023-10-06T01:40:20.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:20.916+0000 7f2311bc0700 1 -- 172.21.15.71:0/1870973360 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f230c1574b0 msgr2=0x7f230c0b0eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:20.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:20.916+0000 7f2311bc0700 1 --2- 172.21.15.71:0/1870973360 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f230c1574b0 0x7f230c0b0eb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f230c06be40 tx=0x7f22fc009220 comp rx=0 tx=0).stop 2023-10-06T01:40:20.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:20.916+0000 7f2311bc0700 1 -- 172.21.15.71:0/1870973360 shutdown_connections 2023-10-06T01:40:20.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:20.916+0000 7f2311bc0700 1 --2- 172.21.15.71:0/1870973360 >> v2:172.21.15.72:3300/0 conn(0x7f230c0c46e0 0x7f230c0cbcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:20.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:20.916+0000 7f2311bc0700 1 --2- 172.21.15.71:0/1870973360 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f230c1574b0 0x7f230c0b0eb0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:20.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:20.916+0000 7f2311bc0700 1 -- 172.21.15.71:0/1870973360 >> 172.21.15.71:0/1870973360 conn(0x7f230c067910 msgr2=0x7f230c0ce0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:20.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:20.916+0000 7f2311bc0700 1 -- 172.21.15.71:0/1870973360 shutdown_connections 2023-10-06T01:40:20.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:20.916+0000 7f2311bc0700 1 -- 172.21.15.71:0/1870973360 wait complete. 2023-10-06T01:40:20.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:20.918+0000 7f2311bc0700 1 Processor -- start 2023-10-06T01:40:20.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:20.918+0000 7f2311bc0700 1 -- start start 2023-10-06T01:40:20.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:20.918+0000 7f2311bc0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f230c0b13f0 0x7f230c149530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:20.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:20.918+0000 7f2311bc0700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f230c0c46e0 0x7f230c0b2380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:20.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:20.918+0000 7f2311bc0700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f230c1574b0 0x7f230c0b28c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:20.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:20.918+0000 7f2311bc0700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f230c0c6170 con 0x7f230c1574b0 2023-10-06T01:40:20.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:20.918+0000 7f2311bc0700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f230c0c6cb0 con 0x7f230c0c46e0 2023-10-06T01:40:20.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:20.918+0000 7f2311bc0700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f230c0c6380 con 0x7f230c0b13f0 2023-10-06T01:40:20.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:20.918+0000 7f230bfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f230c1574b0 0x7f230c0b28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:20.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:20.918+0000 7f230bfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f230c1574b0 0x7f230c0b28c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39912/0 (socket says 172.21.15.71:39912) 2023-10-06T01:40:20.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:20.918+0000 7f230bfff700 1 -- 172.21.15.71:0/2029523812 learned_addr learned my addr 172.21.15.71:0/2029523812 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:20.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:20.919+0000 7f230affd700 1 --2- 172.21.15.71:0/2029523812 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f230c0c46e0 0x7f230c0b2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:20.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:20.919+0000 7f230b7fe700 1 --2- 172.21.15.71:0/2029523812 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f230c0b13f0 0x7f230c149530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:20.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:20.919+0000 7f230bfff700 1 -- 172.21.15.71:0/2029523812 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f230c0b13f0 msgr2=0x7f230c149530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:20.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:20.919+0000 7f230bfff700 1 --2- 172.21.15.71:0/2029523812 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f230c0b13f0 0x7f230c149530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:20.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:20.919+0000 7f230bfff700 1 -- 172.21.15.71:0/2029523812 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f230c0c46e0 msgr2=0x7f230c0b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:20.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:20.919+0000 7f230bfff700 1 --2- 172.21.15.71:0/2029523812 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f230c0c46e0 0x7f230c0b2380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:20.926 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:20.919+0000 7f230bfff700 1 -- 172.21.15.71:0/2029523812 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22fc009480 con 0x7f230c1574b0 2023-10-06T01:40:20.926 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:20.919+0000 7f230bfff700 1 --2- 172.21.15.71:0/2029523812 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f230c1574b0 0x7f230c0b28c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f230400a380 tx=0x7f23040078f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:20.926 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:20.919+0000 7f22f37fe700 1 -- 172.21.15.71:0/2029523812 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2304015440 con 0x7f230c1574b0 2023-10-06T01:40:20.926 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:20.919+0000 7f22f37fe700 1 -- 172.21.15.71:0/2029523812 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23040155c0 con 0x7f230c1574b0 2023-10-06T01:40:20.926 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:20.919+0000 7f2311bc0700 1 -- 172.21.15.71:0/2029523812 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f230c0c6660 con 0x7f230c1574b0 2023-10-06T01:40:20.926 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:20.919+0000 7f22f37fe700 1 -- 172.21.15.71:0/2029523812 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2304015980 con 0x7f230c1574b0 2023-10-06T01:40:20.926 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:20.919+0000 7f2311bc0700 1 -- 172.21.15.71:0/2029523812 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f230c149a70 con 0x7f230c1574b0 2023-10-06T01:40:20.926 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:20.920+0000 7f2311bc0700 1 -- 172.21.15.71:0/2029523812 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f230c0c7040 con 0x7f230c1574b0 2023-10-06T01:40:20.926 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:20.920+0000 7f22f37fe700 1 -- 172.21.15.71:0/2029523812 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2304003020 con 0x7f230c1574b0 2023-10-06T01:40:20.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:20.921+0000 7f22f37fe700 1 --2- 172.21.15.71:0/2029523812 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f22f8066f30 0x7f22f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:20.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:20.921+0000 7f22f37fe700 1 -- 172.21.15.71:0/2029523812 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5958+0+0 (secure 0 0 0) 0x7f2304084cc0 con 0x7f230c1574b0 2023-10-06T01:40:20.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:20.921+0000 7f230b7fe700 1 --2- 172.21.15.71:0/2029523812 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f22f8066f30 0x7f22f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:20.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:20.921+0000 7f230b7fe700 1 --2- 172.21.15.71:0/2029523812 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f22f8066f30 0x7f22f80693e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f22fc0030c0 tx=0x7f22fc015000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:20.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:20.925+0000 7f22f37fe700 1 -- 172.21.15.71:0/2029523812 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f230404d5a0 con 0x7f230c1574b0 2023-10-06T01:40:21.150 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:21.149+0000 7f2311bc0700 1 -- 172.21.15.71:0/2029523812 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f230c06e590 con 0x7f230c1574b0 2023-10-06T01:40:21.255 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T01:40:21.258 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T01:40:21.773 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:21.772+0000 7f22f37fe700 1 -- 172.21.15.71:0/2029523812 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f2304051e30 con 0x7f230c1574b0 2023-10-06T01:40:21.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:21.776+0000 7f2311bc0700 1 -- 172.21.15.71:0/2029523812 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f22f8066f30 msgr2=0x7f22f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:21.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:21.776+0000 7f2311bc0700 1 --2- 172.21.15.71:0/2029523812 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f22f8066f30 0x7f22f80693e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f22fc0030c0 tx=0x7f22fc015000 comp rx=0 tx=0).stop 2023-10-06T01:40:21.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:21.776+0000 7f2311bc0700 1 -- 172.21.15.71:0/2029523812 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f230c1574b0 msgr2=0x7f230c0b28c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:21.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:21.776+0000 7f2311bc0700 1 --2- 172.21.15.71:0/2029523812 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f230c1574b0 0x7f230c0b28c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f230400a380 tx=0x7f23040078f0 comp rx=0 tx=0).stop 2023-10-06T01:40:21.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:21.776+0000 7f2311bc0700 1 -- 172.21.15.71:0/2029523812 shutdown_connections 2023-10-06T01:40:21.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:21.776+0000 7f2311bc0700 1 --2- 172.21.15.71:0/2029523812 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f230c1574b0 0x7f230c0b28c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:21.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:21.776+0000 7f2311bc0700 1 --2- 172.21.15.71:0/2029523812 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f230c0b13f0 0x7f230c149530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:21.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:21.776+0000 7f2311bc0700 1 --2- 172.21.15.71:0/2029523812 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f22f8066f30 0x7f22f80693e0 secure :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f22fc0030c0 tx=0x7f22fc015000 comp rx=0 tx=0).stop 2023-10-06T01:40:21.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:21.776+0000 7f2311bc0700 1 --2- 172.21.15.71:0/2029523812 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f230c0c46e0 0x7f230c0b2380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:21.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:21.776+0000 7f2311bc0700 1 -- 172.21.15.71:0/2029523812 >> 172.21.15.71:0/2029523812 conn(0x7f230c067910 msgr2=0x7f230c0c3fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:21.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:21.778+0000 7f2311bc0700 1 -- 172.21.15.71:0/2029523812 shutdown_connections 2023-10-06T01:40:21.781 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:21.779+0000 7f2311bc0700 1 -- 172.21.15.71:0/2029523812 wait complete. 2023-10-06T01:40:21.792 INFO:teuthology.orchestra.run.smithi071.stderr:new fs with metadata pool 3 and data pool 4 2023-10-06T01:40:21.805 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-10-06T01:40:21.806 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-10-06T01:40:21.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:21.924+0000 7f3a335ec700 1 Processor -- start 2023-10-06T01:40:21.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:21.924+0000 7f3a335ec700 1 -- start start 2023-10-06T01:40:21.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:21.925+0000 7f3a335ec700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3a2c0cfa90 0x7f3a2c0d0260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:21.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:21.925+0000 7f3a335ec700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3a2c0d07a0 0x7f3a2c163060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:21.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:21.925+0000 7f3a335ec700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a2c15a710 con 0x7f3a2c142df0 2023-10-06T01:40:21.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:21.925+0000 7f3a335ec700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a2c0d0c20 con 0x7f3a2c0d07a0 2023-10-06T01:40:21.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:21.925+0000 7f3a335ec700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2c159b40 con 0x7f3a2c0cfa90 2023-10-06T01:40:21.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:21.925+0000 7f3a31388700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f3a2c142df0 0x7f3a2c0cc350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:33150/0 (socket says 172.21.15.71:33150) 2023-10-06T01:40:21.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:21.925+0000 7f3a31388700 1 -- 172.21.15.71:0/2775681532 learned_addr learned my addr 172.21.15.71:0/2775681532 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:40:21.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:21.925+0000 7f3a23fff700 1 -- 172.21.15.71:0/2775681532 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3582582000 0 0) 0x7f3a2c15a710 con 0x7f3a2c142df0 2023-10-06T01:40:21.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:21.925+0000 7f3a31b89700 1 --2- 172.21.15.71:0/2775681532 >> v2:172.21.15.72:3300/0 conn(0x7f3a2c0d07a0 0x7f3a2c163060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:21.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:21.925+0000 7f3a30b87700 1 --2- 172.21.15.71:0/2775681532 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3a2c0cfa90 0x7f3a2c0d0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:21.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:21.925+0000 7f3a23fff700 1 -- 172.21.15.71:0/2775681532 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a18003570 con 0x7f3a2c142df0 2023-10-06T01:40:21.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:21.925+0000 7f3a23fff700 1 -- 172.21.15.71:0/2775681532 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3933875145 0 0) 0x7f3a18003570 con 0x7f3a2c142df0 2023-10-06T01:40:21.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:21.925+0000 7f3a23fff700 1 -- 172.21.15.71:0/2775681532 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3a2c0cfa90 msgr2=0x7f3a2c0d0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:21.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:21.925+0000 7f3a23fff700 1 --2- 172.21.15.71:0/2775681532 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3a2c0cfa90 0x7f3a2c0d0260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:21.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:21.925+0000 7f3a23fff700 1 -- 172.21.15.71:0/2775681532 >> v2:172.21.15.72:3300/0 conn(0x7f3a2c0d07a0 msgr2=0x7f3a2c163060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:21.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:21.925+0000 7f3a23fff700 1 --2- 172.21.15.71:0/2775681532 >> v2:172.21.15.72:3300/0 conn(0x7f3a2c0d07a0 0x7f3a2c163060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:21.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:21.925+0000 7f3a23fff700 1 -- 172.21.15.71:0/2775681532 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a2c159de0 con 0x7f3a2c142df0 2023-10-06T01:40:21.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:21.925+0000 7f3a23fff700 1 -- 172.21.15.71:0/2775681532 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1184243524 0 0) 0x7f3a280017f0 con 0x7f3a2c142df0 2023-10-06T01:40:21.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:21.925+0000 7f3a23fff700 1 -- 172.21.15.71:0/2775681532 >> v1:172.21.15.71:6789/0 conn(0x7f3a2c142df0 legacy=0x7f3a2c0cc350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:21.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:21.925+0000 7f3a23fff700 1 --2- 172.21.15.71:0/2775681532 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a18003ae0 0x7f3a18003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:21.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:21.926+0000 7f3a23fff700 1 --2- 172.21.15.71:0/2775681532 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3a2c0cfa90 0x7f3a18004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:21.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:21.926+0000 7f3a23fff700 1 --2- 172.21.15.71:0/2775681532 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3a18004d50 0x7f3a180051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:21.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:21.926+0000 7f3a23fff700 1 -- 172.21.15.71:0/2775681532 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2c0d0c20 con 0x7f3a18004d50 2023-10-06T01:40:21.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:21.926+0000 7f3a23fff700 1 -- 172.21.15.71:0/2775681532 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2c159b40 con 0x7f3a18003ae0 2023-10-06T01:40:21.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:21.926+0000 7f3a23fff700 1 -- 172.21.15.71:0/2775681532 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1800bb40 con 0x7f3a2c0cfa90 2023-10-06T01:40:21.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:21.926+0000 7f3a31388700 1 --2- 172.21.15.71:0/2775681532 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a18003ae0 0x7f3a18003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:21.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:21.926+0000 7f3a30b87700 1 --2- 172.21.15.71:0/2775681532 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3a2c0cfa90 0x7f3a18004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:21.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:21.926+0000 7f3a31b89700 1 --2- 172.21.15.71:0/2775681532 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3a18004d50 0x7f3a180051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:21.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:21.926+0000 7f3a30b87700 1 -- 172.21.15.71:0/2775681532 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a18003ae0 msgr2=0x7f3a18003ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:21.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:21.926+0000 7f3a30b87700 1 --2- 172.21.15.71:0/2775681532 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a18003ae0 0x7f3a18003ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:21.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:21.926+0000 7f3a30b87700 1 -- 172.21.15.71:0/2775681532 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3a18004d50 msgr2=0x7f3a180051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:21.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:21.926+0000 7f3a30b87700 1 --2- 172.21.15.71:0/2775681532 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3a18004d50 0x7f3a180051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:21.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:21.926+0000 7f3a30b87700 1 -- 172.21.15.71:0/2775681532 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a18003570 con 0x7f3a2c0cfa90 2023-10-06T01:40:21.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:21.926+0000 7f3a31b89700 1 --2- 172.21.15.71:0/2775681532 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3a18004d50 0x7f3a180051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:40:21.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:21.926+0000 7f3a30b87700 1 --2- 172.21.15.71:0/2775681532 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3a2c0cfa90 0x7f3a18004810 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c009c00 tx=0x7f3a1c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5974d0b0a2c4159 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:21.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:21.926+0000 7f3a23fff700 1 -- 172.21.15.71:0/2775681532 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a1c00e6b0 con 0x7f3a2c0cfa90 2023-10-06T01:40:21.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:21.926+0000 7f3a23fff700 1 -- 172.21.15.71:0/2775681532 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a1c00e810 con 0x7f3a2c0cfa90 2023-10-06T01:40:21.935 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:21.926+0000 7f3a23fff700 1 -- 172.21.15.71:0/2775681532 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a1c00ebd0 con 0x7f3a2c0cfa90 2023-10-06T01:40:21.935 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:21.927+0000 7f3a335ec700 1 -- 172.21.15.71:0/2775681532 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3a2c0cfa90 msgr2=0x7f3a18004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:21.935 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:21.927+0000 7f3a335ec700 1 --2- 172.21.15.71:0/2775681532 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3a2c0cfa90 0x7f3a18004810 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c009c00 tx=0x7f3a1c0091a0 comp rx=0 tx=0).stop 2023-10-06T01:40:21.935 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:21.927+0000 7f3a31b89700 1 -- 172.21.15.71:0/2775681532 reap_dead start 2023-10-06T01:40:21.935 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:21.927+0000 7f3a335ec700 1 -- 172.21.15.71:0/2775681532 shutdown_connections 2023-10-06T01:40:21.935 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:21.927+0000 7f3a335ec700 1 -- 172.21.15.71:0/2775681532 >> 172.21.15.71:0/2775681532 conn(0x7f3a2c0690f0 msgr2=0x7f3a2c06a340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:21.935 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:21.927+0000 7f3a335ec700 1 -- 172.21.15.71:0/2775681532 shutdown_connections 2023-10-06T01:40:21.935 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:21.927+0000 7f3a335ec700 1 -- 172.21.15.71:0/2775681532 wait complete. 2023-10-06T01:40:21.935 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:21.928+0000 7f3a335ec700 1 Processor -- start 2023-10-06T01:40:21.935 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:21.928+0000 7f3a335ec700 1 -- start start 2023-10-06T01:40:21.935 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:21.929+0000 7f3a335ec700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3a2c0cfa90 0x7f3a2c140320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:21.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:21.929+0000 7f3a335ec700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a2c0c50d0 0x7f3a2c0c5540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:21.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:21.929+0000 7f3a335ec700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3a2c1588a0 0x7f3a2c158d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:21.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:21.929+0000 7f3a335ec700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2c140860 con 0x7f3a2c1588a0 2023-10-06T01:40:21.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:21.929+0000 7f3a335ec700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2c159260 con 0x7f3a2c0c50d0 2023-10-06T01:40:21.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:21.929+0000 7f3a335ec700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2c0c5b20 con 0x7f3a2c0cfa90 2023-10-06T01:40:21.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:21.929+0000 7f3a31b89700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3a2c1588a0 0x7f3a2c158d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:21.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:21.929+0000 7f3a31388700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3a2c0cfa90 0x7f3a2c140320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:21.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:21.929+0000 7f3a30b87700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a2c0c50d0 0x7f3a2c0c5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:21.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:21.929+0000 7f3a31388700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3a2c0cfa90 0x7f3a2c140320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.71:42072/0 (socket says 172.21.15.71:42072) 2023-10-06T01:40:21.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:21.929+0000 7f3a31388700 1 -- 172.21.15.71:0/3788228798 learned_addr learned my addr 172.21.15.71:0/3788228798 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:21.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:21.929+0000 7f3a31b89700 1 --2- 172.21.15.71:0/3788228798 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3a2c1588a0 0x7f3a2c158d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39938/0 (socket says 172.21.15.71:39938) 2023-10-06T01:40:21.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:21.929+0000 7f3a31388700 1 -- 172.21.15.71:0/3788228798 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a2c0c50d0 msgr2=0x7f3a2c0c5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:21.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:21.929+0000 7f3a31388700 1 --2- 172.21.15.71:0/3788228798 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a2c0c50d0 0x7f3a2c0c5540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:21.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:21.929+0000 7f3a31388700 1 -- 172.21.15.71:0/3788228798 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3a2c1588a0 msgr2=0x7f3a2c158d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:21.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:21.929+0000 7f3a31388700 1 --2- 172.21.15.71:0/3788228798 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3a2c1588a0 0x7f3a2c158d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:21.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:21.929+0000 7f3a31388700 1 -- 172.21.15.71:0/3788228798 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a2c0c5e00 con 0x7f3a2c0cfa90 2023-10-06T01:40:21.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:21.929+0000 7f3a31388700 1 --2- 172.21.15.71:0/3788228798 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3a2c0cfa90 0x7f3a2c140320 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3a28007af0 tx=0x7f3a28002140 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:21.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:21.929+0000 7f3a217fa700 1 -- 172.21.15.71:0/3788228798 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a2800ad00 con 0x7f3a2c0cfa90 2023-10-06T01:40:21.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:21.929+0000 7f3a217fa700 1 -- 172.21.15.71:0/3788228798 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a2800ae80 con 0x7f3a2c0cfa90 2023-10-06T01:40:21.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:21.929+0000 7f3a217fa700 1 -- 172.21.15.71:0/3788228798 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a28013640 con 0x7f3a2c0cfa90 2023-10-06T01:40:21.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:21.929+0000 7f3a335ec700 1 -- 172.21.15.71:0/3788228798 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a2c0c60e0 con 0x7f3a2c0cfa90 2023-10-06T01:40:21.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:21.930+0000 7f3a335ec700 1 -- 172.21.15.71:0/3788228798 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a2c0c66a0 con 0x7f3a2c0cfa90 2023-10-06T01:40:21.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:21.930+0000 7f3a335ec700 1 -- 172.21.15.71:0/3788228798 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a2c0c68c0 con 0x7f3a2c0cfa90 2023-10-06T01:40:21.939 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:21.931+0000 7f3a217fa700 1 -- 172.21.15.71:0/3788228798 <== mon.2 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3a28013a70 con 0x7f3a2c0cfa90 2023-10-06T01:40:21.939 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:21.931+0000 7f3a217fa700 1 --2- 172.21.15.71:0/3788228798 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f3a10066fb0 0x7f3a10069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:21.939 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:21.931+0000 7f3a217fa700 1 -- 172.21.15.71:0/3788228798 <== mon.2 v2:172.21.15.72:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3a28085130 con 0x7f3a2c0cfa90 2023-10-06T01:40:21.939 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:21.931+0000 7f3a30b87700 1 --2- 172.21.15.71:0/3788228798 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f3a10066fb0 0x7f3a10069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:21.939 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:21.932+0000 7f3a30b87700 1 --2- 172.21.15.71:0/3788228798 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f3a10066fb0 0x7f3a10069460 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c0091e0 tx=0x7f3a1c01a000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:21.939 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:21.936+0000 7f3a217fa700 1 -- 172.21.15.71:0/3788228798 <== mon.2 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3a280521a0 con 0x7f3a2c0cfa90 2023-10-06T01:40:22.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:22.132+0000 7f3a335ec700 1 -- 172.21.15.71:0/3788228798 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f3a2c04bb80 con 0x7f3a2c0cfa90 2023-10-06T01:40:22.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:22.775+0000 7f3a217fa700 1 -- 172.21.15.71:0/3788228798 <== mon.2 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v23) v1 ==== 157+0+0 (secure 0 0 0) 0x7f3a280557c0 con 0x7f3a2c0cfa90 2023-10-06T01:40:22.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:22.778+0000 7f3a335ec700 1 -- 172.21.15.71:0/3788228798 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f3a10066fb0 msgr2=0x7f3a10069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:22.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:22.778+0000 7f3a335ec700 1 --2- 172.21.15.71:0/3788228798 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f3a10066fb0 0x7f3a10069460 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c0091e0 tx=0x7f3a1c01a000 comp rx=0 tx=0).stop 2023-10-06T01:40:22.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:22.778+0000 7f3a335ec700 1 -- 172.21.15.71:0/3788228798 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3a2c0cfa90 msgr2=0x7f3a2c140320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:22.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:22.778+0000 7f3a335ec700 1 --2- 172.21.15.71:0/3788228798 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3a2c0cfa90 0x7f3a2c140320 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3a28007af0 tx=0x7f3a28002140 comp rx=0 tx=0).stop 2023-10-06T01:40:22.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:22.778+0000 7f3a335ec700 1 -- 172.21.15.71:0/3788228798 shutdown_connections 2023-10-06T01:40:22.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:22.778+0000 7f3a335ec700 1 --2- 172.21.15.71:0/3788228798 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3a2c1588a0 0x7f3a2c158d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:22.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:22.778+0000 7f3a335ec700 1 --2- 172.21.15.71:0/3788228798 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3a2c0cfa90 0x7f3a2c140320 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:22.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:22.778+0000 7f3a335ec700 1 --2- 172.21.15.71:0/3788228798 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f3a10066fb0 0x7f3a10069460 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:22.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:22.778+0000 7f3a335ec700 1 --2- 172.21.15.71:0/3788228798 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3a2c0c50d0 0x7f3a2c0c5540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:22.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:22.778+0000 7f3a335ec700 1 -- 172.21.15.71:0/3788228798 >> 172.21.15.71:0/3788228798 conn(0x7f3a2c0690f0 msgr2=0x7f3a2c0b5540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:22.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:22.778+0000 7f3a335ec700 1 -- 172.21.15.71:0/3788228798 shutdown_connections 2023-10-06T01:40:22.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:22.778+0000 7f3a335ec700 1 -- 172.21.15.71:0/3788228798 wait complete. 2023-10-06T01:40:22.791 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T01:40:22.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:22.913+0000 7f6469c09700 1 Processor -- start 2023-10-06T01:40:22.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:22.913+0000 7f6469c09700 1 -- start start 2023-10-06T01:40:22.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:22.914+0000 7f6469c09700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f64640d0860 0x7f6464164080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:22.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:22.914+0000 7f6469c09700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64640b3100 con 0x7f6464159660 2023-10-06T01:40:22.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:22.914+0000 7f6469c09700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64640cd420 con 0x7f6464159290 2023-10-06T01:40:22.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:22.914+0000 7f6469c09700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64640cf620 con 0x7f64640d0860 2023-10-06T01:40:22.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:22.914+0000 7f6462ffd700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f6464159660 0x7f64640d0150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:33152/0 (socket says 172.21.15.71:33152) 2023-10-06T01:40:22.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:22.914+0000 7f6462ffd700 1 -- 172.21.15.71:0/1235453890 learned_addr learned my addr 172.21.15.71:0/1235453890 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:40:22.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:22.914+0000 7f6463fff700 1 --2- 172.21.15.71:0/1235453890 >> v2:172.21.15.72:3300/0 conn(0x7f64640d0860 0x7f6464164080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:22.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:22.914+0000 7f64627fc700 1 -- 172.21.15.71:0/1235453890 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1304478810 0 0) 0x7f64640b3100 con 0x7f6464159660 2023-10-06T01:40:22.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:22.914+0000 7f64627fc700 1 -- 172.21.15.71:0/1235453890 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f644c003570 con 0x7f6464159660 2023-10-06T01:40:22.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:22.914+0000 7f64627fc700 1 -- 172.21.15.71:0/1235453890 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3927571524 0 0) 0x7f644c003570 con 0x7f6464159660 2023-10-06T01:40:22.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:22.915+0000 7f64627fc700 1 -- 172.21.15.71:0/1235453890 >> v2:172.21.15.72:3300/0 conn(0x7f64640d0860 msgr2=0x7f6464164080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:22.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:22.915+0000 7f64627fc700 1 --2- 172.21.15.71:0/1235453890 >> v2:172.21.15.72:3300/0 conn(0x7f64640d0860 0x7f6464164080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:22.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:22.915+0000 7f64627fc700 1 -- 172.21.15.71:0/1235453890 >> v1:172.21.15.72:6789/0 conn(0x7f6464159290 legacy=0x7f64640ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:22.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:22.915+0000 7f64627fc700 1 -- 172.21.15.71:0/1235453890 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64640cf900 con 0x7f6464159660 2023-10-06T01:40:22.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:22.915+0000 7f64627fc700 1 -- 172.21.15.71:0/1235453890 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1184243524 0 0) 0x7f6458001470 con 0x7f6464159660 2023-10-06T01:40:22.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:22.915+0000 7f64627fc700 1 -- 172.21.15.71:0/1235453890 >> v1:172.21.15.71:6789/0 conn(0x7f6464159660 legacy=0x7f64640d0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:22.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:22.915+0000 7f64627fc700 1 --2- 172.21.15.71:0/1235453890 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f644c003a60 0x7f644c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:22.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:22.915+0000 7f64627fc700 1 --2- 172.21.15.71:0/1235453890 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f644c004810 0x7f644c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:22.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:22.915+0000 7f64627fc700 1 --2- 172.21.15.71:0/1235453890 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f644c0051c0 0x7f644c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:22.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:22.915+0000 7f64627fc700 1 -- 172.21.15.71:0/1235453890 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64640cf620 con 0x7f644c0051c0 2023-10-06T01:40:22.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:22.915+0000 7f64627fc700 1 -- 172.21.15.71:0/1235453890 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f644c00c050 con 0x7f644c004810 2023-10-06T01:40:22.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:22.915+0000 7f64627fc700 1 -- 172.21.15.71:0/1235453890 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f644c00c210 con 0x7f644c003a60 2023-10-06T01:40:22.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:22.915+0000 7f6463fff700 1 --2- 172.21.15.71:0/1235453890 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f644c0051c0 0x7f644c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:22.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:22.915+0000 7f6462ffd700 1 --2- 172.21.15.71:0/1235453890 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f644c004810 0x7f644c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:22.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:22.915+0000 7f64637fe700 1 --2- 172.21.15.71:0/1235453890 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f644c003a60 0x7f644c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:22.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:22.915+0000 7f6463fff700 1 -- 172.21.15.71:0/1235453890 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f644c003a60 msgr2=0x7f644c003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:22.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:22.915+0000 7f6463fff700 1 --2- 172.21.15.71:0/1235453890 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f644c003a60 0x7f644c003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:22.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:22.915+0000 7f6463fff700 1 -- 172.21.15.71:0/1235453890 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f644c004810 msgr2=0x7f644c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:22.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:22.915+0000 7f6463fff700 1 --2- 172.21.15.71:0/1235453890 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f644c004810 0x7f644c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:22.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:22.915+0000 7f6463fff700 1 -- 172.21.15.71:0/1235453890 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f644c003570 con 0x7f644c0051c0 2023-10-06T01:40:22.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:22.915+0000 7f6463fff700 1 -- 172.21.15.71:0/1235453890 reap_dead start 2023-10-06T01:40:22.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:22.915+0000 7f6463fff700 1 --2- 172.21.15.71:0/1235453890 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f644c0051c0 0x7f644c00ba60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f64640d0c60 tx=0x7f645c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=356ea21f8ef1b5b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:22.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:22.915+0000 7f64627fc700 1 -- 172.21.15.71:0/1235453890 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645c00e710 con 0x7f644c0051c0 2023-10-06T01:40:22.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:22.915+0000 7f64627fc700 1 -- 172.21.15.71:0/1235453890 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f645c00e890 con 0x7f644c0051c0 2023-10-06T01:40:22.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:22.915+0000 7f64627fc700 1 -- 172.21.15.71:0/1235453890 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645c00ec50 con 0x7f644c0051c0 2023-10-06T01:40:22.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:22.916+0000 7f6469c09700 1 -- 172.21.15.71:0/1235453890 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f644c0051c0 msgr2=0x7f644c00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:22.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:22.916+0000 7f6469c09700 1 --2- 172.21.15.71:0/1235453890 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f644c0051c0 0x7f644c00ba60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f64640d0c60 tx=0x7f645c0091a0 comp rx=0 tx=0).stop 2023-10-06T01:40:22.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:22.916+0000 7f6469c09700 1 -- 172.21.15.71:0/1235453890 shutdown_connections 2023-10-06T01:40:22.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:22.916+0000 7f6469c09700 1 --2- 172.21.15.71:0/1235453890 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f644c0051c0 0x7f644c00ba60 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:22.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:22.916+0000 7f6469c09700 1 -- 172.21.15.71:0/1235453890 >> 172.21.15.71:0/1235453890 conn(0x7f646406acf0 msgr2=0x7f6464068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:22.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:22.916+0000 7f6469c09700 1 -- 172.21.15.71:0/1235453890 shutdown_connections 2023-10-06T01:40:22.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:22.916+0000 7f6469c09700 1 -- 172.21.15.71:0/1235453890 wait complete. 2023-10-06T01:40:22.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:22.917+0000 7f6469c09700 1 Processor -- start 2023-10-06T01:40:22.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:22.917+0000 7f6469c09700 1 -- start start 2023-10-06T01:40:22.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:22.918+0000 7f6469c09700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f644c0051c0 0x7f646414cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:22.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:22.918+0000 7f6469c09700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6464148ea0 0x7f6464169ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:22.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:22.918+0000 7f6469c09700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f646413df70 0x7f6464154cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:22.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:22.918+0000 7f6469c09700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f646414d3a0 con 0x7f644c0051c0 2023-10-06T01:40:22.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:22.918+0000 7f6469c09700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f646414d680 con 0x7f646413df70 2023-10-06T01:40:22.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:22.918+0000 7f6469c09700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f646414d960 con 0x7f6464148ea0 2023-10-06T01:40:22.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:22.918+0000 7f64637fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f644c0051c0 0x7f646414cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:22.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:22.918+0000 7f64637fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f644c0051c0 0x7f646414cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39950/0 (socket says 172.21.15.71:39950) 2023-10-06T01:40:22.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:22.918+0000 7f64637fe700 1 -- 172.21.15.71:0/3839030643 learned_addr learned my addr 172.21.15.71:0/3839030643 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:22.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:22.918+0000 7f64637fe700 1 -- 172.21.15.71:0/3839030643 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6464148ea0 msgr2=0x7f6464169ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:22.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:22.918+0000 7f6463fff700 1 --2- 172.21.15.71:0/3839030643 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f646413df70 0x7f6464154cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:22.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:22.918+0000 7f6462ffd700 1 --2- 172.21.15.71:0/3839030643 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6464148ea0 0x7f6464169ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:22.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:22.918+0000 7f64637fe700 1 --2- 172.21.15.71:0/3839030643 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6464148ea0 0x7f6464169ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:22.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:22.918+0000 7f64637fe700 1 -- 172.21.15.71:0/3839030643 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f646413df70 msgr2=0x7f6464154cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:22.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:22.918+0000 7f64637fe700 1 --2- 172.21.15.71:0/3839030643 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f646413df70 0x7f6464154cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:22.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:22.918+0000 7f64637fe700 1 -- 172.21.15.71:0/3839030643 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64641697f0 con 0x7f644c0051c0 2023-10-06T01:40:22.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:22.918+0000 7f64637fe700 1 --2- 172.21.15.71:0/3839030643 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f644c0051c0 0x7f646414cb50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f645400ebe0 tx=0x7f64540016d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:22.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:22.918+0000 7f644b7fe700 1 -- 172.21.15.71:0/3839030643 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645400c900 con 0x7f644c0051c0 2023-10-06T01:40:22.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:22.919+0000 7f644b7fe700 1 -- 172.21.15.71:0/3839030643 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f645400ca60 con 0x7f644c0051c0 2023-10-06T01:40:22.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:22.919+0000 7f6469c09700 1 -- 172.21.15.71:0/3839030643 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6464169ad0 con 0x7f644c0051c0 2023-10-06T01:40:22.926 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:22.919+0000 7f644b7fe700 1 -- 172.21.15.71:0/3839030643 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645400ce00 con 0x7f644c0051c0 2023-10-06T01:40:22.926 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:22.919+0000 7f6469c09700 1 -- 172.21.15.71:0/3839030643 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f646416a530 con 0x7f644c0051c0 2023-10-06T01:40:22.926 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:22.920+0000 7f6469c09700 1 -- 172.21.15.71:0/3839030643 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6464169cf0 con 0x7f644c0051c0 2023-10-06T01:40:22.926 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:22.920+0000 7f644b7fe700 1 -- 172.21.15.71:0/3839030643 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6454015640 con 0x7f644c0051c0 2023-10-06T01:40:22.926 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:22.920+0000 7f644b7fe700 1 --2- 172.21.15.71:0/3839030643 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f6450066f30 0x7f64500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:22.926 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:22.920+0000 7f644b7fe700 1 -- 172.21.15.71:0/3839030643 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6284+0+0 (secure 0 0 0) 0x7f6454085090 con 0x7f644c0051c0 2023-10-06T01:40:22.926 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:22.920+0000 7f6462ffd700 1 --2- 172.21.15.71:0/3839030643 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f6450066f30 0x7f64500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:22.926 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:22.921+0000 7f6462ffd700 1 --2- 172.21.15.71:0/3839030643 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f6450066f30 0x7f64500693e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6458001d60 tx=0x7f6458009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:22.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:22.925+0000 7f644b7fe700 1 -- 172.21.15.71:0/3839030643 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f64540520c0 con 0x7f644c0051c0 2023-10-06T01:40:23.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:23.108+0000 7f6469c09700 1 -- 172.21.15.71:0/3839030643 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f64640889e0 con 0x7f644c0051c0 2023-10-06T01:40:24.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:24.826+0000 7f644b7fe700 1 -- 172.21.15.71:0/3839030643 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v25) v1 ==== 228+0+0 (secure 0 0 0) 0x7f64540556e0 con 0x7f644c0051c0 2023-10-06T01:40:24.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:24.830+0000 7f6469c09700 1 -- 172.21.15.71:0/3839030643 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f6450066f30 msgr2=0x7f64500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:24.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:24.830+0000 7f6469c09700 1 --2- 172.21.15.71:0/3839030643 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f6450066f30 0x7f64500693e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6458001d60 tx=0x7f6458009040 comp rx=0 tx=0).stop 2023-10-06T01:40:24.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:24.830+0000 7f6469c09700 1 -- 172.21.15.71:0/3839030643 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f644c0051c0 msgr2=0x7f646414cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:24.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:24.830+0000 7f6469c09700 1 --2- 172.21.15.71:0/3839030643 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f644c0051c0 0x7f646414cb50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f645400ebe0 tx=0x7f64540016d0 comp rx=0 tx=0).stop 2023-10-06T01:40:24.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:24.830+0000 7f6469c09700 1 -- 172.21.15.71:0/3839030643 shutdown_connections 2023-10-06T01:40:24.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:24.830+0000 7f6469c09700 1 --2- 172.21.15.71:0/3839030643 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f6450066f30 0x7f64500693e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:24.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:24.830+0000 7f6469c09700 1 --2- 172.21.15.71:0/3839030643 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f646413df70 0x7f6464154cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:24.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:24.830+0000 7f6469c09700 1 --2- 172.21.15.71:0/3839030643 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f644c0051c0 0x7f646414cb50 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:24.832 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:24.830+0000 7f6469c09700 1 --2- 172.21.15.71:0/3839030643 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6464148ea0 0x7f6464169ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:24.832 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:24.830+0000 7f6469c09700 1 -- 172.21.15.71:0/3839030643 >> 172.21.15.71:0/3839030643 conn(0x7f646406acf0 msgr2=0x7f6464152bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:24.832 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:24.830+0000 7f6469c09700 1 -- 172.21.15.71:0/3839030643 shutdown_connections 2023-10-06T01:40:24.832 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:24.830+0000 7f6469c09700 1 -- 172.21.15.71:0/3839030643 wait complete. 2023-10-06T01:40:24.832 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'cephfs_data_ec' created 2023-10-06T01:40:24.844 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-10-06T01:40:24.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:24.963+0000 7f73b750f700 1 Processor -- start 2023-10-06T01:40:24.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:24.963+0000 7f73b750f700 1 -- start start 2023-10-06T01:40:24.967 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:24.964+0000 7f73b750f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f73b0068d90 0x7f73b0168820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:24.967 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:24.964+0000 7f73b750f700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73b00b2800 con 0x7f73b00b2c90 2023-10-06T01:40:24.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:24.964+0000 7f73b750f700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73b00b0500 con 0x7f73b015d6e0 2023-10-06T01:40:24.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:24.964+0000 7f73b750f700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73b00b1ed0 con 0x7f73b0068d90 2023-10-06T01:40:24.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:24.964+0000 7f73b4aaa700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f73b00b2c90 0x7f73b0068680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:33154/0 (socket says 172.21.15.71:33154) 2023-10-06T01:40:24.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:24.964+0000 7f73b4aaa700 1 -- 172.21.15.71:0/1707472030 learned_addr learned my addr 172.21.15.71:0/1707472030 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:40:24.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:24.964+0000 7f73a7fff700 1 -- 172.21.15.71:0/1707472030 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 845103929 0 0) 0x7f73b00b2800 con 0x7f73b00b2c90 2023-10-06T01:40:24.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:24.964+0000 7f73a7fff700 1 -- 172.21.15.71:0/1707472030 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f739c003570 con 0x7f73b00b2c90 2023-10-06T01:40:24.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:24.964+0000 7f73b5aac700 1 --2- 172.21.15.71:0/1707472030 >> v2:172.21.15.72:3300/0 conn(0x7f73b0068d90 0x7f73b0168820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:24.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:24.964+0000 7f73a7fff700 1 -- 172.21.15.71:0/1707472030 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2311923412 0 0) 0x7f739c003570 con 0x7f73b00b2c90 2023-10-06T01:40:24.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:24.964+0000 7f73a7fff700 1 -- 172.21.15.71:0/1707472030 >> v2:172.21.15.72:3300/0 conn(0x7f73b0068d90 msgr2=0x7f73b0168820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:24.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:24.964+0000 7f73a7fff700 1 --2- 172.21.15.71:0/1707472030 >> v2:172.21.15.72:3300/0 conn(0x7f73b0068d90 0x7f73b0168820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:24.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:24.964+0000 7f73a7fff700 1 -- 172.21.15.71:0/1707472030 >> v1:172.21.15.72:6789/0 conn(0x7f73b015d6e0 legacy=0x7f73b00afdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:24.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:24.964+0000 7f73a7fff700 1 -- 172.21.15.71:0/1707472030 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73b00b21b0 con 0x7f73b00b2c90 2023-10-06T01:40:24.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:24.964+0000 7f73a7fff700 1 -- 172.21.15.71:0/1707472030 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1184243524 0 0) 0x7f73a0001470 con 0x7f73b00b2c90 2023-10-06T01:40:24.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:24.964+0000 7f73a7fff700 1 -- 172.21.15.71:0/1707472030 >> v1:172.21.15.71:6789/0 conn(0x7f73b00b2c90 legacy=0x7f73b0068680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:24.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:24.964+0000 7f73a7fff700 1 --2- 172.21.15.71:0/1707472030 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f739c003a60 0x7f739c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:24.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:24.964+0000 7f73a7fff700 1 --2- 172.21.15.71:0/1707472030 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f739c004810 0x7f739c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:24.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:24.964+0000 7f73a7fff700 1 --2- 172.21.15.71:0/1707472030 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f739c0051c0 0x7f739c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:24.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:24.964+0000 7f73a7fff700 1 -- 172.21.15.71:0/1707472030 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73b00b1ed0 con 0x7f739c0051c0 2023-10-06T01:40:24.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:24.964+0000 7f73a7fff700 1 -- 172.21.15.71:0/1707472030 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f739c00c0d0 con 0x7f739c004810 2023-10-06T01:40:24.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:24.964+0000 7f73a7fff700 1 -- 172.21.15.71:0/1707472030 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f739c00c290 con 0x7f739c003a60 2023-10-06T01:40:24.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:24.964+0000 7f73b5aac700 1 --2- 172.21.15.71:0/1707472030 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f739c0051c0 0x7f739c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:24.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:24.964+0000 7f73b4aaa700 1 --2- 172.21.15.71:0/1707472030 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f739c004810 0x7f739c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:24.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:24.964+0000 7f73b52ab700 1 --2- 172.21.15.71:0/1707472030 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f739c003a60 0x7f739c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:24.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:24.965+0000 7f73b5aac700 1 -- 172.21.15.71:0/1707472030 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f739c003a60 msgr2=0x7f739c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:24.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:24.965+0000 7f73b5aac700 1 --2- 172.21.15.71:0/1707472030 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f739c003a60 0x7f739c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:24.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:24.965+0000 7f73b5aac700 1 -- 172.21.15.71:0/1707472030 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f739c004810 msgr2=0x7f739c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:24.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:24.965+0000 7f73b5aac700 1 --2- 172.21.15.71:0/1707472030 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f739c004810 0x7f739c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:24.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:24.965+0000 7f73b5aac700 1 -- 172.21.15.71:0/1707472030 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f739c003570 con 0x7f739c0051c0 2023-10-06T01:40:24.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:24.965+0000 7f73b5aac700 1 -- 172.21.15.71:0/1707472030 reap_dead start 2023-10-06T01:40:24.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:24.965+0000 7f73b5aac700 1 --2- 172.21.15.71:0/1707472030 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f739c0051c0 0x7f739c00ba60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f73a800e210 tx=0x7f73a800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=936874d91001001 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:24.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:24.965+0000 7f73a7fff700 1 -- 172.21.15.71:0/1707472030 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73a800eac0 con 0x7f739c0051c0 2023-10-06T01:40:24.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:24.965+0000 7f73a7fff700 1 -- 172.21.15.71:0/1707472030 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73a800f040 con 0x7f739c0051c0 2023-10-06T01:40:24.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:24.965+0000 7f73a7fff700 1 -- 172.21.15.71:0/1707472030 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73a800ee70 con 0x7f739c0051c0 2023-10-06T01:40:24.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:24.965+0000 7f73b750f700 1 -- 172.21.15.71:0/1707472030 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f739c0051c0 msgr2=0x7f739c00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:24.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:24.965+0000 7f73b750f700 1 --2- 172.21.15.71:0/1707472030 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f739c0051c0 0x7f739c00ba60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f73a800e210 tx=0x7f73a800b040 comp rx=0 tx=0).stop 2023-10-06T01:40:24.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:24.965+0000 7f73b750f700 1 -- 172.21.15.71:0/1707472030 shutdown_connections 2023-10-06T01:40:24.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:24.965+0000 7f73b750f700 1 --2- 172.21.15.71:0/1707472030 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f739c0051c0 0x7f739c00ba60 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:24.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:24.965+0000 7f73b750f700 1 -- 172.21.15.71:0/1707472030 >> 172.21.15.71:0/1707472030 conn(0x7f73b00963e0 msgr2=0x7f73b0069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:24.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:24.966+0000 7f73b750f700 1 -- 172.21.15.71:0/1707472030 shutdown_connections 2023-10-06T01:40:24.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:24.966+0000 7f73b750f700 1 -- 172.21.15.71:0/1707472030 wait complete. 2023-10-06T01:40:24.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:24.967+0000 7f73b750f700 1 Processor -- start 2023-10-06T01:40:24.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:24.967+0000 7f73b750f700 1 -- start start 2023-10-06T01:40:24.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:24.967+0000 7f73b750f700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f739c0051c0 0x7f73b015b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:24.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:24.967+0000 7f73b750f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f73b015c8e0 0x7f73b009a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:24.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:24.967+0000 7f73b750f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f73b0097c00 0x7f73b0098080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:24.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:24.967+0000 7f73b750f700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73b009ab50 con 0x7f739c0051c0 2023-10-06T01:40:24.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:24.967+0000 7f73b750f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73b015c450 con 0x7f73b015c8e0 2023-10-06T01:40:24.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:24.967+0000 7f73b750f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73b016df00 con 0x7f73b0097c00 2023-10-06T01:40:24.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:24.968+0000 7f73b52ab700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f739c0051c0 0x7f73b015b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:24.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:24.968+0000 7f73b52ab700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f739c0051c0 0x7f73b015b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39972/0 (socket says 172.21.15.71:39972) 2023-10-06T01:40:24.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:24.968+0000 7f73b52ab700 1 -- 172.21.15.71:0/167332332 learned_addr learned my addr 172.21.15.71:0/167332332 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:24.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:24.968+0000 7f73b4aaa700 1 --2- 172.21.15.71:0/167332332 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f73b015c8e0 0x7f73b009a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:24.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:24.968+0000 7f73b5aac700 1 --2- 172.21.15.71:0/167332332 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f73b0097c00 0x7f73b0098080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:24.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:24.968+0000 7f73b52ab700 1 -- 172.21.15.71:0/167332332 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f73b0097c00 msgr2=0x7f73b0098080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:24.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:24.968+0000 7f73b52ab700 1 --2- 172.21.15.71:0/167332332 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f73b0097c00 0x7f73b0098080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:24.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:24.968+0000 7f73b52ab700 1 -- 172.21.15.71:0/167332332 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f73b015c8e0 msgr2=0x7f73b009a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:24.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:24.968+0000 7f73b52ab700 1 --2- 172.21.15.71:0/167332332 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f73b015c8e0 0x7f73b009a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:24.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:24.968+0000 7f73b52ab700 1 -- 172.21.15.71:0/167332332 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73b015b840 con 0x7f739c0051c0 2023-10-06T01:40:24.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:24.968+0000 7f73b52ab700 1 --2- 172.21.15.71:0/167332332 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f739c0051c0 0x7f73b015b1b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f73ac002950 tx=0x7f73ac007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:24.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:24.968+0000 7f73a57fa700 1 -- 172.21.15.71:0/167332332 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73ac003390 con 0x7f739c0051c0 2023-10-06T01:40:24.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:24.968+0000 7f73a57fa700 1 -- 172.21.15.71:0/167332332 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73ac013600 con 0x7f739c0051c0 2023-10-06T01:40:24.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:24.968+0000 7f73b750f700 1 -- 172.21.15.71:0/167332332 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73b015bb20 con 0x7f739c0051c0 2023-10-06T01:40:24.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:24.968+0000 7f73a57fa700 1 -- 172.21.15.71:0/167332332 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73ac0139a0 con 0x7f739c0051c0 2023-10-06T01:40:24.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:24.968+0000 7f73b750f700 1 -- 172.21.15.71:0/167332332 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73b015c0e0 con 0x7f739c0051c0 2023-10-06T01:40:24.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:24.969+0000 7f73b750f700 1 -- 172.21.15.71:0/167332332 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73b0069160 con 0x7f739c0051c0 2023-10-06T01:40:24.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:24.969+0000 7f73a57fa700 1 -- 172.21.15.71:0/167332332 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f73ac013d50 con 0x7f739c0051c0 2023-10-06T01:40:24.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:24.970+0000 7f73a57fa700 1 --2- 172.21.15.71:0/167332332 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7394066f30 0x7f73940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:24.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:24.970+0000 7f73b4aaa700 1 --2- 172.21.15.71:0/167332332 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7394066f30 0x7f73940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:24.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:24.970+0000 7f73a57fa700 1 -- 172.21.15.71:0/167332332 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6777+0+0 (secure 0 0 0) 0x7f73ac084ae0 con 0x7f739c0051c0 2023-10-06T01:40:24.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:24.970+0000 7f73b4aaa700 1 --2- 172.21.15.71:0/167332332 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7394066f30 0x7f73940693e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f73b009ad50 tx=0x7f73a0001e50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:24.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:24.974+0000 7f73a57fa700 1 -- 172.21.15.71:0/167332332 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f73ac051920 con 0x7f739c0051c0 2023-10-06T01:40:25.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:25.156+0000 7f73b750f700 1 -- 172.21.15.71:0/167332332 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f73b006d590 con 0x7f739c0051c0 2023-10-06T01:40:25.823 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:25.821+0000 7f73a57fa700 1 -- 172.21.15.71:0/167332332 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 5 allow_ec_overwrites to true v26) v1 ==== 169+0+0 (secure 0 0 0) 0x7f73ac054f40 con 0x7f739c0051c0 2023-10-06T01:40:25.828 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:25.827+0000 7f73b750f700 1 -- 172.21.15.71:0/167332332 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7394066f30 msgr2=0x7f73940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:25.828 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:25.827+0000 7f73b750f700 1 --2- 172.21.15.71:0/167332332 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7394066f30 0x7f73940693e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f73b009ad50 tx=0x7f73a0001e50 comp rx=0 tx=0).stop 2023-10-06T01:40:25.828 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:25.827+0000 7f73b750f700 1 -- 172.21.15.71:0/167332332 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f739c0051c0 msgr2=0x7f73b015b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:25.828 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:25.827+0000 7f73b750f700 1 --2- 172.21.15.71:0/167332332 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f739c0051c0 0x7f73b015b1b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f73ac002950 tx=0x7f73ac007d30 comp rx=0 tx=0).stop 2023-10-06T01:40:25.829 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:25.827+0000 7f73b750f700 1 -- 172.21.15.71:0/167332332 shutdown_connections 2023-10-06T01:40:25.829 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:25.827+0000 7f73b750f700 1 --2- 172.21.15.71:0/167332332 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f73b0097c00 0x7f73b0098080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:25.829 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:25.827+0000 7f73b750f700 1 --2- 172.21.15.71:0/167332332 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f739c0051c0 0x7f73b015b1b0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:25.829 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:25.827+0000 7f73b750f700 1 --2- 172.21.15.71:0/167332332 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7394066f30 0x7f73940693e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:25.829 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:25.827+0000 7f73b750f700 1 --2- 172.21.15.71:0/167332332 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f73b015c8e0 0x7f73b009a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:25.829 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:25.827+0000 7f73b750f700 1 -- 172.21.15.71:0/167332332 >> 172.21.15.71:0/167332332 conn(0x7f73b00963e0 msgr2=0x7f73b015f030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:25.829 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:25.827+0000 7f73b750f700 1 -- 172.21.15.71:0/167332332 shutdown_connections 2023-10-06T01:40:25.829 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:25.828+0000 7f73b750f700 1 -- 172.21.15.71:0/167332332 wait complete. 2023-10-06T01:40:25.830 INFO:teuthology.orchestra.run.smithi071.stderr:set pool 5 allow_ec_overwrites to true 2023-10-06T01:40:25.849 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-10-06T01:40:25.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:25.965+0000 7f1d39a9b700 1 Processor -- start 2023-10-06T01:40:25.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:25.965+0000 7f1d39a9b700 1 -- start start 2023-10-06T01:40:25.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:25.965+0000 7f1d39a9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1d34069a20 0x7f1d3415a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:25.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:25.965+0000 7f1d39a9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f1d340cbb70 0x7f1d340cbff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:25.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:25.965+0000 7f1d39a9b700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d34150bd0 con 0x7f1d34069df0 2023-10-06T01:40:25.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:25.965+0000 7f1d39a9b700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d340cc530 con 0x7f1d340cbb70 2023-10-06T01:40:25.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:25.965+0000 7f1d39a9b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d340c7180 con 0x7f1d34069a20 2023-10-06T01:40:25.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:25.966+0000 7f1d33fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f1d340cbb70 0x7f1d340cbff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:25.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:25.966+0000 7f1d33fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f1d340cbb70 0x7f1d340cbff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39988/0 (socket says 172.21.15.71:39988) 2023-10-06T01:40:25.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:25.966+0000 7f1d33fff700 1 -- 172.21.15.71:0/3417107279 learned_addr learned my addr 172.21.15.71:0/3417107279 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:25.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:25.966+0000 7f1d337fe700 1 --2- 172.21.15.71:0/3417107279 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1d34069a20 0x7f1d3415a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:25.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:25.966+0000 7f1d33fff700 1 -- 172.21.15.71:0/3417107279 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1d34069a20 msgr2=0x7f1d3415a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:25.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:25.966+0000 7f1d33fff700 1 --2- 172.21.15.71:0/3417107279 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1d34069a20 0x7f1d3415a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:25.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:25.966+0000 7f1d33fff700 1 -- 172.21.15.71:0/3417107279 >> v1:172.21.15.72:6789/0 conn(0x7f1d34069df0 legacy=0x7f1d34157110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:25.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:25.966+0000 7f1d33fff700 1 -- 172.21.15.71:0/3417107279 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d34159d60 con 0x7f1d340cbb70 2023-10-06T01:40:25.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:25.966+0000 7f1d33fff700 1 --2- 172.21.15.71:0/3417107279 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1d340cbb70 0x7f1d340cbff0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c0099b0 tx=0x7f1d2c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6663d07cac8baac2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:25.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:25.966+0000 7f1d327fc700 1 -- 172.21.15.71:0/3417107279 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d2c00b820 con 0x7f1d340cbb70 2023-10-06T01:40:25.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:25.966+0000 7f1d327fc700 1 -- 172.21.15.71:0/3417107279 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d2c00b980 con 0x7f1d340cbb70 2023-10-06T01:40:25.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:25.966+0000 7f1d327fc700 1 -- 172.21.15.71:0/3417107279 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d2c00bd20 con 0x7f1d340cbb70 2023-10-06T01:40:25.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:25.967+0000 7f1d39a9b700 1 -- 172.21.15.71:0/3417107279 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1d340cbb70 msgr2=0x7f1d340cbff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:25.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:25.967+0000 7f1d39a9b700 1 --2- 172.21.15.71:0/3417107279 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1d340cbb70 0x7f1d340cbff0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c0099b0 tx=0x7f1d2c009250 comp rx=0 tx=0).stop 2023-10-06T01:40:25.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:25.967+0000 7f1d39a9b700 1 -- 172.21.15.71:0/3417107279 shutdown_connections 2023-10-06T01:40:25.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:25.967+0000 7f1d39a9b700 1 --2- 172.21.15.71:0/3417107279 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1d340cbb70 0x7f1d340cbff0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:25.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:25.967+0000 7f1d39a9b700 1 --2- 172.21.15.71:0/3417107279 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1d34069a20 0x7f1d3415a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:25.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:25.967+0000 7f1d39a9b700 1 -- 172.21.15.71:0/3417107279 >> 172.21.15.71:0/3417107279 conn(0x7f1d340c9cc0 msgr2=0x7f1d3406acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:25.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:25.967+0000 7f1d39a9b700 1 -- 172.21.15.71:0/3417107279 shutdown_connections 2023-10-06T01:40:25.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:25.967+0000 7f1d39a9b700 1 -- 172.21.15.71:0/3417107279 wait complete. 2023-10-06T01:40:25.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:25.968+0000 7f1d39a9b700 1 Processor -- start 2023-10-06T01:40:25.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:25.968+0000 7f1d39a9b700 1 -- start start 2023-10-06T01:40:25.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:25.969+0000 7f1d39a9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d34069a20 0x7f1d34168ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:25.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:25.969+0000 7f1d39a9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1d340cbb70 0x7f1d341503c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:25.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:25.969+0000 7f1d39a9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1d340c5880 0x7f1d340c4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:25.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:25.969+0000 7f1d39a9b700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d34150900 con 0x7f1d340cbb70 2023-10-06T01:40:25.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:25.969+0000 7f1d39a9b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d340ad610 con 0x7f1d34069a20 2023-10-06T01:40:25.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:25.969+0000 7f1d39a9b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d340aca00 con 0x7f1d340c5880 2023-10-06T01:40:25.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:25.969+0000 7f1d32ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1d340cbb70 0x7f1d341503c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:25.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:25.969+0000 7f1d32ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1d340cbb70 0x7f1d341503c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39990/0 (socket says 172.21.15.71:39990) 2023-10-06T01:40:25.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:25.969+0000 7f1d32ffd700 1 -- 172.21.15.71:0/503694534 learned_addr learned my addr 172.21.15.71:0/503694534 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:25.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:25.969+0000 7f1d33fff700 1 --2- 172.21.15.71:0/503694534 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1d340c5880 0x7f1d340c4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:25.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:25.969+0000 7f1d337fe700 1 --2- 172.21.15.71:0/503694534 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d34069a20 0x7f1d34168ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:25.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:25.969+0000 7f1d32ffd700 1 -- 172.21.15.71:0/503694534 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1d340c5880 msgr2=0x7f1d340c4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:25.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:25.969+0000 7f1d32ffd700 1 --2- 172.21.15.71:0/503694534 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1d340c5880 0x7f1d340c4240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:25.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:25.969+0000 7f1d32ffd700 1 -- 172.21.15.71:0/503694534 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d34069a20 msgr2=0x7f1d34168ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:25.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:25.969+0000 7f1d32ffd700 1 --2- 172.21.15.71:0/503694534 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d34069a20 0x7f1d34168ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:25.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:25.969+0000 7f1d32ffd700 1 -- 172.21.15.71:0/503694534 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d2c0094f0 con 0x7f1d340cbb70 2023-10-06T01:40:25.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:25.969+0000 7f1d32ffd700 1 --2- 172.21.15.71:0/503694534 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1d340cbb70 0x7f1d341503c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1d2800c5c0 tx=0x7f1d28007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:25.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:25.969+0000 7f1d1b7fe700 1 -- 172.21.15.71:0/503694534 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d28011590 con 0x7f1d340cbb70 2023-10-06T01:40:25.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:25.969+0000 7f1d1b7fe700 1 -- 172.21.15.71:0/503694534 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d280116f0 con 0x7f1d340cbb70 2023-10-06T01:40:25.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:25.969+0000 7f1d39a9b700 1 -- 172.21.15.71:0/503694534 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d340acce0 con 0x7f1d340cbb70 2023-10-06T01:40:25.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:25.969+0000 7f1d1b7fe700 1 -- 172.21.15.71:0/503694534 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d28011ab0 con 0x7f1d340cbb70 2023-10-06T01:40:25.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:25.969+0000 7f1d39a9b700 1 -- 172.21.15.71:0/503694534 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d340ad2a0 con 0x7f1d340cbb70 2023-10-06T01:40:25.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:25.970+0000 7f1d39a9b700 1 -- 172.21.15.71:0/503694534 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d34156860 con 0x7f1d340cbb70 2023-10-06T01:40:25.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:25.971+0000 7f1d1b7fe700 1 -- 172.21.15.71:0/503694534 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1d2801c460 con 0x7f1d340cbb70 2023-10-06T01:40:25.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:25.971+0000 7f1d1b7fe700 1 --2- 172.21.15.71:0/503694534 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f1d20066f30 0x7f1d200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:25.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:25.971+0000 7f1d337fe700 1 --2- 172.21.15.71:0/503694534 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f1d20066f30 0x7f1d200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:25.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:25.971+0000 7f1d1b7fe700 1 -- 172.21.15.71:0/503694534 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6777+0+0 (secure 0 0 0) 0x7f1d28084790 con 0x7f1d340cbb70 2023-10-06T01:40:25.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:25.971+0000 7f1d337fe700 1 --2- 172.21.15.71:0/503694534 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f1d20066f30 0x7f1d200693e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1d24007540 tx=0x7f1d2400b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:25.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:25.975+0000 7f1d1b7fe700 1 -- 172.21.15.71:0/503694534 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1d280515d0 con 0x7f1d340cbb70 2023-10-06T01:40:26.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:26.201+0000 7f1d39a9b700 1 -- 172.21.15.71:0/503694534 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f1d3415a040 con 0x7f1d340cbb70 2023-10-06T01:40:26.839 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:26.839+0000 7f1d1b7fe700 1 -- 172.21.15.71:0/503694534 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 5 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7f1d28054bf0 con 0x7f1d340cbb70 2023-10-06T01:40:26.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:26.841+0000 7f1d39a9b700 1 -- 172.21.15.71:0/503694534 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f1d20066f30 msgr2=0x7f1d200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:26.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:26.841+0000 7f1d39a9b700 1 --2- 172.21.15.71:0/503694534 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f1d20066f30 0x7f1d200693e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1d24007540 tx=0x7f1d2400b040 comp rx=0 tx=0).stop 2023-10-06T01:40:26.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:26.841+0000 7f1d39a9b700 1 -- 172.21.15.71:0/503694534 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1d340cbb70 msgr2=0x7f1d341503c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:26.843 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:26.841+0000 7f1d39a9b700 1 --2- 172.21.15.71:0/503694534 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1d340cbb70 0x7f1d341503c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1d2800c5c0 tx=0x7f1d28007f30 comp rx=0 tx=0).stop 2023-10-06T01:40:26.843 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:26.841+0000 7f1d39a9b700 1 -- 172.21.15.71:0/503694534 shutdown_connections 2023-10-06T01:40:26.843 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:26.841+0000 7f1d39a9b700 1 --2- 172.21.15.71:0/503694534 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1d340c5880 0x7f1d340c4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:26.843 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:26.841+0000 7f1d39a9b700 1 --2- 172.21.15.71:0/503694534 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f1d20066f30 0x7f1d200693e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:26.843 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:26.841+0000 7f1d39a9b700 1 --2- 172.21.15.71:0/503694534 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d34069a20 0x7f1d34168ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:26.843 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:26.841+0000 7f1d39a9b700 1 --2- 172.21.15.71:0/503694534 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1d340cbb70 0x7f1d341503c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:26.843 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:26.841+0000 7f1d39a9b700 1 -- 172.21.15.71:0/503694534 >> 172.21.15.71:0/503694534 conn(0x7f1d340c9cc0 msgr2=0x7f1d34068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:26.843 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:26.841+0000 7f1d39a9b700 1 -- 172.21.15.71:0/503694534 shutdown_connections 2023-10-06T01:40:26.843 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:26.841+0000 7f1d39a9b700 1 -- 172.21.15.71:0/503694534 wait complete. 2023-10-06T01:40:26.844 INFO:teuthology.orchestra.run.smithi071.stderr:added data pool 5 to fsmap 2023-10-06T01:40:26.855 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T01:40:26.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:26.969+0000 7fbac42d7700 1 Processor -- start 2023-10-06T01:40:26.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:26.969+0000 7fbac42d7700 1 -- start start 2023-10-06T01:40:26.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:26.970+0000 7fbac42d7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbabc0af4e0 0x7fbabc0b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:26.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:26.970+0000 7fbac42d7700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbabc0af8b0 0x7fbabc0b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:26.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:26.970+0000 7fbac42d7700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbabc15e190 con 0x7fbabc15d460 2023-10-06T01:40:26.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:26.970+0000 7fbac42d7700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbabc0b1910 con 0x7fbabc0af8b0 2023-10-06T01:40:26.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:26.970+0000 7fbac42d7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbabc15dfb0 con 0x7fbabc0af4e0 2023-10-06T01:40:26.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:26.970+0000 7fbac2874700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fbabc15d460 0x7fbabc15d8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:33166/0 (socket says 172.21.15.71:33166) 2023-10-06T01:40:26.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:26.970+0000 7fbac2874700 1 -- 172.21.15.71:0/1099083552 learned_addr learned my addr 172.21.15.71:0/1099083552 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:40:26.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:26.970+0000 7fbac2073700 1 --2- 172.21.15.71:0/1099083552 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbabc0af4e0 0x7fbabc0b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:26.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:26.970+0000 7fbac1872700 1 --2- 172.21.15.71:0/1099083552 >> v2:172.21.15.72:3300/0 conn(0x7fbabc0af8b0 0x7fbabc0b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:26.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:26.970+0000 7fbac1071700 1 -- 172.21.15.71:0/1099083552 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1837970899 0 0) 0x7fbabc15e190 con 0x7fbabc15d460 2023-10-06T01:40:26.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:26.970+0000 7fbac1071700 1 -- 172.21.15.71:0/1099083552 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbaa8003570 con 0x7fbabc15d460 2023-10-06T01:40:26.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:26.970+0000 7fbac2073700 1 -- 172.21.15.71:0/1099083552 >> v2:172.21.15.72:3300/0 conn(0x7fbabc0af8b0 msgr2=0x7fbabc0b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:26.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:26.970+0000 7fbac2073700 1 --2- 172.21.15.71:0/1099083552 >> v2:172.21.15.72:3300/0 conn(0x7fbabc0af8b0 0x7fbabc0b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:26.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:26.970+0000 7fbac2073700 1 -- 172.21.15.71:0/1099083552 >> v1:172.21.15.71:6789/0 conn(0x7fbabc15d460 legacy=0x7fbabc15d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:26.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:26.970+0000 7fbac2073700 1 -- 172.21.15.71:0/1099083552 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbabc0cb650 con 0x7fbabc0af4e0 2023-10-06T01:40:26.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:26.970+0000 7fbac1872700 1 --2- 172.21.15.71:0/1099083552 >> v2:172.21.15.72:3300/0 conn(0x7fbabc0af8b0 0x7fbabc0b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:40:26.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:26.970+0000 7fbac2073700 1 --2- 172.21.15.71:0/1099083552 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbabc0af4e0 0x7fbabc0b20e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fbab80098e0 tx=0x7fbab80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=138f0a67d9ac8fc7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:26.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:26.971+0000 7fbac1071700 1 -- 172.21.15.71:0/1099083552 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab8011630 con 0x7fbabc0af4e0 2023-10-06T01:40:26.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:26.971+0000 7fbac1071700 1 -- 172.21.15.71:0/1099083552 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbab8011790 con 0x7fbabc0af4e0 2023-10-06T01:40:26.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:26.971+0000 7fbac1071700 1 -- 172.21.15.71:0/1099083552 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab8011b30 con 0x7fbabc0af4e0 2023-10-06T01:40:26.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:26.971+0000 7fbac42d7700 1 -- 172.21.15.71:0/1099083552 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbabc0af4e0 msgr2=0x7fbabc0b20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:26.983 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:26.971+0000 7fbac42d7700 1 --2- 172.21.15.71:0/1099083552 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbabc0af4e0 0x7fbabc0b20e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fbab80098e0 tx=0x7fbab80091a0 comp rx=0 tx=0).stop 2023-10-06T01:40:26.983 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:26.971+0000 7fbac42d7700 1 -- 172.21.15.71:0/1099083552 shutdown_connections 2023-10-06T01:40:26.983 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:26.971+0000 7fbac42d7700 1 --2- 172.21.15.71:0/1099083552 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbabc0af4e0 0x7fbabc0b20e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:26.983 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:26.971+0000 7fbac42d7700 1 --2- 172.21.15.71:0/1099083552 >> v2:172.21.15.72:3300/0 conn(0x7fbabc0af8b0 0x7fbabc0b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:26.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:26.971+0000 7fbac42d7700 1 -- 172.21.15.71:0/1099083552 >> 172.21.15.71:0/1099083552 conn(0x7fbabc068680 msgr2=0x7fbabc068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:26.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:26.971+0000 7fbac42d7700 1 -- 172.21.15.71:0/1099083552 shutdown_connections 2023-10-06T01:40:26.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:26.971+0000 7fbac42d7700 1 -- 172.21.15.71:0/1099083552 wait complete. 2023-10-06T01:40:26.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:26.972+0000 7fbac42d7700 1 Processor -- start 2023-10-06T01:40:26.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:26.972+0000 7fbac42d7700 1 -- start start 2023-10-06T01:40:26.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:26.973+0000 7fbac42d7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbabc0af4e0 0x7fbabc0a7c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:26.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:26.973+0000 7fbac42d7700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbabc0af8b0 0x7fbabc0a9080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:26.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:26.973+0000 7fbac42d7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbabc15d460 0x7fbabc0a95c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:26.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:26.973+0000 7fbac42d7700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbabc0a84d0 con 0x7fbabc0af8b0 2023-10-06T01:40:26.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:26.973+0000 7fbac42d7700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbabc15a300 con 0x7fbabc0af4e0 2023-10-06T01:40:26.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:26.973+0000 7fbac42d7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbabc0b3240 con 0x7fbabc15d460 2023-10-06T01:40:26.986 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:26.973+0000 7fbac1872700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbabc0af8b0 0x7fbabc0a9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:26.986 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:26.973+0000 7fbac1872700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbabc0af8b0 0x7fbabc0a9080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39996/0 (socket says 172.21.15.71:39996) 2023-10-06T01:40:26.986 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:26.973+0000 7fbac1872700 1 -- 172.21.15.71:0/484156450 learned_addr learned my addr 172.21.15.71:0/484156450 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:26.986 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:26.973+0000 7fbac1872700 1 -- 172.21.15.71:0/484156450 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbabc15d460 msgr2=0x7fbabc0a95c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:26.986 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:26.973+0000 7fbac1872700 1 --2- 172.21.15.71:0/484156450 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbabc15d460 0x7fbabc0a95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:26.986 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:26.973+0000 7fbac1872700 1 -- 172.21.15.71:0/484156450 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbabc0af4e0 msgr2=0x7fbabc0a7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:26.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:26.973+0000 7fbac1872700 1 --2- 172.21.15.71:0/484156450 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbabc0af4e0 0x7fbabc0a7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:26.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:26.973+0000 7fbac1872700 1 -- 172.21.15.71:0/484156450 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaac009420 con 0x7fbabc0af8b0 2023-10-06T01:40:26.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:26.974+0000 7fbac1872700 1 --2- 172.21.15.71:0/484156450 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbabc0af8b0 0x7fbabc0a9080 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fbaac00ec80 tx=0x7fbaac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:26.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:26.974+0000 7fbab27fc700 1 -- 172.21.15.71:0/484156450 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaac00c9d0 con 0x7fbabc0af8b0 2023-10-06T01:40:26.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:26.974+0000 7fbab27fc700 1 -- 172.21.15.71:0/484156450 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaac00cb30 con 0x7fbabc0af8b0 2023-10-06T01:40:26.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:26.974+0000 7fbac42d7700 1 -- 172.21.15.71:0/484156450 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbab8009420 con 0x7fbabc0af8b0 2023-10-06T01:40:26.988 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:26.974+0000 7fbab27fc700 1 -- 172.21.15.71:0/484156450 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaac00ceb0 con 0x7fbabc0af8b0 2023-10-06T01:40:26.988 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:26.974+0000 7fbac42d7700 1 -- 172.21.15.71:0/484156450 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbabc0b3880 con 0x7fbabc0af8b0 2023-10-06T01:40:26.988 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:26.975+0000 7fbac42d7700 1 -- 172.21.15.71:0/484156450 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbabc0b03d0 con 0x7fbabc0af8b0 2023-10-06T01:40:26.988 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:26.975+0000 7fbab27fc700 1 -- 172.21.15.71:0/484156450 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbaac013680 con 0x7fbabc0af8b0 2023-10-06T01:40:26.988 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:26.975+0000 7fbab27fc700 1 --2- 172.21.15.71:0/484156450 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fbaa0066f30 0x7fbaa00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:26.988 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:26.976+0000 7fbac2073700 1 --2- 172.21.15.71:0/484156450 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fbaa0066f30 0x7fbaa00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:26.988 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:26.976+0000 7fbab27fc700 1 -- 172.21.15.71:0/484156450 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fbaac084e00 con 0x7fbabc0af8b0 2023-10-06T01:40:26.989 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:26.976+0000 7fbac2073700 1 --2- 172.21.15.71:0/484156450 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fbaa0066f30 0x7fbaa00693e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbab80091e0 tx=0x7fbab8017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:26.989 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:26.980+0000 7fbab27fc700 1 -- 172.21.15.71:0/484156450 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbaac051c20 con 0x7fbabc0af8b0 2023-10-06T01:40:27.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.203+0000 7fbac42d7700 1 -- 172.21.15.71:0/484156450 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbabc067e00 con 0x7fbabc0af8b0 2023-10-06T01:40:27.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.204+0000 7fbab27fc700 1 -- 172.21.15.71:0/484156450 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4590 (secure 0 0 0) 0x7fbaac017090 con 0x7fbabc0af8b0 2023-10-06T01:40:27.205 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:40:27.205 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6836/274053969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":274053969},{"type":"v1","addr":"172.21.15.71:6836","nonce":274053969}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/4158221694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6835","nonce":4158221694},{"type":"v1","addr":"172.21.15.71:6837","nonce":4158221694}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/1094581488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":1094581488},{"type":"v1","addr":"172.21.15.72:6835","nonce":1094581488}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T01:40:21.151426+0000","modified":"2023-10-06T01:40:26.831619+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4315},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4315":{"gid":4315,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6834/2361644634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6833","nonce":2361644634},{"type":"v1","addr":"172.21.15.72:6834","nonce":2361644634}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2023-10-06T01:40:27.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.206+0000 7fbac42d7700 1 -- 172.21.15.71:0/484156450 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fbaa0066f30 msgr2=0x7fbaa00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:27.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.206+0000 7fbac42d7700 1 --2- 172.21.15.71:0/484156450 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fbaa0066f30 0x7fbaa00693e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbab80091e0 tx=0x7fbab8017000 comp rx=0 tx=0).stop 2023-10-06T01:40:27.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.206+0000 7fbac42d7700 1 -- 172.21.15.71:0/484156450 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbabc0af8b0 msgr2=0x7fbabc0a9080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:27.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.206+0000 7fbac42d7700 1 --2- 172.21.15.71:0/484156450 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbabc0af8b0 0x7fbabc0a9080 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fbaac00ec80 tx=0x7fbaac0091a0 comp rx=0 tx=0).stop 2023-10-06T01:40:27.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.206+0000 7fbac42d7700 1 -- 172.21.15.71:0/484156450 shutdown_connections 2023-10-06T01:40:27.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.206+0000 7fbac42d7700 1 --2- 172.21.15.71:0/484156450 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbabc15d460 0x7fbabc0a95c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:27.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.206+0000 7fbac42d7700 1 --2- 172.21.15.71:0/484156450 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fbaa0066f30 0x7fbaa00693e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:27.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.206+0000 7fbac42d7700 1 --2- 172.21.15.71:0/484156450 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbabc0af4e0 0x7fbabc0a7c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:27.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.206+0000 7fbac42d7700 1 --2- 172.21.15.71:0/484156450 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbabc0af8b0 0x7fbabc0a9080 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:27.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.206+0000 7fbac42d7700 1 -- 172.21.15.71:0/484156450 >> 172.21.15.71:0/484156450 conn(0x7fbabc068680 msgr2=0x7fbabc0cf000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:27.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.206+0000 7fbac42d7700 1 -- 172.21.15.71:0/484156450 shutdown_connections 2023-10-06T01:40:27.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.206+0000 7fbac42d7700 1 -- 172.21.15.71:0/484156450 wait complete. 2023-10-06T01:40:27.208 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 7 2023-10-06T01:40:27.218 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:40:27.332 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.332+0000 7f47288f7700 1 Processor -- start 2023-10-06T01:40:27.333 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.332+0000 7f47288f7700 1 -- start start 2023-10-06T01:40:27.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.333+0000 7f47288f7700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f47240af4e0 0x7f47240b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:27.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.333+0000 7f47288f7700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f472415e190 con 0x7f472415db70 2023-10-06T01:40:27.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.333+0000 7f47288f7700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47240cb650 con 0x7f47240af8b0 2023-10-06T01:40:27.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.333+0000 7f47288f7700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47240b1910 con 0x7f47240af4e0 2023-10-06T01:40:27.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.333+0000 7f472259c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f47240af4e0 0x7f47240b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:27.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.333+0000 7f4722d9d700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f472415db70 0x7f47240cbae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:33170/0 (socket says 172.21.15.71:33170) 2023-10-06T01:40:27.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.333+0000 7f4722d9d700 1 -- 172.21.15.71:0/3991761066 learned_addr learned my addr 172.21.15.71:0/3991761066 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:40:27.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.333+0000 7f472259c700 1 -- 172.21.15.71:0/3991761066 >> v1:172.21.15.72:6789/0 conn(0x7f47240af8b0 legacy=0x7f472415d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:27.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.333+0000 7f472259c700 1 -- 172.21.15.71:0/3991761066 >> v1:172.21.15.71:6789/0 conn(0x7f472415db70 legacy=0x7f47240cbae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:27.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.333+0000 7f472259c700 1 -- 172.21.15.71:0/3991761066 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47240cad20 con 0x7f47240af4e0 2023-10-06T01:40:27.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.333+0000 7f4721d9b700 1 -- 172.21.15.71:0/3991761066 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3859089022 0 0) 0x7f472415e190 con 0x7f472415db70 2023-10-06T01:40:27.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.333+0000 7f472259c700 1 --2- 172.21.15.71:0/3991761066 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47240af4e0 0x7f47240b20e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f47140098e0 tx=0x7f47140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73ec67ba7b6c2a90 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:27.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.333+0000 7f4721d9b700 1 -- 172.21.15.71:0/3991761066 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4714009e80 con 0x7f47240af4e0 2023-10-06T01:40:27.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.333+0000 7f4721d9b700 1 -- 172.21.15.71:0/3991761066 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f471400b860 con 0x7f47240af4e0 2023-10-06T01:40:27.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.333+0000 7f4721d9b700 1 -- 172.21.15.71:0/3991761066 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f471400bbe0 con 0x7f47240af4e0 2023-10-06T01:40:27.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.334+0000 7f47288f7700 1 -- 172.21.15.71:0/3991761066 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47240af4e0 msgr2=0x7f47240b20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:27.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.334+0000 7f47288f7700 1 --2- 172.21.15.71:0/3991761066 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47240af4e0 0x7f47240b20e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f47140098e0 tx=0x7f47140091a0 comp rx=0 tx=0).stop 2023-10-06T01:40:27.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.334+0000 7f47288f7700 1 -- 172.21.15.71:0/3991761066 shutdown_connections 2023-10-06T01:40:27.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.334+0000 7f47288f7700 1 --2- 172.21.15.71:0/3991761066 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47240af4e0 0x7f47240b20e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:27.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.334+0000 7f47288f7700 1 -- 172.21.15.71:0/3991761066 >> 172.21.15.71:0/3991761066 conn(0x7f4724068680 msgr2=0x7f4724068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:27.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.334+0000 7f47288f7700 1 -- 172.21.15.71:0/3991761066 shutdown_connections 2023-10-06T01:40:27.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.334+0000 7f47288f7700 1 -- 172.21.15.71:0/3991761066 wait complete. 2023-10-06T01:40:27.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.335+0000 7f47288f7700 1 Processor -- start 2023-10-06T01:40:27.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.335+0000 7f47288f7700 1 -- start start 2023-10-06T01:40:27.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.336+0000 7f47288f7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f47240af4e0 0x7f47240d06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:27.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.336+0000 7f47288f7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47240af8b0 0x7f472416cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:27.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.336+0000 7f47288f7700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f472415db70 0x7f47240cde20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:27.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.336+0000 7f47288f7700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47240ce360 con 0x7f472415db70 2023-10-06T01:40:27.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.336+0000 7f47288f7700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47240cf180 con 0x7f47240af8b0 2023-10-06T01:40:27.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.336+0000 7f47288f7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47240ce570 con 0x7f47240af4e0 2023-10-06T01:40:27.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.336+0000 7f4722d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f472415db70 0x7f47240cde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:27.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.336+0000 7f4722d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f472415db70 0x7f47240cde20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40028/0 (socket says 172.21.15.71:40028) 2023-10-06T01:40:27.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.336+0000 7f4722d9d700 1 -- 172.21.15.71:0/2290161316 learned_addr learned my addr 172.21.15.71:0/2290161316 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:27.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.336+0000 7f472259c700 1 --2- 172.21.15.71:0/2290161316 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f47240af4e0 0x7f47240d06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:27.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.336+0000 7f471bfff700 1 --2- 172.21.15.71:0/2290161316 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47240af8b0 0x7f472416cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:27.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.336+0000 7f4722d9d700 1 -- 172.21.15.71:0/2290161316 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f47240af4e0 msgr2=0x7f47240d06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:27.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.336+0000 7f4722d9d700 1 --2- 172.21.15.71:0/2290161316 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f47240af4e0 0x7f47240d06b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:27.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.336+0000 7f4722d9d700 1 -- 172.21.15.71:0/2290161316 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47240af8b0 msgr2=0x7f472416cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:27.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.336+0000 7f4722d9d700 1 --2- 172.21.15.71:0/2290161316 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47240af8b0 0x7f472416cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:27.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.336+0000 7f4722d9d700 1 -- 172.21.15.71:0/2290161316 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4714009420 con 0x7f472415db70 2023-10-06T01:40:27.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.336+0000 7f4722d9d700 1 --2- 172.21.15.71:0/2290161316 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f472415db70 0x7f47240cde20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f471c00cc90 tx=0x7f471c001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:27.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.336+0000 7f471a7fc700 1 -- 172.21.15.71:0/2290161316 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f471c00a870 con 0x7f472415db70 2023-10-06T01:40:27.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.336+0000 7f471a7fc700 1 -- 172.21.15.71:0/2290161316 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f471c00a9d0 con 0x7f472415db70 2023-10-06T01:40:27.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.336+0000 7f471a7fc700 1 -- 172.21.15.71:0/2290161316 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f471c00ad90 con 0x7f472415db70 2023-10-06T01:40:27.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.336+0000 7f47288f7700 1 -- 172.21.15.71:0/2290161316 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47240ce850 con 0x7f472415db70 2023-10-06T01:40:27.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.337+0000 7f47288f7700 1 -- 172.21.15.71:0/2290161316 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47240cee10 con 0x7f472415db70 2023-10-06T01:40:27.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.337+0000 7f47288f7700 1 -- 172.21.15.71:0/2290161316 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4724088aa0 con 0x7f472415db70 2023-10-06T01:40:27.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.338+0000 7f471a7fc700 1 -- 172.21.15.71:0/2290161316 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f471c007300 con 0x7f472415db70 2023-10-06T01:40:27.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.338+0000 7f471a7fc700 1 --2- 172.21.15.71:0/2290161316 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f4704066f30 0x7f47040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:27.342 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.338+0000 7f471a7fc700 1 -- 172.21.15.71:0/2290161316 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f471c084df0 con 0x7f472415db70 2023-10-06T01:40:27.342 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.338+0000 7f472259c700 1 --2- 172.21.15.71:0/2290161316 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f4704066f30 0x7f47040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:27.342 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.339+0000 7f472259c700 1 --2- 172.21.15.71:0/2290161316 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f4704066f30 0x7f47040693e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f47140093f0 tx=0x7f4714017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:27.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.342+0000 7f471a7fc700 1 -- 172.21.15.71:0/2290161316 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f471c051b60 con 0x7f472415db70 2023-10-06T01:40:27.526 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.525+0000 7f47288f7700 1 -- 172.21.15.71:0/2290161316 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f47240b0910 con 0x7f472415db70 2023-10-06T01:40:27.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.526+0000 7f471a7fc700 1 -- 172.21.15.71:0/2290161316 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18659 (secure 0 0 0) 0x7f471c055180 con 0x7f472415db70 2023-10-06T01:40:27.527 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:40:27.527 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":27,"fsid":"1fbf1bd2-f9b4-4599-bea2-f4aa920e9a56","created":"2023-10-06T01:39:57.016957+0000","modified":"2023-10-06T01:40:26.202441+0000","last_up_change":"2023-10-06T01:40:08.571643+0000","last_in_change":"2023-10-06T01:39:59.462741+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T01:40:08.610349+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T01:40:15.387434+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T01:40:19.640459+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T01:40:20.116883+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T01:40:23.830129+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cf059188-fb20-4dbf-95db-dcf57b213d03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":90670},{"type":"v1","addr":"172.21.15.71:6817","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":90670},{"type":"v1","addr":"172.21.15.71:6819","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":90670},{"type":"v1","addr":"172.21.15.71:6823","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":90670},{"type":"v1","addr":"172.21.15.71:6821","nonce":90670}]},"public_addr":"172.21.15.71:6817/90670","cluster_addr":"172.21.15.71:6819/90670","heartbeat_back_addr":"172.21.15.71:6823/90670","heartbeat_front_addr":"172.21.15.71:6821/90670","state":["exists","up"]},{"osd":1,"uuid":"0cff0aae-1799-4fe0-b610-54cf0813c0e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":90669},{"type":"v1","addr":"172.21.15.71:6809","nonce":90669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":90669},{"type":"v1","addr":"172.21.15.71:6811","nonce":90669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":90669},{"type":"v1","addr":"172.21.15.71:6815","nonce":90669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":90669},{"type":"v1","addr":"172.21.15.71:6813","nonce":90669}]},"public_addr":"172.21.15.71:6809/90669","cluster_addr":"172.21.15.71:6811/90669","heartbeat_back_addr":"172.21.15.71:6815/90669","heartbeat_front_addr":"172.21.15.71:6813/90669","state":["exists","up"]},{"osd":2,"uuid":"88d61ddc-9031-44e1-ba8c-546a41e7c8ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":90679},{"type":"v1","addr":"172.21.15.71:6825","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":90679},{"type":"v1","addr":"172.21.15.71:6827","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":90679},{"type":"v1","addr":"172.21.15.71:6831","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":90679},{"type":"v1","addr":"172.21.15.71:6829","nonce":90679}]},"public_addr":"172.21.15.71:6825/90679","cluster_addr":"172.21.15.71:6827/90679","heartbeat_back_addr":"172.21.15.71:6831/90679","heartbeat_front_addr":"172.21.15.71:6829/90679","state":["exists","up"]},{"osd":3,"uuid":"11ed92b7-960b-4a30-a889-a61d3eeb86f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":90668},{"type":"v1","addr":"172.21.15.71:6801","nonce":90668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":90668},{"type":"v1","addr":"172.21.15.71:6803","nonce":90668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":90668},{"type":"v1","addr":"172.21.15.71:6807","nonce":90668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":90668},{"type":"v1","addr":"172.21.15.71:6805","nonce":90668}]},"public_addr":"172.21.15.71:6801/90668","cluster_addr":"172.21.15.71:6803/90668","heartbeat_back_addr":"172.21.15.71:6807/90668","heartbeat_front_addr":"172.21.15.71:6805/90668","state":["exists","up"]},{"osd":4,"uuid":"ae4df784-abdf-4ddf-aefa-780f3ddafef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":90917},{"type":"v1","addr":"172.21.15.72:6801","nonce":90917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":90917},{"type":"v1","addr":"172.21.15.72:6803","nonce":90917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":90917},{"type":"v1","addr":"172.21.15.72:6807","nonce":90917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":90917},{"type":"v1","addr":"172.21.15.72:6805","nonce":90917}]},"public_addr":"172.21.15.72:6801/90917","cluster_addr":"172.21.15.72:6803/90917","heartbeat_back_addr":"172.21.15.72:6807/90917","heartbeat_front_addr":"172.21.15.72:6805/90917","state":["exists","up"]},{"osd":5,"uuid":"5ef0790f-001e-458f-a05b-efae216cf435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":90941},{"type":"v1","addr":"172.21.15.72:6817","nonce":90941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":90941},{"type":"v1","addr":"172.21.15.72:6819","nonce":90941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":90941},{"type":"v1","addr":"172.21.15.72:6827","nonce":90941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":90941},{"type":"v1","addr":"172.21.15.72:6823","nonce":90941}]},"public_addr":"172.21.15.72:6817/90941","cluster_addr":"172.21.15.72:6819/90941","heartbeat_back_addr":"172.21.15.72:6827/90941","heartbeat_front_addr":"172.21.15.72:6823/90941","state":["exists","up"]},{"osd":6,"uuid":"8705aef1-9ae8-4e54-a3c4-c2909fa0ceb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":90918},{"type":"v1","addr":"172.21.15.72:6809","nonce":90918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":90918},{"type":"v1","addr":"172.21.15.72:6811","nonce":90918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":90918},{"type":"v1","addr":"172.21.15.72:6815","nonce":90918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":90918},{"type":"v1","addr":"172.21.15.72:6813","nonce":90918}]},"public_addr":"172.21.15.72:6809/90918","cluster_addr":"172.21.15.72:6811/90918","heartbeat_back_addr":"172.21.15.72:6815/90918","heartbeat_front_addr":"172.21.15.72:6813/90918","state":["exists","up"]},{"osd":7,"uuid":"364c5119-6b13-4c75-b3f0-15e165eff86a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":90948},{"type":"v1","addr":"172.21.15.72:6822","nonce":90948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":90948},{"type":"v1","addr":"172.21.15.72:6826","nonce":90948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":90948},{"type":"v1","addr":"172.21.15.72:6831","nonce":90948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":90948},{"type":"v1","addr":"172.21.15.72:6829","nonce":90948}]},"public_addr":"172.21.15.72:6822/90948","cluster_addr":"172.21.15.72:6826/90948","heartbeat_back_addr":"172.21.15.72:6831/90948","heartbeat_front_addr":"172.21.15.72:6829/90948","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.642976+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.645372+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.619116+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.663042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.599163+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.646411+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.631545+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.669821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:40:27.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.528+0000 7f47288f7700 1 -- 172.21.15.71:0/2290161316 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f4704066f30 msgr2=0x7f47040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:27.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.528+0000 7f47288f7700 1 --2- 172.21.15.71:0/2290161316 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f4704066f30 0x7f47040693e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f47140093f0 tx=0x7f4714017000 comp rx=0 tx=0).stop 2023-10-06T01:40:27.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.528+0000 7f47288f7700 1 -- 172.21.15.71:0/2290161316 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f472415db70 msgr2=0x7f47240cde20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:27.530 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.528+0000 7f47288f7700 1 --2- 172.21.15.71:0/2290161316 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f472415db70 0x7f47240cde20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f471c00cc90 tx=0x7f471c001a20 comp rx=0 tx=0).stop 2023-10-06T01:40:27.530 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.528+0000 7f47288f7700 1 -- 172.21.15.71:0/2290161316 shutdown_connections 2023-10-06T01:40:27.530 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.528+0000 7f47288f7700 1 --2- 172.21.15.71:0/2290161316 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f472415db70 0x7f47240cde20 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:27.530 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.528+0000 7f47288f7700 1 --2- 172.21.15.71:0/2290161316 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f47240af4e0 0x7f47240d06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:27.530 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.528+0000 7f47288f7700 1 --2- 172.21.15.71:0/2290161316 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f4704066f30 0x7f47040693e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:27.530 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.528+0000 7f47288f7700 1 --2- 172.21.15.71:0/2290161316 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47240af8b0 0x7f472416cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:27.530 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.528+0000 7f47288f7700 1 -- 172.21.15.71:0/2290161316 >> 172.21.15.71:0/2290161316 conn(0x7f4724068680 msgr2=0x7f47240ccd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:27.530 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.528+0000 7f47288f7700 1 -- 172.21.15.71:0/2290161316 shutdown_connections 2023-10-06T01:40:27.530 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.528+0000 7f47288f7700 1 -- 172.21.15.71:0/2290161316 wait complete. 2023-10-06T01:40:27.541 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:40:27.656 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.655+0000 7f89b4c84700 1 Processor -- start 2023-10-06T01:40:27.656 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.655+0000 7f89b4c84700 1 -- start start 2023-10-06T01:40:27.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.656+0000 7f89b4c84700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f89b00af250 0x7f89b00ad5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:27.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.656+0000 7f89b4c84700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f89b00c9f40 0x7f89b00ccfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:27.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.656+0000 7f89b4c84700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f89b00af620 0x7f89b00cd510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:27.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.656+0000 7f89b4c84700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89b0069550 con 0x7f89b00af620 2023-10-06T01:40:27.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.656+0000 7f89b4c84700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89b00adb30 con 0x7f89b00c9f40 2023-10-06T01:40:27.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.656+0000 7f89b4c84700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89b00add80 con 0x7f89b00af250 2023-10-06T01:40:27.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.656+0000 7f89aed9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f89b00af620 0x7f89b00cd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:27.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.656+0000 7f89aed9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f89b00af620 0x7f89b00cd510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40030/0 (socket says 172.21.15.71:40030) 2023-10-06T01:40:27.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.656+0000 7f89aed9d700 1 -- 172.21.15.71:0/683637040 learned_addr learned my addr 172.21.15.71:0/683637040 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:27.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.657+0000 7f89ae59c700 1 --2- 172.21.15.71:0/683637040 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f89b00af250 0x7f89b00ad5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:27.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.657+0000 7f89add9b700 1 --2- 172.21.15.71:0/683637040 >> v2:172.21.15.72:3300/0 conn(0x7f89b00c9f40 0x7f89b00ccfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:27.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.657+0000 7f89aed9d700 1 -- 172.21.15.71:0/683637040 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f89b00af250 msgr2=0x7f89b00ad5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:27.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.657+0000 7f89aed9d700 1 --2- 172.21.15.71:0/683637040 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f89b00af250 0x7f89b00ad5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:27.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.657+0000 7f89aed9d700 1 -- 172.21.15.71:0/683637040 >> v2:172.21.15.72:3300/0 conn(0x7f89b00c9f40 msgr2=0x7f89b00ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:27.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.657+0000 7f89aed9d700 1 --2- 172.21.15.71:0/683637040 >> v2:172.21.15.72:3300/0 conn(0x7f89b00c9f40 0x7f89b00ccfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:27.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.657+0000 7f89aed9d700 1 -- 172.21.15.71:0/683637040 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89b00ae060 con 0x7f89b00af620 2023-10-06T01:40:27.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.657+0000 7f89aed9d700 1 --2- 172.21.15.71:0/683637040 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89b00af620 0x7f89b00cd510 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f89b006e9b0 tx=0x7f89a8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10d4acc4b1e2d137 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:27.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.657+0000 7f89ad59a700 1 -- 172.21.15.71:0/683637040 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a800e070 con 0x7f89b00af620 2023-10-06T01:40:27.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.657+0000 7f89ad59a700 1 -- 172.21.15.71:0/683637040 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89a800ba50 con 0x7f89b00af620 2023-10-06T01:40:27.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.657+0000 7f89ad59a700 1 -- 172.21.15.71:0/683637040 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a80092e0 con 0x7f89b00af620 2023-10-06T01:40:27.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.657+0000 7f89b4c84700 1 -- 172.21.15.71:0/683637040 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89b00af620 msgr2=0x7f89b00cd510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:27.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.657+0000 7f89b4c84700 1 --2- 172.21.15.71:0/683637040 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89b00af620 0x7f89b00cd510 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f89b006e9b0 tx=0x7f89a8009840 comp rx=0 tx=0).stop 2023-10-06T01:40:27.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.657+0000 7f89b4c84700 1 -- 172.21.15.71:0/683637040 shutdown_connections 2023-10-06T01:40:27.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.657+0000 7f89b4c84700 1 --2- 172.21.15.71:0/683637040 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89b00af620 0x7f89b00cd510 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:27.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.658+0000 7f89b4c84700 1 --2- 172.21.15.71:0/683637040 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f89b00af250 0x7f89b00ad5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:27.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.658+0000 7f89b4c84700 1 --2- 172.21.15.71:0/683637040 >> v2:172.21.15.72:3300/0 conn(0x7f89b00c9f40 0x7f89b00ccfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:27.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.658+0000 7f89b4c84700 1 -- 172.21.15.71:0/683637040 >> 172.21.15.71:0/683637040 conn(0x7f89b0069790 msgr2=0x7f89b0069b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:27.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.658+0000 7f89b4c84700 1 -- 172.21.15.71:0/683637040 shutdown_connections 2023-10-06T01:40:27.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.658+0000 7f89b4c84700 1 -- 172.21.15.71:0/683637040 wait complete. 2023-10-06T01:40:27.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.659+0000 7f89b4c84700 1 Processor -- start 2023-10-06T01:40:27.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.659+0000 7f89b4c84700 1 -- start start 2023-10-06T01:40:27.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.659+0000 7f89b4c84700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89b00af250 0x7f89b016a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:27.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.659+0000 7f89b4c84700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89b00af620 0x7f89b0153340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:27.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.659+0000 7f89b4c84700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f89b00c9f40 0x7f89b014d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:27.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.659+0000 7f89b4c84700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89b014de50 con 0x7f89b00af620 2023-10-06T01:40:27.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.659+0000 7f89b4c84700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89b014e0f0 con 0x7f89b00af250 2023-10-06T01:40:27.665 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.659+0000 7f89b4c84700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89b014e3d0 con 0x7f89b00c9f40 2023-10-06T01:40:27.665 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.659+0000 7f89add9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89b00af620 0x7f89b0153340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:27.665 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.659+0000 7f89add9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89b00af620 0x7f89b0153340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40042/0 (socket says 172.21.15.71:40042) 2023-10-06T01:40:27.665 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.659+0000 7f89add9b700 1 -- 172.21.15.71:0/778351532 learned_addr learned my addr 172.21.15.71:0/778351532 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:27.665 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.660+0000 7f89aed9d700 1 --2- 172.21.15.71:0/778351532 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f89b00c9f40 0x7f89b014d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:27.665 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.660+0000 7f89ae59c700 1 --2- 172.21.15.71:0/778351532 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89b00af250 0x7f89b016a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:27.665 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.660+0000 7f89add9b700 1 -- 172.21.15.71:0/778351532 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f89b00c9f40 msgr2=0x7f89b014d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:27.665 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.660+0000 7f89add9b700 1 --2- 172.21.15.71:0/778351532 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f89b00c9f40 0x7f89b014d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:27.665 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.660+0000 7f89add9b700 1 -- 172.21.15.71:0/778351532 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89b00af250 msgr2=0x7f89b016a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:27.665 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.660+0000 7f89add9b700 1 --2- 172.21.15.71:0/778351532 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89b00af250 0x7f89b016a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:27.665 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.660+0000 7f89add9b700 1 -- 172.21.15.71:0/778351532 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89a8009ae0 con 0x7f89b00af620 2023-10-06T01:40:27.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.660+0000 7f89add9b700 1 --2- 172.21.15.71:0/778351532 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89b00af620 0x7f89b0153340 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f89a400d860 tx=0x7f89a4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:27.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.660+0000 7f899e7fc700 1 -- 172.21.15.71:0/778351532 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a40125f0 con 0x7f89b00af620 2023-10-06T01:40:27.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.660+0000 7f899e7fc700 1 -- 172.21.15.71:0/778351532 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89a4012750 con 0x7f89b00af620 2023-10-06T01:40:27.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.660+0000 7f89b4c84700 1 -- 172.21.15.71:0/778351532 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89b014e6b0 con 0x7f89b00af620 2023-10-06T01:40:27.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.660+0000 7f899e7fc700 1 -- 172.21.15.71:0/778351532 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a4012b10 con 0x7f89b00af620 2023-10-06T01:40:27.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.660+0000 7f89b4c84700 1 -- 172.21.15.71:0/778351532 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89b015c380 con 0x7f89b00af620 2023-10-06T01:40:27.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.661+0000 7f89b4c84700 1 -- 172.21.15.71:0/778351532 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89b004bb80 con 0x7f89b00af620 2023-10-06T01:40:27.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.661+0000 7f899e7fc700 1 -- 172.21.15.71:0/778351532 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f89a401e460 con 0x7f89b00af620 2023-10-06T01:40:27.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.662+0000 7f899e7fc700 1 --2- 172.21.15.71:0/778351532 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f8990066f30 0x7f89900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:27.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.662+0000 7f899e7fc700 1 -- 172.21.15.71:0/778351532 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f89a4084e70 con 0x7f89b00af620 2023-10-06T01:40:27.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.662+0000 7f89ae59c700 1 --2- 172.21.15.71:0/778351532 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f8990066f30 0x7f89900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:27.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.662+0000 7f89ae59c700 1 --2- 172.21.15.71:0/778351532 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f8990066f30 0x7f89900693e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f89a0006fd0 tx=0x7f89a0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:27.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.666+0000 7f899e7fc700 1 -- 172.21.15.71:0/778351532 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f89a4055720 con 0x7f89b00af620 2023-10-06T01:40:27.762 INFO:tasks.ceph.mds.b.smithi072.stderr:2023-10-06T01:40:27.761+0000 7f03db0a6700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T01:40:27.854 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.853+0000 7f89b4c84700 1 -- 172.21.15.71:0/778351532 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f89b006d430 con 0x7f89b00af620 2023-10-06T01:40:27.855 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.854+0000 7f899e7fc700 1 -- 172.21.15.71:0/778351532 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18659 (secure 0 0 0) 0x7f89a40552b0 con 0x7f89b00af620 2023-10-06T01:40:27.855 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:40:27.855 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":27,"fsid":"1fbf1bd2-f9b4-4599-bea2-f4aa920e9a56","created":"2023-10-06T01:39:57.016957+0000","modified":"2023-10-06T01:40:26.202441+0000","last_up_change":"2023-10-06T01:40:08.571643+0000","last_in_change":"2023-10-06T01:39:59.462741+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T01:40:08.610349+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T01:40:15.387434+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T01:40:19.640459+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T01:40:20.116883+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T01:40:23.830129+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cf059188-fb20-4dbf-95db-dcf57b213d03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":90670},{"type":"v1","addr":"172.21.15.71:6817","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":90670},{"type":"v1","addr":"172.21.15.71:6819","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":90670},{"type":"v1","addr":"172.21.15.71:6823","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":90670},{"type":"v1","addr":"172.21.15.71:6821","nonce":90670}]},"public_addr":"172.21.15.71:6817/90670","cluster_addr":"172.21.15.71:6819/90670","heartbeat_back_addr":"172.21.15.71:6823/90670","heartbeat_front_addr":"172.21.15.71:6821/90670","state":["exists","up"]},{"osd":1,"uuid":"0cff0aae-1799-4fe0-b610-54cf0813c0e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":90669},{"type":"v1","addr":"172.21.15.71:6809","nonce":90669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":90669},{"type":"v1","addr":"172.21.15.71:6811","nonce":90669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":90669},{"type":"v1","addr":"172.21.15.71:6815","nonce":90669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":90669},{"type":"v1","addr":"172.21.15.71:6813","nonce":90669}]},"public_addr":"172.21.15.71:6809/90669","cluster_addr":"172.21.15.71:6811/90669","heartbeat_back_addr":"172.21.15.71:6815/90669","heartbeat_front_addr":"172.21.15.71:6813/90669","state":["exists","up"]},{"osd":2,"uuid":"88d61ddc-9031-44e1-ba8c-546a41e7c8ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":90679},{"type":"v1","addr":"172.21.15.71:6825","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":90679},{"type":"v1","addr":"172.21.15.71:6827","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":90679},{"type":"v1","addr":"172.21.15.71:6831","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":90679},{"type":"v1","addr":"172.21.15.71:6829","nonce":90679}]},"public_addr":"172.21.15.71:6825/90679","cluster_addr":"172.21.15.71:6827/90679","heartbeat_back_addr":"172.21.15.71:6831/90679","heartbeat_front_addr":"172.21.15.71:6829/90679","state":["exists","up"]},{"osd":3,"uuid":"11ed92b7-960b-4a30-a889-a61d3eeb86f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":90668},{"type":"v1","addr":"172.21.15.71:6801","nonce":90668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":90668},{"type":"v1","addr":"172.21.15.71:6803","nonce":90668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":90668},{"type":"v1","addr":"172.21.15.71:6807","nonce":90668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":90668},{"type":"v1","addr":"172.21.15.71:6805","nonce":90668}]},"public_addr":"172.21.15.71:6801/90668","cluster_addr":"172.21.15.71:6803/90668","heartbeat_back_addr":"172.21.15.71:6807/90668","heartbeat_front_addr":"172.21.15.71:6805/90668","state":["exists","up"]},{"osd":4,"uuid":"ae4df784-abdf-4ddf-aefa-780f3ddafef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":90917},{"type":"v1","addr":"172.21.15.72:6801","nonce":90917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":90917},{"type":"v1","addr":"172.21.15.72:6803","nonce":90917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":90917},{"type":"v1","addr":"172.21.15.72:6807","nonce":90917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":90917},{"type":"v1","addr":"172.21.15.72:6805","nonce":90917}]},"public_addr":"172.21.15.72:6801/90917","cluster_addr":"172.21.15.72:6803/90917","heartbeat_back_addr":"172.21.15.72:6807/90917","heartbeat_front_addr":"172.21.15.72:6805/90917","state":["exists","up"]},{"osd":5,"uuid":"5ef0790f-001e-458f-a05b-efae216cf435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":90941},{"type":"v1","addr":"172.21.15.72:6817","nonce":90941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":90941},{"type":"v1","addr":"172.21.15.72:6819","nonce":90941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":90941},{"type":"v1","addr":"172.21.15.72:6827","nonce":90941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":90941},{"type":"v1","addr":"172.21.15.72:6823","nonce":90941}]},"public_addr":"172.21.15.72:6817/90941","cluster_addr":"172.21.15.72:6819/90941","heartbeat_back_addr":"172.21.15.72:6827/90941","heartbeat_front_addr":"172.21.15.72:6823/90941","state":["exists","up"]},{"osd":6,"uuid":"8705aef1-9ae8-4e54-a3c4-c2909fa0ceb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":90918},{"type":"v1","addr":"172.21.15.72:6809","nonce":90918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":90918},{"type":"v1","addr":"172.21.15.72:6811","nonce":90918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":90918},{"type":"v1","addr":"172.21.15.72:6815","nonce":90918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":90918},{"type":"v1","addr":"172.21.15.72:6813","nonce":90918}]},"public_addr":"172.21.15.72:6809/90918","cluster_addr":"172.21.15.72:6811/90918","heartbeat_back_addr":"172.21.15.72:6815/90918","heartbeat_front_addr":"172.21.15.72:6813/90918","state":["exists","up"]},{"osd":7,"uuid":"364c5119-6b13-4c75-b3f0-15e165eff86a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":90948},{"type":"v1","addr":"172.21.15.72:6822","nonce":90948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":90948},{"type":"v1","addr":"172.21.15.72:6826","nonce":90948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":90948},{"type":"v1","addr":"172.21.15.72:6831","nonce":90948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":90948},{"type":"v1","addr":"172.21.15.72:6829","nonce":90948}]},"public_addr":"172.21.15.72:6822/90948","cluster_addr":"172.21.15.72:6826/90948","heartbeat_back_addr":"172.21.15.72:6831/90948","heartbeat_front_addr":"172.21.15.72:6829/90948","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.642976+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.645372+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.619116+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.663042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.599163+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.646411+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.631545+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.669821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:40:27.857 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.856+0000 7f89b4c84700 1 -- 172.21.15.71:0/778351532 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f8990066f30 msgr2=0x7f89900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:27.857 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.856+0000 7f89b4c84700 1 --2- 172.21.15.71:0/778351532 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f8990066f30 0x7f89900693e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f89a0006fd0 tx=0x7f89a0008040 comp rx=0 tx=0).stop 2023-10-06T01:40:27.857 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.856+0000 7f89b4c84700 1 -- 172.21.15.71:0/778351532 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89b00af620 msgr2=0x7f89b0153340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:27.857 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.856+0000 7f89b4c84700 1 --2- 172.21.15.71:0/778351532 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89b00af620 0x7f89b0153340 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f89a400d860 tx=0x7f89a4008040 comp rx=0 tx=0).stop 2023-10-06T01:40:27.857 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.856+0000 7f89b4c84700 1 -- 172.21.15.71:0/778351532 shutdown_connections 2023-10-06T01:40:27.858 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.856+0000 7f89b4c84700 1 --2- 172.21.15.71:0/778351532 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f89b00c9f40 0x7f89b014d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:27.858 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.856+0000 7f89b4c84700 1 --2- 172.21.15.71:0/778351532 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f8990066f30 0x7f89900693e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:27.858 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.856+0000 7f89b4c84700 1 --2- 172.21.15.71:0/778351532 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89b00af250 0x7f89b016a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:27.858 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.856+0000 7f89b4c84700 1 --2- 172.21.15.71:0/778351532 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89b00af620 0x7f89b0153340 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:27.858 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.856+0000 7f89b4c84700 1 -- 172.21.15.71:0/778351532 >> 172.21.15.71:0/778351532 conn(0x7f89b0069790 msgr2=0x7f89b00caf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:27.858 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.856+0000 7f89b4c84700 1 -- 172.21.15.71:0/778351532 shutdown_connections 2023-10-06T01:40:27.858 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.856+0000 7f89b4c84700 1 -- 172.21.15.71:0/778351532 wait complete. 2023-10-06T01:40:27.880 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T01:40:27.994 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.993+0000 7fd4ece85700 1 Processor -- start 2023-10-06T01:40:27.994 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.993+0000 7fd4ece85700 1 -- start start 2023-10-06T01:40:27.996 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.994+0000 7fd4ece85700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd4e8159400 0x7fd4e80ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:27.997 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.994+0000 7fd4ece85700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd4e80cd030 0x7fd4e80cfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:27.997 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.994+0000 7fd4ece85700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd4e80cf1a0 0x7fd4e80d0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:27.997 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.994+0000 7fd4ece85700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4e80b3560 con 0x7fd4e8159400 2023-10-06T01:40:27.997 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.994+0000 7fd4ece85700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4e80cf6f0 con 0x7fd4e80cd030 2023-10-06T01:40:27.997 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.994+0000 7fd4ece85700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e80cf9d0 con 0x7fd4e80cf1a0 2023-10-06T01:40:27.997 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.994+0000 7fd4e77fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd4e8159400 0x7fd4e80ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:27.997 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.994+0000 7fd4e77fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd4e8159400 0x7fd4e80ccaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40058/0 (socket says 172.21.15.71:40058) 2023-10-06T01:40:27.997 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.994+0000 7fd4e77fe700 1 -- 172.21.15.71:0/1694439946 learned_addr learned my addr 172.21.15.71:0/1694439946 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:27.997 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.994+0000 7fd4e6ffd700 1 --2- 172.21.15.71:0/1694439946 >> v2:172.21.15.72:3300/0 conn(0x7fd4e80cd030 0x7fd4e80cfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:27.997 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.994+0000 7fd4e7fff700 1 --2- 172.21.15.71:0/1694439946 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd4e80cf1a0 0x7fd4e80d0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:27.997 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.994+0000 7fd4e77fe700 1 -- 172.21.15.71:0/1694439946 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd4e80cf1a0 msgr2=0x7fd4e80d0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:27.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.994+0000 7fd4e77fe700 1 --2- 172.21.15.71:0/1694439946 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd4e80cf1a0 0x7fd4e80d0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:27.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.994+0000 7fd4e77fe700 1 -- 172.21.15.71:0/1694439946 >> v2:172.21.15.72:3300/0 conn(0x7fd4e80cd030 msgr2=0x7fd4e80cfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:27.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.994+0000 7fd4e77fe700 1 --2- 172.21.15.71:0/1694439946 >> v2:172.21.15.72:3300/0 conn(0x7fd4e80cd030 0x7fd4e80cfec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:27.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.994+0000 7fd4e77fe700 1 -- 172.21.15.71:0/1694439946 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4e80b2f10 con 0x7fd4e8159400 2023-10-06T01:40:27.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.995+0000 7fd4e77fe700 1 --2- 172.21.15.71:0/1694439946 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4e8159400 0x7fd4e80ccaf0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd4e815d0f0 tx=0x7fd4d8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24d16e07cfd84dbb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:27.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.995+0000 7fd4e67fc700 1 -- 172.21.15.71:0/1694439946 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4d800e070 con 0x7fd4e8159400 2023-10-06T01:40:27.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.995+0000 7fd4e67fc700 1 -- 172.21.15.71:0/1694439946 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4d800b970 con 0x7fd4e8159400 2023-10-06T01:40:27.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.995+0000 7fd4e67fc700 1 -- 172.21.15.71:0/1694439946 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4d80092e0 con 0x7fd4e8159400 2023-10-06T01:40:27.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.995+0000 7fd4ece85700 1 -- 172.21.15.71:0/1694439946 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4e8159400 msgr2=0x7fd4e80ccaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:27.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.995+0000 7fd4ece85700 1 --2- 172.21.15.71:0/1694439946 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4e8159400 0x7fd4e80ccaf0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd4e815d0f0 tx=0x7fd4d8009840 comp rx=0 tx=0).stop 2023-10-06T01:40:27.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.995+0000 7fd4ece85700 1 -- 172.21.15.71:0/1694439946 shutdown_connections 2023-10-06T01:40:27.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.995+0000 7fd4ece85700 1 --2- 172.21.15.71:0/1694439946 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4e8159400 0x7fd4e80ccaf0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:27.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.995+0000 7fd4ece85700 1 --2- 172.21.15.71:0/1694439946 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd4e80cf1a0 0x7fd4e80d0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:27.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.995+0000 7fd4ece85700 1 --2- 172.21.15.71:0/1694439946 >> v2:172.21.15.72:3300/0 conn(0x7fd4e80cd030 0x7fd4e80cfec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:27.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.995+0000 7fd4ece85700 1 -- 172.21.15.71:0/1694439946 >> 172.21.15.71:0/1694439946 conn(0x7fd4e806ac10 msgr2=0x7fd4e8068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:27.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.995+0000 7fd4ece85700 1 -- 172.21.15.71:0/1694439946 shutdown_connections 2023-10-06T01:40:27.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.995+0000 7fd4ece85700 1 -- 172.21.15.71:0/1694439946 wait complete. 2023-10-06T01:40:28.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.997+0000 7fd4ece85700 1 Processor -- start 2023-10-06T01:40:28.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.997+0000 7fd4ece85700 1 -- start start 2023-10-06T01:40:28.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.997+0000 7fd4ece85700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4e80cd030 0x7fd4e815c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:28.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.997+0000 7fd4ece85700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4e80cf1a0 0x7fd4e815a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:28.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.997+0000 7fd4ece85700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd4e8159400 0x7fd4e815a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:28.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.997+0000 7fd4ece85700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e815b1d0 con 0x7fd4e80cd030 2023-10-06T01:40:28.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.997+0000 7fd4ece85700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e815c030 con 0x7fd4e80cf1a0 2023-10-06T01:40:28.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.997+0000 7fd4ece85700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e815b420 con 0x7fd4e8159400 2023-10-06T01:40:28.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.997+0000 7fd4e77fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4e80cd030 0x7fd4e815c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:28.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.997+0000 7fd4e77fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4e80cd030 0x7fd4e815c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40060/0 (socket says 172.21.15.71:40060) 2023-10-06T01:40:28.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.997+0000 7fd4e77fe700 1 -- 172.21.15.71:0/55418317 learned_addr learned my addr 172.21.15.71:0/55418317 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:28.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.997+0000 7fd4e7fff700 1 --2- 172.21.15.71:0/55418317 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd4e8159400 0x7fd4e815a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:28.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.998+0000 7fd4e6ffd700 1 --2- 172.21.15.71:0/55418317 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4e80cf1a0 0x7fd4e815a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:28.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.998+0000 7fd4e77fe700 1 -- 172.21.15.71:0/55418317 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd4e8159400 msgr2=0x7fd4e815a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:28.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.998+0000 7fd4e77fe700 1 --2- 172.21.15.71:0/55418317 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd4e8159400 0x7fd4e815a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:28.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.998+0000 7fd4e77fe700 1 -- 172.21.15.71:0/55418317 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4e80cf1a0 msgr2=0x7fd4e815a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:28.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.998+0000 7fd4e77fe700 1 --2- 172.21.15.71:0/55418317 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4e80cf1a0 0x7fd4e815a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:28.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.998+0000 7fd4e77fe700 1 -- 172.21.15.71:0/55418317 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4d8009ae0 con 0x7fd4e80cd030 2023-10-06T01:40:28.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.998+0000 7fd4e6ffd700 1 --2- 172.21.15.71:0/55418317 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4e80cf1a0 0x7fd4e815a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:40:28.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.998+0000 7fd4e77fe700 1 --2- 172.21.15.71:0/55418317 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4e80cd030 0x7fd4e815c4c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd4e80b2b80 tx=0x7fd4d8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:28.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.998+0000 7fd4cf7fe700 1 -- 172.21.15.71:0/55418317 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4d80088a0 con 0x7fd4e80cd030 2023-10-06T01:40:28.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.998+0000 7fd4cf7fe700 1 -- 172.21.15.71:0/55418317 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4d8008a20 con 0x7fd4e80cd030 2023-10-06T01:40:28.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.998+0000 7fd4ece85700 1 -- 172.21.15.71:0/55418317 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4e815b700 con 0x7fd4e80cd030 2023-10-06T01:40:28.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.998+0000 7fd4cf7fe700 1 -- 172.21.15.71:0/55418317 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4d8008de0 con 0x7fd4e80cd030 2023-10-06T01:40:28.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.998+0000 7fd4ece85700 1 -- 172.21.15.71:0/55418317 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4e815bcc0 con 0x7fd4e80cd030 2023-10-06T01:40:28.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.999+0000 7fd4ece85700 1 -- 172.21.15.71:0/55418317 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4e815c310 con 0x7fd4e80cd030 2023-10-06T01:40:28.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:27.999+0000 7fd4cf7fe700 1 -- 172.21.15.71:0/55418317 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd4d8003040 con 0x7fd4e80cd030 2023-10-06T01:40:28.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:28.000+0000 7fd4cf7fe700 1 --2- 172.21.15.71:0/55418317 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fd4d4066f30 0x7fd4d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:28.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:28.000+0000 7fd4cf7fe700 1 -- 172.21.15.71:0/55418317 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fd4d8085ea0 con 0x7fd4e80cd030 2023-10-06T01:40:28.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:28.000+0000 7fd4e6ffd700 1 --2- 172.21.15.71:0/55418317 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fd4d4066f30 0x7fd4d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:28.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:28.000+0000 7fd4e6ffd700 1 --2- 172.21.15.71:0/55418317 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fd4d4066f30 0x7fd4d40693e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc009d80 tx=0x7fd4dc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:28.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:28.004+0000 7fd4cf7fe700 1 -- 172.21.15.71:0/55418317 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd4d8052cc0 con 0x7fd4e80cd030 2023-10-06T01:40:28.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:28.231+0000 7fd4ece85700 1 -- 172.21.15.71:0/55418317 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd4e81597d0 con 0x7fd4e80cd030 2023-10-06T01:40:28.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:28.232+0000 7fd4cf7fe700 1 -- 172.21.15.71:0/55418317 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4590 (secure 0 0 0) 0x7fd4d80562e0 con 0x7fd4e80cd030 2023-10-06T01:40:28.233 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:40:28.233 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6836/274053969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":274053969},{"type":"v1","addr":"172.21.15.71:6836","nonce":274053969}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/4158221694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6835","nonce":4158221694},{"type":"v1","addr":"172.21.15.71:6837","nonce":4158221694}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/1094581488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":1094581488},{"type":"v1","addr":"172.21.15.72:6835","nonce":1094581488}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T01:40:21.151426+0000","modified":"2023-10-06T01:40:26.831619+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4315},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4315":{"gid":4315,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6834/2361644634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6833","nonce":2361644634},{"type":"v1","addr":"172.21.15.72:6834","nonce":2361644634}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2023-10-06T01:40:28.235 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:28.234+0000 7fd4ece85700 1 -- 172.21.15.71:0/55418317 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fd4d4066f30 msgr2=0x7fd4d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:28.235 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:28.234+0000 7fd4ece85700 1 --2- 172.21.15.71:0/55418317 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fd4d4066f30 0x7fd4d40693e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc009d80 tx=0x7fd4dc008040 comp rx=0 tx=0).stop 2023-10-06T01:40:28.235 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:28.234+0000 7fd4ece85700 1 -- 172.21.15.71:0/55418317 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4e80cd030 msgr2=0x7fd4e815c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:28.235 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:28.234+0000 7fd4ece85700 1 --2- 172.21.15.71:0/55418317 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4e80cd030 0x7fd4e815c4c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd4e80b2b80 tx=0x7fd4d8018000 comp rx=0 tx=0).stop 2023-10-06T01:40:28.235 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:28.234+0000 7fd4ece85700 1 -- 172.21.15.71:0/55418317 shutdown_connections 2023-10-06T01:40:28.235 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:28.234+0000 7fd4ece85700 1 --2- 172.21.15.71:0/55418317 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd4e8159400 0x7fd4e815a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:28.235 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:28.234+0000 7fd4ece85700 1 --2- 172.21.15.71:0/55418317 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4e80cd030 0x7fd4e815c4c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:28.235 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:28.234+0000 7fd4ece85700 1 --2- 172.21.15.71:0/55418317 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fd4d4066f30 0x7fd4d40693e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:28.236 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:28.234+0000 7fd4ece85700 1 --2- 172.21.15.71:0/55418317 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4e80cf1a0 0x7fd4e815a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:28.236 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:28.234+0000 7fd4ece85700 1 -- 172.21.15.71:0/55418317 >> 172.21.15.71:0/55418317 conn(0x7fd4e806ac10 msgr2=0x7fd4e80d0170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:28.236 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:28.234+0000 7fd4ece85700 1 -- 172.21.15.71:0/55418317 shutdown_connections 2023-10-06T01:40:28.236 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:28.234+0000 7fd4ece85700 1 -- 172.21.15.71:0/55418317 wait complete. 2023-10-06T01:40:28.236 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 7 2023-10-06T01:40:28.247 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:40:28.361 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:28.361+0000 7fac53714700 1 Processor -- start 2023-10-06T01:40:28.362 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:28.361+0000 7fac53714700 1 -- start start 2023-10-06T01:40:28.363 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:28.362+0000 7fac53714700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fac4c067d10 0x7fac4c06a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:28.363 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:28.362+0000 7fac53714700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fac4c15cde0 0x7fac4c0b2360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:28.363 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:28.362+0000 7fac53714700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac4c0b1ed0 con 0x7fac4c15ca10 2023-10-06T01:40:28.363 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:28.362+0000 7fac53714700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac4c0879c0 con 0x7fac4c15cde0 2023-10-06T01:40:28.363 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:28.362+0000 7fac53714700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac4c0cec50 con 0x7fac4c067d10 2023-10-06T01:40:28.364 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:28.362+0000 7fac514b0700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fac4c15ca10 0x7fac4c069f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:33174/0 (socket says 172.21.15.71:33174) 2023-10-06T01:40:28.364 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:28.362+0000 7fac514b0700 1 -- 172.21.15.71:0/4109285813 learned_addr learned my addr 172.21.15.71:0/4109285813 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:40:28.364 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:28.362+0000 7fac51cb1700 1 --2- 172.21.15.71:0/4109285813 >> v2:172.21.15.72:3300/0 conn(0x7fac4c15cde0 0x7fac4c0b2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:28.364 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:28.362+0000 7fac50caf700 1 --2- 172.21.15.71:0/4109285813 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fac4c067d10 0x7fac4c06a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:28.364 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:28.362+0000 7fac4bfff700 1 -- 172.21.15.71:0/4109285813 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4158928424 0 0) 0x7fac4c0b1ed0 con 0x7fac4c15ca10 2023-10-06T01:40:28.364 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:28.362+0000 7fac4bfff700 1 -- 172.21.15.71:0/4109285813 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac34003570 con 0x7fac4c15ca10 2023-10-06T01:40:28.364 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:28.362+0000 7fac50caf700 1 -- 172.21.15.71:0/4109285813 >> v2:172.21.15.72:3300/0 conn(0x7fac4c15cde0 msgr2=0x7fac4c0b2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:28.364 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:28.362+0000 7fac50caf700 1 --2- 172.21.15.71:0/4109285813 >> v2:172.21.15.72:3300/0 conn(0x7fac4c15cde0 0x7fac4c0b2360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:28.364 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:28.362+0000 7fac50caf700 1 -- 172.21.15.71:0/4109285813 >> v1:172.21.15.71:6789/0 conn(0x7fac4c15ca10 legacy=0x7fac4c069f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:28.364 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:28.362+0000 7fac50caf700 1 -- 172.21.15.71:0/4109285813 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac4c0cef30 con 0x7fac4c067d10 2023-10-06T01:40:28.364 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:28.362+0000 7fac50caf700 1 --2- 172.21.15.71:0/4109285813 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fac4c067d10 0x7fac4c06a680 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fac40009e60 tx=0x7fac40009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bab92ead3c6d1360 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:28.365 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:28.363+0000 7fac4bfff700 1 -- 172.21.15.71:0/4109285813 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac4000e070 con 0x7fac4c067d10 2023-10-06T01:40:28.365 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:28.363+0000 7fac4bfff700 1 -- 172.21.15.71:0/4109285813 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac4000bab0 con 0x7fac4c067d10 2023-10-06T01:40:28.365 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:28.363+0000 7fac4bfff700 1 -- 172.21.15.71:0/4109285813 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac4000be70 con 0x7fac4c067d10 2023-10-06T01:40:28.368 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:28.363+0000 7fac53714700 1 -- 172.21.15.71:0/4109285813 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fac4c067d10 msgr2=0x7fac4c06a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:28.368 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:28.363+0000 7fac53714700 1 --2- 172.21.15.71:0/4109285813 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fac4c067d10 0x7fac4c06a680 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fac40009e60 tx=0x7fac40009780 comp rx=0 tx=0).stop 2023-10-06T01:40:28.368 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:28.363+0000 7fac53714700 1 -- 172.21.15.71:0/4109285813 shutdown_connections 2023-10-06T01:40:28.368 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:28.363+0000 7fac53714700 1 --2- 172.21.15.71:0/4109285813 >> v2:172.21.15.72:3300/0 conn(0x7fac4c15cde0 0x7fac4c0b2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:28.368 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:28.363+0000 7fac53714700 1 --2- 172.21.15.71:0/4109285813 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fac4c067d10 0x7fac4c06a680 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:28.368 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:28.363+0000 7fac53714700 1 -- 172.21.15.71:0/4109285813 >> 172.21.15.71:0/4109285813 conn(0x7fac4c067910 msgr2=0x7fac4c0ce160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:28.368 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:28.363+0000 7fac53714700 1 -- 172.21.15.71:0/4109285813 shutdown_connections 2023-10-06T01:40:28.368 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:28.363+0000 7fac53714700 1 -- 172.21.15.71:0/4109285813 wait complete. 2023-10-06T01:40:28.368 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:28.364+0000 7fac53714700 1 Processor -- start 2023-10-06T01:40:28.368 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:28.364+0000 7fac53714700 1 -- start start 2023-10-06T01:40:28.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:28.365+0000 7fac53714700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fac4c067d10 0x7fac4c16c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:28.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:28.365+0000 7fac53714700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac4c15ca10 0x7fac4c09b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:28.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:28.365+0000 7fac53714700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fac4c15cde0 0x7fac4c09a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:28.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:28.365+0000 7fac53714700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac4c098f50 con 0x7fac4c15cde0 2023-10-06T01:40:28.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:28.365+0000 7fac53714700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac4c15ef90 con 0x7fac4c15ca10 2023-10-06T01:40:28.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:28.365+0000 7fac53714700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac4c15f200 con 0x7fac4c067d10 2023-10-06T01:40:28.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:28.365+0000 7fac51cb1700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fac4c15cde0 0x7fac4c09a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:28.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:28.365+0000 7fac51cb1700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fac4c15cde0 0x7fac4c09a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40066/0 (socket says 172.21.15.71:40066) 2023-10-06T01:40:28.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:28.365+0000 7fac51cb1700 1 -- 172.21.15.71:0/1360772141 learned_addr learned my addr 172.21.15.71:0/1360772141 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:28.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:28.365+0000 7fac514b0700 1 --2- 172.21.15.71:0/1360772141 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fac4c067d10 0x7fac4c16c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:28.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:28.365+0000 7fac50caf700 1 --2- 172.21.15.71:0/1360772141 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac4c15ca10 0x7fac4c09b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:28.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:28.366+0000 7fac51cb1700 1 -- 172.21.15.71:0/1360772141 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fac4c067d10 msgr2=0x7fac4c16c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:28.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:28.366+0000 7fac51cb1700 1 --2- 172.21.15.71:0/1360772141 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fac4c067d10 0x7fac4c16c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:28.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:28.366+0000 7fac51cb1700 1 -- 172.21.15.71:0/1360772141 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac4c15ca10 msgr2=0x7fac4c09b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:28.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:28.366+0000 7fac51cb1700 1 --2- 172.21.15.71:0/1360772141 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac4c15ca10 0x7fac4c09b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:28.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:28.366+0000 7fac51cb1700 1 -- 172.21.15.71:0/1360772141 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac40009a20 con 0x7fac4c15cde0 2023-10-06T01:40:28.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:28.366+0000 7fac514b0700 1 --2- 172.21.15.71:0/1360772141 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fac4c067d10 0x7fac4c16c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:40:28.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:28.366+0000 7fac51cb1700 1 --2- 172.21.15.71:0/1360772141 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fac4c15cde0 0x7fac4c09a950 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fac3c00e930 tx=0x7fac3c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:28.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:28.366+0000 7fac497fa700 1 -- 172.21.15.71:0/1360772141 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac3c013680 con 0x7fac4c15cde0 2023-10-06T01:40:28.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:28.366+0000 7fac497fa700 1 -- 172.21.15.71:0/1360772141 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac3c013800 con 0x7fac4c15cde0 2023-10-06T01:40:28.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:28.366+0000 7fac53714700 1 -- 172.21.15.71:0/1360772141 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac4c15f4e0 con 0x7fac4c15cde0 2023-10-06T01:40:28.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:28.366+0000 7fac497fa700 1 -- 172.21.15.71:0/1360772141 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac3c013bc0 con 0x7fac4c15cde0 2023-10-06T01:40:28.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:28.366+0000 7fac53714700 1 -- 172.21.15.71:0/1360772141 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac4c15faa0 con 0x7fac4c15cde0 2023-10-06T01:40:28.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:28.367+0000 7fac53714700 1 -- 172.21.15.71:0/1360772141 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac4c06e8d0 con 0x7fac4c15cde0 2023-10-06T01:40:28.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:28.367+0000 7fac497fa700 1 -- 172.21.15.71:0/1360772141 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fac3c0123d0 con 0x7fac4c15cde0 2023-10-06T01:40:28.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:28.368+0000 7fac497fa700 1 --2- 172.21.15.71:0/1360772141 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fac38066f30 0x7fac380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:28.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:28.368+0000 7fac497fa700 1 -- 172.21.15.71:0/1360772141 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fac3c084bb0 con 0x7fac4c15cde0 2023-10-06T01:40:28.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:28.368+0000 7fac514b0700 1 --2- 172.21.15.71:0/1360772141 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fac38066f30 0x7fac380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:28.372 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:28.368+0000 7fac514b0700 1 --2- 172.21.15.71:0/1360772141 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fac38066f30 0x7fac380693e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fac44001360 tx=0x7fac44009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:28.372 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:28.372+0000 7fac497fa700 1 -- 172.21.15.71:0/1360772141 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fac3c051930 con 0x7fac4c15cde0 2023-10-06T01:40:28.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:28.559+0000 7fac53714700 1 -- 172.21.15.71:0/1360772141 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fac4c0b1b60 con 0x7fac4c15cde0 2023-10-06T01:40:28.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:28.560+0000 7fac497fa700 1 -- 172.21.15.71:0/1360772141 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18659 (secure 0 0 0) 0x7fac3c054f50 con 0x7fac4c15cde0 2023-10-06T01:40:28.561 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:40:28.561 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":27,"fsid":"1fbf1bd2-f9b4-4599-bea2-f4aa920e9a56","created":"2023-10-06T01:39:57.016957+0000","modified":"2023-10-06T01:40:26.202441+0000","last_up_change":"2023-10-06T01:40:08.571643+0000","last_in_change":"2023-10-06T01:39:59.462741+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T01:40:08.610349+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T01:40:15.387434+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T01:40:19.640459+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T01:40:20.116883+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T01:40:23.830129+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cf059188-fb20-4dbf-95db-dcf57b213d03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":90670},{"type":"v1","addr":"172.21.15.71:6817","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":90670},{"type":"v1","addr":"172.21.15.71:6819","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":90670},{"type":"v1","addr":"172.21.15.71:6823","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":90670},{"type":"v1","addr":"172.21.15.71:6821","nonce":90670}]},"public_addr":"172.21.15.71:6817/90670","cluster_addr":"172.21.15.71:6819/90670","heartbeat_back_addr":"172.21.15.71:6823/90670","heartbeat_front_addr":"172.21.15.71:6821/90670","state":["exists","up"]},{"osd":1,"uuid":"0cff0aae-1799-4fe0-b610-54cf0813c0e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":90669},{"type":"v1","addr":"172.21.15.71:6809","nonce":90669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":90669},{"type":"v1","addr":"172.21.15.71:6811","nonce":90669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":90669},{"type":"v1","addr":"172.21.15.71:6815","nonce":90669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":90669},{"type":"v1","addr":"172.21.15.71:6813","nonce":90669}]},"public_addr":"172.21.15.71:6809/90669","cluster_addr":"172.21.15.71:6811/90669","heartbeat_back_addr":"172.21.15.71:6815/90669","heartbeat_front_addr":"172.21.15.71:6813/90669","state":["exists","up"]},{"osd":2,"uuid":"88d61ddc-9031-44e1-ba8c-546a41e7c8ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":90679},{"type":"v1","addr":"172.21.15.71:6825","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":90679},{"type":"v1","addr":"172.21.15.71:6827","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":90679},{"type":"v1","addr":"172.21.15.71:6831","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":90679},{"type":"v1","addr":"172.21.15.71:6829","nonce":90679}]},"public_addr":"172.21.15.71:6825/90679","cluster_addr":"172.21.15.71:6827/90679","heartbeat_back_addr":"172.21.15.71:6831/90679","heartbeat_front_addr":"172.21.15.71:6829/90679","state":["exists","up"]},{"osd":3,"uuid":"11ed92b7-960b-4a30-a889-a61d3eeb86f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":90668},{"type":"v1","addr":"172.21.15.71:6801","nonce":90668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":90668},{"type":"v1","addr":"172.21.15.71:6803","nonce":90668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":90668},{"type":"v1","addr":"172.21.15.71:6807","nonce":90668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":90668},{"type":"v1","addr":"172.21.15.71:6805","nonce":90668}]},"public_addr":"172.21.15.71:6801/90668","cluster_addr":"172.21.15.71:6803/90668","heartbeat_back_addr":"172.21.15.71:6807/90668","heartbeat_front_addr":"172.21.15.71:6805/90668","state":["exists","up"]},{"osd":4,"uuid":"ae4df784-abdf-4ddf-aefa-780f3ddafef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":90917},{"type":"v1","addr":"172.21.15.72:6801","nonce":90917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":90917},{"type":"v1","addr":"172.21.15.72:6803","nonce":90917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":90917},{"type":"v1","addr":"172.21.15.72:6807","nonce":90917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":90917},{"type":"v1","addr":"172.21.15.72:6805","nonce":90917}]},"public_addr":"172.21.15.72:6801/90917","cluster_addr":"172.21.15.72:6803/90917","heartbeat_back_addr":"172.21.15.72:6807/90917","heartbeat_front_addr":"172.21.15.72:6805/90917","state":["exists","up"]},{"osd":5,"uuid":"5ef0790f-001e-458f-a05b-efae216cf435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":90941},{"type":"v1","addr":"172.21.15.72:6817","nonce":90941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":90941},{"type":"v1","addr":"172.21.15.72:6819","nonce":90941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":90941},{"type":"v1","addr":"172.21.15.72:6827","nonce":90941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":90941},{"type":"v1","addr":"172.21.15.72:6823","nonce":90941}]},"public_addr":"172.21.15.72:6817/90941","cluster_addr":"172.21.15.72:6819/90941","heartbeat_back_addr":"172.21.15.72:6827/90941","heartbeat_front_addr":"172.21.15.72:6823/90941","state":["exists","up"]},{"osd":6,"uuid":"8705aef1-9ae8-4e54-a3c4-c2909fa0ceb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":90918},{"type":"v1","addr":"172.21.15.72:6809","nonce":90918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":90918},{"type":"v1","addr":"172.21.15.72:6811","nonce":90918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":90918},{"type":"v1","addr":"172.21.15.72:6815","nonce":90918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":90918},{"type":"v1","addr":"172.21.15.72:6813","nonce":90918}]},"public_addr":"172.21.15.72:6809/90918","cluster_addr":"172.21.15.72:6811/90918","heartbeat_back_addr":"172.21.15.72:6815/90918","heartbeat_front_addr":"172.21.15.72:6813/90918","state":["exists","up"]},{"osd":7,"uuid":"364c5119-6b13-4c75-b3f0-15e165eff86a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":90948},{"type":"v1","addr":"172.21.15.72:6822","nonce":90948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":90948},{"type":"v1","addr":"172.21.15.72:6826","nonce":90948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":90948},{"type":"v1","addr":"172.21.15.72:6831","nonce":90948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":90948},{"type":"v1","addr":"172.21.15.72:6829","nonce":90948}]},"public_addr":"172.21.15.72:6822/90948","cluster_addr":"172.21.15.72:6826/90948","heartbeat_back_addr":"172.21.15.72:6831/90948","heartbeat_front_addr":"172.21.15.72:6829/90948","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.642976+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.645372+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.619116+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.663042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.599163+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.646411+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.631545+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.669821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:40:28.563 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:28.562+0000 7fac53714700 1 -- 172.21.15.71:0/1360772141 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fac38066f30 msgr2=0x7fac380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:28.563 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:28.562+0000 7fac53714700 1 --2- 172.21.15.71:0/1360772141 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fac38066f30 0x7fac380693e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fac44001360 tx=0x7fac44009040 comp rx=0 tx=0).stop 2023-10-06T01:40:28.563 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:28.562+0000 7fac53714700 1 -- 172.21.15.71:0/1360772141 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fac4c15cde0 msgr2=0x7fac4c09a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:28.564 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:28.562+0000 7fac53714700 1 --2- 172.21.15.71:0/1360772141 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fac4c15cde0 0x7fac4c09a950 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fac3c00e930 tx=0x7fac3c0091a0 comp rx=0 tx=0).stop 2023-10-06T01:40:28.564 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:28.562+0000 7fac53714700 1 -- 172.21.15.71:0/1360772141 shutdown_connections 2023-10-06T01:40:28.564 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:28.562+0000 7fac53714700 1 --2- 172.21.15.71:0/1360772141 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fac4c15cde0 0x7fac4c09a950 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:28.564 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:28.562+0000 7fac53714700 1 --2- 172.21.15.71:0/1360772141 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fac4c067d10 0x7fac4c16c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:28.564 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:28.562+0000 7fac53714700 1 --2- 172.21.15.71:0/1360772141 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fac38066f30 0x7fac380693e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:28.564 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:28.562+0000 7fac53714700 1 --2- 172.21.15.71:0/1360772141 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac4c15ca10 0x7fac4c09b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:28.564 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:28.562+0000 7fac53714700 1 -- 172.21.15.71:0/1360772141 >> 172.21.15.71:0/1360772141 conn(0x7fac4c067910 msgr2=0x7fac4c15a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:28.564 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:28.562+0000 7fac53714700 1 -- 172.21.15.71:0/1360772141 shutdown_connections 2023-10-06T01:40:28.564 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:28.562+0000 7fac53714700 1 -- 172.21.15.71:0/1360772141 wait complete. 2023-10-06T01:40:28.977 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T01:40:21.151426+0000', 'modified': '2023-10-06T01:40:26.831619+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4315}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4315': {'gid': 4315, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.72:6834/2361644634', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.72:6833', 'nonce': 2361644634}, {'type': 'v1', 'addr': '172.21.15.72:6834', 'nonce': 2361644634}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 1} 2023-10-06T01:40:28.978 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T01:40:28.978 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-06T01:40:29.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.093+0000 7f0c35fab700 1 Processor -- start 2023-10-06T01:40:29.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.093+0000 7f0c35fab700 1 -- start start 2023-10-06T01:40:29.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.094+0000 7f0c35fab700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0c30086ff0 0x7f0c30087470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:29.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.094+0000 7f0c35fab700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f0c300b21b0 0x7f0c300b2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:29.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.094+0000 7f0c35fab700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c300b2b70 con 0x7f0c3015a030 2023-10-06T01:40:29.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.094+0000 7f0c35fab700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c300b0cf0 con 0x7f0c300b21b0 2023-10-06T01:40:29.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.094+0000 7f0c35fab700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c300879b0 con 0x7f0c30086ff0 2023-10-06T01:40:29.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.094+0000 7f0c2ffff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f0c300b21b0 0x7f0c300b2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:29.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.094+0000 7f0c2f7fe700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f0c3015a030 0x7f0c3015a400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:33188/0 (socket says 172.21.15.71:33188) 2023-10-06T01:40:29.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.094+0000 7f0c2ffff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f0c300b21b0 0x7f0c300b2630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40082/0 (socket says 172.21.15.71:40082) 2023-10-06T01:40:29.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.094+0000 7f0c2f7fe700 1 -- 172.21.15.71:0/2786712703 learned_addr learned my addr 172.21.15.71:0/2786712703 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:40:29.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.095+0000 7f0c2effd700 1 --2- 172.21.15.71:0/2786712703 >> v2:172.21.15.72:3300/0 conn(0x7f0c30086ff0 0x7f0c30087470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:29.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.095+0000 7f0c2ffff700 1 -- 172.21.15.71:0/2786712703 >> v2:172.21.15.72:3300/0 conn(0x7f0c30086ff0 msgr2=0x7f0c30087470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:29.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.095+0000 7f0c2ffff700 1 --2- 172.21.15.71:0/2786712703 >> v2:172.21.15.72:3300/0 conn(0x7f0c30086ff0 0x7f0c30087470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:29.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.095+0000 7f0c2ffff700 1 -- 172.21.15.71:0/2786712703 >> v1:172.21.15.71:6789/0 conn(0x7f0c3015a030 legacy=0x7f0c3015a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:29.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.095+0000 7f0c2ffff700 1 -- 172.21.15.71:0/2786712703 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c300afc50 con 0x7f0c300b21b0 2023-10-06T01:40:29.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.095+0000 7f0c2e7fc700 1 -- 172.21.15.71:0/2786712703 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3635692264 0 0) 0x7f0c300b2b70 con 0x7f0c3015a030 2023-10-06T01:40:29.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.095+0000 7f0c2ffff700 1 --2- 172.21.15.71:0/2786712703 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c300b21b0 0x7f0c300b2630 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0c300b1fa0 tx=0x7f0c280091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22e28ba702f37a5b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:29.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.095+0000 7f0c2e7fc700 1 -- 172.21.15.71:0/2786712703 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c28009e80 con 0x7f0c300b21b0 2023-10-06T01:40:29.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.095+0000 7f0c2e7fc700 1 -- 172.21.15.71:0/2786712703 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c2800b820 con 0x7f0c300b21b0 2023-10-06T01:40:29.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.095+0000 7f0c2e7fc700 1 -- 172.21.15.71:0/2786712703 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c2800bba0 con 0x7f0c300b21b0 2023-10-06T01:40:29.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.095+0000 7f0c35fab700 1 -- 172.21.15.71:0/2786712703 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c300b21b0 msgr2=0x7f0c300b2630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:29.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.095+0000 7f0c35fab700 1 --2- 172.21.15.71:0/2786712703 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c300b21b0 0x7f0c300b2630 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0c300b1fa0 tx=0x7f0c280091a0 comp rx=0 tx=0).stop 2023-10-06T01:40:29.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.096+0000 7f0c35fab700 1 -- 172.21.15.71:0/2786712703 shutdown_connections 2023-10-06T01:40:29.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.096+0000 7f0c35fab700 1 --2- 172.21.15.71:0/2786712703 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c300b21b0 0x7f0c300b2630 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:29.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.096+0000 7f0c35fab700 1 --2- 172.21.15.71:0/2786712703 >> v2:172.21.15.72:3300/0 conn(0x7f0c30086ff0 0x7f0c30087470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:29.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.096+0000 7f0c35fab700 1 -- 172.21.15.71:0/2786712703 >> 172.21.15.71:0/2786712703 conn(0x7f0c30068680 msgr2=0x7f0c30068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:29.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.096+0000 7f0c35fab700 1 -- 172.21.15.71:0/2786712703 shutdown_connections 2023-10-06T01:40:29.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.096+0000 7f0c35fab700 1 -- 172.21.15.71:0/2786712703 wait complete. 2023-10-06T01:40:29.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.097+0000 7f0c35fab700 1 Processor -- start 2023-10-06T01:40:29.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.097+0000 7f0c35fab700 1 -- start start 2023-10-06T01:40:29.102 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.098+0000 7f0c35fab700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c30086ff0 0x7f0c301559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:29.102 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.098+0000 7f0c35fab700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c300b21b0 0x7f0c300c6060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:29.102 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.098+0000 7f0c35fab700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0c3015a030 0x7f0c3016cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:29.102 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.098+0000 7f0c35fab700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c300c82a0 con 0x7f0c30086ff0 2023-10-06T01:40:29.102 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.098+0000 7f0c35fab700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c300c7690 con 0x7f0c300b21b0 2023-10-06T01:40:29.102 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.098+0000 7f0c35fab700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c300c7970 con 0x7f0c3015a030 2023-10-06T01:40:29.102 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.098+0000 7f0c2f7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c30086ff0 0x7f0c301559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:29.102 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.098+0000 7f0c2f7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c30086ff0 0x7f0c301559e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40088/0 (socket says 172.21.15.71:40088) 2023-10-06T01:40:29.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.098+0000 7f0c2f7fe700 1 -- 172.21.15.71:0/3325359045 learned_addr learned my addr 172.21.15.71:0/3325359045 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:29.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.098+0000 7f0c2effd700 1 --2- 172.21.15.71:0/3325359045 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c300b21b0 0x7f0c300c6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:29.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.098+0000 7f0c2ffff700 1 --2- 172.21.15.71:0/3325359045 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0c3015a030 0x7f0c3016cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:29.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.098+0000 7f0c2f7fe700 1 -- 172.21.15.71:0/3325359045 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0c3015a030 msgr2=0x7f0c3016cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:29.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.098+0000 7f0c2f7fe700 1 --2- 172.21.15.71:0/3325359045 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0c3015a030 0x7f0c3016cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:29.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.098+0000 7f0c2f7fe700 1 -- 172.21.15.71:0/3325359045 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c300b21b0 msgr2=0x7f0c300c6060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:29.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.098+0000 7f0c2f7fe700 1 --2- 172.21.15.71:0/3325359045 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c300b21b0 0x7f0c300c6060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:29.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.098+0000 7f0c2f7fe700 1 -- 172.21.15.71:0/3325359045 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c28009420 con 0x7f0c30086ff0 2023-10-06T01:40:29.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.098+0000 7f0c2ffff700 1 --2- 172.21.15.71:0/3325359045 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0c3015a030 0x7f0c3016cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:40:29.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.098+0000 7f0c2f7fe700 1 --2- 172.21.15.71:0/3325359045 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c30086ff0 0x7f0c301559e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0c2000cc70 tx=0x7f0c20001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:29.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.098+0000 7f0c177fe700 1 -- 172.21.15.71:0/3325359045 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c2000a940 con 0x7f0c30086ff0 2023-10-06T01:40:29.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.098+0000 7f0c177fe700 1 -- 172.21.15.71:0/3325359045 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c2000aaa0 con 0x7f0c30086ff0 2023-10-06T01:40:29.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.098+0000 7f0c35fab700 1 -- 172.21.15.71:0/3325359045 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c300c7c50 con 0x7f0c30086ff0 2023-10-06T01:40:29.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.098+0000 7f0c177fe700 1 -- 172.21.15.71:0/3325359045 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c2000ae20 con 0x7f0c30086ff0 2023-10-06T01:40:29.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.098+0000 7f0c35fab700 1 -- 172.21.15.71:0/3325359045 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c30155f20 con 0x7f0c30086ff0 2023-10-06T01:40:29.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.100+0000 7f0c177fe700 1 -- 172.21.15.71:0/3325359045 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0c20007300 con 0x7f0c30086ff0 2023-10-06T01:40:29.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.100+0000 7f0c177fe700 1 --2- 172.21.15.71:0/3325359045 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f0c1c066f30 0x7f0c1c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:29.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.100+0000 7f0c177fe700 1 -- 172.21.15.71:0/3325359045 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f0c20084d40 con 0x7f0c30086ff0 2023-10-06T01:40:29.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.100+0000 7f0c2effd700 1 --2- 172.21.15.71:0/3325359045 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f0c1c066f30 0x7f0c1c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:29.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.100+0000 7f0c2effd700 1 --2- 172.21.15.71:0/3325359045 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f0c1c066f30 0x7f0c1c0693e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0c3016cf50 tx=0x7f0c24008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:29.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.102+0000 7f0c3f2a3b80 1 Processor -- start 2023-10-06T01:40:29.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.102+0000 7f0c3f2a3b80 1 -- start start 2023-10-06T01:40:29.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.103+0000 7f0c3f2a3b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558ea6990840 0x558ea6990c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:29.116 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.103+0000 7f0c3f2a3b80 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558ea6991cc0 0x558ea69e06c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:29.116 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.103+0000 7f0c3f2a3b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558ea69e0c00 0x558ea69e1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:29.116 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.103+0000 7f0c3f2a3b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ea68e7a70 con 0x558ea69e0c00 2023-10-06T01:40:29.116 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.103+0000 7f0c3f2a3b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ea68e5270 con 0x558ea6990840 2023-10-06T01:40:29.116 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.103+0000 7f0c3f2a3b80 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x558ea68e1060 con 0x558ea6991cc0 2023-10-06T01:40:29.116 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.103+0000 7f0c2ffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558ea69e0c00 0x558ea69e1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:29.116 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.103+0000 7f0c2ffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558ea69e0c00 0x558ea69e1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40094/0 (socket says 172.21.15.71:40094) 2023-10-06T01:40:29.116 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.103+0000 7f0c2ffff700 1 -- 172.21.15.71:0/1182486116 learned_addr learned my addr 172.21.15.71:0/1182486116 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:29.116 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.103+0000 7f0c2f7fe700 1 --2- 172.21.15.71:0/1182486116 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558ea6990840 0x558ea6990c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:29.116 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.103+0000 7f0c2effd700 1 --2- 172.21.15.71:0/1182486116 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558ea6991cc0 0x558ea69e06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:29.116 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.103+0000 7f0c2ffff700 1 -- 172.21.15.71:0/1182486116 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558ea6991cc0 msgr2=0x558ea69e06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:29.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.103+0000 7f0c2ffff700 1 --2- 172.21.15.71:0/1182486116 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558ea6991cc0 0x558ea69e06c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:29.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.103+0000 7f0c2ffff700 1 -- 172.21.15.71:0/1182486116 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558ea6990840 msgr2=0x558ea6990c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:29.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.103+0000 7f0c2ffff700 1 --2- 172.21.15.71:0/1182486116 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558ea6990840 0x558ea6990c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:29.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.103+0000 7f0c2ffff700 1 -- 172.21.15.71:0/1182486116 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558ea677b270 con 0x558ea69e0c00 2023-10-06T01:40:29.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.103+0000 7f0c2ffff700 1 --2- 172.21.15.71:0/1182486116 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558ea69e0c00 0x558ea69e1050 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0c280091e0 tx=0x7f0c28017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=597d9808a31befff server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:29.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.104+0000 7f0c14ff9700 1 -- 172.21.15.71:0/1182486116 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c28020070 con 0x558ea69e0c00 2023-10-06T01:40:29.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.104+0000 7f0c14ff9700 1 -- 172.21.15.71:0/1182486116 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c2800bb10 con 0x558ea69e0c00 2023-10-06T01:40:29.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.104+0000 7f0c14ff9700 1 -- 172.21.15.71:0/1182486116 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c280256a0 con 0x558ea69e0c00 2023-10-06T01:40:29.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.104+0000 7f0c3f2a3b80 1 -- 172.21.15.71:0/1182486116 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558ea69e0c00 msgr2=0x558ea69e1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:29.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.104+0000 7f0c3f2a3b80 1 --2- 172.21.15.71:0/1182486116 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558ea69e0c00 0x558ea69e1050 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0c280091e0 tx=0x7f0c28017000 comp rx=0 tx=0).stop 2023-10-06T01:40:29.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.104+0000 7f0c3f2a3b80 1 -- 172.21.15.71:0/1182486116 shutdown_connections 2023-10-06T01:40:29.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.104+0000 7f0c3f2a3b80 1 --2- 172.21.15.71:0/1182486116 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558ea69e0c00 0x558ea69e1050 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:29.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.104+0000 7f0c3f2a3b80 1 --2- 172.21.15.71:0/1182486116 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558ea6990840 0x558ea6990c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:29.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.104+0000 7f0c3f2a3b80 1 --2- 172.21.15.71:0/1182486116 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558ea6991cc0 0x558ea69e06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:29.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.104+0000 7f0c3f2a3b80 1 -- 172.21.15.71:0/1182486116 >> 172.21.15.71:0/1182486116 conn(0x558ea6992160 msgr2=0x558ea6992530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:29.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.104+0000 7f0c3f2a3b80 1 -- 172.21.15.71:0/1182486116 shutdown_connections 2023-10-06T01:40:29.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.104+0000 7f0c3f2a3b80 1 -- 172.21.15.71:0/1182486116 wait complete. 2023-10-06T01:40:29.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.105+0000 7f0c3f2a3b80 1 -- start start 2023-10-06T01:40:29.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.105+0000 7f0c3f2a3b80 1 Processor -- start 2023-10-06T01:40:29.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.106+0000 7f0c3f2a3b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558ea6990840 0x558ea69baae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:29.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.106+0000 7f0c3f2a3b80 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558ea6991cc0 0x558ea69bb020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:29.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.106+0000 7f0c3f2a3b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558ea69e0c00 0x558ea69bb560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:29.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.106+0000 7f0c3f2a3b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ea688c890 con 0x558ea6990840 2023-10-06T01:40:29.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.106+0000 7f0c3f2a3b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ea68a7ea0 con 0x558ea69e0c00 2023-10-06T01:40:29.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.106+0000 7f0c3f2a3b80 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x558ea6763e30 con 0x558ea6991cc0 2023-10-06T01:40:29.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.106+0000 7f0c2f7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558ea6990840 0x558ea69baae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:29.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.106+0000 7f0c3f2a3b80 10 client.0 _ll_register_callbacks cb 0x558ea6953e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T01:40:29.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.106+0000 7f0c2f7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558ea6990840 0x558ea69baae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40098/0 (socket says 172.21.15.71:40098) 2023-10-06T01:40:29.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.106+0000 7f0c2f7fe700 1 -- 172.21.15.71:0/1870212448 learned_addr learned my addr 172.21.15.71:0/1870212448 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:29.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.106+0000 7f0c2ffff700 1 --2- 172.21.15.71:0/1870212448 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558ea69e0c00 0x558ea69bb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:29.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.106+0000 7f0c2effd700 1 --2- 172.21.15.71:0/1870212448 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558ea6991cc0 0x558ea69bb020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:29.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.106+0000 7f0c2f7fe700 1 -- 172.21.15.71:0/1870212448 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558ea6991cc0 msgr2=0x558ea69bb020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:29.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.106+0000 7f0c2f7fe700 1 --2- 172.21.15.71:0/1870212448 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558ea6991cc0 0x558ea69bb020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:29.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.106+0000 7f0c2f7fe700 1 -- 172.21.15.71:0/1870212448 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558ea69e0c00 msgr2=0x558ea69bb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:29.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.106+0000 7f0c2f7fe700 1 --2- 172.21.15.71:0/1870212448 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558ea69e0c00 0x558ea69bb560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:29.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.106+0000 7f0c2f7fe700 1 -- 172.21.15.71:0/1870212448 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c300afc50 con 0x558ea6990840 2023-10-06T01:40:29.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.106+0000 7f0c2f7fe700 1 --2- 172.21.15.71:0/1870212448 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558ea6990840 0x558ea69baae0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0c20051da0 tx=0x7f0c20082d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9945c4158184177a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:29.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.106+0000 7f0c0dffb700 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2023-10-06T01:40:29.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.106+0000 7f0c0dffb700 1 -- 172.21.15.71:0/1870212448 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c20081070 con 0x558ea6990840 2023-10-06T01:40:29.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.106+0000 7f0c0dffb700 1 -- 172.21.15.71:0/1870212448 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f0c2006a070 con 0x558ea6990840 2023-10-06T01:40:29.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.106+0000 7f0c3f2a3b80 1 -- 172.21.15.71:0/1870212448 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558ea6985940 con 0x558ea6990840 2023-10-06T01:40:29.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.107+0000 7f0c0dffb700 1 -- 172.21.15.71:0/1870212448 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0c2005c840 con 0x558ea6990840 2023-10-06T01:40:29.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.107+0000 7f0c3f2a3b80 10 client.4431 fetch_fsmap learned FSMap version 7 2023-10-06T01:40:29.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.107+0000 7f0c3f2a3b80 1 -- 172.21.15.71:0/1870212448 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x558ea671dfe0 con 0x558ea6990840 2023-10-06T01:40:29.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.107+0000 7f0c0dffb700 1 -- 172.21.15.71:0/1870212448 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558ea6985940 con 0x558ea6990840 2023-10-06T01:40:29.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.107+0000 7f0c0dffb700 1 -- 172.21.15.71:0/1870212448 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 7) v1 ==== 3108+0+0 (secure 0 0 0) 0x7f0c2005c3b0 con 0x558ea6990840 2023-10-06T01:40:29.121 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.107+0000 7f0c3f2a3b80 10 client.4431 fetch_fsmap finished waiting for FSMap version 7 2023-10-06T01:40:29.121 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.107+0000 7f0c3f2a3b80 10 client.4431 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-06T01:40:29.121 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.107+0000 7f0c3f2a3b80 20 client.4431 populate_metadata read hostname 'smithi071' 2023-10-06T01:40:29.121 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.107+0000 7f0c3f2a3b80 1 --2- 172.21.15.71:0/1870212448 >> [v2:172.21.15.72:6833/2361644634,v1:172.21.15.72:6834/2361644634] conn(0x558ea69e7210 0x558ea69e75e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:29.121 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.107+0000 7f0c3f2a3b80 4 client.4431 mds_command: new command op to 4315 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T01:40:29.121 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.107+0000 7f0c3f2a3b80 1 -- 172.21.15.71:0/1870212448 --> [v2:172.21.15.72:6833/2361644634,v1:172.21.15.72:6834/2361644634] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558ea6962870 con 0x558ea69e7210 2023-10-06T01:40:29.121 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.107+0000 7f0c2effd700 1 --2- 172.21.15.71:0/1870212448 >> [v2:172.21.15.72:6833/2361644634,v1:172.21.15.72:6834/2361644634] conn(0x558ea69e7210 0x558ea69e75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:29.121 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.107+0000 7f0c0dffb700 10 client.4431 ms_handle_connect on v2:172.21.15.72:6833/2361644634 2023-10-06T01:40:29.121 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.107+0000 7f0c2effd700 1 --2- 172.21.15.71:0/1870212448 >> [v2:172.21.15.72:6833/2361644634,v1:172.21.15.72:6834/2361644634] conn(0x558ea69e7210 0x558ea69e75e0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=717f20e35c95a8ed server_cookie=eddfd2c9cb941287 in_seq=0 out_seq=0 2023-10-06T01:40:29.121 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.108+0000 7f0c0dffb700 1 -- 172.21.15.71:0/1870212448 <== mds.0 v2:172.21.15.72:6833/2361644634 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x558ea6962870 con 0x558ea69e7210 2023-10-06T01:40:29.121 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.108+0000 7f0c0dffb700 10 client.4431 handle_command_reply: tid=0 2023-10-06T01:40:29.121 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.108+0000 7f0c3f2a3b80 1 client.4431 shutdown 2023-10-06T01:40:29.122 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.108+0000 7f0c3f2a3b80 1 -- 172.21.15.71:0/1870212448 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558ea6990840 msgr2=0x558ea69baae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:29.122 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.108+0000 7f0c3f2a3b80 1 --2- 172.21.15.71:0/1870212448 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558ea6990840 0x558ea69baae0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0c20051da0 tx=0x7f0c20082d70 comp rx=0 tx=0).stop 2023-10-06T01:40:29.122 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.108+0000 7f0c3f2a3b80 1 -- 172.21.15.71:0/1870212448 shutdown_connections 2023-10-06T01:40:29.122 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.108+0000 7f0c3f2a3b80 1 --2- 172.21.15.71:0/1870212448 >> [v2:172.21.15.72:6833/2361644634,v1:172.21.15.72:6834/2361644634] conn(0x558ea69e7210 0x558ea69e75e0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:29.122 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.108+0000 7f0c3f2a3b80 1 --2- 172.21.15.71:0/1870212448 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558ea69e0c00 0x558ea69bb560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:29.122 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.108+0000 7f0c3f2a3b80 1 --2- 172.21.15.71:0/1870212448 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558ea6990840 0x558ea69baae0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:29.122 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.108+0000 7f0c3f2a3b80 1 --2- 172.21.15.71:0/1870212448 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558ea6991cc0 0x558ea69bb020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:29.122 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.108+0000 7f0c0dffb700 0 client.4431 ms_handle_reset on v2:172.21.15.72:6833/2361644634 2023-10-06T01:40:29.122 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.108+0000 7f0c3f2a3b80 1 -- 172.21.15.71:0/1870212448 >> 172.21.15.71:0/1870212448 conn(0x558ea6992160 msgr2=0x558ea69911b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:29.122 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.108+0000 7f0c3f2a3b80 1 -- 172.21.15.71:0/1870212448 shutdown_connections 2023-10-06T01:40:29.122 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.108+0000 7f0c3f2a3b80 1 -- 172.21.15.71:0/1870212448 wait complete. 2023-10-06T01:40:29.123 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.108+0000 7f0c3f2a3b80 20 client.4431 trim_cache size 0 max 16384 2023-10-06T01:40:29.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.125+0000 7f0c3f2a3b80 1 Processor -- start 2023-10-06T01:40:29.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.125+0000 7f0c3f2a3b80 1 -- start start 2023-10-06T01:40:29.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.125+0000 7f0c3f2a3b80 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558ea6990840 0x558ea6992530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:29.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.125+0000 7f0c3f2a3b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558ea6991cc0 0x558ea698dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:29.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.126+0000 7f0c3f2a3b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558ea69e0c00 0x558ea698ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:29.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.126+0000 7f0c3f2a3b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ea698fa90 con 0x558ea6991cc0 2023-10-06T01:40:29.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.126+0000 7f0c3f2a3b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ea698b620 con 0x558ea69e0c00 2023-10-06T01:40:29.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.126+0000 7f0c3f2a3b80 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x558ea69cf2a0 con 0x558ea6990840 2023-10-06T01:40:29.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.126+0000 7f0c2effd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558ea6991cc0 0x558ea698dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:29.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.126+0000 7f0c2effd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558ea6991cc0 0x558ea698dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40106/0 (socket says 172.21.15.71:40106) 2023-10-06T01:40:29.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.126+0000 7f0c2effd700 1 -- 172.21.15.71:0/3936318590 learned_addr learned my addr 172.21.15.71:0/3936318590 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:29.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.126+0000 7f0c2f7fe700 1 --2- 172.21.15.71:0/3936318590 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558ea6990840 0x558ea6992530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:29.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.126+0000 7f0c2ffff700 1 --2- 172.21.15.71:0/3936318590 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558ea69e0c00 0x558ea698ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:29.134 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.126+0000 7f0c2effd700 1 -- 172.21.15.71:0/3936318590 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558ea6990840 msgr2=0x558ea6992530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:29.134 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.126+0000 7f0c2effd700 1 --2- 172.21.15.71:0/3936318590 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558ea6990840 0x558ea6992530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:29.134 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.126+0000 7f0c2effd700 1 -- 172.21.15.71:0/3936318590 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558ea69e0c00 msgr2=0x558ea698ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:29.134 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.126+0000 7f0c2effd700 1 --2- 172.21.15.71:0/3936318590 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558ea69e0c00 0x558ea698ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:29.134 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.126+0000 7f0c2effd700 1 -- 172.21.15.71:0/3936318590 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558ea68af780 con 0x558ea6991cc0 2023-10-06T01:40:29.134 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.126+0000 7f0c2effd700 1 --2- 172.21.15.71:0/3936318590 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558ea6991cc0 0x558ea698dfd0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0c24006f00 tx=0x7f0c24017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b39372d05c62a729 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:29.134 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.126+0000 7f0c157fa700 1 -- 172.21.15.71:0/3936318590 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c24016a60 con 0x558ea6991cc0 2023-10-06T01:40:29.134 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.126+0000 7f0c157fa700 1 -- 172.21.15.71:0/3936318590 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c24016bc0 con 0x558ea6991cc0 2023-10-06T01:40:29.134 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.126+0000 7f0c157fa700 1 -- 172.21.15.71:0/3936318590 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c2402d460 con 0x558ea6991cc0 2023-10-06T01:40:29.134 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.127+0000 7f0c3f2a3b80 1 -- 172.21.15.71:0/3936318590 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558ea6991cc0 msgr2=0x558ea698dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:29.134 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.127+0000 7f0c3f2a3b80 1 --2- 172.21.15.71:0/3936318590 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558ea6991cc0 0x558ea698dfd0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0c24006f00 tx=0x7f0c24017000 comp rx=0 tx=0).stop 2023-10-06T01:40:29.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.127+0000 7f0c3f2a3b80 1 -- 172.21.15.71:0/3936318590 shutdown_connections 2023-10-06T01:40:29.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.127+0000 7f0c3f2a3b80 1 --2- 172.21.15.71:0/3936318590 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558ea69e0c00 0x558ea698ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:29.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.127+0000 7f0c3f2a3b80 1 --2- 172.21.15.71:0/3936318590 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558ea6990840 0x558ea6992530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:29.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.127+0000 7f0c3f2a3b80 1 --2- 172.21.15.71:0/3936318590 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558ea6991cc0 0x558ea698dfd0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:29.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.127+0000 7f0c3f2a3b80 1 -- 172.21.15.71:0/3936318590 >> 172.21.15.71:0/3936318590 conn(0x558ea6992160 msgr2=0x558ea6993ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:29.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.127+0000 7f0c3f2a3b80 1 -- 172.21.15.71:0/3936318590 shutdown_connections 2023-10-06T01:40:29.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.127+0000 7f0c3f2a3b80 1 -- 172.21.15.71:0/3936318590 wait complete. 2023-10-06T01:40:29.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.127+0000 7f0c3f2a3b80 1 -- start start 2023-10-06T01:40:29.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.127+0000 7f0c3f2a3b80 1 Processor -- start 2023-10-06T01:40:29.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.128+0000 7f0c3f2a3b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558ea6990840 0x558ea698bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:29.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.128+0000 7f0c3f2a3b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558ea6991cc0 0x558ea6a36700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:29.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.128+0000 7f0c3f2a3b80 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558ea69e0c00 0x558ea6a36c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:29.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.128+0000 7f0c3f2a3b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ea6a404d0 con 0x558ea6990840 2023-10-06T01:40:29.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.128+0000 7f0c3f2a3b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ea69cd350 con 0x558ea6991cc0 2023-10-06T01:40:29.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.128+0000 7f0c3f2a3b80 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x558ea69cd590 con 0x558ea69e0c00 2023-10-06T01:40:29.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.128+0000 7f0c3f2a3b80 10 client.0 _ll_register_callbacks cb 0x558ea6953e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T01:40:29.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.128+0000 7f0c2f7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558ea6990840 0x558ea698bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:29.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.128+0000 7f0c2f7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558ea6990840 0x558ea698bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40112/0 (socket says 172.21.15.71:40112) 2023-10-06T01:40:29.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.128+0000 7f0c2f7fe700 1 -- 172.21.15.71:0/938080149 learned_addr learned my addr 172.21.15.71:0/938080149 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:29.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.128+0000 7f0c2effd700 1 --2- 172.21.15.71:0/938080149 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558ea6991cc0 0x558ea6a36700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:29.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.128+0000 7f0c2ffff700 1 --2- 172.21.15.71:0/938080149 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558ea69e0c00 0x558ea6a36c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:29.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.128+0000 7f0c2f7fe700 1 -- 172.21.15.71:0/938080149 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558ea69e0c00 msgr2=0x558ea6a36c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:29.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.128+0000 7f0c2f7fe700 1 --2- 172.21.15.71:0/938080149 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558ea69e0c00 0x558ea6a36c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:29.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.129+0000 7f0c2f7fe700 1 -- 172.21.15.71:0/938080149 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558ea6991cc0 msgr2=0x558ea6a36700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:29.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.129+0000 7f0c2f7fe700 1 --2- 172.21.15.71:0/938080149 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558ea6991cc0 0x558ea6a36700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:29.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.129+0000 7f0c2f7fe700 1 -- 172.21.15.71:0/938080149 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c2400e040 con 0x558ea6990840 2023-10-06T01:40:29.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.129+0000 7f0c2effd700 1 --2- 172.21.15.71:0/938080149 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558ea6991cc0 0x558ea6a36700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:40:29.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.129+0000 7f0c2ffff700 1 --2- 172.21.15.71:0/938080149 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558ea69e0c00 0x558ea6a36c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:40:29.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.129+0000 7f0c2f7fe700 1 --2- 172.21.15.71:0/938080149 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558ea6990840 0x558ea698bdf0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0c200522c0 tx=0x7f0c2006b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dda3f5a6781ca977 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:29.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.129+0000 7f0c0dffb700 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2023-10-06T01:40:29.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.129+0000 7f0c0dffb700 1 -- 172.21.15.71:0/938080149 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c20081040 con 0x558ea6990840 2023-10-06T01:40:29.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.129+0000 7f0c0dffb700 1 -- 172.21.15.71:0/938080149 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f0c2005c840 con 0x558ea6990840 2023-10-06T01:40:29.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.129+0000 7f0c3f2a3b80 1 -- 172.21.15.71:0/938080149 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0c2800bb10 con 0x558ea6990840 2023-10-06T01:40:29.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.129+0000 7f0c0dffb700 1 -- 172.21.15.71:0/938080149 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0c2000a5a0 con 0x558ea6990840 2023-10-06T01:40:29.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.129+0000 7f0c3f2a3b80 10 client.4437 fetch_fsmap learned FSMap version 7 2023-10-06T01:40:29.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.129+0000 7f0c3f2a3b80 1 -- 172.21.15.71:0/938080149 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x558ea6896470 con 0x558ea6990840 2023-10-06T01:40:29.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.129+0000 7f0c0dffb700 1 -- 172.21.15.71:0/938080149 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c2800bb10 con 0x558ea6990840 2023-10-06T01:40:29.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.129+0000 7f0c0dffb700 1 -- 172.21.15.71:0/938080149 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 7) v1 ==== 3108+0+0 (secure 0 0 0) 0x7f0c2001ac10 con 0x558ea6990840 2023-10-06T01:40:29.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.129+0000 7f0c3f2a3b80 10 client.4437 fetch_fsmap finished waiting for FSMap version 7 2023-10-06T01:40:29.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.129+0000 7f0c3f2a3b80 10 client.4437 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-06T01:40:29.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.129+0000 7f0c3f2a3b80 20 client.4437 populate_metadata read hostname 'smithi071' 2023-10-06T01:40:29.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.129+0000 7f0c3f2a3b80 1 --2- 172.21.15.71:0/938080149 >> [v2:172.21.15.72:6833/2361644634,v1:172.21.15.72:6834/2361644634] conn(0x558ea69defa0 0x558ea69df370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:29.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.129+0000 7f0c3f2a3b80 4 client.4437 mds_command: new command op to 4315 tid=0[{"prefix": "status"}] 2023-10-06T01:40:29.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.129+0000 7f0c3f2a3b80 1 -- 172.21.15.71:0/938080149 --> [v2:172.21.15.72:6833/2361644634,v1:172.21.15.72:6834/2361644634] -- command(tid 0: {"prefix": "status"}) v1 -- 0x558ea6883e00 con 0x558ea69defa0 2023-10-06T01:40:29.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.129+0000 7f0c2effd700 1 --2- 172.21.15.71:0/938080149 >> [v2:172.21.15.72:6833/2361644634,v1:172.21.15.72:6834/2361644634] conn(0x558ea69defa0 0x558ea69df370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:29.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.130+0000 7f0c0dffb700 10 client.4437 ms_handle_connect on v2:172.21.15.72:6833/2361644634 2023-10-06T01:40:29.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.130+0000 7f0c2effd700 1 --2- 172.21.15.71:0/938080149 >> [v2:172.21.15.72:6833/2361644634,v1:172.21.15.72:6834/2361644634] conn(0x558ea69defa0 0x558ea69df370 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=56bae18ab370b2be server_cookie=1ce2e94076f7649 in_seq=0 out_seq=0 2023-10-06T01:40:29.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.130+0000 7f0c0dffb700 1 -- 172.21.15.71:0/938080149 <== mds.0 v2:172.21.15.72:6833/2361644634 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x558ea6883e00 con 0x558ea69defa0 2023-10-06T01:40:29.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.130+0000 7f0c0dffb700 10 client.4437 handle_command_reply: tid=0 2023-10-06T01:40:29.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.130+0000 7f0c3f2a3b80 1 client.4437 shutdown 2023-10-06T01:40:29.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.130+0000 7f0c3f2a3b80 1 -- 172.21.15.71:0/938080149 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558ea6990840 msgr2=0x558ea698bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:29.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.130+0000 7f0c3f2a3b80 1 --2- 172.21.15.71:0/938080149 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558ea6990840 0x558ea698bdf0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0c200522c0 tx=0x7f0c2006b000 comp rx=0 tx=0).stop 2023-10-06T01:40:29.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.130+0000 7f0c3f2a3b80 1 -- 172.21.15.71:0/938080149 shutdown_connections 2023-10-06T01:40:29.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.130+0000 7f0c3f2a3b80 1 --2- 172.21.15.71:0/938080149 >> [v2:172.21.15.72:6833/2361644634,v1:172.21.15.72:6834/2361644634] conn(0x558ea69defa0 0x558ea69df370 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:29.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.130+0000 7f0c3f2a3b80 1 --2- 172.21.15.71:0/938080149 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558ea69e0c00 0x558ea6a36c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:29.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.130+0000 7f0c0dffb700 0 client.4437 ms_handle_reset on v2:172.21.15.72:6833/2361644634 2023-10-06T01:40:29.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.130+0000 7f0c3f2a3b80 1 --2- 172.21.15.71:0/938080149 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558ea6990840 0x558ea698bdf0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:29.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.130+0000 7f0c3f2a3b80 1 --2- 172.21.15.71:0/938080149 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558ea6991cc0 0x558ea6a36700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:29.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.130+0000 7f0c3f2a3b80 1 -- 172.21.15.71:0/938080149 >> 172.21.15.71:0/938080149 conn(0x558ea6992160 msgr2=0x558ea698dfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:29.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.130+0000 7f0c3f2a3b80 1 -- 172.21.15.71:0/938080149 shutdown_connections 2023-10-06T01:40:29.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.130+0000 7f0c3f2a3b80 1 -- 172.21.15.71:0/938080149 wait complete. 2023-10-06T01:40:29.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.130+0000 7f0c3f2a3b80 20 client.4437 trim_cache size 0 max 16384 2023-10-06T01:40:29.140 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2023-10-06T01:40:29.140 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster_fsid": "1fbf1bd2-f9b4-4599-bea2-f4aa920e9a56", 2023-10-06T01:40:29.140 INFO:teuthology.orchestra.run.smithi071.stdout: "whoami": 0, 2023-10-06T01:40:29.140 INFO:teuthology.orchestra.run.smithi071.stdout: "id": 4315, 2023-10-06T01:40:29.141 INFO:teuthology.orchestra.run.smithi071.stdout: "want_state": "up:active", 2023-10-06T01:40:29.141 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "up:active", 2023-10-06T01:40:29.141 INFO:teuthology.orchestra.run.smithi071.stdout: "fs_name": "cephfs", 2023-10-06T01:40:29.141 INFO:teuthology.orchestra.run.smithi071.stdout: "rank_uptime": 7.3593098699999997, 2023-10-06T01:40:29.141 INFO:teuthology.orchestra.run.smithi071.stdout: "mdsmap_epoch": 7, 2023-10-06T01:40:29.141 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_epoch": 27, 2023-10-06T01:40:29.141 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_epoch_barrier": 27, 2023-10-06T01:40:29.141 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 12.377020327 2023-10-06T01:40:29.141 INFO:teuthology.orchestra.run.smithi071.stdout:} 2023-10-06T01:40:29.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.131+0000 7f0c35fab700 1 -- 172.21.15.71:0/3325359045 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f0c1c066f30 msgr2=0x7f0c1c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:29.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.131+0000 7f0c35fab700 1 --2- 172.21.15.71:0/3325359045 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f0c1c066f30 0x7f0c1c0693e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0c3016cf50 tx=0x7f0c24008040 comp rx=0 tx=0).stop 2023-10-06T01:40:29.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.131+0000 7f0c35fab700 1 -- 172.21.15.71:0/3325359045 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c30086ff0 msgr2=0x7f0c301559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:29.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.131+0000 7f0c35fab700 1 --2- 172.21.15.71:0/3325359045 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c30086ff0 0x7f0c301559e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0c2000cc70 tx=0x7f0c20001a30 comp rx=0 tx=0).stop 2023-10-06T01:40:29.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.131+0000 7f0c35fab700 1 -- 172.21.15.71:0/3325359045 shutdown_connections 2023-10-06T01:40:29.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.131+0000 7f0c35fab700 1 --2- 172.21.15.71:0/3325359045 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0c3015a030 0x7f0c3016cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:29.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.131+0000 7f0c35fab700 1 --2- 172.21.15.71:0/3325359045 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0c30086ff0 0x7f0c301559e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:29.143 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.131+0000 7f0c35fab700 1 --2- 172.21.15.71:0/3325359045 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f0c1c066f30 0x7f0c1c0693e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:29.143 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.131+0000 7f0c35fab700 1 --2- 172.21.15.71:0/3325359045 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c300b21b0 0x7f0c300c6060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:29.143 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.131+0000 7f0c35fab700 1 -- 172.21.15.71:0/3325359045 >> 172.21.15.71:0/3325359045 conn(0x7f0c30068680 msgr2=0x7f0c3015db40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:29.143 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.131+0000 7f0c35fab700 1 -- 172.21.15.71:0/3325359045 shutdown_connections 2023-10-06T01:40:29.143 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.131+0000 7f0c35fab700 1 -- 172.21.15.71:0/3325359045 wait complete. 2023-10-06T01:40:29.144 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T01:40:29.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.257+0000 7f1dd30b2700 1 Processor -- start 2023-10-06T01:40:29.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.257+0000 7f1dd30b2700 1 -- start start 2023-10-06T01:40:29.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.258+0000 7f1dd30b2700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1dcc0af8b0 0x7f1dcc15d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:29.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.258+0000 7f1dd30b2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1dcc0b27f0 0x7f1dcc15d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:29.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.258+0000 7f1dd30b2700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dcc15e190 con 0x7f1dcc0af4e0 2023-10-06T01:40:29.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.258+0000 7f1dd30b2700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dcc0b1910 con 0x7f1dcc0af8b0 2023-10-06T01:40:29.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.258+0000 7f1dd30b2700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dcc0cb650 con 0x7f1dcc0b27f0 2023-10-06T01:40:29.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.258+0000 7f1dd0e4e700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f1dcc0af4e0 0x7f1dcc0b20e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:33200/0 (socket says 172.21.15.71:33200) 2023-10-06T01:40:29.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.258+0000 7f1dd0e4e700 1 -- 172.21.15.71:0/3832181638 learned_addr learned my addr 172.21.15.71:0/3832181638 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:40:29.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.258+0000 7f1dd164f700 1 --2- 172.21.15.71:0/3832181638 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1dcc0b27f0 0x7f1dcc15d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:29.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.258+0000 7f1dc3fff700 1 --2- 172.21.15.71:0/3832181638 >> v2:172.21.15.72:3300/0 conn(0x7f1dcc0af8b0 0x7f1dcc15d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:29.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.258+0000 7f1dc37fe700 1 -- 172.21.15.71:0/3832181638 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1072025364 0 0) 0x7f1dcc15e190 con 0x7f1dcc0af4e0 2023-10-06T01:40:29.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.258+0000 7f1dc37fe700 1 -- 172.21.15.71:0/3832181638 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1db4003570 con 0x7f1dcc0af4e0 2023-10-06T01:40:29.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.259+0000 7f1dc37fe700 1 -- 172.21.15.71:0/3832181638 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3698008023 0 0) 0x7f1db4003570 con 0x7f1dcc0af4e0 2023-10-06T01:40:29.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.259+0000 7f1dd164f700 1 -- 172.21.15.71:0/3832181638 >> v2:172.21.15.72:3300/0 conn(0x7f1dcc0af8b0 msgr2=0x7f1dcc15d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:29.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.259+0000 7f1dd164f700 1 --2- 172.21.15.71:0/3832181638 >> v2:172.21.15.72:3300/0 conn(0x7f1dcc0af8b0 0x7f1dcc15d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:29.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.259+0000 7f1dd164f700 1 -- 172.21.15.71:0/3832181638 >> v1:172.21.15.71:6789/0 conn(0x7f1dcc0af4e0 legacy=0x7f1dcc0b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:29.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.259+0000 7f1dd164f700 1 -- 172.21.15.71:0/3832181638 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dcc0ccaf0 con 0x7f1dcc0b27f0 2023-10-06T01:40:29.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.259+0000 7f1dd164f700 1 --2- 172.21.15.71:0/3832181638 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1dcc0b27f0 0x7f1dcc15d9a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1dc4009e60 tx=0x7f1dc4009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b238e1749fdd941 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:29.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.259+0000 7f1dc37fe700 1 -- 172.21.15.71:0/3832181638 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc400e070 con 0x7f1dcc0b27f0 2023-10-06T01:40:29.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.259+0000 7f1dc37fe700 1 -- 172.21.15.71:0/3832181638 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dc400b7a0 con 0x7f1dcc0b27f0 2023-10-06T01:40:29.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.259+0000 7f1dc37fe700 1 -- 172.21.15.71:0/3832181638 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc8001470 con 0x7f1dcc0b27f0 2023-10-06T01:40:29.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.260+0000 7f1dd30b2700 1 -- 172.21.15.71:0/3832181638 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1dcc0b27f0 msgr2=0x7f1dcc15d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:29.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.260+0000 7f1dd30b2700 1 --2- 172.21.15.71:0/3832181638 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1dcc0b27f0 0x7f1dcc15d9a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1dc4009e60 tx=0x7f1dc4009780 comp rx=0 tx=0).stop 2023-10-06T01:40:29.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.260+0000 7f1dd30b2700 1 -- 172.21.15.71:0/3832181638 shutdown_connections 2023-10-06T01:40:29.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.260+0000 7f1dd30b2700 1 --2- 172.21.15.71:0/3832181638 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1dcc0b27f0 0x7f1dcc15d9a0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:29.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.260+0000 7f1dd30b2700 1 --2- 172.21.15.71:0/3832181638 >> v2:172.21.15.72:3300/0 conn(0x7f1dcc0af8b0 0x7f1dcc15d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:29.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.260+0000 7f1dd30b2700 1 -- 172.21.15.71:0/3832181638 >> 172.21.15.71:0/3832181638 conn(0x7f1dcc068680 msgr2=0x7f1dcc068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:29.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.260+0000 7f1dd30b2700 1 -- 172.21.15.71:0/3832181638 shutdown_connections 2023-10-06T01:40:29.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.260+0000 7f1dd30b2700 1 -- 172.21.15.71:0/3832181638 wait complete. 2023-10-06T01:40:29.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.261+0000 7f1dd30b2700 1 Processor -- start 2023-10-06T01:40:29.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.261+0000 7f1dd30b2700 1 -- start start 2023-10-06T01:40:29.266 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.262+0000 7f1dd30b2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1dcc0af4e0 0x7f1dcc0a6d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:29.266 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.262+0000 7f1dd30b2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1dcc0af8b0 0x7f1dcc0a7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:29.266 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.262+0000 7f1dd30b2700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1dcc0b27f0 0x7f1dcc15c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:29.266 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.262+0000 7f1dd30b2700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dcc169be0 con 0x7f1dcc0b27f0 2023-10-06T01:40:29.266 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.262+0000 7f1dd30b2700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dcc169df0 con 0x7f1dcc0af4e0 2023-10-06T01:40:29.266 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.262+0000 7f1dd30b2700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dcc16a0d0 con 0x7f1dcc0af8b0 2023-10-06T01:40:29.266 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.262+0000 7f1dd164f700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1dcc0b27f0 0x7f1dcc15c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:29.266 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.262+0000 7f1dd164f700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1dcc0b27f0 0x7f1dcc15c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40118/0 (socket says 172.21.15.71:40118) 2023-10-06T01:40:29.266 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.262+0000 7f1dd164f700 1 -- 172.21.15.71:0/2579546692 learned_addr learned my addr 172.21.15.71:0/2579546692 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:29.266 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.262+0000 7f1dd0e4e700 1 --2- 172.21.15.71:0/2579546692 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1dcc0af4e0 0x7f1dcc0a6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:29.266 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.262+0000 7f1dc3fff700 1 --2- 172.21.15.71:0/2579546692 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1dcc0af8b0 0x7f1dcc0a7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:29.266 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.262+0000 7f1dd164f700 1 -- 172.21.15.71:0/2579546692 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1dcc0af8b0 msgr2=0x7f1dcc0a7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:29.267 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.262+0000 7f1dd164f700 1 --2- 172.21.15.71:0/2579546692 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1dcc0af8b0 0x7f1dcc0a7900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:29.267 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.262+0000 7f1dd164f700 1 -- 172.21.15.71:0/2579546692 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1dcc0af4e0 msgr2=0x7f1dcc0a6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:29.267 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.262+0000 7f1dd164f700 1 --2- 172.21.15.71:0/2579546692 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1dcc0af4e0 0x7f1dcc0a6d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:29.267 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.262+0000 7f1dd164f700 1 -- 172.21.15.71:0/2579546692 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dc4009a20 con 0x7f1dcc0b27f0 2023-10-06T01:40:29.267 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.262+0000 7f1dd164f700 1 --2- 172.21.15.71:0/2579546692 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1dcc0b27f0 0x7f1dcc15c4d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc0ca820 tx=0x7f1dc4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:29.267 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.262+0000 7f1dc0ff9700 1 -- 172.21.15.71:0/2579546692 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc4012bc0 con 0x7f1dcc0b27f0 2023-10-06T01:40:29.267 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.262+0000 7f1dc0ff9700 1 -- 172.21.15.71:0/2579546692 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dc4012d60 con 0x7f1dcc0b27f0 2023-10-06T01:40:29.267 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.262+0000 7f1dd30b2700 1 -- 172.21.15.71:0/2579546692 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dcc16a3b0 con 0x7f1dcc0b27f0 2023-10-06T01:40:29.267 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.262+0000 7f1dc0ff9700 1 -- 172.21.15.71:0/2579546692 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc401d680 con 0x7f1dcc0b27f0 2023-10-06T01:40:29.267 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.262+0000 7f1dd30b2700 1 -- 172.21.15.71:0/2579546692 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dcc0a7e40 con 0x7f1dcc0b27f0 2023-10-06T01:40:29.267 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.263+0000 7f1dd30b2700 1 -- 172.21.15.71:0/2579546692 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dcc16a9e0 con 0x7f1dcc0b27f0 2023-10-06T01:40:29.267 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.264+0000 7f1dc0ff9700 1 -- 172.21.15.71:0/2579546692 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1dc4024070 con 0x7f1dcc0b27f0 2023-10-06T01:40:29.268 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.264+0000 7f1dc0ff9700 1 --2- 172.21.15.71:0/2579546692 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f1db8066f30 0x7f1db80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:29.268 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.264+0000 7f1dc0ff9700 1 -- 172.21.15.71:0/2579546692 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f1dc4086e40 con 0x7f1dcc0b27f0 2023-10-06T01:40:29.268 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.264+0000 7f1dd0e4e700 1 --2- 172.21.15.71:0/2579546692 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f1db8066f30 0x7f1db80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:29.268 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.264+0000 7f1dd0e4e700 1 --2- 172.21.15.71:0/2579546692 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f1db8066f30 0x7f1db80693e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1dc80011e0 tx=0x7f1dc8001a00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:29.269 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.268+0000 7f1dc0ff9700 1 -- 172.21.15.71:0/2579546692 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1dc4053c60 con 0x7f1dcc0b27f0 2023-10-06T01:40:29.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.493+0000 7f1dd30b2700 1 -- 172.21.15.71:0/2579546692 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1dcc0b0910 con 0x7f1dcc0b27f0 2023-10-06T01:40:29.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.494+0000 7f1dc0ff9700 1 -- 172.21.15.71:0/2579546692 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7f1dc4008e80 con 0x7f1dcc0b27f0 2023-10-06T01:40:29.495 INFO:teuthology.orchestra.run.smithi071.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-06T01:40:29.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.496+0000 7f1dd30b2700 1 -- 172.21.15.71:0/2579546692 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f1db8066f30 msgr2=0x7f1db80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:29.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.496+0000 7f1dd30b2700 1 --2- 172.21.15.71:0/2579546692 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f1db8066f30 0x7f1db80693e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1dc80011e0 tx=0x7f1dc8001a00 comp rx=0 tx=0).stop 2023-10-06T01:40:29.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.496+0000 7f1dd30b2700 1 -- 172.21.15.71:0/2579546692 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1dcc0b27f0 msgr2=0x7f1dcc15c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:29.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.496+0000 7f1dd30b2700 1 --2- 172.21.15.71:0/2579546692 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1dcc0b27f0 0x7f1dcc15c4d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc0ca820 tx=0x7f1dc4018000 comp rx=0 tx=0).stop 2023-10-06T01:40:29.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.496+0000 7f1dd30b2700 1 -- 172.21.15.71:0/2579546692 shutdown_connections 2023-10-06T01:40:29.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.496+0000 7f1dd30b2700 1 --2- 172.21.15.71:0/2579546692 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1dcc0b27f0 0x7f1dcc15c4d0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:29.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.496+0000 7f1dd30b2700 1 --2- 172.21.15.71:0/2579546692 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f1db8066f30 0x7f1db80693e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:29.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.496+0000 7f1dd30b2700 1 --2- 172.21.15.71:0/2579546692 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1dcc0af4e0 0x7f1dcc0a6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:29.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.496+0000 7f1dd30b2700 1 --2- 172.21.15.71:0/2579546692 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1dcc0af8b0 0x7f1dcc0a7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:29.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.496+0000 7f1dd30b2700 1 -- 172.21.15.71:0/2579546692 >> 172.21.15.71:0/2579546692 conn(0x7f1dcc068680 msgr2=0x7f1dcc15a4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:29.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.496+0000 7f1dd30b2700 1 -- 172.21.15.71:0/2579546692 shutdown_connections 2023-10-06T01:40:29.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:29.496+0000 7f1dd30b2700 1 -- 172.21.15.71:0/2579546692 wait complete. 2023-10-06T01:40:29.508 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-06T01:40:29.508 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T01:40:29.509 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi071.front.sepia.ceph.com 2023-10-06T01:40:29.509 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-10-06T01:40:29.509 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-10-06T01:40:29.509 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-06T01:40:29.509 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T01:40:29.509 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T01:40:29.509 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-10-06T01:40:29.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:40:29.510 DEBUG:teuthology.orchestra.run.smithi071:> ip addr 2023-10-06T01:40:29.526 INFO:teuthology.orchestra.run.smithi071.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T01:40:29.526 INFO:teuthology.orchestra.run.smithi071.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T01:40:29.526 INFO:teuthology.orchestra.run.smithi071.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T01:40:29.526 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:40:29.526 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 ::1/128 scope host 2023-10-06T01:40:29.526 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:40:29.527 INFO:teuthology.orchestra.run.smithi071.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T01:40:29.527 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:d8:aa:4a brd ff:ff:ff:ff:ff:ff 2023-10-06T01:40:29.527 INFO:teuthology.orchestra.run.smithi071.stdout: altname enp7s0f0 2023-10-06T01:40:29.527 INFO:teuthology.orchestra.run.smithi071.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T01:40:29.527 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:d8:aa:4b brd ff:ff:ff:ff:ff:ff 2023-10-06T01:40:29.527 INFO:teuthology.orchestra.run.smithi071.stdout: altname enp7s0f1 2023-10-06T01:40:29.527 INFO:teuthology.orchestra.run.smithi071.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T01:40:29.527 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:8f:d7:64 brd ff:ff:ff:ff:ff:ff 2023-10-06T01:40:29.528 INFO:teuthology.orchestra.run.smithi071.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T01:40:29.528 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:8f:d7:65 brd ff:ff:ff:ff:ff:ff 2023-10-06T01:40:29.528 INFO:teuthology.orchestra.run.smithi071.stdout: inet 172.21.15.71/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T01:40:29.528 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft 42346sec preferred_lft 42346sec 2023-10-06T01:40:29.528 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::ec4:7aff:fe8f:d765/64 scope link 2023-10-06T01:40:29.528 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:40:29.528 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-06T01:40:29.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:40:29.529 DEBUG:teuthology.orchestra.run.smithi071:> (cd / && exec bash -c ' 2023-10-06T01:40:29.529 DEBUG:teuthology.orchestra.run.smithi071:> set -e 2023-10-06T01:40:29.529 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link add name ceph-brx type bridge 2023-10-06T01:40:29.529 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip addr flush dev ceph-brx 2023-10-06T01:40:29.529 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link set ceph-brx up 2023-10-06T01:40:29.529 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-06T01:40:29.529 DEBUG:teuthology.orchestra.run.smithi071:> ') 2023-10-06T01:40:29.701 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:40:29.701 DEBUG:teuthology.orchestra.run.smithi071:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T01:40:29.726 INFO:teuthology.orchestra.run.smithi071.stdout:1 2023-10-06T01:40:29.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:40:29.728 DEBUG:teuthology.orchestra.run.smithi071:> route 2023-10-06T01:40:29.805 INFO:teuthology.orchestra.run.smithi071.stdout:Kernel IP routing table 2023-10-06T01:40:29.805 INFO:teuthology.orchestra.run.smithi071.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T01:40:29.805 INFO:teuthology.orchestra.run.smithi071.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T01:40:29.805 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T01:40:29.805 INFO:teuthology.orchestra.run.smithi071.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T01:40:29.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:40:29.806 DEBUG:teuthology.orchestra.run.smithi071:> (cd / && exec bash -c ' 2023-10-06T01:40:29.806 DEBUG:teuthology.orchestra.run.smithi071:> set -e 2023-10-06T01:40:29.806 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T01:40:29.806 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T01:40:29.806 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T01:40:29.806 DEBUG:teuthology.orchestra.run.smithi071:> ') 2023-10-06T01:40:30.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:40:30.091 DEBUG:teuthology.orchestra.run.smithi071:> ip netns list 2023-10-06T01:40:30.106 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:40:30.106 DEBUG:teuthology.orchestra.run.smithi071:> ip netns list-id 2023-10-06T01:40:30.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:40:30.160 DEBUG:teuthology.orchestra.run.smithi071:> (cd / && exec bash -c ' 2023-10-06T01:40:30.160 DEBUG:teuthology.orchestra.run.smithi071:> set -e 2023-10-06T01:40:30.161 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-06T01:40:30.161 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-10-06T01:40:30.161 DEBUG:teuthology.orchestra.run.smithi071:> ') 2023-10-06T01:40:30.249 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-10-06T01:40:30.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:40:30.250 DEBUG:teuthology.orchestra.run.smithi071:> (cd / && exec bash -c ' 2023-10-06T01:40:30.250 DEBUG:teuthology.orchestra.run.smithi071:> set -e 2023-10-06T01:40:30.250 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-10-06T01:40:30.250 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-06T01:40:30.250 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-10-06T01:40:30.250 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-10-06T01:40:30.250 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-10-06T01:40:30.250 DEBUG:teuthology.orchestra.run.smithi071:> ') 2023-10-06T01:40:30.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:40:30.429 DEBUG:teuthology.orchestra.run.smithi071:> (cd / && exec bash -c ' 2023-10-06T01:40:30.429 DEBUG:teuthology.orchestra.run.smithi071:> set -e 2023-10-06T01:40:30.429 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link set brx.0 up 2023-10-06T01:40:30.429 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link set dev brx.0 master ceph-brx 2023-10-06T01:40:30.429 DEBUG:teuthology.orchestra.run.smithi071:> ') 2023-10-06T01:40:30.520 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-10-06T01:40:30.520 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T01:40:30.521 DEBUG:teuthology.orchestra.run.smithi071:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-10-06T01:40:30.535 INFO:teuthology.orchestra.run.smithi071.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-10-06T01:40:30.535 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T01:40:30.536 DEBUG:teuthology.orchestra.run.smithi071:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-10-06T01:40:30.590 DEBUG:teuthology.orchestra.run.smithi071:> sudo modprobe fuse 2023-10-06T01:40:30.654 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T01:40:30.654 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T01:40:30.718 INFO:teuthology.orchestra.run.smithi071.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T01:40:30.719 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T01:40:30.720 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T01:40:30.720 DEBUG:teuthology.orchestra.run.smithi071:> ls /sys/fs/fuse/connections 2023-10-06T01:40:30.775 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T01:40:30.775 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-10-06T01:40:30.817 DEBUG:teuthology.orchestra.run.smithi071:> sudo modprobe fuse 2023-10-06T01:40:30.841 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T01:40:30.841 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T01:40:30.905 INFO:teuthology.orchestra.run.smithi071.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T01:40:30.906 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T01:40:30.906 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T01:40:30.906 DEBUG:teuthology.orchestra.run.smithi071:> ls /sys/fs/fuse/connections 2023-10-06T01:40:30.925 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi071.stderr:2023-10-06T01:40:30.924+0000 7f3f7d143540 -1 init, newargv = 0x564d1ac15470 newargc=15 2023-10-06T01:40:30.925 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi071.stderr:ceph-fuse[98089]: starting ceph client 2023-10-06T01:40:30.931 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi071.stderr:ceph-fuse[98089]: starting fuse 2023-10-06T01:40:30.940 INFO:teuthology.orchestra.run.smithi071.stdout:46 2023-10-06T01:40:30.940 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-10-06T01:40:30.940 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T01:40:30.940 DEBUG:teuthology.orchestra.run.smithi071:> import glob 2023-10-06T01:40:30.940 DEBUG:teuthology.orchestra.run.smithi071:> import re 2023-10-06T01:40:30.940 DEBUG:teuthology.orchestra.run.smithi071:> import os 2023-10-06T01:40:30.940 DEBUG:teuthology.orchestra.run.smithi071:> import subprocess 2023-10-06T01:40:30.941 DEBUG:teuthology.orchestra.run.smithi071:> 2023-10-06T01:40:30.941 DEBUG:teuthology.orchestra.run.smithi071:> def _find_admin_socket(client_name): 2023-10-06T01:40:30.941 DEBUG:teuthology.orchestra.run.smithi071:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-10-06T01:40:30.941 DEBUG:teuthology.orchestra.run.smithi071:> files = glob.glob(asok_path) 2023-10-06T01:40:30.941 DEBUG:teuthology.orchestra.run.smithi071:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-10-06T01:40:30.941 DEBUG:teuthology.orchestra.run.smithi071:> 2023-10-06T01:40:30.941 DEBUG:teuthology.orchestra.run.smithi071:> # Given a non-glob path, it better be there 2023-10-06T01:40:30.941 DEBUG:teuthology.orchestra.run.smithi071:> if "*" not in asok_path: 2023-10-06T01:40:30.941 DEBUG:teuthology.orchestra.run.smithi071:> assert(len(files) == 1) 2023-10-06T01:40:30.941 DEBUG:teuthology.orchestra.run.smithi071:> return files[0] 2023-10-06T01:40:30.941 DEBUG:teuthology.orchestra.run.smithi071:> 2023-10-06T01:40:30.942 DEBUG:teuthology.orchestra.run.smithi071:> for f in files: 2023-10-06T01:40:30.942 DEBUG:teuthology.orchestra.run.smithi071:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T01:40:30.942 DEBUG:teuthology.orchestra.run.smithi071:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T01:40:30.942 DEBUG:teuthology.orchestra.run.smithi071:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T01:40:30.942 DEBUG:teuthology.orchestra.run.smithi071:> contents = proc_f.read() 2023-10-06T01:40:30.943 DEBUG:teuthology.orchestra.run.smithi071:> if mountpoint in contents: 2023-10-06T01:40:30.943 DEBUG:teuthology.orchestra.run.smithi071:> return f 2023-10-06T01:40:30.943 DEBUG:teuthology.orchestra.run.smithi071:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T01:40:30.943 DEBUG:teuthology.orchestra.run.smithi071:> 2023-10-06T01:40:30.943 DEBUG:teuthology.orchestra.run.smithi071:> print(_find_admin_socket("client.admin")) 2023-10-06T01:40:30.943 DEBUG:teuthology.orchestra.run.smithi071:> ' 2023-10-06T01:40:31.060 INFO:teuthology.orchestra.run.smithi071.stdout:/var/run/ceph/ceph-client.admin.98089.asok 2023-10-06T01:40:31.243 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.98089.asok 2023-10-06T01:40:31.243 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T01:40:31.243 DEBUG:teuthology.orchestra.run.smithi071:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.98089.asok status 2023-10-06T01:40:31.394 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2023-10-06T01:40:31.394 INFO:teuthology.orchestra.run.smithi071.stdout: "metadata": { 2023-10-06T01:40:31.394 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_sha1": "736ac5ba72cb47af7d6f6666b1e100f7e20a20e2", 2023-10-06T01:40:31.394 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_version": "ceph version 17.2.6-1296-g736ac5ba (736ac5ba72cb47af7d6f6666b1e100f7e20a20e2) quincy (stable)", 2023-10-06T01:40:31.395 INFO:teuthology.orchestra.run.smithi071.stdout: "entity_id": "admin", 2023-10-06T01:40:31.395 INFO:teuthology.orchestra.run.smithi071.stdout: "hostname": "smithi071", 2023-10-06T01:40:31.395 INFO:teuthology.orchestra.run.smithi071.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-10-06T01:40:31.395 INFO:teuthology.orchestra.run.smithi071.stdout: "pid": "98089", 2023-10-06T01:40:31.395 INFO:teuthology.orchestra.run.smithi071.stdout: "root": "/" 2023-10-06T01:40:31.395 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-06T01:40:31.395 INFO:teuthology.orchestra.run.smithi071.stdout: "dentry_count": 0, 2023-10-06T01:40:31.395 INFO:teuthology.orchestra.run.smithi071.stdout: "dentry_pinned_count": 0, 2023-10-06T01:40:31.395 INFO:teuthology.orchestra.run.smithi071.stdout: "id": 4449, 2023-10-06T01:40:31.395 INFO:teuthology.orchestra.run.smithi071.stdout: "inst": { 2023-10-06T01:40:31.395 INFO:teuthology.orchestra.run.smithi071.stdout: "name": { 2023-10-06T01:40:31.396 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "client", 2023-10-06T01:40:31.396 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 4449 2023-10-06T01:40:31.396 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-06T01:40:31.396 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": { 2023-10-06T01:40:31.396 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2023-10-06T01:40:31.396 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "192.168.0.1:0", 2023-10-06T01:40:31.396 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 1956233915 2023-10-06T01:40:31.396 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-06T01:40:31.396 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-06T01:40:31.396 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": { 2023-10-06T01:40:31.397 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2023-10-06T01:40:31.397 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "192.168.0.1:0", 2023-10-06T01:40:31.397 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 1956233915 2023-10-06T01:40:31.397 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-06T01:40:31.397 INFO:teuthology.orchestra.run.smithi071.stdout: "inst_str": "client.4449 192.168.0.1:0/1956233915", 2023-10-06T01:40:31.397 INFO:teuthology.orchestra.run.smithi071.stdout: "addr_str": "192.168.0.1:0/1956233915", 2023-10-06T01:40:31.397 INFO:teuthology.orchestra.run.smithi071.stdout: "inode_count": 1, 2023-10-06T01:40:31.397 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_epoch": 7, 2023-10-06T01:40:31.397 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_epoch": 27, 2023-10-06T01:40:31.398 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_epoch_barrier": 0, 2023-10-06T01:40:31.398 INFO:teuthology.orchestra.run.smithi071.stdout: "blocklisted": false, 2023-10-06T01:40:31.398 INFO:teuthology.orchestra.run.smithi071.stdout: "fs_name": "cephfs" 2023-10-06T01:40:31.398 INFO:teuthology.orchestra.run.smithi071.stdout:} 2023-10-06T01:40:31.404 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T01:40:31.404 DEBUG:teuthology.orchestra.run.smithi071:> stat --file-system '--printf=%T 2023-10-06T01:40:31.404 DEBUG:teuthology.orchestra.run.smithi071:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-10-06T01:40:31.419 INFO:teuthology.orchestra.run.smithi071.stdout:fuseblk 2023-10-06T01:40:31.419 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-10-06T01:40:31.419 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T01:40:31.419 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-10-06T01:40:31.484 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T01:40:31.485 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-10-06T01:40:31.575 INFO:teuthology.orchestra.run.smithi071.stdout:# file: . 2023-10-06T01:40:31.575 INFO:teuthology.orchestra.run.smithi071.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-10-06T01:40:31.575 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:40:31.575 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi071.front.sepia.ceph.com... 2023-10-06T01:40:31.575 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T01:40:31.576 DEBUG:teuthology.orchestra.run.smithi071:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-10-06T01:40:31.609 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi071.stderr:ceph-fuse[98089]: fuse finished with error 0 and tester_r 0 2023-10-06T01:40:31.610 INFO:teuthology.orchestra.run:waiting for 900 2023-10-06T01:40:37.711 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi071.front.sepia.ceph.com 2023-10-06T01:40:37.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:40:37.712 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-10-06T01:40:37.730 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:40:37.897 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:37.895+0000 7f7ab4082700 1 Processor -- start 2023-10-06T01:40:37.897 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:37.895+0000 7f7ab4082700 1 -- start start 2023-10-06T01:40:37.898 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:37.896+0000 7f7ab4082700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f7aac0c1de0 0x7f7aac068680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:37.899 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:37.896+0000 7f7ab4082700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7aac0c3220 con 0x7f7aac0ac150 2023-10-06T01:40:37.899 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:37.896+0000 7f7ab4082700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7aac1582c0 con 0x7f7aac0abd80 2023-10-06T01:40:37.899 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:37.896+0000 7f7ab4082700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7aac159dd0 con 0x7f7aac0c1de0 2023-10-06T01:40:37.899 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:37.896+0000 7f7ab261f700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f7aac0c1de0 0x7f7aac068680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:37.899 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:37.896+0000 7f7ab161d700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f7aac0ac150 0x7f7aac157bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:57352/0 (socket says 172.21.15.71:57352) 2023-10-06T01:40:37.899 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:37.896+0000 7f7ab161d700 1 -- 172.21.15.71:0/1226482519 learned_addr learned my addr 172.21.15.71:0/1226482519 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:40:37.899 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:37.897+0000 7f7ab261f700 1 -- 172.21.15.71:0/1226482519 >> v1:172.21.15.72:6789/0 conn(0x7f7aac0abd80 legacy=0x7f7aac15a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:37.899 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:37.897+0000 7f7ab261f700 1 -- 172.21.15.71:0/1226482519 >> v1:172.21.15.71:6789/0 conn(0x7f7aac0ac150 legacy=0x7f7aac157bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:37.899 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:37.897+0000 7f7ab0e1c700 1 -- 172.21.15.71:0/1226482519 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3651659616 0 0) 0x7f7aac0c3220 con 0x7f7aac0ac150 2023-10-06T01:40:37.899 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:37.897+0000 7f7ab261f700 1 -- 172.21.15.71:0/1226482519 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aac0ccfd0 con 0x7f7aac0c1de0 2023-10-06T01:40:37.899 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:37.897+0000 7f7ab261f700 1 --2- 172.21.15.71:0/1226482519 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7aac0c1de0 0x7f7aac068680 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7aac0cd1c0 tx=0x7f7aa40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=738f7cafd449d9a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:37.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:37.897+0000 7f7ab0e1c700 1 -- 172.21.15.71:0/1226482519 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa400b6b0 con 0x7f7aac0c1de0 2023-10-06T01:40:37.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:37.897+0000 7f7ab0e1c700 1 -- 172.21.15.71:0/1226482519 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aa400b810 con 0x7f7aac0c1de0 2023-10-06T01:40:37.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:37.897+0000 7f7ab0e1c700 1 -- 172.21.15.71:0/1226482519 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa400bbd0 con 0x7f7aac0c1de0 2023-10-06T01:40:37.903 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:37.897+0000 7f7ab4082700 1 -- 172.21.15.71:0/1226482519 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7aac0c1de0 msgr2=0x7f7aac068680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:37.903 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:37.897+0000 7f7ab4082700 1 --2- 172.21.15.71:0/1226482519 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7aac0c1de0 0x7f7aac068680 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7aac0cd1c0 tx=0x7f7aa40091a0 comp rx=0 tx=0).stop 2023-10-06T01:40:37.903 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:37.897+0000 7f7ab4082700 1 -- 172.21.15.71:0/1226482519 shutdown_connections 2023-10-06T01:40:37.903 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:37.897+0000 7f7ab4082700 1 --2- 172.21.15.71:0/1226482519 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7aac0c1de0 0x7f7aac068680 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:37.903 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:37.897+0000 7f7ab4082700 1 -- 172.21.15.71:0/1226482519 >> 172.21.15.71:0/1226482519 conn(0x7f7aac069790 msgr2=0x7f7aac069b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:37.903 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:37.898+0000 7f7ab4082700 1 -- 172.21.15.71:0/1226482519 shutdown_connections 2023-10-06T01:40:37.903 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:37.898+0000 7f7ab4082700 1 -- 172.21.15.71:0/1226482519 wait complete. 2023-10-06T01:40:37.903 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:37.899+0000 7f7ab4082700 1 Processor -- start 2023-10-06T01:40:37.903 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:37.899+0000 7f7ab4082700 1 -- start start 2023-10-06T01:40:37.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:37.899+0000 7f7ab4082700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7aac0abd80 0x7f7aac16db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:37.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:37.899+0000 7f7ab4082700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7aac0ac150 0x7f7aac155770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:37.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:37.899+0000 7f7ab4082700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7aac0c1de0 0x7f7aac0cbf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:37.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:37.899+0000 7f7ab4082700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aac0b1d30 con 0x7f7aac0c1de0 2023-10-06T01:40:37.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:37.899+0000 7f7ab4082700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aac0b18a0 con 0x7f7aac0ac150 2023-10-06T01:40:37.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:37.899+0000 7f7ab4082700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7aac16e0d0 con 0x7f7aac0abd80 2023-10-06T01:40:37.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:37.899+0000 7f7ab261f700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7aac0c1de0 0x7f7aac0cbf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:37.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:37.900+0000 7f7ab261f700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7aac0c1de0 0x7f7aac0cbf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40364/0 (socket says 172.21.15.71:40364) 2023-10-06T01:40:37.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:37.900+0000 7f7ab261f700 1 -- 172.21.15.71:0/1291692376 learned_addr learned my addr 172.21.15.71:0/1291692376 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:37.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:37.900+0000 7f7ab161d700 1 --2- 172.21.15.71:0/1291692376 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7aac0ac150 0x7f7aac155770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:37.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:37.900+0000 7f7ab261f700 1 -- 172.21.15.71:0/1291692376 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7aac0abd80 msgr2=0x7f7aac16db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:37.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:37.900+0000 7f7ab1e1e700 1 --2- 172.21.15.71:0/1291692376 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7aac0abd80 0x7f7aac16db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:37.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:37.900+0000 7f7ab261f700 1 --2- 172.21.15.71:0/1291692376 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7aac0abd80 0x7f7aac16db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:37.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:37.900+0000 7f7ab261f700 1 -- 172.21.15.71:0/1291692376 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7aac0ac150 msgr2=0x7f7aac155770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:37.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:37.900+0000 7f7ab261f700 1 --2- 172.21.15.71:0/1291692376 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7aac0ac150 0x7f7aac155770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:37.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:37.900+0000 7f7ab261f700 1 -- 172.21.15.71:0/1291692376 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aa4009420 con 0x7f7aac0c1de0 2023-10-06T01:40:37.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:37.900+0000 7f7ab1e1e700 1 --2- 172.21.15.71:0/1291692376 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7aac0abd80 0x7f7aac16db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:40:37.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:37.900+0000 7f7ab161d700 1 --2- 172.21.15.71:0/1291692376 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7aac0ac150 0x7f7aac155770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:40:37.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:37.900+0000 7f7ab261f700 1 --2- 172.21.15.71:0/1291692376 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7aac0c1de0 0x7f7aac0cbf80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7aa4013000 tx=0x7f7aa4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:37.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:37.900+0000 7f7aa1ffb700 1 -- 172.21.15.71:0/1291692376 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa400bbd0 con 0x7f7aac0c1de0 2023-10-06T01:40:37.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:37.900+0000 7f7aa1ffb700 1 -- 172.21.15.71:0/1291692376 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aa401f070 con 0x7f7aac0c1de0 2023-10-06T01:40:37.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:37.900+0000 7f7ab4082700 1 -- 172.21.15.71:0/1291692376 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7aac0b0f70 con 0x7f7aac0c1de0 2023-10-06T01:40:37.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:37.900+0000 7f7aa1ffb700 1 -- 172.21.15.71:0/1291692376 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa401a6a0 con 0x7f7aac0c1de0 2023-10-06T01:40:37.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:37.900+0000 7f7ab4082700 1 -- 172.21.15.71:0/1291692376 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7aac0b1530 con 0x7f7aac0c1de0 2023-10-06T01:40:37.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:37.901+0000 7f7ab4082700 1 -- 172.21.15.71:0/1291692376 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7aac0b1a30 con 0x7f7aac0c1de0 2023-10-06T01:40:37.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:37.902+0000 7f7aa1ffb700 1 -- 172.21.15.71:0/1291692376 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7aa4021030 con 0x7f7aac0c1de0 2023-10-06T01:40:37.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:37.902+0000 7f7aa1ffb700 1 --2- 172.21.15.71:0/1291692376 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7a90066f30 0x7f7a900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:37.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:37.902+0000 7f7aa1ffb700 1 -- 172.21.15.71:0/1291692376 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f7aa40863e0 con 0x7f7aac0c1de0 2023-10-06T01:40:37.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:37.902+0000 7f7ab1e1e700 1 --2- 172.21.15.71:0/1291692376 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7a90066f30 0x7f7a900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:37.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:37.903+0000 7f7ab1e1e700 1 --2- 172.21.15.71:0/1291692376 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7a90066f30 0x7f7a900693e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7aa8007fd0 tx=0x7f7aa8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:37.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:37.907+0000 7f7aa1ffb700 1 -- 172.21.15.71:0/1291692376 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7aa4053280 con 0x7f7aac0c1de0 2023-10-06T01:40:38.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.090+0000 7f7ab4082700 1 -- 172.21.15.71:0/1291692376 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7aac04bb80 con 0x7f7aac0c1de0 2023-10-06T01:40:38.092 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.091+0000 7f7aa1ffb700 1 -- 172.21.15.71:0/1291692376 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18659 (secure 0 0 0) 0x7f7aa40568a0 con 0x7f7aac0c1de0 2023-10-06T01:40:38.093 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:40:38.093 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":27,"fsid":"1fbf1bd2-f9b4-4599-bea2-f4aa920e9a56","created":"2023-10-06T01:39:57.016957+0000","modified":"2023-10-06T01:40:26.202441+0000","last_up_change":"2023-10-06T01:40:08.571643+0000","last_in_change":"2023-10-06T01:39:59.462741+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T01:40:08.610349+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T01:40:15.387434+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T01:40:19.640459+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T01:40:20.116883+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T01:40:23.830129+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cf059188-fb20-4dbf-95db-dcf57b213d03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":90670},{"type":"v1","addr":"172.21.15.71:6817","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":90670},{"type":"v1","addr":"172.21.15.71:6819","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":90670},{"type":"v1","addr":"172.21.15.71:6823","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":90670},{"type":"v1","addr":"172.21.15.71:6821","nonce":90670}]},"public_addr":"172.21.15.71:6817/90670","cluster_addr":"172.21.15.71:6819/90670","heartbeat_back_addr":"172.21.15.71:6823/90670","heartbeat_front_addr":"172.21.15.71:6821/90670","state":["exists","up"]},{"osd":1,"uuid":"0cff0aae-1799-4fe0-b610-54cf0813c0e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":90669},{"type":"v1","addr":"172.21.15.71:6809","nonce":90669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":90669},{"type":"v1","addr":"172.21.15.71:6811","nonce":90669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":90669},{"type":"v1","addr":"172.21.15.71:6815","nonce":90669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":90669},{"type":"v1","addr":"172.21.15.71:6813","nonce":90669}]},"public_addr":"172.21.15.71:6809/90669","cluster_addr":"172.21.15.71:6811/90669","heartbeat_back_addr":"172.21.15.71:6815/90669","heartbeat_front_addr":"172.21.15.71:6813/90669","state":["exists","up"]},{"osd":2,"uuid":"88d61ddc-9031-44e1-ba8c-546a41e7c8ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":90679},{"type":"v1","addr":"172.21.15.71:6825","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":90679},{"type":"v1","addr":"172.21.15.71:6827","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":90679},{"type":"v1","addr":"172.21.15.71:6831","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":90679},{"type":"v1","addr":"172.21.15.71:6829","nonce":90679}]},"public_addr":"172.21.15.71:6825/90679","cluster_addr":"172.21.15.71:6827/90679","heartbeat_back_addr":"172.21.15.71:6831/90679","heartbeat_front_addr":"172.21.15.71:6829/90679","state":["exists","up"]},{"osd":3,"uuid":"11ed92b7-960b-4a30-a889-a61d3eeb86f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":90668},{"type":"v1","addr":"172.21.15.71:6801","nonce":90668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":90668},{"type":"v1","addr":"172.21.15.71:6803","nonce":90668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":90668},{"type":"v1","addr":"172.21.15.71:6807","nonce":90668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":90668},{"type":"v1","addr":"172.21.15.71:6805","nonce":90668}]},"public_addr":"172.21.15.71:6801/90668","cluster_addr":"172.21.15.71:6803/90668","heartbeat_back_addr":"172.21.15.71:6807/90668","heartbeat_front_addr":"172.21.15.71:6805/90668","state":["exists","up"]},{"osd":4,"uuid":"ae4df784-abdf-4ddf-aefa-780f3ddafef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":90917},{"type":"v1","addr":"172.21.15.72:6801","nonce":90917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":90917},{"type":"v1","addr":"172.21.15.72:6803","nonce":90917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":90917},{"type":"v1","addr":"172.21.15.72:6807","nonce":90917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":90917},{"type":"v1","addr":"172.21.15.72:6805","nonce":90917}]},"public_addr":"172.21.15.72:6801/90917","cluster_addr":"172.21.15.72:6803/90917","heartbeat_back_addr":"172.21.15.72:6807/90917","heartbeat_front_addr":"172.21.15.72:6805/90917","state":["exists","up"]},{"osd":5,"uuid":"5ef0790f-001e-458f-a05b-efae216cf435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":90941},{"type":"v1","addr":"172.21.15.72:6817","nonce":90941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":90941},{"type":"v1","addr":"172.21.15.72:6819","nonce":90941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":90941},{"type":"v1","addr":"172.21.15.72:6827","nonce":90941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":90941},{"type":"v1","addr":"172.21.15.72:6823","nonce":90941}]},"public_addr":"172.21.15.72:6817/90941","cluster_addr":"172.21.15.72:6819/90941","heartbeat_back_addr":"172.21.15.72:6827/90941","heartbeat_front_addr":"172.21.15.72:6823/90941","state":["exists","up"]},{"osd":6,"uuid":"8705aef1-9ae8-4e54-a3c4-c2909fa0ceb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":90918},{"type":"v1","addr":"172.21.15.72:6809","nonce":90918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":90918},{"type":"v1","addr":"172.21.15.72:6811","nonce":90918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":90918},{"type":"v1","addr":"172.21.15.72:6815","nonce":90918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":90918},{"type":"v1","addr":"172.21.15.72:6813","nonce":90918}]},"public_addr":"172.21.15.72:6809/90918","cluster_addr":"172.21.15.72:6811/90918","heartbeat_back_addr":"172.21.15.72:6815/90918","heartbeat_front_addr":"172.21.15.72:6813/90918","state":["exists","up"]},{"osd":7,"uuid":"364c5119-6b13-4c75-b3f0-15e165eff86a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":90948},{"type":"v1","addr":"172.21.15.72:6822","nonce":90948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":90948},{"type":"v1","addr":"172.21.15.72:6826","nonce":90948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":90948},{"type":"v1","addr":"172.21.15.72:6831","nonce":90948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":90948},{"type":"v1","addr":"172.21.15.72:6829","nonce":90948}]},"public_addr":"172.21.15.72:6822/90948","cluster_addr":"172.21.15.72:6826/90948","heartbeat_back_addr":"172.21.15.72:6831/90948","heartbeat_front_addr":"172.21.15.72:6829/90948","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.642976+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.645372+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.619116+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.663042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.599163+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.646411+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.631545+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.669821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:40:38.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.093+0000 7f7ab4082700 1 -- 172.21.15.71:0/1291692376 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7a90066f30 msgr2=0x7f7a900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:38.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.093+0000 7f7ab4082700 1 --2- 172.21.15.71:0/1291692376 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7a90066f30 0x7f7a900693e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7aa8007fd0 tx=0x7f7aa8009040 comp rx=0 tx=0).stop 2023-10-06T01:40:38.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.093+0000 7f7ab4082700 1 -- 172.21.15.71:0/1291692376 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7aac0c1de0 msgr2=0x7f7aac0cbf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:38.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.093+0000 7f7ab4082700 1 --2- 172.21.15.71:0/1291692376 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7aac0c1de0 0x7f7aac0cbf80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7aa4013000 tx=0x7f7aa4016000 comp rx=0 tx=0).stop 2023-10-06T01:40:38.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.093+0000 7f7ab4082700 1 -- 172.21.15.71:0/1291692376 shutdown_connections 2023-10-06T01:40:38.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.093+0000 7f7ab4082700 1 --2- 172.21.15.71:0/1291692376 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7aac0c1de0 0x7f7aac0cbf80 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:38.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.093+0000 7f7ab4082700 1 --2- 172.21.15.71:0/1291692376 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7aac0abd80 0x7f7aac16db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:38.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.093+0000 7f7ab4082700 1 --2- 172.21.15.71:0/1291692376 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7a90066f30 0x7f7a900693e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:38.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.093+0000 7f7ab4082700 1 --2- 172.21.15.71:0/1291692376 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7aac0ac150 0x7f7aac155770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:38.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.093+0000 7f7ab4082700 1 -- 172.21.15.71:0/1291692376 >> 172.21.15.71:0/1291692376 conn(0x7f7aac069790 msgr2=0x7f7aac156f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:38.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.093+0000 7f7ab4082700 1 -- 172.21.15.71:0/1291692376 shutdown_connections 2023-10-06T01:40:38.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.093+0000 7f7ab4082700 1 -- 172.21.15.71:0/1291692376 wait complete. 2023-10-06T01:40:38.107 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:40:38.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.219+0000 7fcc28261700 1 Processor -- start 2023-10-06T01:40:38.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.220+0000 7fcc28261700 1 -- start start 2023-10-06T01:40:38.223 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.220+0000 7fcc28261700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcc2015ca10 0x7fcc20069f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:38.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.220+0000 7fcc28261700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fcc2015cde0 0x7fcc200b2360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:38.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.220+0000 7fcc28261700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc200b1ed0 con 0x7fcc20067d10 2023-10-06T01:40:38.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.220+0000 7fcc28261700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc200879c0 con 0x7fcc2015cde0 2023-10-06T01:40:38.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.220+0000 7fcc28261700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc200cec50 con 0x7fcc2015ca10 2023-10-06T01:40:38.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.221+0000 7fcc267fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fcc2015cde0 0x7fcc200b2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:38.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.221+0000 7fcc257fc700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fcc20067d10 0x7fcc2006a4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:57354/0 (socket says 172.21.15.71:57354) 2023-10-06T01:40:38.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.221+0000 7fcc257fc700 1 -- 172.21.15.71:0/1812532302 learned_addr learned my addr 172.21.15.71:0/1812532302 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:40:38.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.221+0000 7fcc25ffd700 1 --2- 172.21.15.71:0/1812532302 >> v2:172.21.15.72:3300/0 conn(0x7fcc2015ca10 0x7fcc20069f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:38.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.221+0000 7fcc267fe700 1 -- 172.21.15.71:0/1812532302 >> v2:172.21.15.72:3300/0 conn(0x7fcc2015ca10 msgr2=0x7fcc20069f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:38.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.221+0000 7fcc267fe700 1 --2- 172.21.15.71:0/1812532302 >> v2:172.21.15.72:3300/0 conn(0x7fcc2015ca10 0x7fcc20069f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:38.225 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.221+0000 7fcc267fe700 1 -- 172.21.15.71:0/1812532302 >> v1:172.21.15.71:6789/0 conn(0x7fcc20067d10 legacy=0x7fcc2006a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:38.225 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.221+0000 7fcc267fe700 1 -- 172.21.15.71:0/1812532302 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc200cef30 con 0x7fcc2015cde0 2023-10-06T01:40:38.225 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.221+0000 7fcc24ffb700 1 -- 172.21.15.71:0/1812532302 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4210728251 0 0) 0x7fcc200b1ed0 con 0x7fcc20067d10 2023-10-06T01:40:38.225 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.221+0000 7fcc267fe700 1 --2- 172.21.15.71:0/1812532302 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcc2015cde0 0x7fcc200b2360 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fcc2006f050 tx=0x7fcc18009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ea41b54356e4023 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:38.225 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.221+0000 7fcc24ffb700 1 -- 172.21.15.71:0/1812532302 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc1800e070 con 0x7fcc2015cde0 2023-10-06T01:40:38.225 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.221+0000 7fcc24ffb700 1 -- 172.21.15.71:0/1812532302 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc1800bc30 con 0x7fcc2015cde0 2023-10-06T01:40:38.225 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.221+0000 7fcc24ffb700 1 -- 172.21.15.71:0/1812532302 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc18012430 con 0x7fcc2015cde0 2023-10-06T01:40:38.225 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.222+0000 7fcc28261700 1 -- 172.21.15.71:0/1812532302 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcc2015cde0 msgr2=0x7fcc200b2360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:38.225 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.222+0000 7fcc28261700 1 --2- 172.21.15.71:0/1812532302 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcc2015cde0 0x7fcc200b2360 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fcc2006f050 tx=0x7fcc18009780 comp rx=0 tx=0).stop 2023-10-06T01:40:38.225 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.222+0000 7fcc28261700 1 -- 172.21.15.71:0/1812532302 shutdown_connections 2023-10-06T01:40:38.225 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.222+0000 7fcc28261700 1 --2- 172.21.15.71:0/1812532302 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcc2015cde0 0x7fcc200b2360 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:38.225 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.222+0000 7fcc28261700 1 --2- 172.21.15.71:0/1812532302 >> v2:172.21.15.72:3300/0 conn(0x7fcc2015ca10 0x7fcc20069f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:38.226 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.222+0000 7fcc28261700 1 -- 172.21.15.71:0/1812532302 >> 172.21.15.71:0/1812532302 conn(0x7fcc20067910 msgr2=0x7fcc200ce160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:38.226 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.222+0000 7fcc28261700 1 -- 172.21.15.71:0/1812532302 shutdown_connections 2023-10-06T01:40:38.226 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.222+0000 7fcc28261700 1 -- 172.21.15.71:0/1812532302 wait complete. 2023-10-06T01:40:38.228 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.223+0000 7fcc28261700 1 Processor -- start 2023-10-06T01:40:38.228 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.223+0000 7fcc28261700 1 -- start start 2023-10-06T01:40:38.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.224+0000 7fcc28261700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcc20067d10 0x7fcc20143c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:38.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.224+0000 7fcc28261700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcc2015ca10 0x7fcc200af100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:38.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.224+0000 7fcc28261700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc2015cde0 0x7fcc200af640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:38.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.224+0000 7fcc28261700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc20145380 con 0x7fcc20067d10 2023-10-06T01:40:38.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.224+0000 7fcc28261700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc20145660 con 0x7fcc2015cde0 2023-10-06T01:40:38.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.224+0000 7fcc28261700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc20145940 con 0x7fcc2015ca10 2023-10-06T01:40:38.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.224+0000 7fcc25ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcc20067d10 0x7fcc20143c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:38.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.224+0000 7fcc25ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcc20067d10 0x7fcc20143c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40390/0 (socket says 172.21.15.71:40390) 2023-10-06T01:40:38.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.224+0000 7fcc25ffd700 1 -- 172.21.15.71:0/2998789101 learned_addr learned my addr 172.21.15.71:0/2998789101 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:38.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.224+0000 7fcc267fe700 1 --2- 172.21.15.71:0/2998789101 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc2015cde0 0x7fcc200af640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:38.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.224+0000 7fcc257fc700 1 --2- 172.21.15.71:0/2998789101 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcc2015ca10 0x7fcc200af100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:38.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.224+0000 7fcc25ffd700 1 -- 172.21.15.71:0/2998789101 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcc2015ca10 msgr2=0x7fcc200af100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:38.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.224+0000 7fcc25ffd700 1 --2- 172.21.15.71:0/2998789101 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcc2015ca10 0x7fcc200af100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:38.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.224+0000 7fcc25ffd700 1 -- 172.21.15.71:0/2998789101 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc2015cde0 msgr2=0x7fcc200af640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:38.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.224+0000 7fcc25ffd700 1 --2- 172.21.15.71:0/2998789101 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc2015cde0 0x7fcc200af640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:38.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.224+0000 7fcc25ffd700 1 -- 172.21.15.71:0/2998789101 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc18009a20 con 0x7fcc20067d10 2023-10-06T01:40:38.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.224+0000 7fcc25ffd700 1 --2- 172.21.15.71:0/2998789101 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcc20067d10 0x7fcc20143c80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c00d810 tx=0x7fcc1c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:38.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.224+0000 7fcc15ffb700 1 -- 172.21.15.71:0/2998789101 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc1c0125f0 con 0x7fcc20067d10 2023-10-06T01:40:38.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.224+0000 7fcc15ffb700 1 -- 172.21.15.71:0/2998789101 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc1c012750 con 0x7fcc20067d10 2023-10-06T01:40:38.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.224+0000 7fcc15ffb700 1 -- 172.21.15.71:0/2998789101 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc1c012b10 con 0x7fcc20067d10 2023-10-06T01:40:38.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.224+0000 7fcc28261700 1 -- 172.21.15.71:0/2998789101 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc20145c20 con 0x7fcc20067d10 2023-10-06T01:40:38.231 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.225+0000 7fcc28261700 1 -- 172.21.15.71:0/2998789101 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc201441c0 con 0x7fcc20067d10 2023-10-06T01:40:38.231 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.225+0000 7fcc28261700 1 -- 172.21.15.71:0/2998789101 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc2006e8d0 con 0x7fcc20067d10 2023-10-06T01:40:38.231 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.226+0000 7fcc15ffb700 1 -- 172.21.15.71:0/2998789101 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcc1c01e460 con 0x7fcc20067d10 2023-10-06T01:40:38.231 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.226+0000 7fcc15ffb700 1 --2- 172.21.15.71:0/2998789101 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fcc04066f30 0x7fcc040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:38.231 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.226+0000 7fcc257fc700 1 --2- 172.21.15.71:0/2998789101 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fcc04066f30 0x7fcc040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:38.231 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.226+0000 7fcc15ffb700 1 -- 172.21.15.71:0/2998789101 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fcc1c084ff0 con 0x7fcc20067d10 2023-10-06T01:40:38.231 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.227+0000 7fcc257fc700 1 --2- 172.21.15.71:0/2998789101 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fcc04066f30 0x7fcc040693e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcc10007fd0 tx=0x7fcc10009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:38.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.230+0000 7fcc15ffb700 1 -- 172.21.15.71:0/2998789101 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcc1c051e10 con 0x7fcc20067d10 2023-10-06T01:40:38.414 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.413+0000 7fcc28261700 1 -- 172.21.15.71:0/2998789101 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcc200b1b60 con 0x7fcc20067d10 2023-10-06T01:40:38.415 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.413+0000 7fcc15ffb700 1 -- 172.21.15.71:0/2998789101 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18659 (secure 0 0 0) 0x7fcc1c055430 con 0x7fcc20067d10 2023-10-06T01:40:38.415 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:40:38.415 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":27,"fsid":"1fbf1bd2-f9b4-4599-bea2-f4aa920e9a56","created":"2023-10-06T01:39:57.016957+0000","modified":"2023-10-06T01:40:26.202441+0000","last_up_change":"2023-10-06T01:40:08.571643+0000","last_in_change":"2023-10-06T01:39:59.462741+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T01:40:08.610349+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T01:40:15.387434+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T01:40:19.640459+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T01:40:20.116883+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T01:40:23.830129+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cf059188-fb20-4dbf-95db-dcf57b213d03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":90670},{"type":"v1","addr":"172.21.15.71:6817","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":90670},{"type":"v1","addr":"172.21.15.71:6819","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":90670},{"type":"v1","addr":"172.21.15.71:6823","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":90670},{"type":"v1","addr":"172.21.15.71:6821","nonce":90670}]},"public_addr":"172.21.15.71:6817/90670","cluster_addr":"172.21.15.71:6819/90670","heartbeat_back_addr":"172.21.15.71:6823/90670","heartbeat_front_addr":"172.21.15.71:6821/90670","state":["exists","up"]},{"osd":1,"uuid":"0cff0aae-1799-4fe0-b610-54cf0813c0e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":90669},{"type":"v1","addr":"172.21.15.71:6809","nonce":90669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":90669},{"type":"v1","addr":"172.21.15.71:6811","nonce":90669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":90669},{"type":"v1","addr":"172.21.15.71:6815","nonce":90669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":90669},{"type":"v1","addr":"172.21.15.71:6813","nonce":90669}]},"public_addr":"172.21.15.71:6809/90669","cluster_addr":"172.21.15.71:6811/90669","heartbeat_back_addr":"172.21.15.71:6815/90669","heartbeat_front_addr":"172.21.15.71:6813/90669","state":["exists","up"]},{"osd":2,"uuid":"88d61ddc-9031-44e1-ba8c-546a41e7c8ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":90679},{"type":"v1","addr":"172.21.15.71:6825","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":90679},{"type":"v1","addr":"172.21.15.71:6827","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":90679},{"type":"v1","addr":"172.21.15.71:6831","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":90679},{"type":"v1","addr":"172.21.15.71:6829","nonce":90679}]},"public_addr":"172.21.15.71:6825/90679","cluster_addr":"172.21.15.71:6827/90679","heartbeat_back_addr":"172.21.15.71:6831/90679","heartbeat_front_addr":"172.21.15.71:6829/90679","state":["exists","up"]},{"osd":3,"uuid":"11ed92b7-960b-4a30-a889-a61d3eeb86f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":90668},{"type":"v1","addr":"172.21.15.71:6801","nonce":90668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":90668},{"type":"v1","addr":"172.21.15.71:6803","nonce":90668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":90668},{"type":"v1","addr":"172.21.15.71:6807","nonce":90668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":90668},{"type":"v1","addr":"172.21.15.71:6805","nonce":90668}]},"public_addr":"172.21.15.71:6801/90668","cluster_addr":"172.21.15.71:6803/90668","heartbeat_back_addr":"172.21.15.71:6807/90668","heartbeat_front_addr":"172.21.15.71:6805/90668","state":["exists","up"]},{"osd":4,"uuid":"ae4df784-abdf-4ddf-aefa-780f3ddafef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":90917},{"type":"v1","addr":"172.21.15.72:6801","nonce":90917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":90917},{"type":"v1","addr":"172.21.15.72:6803","nonce":90917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":90917},{"type":"v1","addr":"172.21.15.72:6807","nonce":90917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":90917},{"type":"v1","addr":"172.21.15.72:6805","nonce":90917}]},"public_addr":"172.21.15.72:6801/90917","cluster_addr":"172.21.15.72:6803/90917","heartbeat_back_addr":"172.21.15.72:6807/90917","heartbeat_front_addr":"172.21.15.72:6805/90917","state":["exists","up"]},{"osd":5,"uuid":"5ef0790f-001e-458f-a05b-efae216cf435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":90941},{"type":"v1","addr":"172.21.15.72:6817","nonce":90941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":90941},{"type":"v1","addr":"172.21.15.72:6819","nonce":90941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":90941},{"type":"v1","addr":"172.21.15.72:6827","nonce":90941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":90941},{"type":"v1","addr":"172.21.15.72:6823","nonce":90941}]},"public_addr":"172.21.15.72:6817/90941","cluster_addr":"172.21.15.72:6819/90941","heartbeat_back_addr":"172.21.15.72:6827/90941","heartbeat_front_addr":"172.21.15.72:6823/90941","state":["exists","up"]},{"osd":6,"uuid":"8705aef1-9ae8-4e54-a3c4-c2909fa0ceb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":90918},{"type":"v1","addr":"172.21.15.72:6809","nonce":90918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":90918},{"type":"v1","addr":"172.21.15.72:6811","nonce":90918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":90918},{"type":"v1","addr":"172.21.15.72:6815","nonce":90918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":90918},{"type":"v1","addr":"172.21.15.72:6813","nonce":90918}]},"public_addr":"172.21.15.72:6809/90918","cluster_addr":"172.21.15.72:6811/90918","heartbeat_back_addr":"172.21.15.72:6815/90918","heartbeat_front_addr":"172.21.15.72:6813/90918","state":["exists","up"]},{"osd":7,"uuid":"364c5119-6b13-4c75-b3f0-15e165eff86a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":90948},{"type":"v1","addr":"172.21.15.72:6822","nonce":90948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":90948},{"type":"v1","addr":"172.21.15.72:6826","nonce":90948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":90948},{"type":"v1","addr":"172.21.15.72:6831","nonce":90948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":90948},{"type":"v1","addr":"172.21.15.72:6829","nonce":90948}]},"public_addr":"172.21.15.72:6822/90948","cluster_addr":"172.21.15.72:6826/90948","heartbeat_back_addr":"172.21.15.72:6831/90948","heartbeat_front_addr":"172.21.15.72:6829/90948","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.642976+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.645372+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.619116+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.663042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.599163+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.646411+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.631545+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.669821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:40:38.418 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.416+0000 7fcc28261700 1 -- 172.21.15.71:0/2998789101 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fcc04066f30 msgr2=0x7fcc040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:38.418 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.416+0000 7fcc28261700 1 --2- 172.21.15.71:0/2998789101 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fcc04066f30 0x7fcc040693e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcc10007fd0 tx=0x7fcc10009040 comp rx=0 tx=0).stop 2023-10-06T01:40:38.418 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.416+0000 7fcc28261700 1 -- 172.21.15.71:0/2998789101 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcc20067d10 msgr2=0x7fcc20143c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:38.418 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.416+0000 7fcc28261700 1 --2- 172.21.15.71:0/2998789101 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcc20067d10 0x7fcc20143c80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c00d810 tx=0x7fcc1c008040 comp rx=0 tx=0).stop 2023-10-06T01:40:38.418 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.416+0000 7fcc28261700 1 -- 172.21.15.71:0/2998789101 shutdown_connections 2023-10-06T01:40:38.418 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.416+0000 7fcc28261700 1 --2- 172.21.15.71:0/2998789101 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fcc04066f30 0x7fcc040693e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:38.418 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.416+0000 7fcc28261700 1 --2- 172.21.15.71:0/2998789101 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc2015cde0 0x7fcc200af640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:38.418 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.416+0000 7fcc28261700 1 --2- 172.21.15.71:0/2998789101 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcc20067d10 0x7fcc20143c80 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:38.419 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.416+0000 7fcc28261700 1 --2- 172.21.15.71:0/2998789101 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcc2015ca10 0x7fcc200af100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:38.419 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.416+0000 7fcc28261700 1 -- 172.21.15.71:0/2998789101 >> 172.21.15.71:0/2998789101 conn(0x7fcc20067910 msgr2=0x7fcc2015b990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:38.419 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.416+0000 7fcc28261700 1 -- 172.21.15.71:0/2998789101 shutdown_connections 2023-10-06T01:40:38.419 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.416+0000 7fcc28261700 1 -- 172.21.15.71:0/2998789101 wait complete. 2023-10-06T01:40:38.430 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T01:40:38.546 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.544+0000 7fddc5b36700 1 Processor -- start 2023-10-06T01:40:38.546 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.544+0000 7fddc5b36700 1 -- start start 2023-10-06T01:40:38.550 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.545+0000 7fddc5b36700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fddc00cd400 0x7fddc00b1f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:38.550 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.545+0000 7fddc5b36700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fddc00cd7d0 0x7fddc00b2460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:38.550 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.545+0000 7fddc5b36700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddc00b29a0 con 0x7fddc00b0810 2023-10-06T01:40:38.550 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.545+0000 7fddc5b36700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddc00af770 con 0x7fddc00cd400 2023-10-06T01:40:38.550 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.545+0000 7fddc5b36700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddc00afa50 con 0x7fddc00cd7d0 2023-10-06T01:40:38.550 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.545+0000 7fddc5335700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fddc00b0810 0x7fddc00d01a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:57360/0 (socket says 172.21.15.71:57360) 2023-10-06T01:40:38.550 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.545+0000 7fddc5335700 1 -- 172.21.15.71:0/2664031184 learned_addr learned my addr 172.21.15.71:0/2664031184 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:40:38.550 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.545+0000 7fddb7fff700 1 --2- 172.21.15.71:0/2664031184 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fddc00cd7d0 0x7fddc00b2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:38.550 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.545+0000 7fddc4b34700 1 --2- 172.21.15.71:0/2664031184 >> v2:172.21.15.72:3300/0 conn(0x7fddc00cd400 0x7fddc00b1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:38.550 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.545+0000 7fddb77fe700 1 -- 172.21.15.71:0/2664031184 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3730408195 0 0) 0x7fddb8001490 con 0x7fddc00b0810 2023-10-06T01:40:38.551 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.545+0000 7fddb77fe700 1 -- 172.21.15.71:0/2664031184 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdda8003570 con 0x7fddc00b0810 2023-10-06T01:40:38.551 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.546+0000 7fddb77fe700 1 -- 172.21.15.71:0/2664031184 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1734483682 0 0) 0x7fdda8003570 con 0x7fddc00b0810 2023-10-06T01:40:38.551 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.546+0000 7fddb77fe700 1 -- 172.21.15.71:0/2664031184 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fddc00cd7d0 msgr2=0x7fddc00b2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:38.551 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.546+0000 7fddb77fe700 1 --2- 172.21.15.71:0/2664031184 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fddc00cd7d0 0x7fddc00b2460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:38.551 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.546+0000 7fddb77fe700 1 -- 172.21.15.71:0/2664031184 >> v2:172.21.15.72:3300/0 conn(0x7fddc00cd400 msgr2=0x7fddc00b1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:38.551 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.546+0000 7fddb77fe700 1 --2- 172.21.15.71:0/2664031184 >> v2:172.21.15.72:3300/0 conn(0x7fddc00cd400 0x7fddc00b1f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:38.551 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.546+0000 7fddb77fe700 1 -- 172.21.15.71:0/2664031184 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddc00afd30 con 0x7fddc00b0810 2023-10-06T01:40:38.551 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.546+0000 7fddb77fe700 1 -- 172.21.15.71:0/2664031184 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1184243524 0 0) 0x7fddb8001980 con 0x7fddc00b0810 2023-10-06T01:40:38.551 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.546+0000 7fddc4b34700 1 --2- 172.21.15.71:0/2664031184 >> v2:172.21.15.72:3300/0 conn(0x7fddc00cd400 0x7fddc00b1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:40:38.551 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.546+0000 7fddb77fe700 1 -- 172.21.15.71:0/2664031184 >> v1:172.21.15.71:6789/0 conn(0x7fddc00b0810 legacy=0x7fddc00d01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:38.551 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.546+0000 7fddb77fe700 1 --2- 172.21.15.71:0/2664031184 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdda8003a60 0x7fdda8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:38.552 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.546+0000 7fddb77fe700 1 --2- 172.21.15.71:0/2664031184 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdda8004810 0x7fdda8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:38.552 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.546+0000 7fddb77fe700 1 --2- 172.21.15.71:0/2664031184 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdda80051c0 0x7fdda800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:38.552 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.546+0000 7fddb77fe700 1 -- 172.21.15.71:0/2664031184 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddc00af770 con 0x7fdda8004810 2023-10-06T01:40:38.552 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.546+0000 7fddb77fe700 1 -- 172.21.15.71:0/2664031184 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddc00afa50 con 0x7fdda8003a60 2023-10-06T01:40:38.552 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.546+0000 7fddb77fe700 1 -- 172.21.15.71:0/2664031184 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdda800bfa0 con 0x7fdda80051c0 2023-10-06T01:40:38.552 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.546+0000 7fddb7fff700 1 --2- 172.21.15.71:0/2664031184 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdda8004810 0x7fdda8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:38.552 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.546+0000 7fddc4b34700 1 --2- 172.21.15.71:0/2664031184 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdda8003a60 0x7fdda8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:38.552 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.546+0000 7fddc5335700 1 --2- 172.21.15.71:0/2664031184 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdda80051c0 0x7fdda800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:38.552 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.546+0000 7fddb7fff700 1 -- 172.21.15.71:0/2664031184 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdda80051c0 msgr2=0x7fdda800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:38.552 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.546+0000 7fddb7fff700 1 --2- 172.21.15.71:0/2664031184 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdda80051c0 0x7fdda800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:38.552 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.546+0000 7fddb7fff700 1 -- 172.21.15.71:0/2664031184 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdda8003a60 msgr2=0x7fdda8003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:38.552 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.546+0000 7fddb7fff700 1 --2- 172.21.15.71:0/2664031184 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdda8003a60 0x7fdda8003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:38.553 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.546+0000 7fddb7fff700 1 -- 172.21.15.71:0/2664031184 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdda8003570 con 0x7fdda8004810 2023-10-06T01:40:38.553 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.546+0000 7fddb7fff700 1 --2- 172.21.15.71:0/2664031184 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdda8004810 0x7fdda8004c80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fddb0009be0 tx=0x7fddb00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=957fcdb19d35aeb3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:38.553 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.546+0000 7fddb77fe700 1 -- 172.21.15.71:0/2664031184 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb000e710 con 0x7fdda8004810 2023-10-06T01:40:38.553 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.546+0000 7fddb77fe700 1 -- 172.21.15.71:0/2664031184 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddb000e870 con 0x7fdda8004810 2023-10-06T01:40:38.553 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.546+0000 7fddb77fe700 1 -- 172.21.15.71:0/2664031184 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb000ec30 con 0x7fdda8004810 2023-10-06T01:40:38.553 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.547+0000 7fddc5b36700 1 -- 172.21.15.71:0/2664031184 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdda8004810 msgr2=0x7fdda8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:38.553 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.547+0000 7fddc5b36700 1 --2- 172.21.15.71:0/2664031184 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdda8004810 0x7fdda8004c80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fddb0009be0 tx=0x7fddb00091a0 comp rx=0 tx=0).stop 2023-10-06T01:40:38.553 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.547+0000 7fddc5335700 1 -- 172.21.15.71:0/2664031184 reap_dead start 2023-10-06T01:40:38.553 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.547+0000 7fddc5b36700 1 -- 172.21.15.71:0/2664031184 shutdown_connections 2023-10-06T01:40:38.553 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.547+0000 7fddc5b36700 1 -- 172.21.15.71:0/2664031184 >> 172.21.15.71:0/2664031184 conn(0x7fddc006a110 msgr2=0x7fddc006a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:38.553 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.547+0000 7fddc5b36700 1 -- 172.21.15.71:0/2664031184 shutdown_connections 2023-10-06T01:40:38.553 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.547+0000 7fddc5b36700 1 -- 172.21.15.71:0/2664031184 wait complete. 2023-10-06T01:40:38.554 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.548+0000 7fddc5b36700 1 Processor -- start 2023-10-06T01:40:38.554 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.548+0000 7fddc5b36700 1 -- start start 2023-10-06T01:40:38.556 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.549+0000 7fddc5b36700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fddc00b5450 0x7fddc00b2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:38.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.549+0000 7fddc5b36700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fddc015bbd0 0x7fddc0154ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:38.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.549+0000 7fddc5b36700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fddc00b5820 0x7fddc0155010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:38.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.549+0000 7fddc5b36700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddc00b43f0 con 0x7fddc00b5450 2023-10-06T01:40:38.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.549+0000 7fddc5b36700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddc00b4880 con 0x7fddc015bbd0 2023-10-06T01:40:38.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.549+0000 7fddc5b36700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddc00b37e0 con 0x7fddc00b5820 2023-10-06T01:40:38.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.549+0000 7fddc4b34700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fddc00b5450 0x7fddc00b2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:38.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.549+0000 7fddc4b34700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fddc00b5450 0x7fddc00b2ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40396/0 (socket says 172.21.15.71:40396) 2023-10-06T01:40:38.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.549+0000 7fddc4b34700 1 -- 172.21.15.71:0/1621939579 learned_addr learned my addr 172.21.15.71:0/1621939579 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:38.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.549+0000 7fddc5335700 1 --2- 172.21.15.71:0/1621939579 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fddc00b5820 0x7fddc0155010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:38.558 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.549+0000 7fddb7fff700 1 --2- 172.21.15.71:0/1621939579 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fddc015bbd0 0x7fddc0154ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:38.558 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.549+0000 7fddc4b34700 1 -- 172.21.15.71:0/1621939579 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fddc00b5820 msgr2=0x7fddc0155010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:38.558 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.549+0000 7fddc4b34700 1 --2- 172.21.15.71:0/1621939579 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fddc00b5820 0x7fddc0155010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:38.558 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.549+0000 7fddc4b34700 1 -- 172.21.15.71:0/1621939579 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fddc015bbd0 msgr2=0x7fddc0154ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:38.558 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.549+0000 7fddc4b34700 1 --2- 172.21.15.71:0/1621939579 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fddc015bbd0 0x7fddc0154ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:38.558 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.549+0000 7fddc4b34700 1 -- 172.21.15.71:0/1621939579 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddc00b3ac0 con 0x7fddc00b5450 2023-10-06T01:40:38.558 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.549+0000 7fddc5335700 1 --2- 172.21.15.71:0/1621939579 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fddc00b5820 0x7fddc0155010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:40:38.558 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.549+0000 7fddb7fff700 1 --2- 172.21.15.71:0/1621939579 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fddc015bbd0 0x7fddc0154ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:40:38.558 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.549+0000 7fddc4b34700 1 --2- 172.21.15.71:0/1621939579 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fddc00b5450 0x7fddc00b2ee0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fddbc011cf0 tx=0x7fddbc009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:38.558 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.550+0000 7fddb4ff9700 1 -- 172.21.15.71:0/1621939579 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddbc00fcd0 con 0x7fddc00b5450 2023-10-06T01:40:38.558 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.550+0000 7fddb4ff9700 1 -- 172.21.15.71:0/1621939579 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddbc00fe30 con 0x7fddc00b5450 2023-10-06T01:40:38.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.550+0000 7fddc5b36700 1 -- 172.21.15.71:0/1621939579 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddc00b3da0 con 0x7fddc00b5450 2023-10-06T01:40:38.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.550+0000 7fddb4ff9700 1 -- 172.21.15.71:0/1621939579 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddbc014690 con 0x7fddc00b5450 2023-10-06T01:40:38.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.550+0000 7fddc5b36700 1 -- 172.21.15.71:0/1621939579 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddc00b3420 con 0x7fddc00b5450 2023-10-06T01:40:38.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.551+0000 7fddc5b36700 1 -- 172.21.15.71:0/1621939579 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddc00b46d0 con 0x7fddc00b5450 2023-10-06T01:40:38.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.551+0000 7fddb4ff9700 1 -- 172.21.15.71:0/1621939579 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fddbc014ac0 con 0x7fddc00b5450 2023-10-06T01:40:38.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.551+0000 7fddb4ff9700 1 --2- 172.21.15.71:0/1621939579 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fddac066f30 0x7fddac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:38.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.551+0000 7fddb4ff9700 1 -- 172.21.15.71:0/1621939579 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fddbc018030 con 0x7fddc00b5450 2023-10-06T01:40:38.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.552+0000 7fddb7fff700 1 --2- 172.21.15.71:0/1621939579 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fddac066f30 0x7fddac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:38.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.552+0000 7fddb7fff700 1 --2- 172.21.15.71:0/1621939579 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fddac066f30 0x7fddac0693e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fddc005f200 tx=0x7fddb0019000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:38.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.556+0000 7fddb4ff9700 1 -- 172.21.15.71:0/1621939579 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fddbc052890 con 0x7fddc00b5450 2023-10-06T01:40:38.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.781+0000 7fddc5b36700 1 -- 172.21.15.71:0/1621939579 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fddc0064aa0 con 0x7fddc00b5450 2023-10-06T01:40:38.858 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.857+0000 7fddb4ff9700 1 -- 172.21.15.71:0/1621939579 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7fddbc055eb0 con 0x7fddc00b5450 2023-10-06T01:40:38.861 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.859+0000 7fddc5b36700 1 -- 172.21.15.71:0/1621939579 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fddac066f30 msgr2=0x7fddac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:38.861 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.859+0000 7fddc5b36700 1 --2- 172.21.15.71:0/1621939579 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fddac066f30 0x7fddac0693e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fddc005f200 tx=0x7fddb0019000 comp rx=0 tx=0).stop 2023-10-06T01:40:38.861 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.859+0000 7fddc5b36700 1 -- 172.21.15.71:0/1621939579 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fddc00b5450 msgr2=0x7fddc00b2ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:38.861 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.859+0000 7fddc5b36700 1 --2- 172.21.15.71:0/1621939579 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fddc00b5450 0x7fddc00b2ee0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fddbc011cf0 tx=0x7fddbc009120 comp rx=0 tx=0).stop 2023-10-06T01:40:38.861 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.859+0000 7fddc5b36700 1 -- 172.21.15.71:0/1621939579 shutdown_connections 2023-10-06T01:40:38.861 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.859+0000 7fddc5b36700 1 --2- 172.21.15.71:0/1621939579 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fddc00b5820 0x7fddc0155010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:38.862 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.859+0000 7fddc5b36700 1 --2- 172.21.15.71:0/1621939579 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fddc00b5450 0x7fddc00b2ee0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:38.862 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.859+0000 7fddc5b36700 1 --2- 172.21.15.71:0/1621939579 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fddac066f30 0x7fddac0693e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:38.862 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.859+0000 7fddc5b36700 1 --2- 172.21.15.71:0/1621939579 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fddc015bbd0 0x7fddc0154ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:38.862 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.859+0000 7fddc5b36700 1 -- 172.21.15.71:0/1621939579 >> 172.21.15.71:0/1621939579 conn(0x7fddc006a110 msgr2=0x7fddc01556d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:38.862 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.859+0000 7fddc5b36700 1 -- 172.21.15.71:0/1621939579 shutdown_connections 2023-10-06T01:40:38.862 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.859+0000 7fddc5b36700 1 -- 172.21.15.71:0/1621939579 wait complete. 2023-10-06T01:40:38.873 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T01:40:38.991 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.989+0000 7fc3667aa700 1 Processor -- start 2023-10-06T01:40:38.991 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.989+0000 7fc3667aa700 1 -- start start 2023-10-06T01:40:38.993 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.989+0000 7fc3667aa700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc3600d0400 0x7fc3600b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:38.993 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.990+0000 7fc3667aa700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc3600d07d0 0x7fc3600b3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:38.994 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.990+0000 7fc3667aa700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3600b6170 con 0x7fc3600ccd40 2023-10-06T01:40:38.994 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.990+0000 7fc3667aa700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc36015dd40 con 0x7fc3600d0400 2023-10-06T01:40:38.994 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.990+0000 7fc3667aa700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc36015e020 con 0x7fc3600d07d0 2023-10-06T01:40:38.994 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.990+0000 7fc35ffff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc3600d0400 0x7fc3600b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:38.994 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.990+0000 7fc35f7fe700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fc3600ccd40 0x7fc3600cf2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:57368/0 (socket says 172.21.15.71:57368) 2023-10-06T01:40:38.994 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.990+0000 7fc35ffff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc3600d0400 0x7fc3600b5c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40398/0 (socket says 172.21.15.71:40398) 2023-10-06T01:40:38.994 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.990+0000 7fc35f7fe700 1 -- 172.21.15.71:0/1631656805 learned_addr learned my addr 172.21.15.71:0/1631656805 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:40:38.994 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.990+0000 7fc364d47700 1 --2- 172.21.15.71:0/1631656805 >> v2:172.21.15.72:3300/0 conn(0x7fc3600d07d0 0x7fc3600b3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:38.994 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.990+0000 7fc35ffff700 1 -- 172.21.15.71:0/1631656805 >> v2:172.21.15.72:3300/0 conn(0x7fc3600d07d0 msgr2=0x7fc3600b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:38.994 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.990+0000 7fc35ffff700 1 --2- 172.21.15.71:0/1631656805 >> v2:172.21.15.72:3300/0 conn(0x7fc3600d07d0 0x7fc3600b3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:38.995 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.990+0000 7fc35ffff700 1 -- 172.21.15.71:0/1631656805 >> v1:172.21.15.71:6789/0 conn(0x7fc3600ccd40 legacy=0x7fc3600cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:38.995 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.990+0000 7fc35effd700 1 -- 172.21.15.71:0/1631656805 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1351496825 0 0) 0x7fc3600b6170 con 0x7fc3600ccd40 2023-10-06T01:40:38.995 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.990+0000 7fc35ffff700 1 -- 172.21.15.71:0/1631656805 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3600ceaa0 con 0x7fc3600d0400 2023-10-06T01:40:38.995 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.990+0000 7fc364d47700 1 --2- 172.21.15.71:0/1631656805 >> v2:172.21.15.72:3300/0 conn(0x7fc3600d07d0 0x7fc3600b3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:40:38.995 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.990+0000 7fc35ffff700 1 --2- 172.21.15.71:0/1631656805 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3600d0400 0x7fc3600b5c30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc3600cdf50 tx=0x7fc350009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9ff719cfafe00f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:38.995 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.990+0000 7fc35effd700 1 -- 172.21.15.71:0/1631656805 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc350005c10 con 0x7fc3600d0400 2023-10-06T01:40:38.995 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.990+0000 7fc35effd700 1 -- 172.21.15.71:0/1631656805 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc350005d70 con 0x7fc3600d0400 2023-10-06T01:40:38.995 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.990+0000 7fc35effd700 1 -- 172.21.15.71:0/1631656805 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc350006260 con 0x7fc3600d0400 2023-10-06T01:40:38.995 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.991+0000 7fc3667aa700 1 -- 172.21.15.71:0/1631656805 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3600d0400 msgr2=0x7fc3600b5c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:38.995 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.991+0000 7fc3667aa700 1 --2- 172.21.15.71:0/1631656805 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3600d0400 0x7fc3600b5c30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc3600cdf50 tx=0x7fc350009120 comp rx=0 tx=0).stop 2023-10-06T01:40:38.995 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.991+0000 7fc3667aa700 1 -- 172.21.15.71:0/1631656805 shutdown_connections 2023-10-06T01:40:38.996 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.991+0000 7fc3667aa700 1 --2- 172.21.15.71:0/1631656805 >> v2:172.21.15.72:3300/0 conn(0x7fc3600d07d0 0x7fc3600b3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:38.996 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.991+0000 7fc3667aa700 1 --2- 172.21.15.71:0/1631656805 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3600d0400 0x7fc3600b5c30 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:38.996 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.991+0000 7fc3667aa700 1 -- 172.21.15.71:0/1631656805 >> 172.21.15.71:0/1631656805 conn(0x7fc36006a220 msgr2=0x7fc36006a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:38.996 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.991+0000 7fc3667aa700 1 -- 172.21.15.71:0/1631656805 shutdown_connections 2023-10-06T01:40:38.996 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.991+0000 7fc3667aa700 1 -- 172.21.15.71:0/1631656805 wait complete. 2023-10-06T01:40:38.996 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.992+0000 7fc3667aa700 1 Processor -- start 2023-10-06T01:40:38.996 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.992+0000 7fc3667aa700 1 -- start start 2023-10-06T01:40:38.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.993+0000 7fc3667aa700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3600ccd40 0x7fc3600c5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:38.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.993+0000 7fc3667aa700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3600d0400 0x7fc3600c6db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:39.000 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.993+0000 7fc3667aa700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc3600d07d0 0x7fc36015be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:39.000 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.993+0000 7fc3667aa700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3600c7ef0 con 0x7fc3600d0400 2023-10-06T01:40:39.000 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.993+0000 7fc3667aa700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3600cb0f0 con 0x7fc3600ccd40 2023-10-06T01:40:39.000 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.993+0000 7fc3667aa700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3600cadc0 con 0x7fc3600d07d0 2023-10-06T01:40:39.000 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.993+0000 7fc35f7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3600d0400 0x7fc3600c6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:39.000 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.993+0000 7fc35f7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3600d0400 0x7fc3600c6db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40412/0 (socket says 172.21.15.71:40412) 2023-10-06T01:40:39.001 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.993+0000 7fc35f7fe700 1 -- 172.21.15.71:0/1168610972 learned_addr learned my addr 172.21.15.71:0/1168610972 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:39.001 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.993+0000 7fc35ffff700 1 --2- 172.21.15.71:0/1168610972 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3600ccd40 0x7fc3600c5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:39.001 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.993+0000 7fc364d47700 1 --2- 172.21.15.71:0/1168610972 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc3600d07d0 0x7fc36015be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:39.001 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.993+0000 7fc35f7fe700 1 -- 172.21.15.71:0/1168610972 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc3600d07d0 msgr2=0x7fc36015be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:39.001 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.993+0000 7fc35f7fe700 1 --2- 172.21.15.71:0/1168610972 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc3600d07d0 0x7fc36015be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:39.001 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.993+0000 7fc35f7fe700 1 -- 172.21.15.71:0/1168610972 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3600ccd40 msgr2=0x7fc3600c5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:39.001 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.993+0000 7fc35f7fe700 1 --2- 172.21.15.71:0/1168610972 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3600ccd40 0x7fc3600c5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:39.001 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.993+0000 7fc35f7fe700 1 -- 172.21.15.71:0/1168610972 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3500093c0 con 0x7fc3600d0400 2023-10-06T01:40:39.001 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.993+0000 7fc35ffff700 1 --2- 172.21.15.71:0/1168610972 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3600ccd40 0x7fc3600c5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:40:39.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.993+0000 7fc364d47700 1 --2- 172.21.15.71:0/1168610972 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc3600d07d0 0x7fc36015be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:40:39.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.993+0000 7fc35f7fe700 1 --2- 172.21.15.71:0/1168610972 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3600d0400 0x7fc3600c6db0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc35400c7e0 tx=0x7fc354007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:39.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.993+0000 7fc347fff700 1 -- 172.21.15.71:0/1168610972 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc354005b30 con 0x7fc3600d0400 2023-10-06T01:40:39.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.993+0000 7fc347fff700 1 -- 172.21.15.71:0/1168610972 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc354005c90 con 0x7fc3600d0400 2023-10-06T01:40:39.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.994+0000 7fc3667aa700 1 -- 172.21.15.71:0/1168610972 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3600c7650 con 0x7fc3600d0400 2023-10-06T01:40:39.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.994+0000 7fc347fff700 1 -- 172.21.15.71:0/1168610972 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc354007300 con 0x7fc3600d0400 2023-10-06T01:40:39.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.994+0000 7fc3667aa700 1 -- 172.21.15.71:0/1168610972 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3600c7c90 con 0x7fc3600d0400 2023-10-06T01:40:39.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.995+0000 7fc3667aa700 1 -- 172.21.15.71:0/1168610972 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc36006a800 con 0x7fc3600d0400 2023-10-06T01:40:39.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.995+0000 7fc347fff700 1 -- 172.21.15.71:0/1168610972 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc35401b400 con 0x7fc3600d0400 2023-10-06T01:40:39.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.995+0000 7fc347fff700 1 --2- 172.21.15.71:0/1168610972 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fc34c066f30 0x7fc34c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:39.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.995+0000 7fc347fff700 1 -- 172.21.15.71:0/1168610972 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fc354084480 con 0x7fc3600d0400 2023-10-06T01:40:39.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.995+0000 7fc35ffff700 1 --2- 172.21.15.71:0/1168610972 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fc34c066f30 0x7fc34c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:39.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.996+0000 7fc35ffff700 1 --2- 172.21.15.71:0/1168610972 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fc34c066f30 0x7fc34c0693e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc350009160 tx=0x7fc350016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:39.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:38.999+0000 7fc347fff700 1 -- 172.21.15.71:0/1168610972 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc354051320 con 0x7fc3600d0400 2023-10-06T01:40:39.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:39.231+0000 7fc3667aa700 1 -- 172.21.15.71:0/1168610972 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fc3600cb260 con 0x7fc3600d0400 2023-10-06T01:40:39.865 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:39.863+0000 7fc347fff700 1 -- 172.21.15.71:0/1168610972 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc354054940 con 0x7fc3600d0400 2023-10-06T01:40:39.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:39.866+0000 7fc3667aa700 1 -- 172.21.15.71:0/1168610972 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fc34c066f30 msgr2=0x7fc34c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:39.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:39.866+0000 7fc3667aa700 1 --2- 172.21.15.71:0/1168610972 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fc34c066f30 0x7fc34c0693e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc350009160 tx=0x7fc350016000 comp rx=0 tx=0).stop 2023-10-06T01:40:39.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:39.866+0000 7fc3667aa700 1 -- 172.21.15.71:0/1168610972 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3600d0400 msgr2=0x7fc3600c6db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:39.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:39.866+0000 7fc3667aa700 1 --2- 172.21.15.71:0/1168610972 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3600d0400 0x7fc3600c6db0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc35400c7e0 tx=0x7fc354007df0 comp rx=0 tx=0).stop 2023-10-06T01:40:39.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:39.866+0000 7fc3667aa700 1 -- 172.21.15.71:0/1168610972 shutdown_connections 2023-10-06T01:40:39.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:39.866+0000 7fc3667aa700 1 --2- 172.21.15.71:0/1168610972 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc3600d07d0 0x7fc36015be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:39.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:39.866+0000 7fc3667aa700 1 --2- 172.21.15.71:0/1168610972 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fc34c066f30 0x7fc34c0693e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:39.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:39.866+0000 7fc3667aa700 1 --2- 172.21.15.71:0/1168610972 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3600ccd40 0x7fc3600c5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:39.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:39.866+0000 7fc3667aa700 1 --2- 172.21.15.71:0/1168610972 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3600d0400 0x7fc3600c6db0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:39.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:39.866+0000 7fc3667aa700 1 -- 172.21.15.71:0/1168610972 >> 172.21.15.71:0/1168610972 conn(0x7fc36006a220 msgr2=0x7fc3600b5be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:39.869 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:39.866+0000 7fc3667aa700 1 -- 172.21.15.71:0/1168610972 shutdown_connections 2023-10-06T01:40:39.869 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:39.866+0000 7fc3667aa700 1 -- 172.21.15.71:0/1168610972 wait complete. 2023-10-06T01:40:39.881 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T01:40:39.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:39.996+0000 7fba6482d700 1 Processor -- start 2023-10-06T01:40:39.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:39.996+0000 7fba6482d700 1 -- start start 2023-10-06T01:40:39.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:39.997+0000 7fba6482d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fba60153ad0 0x7fba600cce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:39.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:39.997+0000 7fba6482d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fba60156db0 0x7fba60158500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:39.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:39.997+0000 7fba6482d700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba600cd7c0 con 0x7fba600cd350 2023-10-06T01:40:39.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:39.997+0000 7fba6482d700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba60157230 con 0x7fba60153ad0 2023-10-06T01:40:39.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:39.997+0000 7fba6482d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba60158070 con 0x7fba60156db0 2023-10-06T01:40:40.000 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:39.997+0000 7fba5ffff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fba60156db0 0x7fba60158500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:40.000 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:39.997+0000 7fba5f7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fba60153ad0 0x7fba600cce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:40.000 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:39.997+0000 7fba5ffff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fba60156db0 0x7fba60158500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.71:48632/0 (socket says 172.21.15.71:48632) 2023-10-06T01:40:40.000 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:39.997+0000 7fba5ffff700 1 -- 172.21.15.71:0/197219923 learned_addr learned my addr 172.21.15.71:0/197219923 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:40.000 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:39.997+0000 7fba5effd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fba600cd350 0x7fba601566a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.71:40592/0 (socket says 172.21.15.71:40592) 2023-10-06T01:40:40.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:39.998+0000 7fba5ffff700 1 -- 172.21.15.71:0/197219923 >> v2:172.21.15.72:3300/0 conn(0x7fba60153ad0 msgr2=0x7fba600cce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:40.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:39.998+0000 7fba5ffff700 1 --2- 172.21.15.71:0/197219923 >> v2:172.21.15.72:3300/0 conn(0x7fba60153ad0 0x7fba600cce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:40.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:39.998+0000 7fba5ffff700 1 -- 172.21.15.71:0/197219923 >> v1:172.21.15.72:6789/0 conn(0x7fba600cd350 legacy=0x7fba601566a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:40.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:39.998+0000 7fba5ffff700 1 -- 172.21.15.71:0/197219923 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba60157780 con 0x7fba60156db0 2023-10-06T01:40:40.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:39.998+0000 7fba5f7fe700 1 --2- 172.21.15.71:0/197219923 >> v2:172.21.15.72:3300/0 conn(0x7fba60153ad0 0x7fba600cce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:40:40.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:39.998+0000 7fba5ffff700 1 --2- 172.21.15.71:0/197219923 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fba60156db0 0x7fba60158500 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fba580099b0 tx=0x7fba58009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46ff8a0649804728 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:40.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:39.998+0000 7fba5e7fc700 1 -- 172.21.15.71:0/197219923 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba58009ea0 con 0x7fba60156db0 2023-10-06T01:40:40.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:39.998+0000 7fba5e7fc700 1 -- 172.21.15.71:0/197219923 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba5800b860 con 0x7fba60156db0 2023-10-06T01:40:40.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:39.998+0000 7fba5e7fc700 1 -- 172.21.15.71:0/197219923 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba5800bc00 con 0x7fba60156db0 2023-10-06T01:40:40.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:39.999+0000 7fba6482d700 1 -- 172.21.15.71:0/197219923 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fba60156db0 msgr2=0x7fba60158500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:40.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:39.999+0000 7fba6482d700 1 --2- 172.21.15.71:0/197219923 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fba60156db0 0x7fba60158500 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fba580099b0 tx=0x7fba58009250 comp rx=0 tx=0).stop 2023-10-06T01:40:40.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:39.999+0000 7fba6482d700 1 -- 172.21.15.71:0/197219923 shutdown_connections 2023-10-06T01:40:40.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:39.999+0000 7fba6482d700 1 --2- 172.21.15.71:0/197219923 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fba60156db0 0x7fba60158500 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:40.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:39.999+0000 7fba6482d700 1 --2- 172.21.15.71:0/197219923 >> v2:172.21.15.72:3300/0 conn(0x7fba60153ad0 0x7fba600cce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:40.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:39.999+0000 7fba6482d700 1 -- 172.21.15.71:0/197219923 >> 172.21.15.71:0/197219923 conn(0x7fba6006b320 msgr2=0x7fba6006b720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:40.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:39.999+0000 7fba6482d700 1 -- 172.21.15.71:0/197219923 shutdown_connections 2023-10-06T01:40:40.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:39.999+0000 7fba6482d700 1 -- 172.21.15.71:0/197219923 wait complete. 2023-10-06T01:40:40.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.000+0000 7fba6482d700 1 Processor -- start 2023-10-06T01:40:40.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.000+0000 7fba6482d700 1 -- start start 2023-10-06T01:40:40.006 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.001+0000 7fba6482d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba600cd350 0x7fba60138a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:40.006 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.001+0000 7fba6482d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba60153ad0 0x7fba600c7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:40.006 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.001+0000 7fba6482d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fba60156db0 0x7fba60068680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:40.006 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.001+0000 7fba6482d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba60138fb0 con 0x7fba60153ad0 2023-10-06T01:40:40.006 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.001+0000 7fba6482d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba600c7fd0 con 0x7fba600cd350 2023-10-06T01:40:40.006 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.001+0000 7fba6482d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba600c82b0 con 0x7fba60156db0 2023-10-06T01:40:40.006 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.001+0000 7fba5effd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba60153ad0 0x7fba600c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:40.007 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.001+0000 7fba5effd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba60153ad0 0x7fba600c7550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47198/0 (socket says 172.21.15.71:47198) 2023-10-06T01:40:40.007 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.001+0000 7fba5effd700 1 -- 172.21.15.71:0/1371867220 learned_addr learned my addr 172.21.15.71:0/1371867220 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:40.007 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.001+0000 7fba5ffff700 1 --2- 172.21.15.71:0/1371867220 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fba60156db0 0x7fba60068680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:40.007 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.001+0000 7fba5f7fe700 1 --2- 172.21.15.71:0/1371867220 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba600cd350 0x7fba60138a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:40.007 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.001+0000 7fba5effd700 1 -- 172.21.15.71:0/1371867220 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fba60156db0 msgr2=0x7fba60068680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:40.007 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.001+0000 7fba5effd700 1 --2- 172.21.15.71:0/1371867220 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fba60156db0 0x7fba60068680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:40.007 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.001+0000 7fba5effd700 1 -- 172.21.15.71:0/1371867220 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba600cd350 msgr2=0x7fba60138a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:40.007 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.001+0000 7fba5effd700 1 --2- 172.21.15.71:0/1371867220 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba600cd350 0x7fba60138a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:40.007 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.001+0000 7fba5effd700 1 -- 172.21.15.71:0/1371867220 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba50009a20 con 0x7fba60153ad0 2023-10-06T01:40:40.007 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.001+0000 7fba5effd700 1 --2- 172.21.15.71:0/1371867220 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba60153ad0 0x7fba600c7550 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fba5400c7c0 tx=0x7fba54007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:40.007 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.001+0000 7fba477fe700 1 -- 172.21.15.71:0/1371867220 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba54005a70 con 0x7fba60153ad0 2023-10-06T01:40:40.008 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.001+0000 7fba477fe700 1 -- 172.21.15.71:0/1371867220 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba54005bd0 con 0x7fba60153ad0 2023-10-06T01:40:40.008 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.001+0000 7fba6482d700 1 -- 172.21.15.71:0/1371867220 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba580094f0 con 0x7fba60153ad0 2023-10-06T01:40:40.008 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.001+0000 7fba477fe700 1 -- 172.21.15.71:0/1371867220 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba540070d0 con 0x7fba60153ad0 2023-10-06T01:40:40.008 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.001+0000 7fba6482d700 1 -- 172.21.15.71:0/1371867220 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba600c8870 con 0x7fba60153ad0 2023-10-06T01:40:40.008 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.002+0000 7fba6482d700 1 -- 172.21.15.71:0/1371867220 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba6006e820 con 0x7fba60153ad0 2023-10-06T01:40:40.008 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.003+0000 7fba477fe700 1 -- 172.21.15.71:0/1371867220 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fba54007480 con 0x7fba60153ad0 2023-10-06T01:40:40.008 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.003+0000 7fba477fe700 1 --2- 172.21.15.71:0/1371867220 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fba4c066f30 0x7fba4c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:40.008 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.003+0000 7fba477fe700 1 -- 172.21.15.71:0/1371867220 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fba54083e10 con 0x7fba60153ad0 2023-10-06T01:40:40.008 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.003+0000 7fba5f7fe700 1 --2- 172.21.15.71:0/1371867220 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fba4c066f30 0x7fba4c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:40.008 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.003+0000 7fba5f7fe700 1 --2- 172.21.15.71:0/1371867220 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fba4c066f30 0x7fba4c0693e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fba50009fd0 tx=0x7fba5000b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:40.009 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.007+0000 7fba477fe700 1 -- 172.21.15.71:0/1371867220 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fba54087030 con 0x7fba60153ad0 2023-10-06T01:40:40.234 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.233+0000 7fba6482d700 1 -- 172.21.15.71:0/1371867220 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fba600c8a00 con 0x7fba60153ad0 2023-10-06T01:40:40.235 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.233+0000 7fba477fe700 1 -- 172.21.15.71:0/1371867220 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4590 (secure 0 0 0) 0x7fba54017020 con 0x7fba60153ad0 2023-10-06T01:40:40.235 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:40:40.235 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6836/274053969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":274053969},{"type":"v1","addr":"172.21.15.71:6836","nonce":274053969}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/4158221694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6835","nonce":4158221694},{"type":"v1","addr":"172.21.15.71:6837","nonce":4158221694}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/1094581488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":1094581488},{"type":"v1","addr":"172.21.15.72:6835","nonce":1094581488}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T01:40:21.151426+0000","modified":"2023-10-06T01:40:39.857922+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4315},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4315":{"gid":4315,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6834/2361644634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6833","nonce":2361644634},{"type":"v1","addr":"172.21.15.72:6834","nonce":2361644634}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T01:40:40.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.235+0000 7fba6482d700 1 -- 172.21.15.71:0/1371867220 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fba4c066f30 msgr2=0x7fba4c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:40.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.235+0000 7fba6482d700 1 --2- 172.21.15.71:0/1371867220 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fba4c066f30 0x7fba4c0693e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fba50009fd0 tx=0x7fba5000b040 comp rx=0 tx=0).stop 2023-10-06T01:40:40.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.235+0000 7fba6482d700 1 -- 172.21.15.71:0/1371867220 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba60153ad0 msgr2=0x7fba600c7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:40.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.235+0000 7fba6482d700 1 --2- 172.21.15.71:0/1371867220 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba60153ad0 0x7fba600c7550 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fba5400c7c0 tx=0x7fba54007f70 comp rx=0 tx=0).stop 2023-10-06T01:40:40.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.235+0000 7fba6482d700 1 -- 172.21.15.71:0/1371867220 shutdown_connections 2023-10-06T01:40:40.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.235+0000 7fba6482d700 1 --2- 172.21.15.71:0/1371867220 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fba60156db0 0x7fba60068680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:40.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.235+0000 7fba6482d700 1 --2- 172.21.15.71:0/1371867220 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fba4c066f30 0x7fba4c0693e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:40.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.235+0000 7fba6482d700 1 --2- 172.21.15.71:0/1371867220 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba600cd350 0x7fba60138a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:40.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.235+0000 7fba6482d700 1 --2- 172.21.15.71:0/1371867220 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba60153ad0 0x7fba600c7550 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:40.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.235+0000 7fba6482d700 1 -- 172.21.15.71:0/1371867220 >> 172.21.15.71:0/1371867220 conn(0x7fba6006b320 msgr2=0x7fba600aff60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:40.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.235+0000 7fba6482d700 1 -- 172.21.15.71:0/1371867220 shutdown_connections 2023-10-06T01:40:40.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.235+0000 7fba6482d700 1 -- 172.21.15.71:0/1371867220 wait complete. 2023-10-06T01:40:40.238 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 9 2023-10-06T01:40:40.249 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:40:40.362 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.361+0000 7f939bd80700 1 Processor -- start 2023-10-06T01:40:40.363 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.361+0000 7f939bd80700 1 -- start start 2023-10-06T01:40:40.366 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.362+0000 7f939bd80700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f939415b3c0 0x7f9394097d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:40.366 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.362+0000 7f939bd80700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f93940b3c50 0x7f939415b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:40.366 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.362+0000 7f939bd80700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93940afb90 con 0x7f939415bcd0 2023-10-06T01:40:40.366 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.362+0000 7f939bd80700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93940b2310 con 0x7f939415b3c0 2023-10-06T01:40:40.366 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.362+0000 7f939bd80700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93940b25f0 con 0x7f93940b3c50 2023-10-06T01:40:40.366 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.362+0000 7f9399b1c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f939415b3c0 0x7f9394097d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:40.366 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.362+0000 7f9399b1c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f939415b3c0 0x7f9394097d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47208/0 (socket says 172.21.15.71:47208) 2023-10-06T01:40:40.367 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.362+0000 7f9399b1c700 1 -- 172.21.15.71:0/1458207439 learned_addr learned my addr 172.21.15.71:0/1458207439 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:40.367 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.362+0000 7f939931b700 1 --2- 172.21.15.71:0/1458207439 >> v2:172.21.15.72:3300/0 conn(0x7f93940b3c50 0x7f939415b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:40.367 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.362+0000 7f9399b1c700 1 -- 172.21.15.71:0/1458207439 >> v2:172.21.15.72:3300/0 conn(0x7f93940b3c50 msgr2=0x7f939415b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:40.367 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.362+0000 7f9399b1c700 1 --2- 172.21.15.71:0/1458207439 >> v2:172.21.15.72:3300/0 conn(0x7f93940b3c50 0x7f939415b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:40.367 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.362+0000 7f9399b1c700 1 -- 172.21.15.71:0/1458207439 >> v1:172.21.15.72:6789/0 conn(0x7f939415bcd0 legacy=0x7f939415a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:40.367 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.362+0000 7f9399b1c700 1 -- 172.21.15.71:0/1458207439 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93940af820 con 0x7f939415b3c0 2023-10-06T01:40:40.367 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.362+0000 7f939931b700 1 --2- 172.21.15.71:0/1458207439 >> v2:172.21.15.72:3300/0 conn(0x7f93940b3c50 0x7f939415b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:40:40.367 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.362+0000 7f9399b1c700 1 --2- 172.21.15.71:0/1458207439 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f939415b3c0 0x7f9394097d70 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f939406f9c0 tx=0x7f9390009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=934388ce208cada server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:40.367 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.362+0000 7f9398b1a700 1 -- 172.21.15.71:0/1458207439 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9390005c10 con 0x7f939415b3c0 2023-10-06T01:40:40.368 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.362+0000 7f9398b1a700 1 -- 172.21.15.71:0/1458207439 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9390005d70 con 0x7f939415b3c0 2023-10-06T01:40:40.368 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.362+0000 7f9398b1a700 1 -- 172.21.15.71:0/1458207439 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f939000b860 con 0x7f939415b3c0 2023-10-06T01:40:40.368 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.363+0000 7f939bd80700 1 -- 172.21.15.71:0/1458207439 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f939415b3c0 msgr2=0x7f9394097d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:40.368 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.363+0000 7f939bd80700 1 --2- 172.21.15.71:0/1458207439 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f939415b3c0 0x7f9394097d70 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f939406f9c0 tx=0x7f9390009220 comp rx=0 tx=0).stop 2023-10-06T01:40:40.368 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.363+0000 7f939bd80700 1 -- 172.21.15.71:0/1458207439 shutdown_connections 2023-10-06T01:40:40.368 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.363+0000 7f939bd80700 1 --2- 172.21.15.71:0/1458207439 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f939415b3c0 0x7f9394097d70 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:40.368 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.363+0000 7f939bd80700 1 --2- 172.21.15.71:0/1458207439 >> v2:172.21.15.72:3300/0 conn(0x7f93940b3c50 0x7f939415b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:40.368 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.363+0000 7f939bd80700 1 -- 172.21.15.71:0/1458207439 >> 172.21.15.71:0/1458207439 conn(0x7f9394067910 msgr2=0x7f93940ce160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:40.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.363+0000 7f939bd80700 1 -- 172.21.15.71:0/1458207439 shutdown_connections 2023-10-06T01:40:40.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.363+0000 7f939bd80700 1 -- 172.21.15.71:0/1458207439 wait complete. 2023-10-06T01:40:40.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.364+0000 7f939bd80700 1 Processor -- start 2023-10-06T01:40:40.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.364+0000 7f939bd80700 1 -- start start 2023-10-06T01:40:40.373 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.365+0000 7f939bd80700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93940b3c50 0x7f9394154430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:40.373 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.365+0000 7f939bd80700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f939415b3c0 0x7f9394167440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:40.373 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.365+0000 7f939bd80700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f939415bcd0 0x7f939409ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:40.373 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.365+0000 7f939bd80700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93940c36d0 con 0x7f93940b3c50 2023-10-06T01:40:40.373 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.365+0000 7f939bd80700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9394154970 con 0x7f939415b3c0 2023-10-06T01:40:40.373 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.365+0000 7f939bd80700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9394167f10 con 0x7f939415bcd0 2023-10-06T01:40:40.373 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.365+0000 7f9399b1c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93940b3c50 0x7f9394154430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:40.373 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.365+0000 7f9399b1c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93940b3c50 0x7f9394154430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47218/0 (socket says 172.21.15.71:47218) 2023-10-06T01:40:40.373 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.365+0000 7f9399b1c700 1 -- 172.21.15.71:0/3089604979 learned_addr learned my addr 172.21.15.71:0/3089604979 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:40.373 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.365+0000 7f939931b700 1 --2- 172.21.15.71:0/3089604979 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f939415b3c0 0x7f9394167440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:40.374 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.365+0000 7f939a31d700 1 --2- 172.21.15.71:0/3089604979 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f939415bcd0 0x7f939409ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:40.374 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.365+0000 7f9399b1c700 1 -- 172.21.15.71:0/3089604979 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f939415bcd0 msgr2=0x7f939409ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:40.374 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.365+0000 7f9399b1c700 1 --2- 172.21.15.71:0/3089604979 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f939415bcd0 0x7f939409ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:40.374 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.365+0000 7f9399b1c700 1 -- 172.21.15.71:0/3089604979 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f939415b3c0 msgr2=0x7f9394167440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:40.374 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.365+0000 7f9399b1c700 1 --2- 172.21.15.71:0/3089604979 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f939415b3c0 0x7f9394167440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:40.374 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.365+0000 7f9399b1c700 1 -- 172.21.15.71:0/3089604979 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9390009480 con 0x7f93940b3c50 2023-10-06T01:40:40.374 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.365+0000 7f9399b1c700 1 --2- 172.21.15.71:0/3089604979 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93940b3c50 0x7f9394154430 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9390002000 tx=0x7f9390015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:40.374 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.365+0000 7f9389ffb700 1 -- 172.21.15.71:0/3089604979 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9390011a10 con 0x7f93940b3c50 2023-10-06T01:40:40.374 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.365+0000 7f9389ffb700 1 -- 172.21.15.71:0/3089604979 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9390011b90 con 0x7f93940b3c50 2023-10-06T01:40:40.374 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.365+0000 7f939bd80700 1 -- 172.21.15.71:0/3089604979 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93941681f0 con 0x7f93940b3c50 2023-10-06T01:40:40.374 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.365+0000 7f9389ffb700 1 -- 172.21.15.71:0/3089604979 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f939001c420 con 0x7f93940b3c50 2023-10-06T01:40:40.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.366+0000 7f939bd80700 1 -- 172.21.15.71:0/3089604979 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9394168580 con 0x7f93940b3c50 2023-10-06T01:40:40.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.366+0000 7f939bd80700 1 -- 172.21.15.71:0/3089604979 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f939406dce0 con 0x7f93940b3c50 2023-10-06T01:40:40.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.367+0000 7f9389ffb700 1 -- 172.21.15.71:0/3089604979 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f939001c810 con 0x7f93940b3c50 2023-10-06T01:40:40.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.367+0000 7f9389ffb700 1 --2- 172.21.15.71:0/3089604979 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f9378066f60 0x7f9378069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:40.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.367+0000 7f9389ffb700 1 -- 172.21.15.71:0/3089604979 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f9390086680 con 0x7f93940b3c50 2023-10-06T01:40:40.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.367+0000 7f939931b700 1 --2- 172.21.15.71:0/3089604979 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f9378066f60 0x7f9378069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:40.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.368+0000 7f939931b700 1 --2- 172.21.15.71:0/3089604979 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f9378066f60 0x7f9378069410 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9394157c10 tx=0x7f9384008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:40.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.371+0000 7f9389ffb700 1 -- 172.21.15.71:0/3089604979 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9390053400 con 0x7f93940b3c50 2023-10-06T01:40:40.558 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.556+0000 7f939bd80700 1 -- 172.21.15.71:0/3089604979 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f939406e8d0 con 0x7f93940b3c50 2023-10-06T01:40:40.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.557+0000 7f9389ffb700 1 -- 172.21.15.71:0/3089604979 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18659 (secure 0 0 0) 0x7f9390056a20 con 0x7f93940b3c50 2023-10-06T01:40:40.559 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:40:40.559 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":27,"fsid":"1fbf1bd2-f9b4-4599-bea2-f4aa920e9a56","created":"2023-10-06T01:39:57.016957+0000","modified":"2023-10-06T01:40:26.202441+0000","last_up_change":"2023-10-06T01:40:08.571643+0000","last_in_change":"2023-10-06T01:39:59.462741+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T01:40:08.610349+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T01:40:15.387434+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T01:40:19.640459+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T01:40:20.116883+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T01:40:23.830129+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cf059188-fb20-4dbf-95db-dcf57b213d03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":90670},{"type":"v1","addr":"172.21.15.71:6817","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":90670},{"type":"v1","addr":"172.21.15.71:6819","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":90670},{"type":"v1","addr":"172.21.15.71:6823","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":90670},{"type":"v1","addr":"172.21.15.71:6821","nonce":90670}]},"public_addr":"172.21.15.71:6817/90670","cluster_addr":"172.21.15.71:6819/90670","heartbeat_back_addr":"172.21.15.71:6823/90670","heartbeat_front_addr":"172.21.15.71:6821/90670","state":["exists","up"]},{"osd":1,"uuid":"0cff0aae-1799-4fe0-b610-54cf0813c0e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":90669},{"type":"v1","addr":"172.21.15.71:6809","nonce":90669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":90669},{"type":"v1","addr":"172.21.15.71:6811","nonce":90669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":90669},{"type":"v1","addr":"172.21.15.71:6815","nonce":90669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":90669},{"type":"v1","addr":"172.21.15.71:6813","nonce":90669}]},"public_addr":"172.21.15.71:6809/90669","cluster_addr":"172.21.15.71:6811/90669","heartbeat_back_addr":"172.21.15.71:6815/90669","heartbeat_front_addr":"172.21.15.71:6813/90669","state":["exists","up"]},{"osd":2,"uuid":"88d61ddc-9031-44e1-ba8c-546a41e7c8ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":90679},{"type":"v1","addr":"172.21.15.71:6825","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":90679},{"type":"v1","addr":"172.21.15.71:6827","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":90679},{"type":"v1","addr":"172.21.15.71:6831","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":90679},{"type":"v1","addr":"172.21.15.71:6829","nonce":90679}]},"public_addr":"172.21.15.71:6825/90679","cluster_addr":"172.21.15.71:6827/90679","heartbeat_back_addr":"172.21.15.71:6831/90679","heartbeat_front_addr":"172.21.15.71:6829/90679","state":["exists","up"]},{"osd":3,"uuid":"11ed92b7-960b-4a30-a889-a61d3eeb86f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":90668},{"type":"v1","addr":"172.21.15.71:6801","nonce":90668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":90668},{"type":"v1","addr":"172.21.15.71:6803","nonce":90668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":90668},{"type":"v1","addr":"172.21.15.71:6807","nonce":90668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":90668},{"type":"v1","addr":"172.21.15.71:6805","nonce":90668}]},"public_addr":"172.21.15.71:6801/90668","cluster_addr":"172.21.15.71:6803/90668","heartbeat_back_addr":"172.21.15.71:6807/90668","heartbeat_front_addr":"172.21.15.71:6805/90668","state":["exists","up"]},{"osd":4,"uuid":"ae4df784-abdf-4ddf-aefa-780f3ddafef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":90917},{"type":"v1","addr":"172.21.15.72:6801","nonce":90917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":90917},{"type":"v1","addr":"172.21.15.72:6803","nonce":90917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":90917},{"type":"v1","addr":"172.21.15.72:6807","nonce":90917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":90917},{"type":"v1","addr":"172.21.15.72:6805","nonce":90917}]},"public_addr":"172.21.15.72:6801/90917","cluster_addr":"172.21.15.72:6803/90917","heartbeat_back_addr":"172.21.15.72:6807/90917","heartbeat_front_addr":"172.21.15.72:6805/90917","state":["exists","up"]},{"osd":5,"uuid":"5ef0790f-001e-458f-a05b-efae216cf435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":90941},{"type":"v1","addr":"172.21.15.72:6817","nonce":90941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":90941},{"type":"v1","addr":"172.21.15.72:6819","nonce":90941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":90941},{"type":"v1","addr":"172.21.15.72:6827","nonce":90941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":90941},{"type":"v1","addr":"172.21.15.72:6823","nonce":90941}]},"public_addr":"172.21.15.72:6817/90941","cluster_addr":"172.21.15.72:6819/90941","heartbeat_back_addr":"172.21.15.72:6827/90941","heartbeat_front_addr":"172.21.15.72:6823/90941","state":["exists","up"]},{"osd":6,"uuid":"8705aef1-9ae8-4e54-a3c4-c2909fa0ceb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":90918},{"type":"v1","addr":"172.21.15.72:6809","nonce":90918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":90918},{"type":"v1","addr":"172.21.15.72:6811","nonce":90918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":90918},{"type":"v1","addr":"172.21.15.72:6815","nonce":90918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":90918},{"type":"v1","addr":"172.21.15.72:6813","nonce":90918}]},"public_addr":"172.21.15.72:6809/90918","cluster_addr":"172.21.15.72:6811/90918","heartbeat_back_addr":"172.21.15.72:6815/90918","heartbeat_front_addr":"172.21.15.72:6813/90918","state":["exists","up"]},{"osd":7,"uuid":"364c5119-6b13-4c75-b3f0-15e165eff86a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":90948},{"type":"v1","addr":"172.21.15.72:6822","nonce":90948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":90948},{"type":"v1","addr":"172.21.15.72:6826","nonce":90948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":90948},{"type":"v1","addr":"172.21.15.72:6831","nonce":90948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":90948},{"type":"v1","addr":"172.21.15.72:6829","nonce":90948}]},"public_addr":"172.21.15.72:6822/90948","cluster_addr":"172.21.15.72:6826/90948","heartbeat_back_addr":"172.21.15.72:6831/90948","heartbeat_front_addr":"172.21.15.72:6829/90948","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.642976+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.645372+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.619116+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.663042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.599163+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.646411+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.631545+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.669821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:40:40.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.559+0000 7f939bd80700 1 -- 172.21.15.71:0/3089604979 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f9378066f60 msgr2=0x7f9378069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:40.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.559+0000 7f939bd80700 1 --2- 172.21.15.71:0/3089604979 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f9378066f60 0x7f9378069410 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9394157c10 tx=0x7f9384008040 comp rx=0 tx=0).stop 2023-10-06T01:40:40.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.559+0000 7f939bd80700 1 -- 172.21.15.71:0/3089604979 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93940b3c50 msgr2=0x7f9394154430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:40.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.559+0000 7f939bd80700 1 --2- 172.21.15.71:0/3089604979 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93940b3c50 0x7f9394154430 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9390002000 tx=0x7f9390015000 comp rx=0 tx=0).stop 2023-10-06T01:40:40.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.559+0000 7f939bd80700 1 -- 172.21.15.71:0/3089604979 shutdown_connections 2023-10-06T01:40:40.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.559+0000 7f939bd80700 1 --2- 172.21.15.71:0/3089604979 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f939415bcd0 0x7f939409ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:40.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.559+0000 7f939bd80700 1 --2- 172.21.15.71:0/3089604979 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93940b3c50 0x7f9394154430 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:40.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.559+0000 7f939bd80700 1 --2- 172.21.15.71:0/3089604979 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f9378066f60 0x7f9378069410 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:40.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.559+0000 7f939bd80700 1 --2- 172.21.15.71:0/3089604979 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f939415b3c0 0x7f9394167440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:40.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.559+0000 7f939bd80700 1 -- 172.21.15.71:0/3089604979 >> 172.21.15.71:0/3089604979 conn(0x7f9394067910 msgr2=0x7f9394155390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:40.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.559+0000 7f939bd80700 1 -- 172.21.15.71:0/3089604979 shutdown_connections 2023-10-06T01:40:40.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.560+0000 7f939bd80700 1 -- 172.21.15.71:0/3089604979 wait complete. 2023-10-06T01:40:40.573 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T01:40:40.574 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T01:40:40.687 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.686+0000 7f7f89094700 1 Processor -- start 2023-10-06T01:40:40.687 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.686+0000 7f7f89094700 1 -- start start 2023-10-06T01:40:40.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.686+0000 7f7f89094700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7f840af4e0 0x7f7f840b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:40.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.686+0000 7f7f89094700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f8415db70 0x7f7f840b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:40.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.686+0000 7f7f89094700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f8415e190 con 0x7f7f840af8b0 2023-10-06T01:40:40.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.686+0000 7f7f89094700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f840b1910 con 0x7f7f840af4e0 2023-10-06T01:40:40.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.686+0000 7f7f89094700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f8415dfa0 con 0x7f7f8415db70 2023-10-06T01:40:40.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.687+0000 7f7f8359e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f8415db70 0x7f7f840b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:40.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.687+0000 7f7f8359e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f8415db70 0x7f7f840b2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.71:48650/0 (socket says 172.21.15.71:48650) 2023-10-06T01:40:40.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.687+0000 7f7f8359e700 1 -- 172.21.15.71:0/3194100076 learned_addr learned my addr 172.21.15.71:0/3194100076 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:40.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.687+0000 7f7f82d9d700 1 --2- 172.21.15.71:0/3194100076 >> v2:172.21.15.72:3300/0 conn(0x7f7f840af4e0 0x7f7f840b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:40.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.687+0000 7f7f8359e700 1 -- 172.21.15.71:0/3194100076 >> v2:172.21.15.72:3300/0 conn(0x7f7f840af4e0 msgr2=0x7f7f840b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:40.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.687+0000 7f7f8359e700 1 --2- 172.21.15.71:0/3194100076 >> v2:172.21.15.72:3300/0 conn(0x7f7f840af4e0 0x7f7f840b20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:40.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.687+0000 7f7f8359e700 1 -- 172.21.15.71:0/3194100076 >> v1:172.21.15.72:6789/0 conn(0x7f7f840af8b0 legacy=0x7f7f8415d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:40.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.687+0000 7f7f8359e700 1 -- 172.21.15.71:0/3194100076 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f840cb650 con 0x7f7f8415db70 2023-10-06T01:40:40.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.687+0000 7f7f8359e700 1 --2- 172.21.15.71:0/3194100076 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f8415db70 0x7f7f840b2620 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c009f20 tx=0x7f7f7c009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8f25ed29c987ef5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:40.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.687+0000 7f7f8259c700 1 -- 172.21.15.71:0/3194100076 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f7c00e070 con 0x7f7f8415db70 2023-10-06T01:40:40.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.688+0000 7f7f8259c700 1 -- 172.21.15.71:0/3194100076 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f7c00b9d0 con 0x7f7f8415db70 2023-10-06T01:40:40.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.688+0000 7f7f8259c700 1 -- 172.21.15.71:0/3194100076 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f7c0092e0 con 0x7f7f8415db70 2023-10-06T01:40:40.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.688+0000 7f7f89094700 1 -- 172.21.15.71:0/3194100076 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f8415db70 msgr2=0x7f7f840b2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:40.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.688+0000 7f7f89094700 1 --2- 172.21.15.71:0/3194100076 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f8415db70 0x7f7f840b2620 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c009f20 tx=0x7f7f7c009840 comp rx=0 tx=0).stop 2023-10-06T01:40:40.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.688+0000 7f7f89094700 1 -- 172.21.15.71:0/3194100076 shutdown_connections 2023-10-06T01:40:40.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.688+0000 7f7f89094700 1 --2- 172.21.15.71:0/3194100076 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f8415db70 0x7f7f840b2620 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:40.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.688+0000 7f7f89094700 1 --2- 172.21.15.71:0/3194100076 >> v2:172.21.15.72:3300/0 conn(0x7f7f840af4e0 0x7f7f840b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:40.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.688+0000 7f7f89094700 1 -- 172.21.15.71:0/3194100076 >> 172.21.15.71:0/3194100076 conn(0x7f7f84068680 msgr2=0x7f7f84068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:40.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.688+0000 7f7f89094700 1 -- 172.21.15.71:0/3194100076 shutdown_connections 2023-10-06T01:40:40.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.688+0000 7f7f89094700 1 -- 172.21.15.71:0/3194100076 wait complete. 2023-10-06T01:40:40.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.689+0000 7f7f89094700 1 Processor -- start 2023-10-06T01:40:40.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.689+0000 7f7f89094700 1 -- start start 2023-10-06T01:40:40.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.690+0000 7f7f89094700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f840af4e0 0x7f7f840cdef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:40.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.690+0000 7f7f89094700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f840af8b0 0x7f7f84150b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:40.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.690+0000 7f7f89094700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7f8415db70 0x7f7f841566b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:40.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.690+0000 7f7f89094700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f840c8e70 con 0x7f7f8415db70 2023-10-06T01:40:40.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.690+0000 7f7f89094700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f84156f60 con 0x7f7f840af4e0 2023-10-06T01:40:40.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.690+0000 7f7f89094700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f840c9110 con 0x7f7f840af8b0 2023-10-06T01:40:40.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.690+0000 7f7f8359e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7f8415db70 0x7f7f841566b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:40.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.690+0000 7f7f8359e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7f8415db70 0x7f7f841566b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47226/0 (socket says 172.21.15.71:47226) 2023-10-06T01:40:40.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.690+0000 7f7f8359e700 1 -- 172.21.15.71:0/1680071277 learned_addr learned my addr 172.21.15.71:0/1680071277 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:40.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.690+0000 7f7f7a59c700 1 --2- 172.21.15.71:0/1680071277 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f840af8b0 0x7f7f84150b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:40.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.690+0000 7f7f82d9d700 1 --2- 172.21.15.71:0/1680071277 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f840af4e0 0x7f7f840cdef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:40.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.691+0000 7f7f8359e700 1 -- 172.21.15.71:0/1680071277 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f840af8b0 msgr2=0x7f7f84150b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:40.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.691+0000 7f7f8359e700 1 --2- 172.21.15.71:0/1680071277 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f840af8b0 0x7f7f84150b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:40.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.691+0000 7f7f8359e700 1 -- 172.21.15.71:0/1680071277 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f840af4e0 msgr2=0x7f7f840cdef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:40.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.691+0000 7f7f8359e700 1 --2- 172.21.15.71:0/1680071277 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f840af4e0 0x7f7f840cdef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:40.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.691+0000 7f7f8359e700 1 -- 172.21.15.71:0/1680071277 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f7c009ae0 con 0x7f7f8415db70 2023-10-06T01:40:40.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.691+0000 7f7f8359e700 1 --2- 172.21.15.71:0/1680071277 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7f8415db70 0x7f7f841566b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7f840ca820 tx=0x7f7f7c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:40.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.691+0000 7f7f7b7fe700 1 -- 172.21.15.71:0/1680071277 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f7c007b00 con 0x7f7f8415db70 2023-10-06T01:40:40.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.691+0000 7f7f7b7fe700 1 -- 172.21.15.71:0/1680071277 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f7c007ca0 con 0x7f7f8415db70 2023-10-06T01:40:40.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.691+0000 7f7f89094700 1 -- 172.21.15.71:0/1680071277 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f840c93f0 con 0x7f7f8415db70 2023-10-06T01:40:40.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.691+0000 7f7f7b7fe700 1 -- 172.21.15.71:0/1680071277 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f7c01e680 con 0x7f7f8415db70 2023-10-06T01:40:40.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.691+0000 7f7f89094700 1 -- 172.21.15.71:0/1680071277 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f84157240 con 0x7f7f8415db70 2023-10-06T01:40:40.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.692+0000 7f7f89094700 1 -- 172.21.15.71:0/1680071277 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f840c95e0 con 0x7f7f8415db70 2023-10-06T01:40:40.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.692+0000 7f7f7b7fe700 1 -- 172.21.15.71:0/1680071277 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7f7c003040 con 0x7f7f8415db70 2023-10-06T01:40:40.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.693+0000 7f7f7b7fe700 1 --2- 172.21.15.71:0/1680071277 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7f64066f30 0x7f7f640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:40.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.693+0000 7f7f82d9d700 1 --2- 172.21.15.71:0/1680071277 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7f64066f30 0x7f7f640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:40.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.693+0000 7f7f7b7fe700 1 -- 172.21.15.71:0/1680071277 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f7f7c086a80 con 0x7f7f8415db70 2023-10-06T01:40:40.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.693+0000 7f7f82d9d700 1 --2- 172.21.15.71:0/1680071277 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7f64066f30 0x7f7f640693e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7f74009d10 tx=0x7f7f740091a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:40.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.697+0000 7f7f7b7fe700 1 -- 172.21.15.71:0/1680071277 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7f7c0538a0 con 0x7f7f8415db70 2023-10-06T01:40:40.883 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.881+0000 7f7f89094700 1 -- 172.21.15.71:0/1680071277 --> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7f840b0f90 con 0x7f7f64066f30 2023-10-06T01:40:40.893 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.891+0000 7f7f7b7fe700 1 -- 172.21.15.71:0/1680071277 <== mgr.4107 v2:172.21.15.71:6832/90436 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367316 (secure 0 0 0) 0x7f7f840b0f90 con 0x7f7f64066f30 2023-10-06T01:40:40.899 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:40:40.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.895+0000 7f7f89094700 1 -- 172.21.15.71:0/1680071277 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7f64066f30 msgr2=0x7f7f640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:40.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.895+0000 7f7f89094700 1 --2- 172.21.15.71:0/1680071277 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7f64066f30 0x7f7f640693e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7f74009d10 tx=0x7f7f740091a0 comp rx=0 tx=0).stop 2023-10-06T01:40:40.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.895+0000 7f7f89094700 1 -- 172.21.15.71:0/1680071277 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7f8415db70 msgr2=0x7f7f841566b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:40.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.895+0000 7f7f89094700 1 --2- 172.21.15.71:0/1680071277 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7f8415db70 0x7f7f841566b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7f840ca820 tx=0x7f7f7c018000 comp rx=0 tx=0).stop 2023-10-06T01:40:40.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.895+0000 7f7f89094700 1 -- 172.21.15.71:0/1680071277 shutdown_connections 2023-10-06T01:40:40.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.895+0000 7f7f89094700 1 --2- 172.21.15.71:0/1680071277 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7f8415db70 0x7f7f841566b0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:40.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.895+0000 7f7f89094700 1 --2- 172.21.15.71:0/1680071277 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7f64066f30 0x7f7f640693e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:40.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.895+0000 7f7f89094700 1 --2- 172.21.15.71:0/1680071277 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f840af4e0 0x7f7f840cdef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:40.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.895+0000 7f7f89094700 1 --2- 172.21.15.71:0/1680071277 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f840af8b0 0x7f7f84150b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:40.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.895+0000 7f7f89094700 1 -- 172.21.15.71:0/1680071277 >> 172.21.15.71:0/1680071277 conn(0x7f7f84068680 msgr2=0x7f7f8415a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:40.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.895+0000 7f7f89094700 1 -- 172.21.15.71:0/1680071277 shutdown_connections 2023-10-06T01:40:40.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:40.895+0000 7f7f89094700 1 -- 172.21.15.71:0/1680071277 wait complete. 2023-10-06T01:40:40.906 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2023-10-06T01:40:40.909 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2023-10-06T01:40:40.566547+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594852,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381796,"kb_used_data":3492,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752592924,"statfs":{"total":773094113280,"available":770655154176,"internally_reserved":0,"allocated":3575808,"data_stored":2145327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2178,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003090"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.827077+0000","last_change":"2023-10-06T01:40:21.784720+0000","last_active":"2023-10-06T01:40:25.827077+0000","last_peered":"2023-10-06T01:40:25.827077+0000","last_clean":"2023-10-06T01:40:25.827077+0000","last_became_active":"2023-10-06T01:40:21.784463+0000","last_became_peered":"2023-10-06T01:40:21.784463+0000","last_unstale":"2023-10-06T01:40:25.827077+0000","last_undegraded":"2023-10-06T01:40:25.827077+0000","last_fullsized":"2023-10-06T01:40:25.827077+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:06:11.014583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821980+0000","last_change":"2023-10-06T01:40:21.795765+0000","last_active":"2023-10-06T01:40:25.821980+0000","last_peered":"2023-10-06T01:40:25.821980+0000","last_clean":"2023-10-06T01:40:25.821980+0000","last_became_active":"2023-10-06T01:40:21.795508+0000","last_became_peered":"2023-10-06T01:40:21.795508+0000","last_unstale":"2023-10-06T01:40:25.821980+0000","last_undegraded":"2023-10-06T01:40:25.821980+0000","last_fullsized":"2023-10-06T01:40:25.821980+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:24:04.737047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.829737+0000","last_change":"2023-10-06T01:40:21.801764+0000","last_active":"2023-10-06T01:40:25.829737+0000","last_peered":"2023-10-06T01:40:25.829737+0000","last_clean":"2023-10-06T01:40:25.829737+0000","last_became_active":"2023-10-06T01:40:21.801511+0000","last_became_peered":"2023-10-06T01:40:21.801511+0000","last_unstale":"2023-10-06T01:40:25.829737+0000","last_undegraded":"2023-10-06T01:40:25.829737+0000","last_fullsized":"2023-10-06T01:40:25.829737+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:53:19.501226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.824060+0000","last_change":"2023-10-06T01:40:21.796935+0000","last_active":"2023-10-06T01:40:25.824060+0000","last_peered":"2023-10-06T01:40:25.824060+0000","last_clean":"2023-10-06T01:40:25.824060+0000","last_became_active":"2023-10-06T01:40:21.796664+0000","last_became_peered":"2023-10-06T01:40:21.796664+0000","last_unstale":"2023-10-06T01:40:25.824060+0000","last_undegraded":"2023-10-06T01:40:25.824060+0000","last_fullsized":"2023-10-06T01:40:25.824060+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:18:43.064747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.838848+0000","last_change":"2023-10-06T01:40:21.798926+0000","last_active":"2023-10-06T01:40:25.838848+0000","last_peered":"2023-10-06T01:40:25.838848+0000","last_clean":"2023-10-06T01:40:25.838848+0000","last_became_active":"2023-10-06T01:40:21.798342+0000","last_became_peered":"2023-10-06T01:40:21.798342+0000","last_unstale":"2023-10-06T01:40:25.838848+0000","last_undegraded":"2023-10-06T01:40:25.838848+0000","last_fullsized":"2023-10-06T01:40:25.838848+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:29:36.526509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.832097+0000","last_change":"2023-10-06T01:40:21.801493+0000","last_active":"2023-10-06T01:40:25.832097+0000","last_peered":"2023-10-06T01:40:25.832097+0000","last_clean":"2023-10-06T01:40:25.832097+0000","last_became_active":"2023-10-06T01:40:21.801200+0000","last_became_peered":"2023-10-06T01:40:21.801200+0000","last_unstale":"2023-10-06T01:40:25.832097+0000","last_undegraded":"2023-10-06T01:40:25.832097+0000","last_fullsized":"2023-10-06T01:40:25.832097+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:16:01.004830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.836158+0000","last_change":"2023-10-06T01:40:21.797032+0000","last_active":"2023-10-06T01:40:25.836158+0000","last_peered":"2023-10-06T01:40:25.836158+0000","last_clean":"2023-10-06T01:40:25.836158+0000","last_became_active":"2023-10-06T01:40:21.796712+0000","last_became_peered":"2023-10-06T01:40:21.796712+0000","last_unstale":"2023-10-06T01:40:25.836158+0000","last_undegraded":"2023-10-06T01:40:25.836158+0000","last_fullsized":"2023-10-06T01:40:25.836158+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:04.038873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821476+0000","last_change":"2023-10-06T01:40:21.791132+0000","last_active":"2023-10-06T01:40:25.821476+0000","last_peered":"2023-10-06T01:40:25.821476+0000","last_clean":"2023-10-06T01:40:25.821476+0000","last_became_active":"2023-10-06T01:40:21.790446+0000","last_became_peered":"2023-10-06T01:40:21.790446+0000","last_unstale":"2023-10-06T01:40:25.821476+0000","last_undegraded":"2023-10-06T01:40:25.821476+0000","last_fullsized":"2023-10-06T01:40:25.821476+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:40:45.624442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.839970+0000","last_change":"2023-10-06T01:40:21.793869+0000","last_active":"2023-10-06T01:40:25.839970+0000","last_peered":"2023-10-06T01:40:25.839970+0000","last_clean":"2023-10-06T01:40:25.839970+0000","last_became_active":"2023-10-06T01:40:21.793596+0000","last_became_peered":"2023-10-06T01:40:21.793596+0000","last_unstale":"2023-10-06T01:40:25.839970+0000","last_undegraded":"2023-10-06T01:40:25.839970+0000","last_fullsized":"2023-10-06T01:40:25.839970+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:24:04.737047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.822068+0000","last_change":"2023-10-06T01:40:21.798541+0000","last_active":"2023-10-06T01:40:25.822068+0000","last_peered":"2023-10-06T01:40:25.822068+0000","last_clean":"2023-10-06T01:40:25.822068+0000","last_became_active":"2023-10-06T01:40:21.798271+0000","last_became_peered":"2023-10-06T01:40:21.798271+0000","last_unstale":"2023-10-06T01:40:25.822068+0000","last_undegraded":"2023-10-06T01:40:25.822068+0000","last_fullsized":"2023-10-06T01:40:25.822068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:14:30.814494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.829653+0000","last_change":"2023-10-06T01:40:21.798043+0000","last_active":"2023-10-06T01:40:25.829653+0000","last_peered":"2023-10-06T01:40:25.829653+0000","last_clean":"2023-10-06T01:40:25.829653+0000","last_became_active":"2023-10-06T01:40:21.797768+0000","last_became_peered":"2023-10-06T01:40:21.797768+0000","last_unstale":"2023-10-06T01:40:25.829653+0000","last_undegraded":"2023-10-06T01:40:25.829653+0000","last_fullsized":"2023-10-06T01:40:25.829653+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:39:44.521327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.826805+0000","last_change":"2023-10-06T01:40:21.783366+0000","last_active":"2023-10-06T01:40:25.826805+0000","last_peered":"2023-10-06T01:40:25.826805+0000","last_clean":"2023-10-06T01:40:25.826805+0000","last_became_active":"2023-10-06T01:40:21.783102+0000","last_became_peered":"2023-10-06T01:40:21.783102+0000","last_unstale":"2023-10-06T01:40:25.826805+0000","last_undegraded":"2023-10-06T01:40:25.826805+0000","last_fullsized":"2023-10-06T01:40:25.826805+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:22:12.634757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.826660+0000","last_change":"2023-10-06T01:40:21.789603+0000","last_active":"2023-10-06T01:40:25.826660+0000","last_peered":"2023-10-06T01:40:25.826660+0000","last_clean":"2023-10-06T01:40:25.826660+0000","last_became_active":"2023-10-06T01:40:21.789423+0000","last_became_peered":"2023-10-06T01:40:21.789423+0000","last_unstale":"2023-10-06T01:40:25.826660+0000","last_undegraded":"2023-10-06T01:40:25.826660+0000","last_fullsized":"2023-10-06T01:40:25.826660+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:26:04.581987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821407+0000","last_change":"2023-10-06T01:40:21.786154+0000","last_active":"2023-10-06T01:40:25.821407+0000","last_peered":"2023-10-06T01:40:25.821407+0000","last_clean":"2023-10-06T01:40:25.821407+0000","last_became_active":"2023-10-06T01:40:21.785883+0000","last_became_peered":"2023-10-06T01:40:21.785883+0000","last_unstale":"2023-10-06T01:40:25.821407+0000","last_undegraded":"2023-10-06T01:40:25.821407+0000","last_fullsized":"2023-10-06T01:40:25.821407+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:58:41.783343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.835961+0000","last_change":"2023-10-06T01:40:21.794272+0000","last_active":"2023-10-06T01:40:25.835961+0000","last_peered":"2023-10-06T01:40:25.835961+0000","last_clean":"2023-10-06T01:40:25.835961+0000","last_became_active":"2023-10-06T01:40:21.794004+0000","last_became_peered":"2023-10-06T01:40:21.794004+0000","last_unstale":"2023-10-06T01:40:25.835961+0000","last_undegraded":"2023-10-06T01:40:25.835961+0000","last_fullsized":"2023-10-06T01:40:25.835961+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:14:30.814494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.830236+0000","last_change":"2023-10-06T01:40:21.799382+0000","last_active":"2023-10-06T01:40:25.830236+0000","last_peered":"2023-10-06T01:40:25.830236+0000","last_clean":"2023-10-06T01:40:25.830236+0000","last_became_active":"2023-10-06T01:40:21.799078+0000","last_became_peered":"2023-10-06T01:40:21.799078+0000","last_unstale":"2023-10-06T01:40:25.830236+0000","last_undegraded":"2023-10-06T01:40:25.830236+0000","last_fullsized":"2023-10-06T01:40:25.830236+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:09:24.820551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.840050+0000","last_change":"2023-10-06T01:40:21.793399+0000","last_active":"2023-10-06T01:40:25.840050+0000","last_peered":"2023-10-06T01:40:25.840050+0000","last_clean":"2023-10-06T01:40:25.840050+0000","last_became_active":"2023-10-06T01:40:21.793155+0000","last_became_peered":"2023-10-06T01:40:21.793155+0000","last_unstale":"2023-10-06T01:40:25.840050+0000","last_undegraded":"2023-10-06T01:40:25.840050+0000","last_fullsized":"2023-10-06T01:40:25.840050+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:58:41.783343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.827729+0000","last_change":"2023-10-06T01:40:21.796081+0000","last_active":"2023-10-06T01:40:25.827729+0000","last_peered":"2023-10-06T01:40:25.827729+0000","last_clean":"2023-10-06T01:40:25.827729+0000","last_became_active":"2023-10-06T01:40:21.795755+0000","last_became_peered":"2023-10-06T01:40:21.795755+0000","last_unstale":"2023-10-06T01:40:25.827729+0000","last_undegraded":"2023-10-06T01:40:25.827729+0000","last_fullsized":"2023-10-06T01:40:25.827729+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:26:01.813573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.826585+0000","last_change":"2023-10-06T01:40:21.783713+0000","last_active":"2023-10-06T01:40:25.826585+0000","last_peered":"2023-10-06T01:40:25.826585+0000","last_clean":"2023-10-06T01:40:25.826585+0000","last_became_active":"2023-10-06T01:40:21.783410+0000","last_became_peered":"2023-10-06T01:40:21.783410+0000","last_unstale":"2023-10-06T01:40:25.826585+0000","last_undegraded":"2023-10-06T01:40:25.826585+0000","last_fullsized":"2023-10-06T01:40:25.826585+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:08:57.248267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.830504+0000","last_change":"2023-10-06T01:40:21.784490+0000","last_active":"2023-10-06T01:40:25.830504+0000","last_peered":"2023-10-06T01:40:25.830504+0000","last_clean":"2023-10-06T01:40:25.830504+0000","last_became_active":"2023-10-06T01:40:21.783963+0000","last_became_peered":"2023-10-06T01:40:21.783963+0000","last_unstale":"2023-10-06T01:40:25.830504+0000","last_undegraded":"2023-10-06T01:40:25.830504+0000","last_fullsized":"2023-10-06T01:40:25.830504+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:57:45.536353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.827932+0000","last_change":"2023-10-06T01:40:21.800162+0000","last_active":"2023-10-06T01:40:25.827932+0000","last_peered":"2023-10-06T01:40:25.827932+0000","last_clean":"2023-10-06T01:40:25.827932+0000","last_became_active":"2023-10-06T01:40:21.799563+0000","last_became_peered":"2023-10-06T01:40:21.799563+0000","last_unstale":"2023-10-06T01:40:25.827932+0000","last_undegraded":"2023-10-06T01:40:25.827932+0000","last_fullsized":"2023-10-06T01:40:25.827932+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:26:58.497171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.838626+0000","last_change":"2023-10-06T01:40:21.794761+0000","last_active":"2023-10-06T01:40:25.838626+0000","last_peered":"2023-10-06T01:40:25.838626+0000","last_clean":"2023-10-06T01:40:25.838626+0000","last_became_active":"2023-10-06T01:40:21.794528+0000","last_became_peered":"2023-10-06T01:40:21.794528+0000","last_unstale":"2023-10-06T01:40:25.838626+0000","last_undegraded":"2023-10-06T01:40:25.838626+0000","last_fullsized":"2023-10-06T01:40:25.838626+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:40:45.624442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821624+0000","last_change":"2023-10-06T01:40:21.797159+0000","last_active":"2023-10-06T01:40:25.821624+0000","last_peered":"2023-10-06T01:40:25.821624+0000","last_clean":"2023-10-06T01:40:25.821624+0000","last_became_active":"2023-10-06T01:40:21.796930+0000","last_became_peered":"2023-10-06T01:40:21.796930+0000","last_unstale":"2023-10-06T01:40:25.821624+0000","last_undegraded":"2023-10-06T01:40:25.821624+0000","last_fullsized":"2023-10-06T01:40:25.821624+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:14:30.814494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.831663+0000","last_change":"2023-10-06T01:40:21.800667+0000","last_active":"2023-10-06T01:40:25.831663+0000","last_peered":"2023-10-06T01:40:25.831663+0000","last_clean":"2023-10-06T01:40:25.831663+0000","last_became_active":"2023-10-06T01:40:21.799665+0000","last_became_peered":"2023-10-06T01:40:21.799665+0000","last_unstale":"2023-10-06T01:40:25.831663+0000","last_undegraded":"2023-10-06T01:40:25.831663+0000","last_fullsized":"2023-10-06T01:40:25.831663+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:29:36.526509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.829892+0000","last_change":"2023-10-06T01:40:21.795383+0000","last_active":"2023-10-06T01:40:25.829892+0000","last_peered":"2023-10-06T01:40:25.829892+0000","last_clean":"2023-10-06T01:40:25.829892+0000","last_became_active":"2023-10-06T01:40:21.794463+0000","last_became_peered":"2023-10-06T01:40:21.794463+0000","last_unstale":"2023-10-06T01:40:25.829892+0000","last_undegraded":"2023-10-06T01:40:25.829892+0000","last_fullsized":"2023-10-06T01:40:25.829892+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:15:52.031555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.827471+0000","last_change":"2023-10-06T01:40:21.787299+0000","last_active":"2023-10-06T01:40:25.827471+0000","last_peered":"2023-10-06T01:40:25.827471+0000","last_clean":"2023-10-06T01:40:25.827471+0000","last_became_active":"2023-10-06T01:40:21.786459+0000","last_became_peered":"2023-10-06T01:40:21.786459+0000","last_unstale":"2023-10-06T01:40:25.827471+0000","last_undegraded":"2023-10-06T01:40:25.827471+0000","last_fullsized":"2023-10-06T01:40:25.827471+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:29:49.863294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.822035+0000","last_change":"2023-10-06T01:40:21.798180+0000","last_active":"2023-10-06T01:40:25.822035+0000","last_peered":"2023-10-06T01:40:25.822035+0000","last_clean":"2023-10-06T01:40:25.822035+0000","last_became_active":"2023-10-06T01:40:21.797919+0000","last_became_peered":"2023-10-06T01:40:21.797919+0000","last_unstale":"2023-10-06T01:40:25.822035+0000","last_undegraded":"2023-10-06T01:40:25.822035+0000","last_fullsized":"2023-10-06T01:40:25.822035+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:29:36.526509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.853335+0000","last_change":"2023-10-06T01:40:25.847570+0000","last_active":"2023-10-06T01:40:25.853335+0000","last_peered":"2023-10-06T01:40:25.853335+0000","last_clean":"2023-10-06T01:40:25.853335+0000","last_became_active":"2023-10-06T01:40:25.843197+0000","last_became_peered":"2023-10-06T01:40:25.843197+0000","last_unstale":"2023-10-06T01:40:25.853335+0000","last_undegraded":"2023-10-06T01:40:25.853335+0000","last_fullsized":"2023-10-06T01:40:25.853335+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:44:41.539390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.832007+0000","last_change":"2023-10-06T01:40:20.794740+0000","last_active":"2023-10-06T01:40:25.832007+0000","last_peered":"2023-10-06T01:40:25.832007+0000","last_clean":"2023-10-06T01:40:25.832007+0000","last_became_active":"2023-10-06T01:40:20.794508+0000","last_became_peered":"2023-10-06T01:40:20.794508+0000","last_unstale":"2023-10-06T01:40:25.832007+0000","last_undegraded":"2023-10-06T01:40:25.832007+0000","last_fullsized":"2023-10-06T01:40:25.832007+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:28:17.373431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821586+0000","last_change":"2023-10-06T01:40:21.792738+0000","last_active":"2023-10-06T01:40:25.821586+0000","last_peered":"2023-10-06T01:40:25.821586+0000","last_clean":"2023-10-06T01:40:25.821586+0000","last_became_active":"2023-10-06T01:40:21.792508+0000","last_became_peered":"2023-10-06T01:40:21.792508+0000","last_unstale":"2023-10-06T01:40:25.821586+0000","last_undegraded":"2023-10-06T01:40:25.821586+0000","last_fullsized":"2023-10-06T01:40:25.821586+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:04.038873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.847437+0000","last_change":"2023-10-06T01:40:25.841407+0000","last_active":"2023-10-06T01:40:25.847437+0000","last_peered":"2023-10-06T01:40:25.847437+0000","last_clean":"2023-10-06T01:40:25.847437+0000","last_became_active":"2023-10-06T01:40:25.840998+0000","last_became_peered":"2023-10-06T01:40:25.840998+0000","last_unstale":"2023-10-06T01:40:25.847437+0000","last_undegraded":"2023-10-06T01:40:25.847437+0000","last_fullsized":"2023-10-06T01:40:25.847437+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:24:24.646258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.829628+0000","last_change":"2023-10-06T01:40:20.784535+0000","last_active":"2023-10-06T01:40:25.829628+0000","last_peered":"2023-10-06T01:40:25.829628+0000","last_clean":"2023-10-06T01:40:25.829628+0000","last_became_active":"2023-10-06T01:40:20.784266+0000","last_became_peered":"2023-10-06T01:40:20.784266+0000","last_unstale":"2023-10-06T01:40:25.829628+0000","last_undegraded":"2023-10-06T01:40:25.829628+0000","last_fullsized":"2023-10-06T01:40:25.829628+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:05:51.063526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.839509+0000","last_change":"2023-10-06T01:40:21.796914+0000","last_active":"2023-10-06T01:40:25.839509+0000","last_peered":"2023-10-06T01:40:25.839509+0000","last_clean":"2023-10-06T01:40:25.839509+0000","last_became_active":"2023-10-06T01:40:21.796645+0000","last_became_peered":"2023-10-06T01:40:21.796645+0000","last_unstale":"2023-10-06T01:40:25.839509+0000","last_undegraded":"2023-10-06T01:40:25.839509+0000","last_fullsized":"2023-10-06T01:40:25.839509+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:26:01.813573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.859114+0000","last_change":"2023-10-06T01:40:25.852718+0000","last_active":"2023-10-06T01:40:25.859114+0000","last_peered":"2023-10-06T01:40:25.859114+0000","last_clean":"2023-10-06T01:40:25.859114+0000","last_became_active":"2023-10-06T01:40:25.852410+0000","last_became_peered":"2023-10-06T01:40:25.852410+0000","last_unstale":"2023-10-06T01:40:25.859114+0000","last_undegraded":"2023-10-06T01:40:25.859114+0000","last_fullsized":"2023-10-06T01:40:25.859114+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:51:20.741996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.822073+0000","last_change":"2023-10-06T01:40:20.791628+0000","last_active":"2023-10-06T01:40:25.822073+0000","last_peered":"2023-10-06T01:40:25.822073+0000","last_clean":"2023-10-06T01:40:25.822073+0000","last_became_active":"2023-10-06T01:40:20.791350+0000","last_became_peered":"2023-10-06T01:40:20.791350+0000","last_unstale":"2023-10-06T01:40:25.822073+0000","last_undegraded":"2023-10-06T01:40:25.822073+0000","last_fullsized":"2023-10-06T01:40:25.822073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:40:52.187918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.824300+0000","last_change":"2023-10-06T01:40:21.784888+0000","last_active":"2023-10-06T01:40:25.824300+0000","last_peered":"2023-10-06T01:40:25.824300+0000","last_clean":"2023-10-06T01:40:25.824300+0000","last_became_active":"2023-10-06T01:40:21.784543+0000","last_became_peered":"2023-10-06T01:40:21.784543+0000","last_unstale":"2023-10-06T01:40:25.824300+0000","last_undegraded":"2023-10-06T01:40:25.824300+0000","last_fullsized":"2023-10-06T01:40:25.824300+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:22:12.634757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.852270+0000","last_change":"2023-10-06T01:40:25.846891+0000","last_active":"2023-10-06T01:40:25.852270+0000","last_peered":"2023-10-06T01:40:25.852270+0000","last_clean":"2023-10-06T01:40:25.852270+0000","last_became_active":"2023-10-06T01:40:25.846500+0000","last_became_peered":"2023-10-06T01:40:25.846500+0000","last_unstale":"2023-10-06T01:40:25.852270+0000","last_undegraded":"2023-10-06T01:40:25.852270+0000","last_fullsized":"2023-10-06T01:40:25.852270+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:08:08.709318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.840125+0000","last_change":"2023-10-06T01:40:20.792032+0000","last_active":"2023-10-06T01:40:25.840125+0000","last_peered":"2023-10-06T01:40:25.840125+0000","last_clean":"2023-10-06T01:40:25.840125+0000","last_became_active":"2023-10-06T01:40:20.791755+0000","last_became_peered":"2023-10-06T01:40:20.791755+0000","last_unstale":"2023-10-06T01:40:25.840125+0000","last_undegraded":"2023-10-06T01:40:25.840125+0000","last_fullsized":"2023-10-06T01:40:25.840125+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:26:03.577908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821783+0000","last_change":"2023-10-06T01:40:21.784165+0000","last_active":"2023-10-06T01:40:25.821783+0000","last_peered":"2023-10-06T01:40:25.821783+0000","last_clean":"2023-10-06T01:40:25.821783+0000","last_became_active":"2023-10-06T01:40:21.783915+0000","last_became_peered":"2023-10-06T01:40:21.783915+0000","last_unstale":"2023-10-06T01:40:25.821783+0000","last_undegraded":"2023-10-06T01:40:25.821783+0000","last_fullsized":"2023-10-06T01:40:25.821783+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:24:04.737047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.854974+0000","last_change":"2023-10-06T01:40:25.844941+0000","last_active":"2023-10-06T01:40:25.854974+0000","last_peered":"2023-10-06T01:40:25.854974+0000","last_clean":"2023-10-06T01:40:25.854974+0000","last_became_active":"2023-10-06T01:40:25.844514+0000","last_became_peered":"2023-10-06T01:40:25.844514+0000","last_unstale":"2023-10-06T01:40:25.854974+0000","last_undegraded":"2023-10-06T01:40:25.854974+0000","last_fullsized":"2023-10-06T01:40:25.854974+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:47:01.253527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821998+0000","last_change":"2023-10-06T01:40:20.791960+0000","last_active":"2023-10-06T01:40:25.821998+0000","last_peered":"2023-10-06T01:40:25.821998+0000","last_clean":"2023-10-06T01:40:25.821998+0000","last_became_active":"2023-10-06T01:40:20.791726+0000","last_became_peered":"2023-10-06T01:40:20.791726+0000","last_unstale":"2023-10-06T01:40:25.821998+0000","last_undegraded":"2023-10-06T01:40:25.821998+0000","last_fullsized":"2023-10-06T01:40:25.821998+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:26:03.577908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821717+0000","last_change":"2023-10-06T01:40:21.788771+0000","last_active":"2023-10-06T01:40:25.821717+0000","last_peered":"2023-10-06T01:40:25.821717+0000","last_clean":"2023-10-06T01:40:25.821717+0000","last_became_active":"2023-10-06T01:40:21.788485+0000","last_became_peered":"2023-10-06T01:40:21.788485+0000","last_unstale":"2023-10-06T01:40:25.821717+0000","last_undegraded":"2023-10-06T01:40:25.821717+0000","last_fullsized":"2023-10-06T01:40:25.821717+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:26:01.813573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.856408+0000","last_change":"2023-10-06T01:40:25.843843+0000","last_active":"2023-10-06T01:40:25.856408+0000","last_peered":"2023-10-06T01:40:25.856408+0000","last_clean":"2023-10-06T01:40:25.856408+0000","last_became_active":"2023-10-06T01:40:25.843513+0000","last_became_peered":"2023-10-06T01:40:25.843513+0000","last_unstale":"2023-10-06T01:40:25.856408+0000","last_undegraded":"2023-10-06T01:40:25.856408+0000","last_fullsized":"2023-10-06T01:40:25.856408+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:45.054717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.829858+0000","last_change":"2023-10-06T01:40:20.794114+0000","last_active":"2023-10-06T01:40:25.829858+0000","last_peered":"2023-10-06T01:40:25.829858+0000","last_clean":"2023-10-06T01:40:25.829858+0000","last_became_active":"2023-10-06T01:40:20.793858+0000","last_became_peered":"2023-10-06T01:40:20.793858+0000","last_unstale":"2023-10-06T01:40:25.829858+0000","last_undegraded":"2023-10-06T01:40:25.829858+0000","last_fullsized":"2023-10-06T01:40:25.829858+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:18:42.060669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.827126+0000","last_change":"2023-10-06T01:40:21.794943+0000","last_active":"2023-10-06T01:40:25.827126+0000","last_peered":"2023-10-06T01:40:25.827126+0000","last_clean":"2023-10-06T01:40:25.827126+0000","last_became_active":"2023-10-06T01:40:21.794481+0000","last_became_peered":"2023-10-06T01:40:21.794481+0000","last_unstale":"2023-10-06T01:40:25.827126+0000","last_undegraded":"2023-10-06T01:40:25.827126+0000","last_fullsized":"2023-10-06T01:40:25.827126+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:29:36.526509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.853325+0000","last_change":"2023-10-06T01:40:25.844703+0000","last_active":"2023-10-06T01:40:25.853325+0000","last_peered":"2023-10-06T01:40:25.853325+0000","last_clean":"2023-10-06T01:40:25.853325+0000","last_became_active":"2023-10-06T01:40:25.844372+0000","last_became_peered":"2023-10-06T01:40:25.844372+0000","last_unstale":"2023-10-06T01:40:25.853325+0000","last_undegraded":"2023-10-06T01:40:25.853325+0000","last_fullsized":"2023-10-06T01:40:25.853325+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:09:02.303009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'9","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T01:40:31.572781+0000","last_change":"2023-10-06T01:40:20.794127+0000","last_active":"2023-10-06T01:40:31.572781+0000","last_peered":"2023-10-06T01:40:31.572781+0000","last_clean":"2023-10-06T01:40:31.572781+0000","last_became_active":"2023-10-06T01:40:20.793873+0000","last_became_peered":"2023-10-06T01:40:20.793873+0000","last_unstale":"2023-10-06T01:40:31.572781+0000","last_undegraded":"2023-10-06T01:40:31.572781+0000","last_fullsized":"2023-10-06T01:40:31.572781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:05:51.063526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3714,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.830525+0000","last_change":"2023-10-06T01:40:21.783742+0000","last_active":"2023-10-06T01:40:25.830525+0000","last_peered":"2023-10-06T01:40:25.830525+0000","last_clean":"2023-10-06T01:40:25.830525+0000","last_became_active":"2023-10-06T01:40:21.783474+0000","last_became_peered":"2023-10-06T01:40:21.783474+0000","last_unstale":"2023-10-06T01:40:25.830525+0000","last_undegraded":"2023-10-06T01:40:25.830525+0000","last_fullsized":"2023-10-06T01:40:25.830525+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:40:45.624442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.855108+0000","last_change":"2023-10-06T01:40:25.850810+0000","last_active":"2023-10-06T01:40:25.855108+0000","last_peered":"2023-10-06T01:40:25.855108+0000","last_clean":"2023-10-06T01:40:25.855108+0000","last_became_active":"2023-10-06T01:40:25.850440+0000","last_became_peered":"2023-10-06T01:40:25.850440+0000","last_unstale":"2023-10-06T01:40:25.855108+0000","last_undegraded":"2023-10-06T01:40:25.855108+0000","last_fullsized":"2023-10-06T01:40:25.855108+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:12:18.042310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.827851+0000","last_change":"2023-10-06T01:40:20.795471+0000","last_active":"2023-10-06T01:40:25.827851+0000","last_peered":"2023-10-06T01:40:25.827851+0000","last_clean":"2023-10-06T01:40:25.827851+0000","last_became_active":"2023-10-06T01:40:20.795162+0000","last_became_peered":"2023-10-06T01:40:20.795162+0000","last_unstale":"2023-10-06T01:40:25.827851+0000","last_undegraded":"2023-10-06T01:40:25.827851+0000","last_fullsized":"2023-10-06T01:40:25.827851+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:42:39.472271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.822047+0000","last_change":"2023-10-06T01:40:21.792919+0000","last_active":"2023-10-06T01:40:25.822047+0000","last_peered":"2023-10-06T01:40:25.822047+0000","last_clean":"2023-10-06T01:40:25.822047+0000","last_became_active":"2023-10-06T01:40:21.792603+0000","last_became_peered":"2023-10-06T01:40:21.792603+0000","last_unstale":"2023-10-06T01:40:25.822047+0000","last_undegraded":"2023-10-06T01:40:25.822047+0000","last_fullsized":"2023-10-06T01:40:25.822047+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:58:41.783343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.842053+0000","last_change":"2023-10-06T01:40:25.837982+0000","last_active":"2023-10-06T01:40:25.842053+0000","last_peered":"2023-10-06T01:40:25.842053+0000","last_clean":"2023-10-06T01:40:25.842053+0000","last_became_active":"2023-10-06T01:40:25.837550+0000","last_became_peered":"2023-10-06T01:40:25.837550+0000","last_unstale":"2023-10-06T01:40:25.842053+0000","last_undegraded":"2023-10-06T01:40:25.842053+0000","last_fullsized":"2023-10-06T01:40:25.842053+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:44:33.571977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.838551+0000","last_change":"2023-10-06T01:40:20.791355+0000","last_active":"2023-10-06T01:40:25.838551+0000","last_peered":"2023-10-06T01:40:25.838551+0000","last_clean":"2023-10-06T01:40:25.838551+0000","last_became_active":"2023-10-06T01:40:20.791101+0000","last_became_peered":"2023-10-06T01:40:20.791101+0000","last_unstale":"2023-10-06T01:40:25.838551+0000","last_undegraded":"2023-10-06T01:40:25.838551+0000","last_fullsized":"2023-10-06T01:40:25.838551+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:36.984892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821895+0000","last_change":"2023-10-06T01:40:21.798155+0000","last_active":"2023-10-06T01:40:25.821895+0000","last_peered":"2023-10-06T01:40:25.821895+0000","last_clean":"2023-10-06T01:40:25.821895+0000","last_became_active":"2023-10-06T01:40:21.797870+0000","last_became_peered":"2023-10-06T01:40:21.797870+0000","last_unstale":"2023-10-06T01:40:25.821895+0000","last_undegraded":"2023-10-06T01:40:25.821895+0000","last_fullsized":"2023-10-06T01:40:25.821895+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:04.038873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.856540+0000","last_change":"2023-10-06T01:40:25.845625+0000","last_active":"2023-10-06T01:40:25.856540+0000","last_peered":"2023-10-06T01:40:25.856540+0000","last_clean":"2023-10-06T01:40:25.856540+0000","last_became_active":"2023-10-06T01:40:25.845267+0000","last_became_peered":"2023-10-06T01:40:25.845267+0000","last_unstale":"2023-10-06T01:40:25.856540+0000","last_undegraded":"2023-10-06T01:40:25.856540+0000","last_fullsized":"2023-10-06T01:40:25.856540+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:22:48.941644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.836049+0000","last_change":"2023-10-06T01:40:20.795272+0000","last_active":"2023-10-06T01:40:25.836049+0000","last_peered":"2023-10-06T01:40:25.836049+0000","last_clean":"2023-10-06T01:40:25.836049+0000","last_became_active":"2023-10-06T01:40:20.795001+0000","last_became_peered":"2023-10-06T01:40:20.795001+0000","last_unstale":"2023-10-06T01:40:25.836049+0000","last_undegraded":"2023-10-06T01:40:25.836049+0000","last_fullsized":"2023-10-06T01:40:25.836049+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:08:56.244189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.839584+0000","last_change":"2023-10-06T01:40:21.793411+0000","last_active":"2023-10-06T01:40:25.839584+0000","last_peered":"2023-10-06T01:40:25.839584+0000","last_clean":"2023-10-06T01:40:25.839584+0000","last_became_active":"2023-10-06T01:40:21.793189+0000","last_became_peered":"2023-10-06T01:40:21.793189+0000","last_unstale":"2023-10-06T01:40:25.839584+0000","last_undegraded":"2023-10-06T01:40:25.839584+0000","last_fullsized":"2023-10-06T01:40:25.839584+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:39:44.521327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.848998+0000","last_change":"2023-10-06T01:40:25.844926+0000","last_active":"2023-10-06T01:40:25.848998+0000","last_peered":"2023-10-06T01:40:25.848998+0000","last_clean":"2023-10-06T01:40:25.848998+0000","last_became_active":"2023-10-06T01:40:25.844538+0000","last_became_peered":"2023-10-06T01:40:25.844538+0000","last_unstale":"2023-10-06T01:40:25.848998+0000","last_undegraded":"2023-10-06T01:40:25.848998+0000","last_fullsized":"2023-10-06T01:40:25.848998+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:09:02.303009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.822780+0000","last_change":"2023-10-06T01:40:20.791595+0000","last_active":"2023-10-06T01:40:25.822780+0000","last_peered":"2023-10-06T01:40:25.822780+0000","last_clean":"2023-10-06T01:40:25.822780+0000","last_became_active":"2023-10-06T01:40:20.791307+0000","last_became_peered":"2023-10-06T01:40:20.791307+0000","last_unstale":"2023-10-06T01:40:25.822780+0000","last_undegraded":"2023-10-06T01:40:25.822780+0000","last_fullsized":"2023-10-06T01:40:25.822780+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:28:17.373431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.822628+0000","last_change":"2023-10-06T01:40:21.799944+0000","last_active":"2023-10-06T01:40:25.822628+0000","last_peered":"2023-10-06T01:40:25.822628+0000","last_clean":"2023-10-06T01:40:25.822628+0000","last_became_active":"2023-10-06T01:40:21.799450+0000","last_became_peered":"2023-10-06T01:40:21.799450+0000","last_unstale":"2023-10-06T01:40:25.822628+0000","last_undegraded":"2023-10-06T01:40:25.822628+0000","last_fullsized":"2023-10-06T01:40:25.822628+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:40:45.624442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.855175+0000","last_change":"2023-10-06T01:40:25.846371+0000","last_active":"2023-10-06T01:40:25.855175+0000","last_peered":"2023-10-06T01:40:25.855175+0000","last_clean":"2023-10-06T01:40:25.855175+0000","last_became_active":"2023-10-06T01:40:25.845988+0000","last_became_peered":"2023-10-06T01:40:25.845988+0000","last_unstale":"2023-10-06T01:40:25.855175+0000","last_undegraded":"2023-10-06T01:40:25.855175+0000","last_fullsized":"2023-10-06T01:40:25.855175+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:51:20.741996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.831872+0000","last_change":"2023-10-06T01:40:20.794690+0000","last_active":"2023-10-06T01:40:25.831872+0000","last_peered":"2023-10-06T01:40:25.831872+0000","last_clean":"2023-10-06T01:40:25.831872+0000","last_became_active":"2023-10-06T01:40:20.794423+0000","last_became_peered":"2023-10-06T01:40:20.794423+0000","last_unstale":"2023-10-06T01:40:25.831872+0000","last_undegraded":"2023-10-06T01:40:25.831872+0000","last_fullsized":"2023-10-06T01:40:25.831872+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:22:11.630679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821326+0000","last_change":"2023-10-06T01:40:21.799103+0000","last_active":"2023-10-06T01:40:25.821326+0000","last_peered":"2023-10-06T01:40:25.821326+0000","last_clean":"2023-10-06T01:40:25.821326+0000","last_became_active":"2023-10-06T01:40:21.798863+0000","last_became_peered":"2023-10-06T01:40:21.798863+0000","last_unstale":"2023-10-06T01:40:25.821326+0000","last_undegraded":"2023-10-06T01:40:25.821326+0000","last_fullsized":"2023-10-06T01:40:25.821326+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:26:58.497171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.850182+0000","last_change":"2023-10-06T01:40:25.843557+0000","last_active":"2023-10-06T01:40:25.850182+0000","last_peered":"2023-10-06T01:40:25.850182+0000","last_clean":"2023-10-06T01:40:25.850182+0000","last_became_active":"2023-10-06T01:40:25.843195+0000","last_became_peered":"2023-10-06T01:40:25.843195+0000","last_unstale":"2023-10-06T01:40:25.850182+0000","last_undegraded":"2023-10-06T01:40:25.850182+0000","last_fullsized":"2023-10-06T01:40:25.850182+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:53:23.550542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.835869+0000","last_change":"2023-10-06T01:40:20.796455+0000","last_active":"2023-10-06T01:40:25.835869+0000","last_peered":"2023-10-06T01:40:25.835869+0000","last_clean":"2023-10-06T01:40:25.835869+0000","last_became_active":"2023-10-06T01:40:20.796167+0000","last_became_peered":"2023-10-06T01:40:20.796167+0000","last_unstale":"2023-10-06T01:40:25.835869+0000","last_undegraded":"2023-10-06T01:40:25.835869+0000","last_fullsized":"2023-10-06T01:40:25.835869+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:06:10.010505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.834708+0000","last_change":"2023-10-06T01:40:21.797847+0000","last_active":"2023-10-06T01:40:25.834708+0000","last_peered":"2023-10-06T01:40:25.834708+0000","last_clean":"2023-10-06T01:40:25.834708+0000","last_became_active":"2023-10-06T01:40:21.797521+0000","last_became_peered":"2023-10-06T01:40:21.797521+0000","last_unstale":"2023-10-06T01:40:25.834708+0000","last_undegraded":"2023-10-06T01:40:25.834708+0000","last_fullsized":"2023-10-06T01:40:25.834708+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:50:29.699833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.856330+0000","last_change":"2023-10-06T01:40:25.848998+0000","last_active":"2023-10-06T01:40:25.856330+0000","last_peered":"2023-10-06T01:40:25.856330+0000","last_clean":"2023-10-06T01:40:25.856330+0000","last_became_active":"2023-10-06T01:40:25.848631+0000","last_became_peered":"2023-10-06T01:40:25.848631+0000","last_unstale":"2023-10-06T01:40:25.856330+0000","last_undegraded":"2023-10-06T01:40:25.856330+0000","last_fullsized":"2023-10-06T01:40:25.856330+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:56:06.324200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.830063+0000","last_change":"2023-10-06T01:40:20.794592+0000","last_active":"2023-10-06T01:40:25.830063+0000","last_peered":"2023-10-06T01:40:25.830063+0000","last_clean":"2023-10-06T01:40:25.830063+0000","last_became_active":"2023-10-06T01:40:20.794349+0000","last_became_peered":"2023-10-06T01:40:20.794349+0000","last_unstale":"2023-10-06T01:40:25.830063+0000","last_undegraded":"2023-10-06T01:40:25.830063+0000","last_fullsized":"2023-10-06T01:40:25.830063+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:54:11.553661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.822918+0000","last_change":"2023-10-06T01:40:21.794642+0000","last_active":"2023-10-06T01:40:25.822918+0000","last_peered":"2023-10-06T01:40:25.822918+0000","last_clean":"2023-10-06T01:40:25.822918+0000","last_became_active":"2023-10-06T01:40:21.794359+0000","last_became_peered":"2023-10-06T01:40:21.794359+0000","last_unstale":"2023-10-06T01:40:25.822918+0000","last_undegraded":"2023-10-06T01:40:25.822918+0000","last_fullsized":"2023-10-06T01:40:25.822918+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:42:40.476349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.845522+0000","last_change":"2023-10-06T01:40:25.836956+0000","last_active":"2023-10-06T01:40:25.845522+0000","last_peered":"2023-10-06T01:40:25.845522+0000","last_clean":"2023-10-06T01:40:25.845522+0000","last_became_active":"2023-10-06T01:40:25.836541+0000","last_became_peered":"2023-10-06T01:40:25.836541+0000","last_unstale":"2023-10-06T01:40:25.845522+0000","last_undegraded":"2023-10-06T01:40:25.845522+0000","last_fullsized":"2023-10-06T01:40:25.845522+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:16:05.054146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821650+0000","last_change":"2023-10-06T01:40:20.782445+0000","last_active":"2023-10-06T01:40:25.821650+0000","last_peered":"2023-10-06T01:40:25.821650+0000","last_clean":"2023-10-06T01:40:25.821650+0000","last_became_active":"2023-10-06T01:40:20.782183+0000","last_became_peered":"2023-10-06T01:40:20.782183+0000","last_unstale":"2023-10-06T01:40:25.821650+0000","last_undegraded":"2023-10-06T01:40:25.821650+0000","last_fullsized":"2023-10-06T01:40:25.821650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:36.984892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.839193+0000","last_change":"2023-10-06T01:40:21.798980+0000","last_active":"2023-10-06T01:40:25.839193+0000","last_peered":"2023-10-06T01:40:25.839193+0000","last_clean":"2023-10-06T01:40:25.839193+0000","last_became_active":"2023-10-06T01:40:21.798613+0000","last_became_peered":"2023-10-06T01:40:21.798613+0000","last_unstale":"2023-10-06T01:40:25.839193+0000","last_undegraded":"2023-10-06T01:40:25.839193+0000","last_fullsized":"2023-10-06T01:40:25.839193+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:24:20.596942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.845551+0000","last_change":"2023-10-06T01:40:25.833310+0000","last_active":"2023-10-06T01:40:25.845551+0000","last_peered":"2023-10-06T01:40:25.845551+0000","last_clean":"2023-10-06T01:40:25.845551+0000","last_became_active":"2023-10-06T01:40:25.832963+0000","last_became_peered":"2023-10-06T01:40:25.832963+0000","last_unstale":"2023-10-06T01:40:25.845551+0000","last_undegraded":"2023-10-06T01:40:25.845551+0000","last_fullsized":"2023-10-06T01:40:25.845551+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:23:12.621079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821512+0000","last_change":"2023-10-06T01:40:20.791754+0000","last_active":"2023-10-06T01:40:25.821512+0000","last_peered":"2023-10-06T01:40:25.821512+0000","last_clean":"2023-10-06T01:40:25.821512+0000","last_became_active":"2023-10-06T01:40:20.791494+0000","last_became_peered":"2023-10-06T01:40:20.791494+0000","last_unstale":"2023-10-06T01:40:25.821512+0000","last_undegraded":"2023-10-06T01:40:25.821512+0000","last_fullsized":"2023-10-06T01:40:25.821512+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:05:51.063526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.830148+0000","last_change":"2023-10-06T01:40:21.785721+0000","last_active":"2023-10-06T01:40:25.830148+0000","last_peered":"2023-10-06T01:40:25.830148+0000","last_clean":"2023-10-06T01:40:25.830148+0000","last_became_active":"2023-10-06T01:40:21.785449+0000","last_became_peered":"2023-10-06T01:40:21.785449+0000","last_unstale":"2023-10-06T01:40:25.830148+0000","last_undegraded":"2023-10-06T01:40:25.830148+0000","last_fullsized":"2023-10-06T01:40:25.830148+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:08:04.660002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.844791+0000","last_change":"2023-10-06T01:40:25.840556+0000","last_active":"2023-10-06T01:40:25.844791+0000","last_peered":"2023-10-06T01:40:25.844791+0000","last_clean":"2023-10-06T01:40:25.844791+0000","last_became_active":"2023-10-06T01:40:25.839952+0000","last_became_peered":"2023-10-06T01:40:25.839952+0000","last_unstale":"2023-10-06T01:40:25.844791+0000","last_undegraded":"2023-10-06T01:40:25.844791+0000","last_fullsized":"2023-10-06T01:40:25.844791+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:47:01.253527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.823012+0000","last_change":"2023-10-06T01:40:20.789868+0000","last_active":"2023-10-06T01:40:25.823012+0000","last_peered":"2023-10-06T01:40:25.823012+0000","last_clean":"2023-10-06T01:40:25.823012+0000","last_became_active":"2023-10-06T01:40:20.789583+0000","last_became_peered":"2023-10-06T01:40:20.789583+0000","last_unstale":"2023-10-06T01:40:25.823012+0000","last_undegraded":"2023-10-06T01:40:25.823012+0000","last_fullsized":"2023-10-06T01:40:25.823012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:33:03.922009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.829487+0000","last_change":"2023-10-06T01:40:21.782892+0000","last_active":"2023-10-06T01:40:25.829487+0000","last_peered":"2023-10-06T01:40:25.829487+0000","last_clean":"2023-10-06T01:40:25.829487+0000","last_became_active":"2023-10-06T01:40:21.782614+0000","last_became_peered":"2023-10-06T01:40:21.782614+0000","last_unstale":"2023-10-06T01:40:25.829487+0000","last_undegraded":"2023-10-06T01:40:25.829487+0000","last_fullsized":"2023-10-06T01:40:25.829487+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:29:36.526509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.848904+0000","last_change":"2023-10-06T01:40:25.843490+0000","last_active":"2023-10-06T01:40:25.848904+0000","last_peered":"2023-10-06T01:40:25.848904+0000","last_clean":"2023-10-06T01:40:25.848904+0000","last_became_active":"2023-10-06T01:40:25.843088+0000","last_became_peered":"2023-10-06T01:40:25.843088+0000","last_unstale":"2023-10-06T01:40:25.848904+0000","last_undegraded":"2023-10-06T01:40:25.848904+0000","last_fullsized":"2023-10-06T01:40:25.848904+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:56:02.016770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.834508+0000","last_change":"2023-10-06T01:40:20.789056+0000","last_active":"2023-10-06T01:40:25.834508+0000","last_peered":"2023-10-06T01:40:25.834508+0000","last_clean":"2023-10-06T01:40:25.834508+0000","last_became_active":"2023-10-06T01:40:20.788196+0000","last_became_peered":"2023-10-06T01:40:20.788196+0000","last_unstale":"2023-10-06T01:40:25.834508+0000","last_undegraded":"2023-10-06T01:40:25.834508+0000","last_fullsized":"2023-10-06T01:40:25.834508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:33:03.922009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.827836+0000","last_change":"2023-10-06T01:40:21.797206+0000","last_active":"2023-10-06T01:40:25.827836+0000","last_peered":"2023-10-06T01:40:25.827836+0000","last_clean":"2023-10-06T01:40:25.827836+0000","last_became_active":"2023-10-06T01:40:21.796922+0000","last_became_peered":"2023-10-06T01:40:21.796922+0000","last_unstale":"2023-10-06T01:40:25.827836+0000","last_undegraded":"2023-10-06T01:40:25.827836+0000","last_fullsized":"2023-10-06T01:40:25.827836+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:23:41.001172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.843834+0000","last_change":"2023-10-06T01:40:25.839765+0000","last_active":"2023-10-06T01:40:25.843834+0000","last_peered":"2023-10-06T01:40:25.843834+0000","last_clean":"2023-10-06T01:40:25.843834+0000","last_became_active":"2023-10-06T01:40:25.839357+0000","last_became_peered":"2023-10-06T01:40:25.839357+0000","last_unstale":"2023-10-06T01:40:25.843834+0000","last_undegraded":"2023-10-06T01:40:25.843834+0000","last_fullsized":"2023-10-06T01:40:25.843834+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:19:13.535733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821700+0000","last_change":"2023-10-06T01:40:20.794748+0000","last_active":"2023-10-06T01:40:25.821700+0000","last_peered":"2023-10-06T01:40:25.821700+0000","last_clean":"2023-10-06T01:40:25.821700+0000","last_became_active":"2023-10-06T01:40:20.794480+0000","last_became_peered":"2023-10-06T01:40:20.794480+0000","last_unstale":"2023-10-06T01:40:25.821700+0000","last_undegraded":"2023-10-06T01:40:25.821700+0000","last_fullsized":"2023-10-06T01:40:25.821700+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:28:17.373431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.830047+0000","last_change":"2023-10-06T01:40:21.787258+0000","last_active":"2023-10-06T01:40:25.830047+0000","last_peered":"2023-10-06T01:40:25.830047+0000","last_clean":"2023-10-06T01:40:25.830047+0000","last_became_active":"2023-10-06T01:40:21.786664+0000","last_became_peered":"2023-10-06T01:40:21.786664+0000","last_unstale":"2023-10-06T01:40:25.830047+0000","last_undegraded":"2023-10-06T01:40:25.830047+0000","last_fullsized":"2023-10-06T01:40:25.830047+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:14:30.814494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.850996+0000","last_change":"2023-10-06T01:40:25.844637+0000","last_active":"2023-10-06T01:40:25.850996+0000","last_peered":"2023-10-06T01:40:25.850996+0000","last_clean":"2023-10-06T01:40:25.850996+0000","last_became_active":"2023-10-06T01:40:25.844052+0000","last_became_peered":"2023-10-06T01:40:25.844052+0000","last_unstale":"2023-10-06T01:40:25.850996+0000","last_undegraded":"2023-10-06T01:40:25.850996+0000","last_fullsized":"2023-10-06T01:40:25.850996+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:22:48.941644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.827265+0000","last_change":"2023-10-06T01:40:16.930992+0000","last_active":"2023-10-06T01:40:25.827265+0000","last_peered":"2023-10-06T01:40:25.827265+0000","last_clean":"2023-10-06T01:40:25.827265+0000","last_became_active":"2023-10-06T01:40:16.930707+0000","last_became_peered":"2023-10-06T01:40:16.930707+0000","last_unstale":"2023-10-06T01:40:25.827265+0000","last_undegraded":"2023-10-06T01:40:25.827265+0000","last_fullsized":"2023-10-06T01:40:25.827265+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:52:43.316071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821862+0000","last_change":"2023-10-06T01:40:20.784967+0000","last_active":"2023-10-06T01:40:25.821862+0000","last_peered":"2023-10-06T01:40:25.821862+0000","last_clean":"2023-10-06T01:40:25.821862+0000","last_became_active":"2023-10-06T01:40:20.784588+0000","last_became_peered":"2023-10-06T01:40:20.784588+0000","last_unstale":"2023-10-06T01:40:25.821862+0000","last_undegraded":"2023-10-06T01:40:25.821862+0000","last_fullsized":"2023-10-06T01:40:25.821862+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:05:51.063526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.826944+0000","last_change":"2023-10-06T01:40:21.794725+0000","last_active":"2023-10-06T01:40:25.826944+0000","last_peered":"2023-10-06T01:40:25.826944+0000","last_clean":"2023-10-06T01:40:25.826944+0000","last_became_active":"2023-10-06T01:40:21.794189+0000","last_became_peered":"2023-10-06T01:40:21.794189+0000","last_unstale":"2023-10-06T01:40:25.826944+0000","last_undegraded":"2023-10-06T01:40:25.826944+0000","last_fullsized":"2023-10-06T01:40:25.826944+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:04.038873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.859101+0000","last_change":"2023-10-06T01:40:25.851461+0000","last_active":"2023-10-06T01:40:25.859101+0000","last_peered":"2023-10-06T01:40:25.859101+0000","last_clean":"2023-10-06T01:40:25.859101+0000","last_became_active":"2023-10-06T01:40:25.851161+0000","last_became_peered":"2023-10-06T01:40:25.851161+0000","last_unstale":"2023-10-06T01:40:25.859101+0000","last_undegraded":"2023-10-06T01:40:25.859101+0000","last_fullsized":"2023-10-06T01:40:25.859101+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:29:43.044116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821491+0000","last_change":"2023-10-06T01:40:16.651019+0000","last_active":"2023-10-06T01:40:25.821491+0000","last_peered":"2023-10-06T01:40:25.821491+0000","last_clean":"2023-10-06T01:40:25.821491+0000","last_became_active":"2023-10-06T01:40:16.650628+0000","last_became_peered":"2023-10-06T01:40:16.650628+0000","last_unstale":"2023-10-06T01:40:25.821491+0000","last_undegraded":"2023-10-06T01:40:25.821491+0000","last_fullsized":"2023-10-06T01:40:25.821491+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:11:57.218984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.830606+0000","last_change":"2023-10-06T01:40:20.791834+0000","last_active":"2023-10-06T01:40:25.830606+0000","last_peered":"2023-10-06T01:40:25.830606+0000","last_clean":"2023-10-06T01:40:25.830606+0000","last_became_active":"2023-10-06T01:40:20.791553+0000","last_became_peered":"2023-10-06T01:40:20.791553+0000","last_unstale":"2023-10-06T01:40:25.830606+0000","last_undegraded":"2023-10-06T01:40:25.830606+0000","last_fullsized":"2023-10-06T01:40:25.830606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:40:52.187918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.827267+0000","last_change":"2023-10-06T01:40:21.787773+0000","last_active":"2023-10-06T01:40:25.827267+0000","last_peered":"2023-10-06T01:40:25.827267+0000","last_clean":"2023-10-06T01:40:25.827267+0000","last_became_active":"2023-10-06T01:40:21.787517+0000","last_became_peered":"2023-10-06T01:40:21.787517+0000","last_unstale":"2023-10-06T01:40:25.827267+0000","last_undegraded":"2023-10-06T01:40:25.827267+0000","last_fullsized":"2023-10-06T01:40:25.827267+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:58:41.783343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.849217+0000","last_change":"2023-10-06T01:40:25.844473+0000","last_active":"2023-10-06T01:40:25.849217+0000","last_peered":"2023-10-06T01:40:25.849217+0000","last_clean":"2023-10-06T01:40:25.849217+0000","last_became_active":"2023-10-06T01:40:25.844126+0000","last_became_peered":"2023-10-06T01:40:25.844126+0000","last_unstale":"2023-10-06T01:40:25.849217+0000","last_undegraded":"2023-10-06T01:40:25.849217+0000","last_fullsized":"2023-10-06T01:40:25.849217+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:08:08.709318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.826313+0000","last_change":"2023-10-06T01:40:16.781596+0000","last_active":"2023-10-06T01:40:25.826313+0000","last_peered":"2023-10-06T01:40:25.826313+0000","last_clean":"2023-10-06T01:40:25.826313+0000","last_became_active":"2023-10-06T01:40:16.781352+0000","last_became_peered":"2023-10-06T01:40:16.781352+0000","last_unstale":"2023-10-06T01:40:25.826313+0000","last_undegraded":"2023-10-06T01:40:25.826313+0000","last_fullsized":"2023-10-06T01:40:25.826313+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:52:43.316071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.825380+0000","last_change":"2023-10-06T01:40:20.783263+0000","last_active":"2023-10-06T01:40:25.825380+0000","last_peered":"2023-10-06T01:40:25.825380+0000","last_clean":"2023-10-06T01:40:25.825380+0000","last_became_active":"2023-10-06T01:40:20.781142+0000","last_became_peered":"2023-10-06T01:40:20.781142+0000","last_unstale":"2023-10-06T01:40:25.825380+0000","last_undegraded":"2023-10-06T01:40:25.825380+0000","last_fullsized":"2023-10-06T01:40:25.825380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:28:17.373431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.829970+0000","last_change":"2023-10-06T01:40:21.795215+0000","last_active":"2023-10-06T01:40:25.829970+0000","last_peered":"2023-10-06T01:40:25.829970+0000","last_clean":"2023-10-06T01:40:25.829970+0000","last_became_active":"2023-10-06T01:40:21.794141+0000","last_became_peered":"2023-10-06T01:40:21.794141+0000","last_unstale":"2023-10-06T01:40:25.829970+0000","last_undegraded":"2023-10-06T01:40:25.829970+0000","last_fullsized":"2023-10-06T01:40:25.829970+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:24:04.737047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.855244+0000","last_change":"2023-10-06T01:40:25.849723+0000","last_active":"2023-10-06T01:40:25.855244+0000","last_peered":"2023-10-06T01:40:25.855244+0000","last_clean":"2023-10-06T01:40:25.855244+0000","last_became_active":"2023-10-06T01:40:25.849315+0000","last_became_peered":"2023-10-06T01:40:25.849315+0000","last_unstale":"2023-10-06T01:40:25.855244+0000","last_undegraded":"2023-10-06T01:40:25.855244+0000","last_fullsized":"2023-10-06T01:40:25.855244+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:09:02.303009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821589+0000","last_change":"2023-10-06T01:40:16.650826+0000","last_active":"2023-10-06T01:40:25.821589+0000","last_peered":"2023-10-06T01:40:25.821589+0000","last_clean":"2023-10-06T01:40:25.821589+0000","last_became_active":"2023-10-06T01:40:16.650469+0000","last_became_peered":"2023-10-06T01:40:16.650469+0000","last_unstale":"2023-10-06T01:40:25.821589+0000","last_undegraded":"2023-10-06T01:40:25.821589+0000","last_fullsized":"2023-10-06T01:40:25.821589+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:50:23.628212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":170,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.828939+0000","last_change":"2023-10-06T01:40:10.645512+0000","last_active":"2023-10-06T01:40:25.828939+0000","last_peered":"2023-10-06T01:40:25.828939+0000","last_clean":"2023-10-06T01:40:25.828939+0000","last_became_active":"2023-10-06T01:40:10.644601+0000","last_became_peered":"2023-10-06T01:40:10.644601+0000","last_unstale":"2023-10-06T01:40:25.828939+0000","last_undegraded":"2023-10-06T01:40:25.828939+0000","last_fullsized":"2023-10-06T01:40:25.828939+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:09.580865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:09.580865+0000","last_clean_scrub_stamp":"2023-10-06T01:40:09.580865+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:05:28.268591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821362+0000","last_change":"2023-10-06T01:40:20.787092+0000","last_active":"2023-10-06T01:40:25.821362+0000","last_peered":"2023-10-06T01:40:25.821362+0000","last_clean":"2023-10-06T01:40:25.821362+0000","last_became_active":"2023-10-06T01:40:20.786835+0000","last_became_peered":"2023-10-06T01:40:20.786835+0000","last_unstale":"2023-10-06T01:40:25.821362+0000","last_undegraded":"2023-10-06T01:40:25.821362+0000","last_fullsized":"2023-10-06T01:40:25.821362+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:36.984892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.824208+0000","last_change":"2023-10-06T01:40:21.800342+0000","last_active":"2023-10-06T01:40:25.824208+0000","last_peered":"2023-10-06T01:40:25.824208+0000","last_clean":"2023-10-06T01:40:25.824208+0000","last_became_active":"2023-10-06T01:40:21.800077+0000","last_became_peered":"2023-10-06T01:40:21.800077+0000","last_unstale":"2023-10-06T01:40:25.824208+0000","last_undegraded":"2023-10-06T01:40:25.824208+0000","last_fullsized":"2023-10-06T01:40:25.824208+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:16:08.450725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.849960+0000","last_change":"2023-10-06T01:40:25.846010+0000","last_active":"2023-10-06T01:40:25.849960+0000","last_peered":"2023-10-06T01:40:25.849960+0000","last_clean":"2023-10-06T01:40:25.849960+0000","last_became_active":"2023-10-06T01:40:25.845564+0000","last_became_peered":"2023-10-06T01:40:25.845564+0000","last_unstale":"2023-10-06T01:40:25.849960+0000","last_undegraded":"2023-10-06T01:40:25.849960+0000","last_fullsized":"2023-10-06T01:40:25.849960+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:45.054717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.829152+0000","last_change":"2023-10-06T01:40:16.651332+0000","last_active":"2023-10-06T01:40:25.829152+0000","last_peered":"2023-10-06T01:40:25.829152+0000","last_clean":"2023-10-06T01:40:25.829152+0000","last_became_active":"2023-10-06T01:40:16.651049+0000","last_became_peered":"2023-10-06T01:40:16.651049+0000","last_unstale":"2023-10-06T01:40:25.829152+0000","last_undegraded":"2023-10-06T01:40:25.829152+0000","last_fullsized":"2023-10-06T01:40:25.829152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:11:57.218984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.838433+0000","last_change":"2023-10-06T01:40:20.793541+0000","last_active":"2023-10-06T01:40:25.838433+0000","last_peered":"2023-10-06T01:40:25.838433+0000","last_clean":"2023-10-06T01:40:25.838433+0000","last_became_active":"2023-10-06T01:40:20.793304+0000","last_became_peered":"2023-10-06T01:40:20.793304+0000","last_unstale":"2023-10-06T01:40:25.838433+0000","last_undegraded":"2023-10-06T01:40:25.838433+0000","last_fullsized":"2023-10-06T01:40:25.838433+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:05:51.063526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.839355+0000","last_change":"2023-10-06T01:40:21.797984+0000","last_active":"2023-10-06T01:40:25.839355+0000","last_peered":"2023-10-06T01:40:25.839355+0000","last_clean":"2023-10-06T01:40:25.839355+0000","last_became_active":"2023-10-06T01:40:21.797701+0000","last_became_peered":"2023-10-06T01:40:21.797701+0000","last_unstale":"2023-10-06T01:40:25.839355+0000","last_undegraded":"2023-10-06T01:40:25.839355+0000","last_fullsized":"2023-10-06T01:40:25.839355+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:26:58.497171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.840837+0000","last_change":"2023-10-06T01:40:25.838729+0000","last_active":"2023-10-06T01:40:25.840837+0000","last_peered":"2023-10-06T01:40:25.840837+0000","last_clean":"2023-10-06T01:40:25.840837+0000","last_became_active":"2023-10-06T01:40:25.838267+0000","last_became_peered":"2023-10-06T01:40:25.838267+0000","last_unstale":"2023-10-06T01:40:25.840837+0000","last_undegraded":"2023-10-06T01:40:25.840837+0000","last_fullsized":"2023-10-06T01:40:25.840837+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:50:33.749149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.829955+0000","last_change":"2023-10-06T01:40:16.931106+0000","last_active":"2023-10-06T01:40:25.829955+0000","last_peered":"2023-10-06T01:40:25.829955+0000","last_clean":"2023-10-06T01:40:25.829955+0000","last_became_active":"2023-10-06T01:40:16.930830+0000","last_became_peered":"2023-10-06T01:40:16.930830+0000","last_unstale":"2023-10-06T01:40:25.829955+0000","last_undegraded":"2023-10-06T01:40:25.829955+0000","last_fullsized":"2023-10-06T01:40:25.829955+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:50:23.628212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.827373+0000","last_change":"2023-10-06T01:40:20.788225+0000","last_active":"2023-10-06T01:40:25.827373+0000","last_peered":"2023-10-06T01:40:25.827373+0000","last_clean":"2023-10-06T01:40:25.827373+0000","last_became_active":"2023-10-06T01:40:20.787925+0000","last_became_peered":"2023-10-06T01:40:20.787925+0000","last_unstale":"2023-10-06T01:40:25.827373+0000","last_undegraded":"2023-10-06T01:40:25.827373+0000","last_fullsized":"2023-10-06T01:40:25.827373+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:40:52.187918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.838984+0000","last_change":"2023-10-06T01:40:21.798835+0000","last_active":"2023-10-06T01:40:25.838984+0000","last_peered":"2023-10-06T01:40:25.838984+0000","last_clean":"2023-10-06T01:40:25.838984+0000","last_became_active":"2023-10-06T01:40:21.798060+0000","last_became_peered":"2023-10-06T01:40:21.798060+0000","last_unstale":"2023-10-06T01:40:25.838984+0000","last_undegraded":"2023-10-06T01:40:25.838984+0000","last_fullsized":"2023-10-06T01:40:25.838984+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:04.038873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.853092+0000","last_change":"2023-10-06T01:40:25.842785+0000","last_active":"2023-10-06T01:40:25.853092+0000","last_peered":"2023-10-06T01:40:25.853092+0000","last_clean":"2023-10-06T01:40:25.853092+0000","last_became_active":"2023-10-06T01:40:25.842386+0000","last_became_peered":"2023-10-06T01:40:25.842386+0000","last_unstale":"2023-10-06T01:40:25.853092+0000","last_undegraded":"2023-10-06T01:40:25.853092+0000","last_fullsized":"2023-10-06T01:40:25.853092+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:21.192762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.822713+0000","last_change":"2023-10-06T01:40:20.791442+0000","last_active":"2023-10-06T01:40:25.822713+0000","last_peered":"2023-10-06T01:40:25.822713+0000","last_clean":"2023-10-06T01:40:25.822713+0000","last_became_active":"2023-10-06T01:40:20.791169+0000","last_became_peered":"2023-10-06T01:40:20.791169+0000","last_unstale":"2023-10-06T01:40:25.822713+0000","last_undegraded":"2023-10-06T01:40:25.822713+0000","last_fullsized":"2023-10-06T01:40:25.822713+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:26:03.577908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.827531+0000","last_change":"2023-10-06T01:40:16.649379+0000","last_active":"2023-10-06T01:40:25.827531+0000","last_peered":"2023-10-06T01:40:25.827531+0000","last_clean":"2023-10-06T01:40:25.827531+0000","last_became_active":"2023-10-06T01:40:16.649147+0000","last_became_peered":"2023-10-06T01:40:16.649147+0000","last_unstale":"2023-10-06T01:40:25.827531+0000","last_undegraded":"2023-10-06T01:40:25.827531+0000","last_fullsized":"2023-10-06T01:40:25.827531+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:11:57.218984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821612+0000","last_change":"2023-10-06T01:40:21.797861+0000","last_active":"2023-10-06T01:40:25.821612+0000","last_peered":"2023-10-06T01:40:25.821612+0000","last_clean":"2023-10-06T01:40:25.821612+0000","last_became_active":"2023-10-06T01:40:21.797626+0000","last_became_peered":"2023-10-06T01:40:21.797626+0000","last_unstale":"2023-10-06T01:40:25.821612+0000","last_undegraded":"2023-10-06T01:40:25.821612+0000","last_fullsized":"2023-10-06T01:40:25.821612+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:24:20.596942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.856358+0000","last_change":"2023-10-06T01:40:25.843290+0000","last_active":"2023-10-06T01:40:25.856358+0000","last_peered":"2023-10-06T01:40:25.856358+0000","last_clean":"2023-10-06T01:40:25.856358+0000","last_became_active":"2023-10-06T01:40:25.842953+0000","last_became_peered":"2023-10-06T01:40:25.842953+0000","last_unstale":"2023-10-06T01:40:25.856358+0000","last_undegraded":"2023-10-06T01:40:25.856358+0000","last_fullsized":"2023-10-06T01:40:25.856358+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:12:18.042310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.824283+0000","last_change":"2023-10-06T01:40:16.651477+0000","last_active":"2023-10-06T01:40:25.824283+0000","last_peered":"2023-10-06T01:40:25.824283+0000","last_clean":"2023-10-06T01:40:25.824283+0000","last_became_active":"2023-10-06T01:40:16.651190+0000","last_became_peered":"2023-10-06T01:40:16.651190+0000","last_unstale":"2023-10-06T01:40:25.824283+0000","last_undegraded":"2023-10-06T01:40:25.824283+0000","last_fullsized":"2023-10-06T01:40:25.824283+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:45:47.422876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"26'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:26.761975+0000","last_change":"2023-10-06T01:40:20.794641+0000","last_active":"2023-10-06T01:40:26.761975+0000","last_peered":"2023-10-06T01:40:26.761975+0000","last_clean":"2023-10-06T01:40:26.761975+0000","last_became_active":"2023-10-06T01:40:20.794360+0000","last_became_peered":"2023-10-06T01:40:20.794360+0000","last_unstale":"2023-10-06T01:40:26.761975+0000","last_undegraded":"2023-10-06T01:40:26.761975+0000","last_fullsized":"2023-10-06T01:40:26.761975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:40:52.187918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.834606+0000","last_change":"2023-10-06T01:40:21.791810+0000","last_active":"2023-10-06T01:40:25.834606+0000","last_peered":"2023-10-06T01:40:25.834606+0000","last_clean":"2023-10-06T01:40:25.834606+0000","last_became_active":"2023-10-06T01:40:21.791555+0000","last_became_peered":"2023-10-06T01:40:21.791555+0000","last_unstale":"2023-10-06T01:40:25.834606+0000","last_undegraded":"2023-10-06T01:40:25.834606+0000","last_fullsized":"2023-10-06T01:40:25.834606+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:24:20.596942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.856682+0000","last_change":"2023-10-06T01:40:25.849400+0000","last_active":"2023-10-06T01:40:25.856682+0000","last_peered":"2023-10-06T01:40:25.856682+0000","last_clean":"2023-10-06T01:40:25.856682+0000","last_became_active":"2023-10-06T01:40:25.849029+0000","last_became_peered":"2023-10-06T01:40:25.849029+0000","last_unstale":"2023-10-06T01:40:25.856682+0000","last_undegraded":"2023-10-06T01:40:25.856682+0000","last_fullsized":"2023-10-06T01:40:25.856682+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:33:05.597649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.839064+0000","last_change":"2023-10-06T01:40:20.794942+0000","last_active":"2023-10-06T01:40:25.839064+0000","last_peered":"2023-10-06T01:40:25.839064+0000","last_clean":"2023-10-06T01:40:25.839064+0000","last_became_active":"2023-10-06T01:40:20.794667+0000","last_became_peered":"2023-10-06T01:40:20.794667+0000","last_unstale":"2023-10-06T01:40:25.839064+0000","last_undegraded":"2023-10-06T01:40:25.839064+0000","last_fullsized":"2023-10-06T01:40:25.839064+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:28:17.373431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.827341+0000","last_change":"2023-10-06T01:40:21.784757+0000","last_active":"2023-10-06T01:40:25.827341+0000","last_peered":"2023-10-06T01:40:25.827341+0000","last_clean":"2023-10-06T01:40:25.827341+0000","last_became_active":"2023-10-06T01:40:21.784512+0000","last_became_peered":"2023-10-06T01:40:21.784512+0000","last_unstale":"2023-10-06T01:40:25.827341+0000","last_undegraded":"2023-10-06T01:40:25.827341+0000","last_fullsized":"2023-10-06T01:40:25.827341+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:37.988970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.854971+0000","last_change":"2023-10-06T01:40:25.844934+0000","last_active":"2023-10-06T01:40:25.854971+0000","last_peered":"2023-10-06T01:40:25.854971+0000","last_clean":"2023-10-06T01:40:25.854971+0000","last_became_active":"2023-10-06T01:40:25.844548+0000","last_became_peered":"2023-10-06T01:40:25.844548+0000","last_unstale":"2023-10-06T01:40:25.854971+0000","last_undegraded":"2023-10-06T01:40:25.854971+0000","last_fullsized":"2023-10-06T01:40:25.854971+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:22:48.941644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821739+0000","last_change":"2023-10-06T01:40:20.795699+0000","last_active":"2023-10-06T01:40:25.821739+0000","last_peered":"2023-10-06T01:40:25.821739+0000","last_clean":"2023-10-06T01:40:25.821739+0000","last_became_active":"2023-10-06T01:40:20.795401+0000","last_became_peered":"2023-10-06T01:40:20.795401+0000","last_unstale":"2023-10-06T01:40:25.821739+0000","last_undegraded":"2023-10-06T01:40:25.821739+0000","last_fullsized":"2023-10-06T01:40:25.821739+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:08:56.244189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.830737+0000","last_change":"2023-10-06T01:40:21.796905+0000","last_active":"2023-10-06T01:40:25.830737+0000","last_peered":"2023-10-06T01:40:25.830737+0000","last_clean":"2023-10-06T01:40:25.830737+0000","last_became_active":"2023-10-06T01:40:21.796623+0000","last_became_peered":"2023-10-06T01:40:21.796623+0000","last_unstale":"2023-10-06T01:40:25.830737+0000","last_undegraded":"2023-10-06T01:40:25.830737+0000","last_fullsized":"2023-10-06T01:40:25.830737+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:14:52.758971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.849027+0000","last_change":"2023-10-06T01:40:25.846338+0000","last_active":"2023-10-06T01:40:25.849027+0000","last_peered":"2023-10-06T01:40:25.849027+0000","last_clean":"2023-10-06T01:40:25.849027+0000","last_became_active":"2023-10-06T01:40:25.845938+0000","last_became_peered":"2023-10-06T01:40:25.845938+0000","last_unstale":"2023-10-06T01:40:25.849027+0000","last_undegraded":"2023-10-06T01:40:25.849027+0000","last_fullsized":"2023-10-06T01:40:25.849027+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:44:33.571977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821259+0000","last_change":"2023-10-06T01:40:20.790034+0000","last_active":"2023-10-06T01:40:25.821259+0000","last_peered":"2023-10-06T01:40:25.821259+0000","last_clean":"2023-10-06T01:40:25.821259+0000","last_became_active":"2023-10-06T01:40:20.789692+0000","last_became_peered":"2023-10-06T01:40:20.789692+0000","last_unstale":"2023-10-06T01:40:25.821259+0000","last_undegraded":"2023-10-06T01:40:25.821259+0000","last_fullsized":"2023-10-06T01:40:25.821259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:06:10.010505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.831832+0000","last_change":"2023-10-06T01:40:21.790538+0000","last_active":"2023-10-06T01:40:25.831832+0000","last_peered":"2023-10-06T01:40:25.831832+0000","last_clean":"2023-10-06T01:40:25.831832+0000","last_became_active":"2023-10-06T01:40:21.790281+0000","last_became_peered":"2023-10-06T01:40:21.790281+0000","last_unstale":"2023-10-06T01:40:25.831832+0000","last_undegraded":"2023-10-06T01:40:25.831832+0000","last_fullsized":"2023-10-06T01:40:25.831832+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:26:58.497171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.853306+0000","last_change":"2023-10-06T01:40:25.845691+0000","last_active":"2023-10-06T01:40:25.853306+0000","last_peered":"2023-10-06T01:40:25.853306+0000","last_clean":"2023-10-06T01:40:25.853306+0000","last_became_active":"2023-10-06T01:40:25.843152+0000","last_became_peered":"2023-10-06T01:40:25.843152+0000","last_unstale":"2023-10-06T01:40:25.853306+0000","last_undegraded":"2023-10-06T01:40:25.853306+0000","last_fullsized":"2023-10-06T01:40:25.853306+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:05:21.358447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821427+0000","last_change":"2023-10-06T01:40:20.787411+0000","last_active":"2023-10-06T01:40:25.821427+0000","last_peered":"2023-10-06T01:40:25.821427+0000","last_clean":"2023-10-06T01:40:25.821427+0000","last_became_active":"2023-10-06T01:40:20.787144+0000","last_became_peered":"2023-10-06T01:40:20.787144+0000","last_unstale":"2023-10-06T01:40:25.821427+0000","last_undegraded":"2023-10-06T01:40:25.821427+0000","last_fullsized":"2023-10-06T01:40:25.821427+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:22:22.604958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821801+0000","last_change":"2023-10-06T01:40:21.783499+0000","last_active":"2023-10-06T01:40:25.821801+0000","last_peered":"2023-10-06T01:40:25.821801+0000","last_clean":"2023-10-06T01:40:25.821801+0000","last_became_active":"2023-10-06T01:40:21.783032+0000","last_became_peered":"2023-10-06T01:40:21.783032+0000","last_unstale":"2023-10-06T01:40:25.821801+0000","last_undegraded":"2023-10-06T01:40:25.821801+0000","last_fullsized":"2023-10-06T01:40:25.821801+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:26:58.497171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.856721+0000","last_change":"2023-10-06T01:40:25.852998+0000","last_active":"2023-10-06T01:40:25.856721+0000","last_peered":"2023-10-06T01:40:25.856721+0000","last_clean":"2023-10-06T01:40:25.856721+0000","last_became_active":"2023-10-06T01:40:25.852607+0000","last_became_peered":"2023-10-06T01:40:25.852607+0000","last_unstale":"2023-10-06T01:40:25.856721+0000","last_undegraded":"2023-10-06T01:40:25.856721+0000","last_fullsized":"2023-10-06T01:40:25.856721+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:22:48.941644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.840188+0000","last_change":"2023-10-06T01:40:20.791988+0000","last_active":"2023-10-06T01:40:25.840188+0000","last_peered":"2023-10-06T01:40:25.840188+0000","last_clean":"2023-10-06T01:40:25.840188+0000","last_became_active":"2023-10-06T01:40:20.791712+0000","last_became_peered":"2023-10-06T01:40:20.791712+0000","last_unstale":"2023-10-06T01:40:25.840188+0000","last_undegraded":"2023-10-06T01:40:25.840188+0000","last_fullsized":"2023-10-06T01:40:25.840188+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:08:56.244189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.830146+0000","last_change":"2023-10-06T01:40:21.797245+0000","last_active":"2023-10-06T01:40:25.830146+0000","last_peered":"2023-10-06T01:40:25.830146+0000","last_clean":"2023-10-06T01:40:25.830146+0000","last_became_active":"2023-10-06T01:40:21.796983+0000","last_became_peered":"2023-10-06T01:40:21.796983+0000","last_unstale":"2023-10-06T01:40:25.830146+0000","last_undegraded":"2023-10-06T01:40:25.830146+0000","last_fullsized":"2023-10-06T01:40:25.830146+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:56:02.274884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.822902+0000","last_change":"2023-10-06T01:40:21.778624+0000","last_active":"2023-10-06T01:40:25.822902+0000","last_peered":"2023-10-06T01:40:25.822902+0000","last_clean":"2023-10-06T01:40:25.822902+0000","last_became_active":"2023-10-06T01:40:21.778327+0000","last_became_peered":"2023-10-06T01:40:21.778327+0000","last_unstale":"2023-10-06T01:40:25.822902+0000","last_undegraded":"2023-10-06T01:40:25.822902+0000","last_fullsized":"2023-10-06T01:40:25.822902+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:54:12.557739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821944+0000","last_change":"2023-10-06T01:40:21.784238+0000","last_active":"2023-10-06T01:40:25.821944+0000","last_peered":"2023-10-06T01:40:25.821944+0000","last_clean":"2023-10-06T01:40:25.821944+0000","last_became_active":"2023-10-06T01:40:21.783952+0000","last_became_peered":"2023-10-06T01:40:21.783952+0000","last_unstale":"2023-10-06T01:40:25.821944+0000","last_undegraded":"2023-10-06T01:40:25.821944+0000","last_fullsized":"2023-10-06T01:40:25.821944+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:29:36.526509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.832179+0000","last_change":"2023-10-06T01:40:21.797310+0000","last_active":"2023-10-06T01:40:25.832179+0000","last_peered":"2023-10-06T01:40:25.832179+0000","last_clean":"2023-10-06T01:40:25.832179+0000","last_became_active":"2023-10-06T01:40:21.797085+0000","last_became_peered":"2023-10-06T01:40:21.797085+0000","last_unstale":"2023-10-06T01:40:25.832179+0000","last_undegraded":"2023-10-06T01:40:25.832179+0000","last_fullsized":"2023-10-06T01:40:25.832179+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:23:08.571763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821415+0000","last_change":"2023-10-06T01:40:21.797623+0000","last_active":"2023-10-06T01:40:25.821415+0000","last_peered":"2023-10-06T01:40:25.821415+0000","last_clean":"2023-10-06T01:40:25.821415+0000","last_became_active":"2023-10-06T01:40:21.797365+0000","last_became_peered":"2023-10-06T01:40:21.797365+0000","last_unstale":"2023-10-06T01:40:25.821415+0000","last_undegraded":"2023-10-06T01:40:25.821415+0000","last_fullsized":"2023-10-06T01:40:25.821415+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:39:44.521327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.827357+0000","last_change":"2023-10-06T01:40:21.791795+0000","last_active":"2023-10-06T01:40:25.827357+0000","last_peered":"2023-10-06T01:40:25.827357+0000","last_clean":"2023-10-06T01:40:25.827357+0000","last_became_active":"2023-10-06T01:40:21.791427+0000","last_became_peered":"2023-10-06T01:40:21.791427+0000","last_unstale":"2023-10-06T01:40:25.827357+0000","last_undegraded":"2023-10-06T01:40:25.827357+0000","last_fullsized":"2023-10-06T01:40:25.827357+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:26:58.497171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4484,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298180,"kb_used_data":892,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073660,"statfs":{"total":96636764160,"available":96331427840,"internally_reserved":0,"allocated":913408,"data_stored":713871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297572,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074268,"statfs":{"total":96636764160,"available":96332050432,"internally_reserved":0,"allocated":290816,"data_stored":119573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297572,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074268,"statfs":{"total":96636764160,"available":96332050432,"internally_reserved":0,"allocated":290816,"data_stored":119573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28199999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298152,"kb_used_data":864,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073688,"statfs":{"total":96636764160,"available":96331456512,"internally_reserved":0,"allocated":884736,"data_stored":709534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]}]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297572,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074268,"statfs":{"total":96636764160,"available":96332050432,"internally_reserved":0,"allocated":290816,"data_stored":119573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297576,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074264,"statfs":{"total":96636764160,"available":96332046336,"internally_reserved":0,"allocated":294912,"data_stored":119663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]}]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297592,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074248,"statfs":{"total":96636764160,"available":96332029952,"internally_reserved":0,"allocated":311296,"data_stored":123343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297580,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074260,"statfs":{"total":96636764160,"available":96332042240,"internally_reserved":0,"allocated":299008,"data_stored":120197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T01:40:40.922 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T01:40:41.064 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.062+0000 7f4e86c2e700 1 Processor -- start 2023-10-06T01:40:41.064 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.062+0000 7f4e86c2e700 1 -- start start 2023-10-06T01:40:41.066 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.063+0000 7f4e86c2e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4e800af4e0 0x7f4e800b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:41.066 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.063+0000 7f4e86c2e700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4e800af8b0 0x7f4e800b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:41.066 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.063+0000 7f4e86c2e700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e8015e190 con 0x7f4e8015d460 2023-10-06T01:40:41.067 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.063+0000 7f4e86c2e700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e800b1910 con 0x7f4e800af8b0 2023-10-06T01:40:41.067 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.063+0000 7f4e86c2e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e8015dfb0 con 0x7f4e800af4e0 2023-10-06T01:40:41.067 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.063+0000 7f4e77fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4e800af8b0 0x7f4e800b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:41.067 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.063+0000 7f4e851cb700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f4e8015d460 0x7f4e8015d8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:59372/0 (socket says 172.21.15.71:59372) 2023-10-06T01:40:41.067 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.063+0000 7f4e851cb700 1 -- 172.21.15.71:0/754175118 learned_addr learned my addr 172.21.15.71:0/754175118 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:40:41.067 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.063+0000 7f4e849ca700 1 --2- 172.21.15.71:0/754175118 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4e800af4e0 0x7f4e800b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:41.067 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.064+0000 7f4e77fff700 1 -- 172.21.15.71:0/754175118 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4e800af4e0 msgr2=0x7f4e800b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:41.067 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.064+0000 7f4e77fff700 1 --2- 172.21.15.71:0/754175118 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4e800af4e0 0x7f4e800b20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:41.067 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.064+0000 7f4e77fff700 1 -- 172.21.15.71:0/754175118 >> v1:172.21.15.71:6789/0 conn(0x7f4e8015d460 legacy=0x7f4e8015d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:41.067 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.064+0000 7f4e777fe700 1 -- 172.21.15.71:0/754175118 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 85707311 0 0) 0x7f4e8015e190 con 0x7f4e8015d460 2023-10-06T01:40:41.067 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.064+0000 7f4e77fff700 1 -- 172.21.15.71:0/754175118 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e800cb650 con 0x7f4e800af8b0 2023-10-06T01:40:41.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.064+0000 7f4e77fff700 1 --2- 172.21.15.71:0/754175118 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e800af8b0 0x7f4e800b2620 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4e700098e0 tx=0x7f4e700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99cede27d17d18e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:41.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.064+0000 7f4e777fe700 1 -- 172.21.15.71:0/754175118 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e7000b640 con 0x7f4e800af8b0 2023-10-06T01:40:41.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.064+0000 7f4e777fe700 1 -- 172.21.15.71:0/754175118 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e7000b7a0 con 0x7f4e800af8b0 2023-10-06T01:40:41.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.064+0000 7f4e777fe700 1 -- 172.21.15.71:0/754175118 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e7000bb40 con 0x7f4e800af8b0 2023-10-06T01:40:41.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.064+0000 7f4e86c2e700 1 -- 172.21.15.71:0/754175118 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e800af8b0 msgr2=0x7f4e800b2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:41.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.064+0000 7f4e86c2e700 1 --2- 172.21.15.71:0/754175118 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e800af8b0 0x7f4e800b2620 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4e700098e0 tx=0x7f4e700091a0 comp rx=0 tx=0).stop 2023-10-06T01:40:41.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.064+0000 7f4e86c2e700 1 -- 172.21.15.71:0/754175118 shutdown_connections 2023-10-06T01:40:41.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.064+0000 7f4e86c2e700 1 --2- 172.21.15.71:0/754175118 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4e800af4e0 0x7f4e800b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:41.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.064+0000 7f4e86c2e700 1 --2- 172.21.15.71:0/754175118 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e800af8b0 0x7f4e800b2620 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:41.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.064+0000 7f4e86c2e700 1 -- 172.21.15.71:0/754175118 >> 172.21.15.71:0/754175118 conn(0x7f4e80068680 msgr2=0x7f4e80068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:41.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.064+0000 7f4e86c2e700 1 -- 172.21.15.71:0/754175118 shutdown_connections 2023-10-06T01:40:41.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.064+0000 7f4e86c2e700 1 -- 172.21.15.71:0/754175118 wait complete. 2023-10-06T01:40:41.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.066+0000 7f4e86c2e700 1 Processor -- start 2023-10-06T01:40:41.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.066+0000 7f4e86c2e700 1 -- start start 2023-10-06T01:40:41.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.066+0000 7f4e86c2e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4e800af4e0 0x7f4e80169db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:41.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.066+0000 7f4e86c2e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e800af8b0 0x7f4e8016cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:41.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.067+0000 7f4e86c2e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e8015d460 0x7f4e800a8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:41.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.067+0000 7f4e86c2e700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e800b30a0 con 0x7f4e800af8b0 2023-10-06T01:40:41.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.067+0000 7f4e86c2e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e800b3c20 con 0x7f4e8015d460 2023-10-06T01:40:41.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.067+0000 7f4e86c2e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e8016a2f0 con 0x7f4e800af4e0 2023-10-06T01:40:41.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.067+0000 7f4e77fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e800af8b0 0x7f4e8016cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:41.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.067+0000 7f4e77fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e800af8b0 0x7f4e8016cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47248/0 (socket says 172.21.15.71:47248) 2023-10-06T01:40:41.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.067+0000 7f4e77fff700 1 -- 172.21.15.71:0/3160696472 learned_addr learned my addr 172.21.15.71:0/3160696472 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:41.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.067+0000 7f4e851cb700 1 --2- 172.21.15.71:0/3160696472 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e8015d460 0x7f4e800a8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:41.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.067+0000 7f4e77fff700 1 -- 172.21.15.71:0/3160696472 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4e800af4e0 msgr2=0x7f4e80169db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:41.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.067+0000 7f4e849ca700 1 --2- 172.21.15.71:0/3160696472 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4e800af4e0 0x7f4e80169db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:41.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.067+0000 7f4e77fff700 1 --2- 172.21.15.71:0/3160696472 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4e800af4e0 0x7f4e80169db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:41.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.067+0000 7f4e77fff700 1 -- 172.21.15.71:0/3160696472 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e8015d460 msgr2=0x7f4e800a8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:41.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.067+0000 7f4e77fff700 1 --2- 172.21.15.71:0/3160696472 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e8015d460 0x7f4e800a8e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:41.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.067+0000 7f4e77fff700 1 -- 172.21.15.71:0/3160696472 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e70009420 con 0x7f4e800af8b0 2023-10-06T01:40:41.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.067+0000 7f4e77fff700 1 --2- 172.21.15.71:0/3160696472 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e800af8b0 0x7f4e8016cc80 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4e70009f80 tx=0x7f4e70017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:41.073 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.067+0000 7f4e74ff9700 1 -- 172.21.15.71:0/3160696472 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e7000bb20 con 0x7f4e800af8b0 2023-10-06T01:40:41.073 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.067+0000 7f4e74ff9700 1 -- 172.21.15.71:0/3160696472 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e70011420 con 0x7f4e800af8b0 2023-10-06T01:40:41.073 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.067+0000 7f4e86c2e700 1 -- 172.21.15.71:0/3160696472 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e8016d1c0 con 0x7f4e800af8b0 2023-10-06T01:40:41.073 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.067+0000 7f4e74ff9700 1 -- 172.21.15.71:0/3160696472 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e700117a0 con 0x7f4e800af8b0 2023-10-06T01:40:41.073 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.067+0000 7f4e86c2e700 1 -- 172.21.15.71:0/3160696472 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e800b3370 con 0x7f4e800af8b0 2023-10-06T01:40:41.073 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.068+0000 7f4e86c2e700 1 -- 172.21.15.71:0/3160696472 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e800b3db0 con 0x7f4e800af8b0 2023-10-06T01:40:41.073 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.069+0000 7f4e74ff9700 1 -- 172.21.15.71:0/3160696472 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4e70011b50 con 0x7f4e800af8b0 2023-10-06T01:40:41.073 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.069+0000 7f4e74ff9700 1 --2- 172.21.15.71:0/3160696472 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f4e6c066f30 0x7f4e6c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:41.073 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.069+0000 7f4e849ca700 1 --2- 172.21.15.71:0/3160696472 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f4e6c066f30 0x7f4e6c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:41.073 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.069+0000 7f4e74ff9700 1 -- 172.21.15.71:0/3160696472 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f4e70086000 con 0x7f4e800af8b0 2023-10-06T01:40:41.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.070+0000 7f4e849ca700 1 --2- 172.21.15.71:0/3160696472 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f4e6c066f30 0x7f4e6c0693e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c006f00 tx=0x7f4e7c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:41.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.073+0000 7f4e74ff9700 1 -- 172.21.15.71:0/3160696472 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4e70052e20 con 0x7f4e800af8b0 2023-10-06T01:40:41.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.254+0000 7f4e86c2e700 1 -- 172.21.15.71:0/3160696472 --> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4e800cf330 con 0x7f4e6c066f30 2023-10-06T01:40:41.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.263+0000 7f4e74ff9700 1 -- 172.21.15.71:0/3160696472 <== mgr.4107 v2:172.21.15.71:6832/90436 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367316 (secure 0 0 0) 0x7f4e800cf330 con 0x7f4e6c066f30 2023-10-06T01:40:41.269 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:40:41.273 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.267+0000 7f4e86c2e700 1 -- 172.21.15.71:0/3160696472 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f4e6c066f30 msgr2=0x7f4e6c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:41.273 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.267+0000 7f4e86c2e700 1 --2- 172.21.15.71:0/3160696472 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f4e6c066f30 0x7f4e6c0693e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c006f00 tx=0x7f4e7c008040 comp rx=0 tx=0).stop 2023-10-06T01:40:41.273 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.267+0000 7f4e86c2e700 1 -- 172.21.15.71:0/3160696472 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e800af8b0 msgr2=0x7f4e8016cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:41.273 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.267+0000 7f4e86c2e700 1 --2- 172.21.15.71:0/3160696472 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e800af8b0 0x7f4e8016cc80 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4e70009f80 tx=0x7f4e70017000 comp rx=0 tx=0).stop 2023-10-06T01:40:41.273 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.267+0000 7f4e86c2e700 1 -- 172.21.15.71:0/3160696472 shutdown_connections 2023-10-06T01:40:41.273 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.267+0000 7f4e86c2e700 1 --2- 172.21.15.71:0/3160696472 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f4e6c066f30 0x7f4e6c0693e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:41.273 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.267+0000 7f4e86c2e700 1 --2- 172.21.15.71:0/3160696472 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e8015d460 0x7f4e800a8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:41.273 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.267+0000 7f4e86c2e700 1 --2- 172.21.15.71:0/3160696472 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4e800af4e0 0x7f4e80169db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:41.274 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.267+0000 7f4e86c2e700 1 --2- 172.21.15.71:0/3160696472 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e800af8b0 0x7f4e8016cc80 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:41.274 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.267+0000 7f4e86c2e700 1 -- 172.21.15.71:0/3160696472 >> 172.21.15.71:0/3160696472 conn(0x7f4e80068680 msgr2=0x7f4e800ce9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:41.274 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.267+0000 7f4e86c2e700 1 -- 172.21.15.71:0/3160696472 shutdown_connections 2023-10-06T01:40:41.274 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.267+0000 7f4e86c2e700 1 -- 172.21.15.71:0/3160696472 wait complete. 2023-10-06T01:40:41.274 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2023-10-06T01:40:41.280 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2023-10-06T01:40:40.566547+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594852,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381796,"kb_used_data":3492,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752592924,"statfs":{"total":773094113280,"available":770655154176,"internally_reserved":0,"allocated":3575808,"data_stored":2145327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2178,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003090"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.827077+0000","last_change":"2023-10-06T01:40:21.784720+0000","last_active":"2023-10-06T01:40:25.827077+0000","last_peered":"2023-10-06T01:40:25.827077+0000","last_clean":"2023-10-06T01:40:25.827077+0000","last_became_active":"2023-10-06T01:40:21.784463+0000","last_became_peered":"2023-10-06T01:40:21.784463+0000","last_unstale":"2023-10-06T01:40:25.827077+0000","last_undegraded":"2023-10-06T01:40:25.827077+0000","last_fullsized":"2023-10-06T01:40:25.827077+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:06:11.014583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821980+0000","last_change":"2023-10-06T01:40:21.795765+0000","last_active":"2023-10-06T01:40:25.821980+0000","last_peered":"2023-10-06T01:40:25.821980+0000","last_clean":"2023-10-06T01:40:25.821980+0000","last_became_active":"2023-10-06T01:40:21.795508+0000","last_became_peered":"2023-10-06T01:40:21.795508+0000","last_unstale":"2023-10-06T01:40:25.821980+0000","last_undegraded":"2023-10-06T01:40:25.821980+0000","last_fullsized":"2023-10-06T01:40:25.821980+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:24:04.737047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.829737+0000","last_change":"2023-10-06T01:40:21.801764+0000","last_active":"2023-10-06T01:40:25.829737+0000","last_peered":"2023-10-06T01:40:25.829737+0000","last_clean":"2023-10-06T01:40:25.829737+0000","last_became_active":"2023-10-06T01:40:21.801511+0000","last_became_peered":"2023-10-06T01:40:21.801511+0000","last_unstale":"2023-10-06T01:40:25.829737+0000","last_undegraded":"2023-10-06T01:40:25.829737+0000","last_fullsized":"2023-10-06T01:40:25.829737+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:53:19.501226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.824060+0000","last_change":"2023-10-06T01:40:21.796935+0000","last_active":"2023-10-06T01:40:25.824060+0000","last_peered":"2023-10-06T01:40:25.824060+0000","last_clean":"2023-10-06T01:40:25.824060+0000","last_became_active":"2023-10-06T01:40:21.796664+0000","last_became_peered":"2023-10-06T01:40:21.796664+0000","last_unstale":"2023-10-06T01:40:25.824060+0000","last_undegraded":"2023-10-06T01:40:25.824060+0000","last_fullsized":"2023-10-06T01:40:25.824060+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:18:43.064747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.838848+0000","last_change":"2023-10-06T01:40:21.798926+0000","last_active":"2023-10-06T01:40:25.838848+0000","last_peered":"2023-10-06T01:40:25.838848+0000","last_clean":"2023-10-06T01:40:25.838848+0000","last_became_active":"2023-10-06T01:40:21.798342+0000","last_became_peered":"2023-10-06T01:40:21.798342+0000","last_unstale":"2023-10-06T01:40:25.838848+0000","last_undegraded":"2023-10-06T01:40:25.838848+0000","last_fullsized":"2023-10-06T01:40:25.838848+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:29:36.526509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.832097+0000","last_change":"2023-10-06T01:40:21.801493+0000","last_active":"2023-10-06T01:40:25.832097+0000","last_peered":"2023-10-06T01:40:25.832097+0000","last_clean":"2023-10-06T01:40:25.832097+0000","last_became_active":"2023-10-06T01:40:21.801200+0000","last_became_peered":"2023-10-06T01:40:21.801200+0000","last_unstale":"2023-10-06T01:40:25.832097+0000","last_undegraded":"2023-10-06T01:40:25.832097+0000","last_fullsized":"2023-10-06T01:40:25.832097+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:16:01.004830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.836158+0000","last_change":"2023-10-06T01:40:21.797032+0000","last_active":"2023-10-06T01:40:25.836158+0000","last_peered":"2023-10-06T01:40:25.836158+0000","last_clean":"2023-10-06T01:40:25.836158+0000","last_became_active":"2023-10-06T01:40:21.796712+0000","last_became_peered":"2023-10-06T01:40:21.796712+0000","last_unstale":"2023-10-06T01:40:25.836158+0000","last_undegraded":"2023-10-06T01:40:25.836158+0000","last_fullsized":"2023-10-06T01:40:25.836158+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:04.038873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821476+0000","last_change":"2023-10-06T01:40:21.791132+0000","last_active":"2023-10-06T01:40:25.821476+0000","last_peered":"2023-10-06T01:40:25.821476+0000","last_clean":"2023-10-06T01:40:25.821476+0000","last_became_active":"2023-10-06T01:40:21.790446+0000","last_became_peered":"2023-10-06T01:40:21.790446+0000","last_unstale":"2023-10-06T01:40:25.821476+0000","last_undegraded":"2023-10-06T01:40:25.821476+0000","last_fullsized":"2023-10-06T01:40:25.821476+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:40:45.624442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.839970+0000","last_change":"2023-10-06T01:40:21.793869+0000","last_active":"2023-10-06T01:40:25.839970+0000","last_peered":"2023-10-06T01:40:25.839970+0000","last_clean":"2023-10-06T01:40:25.839970+0000","last_became_active":"2023-10-06T01:40:21.793596+0000","last_became_peered":"2023-10-06T01:40:21.793596+0000","last_unstale":"2023-10-06T01:40:25.839970+0000","last_undegraded":"2023-10-06T01:40:25.839970+0000","last_fullsized":"2023-10-06T01:40:25.839970+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:24:04.737047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.822068+0000","last_change":"2023-10-06T01:40:21.798541+0000","last_active":"2023-10-06T01:40:25.822068+0000","last_peered":"2023-10-06T01:40:25.822068+0000","last_clean":"2023-10-06T01:40:25.822068+0000","last_became_active":"2023-10-06T01:40:21.798271+0000","last_became_peered":"2023-10-06T01:40:21.798271+0000","last_unstale":"2023-10-06T01:40:25.822068+0000","last_undegraded":"2023-10-06T01:40:25.822068+0000","last_fullsized":"2023-10-06T01:40:25.822068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:14:30.814494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.829653+0000","last_change":"2023-10-06T01:40:21.798043+0000","last_active":"2023-10-06T01:40:25.829653+0000","last_peered":"2023-10-06T01:40:25.829653+0000","last_clean":"2023-10-06T01:40:25.829653+0000","last_became_active":"2023-10-06T01:40:21.797768+0000","last_became_peered":"2023-10-06T01:40:21.797768+0000","last_unstale":"2023-10-06T01:40:25.829653+0000","last_undegraded":"2023-10-06T01:40:25.829653+0000","last_fullsized":"2023-10-06T01:40:25.829653+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:39:44.521327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.826805+0000","last_change":"2023-10-06T01:40:21.783366+0000","last_active":"2023-10-06T01:40:25.826805+0000","last_peered":"2023-10-06T01:40:25.826805+0000","last_clean":"2023-10-06T01:40:25.826805+0000","last_became_active":"2023-10-06T01:40:21.783102+0000","last_became_peered":"2023-10-06T01:40:21.783102+0000","last_unstale":"2023-10-06T01:40:25.826805+0000","last_undegraded":"2023-10-06T01:40:25.826805+0000","last_fullsized":"2023-10-06T01:40:25.826805+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:22:12.634757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.826660+0000","last_change":"2023-10-06T01:40:21.789603+0000","last_active":"2023-10-06T01:40:25.826660+0000","last_peered":"2023-10-06T01:40:25.826660+0000","last_clean":"2023-10-06T01:40:25.826660+0000","last_became_active":"2023-10-06T01:40:21.789423+0000","last_became_peered":"2023-10-06T01:40:21.789423+0000","last_unstale":"2023-10-06T01:40:25.826660+0000","last_undegraded":"2023-10-06T01:40:25.826660+0000","last_fullsized":"2023-10-06T01:40:25.826660+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:26:04.581987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821407+0000","last_change":"2023-10-06T01:40:21.786154+0000","last_active":"2023-10-06T01:40:25.821407+0000","last_peered":"2023-10-06T01:40:25.821407+0000","last_clean":"2023-10-06T01:40:25.821407+0000","last_became_active":"2023-10-06T01:40:21.785883+0000","last_became_peered":"2023-10-06T01:40:21.785883+0000","last_unstale":"2023-10-06T01:40:25.821407+0000","last_undegraded":"2023-10-06T01:40:25.821407+0000","last_fullsized":"2023-10-06T01:40:25.821407+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:58:41.783343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.835961+0000","last_change":"2023-10-06T01:40:21.794272+0000","last_active":"2023-10-06T01:40:25.835961+0000","last_peered":"2023-10-06T01:40:25.835961+0000","last_clean":"2023-10-06T01:40:25.835961+0000","last_became_active":"2023-10-06T01:40:21.794004+0000","last_became_peered":"2023-10-06T01:40:21.794004+0000","last_unstale":"2023-10-06T01:40:25.835961+0000","last_undegraded":"2023-10-06T01:40:25.835961+0000","last_fullsized":"2023-10-06T01:40:25.835961+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:14:30.814494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.830236+0000","last_change":"2023-10-06T01:40:21.799382+0000","last_active":"2023-10-06T01:40:25.830236+0000","last_peered":"2023-10-06T01:40:25.830236+0000","last_clean":"2023-10-06T01:40:25.830236+0000","last_became_active":"2023-10-06T01:40:21.799078+0000","last_became_peered":"2023-10-06T01:40:21.799078+0000","last_unstale":"2023-10-06T01:40:25.830236+0000","last_undegraded":"2023-10-06T01:40:25.830236+0000","last_fullsized":"2023-10-06T01:40:25.830236+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:09:24.820551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.840050+0000","last_change":"2023-10-06T01:40:21.793399+0000","last_active":"2023-10-06T01:40:25.840050+0000","last_peered":"2023-10-06T01:40:25.840050+0000","last_clean":"2023-10-06T01:40:25.840050+0000","last_became_active":"2023-10-06T01:40:21.793155+0000","last_became_peered":"2023-10-06T01:40:21.793155+0000","last_unstale":"2023-10-06T01:40:25.840050+0000","last_undegraded":"2023-10-06T01:40:25.840050+0000","last_fullsized":"2023-10-06T01:40:25.840050+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:58:41.783343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.827729+0000","last_change":"2023-10-06T01:40:21.796081+0000","last_active":"2023-10-06T01:40:25.827729+0000","last_peered":"2023-10-06T01:40:25.827729+0000","last_clean":"2023-10-06T01:40:25.827729+0000","last_became_active":"2023-10-06T01:40:21.795755+0000","last_became_peered":"2023-10-06T01:40:21.795755+0000","last_unstale":"2023-10-06T01:40:25.827729+0000","last_undegraded":"2023-10-06T01:40:25.827729+0000","last_fullsized":"2023-10-06T01:40:25.827729+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:26:01.813573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.826585+0000","last_change":"2023-10-06T01:40:21.783713+0000","last_active":"2023-10-06T01:40:25.826585+0000","last_peered":"2023-10-06T01:40:25.826585+0000","last_clean":"2023-10-06T01:40:25.826585+0000","last_became_active":"2023-10-06T01:40:21.783410+0000","last_became_peered":"2023-10-06T01:40:21.783410+0000","last_unstale":"2023-10-06T01:40:25.826585+0000","last_undegraded":"2023-10-06T01:40:25.826585+0000","last_fullsized":"2023-10-06T01:40:25.826585+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:08:57.248267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.830504+0000","last_change":"2023-10-06T01:40:21.784490+0000","last_active":"2023-10-06T01:40:25.830504+0000","last_peered":"2023-10-06T01:40:25.830504+0000","last_clean":"2023-10-06T01:40:25.830504+0000","last_became_active":"2023-10-06T01:40:21.783963+0000","last_became_peered":"2023-10-06T01:40:21.783963+0000","last_unstale":"2023-10-06T01:40:25.830504+0000","last_undegraded":"2023-10-06T01:40:25.830504+0000","last_fullsized":"2023-10-06T01:40:25.830504+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:57:45.536353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.827932+0000","last_change":"2023-10-06T01:40:21.800162+0000","last_active":"2023-10-06T01:40:25.827932+0000","last_peered":"2023-10-06T01:40:25.827932+0000","last_clean":"2023-10-06T01:40:25.827932+0000","last_became_active":"2023-10-06T01:40:21.799563+0000","last_became_peered":"2023-10-06T01:40:21.799563+0000","last_unstale":"2023-10-06T01:40:25.827932+0000","last_undegraded":"2023-10-06T01:40:25.827932+0000","last_fullsized":"2023-10-06T01:40:25.827932+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:26:58.497171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.838626+0000","last_change":"2023-10-06T01:40:21.794761+0000","last_active":"2023-10-06T01:40:25.838626+0000","last_peered":"2023-10-06T01:40:25.838626+0000","last_clean":"2023-10-06T01:40:25.838626+0000","last_became_active":"2023-10-06T01:40:21.794528+0000","last_became_peered":"2023-10-06T01:40:21.794528+0000","last_unstale":"2023-10-06T01:40:25.838626+0000","last_undegraded":"2023-10-06T01:40:25.838626+0000","last_fullsized":"2023-10-06T01:40:25.838626+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:40:45.624442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821624+0000","last_change":"2023-10-06T01:40:21.797159+0000","last_active":"2023-10-06T01:40:25.821624+0000","last_peered":"2023-10-06T01:40:25.821624+0000","last_clean":"2023-10-06T01:40:25.821624+0000","last_became_active":"2023-10-06T01:40:21.796930+0000","last_became_peered":"2023-10-06T01:40:21.796930+0000","last_unstale":"2023-10-06T01:40:25.821624+0000","last_undegraded":"2023-10-06T01:40:25.821624+0000","last_fullsized":"2023-10-06T01:40:25.821624+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:14:30.814494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.831663+0000","last_change":"2023-10-06T01:40:21.800667+0000","last_active":"2023-10-06T01:40:25.831663+0000","last_peered":"2023-10-06T01:40:25.831663+0000","last_clean":"2023-10-06T01:40:25.831663+0000","last_became_active":"2023-10-06T01:40:21.799665+0000","last_became_peered":"2023-10-06T01:40:21.799665+0000","last_unstale":"2023-10-06T01:40:25.831663+0000","last_undegraded":"2023-10-06T01:40:25.831663+0000","last_fullsized":"2023-10-06T01:40:25.831663+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:29:36.526509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.829892+0000","last_change":"2023-10-06T01:40:21.795383+0000","last_active":"2023-10-06T01:40:25.829892+0000","last_peered":"2023-10-06T01:40:25.829892+0000","last_clean":"2023-10-06T01:40:25.829892+0000","last_became_active":"2023-10-06T01:40:21.794463+0000","last_became_peered":"2023-10-06T01:40:21.794463+0000","last_unstale":"2023-10-06T01:40:25.829892+0000","last_undegraded":"2023-10-06T01:40:25.829892+0000","last_fullsized":"2023-10-06T01:40:25.829892+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:15:52.031555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.827471+0000","last_change":"2023-10-06T01:40:21.787299+0000","last_active":"2023-10-06T01:40:25.827471+0000","last_peered":"2023-10-06T01:40:25.827471+0000","last_clean":"2023-10-06T01:40:25.827471+0000","last_became_active":"2023-10-06T01:40:21.786459+0000","last_became_peered":"2023-10-06T01:40:21.786459+0000","last_unstale":"2023-10-06T01:40:25.827471+0000","last_undegraded":"2023-10-06T01:40:25.827471+0000","last_fullsized":"2023-10-06T01:40:25.827471+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:29:49.863294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.822035+0000","last_change":"2023-10-06T01:40:21.798180+0000","last_active":"2023-10-06T01:40:25.822035+0000","last_peered":"2023-10-06T01:40:25.822035+0000","last_clean":"2023-10-06T01:40:25.822035+0000","last_became_active":"2023-10-06T01:40:21.797919+0000","last_became_peered":"2023-10-06T01:40:21.797919+0000","last_unstale":"2023-10-06T01:40:25.822035+0000","last_undegraded":"2023-10-06T01:40:25.822035+0000","last_fullsized":"2023-10-06T01:40:25.822035+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:29:36.526509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.853335+0000","last_change":"2023-10-06T01:40:25.847570+0000","last_active":"2023-10-06T01:40:25.853335+0000","last_peered":"2023-10-06T01:40:25.853335+0000","last_clean":"2023-10-06T01:40:25.853335+0000","last_became_active":"2023-10-06T01:40:25.843197+0000","last_became_peered":"2023-10-06T01:40:25.843197+0000","last_unstale":"2023-10-06T01:40:25.853335+0000","last_undegraded":"2023-10-06T01:40:25.853335+0000","last_fullsized":"2023-10-06T01:40:25.853335+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:44:41.539390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.832007+0000","last_change":"2023-10-06T01:40:20.794740+0000","last_active":"2023-10-06T01:40:25.832007+0000","last_peered":"2023-10-06T01:40:25.832007+0000","last_clean":"2023-10-06T01:40:25.832007+0000","last_became_active":"2023-10-06T01:40:20.794508+0000","last_became_peered":"2023-10-06T01:40:20.794508+0000","last_unstale":"2023-10-06T01:40:25.832007+0000","last_undegraded":"2023-10-06T01:40:25.832007+0000","last_fullsized":"2023-10-06T01:40:25.832007+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:28:17.373431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821586+0000","last_change":"2023-10-06T01:40:21.792738+0000","last_active":"2023-10-06T01:40:25.821586+0000","last_peered":"2023-10-06T01:40:25.821586+0000","last_clean":"2023-10-06T01:40:25.821586+0000","last_became_active":"2023-10-06T01:40:21.792508+0000","last_became_peered":"2023-10-06T01:40:21.792508+0000","last_unstale":"2023-10-06T01:40:25.821586+0000","last_undegraded":"2023-10-06T01:40:25.821586+0000","last_fullsized":"2023-10-06T01:40:25.821586+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:04.038873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.847437+0000","last_change":"2023-10-06T01:40:25.841407+0000","last_active":"2023-10-06T01:40:25.847437+0000","last_peered":"2023-10-06T01:40:25.847437+0000","last_clean":"2023-10-06T01:40:25.847437+0000","last_became_active":"2023-10-06T01:40:25.840998+0000","last_became_peered":"2023-10-06T01:40:25.840998+0000","last_unstale":"2023-10-06T01:40:25.847437+0000","last_undegraded":"2023-10-06T01:40:25.847437+0000","last_fullsized":"2023-10-06T01:40:25.847437+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:24:24.646258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.829628+0000","last_change":"2023-10-06T01:40:20.784535+0000","last_active":"2023-10-06T01:40:25.829628+0000","last_peered":"2023-10-06T01:40:25.829628+0000","last_clean":"2023-10-06T01:40:25.829628+0000","last_became_active":"2023-10-06T01:40:20.784266+0000","last_became_peered":"2023-10-06T01:40:20.784266+0000","last_unstale":"2023-10-06T01:40:25.829628+0000","last_undegraded":"2023-10-06T01:40:25.829628+0000","last_fullsized":"2023-10-06T01:40:25.829628+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:05:51.063526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.839509+0000","last_change":"2023-10-06T01:40:21.796914+0000","last_active":"2023-10-06T01:40:25.839509+0000","last_peered":"2023-10-06T01:40:25.839509+0000","last_clean":"2023-10-06T01:40:25.839509+0000","last_became_active":"2023-10-06T01:40:21.796645+0000","last_became_peered":"2023-10-06T01:40:21.796645+0000","last_unstale":"2023-10-06T01:40:25.839509+0000","last_undegraded":"2023-10-06T01:40:25.839509+0000","last_fullsized":"2023-10-06T01:40:25.839509+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:26:01.813573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.859114+0000","last_change":"2023-10-06T01:40:25.852718+0000","last_active":"2023-10-06T01:40:25.859114+0000","last_peered":"2023-10-06T01:40:25.859114+0000","last_clean":"2023-10-06T01:40:25.859114+0000","last_became_active":"2023-10-06T01:40:25.852410+0000","last_became_peered":"2023-10-06T01:40:25.852410+0000","last_unstale":"2023-10-06T01:40:25.859114+0000","last_undegraded":"2023-10-06T01:40:25.859114+0000","last_fullsized":"2023-10-06T01:40:25.859114+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:51:20.741996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.822073+0000","last_change":"2023-10-06T01:40:20.791628+0000","last_active":"2023-10-06T01:40:25.822073+0000","last_peered":"2023-10-06T01:40:25.822073+0000","last_clean":"2023-10-06T01:40:25.822073+0000","last_became_active":"2023-10-06T01:40:20.791350+0000","last_became_peered":"2023-10-06T01:40:20.791350+0000","last_unstale":"2023-10-06T01:40:25.822073+0000","last_undegraded":"2023-10-06T01:40:25.822073+0000","last_fullsized":"2023-10-06T01:40:25.822073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:40:52.187918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.824300+0000","last_change":"2023-10-06T01:40:21.784888+0000","last_active":"2023-10-06T01:40:25.824300+0000","last_peered":"2023-10-06T01:40:25.824300+0000","last_clean":"2023-10-06T01:40:25.824300+0000","last_became_active":"2023-10-06T01:40:21.784543+0000","last_became_peered":"2023-10-06T01:40:21.784543+0000","last_unstale":"2023-10-06T01:40:25.824300+0000","last_undegraded":"2023-10-06T01:40:25.824300+0000","last_fullsized":"2023-10-06T01:40:25.824300+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:22:12.634757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.852270+0000","last_change":"2023-10-06T01:40:25.846891+0000","last_active":"2023-10-06T01:40:25.852270+0000","last_peered":"2023-10-06T01:40:25.852270+0000","last_clean":"2023-10-06T01:40:25.852270+0000","last_became_active":"2023-10-06T01:40:25.846500+0000","last_became_peered":"2023-10-06T01:40:25.846500+0000","last_unstale":"2023-10-06T01:40:25.852270+0000","last_undegraded":"2023-10-06T01:40:25.852270+0000","last_fullsized":"2023-10-06T01:40:25.852270+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:08:08.709318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.840125+0000","last_change":"2023-10-06T01:40:20.792032+0000","last_active":"2023-10-06T01:40:25.840125+0000","last_peered":"2023-10-06T01:40:25.840125+0000","last_clean":"2023-10-06T01:40:25.840125+0000","last_became_active":"2023-10-06T01:40:20.791755+0000","last_became_peered":"2023-10-06T01:40:20.791755+0000","last_unstale":"2023-10-06T01:40:25.840125+0000","last_undegraded":"2023-10-06T01:40:25.840125+0000","last_fullsized":"2023-10-06T01:40:25.840125+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:26:03.577908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821783+0000","last_change":"2023-10-06T01:40:21.784165+0000","last_active":"2023-10-06T01:40:25.821783+0000","last_peered":"2023-10-06T01:40:25.821783+0000","last_clean":"2023-10-06T01:40:25.821783+0000","last_became_active":"2023-10-06T01:40:21.783915+0000","last_became_peered":"2023-10-06T01:40:21.783915+0000","last_unstale":"2023-10-06T01:40:25.821783+0000","last_undegraded":"2023-10-06T01:40:25.821783+0000","last_fullsized":"2023-10-06T01:40:25.821783+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:24:04.737047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.854974+0000","last_change":"2023-10-06T01:40:25.844941+0000","last_active":"2023-10-06T01:40:25.854974+0000","last_peered":"2023-10-06T01:40:25.854974+0000","last_clean":"2023-10-06T01:40:25.854974+0000","last_became_active":"2023-10-06T01:40:25.844514+0000","last_became_peered":"2023-10-06T01:40:25.844514+0000","last_unstale":"2023-10-06T01:40:25.854974+0000","last_undegraded":"2023-10-06T01:40:25.854974+0000","last_fullsized":"2023-10-06T01:40:25.854974+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:47:01.253527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821998+0000","last_change":"2023-10-06T01:40:20.791960+0000","last_active":"2023-10-06T01:40:25.821998+0000","last_peered":"2023-10-06T01:40:25.821998+0000","last_clean":"2023-10-06T01:40:25.821998+0000","last_became_active":"2023-10-06T01:40:20.791726+0000","last_became_peered":"2023-10-06T01:40:20.791726+0000","last_unstale":"2023-10-06T01:40:25.821998+0000","last_undegraded":"2023-10-06T01:40:25.821998+0000","last_fullsized":"2023-10-06T01:40:25.821998+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:26:03.577908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821717+0000","last_change":"2023-10-06T01:40:21.788771+0000","last_active":"2023-10-06T01:40:25.821717+0000","last_peered":"2023-10-06T01:40:25.821717+0000","last_clean":"2023-10-06T01:40:25.821717+0000","last_became_active":"2023-10-06T01:40:21.788485+0000","last_became_peered":"2023-10-06T01:40:21.788485+0000","last_unstale":"2023-10-06T01:40:25.821717+0000","last_undegraded":"2023-10-06T01:40:25.821717+0000","last_fullsized":"2023-10-06T01:40:25.821717+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:26:01.813573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.856408+0000","last_change":"2023-10-06T01:40:25.843843+0000","last_active":"2023-10-06T01:40:25.856408+0000","last_peered":"2023-10-06T01:40:25.856408+0000","last_clean":"2023-10-06T01:40:25.856408+0000","last_became_active":"2023-10-06T01:40:25.843513+0000","last_became_peered":"2023-10-06T01:40:25.843513+0000","last_unstale":"2023-10-06T01:40:25.856408+0000","last_undegraded":"2023-10-06T01:40:25.856408+0000","last_fullsized":"2023-10-06T01:40:25.856408+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:45.054717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.829858+0000","last_change":"2023-10-06T01:40:20.794114+0000","last_active":"2023-10-06T01:40:25.829858+0000","last_peered":"2023-10-06T01:40:25.829858+0000","last_clean":"2023-10-06T01:40:25.829858+0000","last_became_active":"2023-10-06T01:40:20.793858+0000","last_became_peered":"2023-10-06T01:40:20.793858+0000","last_unstale":"2023-10-06T01:40:25.829858+0000","last_undegraded":"2023-10-06T01:40:25.829858+0000","last_fullsized":"2023-10-06T01:40:25.829858+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:18:42.060669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.827126+0000","last_change":"2023-10-06T01:40:21.794943+0000","last_active":"2023-10-06T01:40:25.827126+0000","last_peered":"2023-10-06T01:40:25.827126+0000","last_clean":"2023-10-06T01:40:25.827126+0000","last_became_active":"2023-10-06T01:40:21.794481+0000","last_became_peered":"2023-10-06T01:40:21.794481+0000","last_unstale":"2023-10-06T01:40:25.827126+0000","last_undegraded":"2023-10-06T01:40:25.827126+0000","last_fullsized":"2023-10-06T01:40:25.827126+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:29:36.526509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.853325+0000","last_change":"2023-10-06T01:40:25.844703+0000","last_active":"2023-10-06T01:40:25.853325+0000","last_peered":"2023-10-06T01:40:25.853325+0000","last_clean":"2023-10-06T01:40:25.853325+0000","last_became_active":"2023-10-06T01:40:25.844372+0000","last_became_peered":"2023-10-06T01:40:25.844372+0000","last_unstale":"2023-10-06T01:40:25.853325+0000","last_undegraded":"2023-10-06T01:40:25.853325+0000","last_fullsized":"2023-10-06T01:40:25.853325+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:09:02.303009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'9","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T01:40:31.572781+0000","last_change":"2023-10-06T01:40:20.794127+0000","last_active":"2023-10-06T01:40:31.572781+0000","last_peered":"2023-10-06T01:40:31.572781+0000","last_clean":"2023-10-06T01:40:31.572781+0000","last_became_active":"2023-10-06T01:40:20.793873+0000","last_became_peered":"2023-10-06T01:40:20.793873+0000","last_unstale":"2023-10-06T01:40:31.572781+0000","last_undegraded":"2023-10-06T01:40:31.572781+0000","last_fullsized":"2023-10-06T01:40:31.572781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:05:51.063526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3714,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.830525+0000","last_change":"2023-10-06T01:40:21.783742+0000","last_active":"2023-10-06T01:40:25.830525+0000","last_peered":"2023-10-06T01:40:25.830525+0000","last_clean":"2023-10-06T01:40:25.830525+0000","last_became_active":"2023-10-06T01:40:21.783474+0000","last_became_peered":"2023-10-06T01:40:21.783474+0000","last_unstale":"2023-10-06T01:40:25.830525+0000","last_undegraded":"2023-10-06T01:40:25.830525+0000","last_fullsized":"2023-10-06T01:40:25.830525+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:40:45.624442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.855108+0000","last_change":"2023-10-06T01:40:25.850810+0000","last_active":"2023-10-06T01:40:25.855108+0000","last_peered":"2023-10-06T01:40:25.855108+0000","last_clean":"2023-10-06T01:40:25.855108+0000","last_became_active":"2023-10-06T01:40:25.850440+0000","last_became_peered":"2023-10-06T01:40:25.850440+0000","last_unstale":"2023-10-06T01:40:25.855108+0000","last_undegraded":"2023-10-06T01:40:25.855108+0000","last_fullsized":"2023-10-06T01:40:25.855108+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:12:18.042310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.827851+0000","last_change":"2023-10-06T01:40:20.795471+0000","last_active":"2023-10-06T01:40:25.827851+0000","last_peered":"2023-10-06T01:40:25.827851+0000","last_clean":"2023-10-06T01:40:25.827851+0000","last_became_active":"2023-10-06T01:40:20.795162+0000","last_became_peered":"2023-10-06T01:40:20.795162+0000","last_unstale":"2023-10-06T01:40:25.827851+0000","last_undegraded":"2023-10-06T01:40:25.827851+0000","last_fullsized":"2023-10-06T01:40:25.827851+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:42:39.472271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.822047+0000","last_change":"2023-10-06T01:40:21.792919+0000","last_active":"2023-10-06T01:40:25.822047+0000","last_peered":"2023-10-06T01:40:25.822047+0000","last_clean":"2023-10-06T01:40:25.822047+0000","last_became_active":"2023-10-06T01:40:21.792603+0000","last_became_peered":"2023-10-06T01:40:21.792603+0000","last_unstale":"2023-10-06T01:40:25.822047+0000","last_undegraded":"2023-10-06T01:40:25.822047+0000","last_fullsized":"2023-10-06T01:40:25.822047+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:58:41.783343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.842053+0000","last_change":"2023-10-06T01:40:25.837982+0000","last_active":"2023-10-06T01:40:25.842053+0000","last_peered":"2023-10-06T01:40:25.842053+0000","last_clean":"2023-10-06T01:40:25.842053+0000","last_became_active":"2023-10-06T01:40:25.837550+0000","last_became_peered":"2023-10-06T01:40:25.837550+0000","last_unstale":"2023-10-06T01:40:25.842053+0000","last_undegraded":"2023-10-06T01:40:25.842053+0000","last_fullsized":"2023-10-06T01:40:25.842053+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:44:33.571977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.838551+0000","last_change":"2023-10-06T01:40:20.791355+0000","last_active":"2023-10-06T01:40:25.838551+0000","last_peered":"2023-10-06T01:40:25.838551+0000","last_clean":"2023-10-06T01:40:25.838551+0000","last_became_active":"2023-10-06T01:40:20.791101+0000","last_became_peered":"2023-10-06T01:40:20.791101+0000","last_unstale":"2023-10-06T01:40:25.838551+0000","last_undegraded":"2023-10-06T01:40:25.838551+0000","last_fullsized":"2023-10-06T01:40:25.838551+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:36.984892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821895+0000","last_change":"2023-10-06T01:40:21.798155+0000","last_active":"2023-10-06T01:40:25.821895+0000","last_peered":"2023-10-06T01:40:25.821895+0000","last_clean":"2023-10-06T01:40:25.821895+0000","last_became_active":"2023-10-06T01:40:21.797870+0000","last_became_peered":"2023-10-06T01:40:21.797870+0000","last_unstale":"2023-10-06T01:40:25.821895+0000","last_undegraded":"2023-10-06T01:40:25.821895+0000","last_fullsized":"2023-10-06T01:40:25.821895+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:04.038873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.856540+0000","last_change":"2023-10-06T01:40:25.845625+0000","last_active":"2023-10-06T01:40:25.856540+0000","last_peered":"2023-10-06T01:40:25.856540+0000","last_clean":"2023-10-06T01:40:25.856540+0000","last_became_active":"2023-10-06T01:40:25.845267+0000","last_became_peered":"2023-10-06T01:40:25.845267+0000","last_unstale":"2023-10-06T01:40:25.856540+0000","last_undegraded":"2023-10-06T01:40:25.856540+0000","last_fullsized":"2023-10-06T01:40:25.856540+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:22:48.941644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.836049+0000","last_change":"2023-10-06T01:40:20.795272+0000","last_active":"2023-10-06T01:40:25.836049+0000","last_peered":"2023-10-06T01:40:25.836049+0000","last_clean":"2023-10-06T01:40:25.836049+0000","last_became_active":"2023-10-06T01:40:20.795001+0000","last_became_peered":"2023-10-06T01:40:20.795001+0000","last_unstale":"2023-10-06T01:40:25.836049+0000","last_undegraded":"2023-10-06T01:40:25.836049+0000","last_fullsized":"2023-10-06T01:40:25.836049+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:08:56.244189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.839584+0000","last_change":"2023-10-06T01:40:21.793411+0000","last_active":"2023-10-06T01:40:25.839584+0000","last_peered":"2023-10-06T01:40:25.839584+0000","last_clean":"2023-10-06T01:40:25.839584+0000","last_became_active":"2023-10-06T01:40:21.793189+0000","last_became_peered":"2023-10-06T01:40:21.793189+0000","last_unstale":"2023-10-06T01:40:25.839584+0000","last_undegraded":"2023-10-06T01:40:25.839584+0000","last_fullsized":"2023-10-06T01:40:25.839584+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:39:44.521327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.848998+0000","last_change":"2023-10-06T01:40:25.844926+0000","last_active":"2023-10-06T01:40:25.848998+0000","last_peered":"2023-10-06T01:40:25.848998+0000","last_clean":"2023-10-06T01:40:25.848998+0000","last_became_active":"2023-10-06T01:40:25.844538+0000","last_became_peered":"2023-10-06T01:40:25.844538+0000","last_unstale":"2023-10-06T01:40:25.848998+0000","last_undegraded":"2023-10-06T01:40:25.848998+0000","last_fullsized":"2023-10-06T01:40:25.848998+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:09:02.303009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.822780+0000","last_change":"2023-10-06T01:40:20.791595+0000","last_active":"2023-10-06T01:40:25.822780+0000","last_peered":"2023-10-06T01:40:25.822780+0000","last_clean":"2023-10-06T01:40:25.822780+0000","last_became_active":"2023-10-06T01:40:20.791307+0000","last_became_peered":"2023-10-06T01:40:20.791307+0000","last_unstale":"2023-10-06T01:40:25.822780+0000","last_undegraded":"2023-10-06T01:40:25.822780+0000","last_fullsized":"2023-10-06T01:40:25.822780+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:28:17.373431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.822628+0000","last_change":"2023-10-06T01:40:21.799944+0000","last_active":"2023-10-06T01:40:25.822628+0000","last_peered":"2023-10-06T01:40:25.822628+0000","last_clean":"2023-10-06T01:40:25.822628+0000","last_became_active":"2023-10-06T01:40:21.799450+0000","last_became_peered":"2023-10-06T01:40:21.799450+0000","last_unstale":"2023-10-06T01:40:25.822628+0000","last_undegraded":"2023-10-06T01:40:25.822628+0000","last_fullsized":"2023-10-06T01:40:25.822628+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:40:45.624442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.855175+0000","last_change":"2023-10-06T01:40:25.846371+0000","last_active":"2023-10-06T01:40:25.855175+0000","last_peered":"2023-10-06T01:40:25.855175+0000","last_clean":"2023-10-06T01:40:25.855175+0000","last_became_active":"2023-10-06T01:40:25.845988+0000","last_became_peered":"2023-10-06T01:40:25.845988+0000","last_unstale":"2023-10-06T01:40:25.855175+0000","last_undegraded":"2023-10-06T01:40:25.855175+0000","last_fullsized":"2023-10-06T01:40:25.855175+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:51:20.741996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.831872+0000","last_change":"2023-10-06T01:40:20.794690+0000","last_active":"2023-10-06T01:40:25.831872+0000","last_peered":"2023-10-06T01:40:25.831872+0000","last_clean":"2023-10-06T01:40:25.831872+0000","last_became_active":"2023-10-06T01:40:20.794423+0000","last_became_peered":"2023-10-06T01:40:20.794423+0000","last_unstale":"2023-10-06T01:40:25.831872+0000","last_undegraded":"2023-10-06T01:40:25.831872+0000","last_fullsized":"2023-10-06T01:40:25.831872+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:22:11.630679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821326+0000","last_change":"2023-10-06T01:40:21.799103+0000","last_active":"2023-10-06T01:40:25.821326+0000","last_peered":"2023-10-06T01:40:25.821326+0000","last_clean":"2023-10-06T01:40:25.821326+0000","last_became_active":"2023-10-06T01:40:21.798863+0000","last_became_peered":"2023-10-06T01:40:21.798863+0000","last_unstale":"2023-10-06T01:40:25.821326+0000","last_undegraded":"2023-10-06T01:40:25.821326+0000","last_fullsized":"2023-10-06T01:40:25.821326+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:26:58.497171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.850182+0000","last_change":"2023-10-06T01:40:25.843557+0000","last_active":"2023-10-06T01:40:25.850182+0000","last_peered":"2023-10-06T01:40:25.850182+0000","last_clean":"2023-10-06T01:40:25.850182+0000","last_became_active":"2023-10-06T01:40:25.843195+0000","last_became_peered":"2023-10-06T01:40:25.843195+0000","last_unstale":"2023-10-06T01:40:25.850182+0000","last_undegraded":"2023-10-06T01:40:25.850182+0000","last_fullsized":"2023-10-06T01:40:25.850182+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:53:23.550542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.835869+0000","last_change":"2023-10-06T01:40:20.796455+0000","last_active":"2023-10-06T01:40:25.835869+0000","last_peered":"2023-10-06T01:40:25.835869+0000","last_clean":"2023-10-06T01:40:25.835869+0000","last_became_active":"2023-10-06T01:40:20.796167+0000","last_became_peered":"2023-10-06T01:40:20.796167+0000","last_unstale":"2023-10-06T01:40:25.835869+0000","last_undegraded":"2023-10-06T01:40:25.835869+0000","last_fullsized":"2023-10-06T01:40:25.835869+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:06:10.010505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.834708+0000","last_change":"2023-10-06T01:40:21.797847+0000","last_active":"2023-10-06T01:40:25.834708+0000","last_peered":"2023-10-06T01:40:25.834708+0000","last_clean":"2023-10-06T01:40:25.834708+0000","last_became_active":"2023-10-06T01:40:21.797521+0000","last_became_peered":"2023-10-06T01:40:21.797521+0000","last_unstale":"2023-10-06T01:40:25.834708+0000","last_undegraded":"2023-10-06T01:40:25.834708+0000","last_fullsized":"2023-10-06T01:40:25.834708+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:50:29.699833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.856330+0000","last_change":"2023-10-06T01:40:25.848998+0000","last_active":"2023-10-06T01:40:25.856330+0000","last_peered":"2023-10-06T01:40:25.856330+0000","last_clean":"2023-10-06T01:40:25.856330+0000","last_became_active":"2023-10-06T01:40:25.848631+0000","last_became_peered":"2023-10-06T01:40:25.848631+0000","last_unstale":"2023-10-06T01:40:25.856330+0000","last_undegraded":"2023-10-06T01:40:25.856330+0000","last_fullsized":"2023-10-06T01:40:25.856330+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:56:06.324200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.830063+0000","last_change":"2023-10-06T01:40:20.794592+0000","last_active":"2023-10-06T01:40:25.830063+0000","last_peered":"2023-10-06T01:40:25.830063+0000","last_clean":"2023-10-06T01:40:25.830063+0000","last_became_active":"2023-10-06T01:40:20.794349+0000","last_became_peered":"2023-10-06T01:40:20.794349+0000","last_unstale":"2023-10-06T01:40:25.830063+0000","last_undegraded":"2023-10-06T01:40:25.830063+0000","last_fullsized":"2023-10-06T01:40:25.830063+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:54:11.553661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.822918+0000","last_change":"2023-10-06T01:40:21.794642+0000","last_active":"2023-10-06T01:40:25.822918+0000","last_peered":"2023-10-06T01:40:25.822918+0000","last_clean":"2023-10-06T01:40:25.822918+0000","last_became_active":"2023-10-06T01:40:21.794359+0000","last_became_peered":"2023-10-06T01:40:21.794359+0000","last_unstale":"2023-10-06T01:40:25.822918+0000","last_undegraded":"2023-10-06T01:40:25.822918+0000","last_fullsized":"2023-10-06T01:40:25.822918+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:42:40.476349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.845522+0000","last_change":"2023-10-06T01:40:25.836956+0000","last_active":"2023-10-06T01:40:25.845522+0000","last_peered":"2023-10-06T01:40:25.845522+0000","last_clean":"2023-10-06T01:40:25.845522+0000","last_became_active":"2023-10-06T01:40:25.836541+0000","last_became_peered":"2023-10-06T01:40:25.836541+0000","last_unstale":"2023-10-06T01:40:25.845522+0000","last_undegraded":"2023-10-06T01:40:25.845522+0000","last_fullsized":"2023-10-06T01:40:25.845522+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:16:05.054146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821650+0000","last_change":"2023-10-06T01:40:20.782445+0000","last_active":"2023-10-06T01:40:25.821650+0000","last_peered":"2023-10-06T01:40:25.821650+0000","last_clean":"2023-10-06T01:40:25.821650+0000","last_became_active":"2023-10-06T01:40:20.782183+0000","last_became_peered":"2023-10-06T01:40:20.782183+0000","last_unstale":"2023-10-06T01:40:25.821650+0000","last_undegraded":"2023-10-06T01:40:25.821650+0000","last_fullsized":"2023-10-06T01:40:25.821650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:36.984892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.839193+0000","last_change":"2023-10-06T01:40:21.798980+0000","last_active":"2023-10-06T01:40:25.839193+0000","last_peered":"2023-10-06T01:40:25.839193+0000","last_clean":"2023-10-06T01:40:25.839193+0000","last_became_active":"2023-10-06T01:40:21.798613+0000","last_became_peered":"2023-10-06T01:40:21.798613+0000","last_unstale":"2023-10-06T01:40:25.839193+0000","last_undegraded":"2023-10-06T01:40:25.839193+0000","last_fullsized":"2023-10-06T01:40:25.839193+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:24:20.596942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.845551+0000","last_change":"2023-10-06T01:40:25.833310+0000","last_active":"2023-10-06T01:40:25.845551+0000","last_peered":"2023-10-06T01:40:25.845551+0000","last_clean":"2023-10-06T01:40:25.845551+0000","last_became_active":"2023-10-06T01:40:25.832963+0000","last_became_peered":"2023-10-06T01:40:25.832963+0000","last_unstale":"2023-10-06T01:40:25.845551+0000","last_undegraded":"2023-10-06T01:40:25.845551+0000","last_fullsized":"2023-10-06T01:40:25.845551+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:23:12.621079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821512+0000","last_change":"2023-10-06T01:40:20.791754+0000","last_active":"2023-10-06T01:40:25.821512+0000","last_peered":"2023-10-06T01:40:25.821512+0000","last_clean":"2023-10-06T01:40:25.821512+0000","last_became_active":"2023-10-06T01:40:20.791494+0000","last_became_peered":"2023-10-06T01:40:20.791494+0000","last_unstale":"2023-10-06T01:40:25.821512+0000","last_undegraded":"2023-10-06T01:40:25.821512+0000","last_fullsized":"2023-10-06T01:40:25.821512+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:05:51.063526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.830148+0000","last_change":"2023-10-06T01:40:21.785721+0000","last_active":"2023-10-06T01:40:25.830148+0000","last_peered":"2023-10-06T01:40:25.830148+0000","last_clean":"2023-10-06T01:40:25.830148+0000","last_became_active":"2023-10-06T01:40:21.785449+0000","last_became_peered":"2023-10-06T01:40:21.785449+0000","last_unstale":"2023-10-06T01:40:25.830148+0000","last_undegraded":"2023-10-06T01:40:25.830148+0000","last_fullsized":"2023-10-06T01:40:25.830148+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:08:04.660002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.844791+0000","last_change":"2023-10-06T01:40:25.840556+0000","last_active":"2023-10-06T01:40:25.844791+0000","last_peered":"2023-10-06T01:40:25.844791+0000","last_clean":"2023-10-06T01:40:25.844791+0000","last_became_active":"2023-10-06T01:40:25.839952+0000","last_became_peered":"2023-10-06T01:40:25.839952+0000","last_unstale":"2023-10-06T01:40:25.844791+0000","last_undegraded":"2023-10-06T01:40:25.844791+0000","last_fullsized":"2023-10-06T01:40:25.844791+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:47:01.253527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.823012+0000","last_change":"2023-10-06T01:40:20.789868+0000","last_active":"2023-10-06T01:40:25.823012+0000","last_peered":"2023-10-06T01:40:25.823012+0000","last_clean":"2023-10-06T01:40:25.823012+0000","last_became_active":"2023-10-06T01:40:20.789583+0000","last_became_peered":"2023-10-06T01:40:20.789583+0000","last_unstale":"2023-10-06T01:40:25.823012+0000","last_undegraded":"2023-10-06T01:40:25.823012+0000","last_fullsized":"2023-10-06T01:40:25.823012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:33:03.922009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.829487+0000","last_change":"2023-10-06T01:40:21.782892+0000","last_active":"2023-10-06T01:40:25.829487+0000","last_peered":"2023-10-06T01:40:25.829487+0000","last_clean":"2023-10-06T01:40:25.829487+0000","last_became_active":"2023-10-06T01:40:21.782614+0000","last_became_peered":"2023-10-06T01:40:21.782614+0000","last_unstale":"2023-10-06T01:40:25.829487+0000","last_undegraded":"2023-10-06T01:40:25.829487+0000","last_fullsized":"2023-10-06T01:40:25.829487+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:29:36.526509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.848904+0000","last_change":"2023-10-06T01:40:25.843490+0000","last_active":"2023-10-06T01:40:25.848904+0000","last_peered":"2023-10-06T01:40:25.848904+0000","last_clean":"2023-10-06T01:40:25.848904+0000","last_became_active":"2023-10-06T01:40:25.843088+0000","last_became_peered":"2023-10-06T01:40:25.843088+0000","last_unstale":"2023-10-06T01:40:25.848904+0000","last_undegraded":"2023-10-06T01:40:25.848904+0000","last_fullsized":"2023-10-06T01:40:25.848904+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:56:02.016770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.834508+0000","last_change":"2023-10-06T01:40:20.789056+0000","last_active":"2023-10-06T01:40:25.834508+0000","last_peered":"2023-10-06T01:40:25.834508+0000","last_clean":"2023-10-06T01:40:25.834508+0000","last_became_active":"2023-10-06T01:40:20.788196+0000","last_became_peered":"2023-10-06T01:40:20.788196+0000","last_unstale":"2023-10-06T01:40:25.834508+0000","last_undegraded":"2023-10-06T01:40:25.834508+0000","last_fullsized":"2023-10-06T01:40:25.834508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:33:03.922009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.827836+0000","last_change":"2023-10-06T01:40:21.797206+0000","last_active":"2023-10-06T01:40:25.827836+0000","last_peered":"2023-10-06T01:40:25.827836+0000","last_clean":"2023-10-06T01:40:25.827836+0000","last_became_active":"2023-10-06T01:40:21.796922+0000","last_became_peered":"2023-10-06T01:40:21.796922+0000","last_unstale":"2023-10-06T01:40:25.827836+0000","last_undegraded":"2023-10-06T01:40:25.827836+0000","last_fullsized":"2023-10-06T01:40:25.827836+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:23:41.001172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.843834+0000","last_change":"2023-10-06T01:40:25.839765+0000","last_active":"2023-10-06T01:40:25.843834+0000","last_peered":"2023-10-06T01:40:25.843834+0000","last_clean":"2023-10-06T01:40:25.843834+0000","last_became_active":"2023-10-06T01:40:25.839357+0000","last_became_peered":"2023-10-06T01:40:25.839357+0000","last_unstale":"2023-10-06T01:40:25.843834+0000","last_undegraded":"2023-10-06T01:40:25.843834+0000","last_fullsized":"2023-10-06T01:40:25.843834+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:19:13.535733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821700+0000","last_change":"2023-10-06T01:40:20.794748+0000","last_active":"2023-10-06T01:40:25.821700+0000","last_peered":"2023-10-06T01:40:25.821700+0000","last_clean":"2023-10-06T01:40:25.821700+0000","last_became_active":"2023-10-06T01:40:20.794480+0000","last_became_peered":"2023-10-06T01:40:20.794480+0000","last_unstale":"2023-10-06T01:40:25.821700+0000","last_undegraded":"2023-10-06T01:40:25.821700+0000","last_fullsized":"2023-10-06T01:40:25.821700+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:28:17.373431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.830047+0000","last_change":"2023-10-06T01:40:21.787258+0000","last_active":"2023-10-06T01:40:25.830047+0000","last_peered":"2023-10-06T01:40:25.830047+0000","last_clean":"2023-10-06T01:40:25.830047+0000","last_became_active":"2023-10-06T01:40:21.786664+0000","last_became_peered":"2023-10-06T01:40:21.786664+0000","last_unstale":"2023-10-06T01:40:25.830047+0000","last_undegraded":"2023-10-06T01:40:25.830047+0000","last_fullsized":"2023-10-06T01:40:25.830047+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:14:30.814494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.850996+0000","last_change":"2023-10-06T01:40:25.844637+0000","last_active":"2023-10-06T01:40:25.850996+0000","last_peered":"2023-10-06T01:40:25.850996+0000","last_clean":"2023-10-06T01:40:25.850996+0000","last_became_active":"2023-10-06T01:40:25.844052+0000","last_became_peered":"2023-10-06T01:40:25.844052+0000","last_unstale":"2023-10-06T01:40:25.850996+0000","last_undegraded":"2023-10-06T01:40:25.850996+0000","last_fullsized":"2023-10-06T01:40:25.850996+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:22:48.941644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.827265+0000","last_change":"2023-10-06T01:40:16.930992+0000","last_active":"2023-10-06T01:40:25.827265+0000","last_peered":"2023-10-06T01:40:25.827265+0000","last_clean":"2023-10-06T01:40:25.827265+0000","last_became_active":"2023-10-06T01:40:16.930707+0000","last_became_peered":"2023-10-06T01:40:16.930707+0000","last_unstale":"2023-10-06T01:40:25.827265+0000","last_undegraded":"2023-10-06T01:40:25.827265+0000","last_fullsized":"2023-10-06T01:40:25.827265+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:52:43.316071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821862+0000","last_change":"2023-10-06T01:40:20.784967+0000","last_active":"2023-10-06T01:40:25.821862+0000","last_peered":"2023-10-06T01:40:25.821862+0000","last_clean":"2023-10-06T01:40:25.821862+0000","last_became_active":"2023-10-06T01:40:20.784588+0000","last_became_peered":"2023-10-06T01:40:20.784588+0000","last_unstale":"2023-10-06T01:40:25.821862+0000","last_undegraded":"2023-10-06T01:40:25.821862+0000","last_fullsized":"2023-10-06T01:40:25.821862+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:05:51.063526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.826944+0000","last_change":"2023-10-06T01:40:21.794725+0000","last_active":"2023-10-06T01:40:25.826944+0000","last_peered":"2023-10-06T01:40:25.826944+0000","last_clean":"2023-10-06T01:40:25.826944+0000","last_became_active":"2023-10-06T01:40:21.794189+0000","last_became_peered":"2023-10-06T01:40:21.794189+0000","last_unstale":"2023-10-06T01:40:25.826944+0000","last_undegraded":"2023-10-06T01:40:25.826944+0000","last_fullsized":"2023-10-06T01:40:25.826944+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:04.038873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.859101+0000","last_change":"2023-10-06T01:40:25.851461+0000","last_active":"2023-10-06T01:40:25.859101+0000","last_peered":"2023-10-06T01:40:25.859101+0000","last_clean":"2023-10-06T01:40:25.859101+0000","last_became_active":"2023-10-06T01:40:25.851161+0000","last_became_peered":"2023-10-06T01:40:25.851161+0000","last_unstale":"2023-10-06T01:40:25.859101+0000","last_undegraded":"2023-10-06T01:40:25.859101+0000","last_fullsized":"2023-10-06T01:40:25.859101+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:29:43.044116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821491+0000","last_change":"2023-10-06T01:40:16.651019+0000","last_active":"2023-10-06T01:40:25.821491+0000","last_peered":"2023-10-06T01:40:25.821491+0000","last_clean":"2023-10-06T01:40:25.821491+0000","last_became_active":"2023-10-06T01:40:16.650628+0000","last_became_peered":"2023-10-06T01:40:16.650628+0000","last_unstale":"2023-10-06T01:40:25.821491+0000","last_undegraded":"2023-10-06T01:40:25.821491+0000","last_fullsized":"2023-10-06T01:40:25.821491+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:11:57.218984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.830606+0000","last_change":"2023-10-06T01:40:20.791834+0000","last_active":"2023-10-06T01:40:25.830606+0000","last_peered":"2023-10-06T01:40:25.830606+0000","last_clean":"2023-10-06T01:40:25.830606+0000","last_became_active":"2023-10-06T01:40:20.791553+0000","last_became_peered":"2023-10-06T01:40:20.791553+0000","last_unstale":"2023-10-06T01:40:25.830606+0000","last_undegraded":"2023-10-06T01:40:25.830606+0000","last_fullsized":"2023-10-06T01:40:25.830606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:40:52.187918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.827267+0000","last_change":"2023-10-06T01:40:21.787773+0000","last_active":"2023-10-06T01:40:25.827267+0000","last_peered":"2023-10-06T01:40:25.827267+0000","last_clean":"2023-10-06T01:40:25.827267+0000","last_became_active":"2023-10-06T01:40:21.787517+0000","last_became_peered":"2023-10-06T01:40:21.787517+0000","last_unstale":"2023-10-06T01:40:25.827267+0000","last_undegraded":"2023-10-06T01:40:25.827267+0000","last_fullsized":"2023-10-06T01:40:25.827267+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:58:41.783343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.849217+0000","last_change":"2023-10-06T01:40:25.844473+0000","last_active":"2023-10-06T01:40:25.849217+0000","last_peered":"2023-10-06T01:40:25.849217+0000","last_clean":"2023-10-06T01:40:25.849217+0000","last_became_active":"2023-10-06T01:40:25.844126+0000","last_became_peered":"2023-10-06T01:40:25.844126+0000","last_unstale":"2023-10-06T01:40:25.849217+0000","last_undegraded":"2023-10-06T01:40:25.849217+0000","last_fullsized":"2023-10-06T01:40:25.849217+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:08:08.709318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.826313+0000","last_change":"2023-10-06T01:40:16.781596+0000","last_active":"2023-10-06T01:40:25.826313+0000","last_peered":"2023-10-06T01:40:25.826313+0000","last_clean":"2023-10-06T01:40:25.826313+0000","last_became_active":"2023-10-06T01:40:16.781352+0000","last_became_peered":"2023-10-06T01:40:16.781352+0000","last_unstale":"2023-10-06T01:40:25.826313+0000","last_undegraded":"2023-10-06T01:40:25.826313+0000","last_fullsized":"2023-10-06T01:40:25.826313+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:52:43.316071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.825380+0000","last_change":"2023-10-06T01:40:20.783263+0000","last_active":"2023-10-06T01:40:25.825380+0000","last_peered":"2023-10-06T01:40:25.825380+0000","last_clean":"2023-10-06T01:40:25.825380+0000","last_became_active":"2023-10-06T01:40:20.781142+0000","last_became_peered":"2023-10-06T01:40:20.781142+0000","last_unstale":"2023-10-06T01:40:25.825380+0000","last_undegraded":"2023-10-06T01:40:25.825380+0000","last_fullsized":"2023-10-06T01:40:25.825380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:28:17.373431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.829970+0000","last_change":"2023-10-06T01:40:21.795215+0000","last_active":"2023-10-06T01:40:25.829970+0000","last_peered":"2023-10-06T01:40:25.829970+0000","last_clean":"2023-10-06T01:40:25.829970+0000","last_became_active":"2023-10-06T01:40:21.794141+0000","last_became_peered":"2023-10-06T01:40:21.794141+0000","last_unstale":"2023-10-06T01:40:25.829970+0000","last_undegraded":"2023-10-06T01:40:25.829970+0000","last_fullsized":"2023-10-06T01:40:25.829970+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:24:04.737047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.855244+0000","last_change":"2023-10-06T01:40:25.849723+0000","last_active":"2023-10-06T01:40:25.855244+0000","last_peered":"2023-10-06T01:40:25.855244+0000","last_clean":"2023-10-06T01:40:25.855244+0000","last_became_active":"2023-10-06T01:40:25.849315+0000","last_became_peered":"2023-10-06T01:40:25.849315+0000","last_unstale":"2023-10-06T01:40:25.855244+0000","last_undegraded":"2023-10-06T01:40:25.855244+0000","last_fullsized":"2023-10-06T01:40:25.855244+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:09:02.303009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821589+0000","last_change":"2023-10-06T01:40:16.650826+0000","last_active":"2023-10-06T01:40:25.821589+0000","last_peered":"2023-10-06T01:40:25.821589+0000","last_clean":"2023-10-06T01:40:25.821589+0000","last_became_active":"2023-10-06T01:40:16.650469+0000","last_became_peered":"2023-10-06T01:40:16.650469+0000","last_unstale":"2023-10-06T01:40:25.821589+0000","last_undegraded":"2023-10-06T01:40:25.821589+0000","last_fullsized":"2023-10-06T01:40:25.821589+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:50:23.628212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":170,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.828939+0000","last_change":"2023-10-06T01:40:10.645512+0000","last_active":"2023-10-06T01:40:25.828939+0000","last_peered":"2023-10-06T01:40:25.828939+0000","last_clean":"2023-10-06T01:40:25.828939+0000","last_became_active":"2023-10-06T01:40:10.644601+0000","last_became_peered":"2023-10-06T01:40:10.644601+0000","last_unstale":"2023-10-06T01:40:25.828939+0000","last_undegraded":"2023-10-06T01:40:25.828939+0000","last_fullsized":"2023-10-06T01:40:25.828939+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:09.580865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:09.580865+0000","last_clean_scrub_stamp":"2023-10-06T01:40:09.580865+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:05:28.268591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821362+0000","last_change":"2023-10-06T01:40:20.787092+0000","last_active":"2023-10-06T01:40:25.821362+0000","last_peered":"2023-10-06T01:40:25.821362+0000","last_clean":"2023-10-06T01:40:25.821362+0000","last_became_active":"2023-10-06T01:40:20.786835+0000","last_became_peered":"2023-10-06T01:40:20.786835+0000","last_unstale":"2023-10-06T01:40:25.821362+0000","last_undegraded":"2023-10-06T01:40:25.821362+0000","last_fullsized":"2023-10-06T01:40:25.821362+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:36.984892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.824208+0000","last_change":"2023-10-06T01:40:21.800342+0000","last_active":"2023-10-06T01:40:25.824208+0000","last_peered":"2023-10-06T01:40:25.824208+0000","last_clean":"2023-10-06T01:40:25.824208+0000","last_became_active":"2023-10-06T01:40:21.800077+0000","last_became_peered":"2023-10-06T01:40:21.800077+0000","last_unstale":"2023-10-06T01:40:25.824208+0000","last_undegraded":"2023-10-06T01:40:25.824208+0000","last_fullsized":"2023-10-06T01:40:25.824208+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:16:08.450725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.849960+0000","last_change":"2023-10-06T01:40:25.846010+0000","last_active":"2023-10-06T01:40:25.849960+0000","last_peered":"2023-10-06T01:40:25.849960+0000","last_clean":"2023-10-06T01:40:25.849960+0000","last_became_active":"2023-10-06T01:40:25.845564+0000","last_became_peered":"2023-10-06T01:40:25.845564+0000","last_unstale":"2023-10-06T01:40:25.849960+0000","last_undegraded":"2023-10-06T01:40:25.849960+0000","last_fullsized":"2023-10-06T01:40:25.849960+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:45.054717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.829152+0000","last_change":"2023-10-06T01:40:16.651332+0000","last_active":"2023-10-06T01:40:25.829152+0000","last_peered":"2023-10-06T01:40:25.829152+0000","last_clean":"2023-10-06T01:40:25.829152+0000","last_became_active":"2023-10-06T01:40:16.651049+0000","last_became_peered":"2023-10-06T01:40:16.651049+0000","last_unstale":"2023-10-06T01:40:25.829152+0000","last_undegraded":"2023-10-06T01:40:25.829152+0000","last_fullsized":"2023-10-06T01:40:25.829152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:11:57.218984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.838433+0000","last_change":"2023-10-06T01:40:20.793541+0000","last_active":"2023-10-06T01:40:25.838433+0000","last_peered":"2023-10-06T01:40:25.838433+0000","last_clean":"2023-10-06T01:40:25.838433+0000","last_became_active":"2023-10-06T01:40:20.793304+0000","last_became_peered":"2023-10-06T01:40:20.793304+0000","last_unstale":"2023-10-06T01:40:25.838433+0000","last_undegraded":"2023-10-06T01:40:25.838433+0000","last_fullsized":"2023-10-06T01:40:25.838433+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:05:51.063526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.839355+0000","last_change":"2023-10-06T01:40:21.797984+0000","last_active":"2023-10-06T01:40:25.839355+0000","last_peered":"2023-10-06T01:40:25.839355+0000","last_clean":"2023-10-06T01:40:25.839355+0000","last_became_active":"2023-10-06T01:40:21.797701+0000","last_became_peered":"2023-10-06T01:40:21.797701+0000","last_unstale":"2023-10-06T01:40:25.839355+0000","last_undegraded":"2023-10-06T01:40:25.839355+0000","last_fullsized":"2023-10-06T01:40:25.839355+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:26:58.497171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.840837+0000","last_change":"2023-10-06T01:40:25.838729+0000","last_active":"2023-10-06T01:40:25.840837+0000","last_peered":"2023-10-06T01:40:25.840837+0000","last_clean":"2023-10-06T01:40:25.840837+0000","last_became_active":"2023-10-06T01:40:25.838267+0000","last_became_peered":"2023-10-06T01:40:25.838267+0000","last_unstale":"2023-10-06T01:40:25.840837+0000","last_undegraded":"2023-10-06T01:40:25.840837+0000","last_fullsized":"2023-10-06T01:40:25.840837+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:50:33.749149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.829955+0000","last_change":"2023-10-06T01:40:16.931106+0000","last_active":"2023-10-06T01:40:25.829955+0000","last_peered":"2023-10-06T01:40:25.829955+0000","last_clean":"2023-10-06T01:40:25.829955+0000","last_became_active":"2023-10-06T01:40:16.930830+0000","last_became_peered":"2023-10-06T01:40:16.930830+0000","last_unstale":"2023-10-06T01:40:25.829955+0000","last_undegraded":"2023-10-06T01:40:25.829955+0000","last_fullsized":"2023-10-06T01:40:25.829955+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:50:23.628212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.827373+0000","last_change":"2023-10-06T01:40:20.788225+0000","last_active":"2023-10-06T01:40:25.827373+0000","last_peered":"2023-10-06T01:40:25.827373+0000","last_clean":"2023-10-06T01:40:25.827373+0000","last_became_active":"2023-10-06T01:40:20.787925+0000","last_became_peered":"2023-10-06T01:40:20.787925+0000","last_unstale":"2023-10-06T01:40:25.827373+0000","last_undegraded":"2023-10-06T01:40:25.827373+0000","last_fullsized":"2023-10-06T01:40:25.827373+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:40:52.187918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.838984+0000","last_change":"2023-10-06T01:40:21.798835+0000","last_active":"2023-10-06T01:40:25.838984+0000","last_peered":"2023-10-06T01:40:25.838984+0000","last_clean":"2023-10-06T01:40:25.838984+0000","last_became_active":"2023-10-06T01:40:21.798060+0000","last_became_peered":"2023-10-06T01:40:21.798060+0000","last_unstale":"2023-10-06T01:40:25.838984+0000","last_undegraded":"2023-10-06T01:40:25.838984+0000","last_fullsized":"2023-10-06T01:40:25.838984+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:04.038873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.853092+0000","last_change":"2023-10-06T01:40:25.842785+0000","last_active":"2023-10-06T01:40:25.853092+0000","last_peered":"2023-10-06T01:40:25.853092+0000","last_clean":"2023-10-06T01:40:25.853092+0000","last_became_active":"2023-10-06T01:40:25.842386+0000","last_became_peered":"2023-10-06T01:40:25.842386+0000","last_unstale":"2023-10-06T01:40:25.853092+0000","last_undegraded":"2023-10-06T01:40:25.853092+0000","last_fullsized":"2023-10-06T01:40:25.853092+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:21.192762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.822713+0000","last_change":"2023-10-06T01:40:20.791442+0000","last_active":"2023-10-06T01:40:25.822713+0000","last_peered":"2023-10-06T01:40:25.822713+0000","last_clean":"2023-10-06T01:40:25.822713+0000","last_became_active":"2023-10-06T01:40:20.791169+0000","last_became_peered":"2023-10-06T01:40:20.791169+0000","last_unstale":"2023-10-06T01:40:25.822713+0000","last_undegraded":"2023-10-06T01:40:25.822713+0000","last_fullsized":"2023-10-06T01:40:25.822713+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:26:03.577908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.827531+0000","last_change":"2023-10-06T01:40:16.649379+0000","last_active":"2023-10-06T01:40:25.827531+0000","last_peered":"2023-10-06T01:40:25.827531+0000","last_clean":"2023-10-06T01:40:25.827531+0000","last_became_active":"2023-10-06T01:40:16.649147+0000","last_became_peered":"2023-10-06T01:40:16.649147+0000","last_unstale":"2023-10-06T01:40:25.827531+0000","last_undegraded":"2023-10-06T01:40:25.827531+0000","last_fullsized":"2023-10-06T01:40:25.827531+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:11:57.218984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821612+0000","last_change":"2023-10-06T01:40:21.797861+0000","last_active":"2023-10-06T01:40:25.821612+0000","last_peered":"2023-10-06T01:40:25.821612+0000","last_clean":"2023-10-06T01:40:25.821612+0000","last_became_active":"2023-10-06T01:40:21.797626+0000","last_became_peered":"2023-10-06T01:40:21.797626+0000","last_unstale":"2023-10-06T01:40:25.821612+0000","last_undegraded":"2023-10-06T01:40:25.821612+0000","last_fullsized":"2023-10-06T01:40:25.821612+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:24:20.596942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.856358+0000","last_change":"2023-10-06T01:40:25.843290+0000","last_active":"2023-10-06T01:40:25.856358+0000","last_peered":"2023-10-06T01:40:25.856358+0000","last_clean":"2023-10-06T01:40:25.856358+0000","last_became_active":"2023-10-06T01:40:25.842953+0000","last_became_peered":"2023-10-06T01:40:25.842953+0000","last_unstale":"2023-10-06T01:40:25.856358+0000","last_undegraded":"2023-10-06T01:40:25.856358+0000","last_fullsized":"2023-10-06T01:40:25.856358+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:12:18.042310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.824283+0000","last_change":"2023-10-06T01:40:16.651477+0000","last_active":"2023-10-06T01:40:25.824283+0000","last_peered":"2023-10-06T01:40:25.824283+0000","last_clean":"2023-10-06T01:40:25.824283+0000","last_became_active":"2023-10-06T01:40:16.651190+0000","last_became_peered":"2023-10-06T01:40:16.651190+0000","last_unstale":"2023-10-06T01:40:25.824283+0000","last_undegraded":"2023-10-06T01:40:25.824283+0000","last_fullsized":"2023-10-06T01:40:25.824283+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:45:47.422876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"26'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:26.761975+0000","last_change":"2023-10-06T01:40:20.794641+0000","last_active":"2023-10-06T01:40:26.761975+0000","last_peered":"2023-10-06T01:40:26.761975+0000","last_clean":"2023-10-06T01:40:26.761975+0000","last_became_active":"2023-10-06T01:40:20.794360+0000","last_became_peered":"2023-10-06T01:40:20.794360+0000","last_unstale":"2023-10-06T01:40:26.761975+0000","last_undegraded":"2023-10-06T01:40:26.761975+0000","last_fullsized":"2023-10-06T01:40:26.761975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:40:52.187918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.834606+0000","last_change":"2023-10-06T01:40:21.791810+0000","last_active":"2023-10-06T01:40:25.834606+0000","last_peered":"2023-10-06T01:40:25.834606+0000","last_clean":"2023-10-06T01:40:25.834606+0000","last_became_active":"2023-10-06T01:40:21.791555+0000","last_became_peered":"2023-10-06T01:40:21.791555+0000","last_unstale":"2023-10-06T01:40:25.834606+0000","last_undegraded":"2023-10-06T01:40:25.834606+0000","last_fullsized":"2023-10-06T01:40:25.834606+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:24:20.596942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.856682+0000","last_change":"2023-10-06T01:40:25.849400+0000","last_active":"2023-10-06T01:40:25.856682+0000","last_peered":"2023-10-06T01:40:25.856682+0000","last_clean":"2023-10-06T01:40:25.856682+0000","last_became_active":"2023-10-06T01:40:25.849029+0000","last_became_peered":"2023-10-06T01:40:25.849029+0000","last_unstale":"2023-10-06T01:40:25.856682+0000","last_undegraded":"2023-10-06T01:40:25.856682+0000","last_fullsized":"2023-10-06T01:40:25.856682+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:33:05.597649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.839064+0000","last_change":"2023-10-06T01:40:20.794942+0000","last_active":"2023-10-06T01:40:25.839064+0000","last_peered":"2023-10-06T01:40:25.839064+0000","last_clean":"2023-10-06T01:40:25.839064+0000","last_became_active":"2023-10-06T01:40:20.794667+0000","last_became_peered":"2023-10-06T01:40:20.794667+0000","last_unstale":"2023-10-06T01:40:25.839064+0000","last_undegraded":"2023-10-06T01:40:25.839064+0000","last_fullsized":"2023-10-06T01:40:25.839064+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:28:17.373431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.827341+0000","last_change":"2023-10-06T01:40:21.784757+0000","last_active":"2023-10-06T01:40:25.827341+0000","last_peered":"2023-10-06T01:40:25.827341+0000","last_clean":"2023-10-06T01:40:25.827341+0000","last_became_active":"2023-10-06T01:40:21.784512+0000","last_became_peered":"2023-10-06T01:40:21.784512+0000","last_unstale":"2023-10-06T01:40:25.827341+0000","last_undegraded":"2023-10-06T01:40:25.827341+0000","last_fullsized":"2023-10-06T01:40:25.827341+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:37.988970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.854971+0000","last_change":"2023-10-06T01:40:25.844934+0000","last_active":"2023-10-06T01:40:25.854971+0000","last_peered":"2023-10-06T01:40:25.854971+0000","last_clean":"2023-10-06T01:40:25.854971+0000","last_became_active":"2023-10-06T01:40:25.844548+0000","last_became_peered":"2023-10-06T01:40:25.844548+0000","last_unstale":"2023-10-06T01:40:25.854971+0000","last_undegraded":"2023-10-06T01:40:25.854971+0000","last_fullsized":"2023-10-06T01:40:25.854971+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:22:48.941644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821739+0000","last_change":"2023-10-06T01:40:20.795699+0000","last_active":"2023-10-06T01:40:25.821739+0000","last_peered":"2023-10-06T01:40:25.821739+0000","last_clean":"2023-10-06T01:40:25.821739+0000","last_became_active":"2023-10-06T01:40:20.795401+0000","last_became_peered":"2023-10-06T01:40:20.795401+0000","last_unstale":"2023-10-06T01:40:25.821739+0000","last_undegraded":"2023-10-06T01:40:25.821739+0000","last_fullsized":"2023-10-06T01:40:25.821739+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:08:56.244189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.830737+0000","last_change":"2023-10-06T01:40:21.796905+0000","last_active":"2023-10-06T01:40:25.830737+0000","last_peered":"2023-10-06T01:40:25.830737+0000","last_clean":"2023-10-06T01:40:25.830737+0000","last_became_active":"2023-10-06T01:40:21.796623+0000","last_became_peered":"2023-10-06T01:40:21.796623+0000","last_unstale":"2023-10-06T01:40:25.830737+0000","last_undegraded":"2023-10-06T01:40:25.830737+0000","last_fullsized":"2023-10-06T01:40:25.830737+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:14:52.758971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.849027+0000","last_change":"2023-10-06T01:40:25.846338+0000","last_active":"2023-10-06T01:40:25.849027+0000","last_peered":"2023-10-06T01:40:25.849027+0000","last_clean":"2023-10-06T01:40:25.849027+0000","last_became_active":"2023-10-06T01:40:25.845938+0000","last_became_peered":"2023-10-06T01:40:25.845938+0000","last_unstale":"2023-10-06T01:40:25.849027+0000","last_undegraded":"2023-10-06T01:40:25.849027+0000","last_fullsized":"2023-10-06T01:40:25.849027+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:44:33.571977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821259+0000","last_change":"2023-10-06T01:40:20.790034+0000","last_active":"2023-10-06T01:40:25.821259+0000","last_peered":"2023-10-06T01:40:25.821259+0000","last_clean":"2023-10-06T01:40:25.821259+0000","last_became_active":"2023-10-06T01:40:20.789692+0000","last_became_peered":"2023-10-06T01:40:20.789692+0000","last_unstale":"2023-10-06T01:40:25.821259+0000","last_undegraded":"2023-10-06T01:40:25.821259+0000","last_fullsized":"2023-10-06T01:40:25.821259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:06:10.010505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.831832+0000","last_change":"2023-10-06T01:40:21.790538+0000","last_active":"2023-10-06T01:40:25.831832+0000","last_peered":"2023-10-06T01:40:25.831832+0000","last_clean":"2023-10-06T01:40:25.831832+0000","last_became_active":"2023-10-06T01:40:21.790281+0000","last_became_peered":"2023-10-06T01:40:21.790281+0000","last_unstale":"2023-10-06T01:40:25.831832+0000","last_undegraded":"2023-10-06T01:40:25.831832+0000","last_fullsized":"2023-10-06T01:40:25.831832+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:26:58.497171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.853306+0000","last_change":"2023-10-06T01:40:25.845691+0000","last_active":"2023-10-06T01:40:25.853306+0000","last_peered":"2023-10-06T01:40:25.853306+0000","last_clean":"2023-10-06T01:40:25.853306+0000","last_became_active":"2023-10-06T01:40:25.843152+0000","last_became_peered":"2023-10-06T01:40:25.843152+0000","last_unstale":"2023-10-06T01:40:25.853306+0000","last_undegraded":"2023-10-06T01:40:25.853306+0000","last_fullsized":"2023-10-06T01:40:25.853306+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:05:21.358447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821427+0000","last_change":"2023-10-06T01:40:20.787411+0000","last_active":"2023-10-06T01:40:25.821427+0000","last_peered":"2023-10-06T01:40:25.821427+0000","last_clean":"2023-10-06T01:40:25.821427+0000","last_became_active":"2023-10-06T01:40:20.787144+0000","last_became_peered":"2023-10-06T01:40:20.787144+0000","last_unstale":"2023-10-06T01:40:25.821427+0000","last_undegraded":"2023-10-06T01:40:25.821427+0000","last_fullsized":"2023-10-06T01:40:25.821427+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:22:22.604958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821801+0000","last_change":"2023-10-06T01:40:21.783499+0000","last_active":"2023-10-06T01:40:25.821801+0000","last_peered":"2023-10-06T01:40:25.821801+0000","last_clean":"2023-10-06T01:40:25.821801+0000","last_became_active":"2023-10-06T01:40:21.783032+0000","last_became_peered":"2023-10-06T01:40:21.783032+0000","last_unstale":"2023-10-06T01:40:25.821801+0000","last_undegraded":"2023-10-06T01:40:25.821801+0000","last_fullsized":"2023-10-06T01:40:25.821801+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:26:58.497171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.856721+0000","last_change":"2023-10-06T01:40:25.852998+0000","last_active":"2023-10-06T01:40:25.856721+0000","last_peered":"2023-10-06T01:40:25.856721+0000","last_clean":"2023-10-06T01:40:25.856721+0000","last_became_active":"2023-10-06T01:40:25.852607+0000","last_became_peered":"2023-10-06T01:40:25.852607+0000","last_unstale":"2023-10-06T01:40:25.856721+0000","last_undegraded":"2023-10-06T01:40:25.856721+0000","last_fullsized":"2023-10-06T01:40:25.856721+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:22:48.941644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.840188+0000","last_change":"2023-10-06T01:40:20.791988+0000","last_active":"2023-10-06T01:40:25.840188+0000","last_peered":"2023-10-06T01:40:25.840188+0000","last_clean":"2023-10-06T01:40:25.840188+0000","last_became_active":"2023-10-06T01:40:20.791712+0000","last_became_peered":"2023-10-06T01:40:20.791712+0000","last_unstale":"2023-10-06T01:40:25.840188+0000","last_undegraded":"2023-10-06T01:40:25.840188+0000","last_fullsized":"2023-10-06T01:40:25.840188+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:08:56.244189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.830146+0000","last_change":"2023-10-06T01:40:21.797245+0000","last_active":"2023-10-06T01:40:25.830146+0000","last_peered":"2023-10-06T01:40:25.830146+0000","last_clean":"2023-10-06T01:40:25.830146+0000","last_became_active":"2023-10-06T01:40:21.796983+0000","last_became_peered":"2023-10-06T01:40:21.796983+0000","last_unstale":"2023-10-06T01:40:25.830146+0000","last_undegraded":"2023-10-06T01:40:25.830146+0000","last_fullsized":"2023-10-06T01:40:25.830146+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:56:02.274884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.822902+0000","last_change":"2023-10-06T01:40:21.778624+0000","last_active":"2023-10-06T01:40:25.822902+0000","last_peered":"2023-10-06T01:40:25.822902+0000","last_clean":"2023-10-06T01:40:25.822902+0000","last_became_active":"2023-10-06T01:40:21.778327+0000","last_became_peered":"2023-10-06T01:40:21.778327+0000","last_unstale":"2023-10-06T01:40:25.822902+0000","last_undegraded":"2023-10-06T01:40:25.822902+0000","last_fullsized":"2023-10-06T01:40:25.822902+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:54:12.557739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821944+0000","last_change":"2023-10-06T01:40:21.784238+0000","last_active":"2023-10-06T01:40:25.821944+0000","last_peered":"2023-10-06T01:40:25.821944+0000","last_clean":"2023-10-06T01:40:25.821944+0000","last_became_active":"2023-10-06T01:40:21.783952+0000","last_became_peered":"2023-10-06T01:40:21.783952+0000","last_unstale":"2023-10-06T01:40:25.821944+0000","last_undegraded":"2023-10-06T01:40:25.821944+0000","last_fullsized":"2023-10-06T01:40:25.821944+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:29:36.526509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.832179+0000","last_change":"2023-10-06T01:40:21.797310+0000","last_active":"2023-10-06T01:40:25.832179+0000","last_peered":"2023-10-06T01:40:25.832179+0000","last_clean":"2023-10-06T01:40:25.832179+0000","last_became_active":"2023-10-06T01:40:21.797085+0000","last_became_peered":"2023-10-06T01:40:21.797085+0000","last_unstale":"2023-10-06T01:40:25.832179+0000","last_undegraded":"2023-10-06T01:40:25.832179+0000","last_fullsized":"2023-10-06T01:40:25.832179+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:23:08.571763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821415+0000","last_change":"2023-10-06T01:40:21.797623+0000","last_active":"2023-10-06T01:40:25.821415+0000","last_peered":"2023-10-06T01:40:25.821415+0000","last_clean":"2023-10-06T01:40:25.821415+0000","last_became_active":"2023-10-06T01:40:21.797365+0000","last_became_peered":"2023-10-06T01:40:21.797365+0000","last_unstale":"2023-10-06T01:40:25.821415+0000","last_undegraded":"2023-10-06T01:40:25.821415+0000","last_fullsized":"2023-10-06T01:40:25.821415+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:39:44.521327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.827357+0000","last_change":"2023-10-06T01:40:21.791795+0000","last_active":"2023-10-06T01:40:25.827357+0000","last_peered":"2023-10-06T01:40:25.827357+0000","last_clean":"2023-10-06T01:40:25.827357+0000","last_became_active":"2023-10-06T01:40:21.791427+0000","last_became_peered":"2023-10-06T01:40:21.791427+0000","last_unstale":"2023-10-06T01:40:25.827357+0000","last_undegraded":"2023-10-06T01:40:25.827357+0000","last_fullsized":"2023-10-06T01:40:25.827357+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:26:58.497171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4484,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298180,"kb_used_data":892,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073660,"statfs":{"total":96636764160,"available":96331427840,"internally_reserved":0,"allocated":913408,"data_stored":713871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297572,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074268,"statfs":{"total":96636764160,"available":96332050432,"internally_reserved":0,"allocated":290816,"data_stored":119573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297572,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074268,"statfs":{"total":96636764160,"available":96332050432,"internally_reserved":0,"allocated":290816,"data_stored":119573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28199999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298152,"kb_used_data":864,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073688,"statfs":{"total":96636764160,"available":96331456512,"internally_reserved":0,"allocated":884736,"data_stored":709534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]}]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297572,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074268,"statfs":{"total":96636764160,"available":96332050432,"internally_reserved":0,"allocated":290816,"data_stored":119573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297576,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074264,"statfs":{"total":96636764160,"available":96332046336,"internally_reserved":0,"allocated":294912,"data_stored":119663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]}]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297592,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074248,"statfs":{"total":96636764160,"available":96332029952,"internally_reserved":0,"allocated":311296,"data_stored":123343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297580,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074260,"statfs":{"total":96636764160,"available":96332042240,"internally_reserved":0,"allocated":299008,"data_stored":120197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T01:40:41.288 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T01:40:41.288 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-06T01:40:41.288 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-06T01:40:41.288 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-06T01:40:41.289 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-10-06T01:40:41.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.432+0000 7ffb3122d700 1 Processor -- start 2023-10-06T01:40:41.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.432+0000 7ffb3122d700 1 -- start start 2023-10-06T01:40:41.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.433+0000 7ffb3122d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ffb2c06a3e0 0x7ffb2c158e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:41.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.433+0000 7ffb3122d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb2c0ce390 con 0x7ffb2c06a010 2023-10-06T01:40:41.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.433+0000 7ffb3122d700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb2c15d700 con 0x7ffb2c159380 2023-10-06T01:40:41.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.433+0000 7ffb3122d700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb2c15d9d0 con 0x7ffb2c06a3e0 2023-10-06T01:40:41.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.433+0000 7ffb2ad9d700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7ffb2c06a010 0x7ffb2c15cff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:59386/0 (socket says 172.21.15.71:59386) 2023-10-06T01:40:41.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.433+0000 7ffb2ad9d700 1 -- 172.21.15.71:0/1077961380 learned_addr learned my addr 172.21.15.71:0/1077961380 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:40:41.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.433+0000 7ffb2259c700 1 --2- 172.21.15.71:0/1077961380 >> v2:172.21.15.72:3300/0 conn(0x7ffb2c06a3e0 0x7ffb2c158e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:41.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.434+0000 7ffb2a59c700 1 -- 172.21.15.71:0/1077961380 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2677324027 0 0) 0x7ffb2c0ce390 con 0x7ffb2c06a010 2023-10-06T01:40:41.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.434+0000 7ffb2a59c700 1 -- 172.21.15.71:0/1077961380 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb18003570 con 0x7ffb2c06a010 2023-10-06T01:40:41.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.434+0000 7ffb2a59c700 1 -- 172.21.15.71:0/1077961380 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1440083088 0 0) 0x7ffb2c15d700 con 0x7ffb2c159380 2023-10-06T01:40:41.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.434+0000 7ffb2a59c700 1 -- 172.21.15.71:0/1077961380 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb2c0ce390 con 0x7ffb2c159380 2023-10-06T01:40:41.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.434+0000 7ffb2a59c700 1 -- 172.21.15.71:0/1077961380 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3073453991 0 0) 0x7ffb18003570 con 0x7ffb2c06a010 2023-10-06T01:40:41.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.434+0000 7ffb2259c700 1 -- 172.21.15.71:0/1077961380 >> v1:172.21.15.72:6789/0 conn(0x7ffb2c159380 legacy=0x7ffb2c0ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:41.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.434+0000 7ffb2259c700 1 -- 172.21.15.71:0/1077961380 >> v1:172.21.15.71:6789/0 conn(0x7ffb2c06a010 legacy=0x7ffb2c15cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:41.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.434+0000 7ffb2259c700 1 -- 172.21.15.71:0/1077961380 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb2c15dcb0 con 0x7ffb2c06a3e0 2023-10-06T01:40:41.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.434+0000 7ffb2259c700 1 --2- 172.21.15.71:0/1077961380 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb2c06a3e0 0x7ffb2c158e40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ffb140098e0 tx=0x7ffb140091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab921d24dd2918e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:41.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.434+0000 7ffb2a59c700 1 -- 172.21.15.71:0/1077961380 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb1c001470 con 0x7ffb2c06a3e0 2023-10-06T01:40:41.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.434+0000 7ffb2a59c700 1 -- 172.21.15.71:0/1077961380 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb14011420 con 0x7ffb2c06a3e0 2023-10-06T01:40:41.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.434+0000 7ffb2a59c700 1 -- 172.21.15.71:0/1077961380 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb140117c0 con 0x7ffb2c06a3e0 2023-10-06T01:40:41.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.435+0000 7ffb3122d700 1 -- 172.21.15.71:0/1077961380 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb2c06a3e0 msgr2=0x7ffb2c158e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:41.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.435+0000 7ffb3122d700 1 --2- 172.21.15.71:0/1077961380 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb2c06a3e0 0x7ffb2c158e40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ffb140098e0 tx=0x7ffb140091a0 comp rx=0 tx=0).stop 2023-10-06T01:40:41.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.435+0000 7ffb3122d700 1 -- 172.21.15.71:0/1077961380 shutdown_connections 2023-10-06T01:40:41.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.435+0000 7ffb3122d700 1 --2- 172.21.15.71:0/1077961380 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb2c06a3e0 0x7ffb2c158e40 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:41.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.435+0000 7ffb3122d700 1 -- 172.21.15.71:0/1077961380 >> 172.21.15.71:0/1077961380 conn(0x7ffb2c087c90 msgr2=0x7ffb2c0d02b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:41.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.435+0000 7ffb3122d700 1 -- 172.21.15.71:0/1077961380 shutdown_connections 2023-10-06T01:40:41.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.435+0000 7ffb3122d700 1 -- 172.21.15.71:0/1077961380 wait complete. 2023-10-06T01:40:41.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.436+0000 7ffb3122d700 1 Processor -- start 2023-10-06T01:40:41.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.436+0000 7ffb3122d700 1 -- start start 2023-10-06T01:40:41.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.437+0000 7ffb3122d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb2c06a010 0x7ffb2c0ca1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:41.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.437+0000 7ffb3122d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb2c06a3e0 0x7ffb2c0c7d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:41.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.437+0000 7ffb3122d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffb2c159380 0x7ffb2c153600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:41.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.437+0000 7ffb3122d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb2c0ca6f0 con 0x7ffb2c159380 2023-10-06T01:40:41.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.437+0000 7ffb3122d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb2c15ab90 con 0x7ffb2c06a3e0 2023-10-06T01:40:41.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.437+0000 7ffb3122d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb2c15ad20 con 0x7ffb2c06a010 2023-10-06T01:40:41.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.437+0000 7ffb2b59e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffb2c159380 0x7ffb2c153600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:41.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.437+0000 7ffb2b59e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffb2c159380 0x7ffb2c153600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47250/0 (socket says 172.21.15.71:47250) 2023-10-06T01:40:41.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.437+0000 7ffb2b59e700 1 -- 172.21.15.71:0/628459860 learned_addr learned my addr 172.21.15.71:0/628459860 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:41.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.437+0000 7ffb2ad9d700 1 --2- 172.21.15.71:0/628459860 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb2c06a010 0x7ffb2c0ca1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:41.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.437+0000 7ffb2259c700 1 --2- 172.21.15.71:0/628459860 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb2c06a3e0 0x7ffb2c0c7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:41.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.437+0000 7ffb2b59e700 1 -- 172.21.15.71:0/628459860 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb2c06a010 msgr2=0x7ffb2c0ca1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:41.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.437+0000 7ffb2b59e700 1 --2- 172.21.15.71:0/628459860 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb2c06a010 0x7ffb2c0ca1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:41.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.437+0000 7ffb2b59e700 1 -- 172.21.15.71:0/628459860 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb2c06a3e0 msgr2=0x7ffb2c0c7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:41.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.437+0000 7ffb2b59e700 1 --2- 172.21.15.71:0/628459860 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb2c06a3e0 0x7ffb2c0c7d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:41.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.437+0000 7ffb2b59e700 1 -- 172.21.15.71:0/628459860 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb14009420 con 0x7ffb2c159380 2023-10-06T01:40:41.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.437+0000 7ffb2b59e700 1 --2- 172.21.15.71:0/628459860 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffb2c159380 0x7ffb2c153600 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ffb2400c860 tx=0x7ffb24002700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:41.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.438+0000 7ffb237fe700 1 -- 172.21.15.71:0/628459860 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb24002030 con 0x7ffb2c159380 2023-10-06T01:40:41.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.438+0000 7ffb237fe700 1 -- 172.21.15.71:0/628459860 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb240021b0 con 0x7ffb2c159380 2023-10-06T01:40:41.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.438+0000 7ffb237fe700 1 -- 172.21.15.71:0/628459860 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb24012630 con 0x7ffb2c159380 2023-10-06T01:40:41.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.438+0000 7ffb3122d700 1 -- 172.21.15.71:0/628459860 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb2c0c84e0 con 0x7ffb2c159380 2023-10-06T01:40:41.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.438+0000 7ffb3122d700 1 -- 172.21.15.71:0/628459860 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb2c0c8aa0 con 0x7ffb2c159380 2023-10-06T01:40:41.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.439+0000 7ffb3122d700 1 -- 172.21.15.71:0/628459860 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb2c088610 con 0x7ffb2c159380 2023-10-06T01:40:41.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.439+0000 7ffb237fe700 1 -- 172.21.15.71:0/628459860 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ffb240129e0 con 0x7ffb2c159380 2023-10-06T01:40:41.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.439+0000 7ffb237fe700 1 --2- 172.21.15.71:0/628459860 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7ffb0c066f30 0x7ffb0c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:41.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.439+0000 7ffb237fe700 1 -- 172.21.15.71:0/628459860 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7ffb24084840 con 0x7ffb2c159380 2023-10-06T01:40:41.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.439+0000 7ffb2ad9d700 1 --2- 172.21.15.71:0/628459860 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7ffb0c066f30 0x7ffb0c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:41.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.440+0000 7ffb2ad9d700 1 --2- 172.21.15.71:0/628459860 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7ffb0c066f30 0x7ffb0c0693e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c0011e0 tx=0x7ffb1c000bc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:41.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.444+0000 7ffb237fe700 1 -- 172.21.15.71:0/628459860 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffb24051660 con 0x7ffb2c159380 2023-10-06T01:40:41.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.678+0000 7ffb3122d700 1 -- 172.21.15.71:0/628459860 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7ffb2c15ae60 con 0x7ffb2c159380 2023-10-06T01:40:41.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.681+0000 7ffb237fe700 1 -- 172.21.15.71:0/628459860 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+163698 (secure 0 0 0) 0x7ffb24054c80 con 0x7ffb2c159380 2023-10-06T01:40:41.684 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:40:41.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.683+0000 7ffb3122d700 1 -- 172.21.15.71:0/628459860 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7ffb0c066f30 msgr2=0x7ffb0c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:41.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.683+0000 7ffb3122d700 1 --2- 172.21.15.71:0/628459860 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7ffb0c066f30 0x7ffb0c0693e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c0011e0 tx=0x7ffb1c000bc0 comp rx=0 tx=0).stop 2023-10-06T01:40:41.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.683+0000 7ffb3122d700 1 -- 172.21.15.71:0/628459860 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffb2c159380 msgr2=0x7ffb2c153600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:41.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.683+0000 7ffb3122d700 1 --2- 172.21.15.71:0/628459860 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffb2c159380 0x7ffb2c153600 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ffb2400c860 tx=0x7ffb24002700 comp rx=0 tx=0).stop 2023-10-06T01:40:41.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.683+0000 7ffb3122d700 1 -- 172.21.15.71:0/628459860 shutdown_connections 2023-10-06T01:40:41.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.683+0000 7ffb3122d700 1 --2- 172.21.15.71:0/628459860 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffb2c159380 0x7ffb2c153600 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:41.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.683+0000 7ffb3122d700 1 --2- 172.21.15.71:0/628459860 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb2c06a010 0x7ffb2c0ca1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:41.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.683+0000 7ffb3122d700 1 --2- 172.21.15.71:0/628459860 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7ffb0c066f30 0x7ffb0c0693e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:41.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.683+0000 7ffb3122d700 1 --2- 172.21.15.71:0/628459860 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb2c06a3e0 0x7ffb2c0c7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:41.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.683+0000 7ffb3122d700 1 -- 172.21.15.71:0/628459860 >> 172.21.15.71:0/628459860 conn(0x7ffb2c087c90 msgr2=0x7ffb2c156040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:41.687 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.683+0000 7ffb3122d700 1 -- 172.21.15.71:0/628459860 shutdown_connections 2023-10-06T01:40:41.687 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.683+0000 7ffb3122d700 1 -- 172.21.15.71:0/628459860 wait complete. 2023-10-06T01:40:41.696 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":5,"active_gid":4107,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":90436},{"type":"v1","addr":"172.21.15.71:6833","nonce":90436}]},"active_addr":"172.21.15.71:6833/90436","active_change":"2023-10-06T01:40:02.552925+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":4108,"name":"x","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.71:0","nonce":3012553092}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.71:0","nonce":2593407428}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.71:0","nonce":3425726050}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.71:0","nonce":300302363}]}]} 2023-10-06T01:40:41.701 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-06T01:40:41.701 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-06T01:40:41.701 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:40:41.815 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.814+0000 7f57b2256700 1 Processor -- start 2023-10-06T01:40:41.816 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.814+0000 7f57b2256700 1 -- start start 2023-10-06T01:40:41.818 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.815+0000 7f57b2256700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f57ac153a10 0x7f57ac0cf330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:41.818 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.815+0000 7f57b2256700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f57ac0d05a0 0x7f57ac15abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:41.818 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.815+0000 7f57b2256700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57ac0ceea0 con 0x7f57ac0cf870 2023-10-06T01:40:41.818 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.815+0000 7f57b2256700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57ac069140 con 0x7f57ac0d05a0 2023-10-06T01:40:41.818 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.815+0000 7f57b2256700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57ac15a690 con 0x7f57ac153a10 2023-10-06T01:40:41.818 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.815+0000 7f57b1a55700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f57ac0d05a0 0x7f57ac15abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:41.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.815+0000 7f57b1a55700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f57ac0d05a0 0x7f57ac15abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47266/0 (socket says 172.21.15.71:47266) 2023-10-06T01:40:41.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.815+0000 7f57b1a55700 1 -- 172.21.15.71:0/3477688989 learned_addr learned my addr 172.21.15.71:0/3477688989 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:41.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.815+0000 7f57b1254700 1 --2- 172.21.15.71:0/3477688989 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f57ac153a10 0x7f57ac0cf330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:41.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.815+0000 7f57b1a55700 1 -- 172.21.15.71:0/3477688989 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f57ac153a10 msgr2=0x7f57ac0cf330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:41.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.815+0000 7f57b1a55700 1 --2- 172.21.15.71:0/3477688989 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f57ac153a10 0x7f57ac0cf330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:41.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.815+0000 7f57b1a55700 1 -- 172.21.15.71:0/3477688989 >> v1:172.21.15.72:6789/0 conn(0x7f57ac0cf870 legacy=0x7f57ac0cfe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:41.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.815+0000 7f57b1a55700 1 -- 172.21.15.71:0/3477688989 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57ac0ce850 con 0x7f57ac0d05a0 2023-10-06T01:40:41.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.815+0000 7f57b1254700 1 --2- 172.21.15.71:0/3477688989 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f57ac153a10 0x7f57ac0cf330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:40:41.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.815+0000 7f57b1a55700 1 --2- 172.21.15.71:0/3477688989 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f57ac0d05a0 0x7f57ac15abe0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f57a4009f20 tx=0x7f57a4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c333d073f0a8b49a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:41.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.815+0000 7f57a3fff700 1 -- 172.21.15.71:0/3477688989 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a400e070 con 0x7f57ac0d05a0 2023-10-06T01:40:41.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.815+0000 7f57a3fff700 1 -- 172.21.15.71:0/3477688989 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57a400ba40 con 0x7f57ac0d05a0 2023-10-06T01:40:41.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.815+0000 7f57a3fff700 1 -- 172.21.15.71:0/3477688989 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a40092e0 con 0x7f57ac0d05a0 2023-10-06T01:40:41.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.816+0000 7f57b2256700 1 -- 172.21.15.71:0/3477688989 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f57ac0d05a0 msgr2=0x7f57ac15abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:41.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.816+0000 7f57b2256700 1 --2- 172.21.15.71:0/3477688989 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f57ac0d05a0 0x7f57ac15abe0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f57a4009f20 tx=0x7f57a4009840 comp rx=0 tx=0).stop 2023-10-06T01:40:41.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.816+0000 7f57b2256700 1 -- 172.21.15.71:0/3477688989 shutdown_connections 2023-10-06T01:40:41.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.816+0000 7f57b2256700 1 --2- 172.21.15.71:0/3477688989 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f57ac0d05a0 0x7f57ac15abe0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:41.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.816+0000 7f57b2256700 1 --2- 172.21.15.71:0/3477688989 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f57ac153a10 0x7f57ac0cf330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:41.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.816+0000 7f57b2256700 1 -- 172.21.15.71:0/3477688989 >> 172.21.15.71:0/3477688989 conn(0x7f57ac06ac00 msgr2=0x7f57ac068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:41.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.816+0000 7f57b2256700 1 -- 172.21.15.71:0/3477688989 shutdown_connections 2023-10-06T01:40:41.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.816+0000 7f57b2256700 1 -- 172.21.15.71:0/3477688989 wait complete. 2023-10-06T01:40:41.823 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.817+0000 7f57b2256700 1 Processor -- start 2023-10-06T01:40:41.823 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.817+0000 7f57b2256700 1 -- start start 2023-10-06T01:40:41.823 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.818+0000 7f57b2256700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f57ac0cf870 0x7f57ac157200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:41.823 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.818+0000 7f57b2256700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f57ac0d05a0 0x7f57ac0c5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:41.823 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.818+0000 7f57b2256700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f57ac153a10 0x7f57ac0cbe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:41.823 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.818+0000 7f57b2256700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57ac158510 con 0x7f57ac0d05a0 2023-10-06T01:40:41.823 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.818+0000 7f57b2256700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57ac0c5660 con 0x7f57ac153a10 2023-10-06T01:40:41.823 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.818+0000 7f57b2256700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57ac157900 con 0x7f57ac0cf870 2023-10-06T01:40:41.823 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.818+0000 7f57b0a53700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f57ac0d05a0 0x7f57ac0c5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:41.823 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.818+0000 7f57b0a53700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f57ac0d05a0 0x7f57ac0c5120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47282/0 (socket says 172.21.15.71:47282) 2023-10-06T01:40:41.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.818+0000 7f57b0a53700 1 -- 172.21.15.71:0/4161349175 learned_addr learned my addr 172.21.15.71:0/4161349175 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:41.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.818+0000 7f57b1a55700 1 --2- 172.21.15.71:0/4161349175 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f57ac153a10 0x7f57ac0cbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:41.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.818+0000 7f57b1254700 1 --2- 172.21.15.71:0/4161349175 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f57ac0cf870 0x7f57ac157200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:41.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.818+0000 7f57b0a53700 1 -- 172.21.15.71:0/4161349175 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f57ac0cf870 msgr2=0x7f57ac157200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:41.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.818+0000 7f57b0a53700 1 --2- 172.21.15.71:0/4161349175 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f57ac0cf870 0x7f57ac157200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:41.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.818+0000 7f57b0a53700 1 -- 172.21.15.71:0/4161349175 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f57ac153a10 msgr2=0x7f57ac0cbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:41.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.818+0000 7f57b0a53700 1 --2- 172.21.15.71:0/4161349175 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f57ac153a10 0x7f57ac0cbe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:41.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.818+0000 7f57b0a53700 1 -- 172.21.15.71:0/4161349175 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57a4009ae0 con 0x7f57ac0d05a0 2023-10-06T01:40:41.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.818+0000 7f57b0a53700 1 --2- 172.21.15.71:0/4161349175 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f57ac0d05a0 0x7f57ac0c5120 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f579c00c5d0 tx=0x7f579c007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:41.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.818+0000 7f57a17fa700 1 -- 172.21.15.71:0/4161349175 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f579c011590 con 0x7f57ac0d05a0 2023-10-06T01:40:41.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.819+0000 7f57a17fa700 1 -- 172.21.15.71:0/4161349175 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f579c011710 con 0x7f57ac0d05a0 2023-10-06T01:40:41.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.819+0000 7f57b2256700 1 -- 172.21.15.71:0/4161349175 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57ac157be0 con 0x7f57ac0d05a0 2023-10-06T01:40:41.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.819+0000 7f57a17fa700 1 -- 172.21.15.71:0/4161349175 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f579c011ad0 con 0x7f57ac0d05a0 2023-10-06T01:40:41.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.819+0000 7f57b2256700 1 -- 172.21.15.71:0/4161349175 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57ac1581a0 con 0x7f57ac0d05a0 2023-10-06T01:40:41.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.819+0000 7f57b2256700 1 -- 172.21.15.71:0/4161349175 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57ac158680 con 0x7f57ac0d05a0 2023-10-06T01:40:41.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.820+0000 7f57a17fa700 1 -- 172.21.15.71:0/4161349175 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f579c01c460 con 0x7f57ac0d05a0 2023-10-06T01:40:41.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.820+0000 7f57a17fa700 1 --2- 172.21.15.71:0/4161349175 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f5790066f30 0x7f57900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:41.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.820+0000 7f57a17fa700 1 -- 172.21.15.71:0/4161349175 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f579c084780 con 0x7f57ac0d05a0 2023-10-06T01:40:41.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.820+0000 7f57b1254700 1 --2- 172.21.15.71:0/4161349175 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f5790066f30 0x7f57900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:41.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.821+0000 7f57b1254700 1 --2- 172.21.15.71:0/4161349175 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f5790066f30 0x7f57900693e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f57a8006fd0 tx=0x7f57a8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:41.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:41.825+0000 7f57a17fa700 1 -- 172.21.15.71:0/4161349175 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f579c0515a0 con 0x7f57ac0d05a0 2023-10-06T01:40:42.012 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.011+0000 7f57b2256700 1 -- 172.21.15.71:0/4161349175 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f57ac0ceb30 con 0x7f57ac0d05a0 2023-10-06T01:40:42.013 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.012+0000 7f57a17fa700 1 -- 172.21.15.71:0/4161349175 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18659 (secure 0 0 0) 0x7f579c054bc0 con 0x7f57ac0d05a0 2023-10-06T01:40:42.014 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:40:42.014 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":27,"fsid":"1fbf1bd2-f9b4-4599-bea2-f4aa920e9a56","created":"2023-10-06T01:39:57.016957+0000","modified":"2023-10-06T01:40:26.202441+0000","last_up_change":"2023-10-06T01:40:08.571643+0000","last_in_change":"2023-10-06T01:39:59.462741+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T01:40:08.610349+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T01:40:15.387434+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T01:40:19.640459+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T01:40:20.116883+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T01:40:23.830129+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cf059188-fb20-4dbf-95db-dcf57b213d03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":90670},{"type":"v1","addr":"172.21.15.71:6817","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":90670},{"type":"v1","addr":"172.21.15.71:6819","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":90670},{"type":"v1","addr":"172.21.15.71:6823","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":90670},{"type":"v1","addr":"172.21.15.71:6821","nonce":90670}]},"public_addr":"172.21.15.71:6817/90670","cluster_addr":"172.21.15.71:6819/90670","heartbeat_back_addr":"172.21.15.71:6823/90670","heartbeat_front_addr":"172.21.15.71:6821/90670","state":["exists","up"]},{"osd":1,"uuid":"0cff0aae-1799-4fe0-b610-54cf0813c0e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":90669},{"type":"v1","addr":"172.21.15.71:6809","nonce":90669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":90669},{"type":"v1","addr":"172.21.15.71:6811","nonce":90669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":90669},{"type":"v1","addr":"172.21.15.71:6815","nonce":90669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":90669},{"type":"v1","addr":"172.21.15.71:6813","nonce":90669}]},"public_addr":"172.21.15.71:6809/90669","cluster_addr":"172.21.15.71:6811/90669","heartbeat_back_addr":"172.21.15.71:6815/90669","heartbeat_front_addr":"172.21.15.71:6813/90669","state":["exists","up"]},{"osd":2,"uuid":"88d61ddc-9031-44e1-ba8c-546a41e7c8ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":90679},{"type":"v1","addr":"172.21.15.71:6825","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":90679},{"type":"v1","addr":"172.21.15.71:6827","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":90679},{"type":"v1","addr":"172.21.15.71:6831","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":90679},{"type":"v1","addr":"172.21.15.71:6829","nonce":90679}]},"public_addr":"172.21.15.71:6825/90679","cluster_addr":"172.21.15.71:6827/90679","heartbeat_back_addr":"172.21.15.71:6831/90679","heartbeat_front_addr":"172.21.15.71:6829/90679","state":["exists","up"]},{"osd":3,"uuid":"11ed92b7-960b-4a30-a889-a61d3eeb86f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":90668},{"type":"v1","addr":"172.21.15.71:6801","nonce":90668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":90668},{"type":"v1","addr":"172.21.15.71:6803","nonce":90668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":90668},{"type":"v1","addr":"172.21.15.71:6807","nonce":90668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":90668},{"type":"v1","addr":"172.21.15.71:6805","nonce":90668}]},"public_addr":"172.21.15.71:6801/90668","cluster_addr":"172.21.15.71:6803/90668","heartbeat_back_addr":"172.21.15.71:6807/90668","heartbeat_front_addr":"172.21.15.71:6805/90668","state":["exists","up"]},{"osd":4,"uuid":"ae4df784-abdf-4ddf-aefa-780f3ddafef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":90917},{"type":"v1","addr":"172.21.15.72:6801","nonce":90917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":90917},{"type":"v1","addr":"172.21.15.72:6803","nonce":90917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":90917},{"type":"v1","addr":"172.21.15.72:6807","nonce":90917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":90917},{"type":"v1","addr":"172.21.15.72:6805","nonce":90917}]},"public_addr":"172.21.15.72:6801/90917","cluster_addr":"172.21.15.72:6803/90917","heartbeat_back_addr":"172.21.15.72:6807/90917","heartbeat_front_addr":"172.21.15.72:6805/90917","state":["exists","up"]},{"osd":5,"uuid":"5ef0790f-001e-458f-a05b-efae216cf435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":90941},{"type":"v1","addr":"172.21.15.72:6817","nonce":90941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":90941},{"type":"v1","addr":"172.21.15.72:6819","nonce":90941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":90941},{"type":"v1","addr":"172.21.15.72:6827","nonce":90941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":90941},{"type":"v1","addr":"172.21.15.72:6823","nonce":90941}]},"public_addr":"172.21.15.72:6817/90941","cluster_addr":"172.21.15.72:6819/90941","heartbeat_back_addr":"172.21.15.72:6827/90941","heartbeat_front_addr":"172.21.15.72:6823/90941","state":["exists","up"]},{"osd":6,"uuid":"8705aef1-9ae8-4e54-a3c4-c2909fa0ceb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":90918},{"type":"v1","addr":"172.21.15.72:6809","nonce":90918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":90918},{"type":"v1","addr":"172.21.15.72:6811","nonce":90918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":90918},{"type":"v1","addr":"172.21.15.72:6815","nonce":90918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":90918},{"type":"v1","addr":"172.21.15.72:6813","nonce":90918}]},"public_addr":"172.21.15.72:6809/90918","cluster_addr":"172.21.15.72:6811/90918","heartbeat_back_addr":"172.21.15.72:6815/90918","heartbeat_front_addr":"172.21.15.72:6813/90918","state":["exists","up"]},{"osd":7,"uuid":"364c5119-6b13-4c75-b3f0-15e165eff86a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":90948},{"type":"v1","addr":"172.21.15.72:6822","nonce":90948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":90948},{"type":"v1","addr":"172.21.15.72:6826","nonce":90948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":90948},{"type":"v1","addr":"172.21.15.72:6831","nonce":90948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":90948},{"type":"v1","addr":"172.21.15.72:6829","nonce":90948}]},"public_addr":"172.21.15.72:6822/90948","cluster_addr":"172.21.15.72:6826/90948","heartbeat_back_addr":"172.21.15.72:6831/90948","heartbeat_front_addr":"172.21.15.72:6829/90948","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.642976+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.645372+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.619116+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.663042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.599163+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.646411+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.631545+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.669821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:40:42.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.014+0000 7f57b2256700 1 -- 172.21.15.71:0/4161349175 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f5790066f30 msgr2=0x7f57900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:42.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.014+0000 7f57b2256700 1 --2- 172.21.15.71:0/4161349175 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f5790066f30 0x7f57900693e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f57a8006fd0 tx=0x7f57a8008040 comp rx=0 tx=0).stop 2023-10-06T01:40:42.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.014+0000 7f57b2256700 1 -- 172.21.15.71:0/4161349175 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f57ac0d05a0 msgr2=0x7f57ac0c5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:42.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.014+0000 7f57b2256700 1 --2- 172.21.15.71:0/4161349175 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f57ac0d05a0 0x7f57ac0c5120 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f579c00c5d0 tx=0x7f579c007f60 comp rx=0 tx=0).stop 2023-10-06T01:40:42.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.014+0000 7f57b2256700 1 -- 172.21.15.71:0/4161349175 shutdown_connections 2023-10-06T01:40:42.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.014+0000 7f57b2256700 1 --2- 172.21.15.71:0/4161349175 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f5790066f30 0x7f57900693e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.014+0000 7f57b2256700 1 --2- 172.21.15.71:0/4161349175 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f57ac153a10 0x7f57ac0cbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.014+0000 7f57b2256700 1 --2- 172.21.15.71:0/4161349175 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f57ac0cf870 0x7f57ac157200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.014+0000 7f57b2256700 1 --2- 172.21.15.71:0/4161349175 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f57ac0d05a0 0x7f57ac0c5120 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.014+0000 7f57b2256700 1 -- 172.21.15.71:0/4161349175 >> 172.21.15.71:0/4161349175 conn(0x7f57ac06ac00 msgr2=0x7f57ac0b3aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:42.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.014+0000 7f57b2256700 1 -- 172.21.15.71:0/4161349175 shutdown_connections 2023-10-06T01:40:42.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.014+0000 7f57b2256700 1 -- 172.21.15.71:0/4161349175 wait complete. 2023-10-06T01:40:42.027 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-06T01:40:42.028 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:40:42.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.140+0000 7fe3b3fff700 1 Processor -- start 2023-10-06T01:40:42.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.140+0000 7fe3b3fff700 1 -- start start 2023-10-06T01:40:42.150 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.141+0000 7fe3b3fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe3b40cf1a0 0x7fe3b40cfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.150 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.141+0000 7fe3b3fff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3b40b3560 con 0x7fe3b41597d0 2023-10-06T01:40:42.150 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.141+0000 7fe3b3fff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3b40cf6f0 con 0x7fe3b4159400 2023-10-06T01:40:42.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.141+0000 7fe3b3fff700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b40cf9d0 con 0x7fe3b40cf1a0 2023-10-06T01:40:42.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.141+0000 7fe3b37fe700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fe3b41597d0 0x7fe3b40b39f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:59400/0 (socket says 172.21.15.71:59400) 2023-10-06T01:40:42.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.141+0000 7fe3b37fe700 1 -- 172.21.15.71:0/1677696266 learned_addr learned my addr 172.21.15.71:0/1677696266 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:40:42.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.141+0000 7fe3aa7fc700 1 --2- 172.21.15.71:0/1677696266 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe3b40cf1a0 0x7fe3b40cfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:42.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.141+0000 7fe3b27fc700 1 -- 172.21.15.71:0/1677696266 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 117999325 0 0) 0x7fe3b40b3560 con 0x7fe3b41597d0 2023-10-06T01:40:42.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.142+0000 7fe3b27fc700 1 -- 172.21.15.71:0/1677696266 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3a0003570 con 0x7fe3b41597d0 2023-10-06T01:40:42.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.142+0000 7fe3b27fc700 1 -- 172.21.15.71:0/1677696266 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 442756465 0 0) 0x7fe3b40cf6f0 con 0x7fe3b4159400 2023-10-06T01:40:42.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.142+0000 7fe3b27fc700 1 -- 172.21.15.71:0/1677696266 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3b40b3560 con 0x7fe3b4159400 2023-10-06T01:40:42.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.142+0000 7fe3b27fc700 1 -- 172.21.15.71:0/1677696266 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3004881663 0 0) 0x7fe3a0003570 con 0x7fe3b41597d0 2023-10-06T01:40:42.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.142+0000 7fe3aa7fc700 1 -- 172.21.15.71:0/1677696266 >> v1:172.21.15.72:6789/0 conn(0x7fe3b4159400 legacy=0x7fe3b40ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:42.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.142+0000 7fe3aa7fc700 1 -- 172.21.15.71:0/1677696266 >> v1:172.21.15.71:6789/0 conn(0x7fe3b41597d0 legacy=0x7fe3b40b39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:42.152 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.142+0000 7fe3aa7fc700 1 -- 172.21.15.71:0/1677696266 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3b40b2f10 con 0x7fe3b40cf1a0 2023-10-06T01:40:42.152 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.142+0000 7fe3aa7fc700 1 --2- 172.21.15.71:0/1677696266 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe3b40cf1a0 0x7fe3b40cfec0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe39c009910 tx=0x7fe39c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46b317dc14fbc8b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:42.152 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.142+0000 7fe3b27fc700 1 -- 172.21.15.71:0/1677696266 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3ac0017f0 con 0x7fe3b40cf1a0 2023-10-06T01:40:42.152 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.142+0000 7fe3b27fc700 1 -- 172.21.15.71:0/1677696266 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe39c011420 con 0x7fe3b40cf1a0 2023-10-06T01:40:42.152 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.142+0000 7fe3b27fc700 1 -- 172.21.15.71:0/1677696266 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe39c0117a0 con 0x7fe3b40cf1a0 2023-10-06T01:40:42.152 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.142+0000 7fe3b3fff700 1 -- 172.21.15.71:0/1677696266 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe3b40cf1a0 msgr2=0x7fe3b40cfec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:42.152 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.143+0000 7fe3b3fff700 1 --2- 172.21.15.71:0/1677696266 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe3b40cf1a0 0x7fe3b40cfec0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe39c009910 tx=0x7fe39c0091a0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.152 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.143+0000 7fe3b3fff700 1 -- 172.21.15.71:0/1677696266 shutdown_connections 2023-10-06T01:40:42.152 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.143+0000 7fe3b3fff700 1 --2- 172.21.15.71:0/1677696266 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe3b40cf1a0 0x7fe3b40cfec0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.152 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.143+0000 7fe3b3fff700 1 -- 172.21.15.71:0/1677696266 >> 172.21.15.71:0/1677696266 conn(0x7fe3b406ac10 msgr2=0x7fe3b4068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:42.152 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.143+0000 7fe3b3fff700 1 -- 172.21.15.71:0/1677696266 shutdown_connections 2023-10-06T01:40:42.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.143+0000 7fe3b3fff700 1 -- 172.21.15.71:0/1677696266 wait complete. 2023-10-06T01:40:42.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.144+0000 7fe3b3fff700 1 Processor -- start 2023-10-06T01:40:42.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.144+0000 7fe3b3fff700 1 -- start start 2023-10-06T01:40:42.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.145+0000 7fe3b3fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3b40cf1a0 0x7fe3b415c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.145+0000 7fe3b3fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3b4159400 0x7fe3b416d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.145+0000 7fe3b3fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe3b41597d0 0x7fe3b416d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.145+0000 7fe3b3fff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b416dfa0 con 0x7fe3b40cf1a0 2023-10-06T01:40:42.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.145+0000 7fe3b3fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b416dac0 con 0x7fe3b4159400 2023-10-06T01:40:42.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.145+0000 7fe3b3fff700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b40b0750 con 0x7fe3b41597d0 2023-10-06T01:40:42.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.145+0000 7fe3b2ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3b40cf1a0 0x7fe3b415c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:42.153 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.145+0000 7fe3b2ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3b40cf1a0 0x7fe3b415c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47290/0 (socket says 172.21.15.71:47290) 2023-10-06T01:40:42.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.145+0000 7fe3b2ffd700 1 -- 172.21.15.71:0/1851180832 learned_addr learned my addr 172.21.15.71:0/1851180832 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:42.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.145+0000 7fe3b37fe700 1 --2- 172.21.15.71:0/1851180832 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe3b41597d0 0x7fe3b416d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:42.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.145+0000 7fe3aa7fc700 1 --2- 172.21.15.71:0/1851180832 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3b4159400 0x7fe3b416d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:42.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.145+0000 7fe3b2ffd700 1 -- 172.21.15.71:0/1851180832 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe3b41597d0 msgr2=0x7fe3b416d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:42.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.145+0000 7fe3b2ffd700 1 --2- 172.21.15.71:0/1851180832 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe3b41597d0 0x7fe3b416d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.145+0000 7fe3b2ffd700 1 -- 172.21.15.71:0/1851180832 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3b4159400 msgr2=0x7fe3b416d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:42.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.145+0000 7fe3b2ffd700 1 --2- 172.21.15.71:0/1851180832 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3b4159400 0x7fe3b416d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.145+0000 7fe3b2ffd700 1 -- 172.21.15.71:0/1851180832 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe39c009420 con 0x7fe3b40cf1a0 2023-10-06T01:40:42.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.145+0000 7fe3b2ffd700 1 --2- 172.21.15.71:0/1851180832 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3b40cf1a0 0x7fe3b415c0d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe3a400c7c0 tx=0x7fe3a4007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:42.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.145+0000 7fe3ab7fe700 1 -- 172.21.15.71:0/1851180832 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a4001530 con 0x7fe3b40cf1a0 2023-10-06T01:40:42.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.145+0000 7fe3ab7fe700 1 -- 172.21.15.71:0/1851180832 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3a40016b0 con 0x7fe3b40cf1a0 2023-10-06T01:40:42.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.145+0000 7fe3b3fff700 1 -- 172.21.15.71:0/1851180832 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3b416dcc0 con 0x7fe3b40cf1a0 2023-10-06T01:40:42.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.145+0000 7fe3ab7fe700 1 -- 172.21.15.71:0/1851180832 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a4001a70 con 0x7fe3b40cf1a0 2023-10-06T01:40:42.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.145+0000 7fe3b3fff700 1 -- 172.21.15.71:0/1851180832 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3b40b03e0 con 0x7fe3b40cf1a0 2023-10-06T01:40:42.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.146+0000 7fe3b3fff700 1 -- 172.21.15.71:0/1851180832 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3b40aff60 con 0x7fe3b40cf1a0 2023-10-06T01:40:42.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.147+0000 7fe3ab7fe700 1 -- 172.21.15.71:0/1851180832 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe3a401b3b0 con 0x7fe3b40cf1a0 2023-10-06T01:40:42.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.147+0000 7fe3ab7fe700 1 --2- 172.21.15.71:0/1851180832 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fe394066fb0 0x7fe394069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.147+0000 7fe3ab7fe700 1 -- 172.21.15.71:0/1851180832 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fe3a4084200 con 0x7fe3b40cf1a0 2023-10-06T01:40:42.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.147+0000 7fe3aa7fc700 1 --2- 172.21.15.71:0/1851180832 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fe394066fb0 0x7fe394069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:42.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.148+0000 7fe3aa7fc700 1 --2- 172.21.15.71:0/1851180832 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fe394066fb0 0x7fe394069460 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe39c009860 tx=0x7fe39c016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:42.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.151+0000 7fe3ab7fe700 1 -- 172.21.15.71:0/1851180832 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe3b40aff60 con 0x7fe3b40cf1a0 2023-10-06T01:40:42.334 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.333+0000 7fe3b3fff700 1 -- 172.21.15.71:0/1851180832 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe3b40aff60 con 0x7fe3b40cf1a0 2023-10-06T01:40:42.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.334+0000 7fe3ab7fe700 1 -- 172.21.15.71:0/1851180832 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18659 (secure 0 0 0) 0x7fe3b40aff60 con 0x7fe3b40cf1a0 2023-10-06T01:40:42.336 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:40:42.336 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":27,"fsid":"1fbf1bd2-f9b4-4599-bea2-f4aa920e9a56","created":"2023-10-06T01:39:57.016957+0000","modified":"2023-10-06T01:40:26.202441+0000","last_up_change":"2023-10-06T01:40:08.571643+0000","last_in_change":"2023-10-06T01:39:59.462741+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T01:40:08.610349+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T01:40:15.387434+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T01:40:19.640459+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T01:40:20.116883+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T01:40:23.830129+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cf059188-fb20-4dbf-95db-dcf57b213d03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":90670},{"type":"v1","addr":"172.21.15.71:6817","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":90670},{"type":"v1","addr":"172.21.15.71:6819","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":90670},{"type":"v1","addr":"172.21.15.71:6823","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":90670},{"type":"v1","addr":"172.21.15.71:6821","nonce":90670}]},"public_addr":"172.21.15.71:6817/90670","cluster_addr":"172.21.15.71:6819/90670","heartbeat_back_addr":"172.21.15.71:6823/90670","heartbeat_front_addr":"172.21.15.71:6821/90670","state":["exists","up"]},{"osd":1,"uuid":"0cff0aae-1799-4fe0-b610-54cf0813c0e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":90669},{"type":"v1","addr":"172.21.15.71:6809","nonce":90669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":90669},{"type":"v1","addr":"172.21.15.71:6811","nonce":90669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":90669},{"type":"v1","addr":"172.21.15.71:6815","nonce":90669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":90669},{"type":"v1","addr":"172.21.15.71:6813","nonce":90669}]},"public_addr":"172.21.15.71:6809/90669","cluster_addr":"172.21.15.71:6811/90669","heartbeat_back_addr":"172.21.15.71:6815/90669","heartbeat_front_addr":"172.21.15.71:6813/90669","state":["exists","up"]},{"osd":2,"uuid":"88d61ddc-9031-44e1-ba8c-546a41e7c8ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":90679},{"type":"v1","addr":"172.21.15.71:6825","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":90679},{"type":"v1","addr":"172.21.15.71:6827","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":90679},{"type":"v1","addr":"172.21.15.71:6831","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":90679},{"type":"v1","addr":"172.21.15.71:6829","nonce":90679}]},"public_addr":"172.21.15.71:6825/90679","cluster_addr":"172.21.15.71:6827/90679","heartbeat_back_addr":"172.21.15.71:6831/90679","heartbeat_front_addr":"172.21.15.71:6829/90679","state":["exists","up"]},{"osd":3,"uuid":"11ed92b7-960b-4a30-a889-a61d3eeb86f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":90668},{"type":"v1","addr":"172.21.15.71:6801","nonce":90668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":90668},{"type":"v1","addr":"172.21.15.71:6803","nonce":90668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":90668},{"type":"v1","addr":"172.21.15.71:6807","nonce":90668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":90668},{"type":"v1","addr":"172.21.15.71:6805","nonce":90668}]},"public_addr":"172.21.15.71:6801/90668","cluster_addr":"172.21.15.71:6803/90668","heartbeat_back_addr":"172.21.15.71:6807/90668","heartbeat_front_addr":"172.21.15.71:6805/90668","state":["exists","up"]},{"osd":4,"uuid":"ae4df784-abdf-4ddf-aefa-780f3ddafef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":90917},{"type":"v1","addr":"172.21.15.72:6801","nonce":90917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":90917},{"type":"v1","addr":"172.21.15.72:6803","nonce":90917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":90917},{"type":"v1","addr":"172.21.15.72:6807","nonce":90917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":90917},{"type":"v1","addr":"172.21.15.72:6805","nonce":90917}]},"public_addr":"172.21.15.72:6801/90917","cluster_addr":"172.21.15.72:6803/90917","heartbeat_back_addr":"172.21.15.72:6807/90917","heartbeat_front_addr":"172.21.15.72:6805/90917","state":["exists","up"]},{"osd":5,"uuid":"5ef0790f-001e-458f-a05b-efae216cf435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":90941},{"type":"v1","addr":"172.21.15.72:6817","nonce":90941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":90941},{"type":"v1","addr":"172.21.15.72:6819","nonce":90941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":90941},{"type":"v1","addr":"172.21.15.72:6827","nonce":90941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":90941},{"type":"v1","addr":"172.21.15.72:6823","nonce":90941}]},"public_addr":"172.21.15.72:6817/90941","cluster_addr":"172.21.15.72:6819/90941","heartbeat_back_addr":"172.21.15.72:6827/90941","heartbeat_front_addr":"172.21.15.72:6823/90941","state":["exists","up"]},{"osd":6,"uuid":"8705aef1-9ae8-4e54-a3c4-c2909fa0ceb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":90918},{"type":"v1","addr":"172.21.15.72:6809","nonce":90918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":90918},{"type":"v1","addr":"172.21.15.72:6811","nonce":90918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":90918},{"type":"v1","addr":"172.21.15.72:6815","nonce":90918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":90918},{"type":"v1","addr":"172.21.15.72:6813","nonce":90918}]},"public_addr":"172.21.15.72:6809/90918","cluster_addr":"172.21.15.72:6811/90918","heartbeat_back_addr":"172.21.15.72:6815/90918","heartbeat_front_addr":"172.21.15.72:6813/90918","state":["exists","up"]},{"osd":7,"uuid":"364c5119-6b13-4c75-b3f0-15e165eff86a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":90948},{"type":"v1","addr":"172.21.15.72:6822","nonce":90948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":90948},{"type":"v1","addr":"172.21.15.72:6826","nonce":90948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":90948},{"type":"v1","addr":"172.21.15.72:6831","nonce":90948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":90948},{"type":"v1","addr":"172.21.15.72:6829","nonce":90948}]},"public_addr":"172.21.15.72:6822/90948","cluster_addr":"172.21.15.72:6826/90948","heartbeat_back_addr":"172.21.15.72:6831/90948","heartbeat_front_addr":"172.21.15.72:6829/90948","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.642976+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.645372+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.619116+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.663042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.599163+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.646411+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.631545+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.669821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:40:42.338 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.336+0000 7fe3b3fff700 1 -- 172.21.15.71:0/1851180832 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fe394066fb0 msgr2=0x7fe394069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:42.338 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.336+0000 7fe3b3fff700 1 --2- 172.21.15.71:0/1851180832 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fe394066fb0 0x7fe394069460 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe39c009860 tx=0x7fe39c016000 comp rx=0 tx=0).stop 2023-10-06T01:40:42.338 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.336+0000 7fe3b3fff700 1 -- 172.21.15.71:0/1851180832 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3b40cf1a0 msgr2=0x7fe3b415c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:42.338 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.336+0000 7fe3b3fff700 1 --2- 172.21.15.71:0/1851180832 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3b40cf1a0 0x7fe3b415c0d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe3a400c7c0 tx=0x7fe3a4007e00 comp rx=0 tx=0).stop 2023-10-06T01:40:42.338 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.336+0000 7fe3b3fff700 1 -- 172.21.15.71:0/1851180832 shutdown_connections 2023-10-06T01:40:42.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.336+0000 7fe3b3fff700 1 --2- 172.21.15.71:0/1851180832 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe3b41597d0 0x7fe3b416d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.336+0000 7fe3b3fff700 1 --2- 172.21.15.71:0/1851180832 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe3b40cf1a0 0x7fe3b415c0d0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.336+0000 7fe3b3fff700 1 --2- 172.21.15.71:0/1851180832 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fe394066fb0 0x7fe394069460 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.336+0000 7fe3b3fff700 1 --2- 172.21.15.71:0/1851180832 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3b4159400 0x7fe3b416d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.336+0000 7fe3b3fff700 1 -- 172.21.15.71:0/1851180832 >> 172.21.15.71:0/1851180832 conn(0x7fe3b406ac10 msgr2=0x7fe3b40b39f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:42.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.336+0000 7fe3b3fff700 1 -- 172.21.15.71:0/1851180832 shutdown_connections 2023-10-06T01:40:42.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.336+0000 7fe3b3fff700 1 -- 172.21.15.71:0/1851180832 wait complete. 2023-10-06T01:40:42.350 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-06T01:40:42.350 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-06T01:40:42.351 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-06T01:40:42.351 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-06T01:40:42.352 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-10-06T01:40:42.352 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-10-06T01:40:42.352 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-10-06T01:40:42.353 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-10-06T01:40:42.547 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.545+0000 7feefba0d700 1 Processor -- start 2023-10-06T01:40:42.547 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.545+0000 7f5ce7cd6700 1 Processor -- start 2023-10-06T01:40:42.548 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.546+0000 7feefba0d700 1 -- start start 2023-10-06T01:40:42.548 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.546+0000 7f5ce7cd6700 1 -- start start 2023-10-06T01:40:42.548 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.547+0000 7feefba0d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7feef40af3f0 0x7feef415a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.549 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.547+0000 7feefba0d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7feef40af7c0 0x7feef415d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.549 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.547+0000 7feefba0d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feef415a170 con 0x7feef4159960 2023-10-06T01:40:42.549 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.547+0000 7feefba0d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feef40caeb0 con 0x7feef40af7c0 2023-10-06T01:40:42.549 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.547+0000 7feefba0d700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feef415db80 con 0x7feef40af3f0 2023-10-06T01:40:42.549 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.547+0000 7f5ce7cd6700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5ce0155600 0x7f5ce006c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.549 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.547+0000 7f5ce7cd6700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f5ce01559d0 0x7f5ce006c750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.550 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.547+0000 7f5ce7cd6700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ce00ca680 con 0x7f5ce00688b0 2023-10-06T01:40:42.550 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.547+0000 7f5ce7cd6700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ce0069420 con 0x7f5ce01559d0 2023-10-06T01:40:42.550 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.547+0000 7f5ce7cd6700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ce00ca350 con 0x7f5ce0155600 2023-10-06T01:40:42.550 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.547+0000 7f5ce5271700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f5ce01559d0 0x7f5ce006c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:42.550 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.547+0000 7feef97a9700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7feef40af3f0 0x7feef415a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:42.550 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.547+0000 7feef97a9700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7feef40af3f0 0x7feef415a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:55910/0 (socket says 172.21.15.71:55910) 2023-10-06T01:40:42.550 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.547+0000 7feef97a9700 1 -- 172.21.15.71:0/2906814774 learned_addr learned my addr 172.21.15.71:0/2906814774 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:42.551 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.547+0000 7f5ce5271700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f5ce01559d0 0x7f5ce006c750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47300/0 (socket says 172.21.15.71:47300) 2023-10-06T01:40:42.551 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.547+0000 7f5ce5271700 1 -- 172.21.15.71:0/2597827613 learned_addr learned my addr 172.21.15.71:0/2597827613 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:42.551 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.548+0000 7f5ce5271700 1 -- 172.21.15.71:0/2597827613 >> v2:172.21.15.72:3300/0 conn(0x7f5ce0155600 msgr2=0x7f5ce006c210 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T01:40:42.551 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.548+0000 7f5ce5271700 1 --2- 172.21.15.71:0/2597827613 >> v2:172.21.15.72:3300/0 conn(0x7f5ce0155600 0x7f5ce006c210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.551 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.548+0000 7f5ce5271700 1 -- 172.21.15.71:0/2597827613 >> v1:172.21.15.71:6789/0 conn(0x7f5ce00688b0 legacy=0x7f5ce0068d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:42.552 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.548+0000 7feef97a9700 1 -- 172.21.15.71:0/2906814774 >> v2:172.21.15.71:3300/0 conn(0x7feef40af7c0 msgr2=0x7feef415d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:42.552 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.548+0000 7feef97a9700 1 --2- 172.21.15.71:0/2906814774 >> v2:172.21.15.71:3300/0 conn(0x7feef40af7c0 0x7feef415d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.552 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.548+0000 7feef97a9700 1 -- 172.21.15.71:0/2906814774 >> v1:172.21.15.71:6789/0 conn(0x7feef4159960 legacy=0x7feef4068680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:42.552 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.548+0000 7feef97a9700 1 -- 172.21.15.71:0/2906814774 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feef415de60 con 0x7feef40af3f0 2023-10-06T01:40:42.552 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.548+0000 7feef97a9700 1 --2- 172.21.15.71:0/2906814774 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feef40af3f0 0x7feef415a600 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7feef40ccf90 tx=0x7feef0009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4b3c8f71bd23920 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:42.552 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.548+0000 7f5ce5271700 1 -- 172.21.15.71:0/2597827613 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ce0069620 con 0x7f5ce01559d0 2023-10-06T01:40:42.552 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.548+0000 7f5ce5271700 1 --2- 172.21.15.71:0/2597827613 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ce01559d0 0x7f5ce006c750 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5ce00c91c0 tx=0x7f5cd0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24b19f72fff0992e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:42.553 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.548+0000 7feeebfff700 1 -- 172.21.15.71:0/2906814774 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef000b820 con 0x7feef40af3f0 2023-10-06T01:40:42.553 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.548+0000 7feeebfff700 1 -- 172.21.15.71:0/2906814774 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feef000b980 con 0x7feef40af3f0 2023-10-06T01:40:42.553 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.548+0000 7feeebfff700 1 -- 172.21.15.71:0/2906814774 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef000bd20 con 0x7feef40af3f0 2023-10-06T01:40:42.553 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.548+0000 7f5ce4a70700 1 -- 172.21.15.71:0/2597827613 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd000b860 con 0x7f5ce01559d0 2023-10-06T01:40:42.554 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.548+0000 7f5ce4a70700 1 -- 172.21.15.71:0/2597827613 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cd000b9c0 con 0x7f5ce01559d0 2023-10-06T01:40:42.554 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.549+0000 7f8cac490700 1 Processor -- start 2023-10-06T01:40:42.554 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.549+0000 7fe607240700 1 Processor -- start 2023-10-06T01:40:42.555 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.548+0000 7f5ce4a70700 1 -- 172.21.15.71:0/2597827613 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd000bd60 con 0x7f5ce01559d0 2023-10-06T01:40:42.555 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.549+0000 7f5ce7cd6700 1 -- 172.21.15.71:0/2597827613 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ce01559d0 msgr2=0x7f5ce006c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:42.555 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.549+0000 7f5ce7cd6700 1 --2- 172.21.15.71:0/2597827613 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ce01559d0 0x7f5ce006c750 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5ce00c91c0 tx=0x7f5cd0009250 comp rx=0 tx=0).stop 2023-10-06T01:40:42.555 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.549+0000 7feefba0d700 1 -- 172.21.15.71:0/2906814774 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feef40af3f0 msgr2=0x7feef415a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:42.555 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.549+0000 7feefba0d700 1 --2- 172.21.15.71:0/2906814774 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feef40af3f0 0x7feef415a600 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7feef40ccf90 tx=0x7feef0009250 comp rx=0 tx=0).stop 2023-10-06T01:40:42.555 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.549+0000 7fe607240700 1 -- start start 2023-10-06T01:40:42.556 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.549+0000 7f5ce7cd6700 1 -- 172.21.15.71:0/2597827613 shutdown_connections 2023-10-06T01:40:42.556 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.549+0000 7f5ce7cd6700 1 --2- 172.21.15.71:0/2597827613 >> v2:172.21.15.72:3300/0 conn(0x7f5ce0155600 0x7f5ce006c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.556 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.549+0000 7f5ce7cd6700 1 --2- 172.21.15.71:0/2597827613 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ce01559d0 0x7f5ce006c750 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.549+0000 7f5ce7cd6700 1 -- 172.21.15.71:0/2597827613 >> 172.21.15.71:0/2597827613 conn(0x7f5ce00c9cc0 msgr2=0x7f5ce006acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:42.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.549+0000 7f5ce7cd6700 1 -- 172.21.15.71:0/2597827613 shutdown_connections 2023-10-06T01:40:42.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.549+0000 7f5ce7cd6700 1 -- 172.21.15.71:0/2597827613 wait complete. 2023-10-06T01:40:42.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.550+0000 7fe607240700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe60006c210 0x7fe6000c8010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.550+0000 7fe607240700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe6000c8550 0x7fe600068680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.550+0000 7fe607240700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6000c8ad0 con 0x7fe600157d40 2023-10-06T01:40:42.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.550+0000 7fe607240700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe60006b730 con 0x7fe6000c8550 2023-10-06T01:40:42.558 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.550+0000 7fe607240700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe60006ba10 con 0x7fe60006c210 2023-10-06T01:40:42.558 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.551+0000 7feefba0d700 1 -- 172.21.15.71:0/2906814774 shutdown_connections 2023-10-06T01:40:42.558 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.551+0000 7feefba0d700 1 --2- 172.21.15.71:0/2906814774 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feef40af3f0 0x7feef415a600 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.558 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.551+0000 7feefba0d700 1 --2- 172.21.15.71:0/2906814774 >> v2:172.21.15.71:3300/0 conn(0x7feef40af7c0 0x7feef415d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.558 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.551+0000 7feefba0d700 1 -- 172.21.15.71:0/2906814774 >> 172.21.15.71:0/2906814774 conn(0x7feef406a260 msgr2=0x7feef40cd030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:42.558 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.551+0000 7f01f2b14700 1 Processor -- start 2023-10-06T01:40:42.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.551+0000 7fe604fdc700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fe600157d40 0x7fe600158110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:59424/0 (socket says 172.21.15.71:59424) 2023-10-06T01:40:42.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.551+0000 7fe604fdc700 1 -- 172.21.15.71:0/2113525403 learned_addr learned my addr 172.21.15.71:0/2113525403 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:40:42.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.551+0000 7feefba0d700 1 -- 172.21.15.71:0/2906814774 shutdown_connections 2023-10-06T01:40:42.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.551+0000 7f01f2b14700 1 -- start start 2023-10-06T01:40:42.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.549+0000 7f8cac490700 1 -- start start 2023-10-06T01:40:42.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.551+0000 7f8cac490700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f8ca4159590 0x7f8ca4159a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.551+0000 7f8cac490700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ca40b00c0 con 0x7f8ca4159f40 2023-10-06T01:40:42.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.551+0000 7f8cac490700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ca415a380 con 0x7f8ca4158da0 2023-10-06T01:40:42.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.551+0000 7f8cac490700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ca40af790 con 0x7f8ca4159590 2023-10-06T01:40:42.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.551+0000 7f8ca9a2b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f8ca4159590 0x7f8ca4159a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:42.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.551+0000 7f8ca9a2b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f8ca4159590 0x7f8ca4159a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47306/0 (socket says 172.21.15.71:47306) 2023-10-06T01:40:42.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.551+0000 7f8ca9a2b700 1 -- 172.21.15.71:0/595540172 learned_addr learned my addr 172.21.15.71:0/595540172 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:42.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.551+0000 7fe6057dd700 1 --2- 172.21.15.71:0/2113525403 >> v2:172.21.15.72:3300/0 conn(0x7fe6000c8550 0x7fe600068680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:42.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.551+0000 7feefba0d700 1 -- 172.21.15.71:0/2906814774 wait complete. 2023-10-06T01:40:42.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.551+0000 7f5ce7cd6700 1 Processor -- start 2023-10-06T01:40:42.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.551+0000 7fe5ff7fe700 1 -- 172.21.15.71:0/2113525403 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2828529053 0 0) 0x7fe6000c8ad0 con 0x7fe600157d40 2023-10-06T01:40:42.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.551+0000 7fe5ff7fe700 1 -- 172.21.15.71:0/2113525403 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5e8003570 con 0x7fe600157d40 2023-10-06T01:40:42.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.551+0000 7f5ce7cd6700 1 -- start start 2023-10-06T01:40:42.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.552+0000 7fe6057dd700 1 -- 172.21.15.71:0/2113525403 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe60006c210 msgr2=0x7fe6000c8010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:42.563 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.552+0000 7fe6057dd700 1 --2- 172.21.15.71:0/2113525403 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe60006c210 0x7fe6000c8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.563 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.552+0000 7fe6057dd700 1 -- 172.21.15.71:0/2113525403 >> v1:172.21.15.71:6789/0 conn(0x7fe600157d40 legacy=0x7fe600158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:42.563 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.552+0000 7fe6057dd700 1 -- 172.21.15.71:0/2113525403 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe60006bcf0 con 0x7fe6000c8550 2023-10-06T01:40:42.564 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.552+0000 7f01f2b14700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f01ec0a9dd0 0x7f01ec06e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.564 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.552+0000 7f01f2b14700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f01ec0aa1a0 0x7f01ec1599e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.564 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.552+0000 7f01f2b14700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01ec06e890 con 0x7f01ec15d4c0 2023-10-06T01:40:42.564 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.552+0000 7f01f2b14700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01ec0c8250 con 0x7f01ec0a9dd0 2023-10-06T01:40:42.564 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.552+0000 7f01f2b14700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01ec06eb70 con 0x7f01ec0aa1a0 2023-10-06T01:40:42.564 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.552+0000 7f01ebfff700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f01ec15d4c0 0x7f01ec1592d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:59436/0 (socket says 172.21.15.71:59436) 2023-10-06T01:40:42.564 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.552+0000 7f01ebfff700 1 -- 172.21.15.71:0/3397227125 learned_addr learned my addr 172.21.15.71:0/3397227125 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:40:42.564 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.552+0000 7f01f10b1700 1 --2- 172.21.15.71:0/3397227125 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f01ec0aa1a0 0x7f01ec1599e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:42.564 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.552+0000 7f01f08b0700 1 --2- 172.21.15.71:0/3397227125 >> v2:172.21.15.72:3300/0 conn(0x7f01ec0a9dd0 0x7f01ec06e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:42.565 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.553+0000 7fe6057dd700 1 --2- 172.21.15.71:0/2113525403 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6000c8550 0x7fe600068680 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe5f8009e60 tx=0x7fe5f8009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f6e00d6403b17ee server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:42.565 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.553+0000 7f01eb7fe700 1 -- 172.21.15.71:0/3397227125 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3048914256 0 0) 0x7f01ec06e890 con 0x7f01ec15d4c0 2023-10-06T01:40:42.565 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.553+0000 7f01eb7fe700 1 -- 172.21.15.71:0/3397227125 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01dc003570 con 0x7f01ec15d4c0 2023-10-06T01:40:42.565 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.553+0000 7f5ce7cd6700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ce00688b0 0x7f5ce0169e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.566 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.553+0000 7f5ce7cd6700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5ce0155600 0x7f5ce014f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.566 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.553+0000 7f5ce7cd6700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ce01559d0 0x7f5ce0152f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.566 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.553+0000 7f5ce7cd6700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce0157f30 con 0x7f5ce01559d0 2023-10-06T01:40:42.566 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.553+0000 7f5ce7cd6700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce00af520 con 0x7f5ce00688b0 2023-10-06T01:40:42.566 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.553+0000 7f5ce7cd6700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce016a390 con 0x7f5ce0155600 2023-10-06T01:40:42.566 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.553+0000 7feefba0d700 1 Processor -- start 2023-10-06T01:40:42.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.553+0000 7f5ce5a72700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ce00688b0 0x7f5ce0169e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:42.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.553+0000 7f5ce5a72700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ce00688b0 0x7f5ce0169e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:55946/0 (socket says 172.21.15.71:55946) 2023-10-06T01:40:42.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.553+0000 7f5ce5a72700 1 -- 172.21.15.71:0/2612114386 learned_addr learned my addr 172.21.15.71:0/2612114386 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:42.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.553+0000 7feefba0d700 1 -- start start 2023-10-06T01:40:42.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.553+0000 7f01f10b1700 1 -- 172.21.15.71:0/3397227125 >> v2:172.21.15.72:3300/0 conn(0x7f01ec0a9dd0 msgr2=0x7f01ec06e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:42.568 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.553+0000 7f01f10b1700 1 --2- 172.21.15.71:0/3397227125 >> v2:172.21.15.72:3300/0 conn(0x7f01ec0a9dd0 0x7f01ec06e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.568 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.553+0000 7f01f10b1700 1 -- 172.21.15.71:0/3397227125 >> v1:172.21.15.71:6789/0 conn(0x7f01ec15d4c0 legacy=0x7f01ec1592d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:42.568 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.553+0000 7f5ce6273700 1 --2- 172.21.15.71:0/2612114386 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ce01559d0 0x7f5ce0152f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:42.568 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.553+0000 7f01f10b1700 1 -- 172.21.15.71:0/3397227125 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01ec06ee50 con 0x7f01ec0aa1a0 2023-10-06T01:40:42.568 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.553+0000 7f01f08b0700 1 --2- 172.21.15.71:0/3397227125 >> v2:172.21.15.72:3300/0 conn(0x7f01ec0a9dd0 0x7f01ec06e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:40:42.569 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.553+0000 7fe5ff7fe700 1 -- 172.21.15.71:0/2113525403 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f800e070 con 0x7fe6000c8550 2023-10-06T01:40:42.569 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.553+0000 7fe5ff7fe700 1 -- 172.21.15.71:0/2113525403 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5f800bb60 con 0x7fe6000c8550 2023-10-06T01:40:42.569 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.553+0000 7fe5ff7fe700 1 -- 172.21.15.71:0/2113525403 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f8012430 con 0x7fe6000c8550 2023-10-06T01:40:42.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.553+0000 7f5ce5a72700 1 -- 172.21.15.71:0/2612114386 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5ce0155600 msgr2=0x7f5ce014f260 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T01:40:42.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.553+0000 7f5ce5a72700 1 --2- 172.21.15.71:0/2612114386 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5ce0155600 0x7f5ce014f260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.554+0000 7f5ce5a72700 1 -- 172.21.15.71:0/2612114386 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ce01559d0 msgr2=0x7f5ce0152f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:42.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.554+0000 7f5ce5a72700 1 --2- 172.21.15.71:0/2612114386 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ce01559d0 0x7f5ce0152f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.554+0000 7f5ce5a72700 1 -- 172.21.15.71:0/2612114386 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cd00094f0 con 0x7f5ce00688b0 2023-10-06T01:40:42.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.554+0000 7f5ce6273700 1 --2- 172.21.15.71:0/2612114386 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ce01559d0 0x7f5ce0152f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:40:42.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.554+0000 7f5ce5a72700 1 --2- 172.21.15.71:0/2612114386 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ce00688b0 0x7f5ce0169e50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc00b630 tx=0x7f5cdc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:42.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.554+0000 7f01f10b1700 1 --2- 172.21.15.71:0/3397227125 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f01ec0aa1a0 0x7f01ec1599e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f01ec0c8390 tx=0x7f01e4009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d598365aa1d3b2f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:42.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.554+0000 7f5cd5ffb700 1 -- 172.21.15.71:0/2612114386 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cdc00f510 con 0x7f5ce00688b0 2023-10-06T01:40:42.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.554+0000 7f5ce7cd6700 1 -- 172.21.15.71:0/2612114386 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ce01588d0 con 0x7f5ce00688b0 2023-10-06T01:40:42.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.554+0000 7feefba0d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feef40af3f0 0x7feef40b0de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.554+0000 7feefba0d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feef4159960 0x7feef4155fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.554+0000 7feefba0d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feef40c6a40 0x7feef40c5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.554+0000 7feefba0d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feef40afdd0 con 0x7feef40af3f0 2023-10-06T01:40:42.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.554+0000 7feefba0d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feef40b0950 con 0x7feef4159960 2023-10-06T01:40:42.572 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.554+0000 7feefba0d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feef40c6440 con 0x7feef40c6a40 2023-10-06T01:40:42.572 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.554+0000 7fe607240700 1 -- 172.21.15.71:0/2113525403 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6000c8550 msgr2=0x7fe600068680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:42.572 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.554+0000 7fe607240700 1 --2- 172.21.15.71:0/2113525403 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6000c8550 0x7fe600068680 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe5f8009e60 tx=0x7fe5f8009780 comp rx=0 tx=0).stop 2023-10-06T01:40:42.572 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.554+0000 7f5cd5ffb700 1 -- 172.21.15.71:0/2612114386 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cdc00f670 con 0x7f5ce00688b0 2023-10-06T01:40:42.572 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.554+0000 7f5cd5ffb700 1 -- 172.21.15.71:0/2612114386 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cdc00fa30 con 0x7f5ce00688b0 2023-10-06T01:40:42.572 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.555+0000 7f5ce7cd6700 1 -- 172.21.15.71:0/2612114386 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ce00af7f0 con 0x7f5ce00688b0 2023-10-06T01:40:42.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.554+0000 7feef9faa700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feef40c6a40 0x7feef40c5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:42.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.554+0000 7feef9faa700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feef40c6a40 0x7feef40c5f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.71:48728/0 (socket says 172.21.15.71:48728) 2023-10-06T01:40:42.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.554+0000 7feef9faa700 1 -- 172.21.15.71:0/3393701574 learned_addr learned my addr 172.21.15.71:0/3393701574 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:42.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.554+0000 7feef8fa8700 1 --2- 172.21.15.71:0/3393701574 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feef4159960 0x7feef4155fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:42.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.555+0000 7fe607240700 1 -- 172.21.15.71:0/2113525403 shutdown_connections 2023-10-06T01:40:42.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.555+0000 7fe607240700 1 --2- 172.21.15.71:0/2113525403 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6000c8550 0x7fe600068680 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.574 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.555+0000 7fe607240700 1 --2- 172.21.15.71:0/2113525403 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe60006c210 0x7fe6000c8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.574 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.555+0000 7fe607240700 1 -- 172.21.15.71:0/2113525403 >> 172.21.15.71:0/2113525403 conn(0x7fe60006a260 msgr2=0x7fe6000cd030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:42.574 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.555+0000 7feef9faa700 1 -- 172.21.15.71:0/3393701574 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feef4159960 msgr2=0x7feef4155fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:42.574 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.555+0000 7feef9faa700 1 --2- 172.21.15.71:0/3393701574 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feef4159960 0x7feef4155fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.574 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.555+0000 7feef9faa700 1 -- 172.21.15.71:0/3393701574 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feef40af3f0 msgr2=0x7feef40b0de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:42.574 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.555+0000 7feef9faa700 1 --2- 172.21.15.71:0/3393701574 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feef40af3f0 0x7feef40b0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.552+0000 7f8ca9a2b700 1 -- 172.21.15.71:0/595540172 >> v1:172.21.15.72:6789/0 conn(0x7f8ca4158da0 legacy=0x7f8ca406ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:42.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.552+0000 7f8ca9a2b700 1 -- 172.21.15.71:0/595540172 >> v1:172.21.15.71:6789/0 conn(0x7f8ca4159f40 legacy=0x7f8ca40b0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:42.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.552+0000 7f8ca9a2b700 1 -- 172.21.15.71:0/595540172 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ca40afa70 con 0x7f8ca4159590 2023-10-06T01:40:42.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.553+0000 7f8ca9a2b700 1 --2- 172.21.15.71:0/595540172 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ca4159590 0x7f8ca4159a00 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8c94009320 tx=0x7f8c94009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e69e8413c776ac1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:42.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.555+0000 7f8ca922a700 1 -- 172.21.15.71:0/595540172 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c94013a90 con 0x7f8ca4159590 2023-10-06T01:40:42.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.555+0000 7f8ca922a700 1 -- 172.21.15.71:0/595540172 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c94013bf0 con 0x7f8ca4159590 2023-10-06T01:40:42.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.555+0000 7f8ca922a700 1 -- 172.21.15.71:0/595540172 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c9400b650 con 0x7f8ca4159590 2023-10-06T01:40:42.576 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.555+0000 7feef9faa700 1 -- 172.21.15.71:0/3393701574 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feef00094f0 con 0x7feef40c6a40 2023-10-06T01:40:42.576 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.555+0000 7fe607240700 1 -- 172.21.15.71:0/2113525403 shutdown_connections 2023-10-06T01:40:42.576 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.555+0000 7fe607240700 1 -- 172.21.15.71:0/2113525403 wait complete. 2023-10-06T01:40:42.576 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.555+0000 7feef9faa700 1 --2- 172.21.15.71:0/3393701574 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feef40c6a40 0x7feef40c5f00 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7feeec00bbb0 tx=0x7feeec009810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:42.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.554+0000 7f01eb7fe700 1 -- 172.21.15.71:0/3397227125 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e4016070 con 0x7f01ec0aa1a0 2023-10-06T01:40:42.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.554+0000 7f01eb7fe700 1 -- 172.21.15.71:0/3397227125 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01e400bb60 con 0x7f01ec0aa1a0 2023-10-06T01:40:42.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.554+0000 7f01eb7fe700 1 -- 172.21.15.71:0/3397227125 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e400e070 con 0x7f01ec0aa1a0 2023-10-06T01:40:42.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.555+0000 7feee97fa700 1 -- 172.21.15.71:0/3393701574 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeec00c8c0 con 0x7feef40c6a40 2023-10-06T01:40:42.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.555+0000 7f5ce7cd6700 1 -- 172.21.15.71:0/2612114386 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5ce00afb70 con 0x7f5ce00688b0 2023-10-06T01:40:42.578 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.555+0000 7feee97fa700 1 -- 172.21.15.71:0/3393701574 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeec00ca20 con 0x7feef40c6a40 2023-10-06T01:40:42.578 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.555+0000 7feee97fa700 1 -- 172.21.15.71:0/3393701574 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeec00cde0 con 0x7feef40c6a40 2023-10-06T01:40:42.578 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.556+0000 7feefba0d700 1 -- 172.21.15.71:0/3393701574 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feef40b0020 con 0x7feef40c6a40 2023-10-06T01:40:42.578 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.556+0000 7feefba0d700 1 -- 172.21.15.71:0/3393701574 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feef40b05e0 con 0x7feef40c6a40 2023-10-06T01:40:42.578 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.556+0000 7f8cac490700 1 -- 172.21.15.71:0/595540172 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ca4159590 msgr2=0x7f8ca4159a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:42.578 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.556+0000 7f8cac490700 1 --2- 172.21.15.71:0/595540172 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ca4159590 0x7f8ca4159a00 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8c94009320 tx=0x7f8c94009ae0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.579 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.556+0000 7fcdd832d700 1 Processor -- start 2023-10-06T01:40:42.579 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.556+0000 7f01f2b14700 1 -- 172.21.15.71:0/3397227125 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f01ec0aa1a0 msgr2=0x7f01ec1599e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:42.579 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.556+0000 7f01f2b14700 1 --2- 172.21.15.71:0/3397227125 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f01ec0aa1a0 0x7f01ec1599e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f01ec0c8390 tx=0x7f01e4009780 comp rx=0 tx=0).stop 2023-10-06T01:40:42.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.557+0000 7fe607240700 1 Processor -- start 2023-10-06T01:40:42.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.557+0000 7fe607240700 1 -- start start 2023-10-06T01:40:42.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.556+0000 7f5cd5ffb700 1 -- 172.21.15.71:0/2612114386 <== mon.1 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5cdc01a400 con 0x7f5ce00688b0 2023-10-06T01:40:42.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.557+0000 7f5cd5ffb700 1 --2- 172.21.15.71:0/2612114386 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f5cc4067000 0x7f5cc40694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.557+0000 7f5cd5ffb700 1 -- 172.21.15.71:0/2612114386 <== mon.1 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f5cdc0845e0 con 0x7f5ce00688b0 2023-10-06T01:40:42.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.557+0000 7f5cd5ffb700 1 --2- 172.21.15.71:0/2612114386 >> [v2:172.21.15.71:6800/90668,v1:172.21.15.71:6801/90668] conn(0x7f5cc4070cd0 0x7f5cc4073100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.557+0000 7f5cd5ffb700 1 -- 172.21.15.71:0/2612114386 --> [v2:172.21.15.71:6800/90668,v1:172.21.15.71:6801/90668] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5cc40737d0 con 0x7f5cc4070cd0 2023-10-06T01:40:42.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.557+0000 7f5cd5ffb700 1 -- 172.21.15.71:0/2612114386 <== mon.1 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5cdc084a00 con 0x7f5ce00688b0 2023-10-06T01:40:42.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.557+0000 7f5ce5271700 1 --2- 172.21.15.71:0/2612114386 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f5cc4067000 0x7f5cc40694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:42.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.558+0000 7f5ce5271700 1 --2- 172.21.15.71:0/2612114386 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f5cc4067000 0x7f5cc40694b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5ce00c91c0 tx=0x7f5cd0018000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:42.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.558+0000 7f01f2b14700 1 -- 172.21.15.71:0/3397227125 shutdown_connections 2023-10-06T01:40:42.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.558+0000 7f01f2b14700 1 --2- 172.21.15.71:0/3397227125 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f01ec0aa1a0 0x7f01ec1599e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.558+0000 7f01f2b14700 1 --2- 172.21.15.71:0/3397227125 >> v2:172.21.15.72:3300/0 conn(0x7f01ec0a9dd0 0x7f01ec06e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.558+0000 7f01f2b14700 1 -- 172.21.15.71:0/3397227125 >> 172.21.15.71:0/3397227125 conn(0x7f01ec069110 msgr2=0x7f01ec0cbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:42.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.556+0000 7fcdd832d700 1 -- start start 2023-10-06T01:40:42.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.558+0000 7fcdd832d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcdd006e390 0x7fcdd00acb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.558+0000 7fcdd832d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcdd015ddc0 0x7fcdd00ad080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.558+0000 7fcdd832d700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdd00af340 con 0x7fcdd015d9f0 2023-10-06T01:40:42.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.558+0000 7fcdd832d700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdd00abdf0 con 0x7fcdd015ddc0 2023-10-06T01:40:42.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.558+0000 7fcdd832d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd00abfe0 con 0x7fcdd006e390 2023-10-06T01:40:42.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.558+0000 7fcdd60c9700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fcdd015d9f0 0x7fcdd00ab6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.71:40658/0 (socket says 172.21.15.71:40658) 2023-10-06T01:40:42.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.558+0000 7fcdd60c9700 1 -- 172.21.15.71:0/2309777256 learned_addr learned my addr 172.21.15.71:0/2309777256 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:40:42.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.557+0000 7feefba0d700 1 -- 172.21.15.71:0/3393701574 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7feef406e700 con 0x7feef40c6a40 2023-10-06T01:40:42.583 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.557+0000 7feee97fa700 1 -- 172.21.15.71:0/3393701574 <== mon.2 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7feeec014620 con 0x7feef40c6a40 2023-10-06T01:40:42.583 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.558+0000 7feee97fa700 1 --2- 172.21.15.71:0/3393701574 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7feed8067000 0x7feed80694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.583 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.558+0000 7feee97fa700 1 -- 172.21.15.71:0/3393701574 <== mon.2 v2:172.21.15.72:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7feeec084910 con 0x7feef40c6a40 2023-10-06T01:40:42.583 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.558+0000 7fcdd58c8700 1 --2- 172.21.15.71:0/2309777256 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcdd006e390 0x7fcdd00acb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:42.583 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.558+0000 7f8cac490700 1 -- 172.21.15.71:0/595540172 shutdown_connections 2023-10-06T01:40:42.583 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.558+0000 7f8cac490700 1 --2- 172.21.15.71:0/595540172 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ca4159590 0x7f8ca4159a00 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.583 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.558+0000 7f8cac490700 1 -- 172.21.15.71:0/595540172 >> 172.21.15.71:0/595540172 conn(0x7f8ca4069110 msgr2=0x7f8ca40cbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:42.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.558+0000 7f01f2b14700 1 -- 172.21.15.71:0/3397227125 shutdown_connections 2023-10-06T01:40:42.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.558+0000 7f01f2b14700 1 -- 172.21.15.71:0/3397227125 wait complete. 2023-10-06T01:40:42.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.558+0000 7f8cac490700 1 -- 172.21.15.71:0/595540172 shutdown_connections 2023-10-06T01:40:42.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.558+0000 7f8cac490700 1 -- 172.21.15.71:0/595540172 wait complete. 2023-10-06T01:40:42.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.558+0000 7fe607240700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe60006c210 0x7fe6000c6af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.558+0000 7fe607240700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6000c8550 0x7fe6001509e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.558+0000 7fe607240700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe600157d40 0x7fe6001714d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.558+0000 7fe607240700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe600143b80 con 0x7fe60006c210 2023-10-06T01:40:42.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.558+0000 7fe607240700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe600159020 con 0x7fe6000c8550 2023-10-06T01:40:42.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.558+0000 7fe607240700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe600159300 con 0x7fe600157d40 2023-10-06T01:40:42.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.559+0000 7f5ce6273700 1 --2- 172.21.15.71:0/2612114386 >> [v2:172.21.15.71:6800/90668,v1:172.21.15.71:6801/90668] conn(0x7f5cc4070cd0 0x7f5cc4073100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:42.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.558+0000 7feee97fa700 1 --2- 172.21.15.71:0/3393701574 >> [v2:172.21.15.72:6820/90948,v1:172.21.15.72:6822/90948] conn(0x7feed8070cd0 0x7feed8073100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.558+0000 7feee97fa700 1 -- 172.21.15.71:0/3393701574 --> [v2:172.21.15.72:6820/90948,v1:172.21.15.72:6822/90948] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7feed80737d0 con 0x7feed8070cd0 2023-10-06T01:40:42.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.558+0000 7feee97fa700 1 -- 172.21.15.71:0/3393701574 <== mon.2 v2:172.21.15.72:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7feeec089220 con 0x7feef40c6a40 2023-10-06T01:40:42.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.558+0000 7feef8fa8700 1 --2- 172.21.15.71:0/3393701574 >> [v2:172.21.15.72:6820/90948,v1:172.21.15.72:6822/90948] conn(0x7feed8070cd0 0x7feed8073100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:42.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.559+0000 7feef97a9700 1 --2- 172.21.15.71:0/3393701574 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7feed8067000 0x7feed80694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:42.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.559+0000 7fe6057dd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe600157d40 0x7fe6001714d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:42.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.559+0000 7fe5fffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6000c8550 0x7fe6001509e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:42.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.559+0000 7fe6057dd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe600157d40 0x7fe6001714d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.71:48736/0 (socket says 172.21.15.71:48736) 2023-10-06T01:40:42.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.559+0000 7fe6057dd700 1 -- 172.21.15.71:0/1791831322 learned_addr learned my addr 172.21.15.71:0/1791831322 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:42.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.559+0000 7fe604fdc700 1 --2- 172.21.15.71:0/1791831322 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe60006c210 0x7fe6000c6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:42.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.559+0000 7fe6057dd700 1 -- 172.21.15.71:0/1791831322 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6000c8550 msgr2=0x7fe6001509e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:42.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.559+0000 7fe6057dd700 1 --2- 172.21.15.71:0/1791831322 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6000c8550 0x7fe6001509e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.588 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.559+0000 7fe6057dd700 1 -- 172.21.15.71:0/1791831322 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe60006c210 msgr2=0x7fe6000c6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:42.588 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.559+0000 7fe6057dd700 1 --2- 172.21.15.71:0/1791831322 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe60006c210 0x7fe6000c6af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.588 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.559+0000 7fe6057dd700 1 -- 172.21.15.71:0/1791831322 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5f8009a20 con 0x7fe600157d40 2023-10-06T01:40:42.588 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.559+0000 7fe6057dd700 1 --2- 172.21.15.71:0/1791831322 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe600157d40 0x7fe6001714d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe6000cce70 tx=0x7fe5f8019000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:42.588 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.559+0000 7f5ce6273700 1 --2- 172.21.15.71:0/2612114386 >> [v2:172.21.15.71:6800/90668,v1:172.21.15.71:6801/90668] conn(0x7f5cc4070cd0 0x7f5cc4073100 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:42.588 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.559+0000 7feef97a9700 1 --2- 172.21.15.71:0/3393701574 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7feed8067000 0x7feed80694b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7feef40ccf90 tx=0x7feef0016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:42.589 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.560+0000 7fe5fcff9700 1 -- 172.21.15.71:0/1791831322 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f8027470 con 0x7fe600157d40 2023-10-06T01:40:42.589 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.560+0000 7fe5fcff9700 1 -- 172.21.15.71:0/1791831322 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5f80275d0 con 0x7fe600157d40 2023-10-06T01:40:42.589 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.560+0000 7fe607240700 1 -- 172.21.15.71:0/1791831322 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6001595e0 con 0x7fe600157d40 2023-10-06T01:40:42.589 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.560+0000 7fe5fcff9700 1 -- 172.21.15.71:0/1791831322 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f8027990 con 0x7fe600157d40 2023-10-06T01:40:42.589 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.560+0000 7fe607240700 1 -- 172.21.15.71:0/1791831322 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe600150f20 con 0x7fe600157d40 2023-10-06T01:40:42.589 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.560+0000 7f01f2b14700 1 Processor -- start 2023-10-06T01:40:42.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.558+0000 7fcdd50c7700 1 -- 172.21.15.71:0/2309777256 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 147446502 0 0) 0x7fcdd00af340 con 0x7fcdd015d9f0 2023-10-06T01:40:42.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.558+0000 7fcdd50c7700 1 -- 172.21.15.71:0/2309777256 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcdbc003570 con 0x7fcdd015d9f0 2023-10-06T01:40:42.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.559+0000 7fcdd58c8700 1 -- 172.21.15.71:0/2309777256 >> v2:172.21.15.72:3300/0 conn(0x7fcdd015ddc0 msgr2=0x7fcdd00ad080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:42.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.559+0000 7fcdd58c8700 1 --2- 172.21.15.71:0/2309777256 >> v2:172.21.15.72:3300/0 conn(0x7fcdd015ddc0 0x7fcdd00ad080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.559+0000 7fcdd58c8700 1 -- 172.21.15.71:0/2309777256 >> v1:172.21.15.72:6789/0 conn(0x7fcdd015d9f0 legacy=0x7fcdd00ab6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:42.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.559+0000 7fcdd58c8700 1 -- 172.21.15.71:0/2309777256 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdd00ac2c0 con 0x7fcdd006e390 2023-10-06T01:40:42.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.559+0000 7fcdd58c8700 1 --2- 172.21.15.71:0/2309777256 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcdd006e390 0x7fcdd00acb40 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc0098e0 tx=0x7fcdcc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=676eae43892c9c5a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:42.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.560+0000 7feef8fa8700 1 --2- 172.21.15.71:0/3393701574 >> [v2:172.21.15.72:6820/90948,v1:172.21.15.72:6822/90948] conn(0x7feed8070cd0 0x7feed8073100 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:42.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.560+0000 7f5cd5ffb700 1 -- 172.21.15.71:0/2612114386 <== osd.3 v2:172.21.15.71:6800/90668 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f5cc40737d0 con 0x7f5cc4070cd0 2023-10-06T01:40:42.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.560+0000 7f8cac490700 1 Processor -- start 2023-10-06T01:40:42.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.560+0000 7f8cac490700 1 -- start start 2023-10-06T01:40:42.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.560+0000 7f01f2b14700 1 -- start start 2023-10-06T01:40:42.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.560+0000 7fcdd50c7700 1 -- 172.21.15.71:0/2309777256 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdcc00b640 con 0x7fcdd006e390 2023-10-06T01:40:42.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.560+0000 7fcdd50c7700 1 -- 172.21.15.71:0/2309777256 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdcc00b7c0 con 0x7fcdd006e390 2023-10-06T01:40:42.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.560+0000 7fcdd50c7700 1 -- 172.21.15.71:0/2309777256 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdcc00bb80 con 0x7fcdd006e390 2023-10-06T01:40:42.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.561+0000 7f06bf01a700 1 Processor -- start 2023-10-06T01:40:42.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.561+0000 7fe6d1e68700 1 Processor -- start 2023-10-06T01:40:42.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.561+0000 7fe607240700 1 -- 172.21.15.71:0/1791831322 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe5e0000fd0 con 0x7fe600157d40 2023-10-06T01:40:42.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.561+0000 7fcdd832d700 1 -- 172.21.15.71:0/2309777256 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcdd006e390 msgr2=0x7fcdd00acb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:42.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.561+0000 7fcdd832d700 1 --2- 172.21.15.71:0/2309777256 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcdd006e390 0x7fcdd00acb40 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc0098e0 tx=0x7fcdcc0091a0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.561+0000 7feee97fa700 1 -- 172.21.15.71:0/3393701574 <== osd.7 v2:172.21.15.72:6820/90948 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7feed80737d0 con 0x7feed8070cd0 2023-10-06T01:40:42.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.561+0000 7fcdd832d700 1 -- 172.21.15.71:0/2309777256 shutdown_connections 2023-10-06T01:40:42.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.561+0000 7fcdd832d700 1 --2- 172.21.15.71:0/2309777256 >> v2:172.21.15.72:3300/0 conn(0x7fcdd015ddc0 0x7fcdd00ad080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.561+0000 7fcdd832d700 1 --2- 172.21.15.71:0/2309777256 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcdd006e390 0x7fcdd00acb40 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.561+0000 7fcdd832d700 1 -- 172.21.15.71:0/2309777256 >> 172.21.15.71:0/2309777256 conn(0x7fcdd0069110 msgr2=0x7fcdd00cbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:42.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.561+0000 7fcdd832d700 1 -- 172.21.15.71:0/2309777256 shutdown_connections 2023-10-06T01:40:42.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.561+0000 7f8cac490700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ca4158da0 0x7f8ca414d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.561+0000 7f8cac490700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8ca4159590 0x7f8ca41487c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.561+0000 7f8cac490700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ca4159f40 0x7f8ca4151230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.561+0000 7f8cac490700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca414d180 con 0x7f8ca4159f40 2023-10-06T01:40:42.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.561+0000 7f8cac490700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca414c570 con 0x7f8ca4158da0 2023-10-06T01:40:42.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.561+0000 7f8cac490700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca414c850 con 0x7f8ca4159590 2023-10-06T01:40:42.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.562+0000 7f8caa22c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ca4158da0 0x7f8ca414d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:42.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.562+0000 7f8caa22c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ca4158da0 0x7f8ca414d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:55994/0 (socket says 172.21.15.71:55994) 2023-10-06T01:40:42.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.562+0000 7f8caa22c700 1 -- 172.21.15.71:0/3744562108 learned_addr learned my addr 172.21.15.71:0/3744562108 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:42.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.562+0000 7f8caaa2d700 1 --2- 172.21.15.71:0/3744562108 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ca4159f40 0x7f8ca4151230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:42.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.561+0000 7f06bf01a700 1 -- start start 2023-10-06T01:40:42.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.561+0000 7f01f2b14700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f01ec0a9dd0 0x7f01ec16e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.561+0000 7f01f2b14700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f01ec0aa1a0 0x7f01ec0ca7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.561+0000 7f01f2b14700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01ec15d4c0 0x7f01ec153950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.561+0000 7f01f2b14700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01ec16f190 con 0x7f01ec0a9dd0 2023-10-06T01:40:42.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.561+0000 7f01f2b14700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01ec16e8f0 con 0x7f01ec15d4c0 2023-10-06T01:40:42.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.561+0000 7f01f2b14700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01ec16ebd0 con 0x7f01ec0aa1a0 2023-10-06T01:40:42.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.562+0000 7f01ebfff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f01ec0aa1a0 0x7f01ec0ca7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:42.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.562+0000 7f01ebfff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f01ec0aa1a0 0x7f01ec0ca7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.71:48744/0 (socket says 172.21.15.71:48744) 2023-10-06T01:40:42.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.562+0000 7f01ebfff700 1 -- 172.21.15.71:0/2337569138 learned_addr learned my addr 172.21.15.71:0/2337569138 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:42.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.562+0000 7f01f08b0700 1 --2- 172.21.15.71:0/2337569138 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f01ec0a9dd0 0x7f01ec16e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:42.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.562+0000 7f01f10b1700 1 --2- 172.21.15.71:0/2337569138 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01ec15d4c0 0x7f01ec153950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:42.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.561+0000 7fcdd832d700 1 -- 172.21.15.71:0/2309777256 wait complete. 2023-10-06T01:40:42.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.562+0000 7f06bf01a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f06b8158da0 0x7f06b806ec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.562+0000 7f06bf01a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f06b80c9480 0x7f06b80b0550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.562+0000 7f06bf01a700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06b80b00c0 con 0x7f06b80c8900 2023-10-06T01:40:42.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.562+0000 7f06bf01a700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06b80af790 con 0x7f06b80c9480 2023-10-06T01:40:42.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.562+0000 7f06bf01a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06b80afa70 con 0x7f06b8158da0 2023-10-06T01:40:42.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.562+0000 7f8caa22c700 1 -- 172.21.15.71:0/3744562108 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8ca4159590 msgr2=0x7f8ca41487c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:42.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.562+0000 7f8caa22c700 1 --2- 172.21.15.71:0/3744562108 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8ca4159590 0x7f8ca41487c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.562+0000 7f8caa22c700 1 -- 172.21.15.71:0/3744562108 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ca4159f40 msgr2=0x7f8ca4151230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:42.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.562+0000 7f8caa22c700 1 --2- 172.21.15.71:0/3744562108 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ca4159f40 0x7f8ca4151230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.562+0000 7f8caa22c700 1 -- 172.21.15.71:0/3744562108 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c94009d80 con 0x7f8ca4158da0 2023-10-06T01:40:42.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.562+0000 7f01ebfff700 1 -- 172.21.15.71:0/2337569138 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01ec15d4c0 msgr2=0x7f01ec153950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:42.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.562+0000 7f01ebfff700 1 --2- 172.21.15.71:0/2337569138 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01ec15d4c0 0x7f01ec153950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.562+0000 7f01ebfff700 1 -- 172.21.15.71:0/2337569138 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f01ec0a9dd0 msgr2=0x7f01ec16e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:42.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.562+0000 7f01ebfff700 1 --2- 172.21.15.71:0/2337569138 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f01ec0a9dd0 0x7f01ec16e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.562+0000 7f01ebfff700 1 -- 172.21.15.71:0/2337569138 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01e4009a20 con 0x7f01ec0aa1a0 2023-10-06T01:40:42.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.562+0000 7f06bcdb6700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f06b8158da0 0x7f06b806ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:42.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.563+0000 7f06bcdb6700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f06b8158da0 0x7f06b806ec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.71:48758/0 (socket says 172.21.15.71:48758) 2023-10-06T01:40:42.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.563+0000 7f06bcdb6700 1 -- 172.21.15.71:0/2655003220 learned_addr learned my addr 172.21.15.71:0/2655003220 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:42.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.563+0000 7f06bd5b7700 1 --2- 172.21.15.71:0/2655003220 >> v2:172.21.15.72:3300/0 conn(0x7f06b80c9480 0x7f06b80b0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:42.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.563+0000 7f01f08b0700 1 --2- 172.21.15.71:0/2337569138 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f01ec0a9dd0 0x7f01ec16e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:40:42.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.563+0000 7f8caa22c700 1 --2- 172.21.15.71:0/3744562108 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ca4158da0 0x7f8ca414d610 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8ca000c490 tx=0x7f8ca000c7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:42.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.563+0000 7f06bcdb6700 1 -- 172.21.15.71:0/2655003220 >> v2:172.21.15.72:3300/0 conn(0x7f06b80c9480 msgr2=0x7f06b80b0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:42.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.563+0000 7f06bcdb6700 1 --2- 172.21.15.71:0/2655003220 >> v2:172.21.15.72:3300/0 conn(0x7f06b80c9480 0x7f06b80b0550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.563+0000 7f06bcdb6700 1 -- 172.21.15.71:0/2655003220 >> v1:172.21.15.71:6789/0 conn(0x7f06b80c8900 legacy=0x7f06b80c8d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:42.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.563+0000 7f06bcdb6700 1 -- 172.21.15.71:0/2655003220 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06b80afd50 con 0x7f06b8158da0 2023-10-06T01:40:42.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.563+0000 7f01ebfff700 1 --2- 172.21.15.71:0/2337569138 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f01ec0aa1a0 0x7f01ec0ca7b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f01d800c7c0 tx=0x7f01d8007e00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:42.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.563+0000 7f8c9a7fc700 1 -- 172.21.15.71:0/3744562108 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca0011590 con 0x7f8ca4158da0 2023-10-06T01:40:42.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.563+0000 7f06bcdb6700 1 --2- 172.21.15.71:0/2655003220 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f06b8158da0 0x7f06b806ec70 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f06b40099b0 tx=0x7f06b4009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=efc2249da6def618 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:42.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.562+0000 7fe5fcff9700 1 -- 172.21.15.71:0/1791831322 <== mon.2 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe5f8024070 con 0x7fe600157d40 2023-10-06T01:40:42.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.562+0000 7fe5fcff9700 1 --2- 172.21.15.71:0/1791831322 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fe5ec066f30 0x7fe5ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.562+0000 7fe5fcff9700 1 -- 172.21.15.71:0/1791831322 <== mon.2 v2:172.21.15.72:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fe5f8086f50 con 0x7fe600157d40 2023-10-06T01:40:42.604 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.562+0000 7fe604fdc700 1 --2- 172.21.15.71:0/1791831322 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fe5ec066f30 0x7fe5ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:42.604 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.563+0000 7fe5fcff9700 1 --2- 172.21.15.71:0/1791831322 >> [v2:172.21.15.71:6808/90669,v1:172.21.15.71:6809/90669] conn(0x7fe5ec070c00 0x7fe5ec073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.604 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.563+0000 7fe5fcff9700 1 -- 172.21.15.71:0/1791831322 --> [v2:172.21.15.71:6808/90669,v1:172.21.15.71:6809/90669] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe5ec073700 con 0x7fe5ec070c00 2023-10-06T01:40:42.604 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.563+0000 7fe5fcff9700 1 -- 172.21.15.71:0/1791831322 <== mon.2 v2:172.21.15.72:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe5f8089590 con 0x7fe600157d40 2023-10-06T01:40:42.604 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.563+0000 7fe604fdc700 1 --2- 172.21.15.71:0/1791831322 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fe5ec066f30 0x7fe5ec0693e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe5f0007fd0 tx=0x7fe5f0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:42.604 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.563+0000 7f8c9a7fc700 1 -- 172.21.15.71:0/3744562108 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ca0011710 con 0x7f8ca4158da0 2023-10-06T01:40:42.604 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.563+0000 7f8c9a7fc700 1 -- 172.21.15.71:0/3744562108 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca0011ad0 con 0x7f8ca4158da0 2023-10-06T01:40:42.604 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.563+0000 7f8cac490700 1 -- 172.21.15.71:0/3744562108 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ca414cb30 con 0x7f8ca4158da0 2023-10-06T01:40:42.604 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.563+0000 7f8cac490700 1 -- 172.21.15.71:0/3744562108 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ca414db50 con 0x7f8ca4158da0 2023-10-06T01:40:42.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.563+0000 7f06af7fe700 1 -- 172.21.15.71:0/2655003220 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b4009ea0 con 0x7f06b8158da0 2023-10-06T01:40:42.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.563+0000 7f06af7fe700 1 -- 172.21.15.71:0/2655003220 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06b400b860 con 0x7f06b8158da0 2023-10-06T01:40:42.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.563+0000 7f06af7fe700 1 -- 172.21.15.71:0/2655003220 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b400bc00 con 0x7f06b8158da0 2023-10-06T01:40:42.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.563+0000 7f01e8ff9700 1 -- 172.21.15.71:0/2337569138 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d8005cd0 con 0x7f01ec0aa1a0 2023-10-06T01:40:42.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.563+0000 7f01e8ff9700 1 -- 172.21.15.71:0/2337569138 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01d8005e30 con 0x7f01ec0aa1a0 2023-10-06T01:40:42.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.563+0000 7f01e8ff9700 1 -- 172.21.15.71:0/2337569138 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d8007300 con 0x7f01ec0aa1a0 2023-10-06T01:40:42.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.564+0000 7f01f2b14700 1 -- 172.21.15.71:0/2337569138 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01ec16eeb0 con 0x7f01ec0aa1a0 2023-10-06T01:40:42.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.564+0000 7f01f2b14700 1 -- 172.21.15.71:0/2337569138 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01ec0b1720 con 0x7f01ec0aa1a0 2023-10-06T01:40:42.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.564+0000 7f06bf01a700 1 -- 172.21.15.71:0/2655003220 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f06b8158da0 msgr2=0x7f06b806ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:42.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.564+0000 7f06bf01a700 1 --2- 172.21.15.71:0/2655003220 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f06b8158da0 0x7f06b806ec70 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f06b40099b0 tx=0x7f06b4009250 comp rx=0 tx=0).stop 2023-10-06T01:40:42.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.564+0000 7f06bf01a700 1 -- 172.21.15.71:0/2655003220 shutdown_connections 2023-10-06T01:40:42.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.564+0000 7f06bf01a700 1 --2- 172.21.15.71:0/2655003220 >> v2:172.21.15.72:3300/0 conn(0x7f06b80c9480 0x7f06b80b0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.564+0000 7f06bf01a700 1 --2- 172.21.15.71:0/2655003220 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f06b8158da0 0x7f06b806ec70 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.564+0000 7f06bf01a700 1 -- 172.21.15.71:0/2655003220 >> 172.21.15.71:0/2655003220 conn(0x7f06b8069110 msgr2=0x7f06b80cbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:42.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.563+0000 7fcdd832d700 1 Processor -- start 2023-10-06T01:40:42.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.563+0000 7fcdd832d700 1 -- start start 2023-10-06T01:40:42.608 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.565+0000 7f06bf01a700 1 -- 172.21.15.71:0/2655003220 shutdown_connections 2023-10-06T01:40:42.608 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.565+0000 7f06bf01a700 1 -- 172.21.15.71:0/2655003220 wait complete. 2023-10-06T01:40:42.608 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.565+0000 7f01f2b14700 1 -- 172.21.15.71:0/2337569138 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f01cc000fd0 con 0x7f01ec0aa1a0 2023-10-06T01:40:42.609 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.565+0000 7fe5fffff700 1 --2- 172.21.15.71:0/1791831322 >> [v2:172.21.15.71:6808/90669,v1:172.21.15.71:6809/90669] conn(0x7fe5ec070c00 0x7fe5ec073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:42.609 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.566+0000 7f01e8ff9700 1 -- 172.21.15.71:0/2337569138 <== mon.2 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f01d801b3b0 con 0x7f01ec0aa1a0 2023-10-06T01:40:42.609 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.565+0000 7fcdd832d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcdd006e390 0x7fcdd00c7350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.609 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.565+0000 7fcdd832d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcdd015d9f0 0x7fcdd0144210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.609 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.565+0000 7fcdd832d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcdd015ddc0 0x7fcdd0144750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.610 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.565+0000 7fcdd832d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd0143d80 con 0x7fcdd015ddc0 2023-10-06T01:40:42.610 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.565+0000 7fcdd832d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd00c2590 con 0x7fcdd006e390 2023-10-06T01:40:42.610 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.565+0000 7fcdd832d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd0143730 con 0x7fcdd015d9f0 2023-10-06T01:40:42.610 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.566+0000 7fcdd60c9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcdd006e390 0x7fcdd00c7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:42.610 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.566+0000 7fcdd60c9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcdd006e390 0x7fcdd00c7350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:56030/0 (socket says 172.21.15.71:56030) 2023-10-06T01:40:42.610 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.566+0000 7fcdd60c9700 1 -- 172.21.15.71:0/825836127 learned_addr learned my addr 172.21.15.71:0/825836127 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:42.610 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.566+0000 7fcdd68ca700 1 --2- 172.21.15.71:0/825836127 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcdd015ddc0 0x7fcdd0144750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:42.610 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.566+0000 7fcdd60c9700 1 -- 172.21.15.71:0/825836127 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcdd015d9f0 msgr2=0x7fcdd0144210 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T01:40:42.610 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.566+0000 7fcdd60c9700 1 --2- 172.21.15.71:0/825836127 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcdd015d9f0 0x7fcdd0144210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.610 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.566+0000 7fcdd60c9700 1 -- 172.21.15.71:0/825836127 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcdd015ddc0 msgr2=0x7fcdd0144750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:42.610 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.566+0000 7fcdd60c9700 1 --2- 172.21.15.71:0/825836127 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcdd015ddc0 0x7fcdd0144750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.566+0000 7fcdd60c9700 1 -- 172.21.15.71:0/825836127 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdcc009420 con 0x7fcdd006e390 2023-10-06T01:40:42.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.566+0000 7f8c9a7fc700 1 -- 172.21.15.71:0/3744562108 <== mon.1 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8ca0000fd0 con 0x7f8ca4158da0 2023-10-06T01:40:42.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.566+0000 7fcdd60c9700 1 --2- 172.21.15.71:0/825836127 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcdd006e390 0x7fcdd00c7350 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fcdc800cd30 tx=0x7fcdc8001b10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:42.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.567+0000 7f8c9a7fc700 1 --2- 172.21.15.71:0/3744562108 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f8c88066fb0 0x7f8c88069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.612 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.566+0000 7f06bf01a700 1 Processor -- start 2023-10-06T01:40:42.612 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.566+0000 7f06bf01a700 1 -- start start 2023-10-06T01:40:42.612 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.566+0000 7f01e8ff9700 1 --2- 172.21.15.71:0/2337569138 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f01d0066fb0 0x7f01d0069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.612 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.566+0000 7f01e8ff9700 1 -- 172.21.15.71:0/2337569138 <== mon.2 v2:172.21.15.72:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f01d8084080 con 0x7f01ec0aa1a0 2023-10-06T01:40:42.612 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.566+0000 7f01e8ff9700 1 --2- 172.21.15.71:0/2337569138 >> [v2:172.21.15.72:6800/90917,v1:172.21.15.72:6801/90917] conn(0x7f01d0070c00 0x7f01d0073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.612 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.566+0000 7f01e8ff9700 1 -- 172.21.15.71:0/2337569138 --> [v2:172.21.15.72:6800/90917,v1:172.21.15.72:6801/90917] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f01d0073700 con 0x7f01d0070c00 2023-10-06T01:40:42.613 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.567+0000 7f8c9a7fc700 1 -- 172.21.15.71:0/3744562108 <== mon.1 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f8ca0083d80 con 0x7f8ca4158da0 2023-10-06T01:40:42.613 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.567+0000 7f8ca9a2b700 1 --2- 172.21.15.71:0/3744562108 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f8c88066fb0 0x7f8c88069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:42.613 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.567+0000 7fe5fffff700 1 --2- 172.21.15.71:0/1791831322 >> [v2:172.21.15.71:6808/90669,v1:172.21.15.71:6809/90669] conn(0x7fe5ec070c00 0x7fe5ec073030 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:42.613 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.567+0000 7f01f10b1700 1 --2- 172.21.15.71:0/2337569138 >> [v2:172.21.15.72:6800/90917,v1:172.21.15.72:6801/90917] conn(0x7f01d0070c00 0x7f01d0073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:42.614 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.567+0000 7f01e8ff9700 1 -- 172.21.15.71:0/2337569138 <== mon.2 v2:172.21.15.72:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f01d8050e00 con 0x7f01ec0aa1a0 2023-10-06T01:40:42.614 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.567+0000 7f01f08b0700 1 --2- 172.21.15.71:0/2337569138 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f01d0066fb0 0x7f01d0069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:42.614 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.567+0000 7fcdc67fc700 1 -- 172.21.15.71:0/825836127 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc800ce90 con 0x7fcdd006e390 2023-10-06T01:40:42.614 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.567+0000 7fcdc67fc700 1 -- 172.21.15.71:0/825836127 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdc800ab70 con 0x7fcdd006e390 2023-10-06T01:40:42.614 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.567+0000 7fcdc67fc700 1 -- 172.21.15.71:0/825836127 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc80070f0 con 0x7fcdd006e390 2023-10-06T01:40:42.614 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.567+0000 7fcdd832d700 1 -- 172.21.15.71:0/825836127 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdd0143a10 con 0x7fcdd006e390 2023-10-06T01:40:42.614 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.567+0000 7fcdd832d700 1 -- 172.21.15.71:0/825836127 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdd00c7890 con 0x7fcdd006e390 2023-10-06T01:40:42.615 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.561+0000 7fe6d1e68700 1 -- start start 2023-10-06T01:40:42.615 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.562+0000 7fe6d1e68700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe6cc158da0 0x7fe6cc06ec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.615 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.562+0000 7fe6d1e68700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe6cc0c9480 0x7fe6cc0b0550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.615 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.562+0000 7fe6d1e68700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6cc0b00c0 con 0x7fe6cc0c8900 2023-10-06T01:40:42.615 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.562+0000 7fe6d1e68700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6cc0af790 con 0x7fe6cc0c9480 2023-10-06T01:40:42.615 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.562+0000 7fe6d1e68700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6cc0afa70 con 0x7fe6cc158da0 2023-10-06T01:40:42.615 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.563+0000 7fe6caffd700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fe6cc0c8900 0x7fe6cc0c8d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:59448/0 (socket says 172.21.15.71:59448) 2023-10-06T01:40:42.615 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.563+0000 7fe6caffd700 1 -- 172.21.15.71:0/1174318387 learned_addr learned my addr 172.21.15.71:0/1174318387 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:40:42.615 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.563+0000 7fe6ca7fc700 1 -- 172.21.15.71:0/1174318387 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2201624947 0 0) 0x7fe6cc0b00c0 con 0x7fe6cc0c8900 2023-10-06T01:40:42.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.563+0000 7fe6ca7fc700 1 -- 172.21.15.71:0/1174318387 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6b4003570 con 0x7fe6cc0c8900 2023-10-06T01:40:42.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.563+0000 7fe6ca7fc700 1 -- 172.21.15.71:0/1174318387 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2836054084 0 0) 0x7fe6b4003570 con 0x7fe6cc0c8900 2023-10-06T01:40:42.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.563+0000 7fe6ca7fc700 1 -- 172.21.15.71:0/1174318387 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe6cc158da0 msgr2=0x7fe6cc06ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:42.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.563+0000 7fe6ca7fc700 1 --2- 172.21.15.71:0/1174318387 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe6cc158da0 0x7fe6cc06ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.563+0000 7fe6ca7fc700 1 -- 172.21.15.71:0/1174318387 >> v2:172.21.15.72:3300/0 conn(0x7fe6cc0c9480 msgr2=0x7fe6cc0b0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:42.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.563+0000 7fe6ca7fc700 1 --2- 172.21.15.71:0/1174318387 >> v2:172.21.15.72:3300/0 conn(0x7fe6cc0c9480 0x7fe6cc0b0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.563+0000 7fe6ca7fc700 1 -- 172.21.15.71:0/1174318387 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6cc0afd50 con 0x7fe6cc0c8900 2023-10-06T01:40:42.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.563+0000 7fe6ca7fc700 1 -- 172.21.15.71:0/1174318387 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1184243524 0 0) 0x7fe6bc001470 con 0x7fe6cc0c8900 2023-10-06T01:40:42.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.564+0000 7fe6ca7fc700 1 -- 172.21.15.71:0/1174318387 >> v1:172.21.15.71:6789/0 conn(0x7fe6cc0c8900 legacy=0x7fe6cc0c8d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:42.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.564+0000 7fe6ca7fc700 1 --2- 172.21.15.71:0/1174318387 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe6b4003ae0 0x7fe6b4003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.564+0000 7fe6ca7fc700 1 --2- 172.21.15.71:0/1174318387 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6b4004810 0x7fe6b4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.564+0000 7fe6ca7fc700 1 --2- 172.21.15.71:0/1174318387 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe6b40053c0 0x7fe6b400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.564+0000 7fe6ca7fc700 1 -- 172.21.15.71:0/1174318387 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6cc0af790 con 0x7fe6b40053c0 2023-10-06T01:40:42.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.564+0000 7fe6ca7fc700 1 -- 172.21.15.71:0/1174318387 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6cc0afa70 con 0x7fe6b4004810 2023-10-06T01:40:42.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.564+0000 7fe6ca7fc700 1 -- 172.21.15.71:0/1174318387 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b402e390 con 0x7fe6b4003ae0 2023-10-06T01:40:42.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.565+0000 7fe6caffd700 1 --2- 172.21.15.71:0/1174318387 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6b4004810 0x7fe6b4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:42.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.566+0000 7fe6caffd700 1 -- 172.21.15.71:0/1174318387 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe6b4003ae0 msgr2=0x7fe6b4003ef0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T01:40:42.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.566+0000 7fe6caffd700 1 --2- 172.21.15.71:0/1174318387 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe6b4003ae0 0x7fe6b4003ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.566+0000 7fe6caffd700 1 -- 172.21.15.71:0/1174318387 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe6b40053c0 msgr2=0x7fe6b400ba60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T01:40:42.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.566+0000 7fe6caffd700 1 --2- 172.21.15.71:0/1174318387 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe6b40053c0 0x7fe6b400ba60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.566+0000 7fe6caffd700 1 -- 172.21.15.71:0/1174318387 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6b4003570 con 0x7fe6b4004810 2023-10-06T01:40:42.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.566+0000 7fe6caffd700 1 --2- 172.21.15.71:0/1174318387 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6b4004810 0x7fe6b4004c80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc00c2d0 tx=0x7fe6bc001e00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e50d3b71fb47a4b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:42.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.566+0000 7fe6ca7fc700 1 -- 172.21.15.71:0/1174318387 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6bc00cc00 con 0x7fe6b4004810 2023-10-06T01:40:42.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.566+0000 7fe6ca7fc700 1 -- 172.21.15.71:0/1174318387 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6bc00cd60 con 0x7fe6b4004810 2023-10-06T01:40:42.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.566+0000 7fe6ca7fc700 1 -- 172.21.15.71:0/1174318387 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6bc005b50 con 0x7fe6b4004810 2023-10-06T01:40:42.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.567+0000 7f8cac490700 1 --2- 172.21.15.71:0/3744562108 >> [v2:172.21.15.71:6816/90670,v1:172.21.15.71:6817/90670] conn(0x7f8ca4146ba0 0x7f8ca4151770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.567+0000 7f8cac490700 1 -- 172.21.15.71:0/3744562108 --> [v2:172.21.15.71:6816/90670,v1:172.21.15.71:6817/90670] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8ca40af460 con 0x7f8ca4146ba0 2023-10-06T01:40:42.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.568+0000 7f8ca9a2b700 1 --2- 172.21.15.71:0/3744562108 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f8c88066fb0 0x7f8c88069460 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8c94009320 tx=0x7f8c9401b000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:42.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.568+0000 7f01f10b1700 1 --2- 172.21.15.71:0/2337569138 >> [v2:172.21.15.72:6800/90917,v1:172.21.15.72:6801/90917] conn(0x7f01d0070c00 0x7f01d0073030 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:42.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.568+0000 7f01f08b0700 1 --2- 172.21.15.71:0/2337569138 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f01d0066fb0 0x7f01d0069460 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f01ec0cbfd0 tx=0x7f01e0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:42.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.568+0000 7f06bf01a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f06b80c8900 0x7f06b81689a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.620 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.568+0000 7f06bf01a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06b80c9480 0x7f06b8124ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.620 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.568+0000 7f06bf01a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06b8158da0 0x7f06b816f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.620 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.568+0000 7f06bf01a700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06b80c4da0 con 0x7f06b8158da0 2023-10-06T01:40:42.620 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.568+0000 7f06bf01a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06b80c2df0 con 0x7f06b80c9480 2023-10-06T01:40:42.620 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.568+0000 7f06bf01a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06b80c30d0 con 0x7f06b80c8900 2023-10-06T01:40:42.620 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.568+0000 7f06bd5b7700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06b8158da0 0x7f06b816f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:42.620 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.568+0000 7f06bd5b7700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06b8158da0 0x7f06b816f320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47376/0 (socket says 172.21.15.71:47376) 2023-10-06T01:40:42.620 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.568+0000 7f06bd5b7700 1 -- 172.21.15.71:0/976094450 learned_addr learned my addr 172.21.15.71:0/976094450 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:42.620 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.568+0000 7f06bcdb6700 1 --2- 172.21.15.71:0/976094450 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f06b80c8900 0x7f06b81689a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:42.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.568+0000 7fcdd832d700 1 -- 172.21.15.71:0/825836127 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcdb8000fd0 con 0x7fcdd006e390 2023-10-06T01:40:42.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.568+0000 7f06bd5b7700 1 -- 172.21.15.71:0/976094450 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f06b80c8900 msgr2=0x7f06b81689a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:42.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.568+0000 7f06affff700 1 --2- 172.21.15.71:0/976094450 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06b80c9480 0x7f06b8124ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:42.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.568+0000 7f06bd5b7700 1 --2- 172.21.15.71:0/976094450 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f06b80c8900 0x7f06b81689a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.568+0000 7f06bd5b7700 1 -- 172.21.15.71:0/976094450 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06b80c9480 msgr2=0x7f06b8124ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:42.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.568+0000 7f06bd5b7700 1 --2- 172.21.15.71:0/976094450 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06b80c9480 0x7f06b8124ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.568+0000 7f01e8ff9700 1 -- 172.21.15.71:0/2337569138 <== osd.4 v2:172.21.15.72:6800/90917 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f01d0073700 con 0x7f01d0070c00 2023-10-06T01:40:42.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.568+0000 7f06bd5b7700 1 -- 172.21.15.71:0/976094450 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06b40094f0 con 0x7f06b8158da0 2023-10-06T01:40:42.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.569+0000 7f8caaa2d700 1 --2- 172.21.15.71:0/3744562108 >> [v2:172.21.15.71:6816/90670,v1:172.21.15.71:6817/90670] conn(0x7f8ca4146ba0 0x7f8ca4151770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:42.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.569+0000 7f8caaa2d700 1 --2- 172.21.15.71:0/3744562108 >> [v2:172.21.15.71:6816/90670,v1:172.21.15.71:6817/90670] conn(0x7f8ca4146ba0 0x7f8ca4151770 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:42.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.569+0000 7f06bd5b7700 1 --2- 172.21.15.71:0/976094450 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06b8158da0 0x7f06b816f320 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f06b0002360 tx=0x7f06b000c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:42.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.569+0000 7f06acff9700 1 -- 172.21.15.71:0/976094450 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b000a0d0 con 0x7f06b8158da0 2023-10-06T01:40:42.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.569+0000 7f06acff9700 1 -- 172.21.15.71:0/976094450 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06b000a230 con 0x7f06b8158da0 2023-10-06T01:40:42.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.569+0000 7f06acff9700 1 -- 172.21.15.71:0/976094450 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b0008680 con 0x7f06b8158da0 2023-10-06T01:40:42.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.569+0000 7f06bf01a700 1 -- 172.21.15.71:0/976094450 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06b816f860 con 0x7f06b8158da0 2023-10-06T01:40:42.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.568+0000 7fe6d1e68700 1 -- 172.21.15.71:0/1174318387 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6b4004810 msgr2=0x7fe6b4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:42.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.568+0000 7fe6d1e68700 1 --2- 172.21.15.71:0/1174318387 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6b4004810 0x7fe6b4004c80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc00c2d0 tx=0x7fe6bc001e00 comp rx=0 tx=0).stop 2023-10-06T01:40:42.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.569+0000 7fe6cbfff700 1 -- 172.21.15.71:0/1174318387 reap_dead start 2023-10-06T01:40:42.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.569+0000 7fe6d1e68700 1 -- 172.21.15.71:0/1174318387 shutdown_connections 2023-10-06T01:40:42.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.569+0000 7fe6d1e68700 1 -- 172.21.15.71:0/1174318387 >> 172.21.15.71:0/1174318387 conn(0x7fe6cc069110 msgr2=0x7fe6cc0cbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:42.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.569+0000 7fe6d1e68700 1 -- 172.21.15.71:0/1174318387 shutdown_connections 2023-10-06T01:40:42.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.569+0000 7fe6d1e68700 1 -- 172.21.15.71:0/1174318387 wait complete. 2023-10-06T01:40:42.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.571+0000 7f8c9a7fc700 1 -- 172.21.15.71:0/3744562108 <== osd.0 v2:172.21.15.71:6816/90670 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f8ca40af460 con 0x7f8ca4146ba0 2023-10-06T01:40:42.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.570+0000 7f06bf01a700 1 -- 172.21.15.71:0/976094450 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06b80c52d0 con 0x7f06b8158da0 2023-10-06T01:40:42.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.571+0000 7f06acff9700 1 -- 172.21.15.71:0/976094450 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f06b0003040 con 0x7f06b8158da0 2023-10-06T01:40:42.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.571+0000 7fcdc67fc700 1 -- 172.21.15.71:0/825836127 <== mon.1 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcdc8007520 con 0x7fcdd006e390 2023-10-06T01:40:42.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.571+0000 7fcdc67fc700 1 --2- 172.21.15.71:0/825836127 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fcdb4067080 0x7fcdb4069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.570+0000 7fe6d1e68700 1 Processor -- start 2023-10-06T01:40:42.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.571+0000 7fcdc67fc700 1 -- 172.21.15.71:0/825836127 <== mon.1 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fcdc8085860 con 0x7fcdd006e390 2023-10-06T01:40:42.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.571+0000 7f06acff9700 1 --2- 172.21.15.71:0/976094450 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f06a4067000 0x7f06a40694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.571+0000 7fcdc67fc700 1 --2- 172.21.15.71:0/825836127 >> [v2:172.21.15.72:6816/90941,v1:172.21.15.72:6817/90941] conn(0x7fcdb4070be0 0x7fcdb4073010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.571+0000 7fcdc67fc700 1 -- 172.21.15.71:0/825836127 --> [v2:172.21.15.72:6816/90941,v1:172.21.15.72:6817/90941] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcdb40736e0 con 0x7fcdb4070be0 2023-10-06T01:40:42.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.571+0000 7fcdc67fc700 1 -- 172.21.15.71:0/825836127 <== mon.1 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcdc8085b90 con 0x7fcdd006e390 2023-10-06T01:40:42.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.572+0000 7f06acff9700 1 -- 172.21.15.71:0/976094450 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f06b0084d10 con 0x7f06b8158da0 2023-10-06T01:40:42.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.572+0000 7f06bf01a700 1 --2- 172.21.15.71:0/976094450 >> [v2:172.21.15.71:6824/90679,v1:172.21.15.71:6825/90679] conn(0x7f06b8152920 0x7f06b8152cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.572+0000 7f06bf01a700 1 -- 172.21.15.71:0/976094450 --> [v2:172.21.15.71:6824/90679,v1:172.21.15.71:6825/90679] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f06b806fcb0 con 0x7f06b8152920 2023-10-06T01:40:42.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.572+0000 7f06bcdb6700 1 --2- 172.21.15.71:0/976094450 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f06a4067000 0x7f06a40694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:42.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.572+0000 7f06affff700 1 --2- 172.21.15.71:0/976094450 >> [v2:172.21.15.71:6824/90679,v1:172.21.15.71:6825/90679] conn(0x7f06b8152920 0x7f06b8152cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:42.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.573+0000 7f06bcdb6700 1 --2- 172.21.15.71:0/976094450 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f06a4067000 0x7f06a40694b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f06b40099b0 tx=0x7f06b4017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:42.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.573+0000 7f06affff700 1 --2- 172.21.15.71:0/976094450 >> [v2:172.21.15.71:6824/90679,v1:172.21.15.71:6825/90679] conn(0x7f06b8152920 0x7f06b8152cf0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:42.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.572+0000 7fcdd68ca700 1 --2- 172.21.15.71:0/825836127 >> [v2:172.21.15.72:6816/90941,v1:172.21.15.72:6817/90941] conn(0x7fcdb4070be0 0x7fcdb4073010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:42.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.572+0000 7fcdd58c8700 1 --2- 172.21.15.71:0/825836127 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fcdb4067080 0x7fcdb4069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:42.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.571+0000 7fe6d1e68700 1 -- start start 2023-10-06T01:40:42.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.572+0000 7fe6d1e68700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6b4004810 0x7fe6cc144950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.572+0000 7fe6d1e68700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe6cc0c5eb0 0x7fe6cc157350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.572+0000 7fe6d1e68700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe6cc0accd0 0x7fe6cc0ad150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.572+0000 7fe6d1e68700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6cc157890 con 0x7fe6cc0c5eb0 2023-10-06T01:40:42.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.572+0000 7fe6d1e68700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6cc156710 con 0x7fe6b4004810 2023-10-06T01:40:42.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.572+0000 7fe6d1e68700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6cc0ad690 con 0x7fe6cc0accd0 2023-10-06T01:40:42.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.572+0000 7fe6caffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe6cc0c5eb0 0x7fe6cc157350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:42.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.572+0000 7fe6caffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe6cc0c5eb0 0x7fe6cc157350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47392/0 (socket says 172.21.15.71:47392) 2023-10-06T01:40:42.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.572+0000 7fe6caffd700 1 -- 172.21.15.71:0/3414954720 learned_addr learned my addr 172.21.15.71:0/3414954720 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:42.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.572+0000 7fe6cb7fe700 1 --2- 172.21.15.71:0/3414954720 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6b4004810 0x7fe6cc144950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:42.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.572+0000 7fe6cbfff700 1 --2- 172.21.15.71:0/3414954720 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe6cc0accd0 0x7fe6cc0ad150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:42.630 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.572+0000 7fe6caffd700 1 -- 172.21.15.71:0/3414954720 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe6cc0accd0 msgr2=0x7fe6cc0ad150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:42.630 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.572+0000 7fe6caffd700 1 --2- 172.21.15.71:0/3414954720 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe6cc0accd0 0x7fe6cc0ad150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.630 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.572+0000 7fe6caffd700 1 -- 172.21.15.71:0/3414954720 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6b4004810 msgr2=0x7fe6cc144950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:42.630 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.572+0000 7fe6caffd700 1 --2- 172.21.15.71:0/3414954720 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6b4004810 0x7fe6cc144950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.630 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.572+0000 7fe6caffd700 1 -- 172.21.15.71:0/3414954720 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6cc155820 con 0x7fe6cc0c5eb0 2023-10-06T01:40:42.630 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.572+0000 7fe6cb7fe700 1 --2- 172.21.15.71:0/3414954720 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6b4004810 0x7fe6cc144950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:40:42.630 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.573+0000 7fe6caffd700 1 --2- 172.21.15.71:0/3414954720 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe6cc0c5eb0 0x7fe6cc157350 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc00c8c0 tx=0x7fe6bc015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:42.630 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.573+0000 7fcdd68ca700 1 --2- 172.21.15.71:0/825836127 >> [v2:172.21.15.72:6816/90941,v1:172.21.15.72:6817/90941] conn(0x7fcdb4070be0 0x7fcdb4073010 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:42.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.573+0000 7fcdd58c8700 1 --2- 172.21.15.71:0/825836127 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fcdb4067080 0x7fcdb4069530 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc0098e0 tx=0x7fcdcc017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:42.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.574+0000 7fe5fcff9700 1 -- 172.21.15.71:0/1791831322 <== osd.1 v2:172.21.15.71:6808/90669 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fe5ec073700 con 0x7fe5ec070c00 2023-10-06T01:40:42.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.574+0000 7f06acff9700 1 -- 172.21.15.71:0/976094450 <== osd.2 v2:172.21.15.71:6824/90679 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f06b806fcb0 con 0x7f06b8152920 2023-10-06T01:40:42.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.574+0000 7fcdc67fc700 1 -- 172.21.15.71:0/825836127 <== osd.5 v2:172.21.15.72:6816/90941 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fcdb40736e0 con 0x7fcdb4070be0 2023-10-06T01:40:42.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.589+0000 7fe607240700 1 -- 172.21.15.71:0/1791831322 --> [v2:172.21.15.71:6808/90669,v1:172.21.15.71:6809/90669] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe5e0002d30 con 0x7fe5ec070c00 2023-10-06T01:40:42.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.589+0000 7fe5fcff9700 1 -- 172.21.15.71:0/1791831322 <== osd.1 v2:172.21.15.71:6808/90669 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe5e0002d30 con 0x7fe5ec070c00 2023-10-06T01:40:42.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.590+0000 7fe607240700 1 -- 172.21.15.71:0/1791831322 >> [v2:172.21.15.71:6808/90669,v1:172.21.15.71:6809/90669] conn(0x7fe5ec070c00 msgr2=0x7fe5ec073030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:42.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.590+0000 7fe607240700 1 --2- 172.21.15.71:0/1791831322 >> [v2:172.21.15.71:6808/90669,v1:172.21.15.71:6809/90669] conn(0x7fe5ec070c00 0x7fe5ec073030 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.590+0000 7fe607240700 1 -- 172.21.15.71:0/1791831322 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fe5ec066f30 msgr2=0x7fe5ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:42.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.590+0000 7fe607240700 1 --2- 172.21.15.71:0/1791831322 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fe5ec066f30 0x7fe5ec0693e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe5f0007fd0 tx=0x7fe5f0009040 comp rx=0 tx=0).stop 2023-10-06T01:40:42.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.590+0000 7fe607240700 1 -- 172.21.15.71:0/1791831322 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe600157d40 msgr2=0x7fe6001714d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:42.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.590+0000 7fe607240700 1 --2- 172.21.15.71:0/1791831322 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe600157d40 0x7fe6001714d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe6000cce70 tx=0x7fe5f8019000 comp rx=0 tx=0).stop 2023-10-06T01:40:42.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.590+0000 7fe6057dd700 1 -- 172.21.15.71:0/1791831322 reap_dead start 2023-10-06T01:40:42.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.592+0000 7fe607240700 1 -- 172.21.15.71:0/1791831322 shutdown_connections 2023-10-06T01:40:42.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.593+0000 7fe607240700 1 -- 172.21.15.71:0/1791831322 >> 172.21.15.71:0/1791831322 conn(0x7fe60006a260 msgr2=0x7fe6000ad1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:42.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.592+0000 7f5ce7cd6700 1 -- 172.21.15.71:0/2612114386 --> [v2:172.21.15.71:6800/90668,v1:172.21.15.71:6801/90668] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5ce006e140 con 0x7f5cc4070cd0 2023-10-06T01:40:42.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.593+0000 7fe6b37fe700 1 -- 172.21.15.71:0/3414954720 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6bc0072e0 con 0x7fe6cc0c5eb0 2023-10-06T01:40:42.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.593+0000 7feefba0d700 1 -- 172.21.15.71:0/3393701574 --> [v2:172.21.15.72:6820/90948,v1:172.21.15.72:6822/90948] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7feef4068420 con 0x7feed8070cd0 2023-10-06T01:40:42.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.593+0000 7fe607240700 1 -- 172.21.15.71:0/1791831322 shutdown_connections 2023-10-06T01:40:42.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.593+0000 7fe6d1e68700 1 -- 172.21.15.71:0/3414954720 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6cc155b00 con 0x7fe6cc0c5eb0 2023-10-06T01:40:42.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.593+0000 7fe6d1e68700 1 -- 172.21.15.71:0/3414954720 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6cc1560c0 con 0x7fe6cc0c5eb0 2023-10-06T01:40:42.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.593+0000 7fe6b37fe700 1 -- 172.21.15.71:0/3414954720 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6bc007440 con 0x7fe6cc0c5eb0 2023-10-06T01:40:42.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.593+0000 7fe6b37fe700 1 -- 172.21.15.71:0/3414954720 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6bc007800 con 0x7fe6cc0c5eb0 2023-10-06T01:40:42.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.593+0000 7fe607240700 1 -- 172.21.15.71:0/1791831322 wait complete. 2023-10-06T01:40:42.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.594+0000 7f5cd5ffb700 1 -- 172.21.15.71:0/2612114386 <== osd.3 v2:172.21.15.71:6800/90668 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5ce006e140 con 0x7f5cc4070cd0 2023-10-06T01:40:42.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.594+0000 7feee97fa700 1 -- 172.21.15.71:0/3393701574 <== osd.7 v2:172.21.15.72:6820/90948 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7feef4068420 con 0x7feed8070cd0 2023-10-06T01:40:42.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.594+0000 7f5ce7cd6700 1 -- 172.21.15.71:0/2612114386 >> [v2:172.21.15.71:6800/90668,v1:172.21.15.71:6801/90668] conn(0x7f5cc4070cd0 msgr2=0x7f5cc4073100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:42.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.594+0000 7f5ce7cd6700 1 --2- 172.21.15.71:0/2612114386 >> [v2:172.21.15.71:6800/90668,v1:172.21.15.71:6801/90668] conn(0x7f5cc4070cd0 0x7f5cc4073100 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.594+0000 7f5ce7cd6700 1 -- 172.21.15.71:0/2612114386 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f5cc4067000 msgr2=0x7f5cc40694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:42.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.594+0000 7f5ce7cd6700 1 --2- 172.21.15.71:0/2612114386 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f5cc4067000 0x7f5cc40694b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5ce00c91c0 tx=0x7f5cd0018000 comp rx=0 tx=0).stop 2023-10-06T01:40:42.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.594+0000 7f5ce7cd6700 1 -- 172.21.15.71:0/2612114386 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ce00688b0 msgr2=0x7f5ce0169e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:42.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.594+0000 7f5ce7cd6700 1 --2- 172.21.15.71:0/2612114386 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ce00688b0 0x7f5ce0169e50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc00b630 tx=0x7f5cdc0091a0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.594+0000 7f5ce6273700 1 -- 172.21.15.71:0/2612114386 reap_dead start 2023-10-06T01:40:42.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.594+0000 7f5ce7cd6700 1 -- 172.21.15.71:0/2612114386 shutdown_connections 2023-10-06T01:40:42.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.594+0000 7f5ce7cd6700 1 -- 172.21.15.71:0/2612114386 >> 172.21.15.71:0/2612114386 conn(0x7f5ce00c9cc0 msgr2=0x7f5ce00cb280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:42.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.597+0000 7feefba0d700 1 -- 172.21.15.71:0/3393701574 >> [v2:172.21.15.72:6820/90948,v1:172.21.15.72:6822/90948] conn(0x7feed8070cd0 msgr2=0x7feed8073100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:42.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.597+0000 7feefba0d700 1 --2- 172.21.15.71:0/3393701574 >> [v2:172.21.15.72:6820/90948,v1:172.21.15.72:6822/90948] conn(0x7feed8070cd0 0x7feed8073100 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.598+0000 7f01f2b14700 1 -- 172.21.15.71:0/2337569138 --> [v2:172.21.15.72:6800/90917,v1:172.21.15.72:6801/90917] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f01cc002d30 con 0x7f01d0070c00 2023-10-06T01:40:42.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.598+0000 7fe6d1e68700 1 -- 172.21.15.71:0/3414954720 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe6ac000fd0 con 0x7fe6cc0c5eb0 2023-10-06T01:40:42.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.599+0000 7feefba0d700 1 -- 172.21.15.71:0/3393701574 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7feed8067000 msgr2=0x7feed80694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:42.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.599+0000 7feefba0d700 1 --2- 172.21.15.71:0/3393701574 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7feed8067000 0x7feed80694b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7feef40ccf90 tx=0x7feef0016000 comp rx=0 tx=0).stop 2023-10-06T01:40:42.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.599+0000 7feefba0d700 1 -- 172.21.15.71:0/3393701574 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feef40c6a40 msgr2=0x7feef40c5f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:42.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.599+0000 7feefba0d700 1 --2- 172.21.15.71:0/3393701574 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feef40c6a40 0x7feef40c5f00 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7feeec00bbb0 tx=0x7feeec009810 comp rx=0 tx=0).stop 2023-10-06T01:40:42.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.599+0000 7feef9faa700 1 -- 172.21.15.71:0/3393701574 reap_dead start 2023-10-06T01:40:42.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.599+0000 7feefba0d700 1 -- 172.21.15.71:0/3393701574 shutdown_connections 2023-10-06T01:40:42.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.599+0000 7feefba0d700 1 -- 172.21.15.71:0/3393701574 >> 172.21.15.71:0/3393701574 conn(0x7feef406a260 msgr2=0x7feef406d990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:42.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.599+0000 7feefba0d700 1 -- 172.21.15.71:0/3393701574 shutdown_connections 2023-10-06T01:40:42.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.599+0000 7feefba0d700 1 -- 172.21.15.71:0/3393701574 wait complete. 2023-10-06T01:40:42.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.600+0000 7f5ce7cd6700 1 -- 172.21.15.71:0/2612114386 shutdown_connections 2023-10-06T01:40:42.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.600+0000 7f5ce7cd6700 1 -- 172.21.15.71:0/2612114386 wait complete. 2023-10-06T01:40:42.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.601+0000 7f8cac490700 1 -- 172.21.15.71:0/3744562108 --> [v2:172.21.15.71:6816/90670,v1:172.21.15.71:6817/90670] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8ca4068420 con 0x7f8ca4146ba0 2023-10-06T01:40:42.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.604+0000 7f06bf01a700 1 -- 172.21.15.71:0/976094450 --> [v2:172.21.15.71:6824/90679,v1:172.21.15.71:6825/90679] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f06b80af460 con 0x7f06b8152920 2023-10-06T01:40:42.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.604+0000 7fcdd832d700 1 -- 172.21.15.71:0/825836127 --> [v2:172.21.15.72:6816/90941,v1:172.21.15.72:6817/90941] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fcdb8002d30 con 0x7fcdb4070be0 2023-10-06T01:40:42.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.604+0000 7f06acff9700 1 -- 172.21.15.71:0/976094450 <== osd.2 v2:172.21.15.71:6824/90679 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f06b80af460 con 0x7f06b8152920 2023-10-06T01:40:42.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.604+0000 7fcdc67fc700 1 -- 172.21.15.71:0/825836127 <== osd.5 v2:172.21.15.72:6816/90941 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fcdb8002d30 con 0x7fcdb4070be0 2023-10-06T01:40:42.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.605+0000 7f8c9a7fc700 1 -- 172.21.15.71:0/3744562108 <== osd.0 v2:172.21.15.71:6816/90670 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8ca4068420 con 0x7f8ca4146ba0 2023-10-06T01:40:42.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.605+0000 7f06bf01a700 1 -- 172.21.15.71:0/976094450 >> [v2:172.21.15.71:6824/90679,v1:172.21.15.71:6825/90679] conn(0x7f06b8152920 msgr2=0x7f06b8152cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:42.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.605+0000 7f06bf01a700 1 --2- 172.21.15.71:0/976094450 >> [v2:172.21.15.71:6824/90679,v1:172.21.15.71:6825/90679] conn(0x7f06b8152920 0x7f06b8152cf0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.605+0000 7fe6b37fe700 1 -- 172.21.15.71:0/3414954720 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe6bc019030 con 0x7fe6cc0c5eb0 2023-10-06T01:40:42.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.605+0000 7f06bf01a700 1 -- 172.21.15.71:0/976094450 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f06a4067000 msgr2=0x7f06a40694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:42.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.605+0000 7f06bf01a700 1 --2- 172.21.15.71:0/976094450 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f06a4067000 0x7f06a40694b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f06b40099b0 tx=0x7f06b4017000 comp rx=0 tx=0).stop 2023-10-06T01:40:42.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.605+0000 7f06bf01a700 1 -- 172.21.15.71:0/976094450 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06b8158da0 msgr2=0x7f06b816f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:42.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.605+0000 7f06bf01a700 1 --2- 172.21.15.71:0/976094450 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06b8158da0 0x7f06b816f320 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f06b0002360 tx=0x7f06b000c040 comp rx=0 tx=0).stop 2023-10-06T01:40:42.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.605+0000 7f06bd5b7700 1 -- 172.21.15.71:0/976094450 reap_dead start 2023-10-06T01:40:42.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.605+0000 7f06bf01a700 1 -- 172.21.15.71:0/976094450 shutdown_connections 2023-10-06T01:40:42.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.605+0000 7f06bf01a700 1 -- 172.21.15.71:0/976094450 >> 172.21.15.71:0/976094450 conn(0x7f06b8069110 msgr2=0x7f06b80cc280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:42.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.605+0000 7f8cac490700 1 -- 172.21.15.71:0/3744562108 >> [v2:172.21.15.71:6816/90670,v1:172.21.15.71:6817/90670] conn(0x7f8ca4146ba0 msgr2=0x7f8ca4151770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:42.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.605+0000 7f8cac490700 1 --2- 172.21.15.71:0/3744562108 >> [v2:172.21.15.71:6816/90670,v1:172.21.15.71:6817/90670] conn(0x7f8ca4146ba0 0x7f8ca4151770 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.605+0000 7fcdd832d700 1 -- 172.21.15.71:0/825836127 >> [v2:172.21.15.72:6816/90941,v1:172.21.15.72:6817/90941] conn(0x7fcdb4070be0 msgr2=0x7fcdb4073010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:42.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.605+0000 7fcdd832d700 1 --2- 172.21.15.71:0/825836127 >> [v2:172.21.15.72:6816/90941,v1:172.21.15.72:6817/90941] conn(0x7fcdb4070be0 0x7fcdb4073010 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.605+0000 7f8cac490700 1 -- 172.21.15.71:0/3744562108 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f8c88066fb0 msgr2=0x7f8c88069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:42.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.605+0000 7f8cac490700 1 --2- 172.21.15.71:0/3744562108 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f8c88066fb0 0x7f8c88069460 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8c94009320 tx=0x7f8c9401b000 comp rx=0 tx=0).stop 2023-10-06T01:40:42.646 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.605+0000 7f8cac490700 1 -- 172.21.15.71:0/3744562108 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ca4158da0 msgr2=0x7f8ca414d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:42.646 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.605+0000 7f8cac490700 1 --2- 172.21.15.71:0/3744562108 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8ca4158da0 0x7f8ca414d610 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8ca000c490 tx=0x7f8ca000c7a0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.646 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.605+0000 7f06bf01a700 1 -- 172.21.15.71:0/976094450 shutdown_connections 2023-10-06T01:40:42.646 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.605+0000 7f8caaa2d700 1 -- 172.21.15.71:0/3744562108 reap_dead start 2023-10-06T01:40:42.646 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.605+0000 7f06bf01a700 1 -- 172.21.15.71:0/976094450 wait complete. 2023-10-06T01:40:42.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.605+0000 7fe6b37fe700 1 --2- 172.21.15.71:0/3414954720 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fe6b8067070 0x7fe6b8069520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.605+0000 7fe6b37fe700 1 -- 172.21.15.71:0/3414954720 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fe6bc085e60 con 0x7fe6cc0c5eb0 2023-10-06T01:40:42.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.605+0000 7fe6cb7fe700 1 --2- 172.21.15.71:0/3414954720 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fe6b8067070 0x7fe6b8069520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:42.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.605+0000 7fe6b37fe700 1 --2- 172.21.15.71:0/3414954720 >> [v2:172.21.15.72:6808/90918,v1:172.21.15.72:6809/90918] conn(0x7fe6b8070d40 0x7fe6b8073170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.605+0000 7fe6b37fe700 1 -- 172.21.15.71:0/3414954720 --> [v2:172.21.15.72:6808/90918,v1:172.21.15.72:6809/90918] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe6b8073840 con 0x7fe6b8070d40 2023-10-06T01:40:42.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.606+0000 7fe6b37fe700 1 -- 172.21.15.71:0/3414954720 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe6bc088400 con 0x7fe6cc0c5eb0 2023-10-06T01:40:42.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.606+0000 7fe6cbfff700 1 --2- 172.21.15.71:0/3414954720 >> [v2:172.21.15.72:6808/90918,v1:172.21.15.72:6809/90918] conn(0x7fe6b8070d40 0x7fe6b8073170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:42.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.606+0000 7fe6cb7fe700 1 --2- 172.21.15.71:0/3414954720 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fe6b8067070 0x7fe6b8069520 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe6cc06d880 tx=0x7fe6c00090f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:42.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.606+0000 7fe6cbfff700 1 --2- 172.21.15.71:0/3414954720 >> [v2:172.21.15.72:6808/90918,v1:172.21.15.72:6809/90918] conn(0x7fe6b8070d40 0x7fe6b8073170 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:42.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.607+0000 7fe6b37fe700 1 -- 172.21.15.71:0/3414954720 <== osd.6 v2:172.21.15.72:6808/90918 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fe6b8073840 con 0x7fe6b8070d40 2023-10-06T01:40:42.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.603+0000 7f01e8ff9700 1 -- 172.21.15.71:0/2337569138 <== osd.4 v2:172.21.15.72:6800/90917 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f01cc002d30 con 0x7f01d0070c00 2023-10-06T01:40:42.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.603+0000 7f01f2b14700 1 -- 172.21.15.71:0/2337569138 >> [v2:172.21.15.72:6800/90917,v1:172.21.15.72:6801/90917] conn(0x7f01d0070c00 msgr2=0x7f01d0073030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:42.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.603+0000 7f01f2b14700 1 --2- 172.21.15.71:0/2337569138 >> [v2:172.21.15.72:6800/90917,v1:172.21.15.72:6801/90917] conn(0x7f01d0070c00 0x7f01d0073030 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.603+0000 7f01f2b14700 1 -- 172.21.15.71:0/2337569138 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f01d0066fb0 msgr2=0x7f01d0069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:42.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.603+0000 7f01f2b14700 1 --2- 172.21.15.71:0/2337569138 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f01d0066fb0 0x7f01d0069460 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f01ec0cbfd0 tx=0x7f01e0008040 comp rx=0 tx=0).stop 2023-10-06T01:40:42.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.603+0000 7f01f2b14700 1 -- 172.21.15.71:0/2337569138 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f01ec0aa1a0 msgr2=0x7f01ec0ca7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:42.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.603+0000 7f01f2b14700 1 --2- 172.21.15.71:0/2337569138 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f01ec0aa1a0 0x7f01ec0ca7b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f01d800c7c0 tx=0x7f01d8007e00 comp rx=0 tx=0).stop 2023-10-06T01:40:42.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.603+0000 7f01f10b1700 1 -- 172.21.15.71:0/2337569138 reap_dead start 2023-10-06T01:40:42.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.603+0000 7f01f2b14700 1 -- 172.21.15.71:0/2337569138 shutdown_connections 2023-10-06T01:40:42.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.603+0000 7f01f2b14700 1 -- 172.21.15.71:0/2337569138 >> 172.21.15.71:0/2337569138 conn(0x7f01ec069110 msgr2=0x7f01ec154f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:42.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.603+0000 7f01f2b14700 1 -- 172.21.15.71:0/2337569138 shutdown_connections 2023-10-06T01:40:42.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.603+0000 7f01f2b14700 1 -- 172.21.15.71:0/2337569138 wait complete. 2023-10-06T01:40:42.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.610+0000 7fcdd832d700 1 -- 172.21.15.71:0/825836127 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fcdb4067080 msgr2=0x7fcdb4069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:42.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.610+0000 7fcdd832d700 1 --2- 172.21.15.71:0/825836127 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fcdb4067080 0x7fcdb4069530 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc0098e0 tx=0x7fcdcc017000 comp rx=0 tx=0).stop 2023-10-06T01:40:42.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.610+0000 7fcdd832d700 1 -- 172.21.15.71:0/825836127 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcdd006e390 msgr2=0x7fcdd00c7350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:42.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.610+0000 7fcdd832d700 1 --2- 172.21.15.71:0/825836127 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcdd006e390 0x7fcdd00c7350 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fcdc800cd30 tx=0x7fcdc8001b10 comp rx=0 tx=0).stop 2023-10-06T01:40:42.651 INFO:teuthology.orchestra.run.smithi071.stdout:55834574858 2023-10-06T01:40:42.651 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-06T01:40:42.653 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.611+0000 7f8cac490700 1 -- 172.21.15.71:0/3744562108 shutdown_connections 2023-10-06T01:40:42.653 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.611+0000 7f8cac490700 1 -- 172.21.15.71:0/3744562108 >> 172.21.15.71:0/3744562108 conn(0x7f8ca4069110 msgr2=0x7f8ca40b0550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:42.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.611+0000 7fcdd68ca700 1 -- 172.21.15.71:0/825836127 reap_dead start 2023-10-06T01:40:42.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.612+0000 7fcdd832d700 1 -- 172.21.15.71:0/825836127 shutdown_connections 2023-10-06T01:40:42.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.612+0000 7fcdd832d700 1 -- 172.21.15.71:0/825836127 >> 172.21.15.71:0/825836127 conn(0x7fcdd0069110 msgr2=0x7fcdd006e780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:42.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.616+0000 7fcdd832d700 1 -- 172.21.15.71:0/825836127 shutdown_connections 2023-10-06T01:40:42.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.616+0000 7fcdd832d700 1 -- 172.21.15.71:0/825836127 wait complete. 2023-10-06T01:40:42.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.619+0000 7f8cac490700 1 -- 172.21.15.71:0/3744562108 shutdown_connections 2023-10-06T01:40:42.655 INFO:teuthology.orchestra.run.smithi071.stdout:55834574858 2023-10-06T01:40:42.656 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-06T01:40:42.656 INFO:teuthology.orchestra.run.smithi071.stdout:55834574858 2023-10-06T01:40:42.656 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-06T01:40:42.657 INFO:teuthology.orchestra.run.smithi071.stdout:55834574858 2023-10-06T01:40:42.657 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-06T01:40:42.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.622+0000 7f8cac490700 1 -- 172.21.15.71:0/3744562108 wait complete. 2023-10-06T01:40:42.658 INFO:teuthology.orchestra.run.smithi071.stdout:55834574858 2023-10-06T01:40:42.659 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-06T01:40:42.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.628+0000 7fe6d1e68700 1 -- 172.21.15.71:0/3414954720 --> [v2:172.21.15.72:6808/90918,v1:172.21.15.72:6809/90918] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe6ac002d30 con 0x7fe6b8070d40 2023-10-06T01:40:42.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.629+0000 7fe6b37fe700 1 -- 172.21.15.71:0/3414954720 <== osd.6 v2:172.21.15.72:6808/90918 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe6ac002d30 con 0x7fe6b8070d40 2023-10-06T01:40:42.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.629+0000 7fe6d1e68700 1 -- 172.21.15.71:0/3414954720 >> [v2:172.21.15.72:6808/90918,v1:172.21.15.72:6809/90918] conn(0x7fe6b8070d40 msgr2=0x7fe6b8073170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:42.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.629+0000 7fe6d1e68700 1 --2- 172.21.15.71:0/3414954720 >> [v2:172.21.15.72:6808/90918,v1:172.21.15.72:6809/90918] conn(0x7fe6b8070d40 0x7fe6b8073170 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.629+0000 7fe6d1e68700 1 -- 172.21.15.71:0/3414954720 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fe6b8067070 msgr2=0x7fe6b8069520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:42.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.629+0000 7fe6d1e68700 1 --2- 172.21.15.71:0/3414954720 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fe6b8067070 0x7fe6b8069520 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe6cc06d880 tx=0x7fe6c00090f0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.630+0000 7fe6d1e68700 1 -- 172.21.15.71:0/3414954720 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe6cc0c5eb0 msgr2=0x7fe6cc157350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:42.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.630+0000 7fe6d1e68700 1 --2- 172.21.15.71:0/3414954720 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe6cc0c5eb0 0x7fe6cc157350 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc00c8c0 tx=0x7fe6bc015000 comp rx=0 tx=0).stop 2023-10-06T01:40:42.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.630+0000 7fe6cbfff700 1 -- 172.21.15.71:0/3414954720 reap_dead start 2023-10-06T01:40:42.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.630+0000 7fe6d1e68700 1 -- 172.21.15.71:0/3414954720 shutdown_connections 2023-10-06T01:40:42.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.630+0000 7fe6d1e68700 1 -- 172.21.15.71:0/3414954720 >> 172.21.15.71:0/3414954720 conn(0x7fe6cc069110 msgr2=0x7fe6cc0b0550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:42.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.630+0000 7fe6d1e68700 1 -- 172.21.15.71:0/3414954720 shutdown_connections 2023-10-06T01:40:42.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.630+0000 7fe6d1e68700 1 -- 172.21.15.71:0/3414954720 wait complete. 2023-10-06T01:40:42.662 INFO:teuthology.orchestra.run.smithi071.stdout:55834574858 2023-10-06T01:40:42.662 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-06T01:40:42.663 INFO:teuthology.orchestra.run.smithi071.stdout:55834574858 2023-10-06T01:40:42.663 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-06T01:40:42.664 INFO:teuthology.orchestra.run.smithi071.stdout:55834574858 2023-10-06T01:40:42.664 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-06T01:40:42.895 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.893+0000 7fbb98b67700 1 Processor -- start 2023-10-06T01:40:42.895 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.893+0000 7fbb98b67700 1 -- start start 2023-10-06T01:40:42.896 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.894+0000 7fbb98b67700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbb941574b0 0x7fbb940b0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.897 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.895+0000 7fbb98b67700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb940c3b40 con 0x7fbb940c46e0 2023-10-06T01:40:42.897 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.895+0000 7fbb98b67700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb940c2f30 con 0x7fbb940b13f0 2023-10-06T01:40:42.897 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.895+0000 7fbb98b67700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb940c3210 con 0x7fbb941574b0 2023-10-06T01:40:42.897 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.895+0000 7fbb9259c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbb941574b0 0x7fbb940b0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:42.897 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.895+0000 7fbb91d9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fbb940b13f0 0x7fbb940c3fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.71:40660/0 (socket says 172.21.15.71:40660) 2023-10-06T01:40:42.897 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.895+0000 7fbb91d9b700 1 -- 172.21.15.71:0/3852195392 learned_addr learned my addr 172.21.15.71:0/3852195392 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:40:42.897 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.895+0000 7fbb9159a700 1 -- 172.21.15.71:0/3852195392 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4290261123 0 0) 0x7fbb940c2f30 con 0x7fbb940b13f0 2023-10-06T01:40:42.897 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.895+0000 7fbb9159a700 1 -- 172.21.15.71:0/3852195392 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb7c003570 con 0x7fbb940b13f0 2023-10-06T01:40:42.898 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.895+0000 7fbb9259c700 1 -- 172.21.15.71:0/3852195392 >> v1:172.21.15.72:6789/0 conn(0x7fbb940b13f0 legacy=0x7fbb940c3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:42.898 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.895+0000 7fbb9259c700 1 -- 172.21.15.71:0/3852195392 >> v1:172.21.15.71:6789/0 conn(0x7fbb940c46e0 legacy=0x7fbb940cbcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:42.898 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.895+0000 7fbb9259c700 1 -- 172.21.15.71:0/3852195392 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb940c34f0 con 0x7fbb941574b0 2023-10-06T01:40:42.898 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.895+0000 7fbb9259c700 1 --2- 172.21.15.71:0/3852195392 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb941574b0 0x7fbb940b0eb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbb880098d0 tx=0x7fbb88009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=588b0f1f40f0df07 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:42.898 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.896+0000 7fbb9159a700 1 -- 172.21.15.71:0/3852195392 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb88011630 con 0x7fbb941574b0 2023-10-06T01:40:42.898 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.896+0000 7fbb9159a700 1 -- 172.21.15.71:0/3852195392 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb88011790 con 0x7fbb941574b0 2023-10-06T01:40:42.899 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.896+0000 7fbb9159a700 1 -- 172.21.15.71:0/3852195392 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb88011b30 con 0x7fbb941574b0 2023-10-06T01:40:42.899 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.897+0000 7fbb98b67700 1 -- 172.21.15.71:0/3852195392 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb941574b0 msgr2=0x7fbb940b0eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:42.899 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.897+0000 7fbb98b67700 1 --2- 172.21.15.71:0/3852195392 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb941574b0 0x7fbb940b0eb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbb880098d0 tx=0x7fbb88009120 comp rx=0 tx=0).stop 2023-10-06T01:40:42.899 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.897+0000 7fbb98b67700 1 -- 172.21.15.71:0/3852195392 shutdown_connections 2023-10-06T01:40:42.899 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.897+0000 7fbb98b67700 1 --2- 172.21.15.71:0/3852195392 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb941574b0 0x7fbb940b0eb0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.899 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.897+0000 7fbb98b67700 1 -- 172.21.15.71:0/3852195392 >> 172.21.15.71:0/3852195392 conn(0x7fbb94067910 msgr2=0x7fbb940ce0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:42.899 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.897+0000 7f7276e32700 1 Processor -- start 2023-10-06T01:40:42.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.898+0000 7f7276e32700 1 -- start start 2023-10-06T01:40:42.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.898+0000 7fbb98b67700 1 -- 172.21.15.71:0/3852195392 shutdown_connections 2023-10-06T01:40:42.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.898+0000 7f7276e32700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f727006b7e0 0x7f72700cac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.898+0000 7f7276e32700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f727006d1c0 0x7f72701600e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.901 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.898+0000 7f7276e32700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72700c90d0 con 0x7f727006bbb0 2023-10-06T01:40:42.901 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.898+0000 7f7276e32700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72700c7c60 con 0x7f727006b7e0 2023-10-06T01:40:42.901 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.898+0000 7f7276e32700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7270157600 con 0x7f727006d1c0 2023-10-06T01:40:42.901 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.899+0000 7f7d1264b700 1 Processor -- start 2023-10-06T01:40:42.901 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.899+0000 7f2f132ef700 1 Processor -- start 2023-10-06T01:40:42.902 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.899+0000 7f72753cf700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f727006d1c0 0x7f72701600e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:42.902 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.899+0000 7f726ffff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f727006bbb0 0x7f727006cab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.71:40664/0 (socket says 172.21.15.71:40664) 2023-10-06T01:40:42.902 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.899+0000 7f726ffff700 1 -- 172.21.15.71:0/3430702276 learned_addr learned my addr 172.21.15.71:0/3430702276 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:40:42.902 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.899+0000 7f726f7fe700 1 -- 172.21.15.71:0/3430702276 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1121902934 0 0) 0x7f72700c90d0 con 0x7f727006bbb0 2023-10-06T01:40:42.902 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.899+0000 7f726f7fe700 1 -- 172.21.15.71:0/3430702276 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7260003570 con 0x7f727006bbb0 2023-10-06T01:40:42.902 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.899+0000 7f7274bce700 1 --2- 172.21.15.71:0/3430702276 >> v2:172.21.15.72:3300/0 conn(0x7f727006b7e0 0x7f72700cac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:42.903 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.899+0000 7fe984768700 1 Processor -- start 2023-10-06T01:40:42.903 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.899+0000 7fe984768700 1 -- start start 2023-10-06T01:40:42.903 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.898+0000 7fbb98b67700 1 -- 172.21.15.71:0/3852195392 wait complete. 2023-10-06T01:40:42.903 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.899+0000 7fbb98b67700 1 Processor -- start 2023-10-06T01:40:42.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.899+0000 7fbb98b67700 1 -- start start 2023-10-06T01:40:42.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.899+0000 7f72753cf700 1 -- 172.21.15.71:0/3430702276 >> v2:172.21.15.72:3300/0 conn(0x7f727006b7e0 msgr2=0x7f72700cac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:42.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.899+0000 7f72753cf700 1 --2- 172.21.15.71:0/3430702276 >> v2:172.21.15.72:3300/0 conn(0x7f727006b7e0 0x7f72700cac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.899+0000 7f72753cf700 1 -- 172.21.15.71:0/3430702276 >> v1:172.21.15.72:6789/0 conn(0x7f727006bbb0 legacy=0x7f727006cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:42.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.899+0000 7f72753cf700 1 -- 172.21.15.71:0/3430702276 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72700c7980 con 0x7f727006d1c0 2023-10-06T01:40:42.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.900+0000 7f72753cf700 1 --2- 172.21.15.71:0/3430702276 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f727006d1c0 0x7f72701600e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7268009e60 tx=0x7f7268009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7152973e0577295 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:42.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.899+0000 7f7d1264b700 1 -- start start 2023-10-06T01:40:42.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.900+0000 7f7d1264b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f7d0c158da0 0x7f7d0c06ec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.900+0000 7f7d1264b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7d0c0c8900 0x7f7d0c0c8d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.900+0000 7f7d1264b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7d0c0c92b0 0x7f7d0c159590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.900+0000 7f7d1264b700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d0c0b00c0 con 0x7f7d0c158da0 2023-10-06T01:40:42.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.900+0000 7f7d1264b700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d0c0c9730 con 0x7f7d0c0c92b0 2023-10-06T01:40:42.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.900+0000 7f7d1264b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0c0af790 con 0x7f7d0c0c8900 2023-10-06T01:40:42.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.900+0000 7f7d0b7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7d0c0c8900 0x7f7d0c0c8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:42.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.900+0000 7f7d0b7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7d0c0c8900 0x7f7d0c0c8d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.71:48810/0 (socket says 172.21.15.71:48810) 2023-10-06T01:40:42.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.900+0000 7f7d0b7fe700 1 -- 172.21.15.71:0/2268199640 learned_addr learned my addr 172.21.15.71:0/2268199640 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:42.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.900+0000 7f7d10be8700 1 --2- 172.21.15.71:0/2268199640 >> v2:172.21.15.72:3300/0 conn(0x7f7d0c0c92b0 0x7f7d0c159590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:42.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.899+0000 7f2f132ef700 1 -- start start 2023-10-06T01:40:42.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.900+0000 7f2f132ef700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2f0c15db80 0x7f2f0c0c8730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.900+0000 7f2f132ef700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f2f0c0ceaa0 0x7f2f0c06a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.900+0000 7f2f132ef700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f0c0cd750 con 0x7f2f0c06aac0 2023-10-06T01:40:42.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.900+0000 7f2f132ef700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f0c06a150 con 0x7f2f0c0ceaa0 2023-10-06T01:40:42.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.900+0000 7f2f132ef700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0c0cda10 con 0x7f2f0c15db80 2023-10-06T01:40:42.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.900+0000 7f2f1108b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2f0c15db80 0x7f2f0c0c8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:42.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.900+0000 7f2f1108b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2f0c15db80 0x7f2f0c0c8730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.71:48804/0 (socket says 172.21.15.71:48804) 2023-10-06T01:40:42.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.900+0000 7f2f1108b700 1 -- 172.21.15.71:0/2640547075 learned_addr learned my addr 172.21.15.71:0/2640547075 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:42.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.900+0000 7f2f1108b700 1 -- 172.21.15.71:0/2640547075 >> v2:172.21.15.71:3300/0 conn(0x7f2f0c0ceaa0 msgr2=0x7f2f0c06a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:42.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.900+0000 7f2f1088a700 1 --2- 172.21.15.71:0/2640547075 >> v2:172.21.15.71:3300/0 conn(0x7f2f0c0ceaa0 0x7f2f0c06a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:42.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.901+0000 7fe984768700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe97c0d06b0 0x7fe97c0cf350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.901+0000 7fe984768700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe97c162420 con 0x7fe97c15b490 2023-10-06T01:40:42.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.901+0000 7fe984768700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe97c1615c0 con 0x7fe97c0d0260 2023-10-06T01:40:42.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.901+0000 7fe984768700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe97c161810 con 0x7fe97c0d06b0 2023-10-06T01:40:42.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.901+0000 7f2f1108b700 1 --2- 172.21.15.71:0/2640547075 >> v2:172.21.15.71:3300/0 conn(0x7f2f0c0ceaa0 0x7f2f0c06a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.901+0000 7f2f1108b700 1 -- 172.21.15.71:0/2640547075 >> v1:172.21.15.71:6789/0 conn(0x7f2f0c06aac0 legacy=0x7f2f0c0c2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:42.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.901+0000 7f2f1108b700 1 -- 172.21.15.71:0/2640547075 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f0c0c4160 con 0x7f2f0c15db80 2023-10-06T01:40:42.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.901+0000 7f2f1088a700 1 --2- 172.21.15.71:0/2640547075 >> v2:172.21.15.71:3300/0 conn(0x7f2f0c0ceaa0 0x7f2f0c06a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:40:42.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.901+0000 7fbb98b67700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbb940b13f0 0x7fbb94153d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.901+0000 7fbb98b67700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbb940c46e0 0x7fbb9415afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.901+0000 7fbb98b67700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb941574b0 0x7fbb9415b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.901+0000 7fbb98b67700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb94158f90 con 0x7fbb940c46e0 2023-10-06T01:40:42.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.901+0000 7fbb98b67700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb941583c0 con 0x7fbb941574b0 2023-10-06T01:40:42.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.901+0000 7fbb98b67700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb94158660 con 0x7fbb940b13f0 2023-10-06T01:40:42.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.901+0000 7f7d0bfff700 1 --2- 172.21.15.71:0/2268199640 >> v2:172.21.15.71:3300/0 conn(0x7f7d0c158da0 0x7f7d0c06ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:42.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.901+0000 7f7274bce700 1 --2- 172.21.15.71:0/3430702276 >> v2:172.21.15.72:3300/0 conn(0x7f727006b7e0 0x7f72700cac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:40:42.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.901+0000 7fe981d03700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fe97c0d0260 0x7fe97c0cec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.71:40676/0 (socket says 172.21.15.71:40676) 2023-10-06T01:40:42.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.901+0000 7fe981d03700 1 -- 172.21.15.71:0/963210860 learned_addr learned my addr 172.21.15.71:0/963210860 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:40:42.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.901+0000 7fbb91d9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbb940c46e0 0x7fbb9415afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:42.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.901+0000 7fbb91d9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbb940c46e0 0x7fbb9415afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47410/0 (socket says 172.21.15.71:47410) 2023-10-06T01:40:42.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.901+0000 7fbb91d9b700 1 -- 172.21.15.71:0/613191943 learned_addr learned my addr 172.21.15.71:0/613191943 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:42.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.901+0000 7fbb92d9d700 1 --2- 172.21.15.71:0/613191943 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb941574b0 0x7fbb9415b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:42.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.901+0000 7f7d0b7fe700 1 -- 172.21.15.71:0/2268199640 >> v2:172.21.15.72:3300/0 conn(0x7f7d0c0c92b0 msgr2=0x7f7d0c159590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:42.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.901+0000 7f7d0b7fe700 1 --2- 172.21.15.71:0/2268199640 >> v2:172.21.15.72:3300/0 conn(0x7f7d0c0c92b0 0x7f7d0c159590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.901+0000 7f7d0b7fe700 1 -- 172.21.15.71:0/2268199640 >> v2:172.21.15.71:3300/0 conn(0x7f7d0c158da0 msgr2=0x7f7d0c06ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:42.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.901+0000 7f7d0b7fe700 1 --2- 172.21.15.71:0/2268199640 >> v2:172.21.15.71:3300/0 conn(0x7f7d0c158da0 0x7f7d0c06ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.901+0000 7f7d0b7fe700 1 -- 172.21.15.71:0/2268199640 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d0c0afa70 con 0x7f7d0c0c8900 2023-10-06T01:40:42.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.901+0000 7f2f1108b700 1 --2- 172.21.15.71:0/2640547075 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2f0c15db80 0x7f2f0c0c8730 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2f08009990 tx=0x7f2f08009220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c295441ea104a466 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:42.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.901+0000 7f726f7fe700 1 -- 172.21.15.71:0/3430702276 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726800e070 con 0x7f727006d1c0 2023-10-06T01:40:42.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.901+0000 7f726f7fe700 1 -- 172.21.15.71:0/3430702276 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f726800bb60 con 0x7f727006d1c0 2023-10-06T01:40:42.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.901+0000 7f726f7fe700 1 -- 172.21.15.71:0/3430702276 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7268012430 con 0x7f727006d1c0 2023-10-06T01:40:42.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.901+0000 7f2f03fff700 1 -- 172.21.15.71:0/2640547075 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f08005c10 con 0x7f2f0c15db80 2023-10-06T01:40:42.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.901+0000 7fe982d05700 1 --2- 172.21.15.71:0/963210860 >> v2:172.21.15.72:3300/0 conn(0x7fe97c0d06b0 0x7fe97c0cf350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:42.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.901+0000 7f2f03fff700 1 -- 172.21.15.71:0/2640547075 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f08005d70 con 0x7f2f0c15db80 2023-10-06T01:40:42.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.901+0000 7f2f03fff700 1 -- 172.21.15.71:0/2640547075 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f0800b840 con 0x7f2f0c15db80 2023-10-06T01:40:42.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.901+0000 7fe981502700 1 -- 172.21.15.71:0/963210860 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1507747935 0 0) 0x7fe97c1615c0 con 0x7fe97c0d0260 2023-10-06T01:40:42.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.901+0000 7fe981502700 1 -- 172.21.15.71:0/963210860 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe968003570 con 0x7fe97c0d0260 2023-10-06T01:40:42.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.901+0000 7f7d0b7fe700 1 --2- 172.21.15.71:0/2268199640 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7d0c0c8900 0x7f7d0c0c8d70 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c06f720 tx=0x7f7d00009ae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6798ea55321eee14 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:42.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.902+0000 7f4985cd8700 1 Processor -- start 2023-10-06T01:40:42.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.902+0000 7fe982d05700 1 -- 172.21.15.71:0/963210860 >> v1:172.21.15.72:6789/0 conn(0x7fe97c0d0260 legacy=0x7fe97c0cec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:42.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.902+0000 7f432fd89700 1 Processor -- start 2023-10-06T01:40:42.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.902+0000 7f1848d65700 1 Processor -- start 2023-10-06T01:40:42.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.902+0000 7f4985cd8700 1 -- start start 2023-10-06T01:40:42.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.902+0000 7f1848d65700 1 -- start start 2023-10-06T01:40:42.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.902+0000 7f7d0affd700 1 -- 172.21.15.71:0/2268199640 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d0000c650 con 0x7f7d0c0c8900 2023-10-06T01:40:42.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.902+0000 7f7d0affd700 1 -- 172.21.15.71:0/2268199640 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d0000c7b0 con 0x7f7d0c0c8900 2023-10-06T01:40:42.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.902+0000 7f7276e32700 1 -- 172.21.15.71:0/3430702276 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f727006d1c0 msgr2=0x7f72701600e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:42.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.902+0000 7f7276e32700 1 --2- 172.21.15.71:0/3430702276 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f727006d1c0 0x7f72701600e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7268009e60 tx=0x7f7268009780 comp rx=0 tx=0).stop 2023-10-06T01:40:42.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.902+0000 7f7276e32700 1 -- 172.21.15.71:0/3430702276 shutdown_connections 2023-10-06T01:40:42.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.902+0000 7f7276e32700 1 --2- 172.21.15.71:0/3430702276 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f727006d1c0 0x7f72701600e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.902+0000 7f7276e32700 1 --2- 172.21.15.71:0/3430702276 >> v2:172.21.15.72:3300/0 conn(0x7f727006b7e0 0x7f72700cac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.902+0000 7f7276e32700 1 -- 172.21.15.71:0/3430702276 >> 172.21.15.71:0/3430702276 conn(0x7f727006a260 msgr2=0x7f72700cd030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:42.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.902+0000 7f7276e32700 1 -- 172.21.15.71:0/3430702276 shutdown_connections 2023-10-06T01:40:42.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.901+0000 7fbb92d9d700 1 -- 172.21.15.71:0/613191943 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbb940b13f0 msgr2=0x7fbb94153d70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T01:40:42.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.901+0000 7fbb92d9d700 1 --2- 172.21.15.71:0/613191943 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbb940b13f0 0x7fbb94153d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.901+0000 7fbb92d9d700 1 -- 172.21.15.71:0/613191943 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbb940c46e0 msgr2=0x7fbb9415afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:42.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.901+0000 7fbb92d9d700 1 --2- 172.21.15.71:0/613191943 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbb940c46e0 0x7fbb9415afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.902+0000 7fbb92d9d700 1 -- 172.21.15.71:0/613191943 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb880093c0 con 0x7fbb941574b0 2023-10-06T01:40:42.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.902+0000 7fbb92d9d700 1 --2- 172.21.15.71:0/613191943 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb941574b0 0x7fbb9415b500 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c00bad0 tx=0x7fbb8c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:42.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.902+0000 7fbb827fc700 1 -- 172.21.15.71:0/613191943 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb8c00c840 con 0x7fbb941574b0 2023-10-06T01:40:42.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.902+0000 7fbb827fc700 1 -- 172.21.15.71:0/613191943 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb8c00c9a0 con 0x7fbb941574b0 2023-10-06T01:40:42.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.902+0000 7fbb827fc700 1 -- 172.21.15.71:0/613191943 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb8c00cd60 con 0x7fbb941574b0 2023-10-06T01:40:42.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.902+0000 7fbb98b67700 1 -- 172.21.15.71:0/613191943 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb94158940 con 0x7fbb941574b0 2023-10-06T01:40:42.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.902+0000 7fbb98b67700 1 -- 172.21.15.71:0/613191943 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb941542b0 con 0x7fbb941574b0 2023-10-06T01:40:42.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.902+0000 7f2f132ef700 1 -- 172.21.15.71:0/2640547075 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2f0c15db80 msgr2=0x7f2f0c0c8730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:42.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.902+0000 7f2f132ef700 1 --2- 172.21.15.71:0/2640547075 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2f0c15db80 0x7f2f0c0c8730 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2f08009990 tx=0x7f2f08009220 comp rx=0 tx=0).stop 2023-10-06T01:40:42.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.902+0000 7f7276e32700 1 -- 172.21.15.71:0/3430702276 wait complete. 2023-10-06T01:40:42.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.903+0000 7f2f132ef700 1 -- 172.21.15.71:0/2640547075 shutdown_connections 2023-10-06T01:40:42.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.903+0000 7f2f132ef700 1 --2- 172.21.15.71:0/2640547075 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2f0c15db80 0x7f2f0c0c8730 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.903+0000 7f2f132ef700 1 --2- 172.21.15.71:0/2640547075 >> v2:172.21.15.71:3300/0 conn(0x7f2f0c0ceaa0 0x7f2f0c06a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.903+0000 7f2f132ef700 1 -- 172.21.15.71:0/2640547075 >> 172.21.15.71:0/2640547075 conn(0x7f2f0c067910 msgr2=0x7f2f0c0ce0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:42.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.903+0000 7f4985cd8700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f49801576a0 0x7f49800cc820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.903+0000 7f4985cd8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f49800af710 0x7f49800adb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.922 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.903+0000 7f4985cd8700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49800ae4d0 con 0x7f49800ae070 2023-10-06T01:40:42.922 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.903+0000 7f4985cd8700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49800ccd60 con 0x7f49801576a0 2023-10-06T01:40:42.922 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.903+0000 7f4985cd8700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49800b1d20 con 0x7f49800af710 2023-10-06T01:40:42.922 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.902+0000 7fe982d05700 1 -- 172.21.15.71:0/963210860 >> v1:172.21.15.71:6789/0 conn(0x7fe97c15b490 legacy=0x7fe97c15ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:42.922 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.902+0000 7fe982d05700 1 -- 172.21.15.71:0/963210860 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe97c161af0 con 0x7fe97c0d06b0 2023-10-06T01:40:42.922 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.902+0000 7fe982d05700 1 --2- 172.21.15.71:0/963210860 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe97c0d06b0 0x7fe97c0cf350 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe978009860 tx=0x7fe9780091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7da5ddf032860226 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:42.922 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.902+0000 7f432fd89700 1 -- start start 2023-10-06T01:40:42.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.903+0000 7f432fd89700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f432806e390 0x7f43280acb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.903+0000 7f432fd89700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f432815ddc0 0x7f43280ad080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.903+0000 7f432fd89700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43280af340 con 0x7f432815d9f0 2023-10-06T01:40:42.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.903+0000 7f432fd89700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43280abdf0 con 0x7f432806e390 2023-10-06T01:40:42.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.903+0000 7f432fd89700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43280abfe0 con 0x7f432815ddc0 2023-10-06T01:40:42.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.903+0000 7f2f132ef700 1 -- 172.21.15.71:0/2640547075 shutdown_connections 2023-10-06T01:40:42.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.903+0000 7f432db25700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f432815d9f0 0x7f43280ab6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:59476/0 (socket says 172.21.15.71:59476) 2023-10-06T01:40:42.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.903+0000 7f432db25700 1 -- 172.21.15.71:0/3939209294 learned_addr learned my addr 172.21.15.71:0/3939209294 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:40:42.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.903+0000 7f2f132ef700 1 -- 172.21.15.71:0/2640547075 wait complete. 2023-10-06T01:40:42.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.903+0000 7f497f7fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f49801576a0 0x7f49800cc820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:42.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.902+0000 7f7d0affd700 1 -- 172.21.15.71:0/2268199640 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d0000cb70 con 0x7f7d0c0c8900 2023-10-06T01:40:42.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.903+0000 7f7d1264b700 1 -- 172.21.15.71:0/2268199640 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7d0c0c8900 msgr2=0x7f7d0c0c8d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:42.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.903+0000 7f7d1264b700 1 --2- 172.21.15.71:0/2268199640 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7d0c0c8900 0x7f7d0c0c8d70 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c06f720 tx=0x7f7d00009ae0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.903+0000 7f7d1264b700 1 -- 172.21.15.71:0/2268199640 shutdown_connections 2023-10-06T01:40:42.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.903+0000 7f7d1264b700 1 --2- 172.21.15.71:0/2268199640 >> v2:172.21.15.71:3300/0 conn(0x7f7d0c158da0 0x7f7d0c06ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.903+0000 7f7d1264b700 1 --2- 172.21.15.71:0/2268199640 >> v2:172.21.15.72:3300/0 conn(0x7f7d0c0c92b0 0x7f7d0c159590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.903+0000 7f7d1264b700 1 --2- 172.21.15.71:0/2268199640 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7d0c0c8900 0x7f7d0c0c8d70 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.903+0000 7f7d1264b700 1 -- 172.21.15.71:0/2268199640 >> 172.21.15.71:0/2268199640 conn(0x7f7d0c069110 msgr2=0x7f7d0c0cbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:42.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.904+0000 7f432d324700 1 --2- 172.21.15.71:0/3939209294 >> v2:172.21.15.71:3300/0 conn(0x7f432806e390 0x7f43280acb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:42.926 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.904+0000 7f497f7fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f49801576a0 0x7f49800cc820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47412/0 (socket says 172.21.15.71:47412) 2023-10-06T01:40:42.926 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.904+0000 7f497f7fe700 1 -- 172.21.15.71:0/2559930071 learned_addr learned my addr 172.21.15.71:0/2559930071 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:42.926 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.904+0000 7f7276e32700 1 Processor -- start 2023-10-06T01:40:42.926 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.904+0000 7f432d324700 1 -- 172.21.15.71:0/3939209294 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f432815ddc0 msgr2=0x7f43280ad080 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T01:40:42.926 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.904+0000 7f432d324700 1 --2- 172.21.15.71:0/3939209294 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f432815ddc0 0x7f43280ad080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.904+0000 7f432d324700 1 -- 172.21.15.71:0/3939209294 >> v1:172.21.15.71:6789/0 conn(0x7f432815d9f0 legacy=0x7f43280ab6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:42.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.904+0000 7f432d324700 1 -- 172.21.15.71:0/3939209294 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43280ac2c0 con 0x7f432806e390 2023-10-06T01:40:42.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.903+0000 7f1848d65700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f184415b490 0x7f184415ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.903+0000 7f1848d65700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1844162420 con 0x7f18440cfc50 2023-10-06T01:40:42.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.903+0000 7f1848d65700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18441615c0 con 0x7f18440d0260 2023-10-06T01:40:42.927 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.903+0000 7f1848d65700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f184415ef50 con 0x7f184415b490 2023-10-06T01:40:42.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.904+0000 7f1842d9d700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f18440cfc50 0x7f1844087910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:59486/0 (socket says 172.21.15.71:59486) 2023-10-06T01:40:42.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.904+0000 7f1842d9d700 1 -- 172.21.15.71:0/4214767190 learned_addr learned my addr 172.21.15.71:0/4214767190 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:40:42.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.904+0000 7f184159a700 1 -- 172.21.15.71:0/4214767190 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1965714434 0 0) 0x7f1844162420 con 0x7f18440cfc50 2023-10-06T01:40:42.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.904+0000 7f184159a700 1 -- 172.21.15.71:0/4214767190 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f182c003570 con 0x7f18440cfc50 2023-10-06T01:40:42.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.904+0000 7f7d1264b700 1 -- 172.21.15.71:0/2268199640 shutdown_connections 2023-10-06T01:40:42.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.904+0000 7f7d1264b700 1 -- 172.21.15.71:0/2268199640 wait complete. 2023-10-06T01:40:42.929 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.905+0000 7f184159a700 1 -- 172.21.15.71:0/4214767190 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 21266440 0 0) 0x7f18441615c0 con 0x7f18440d0260 2023-10-06T01:40:42.929 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.905+0000 7f184159a700 1 -- 172.21.15.71:0/4214767190 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1844162420 con 0x7f18440d0260 2023-10-06T01:40:42.929 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.904+0000 7fbb827fc700 1 -- 172.21.15.71:0/613191943 <== mon.1 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbb8c014620 con 0x7fbb941574b0 2023-10-06T01:40:42.929 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.905+0000 7fbb827fc700 1 --2- 172.21.15.71:0/613191943 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fbb74066f30 0x7fbb740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.929 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.905+0000 7fbb98b67700 1 -- 172.21.15.71:0/613191943 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb780052b0 con 0x7fbb941574b0 2023-10-06T01:40:42.929 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.905+0000 7f2f132ef700 1 Processor -- start 2023-10-06T01:40:42.930 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.904+0000 7fe981502700 1 -- 172.21.15.71:0/963210860 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9740017f0 con 0x7fe97c0d06b0 2023-10-06T01:40:42.930 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.904+0000 7fe981502700 1 -- 172.21.15.71:0/963210860 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe978011420 con 0x7fe97c0d06b0 2023-10-06T01:40:42.930 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.904+0000 7fe981502700 1 -- 172.21.15.71:0/963210860 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9780117c0 con 0x7fe97c0d06b0 2023-10-06T01:40:42.930 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.905+0000 7fbb9259c700 1 --2- 172.21.15.71:0/613191943 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fbb74066f30 0x7fbb740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:42.930 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.905+0000 7fbb827fc700 1 -- 172.21.15.71:0/613191943 <== mon.1 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fbb8c084940 con 0x7fbb941574b0 2023-10-06T01:40:42.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.905+0000 7f184159a700 1 -- 172.21.15.71:0/4214767190 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4036694087 0 0) 0x7f182c003570 con 0x7f18440cfc50 2023-10-06T01:40:42.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.905+0000 7f184159a700 1 -- 172.21.15.71:0/4214767190 >> v2:172.21.15.71:3300/0 conn(0x7f184415b490 msgr2=0x7f184415ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:42.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.905+0000 7f184159a700 1 --2- 172.21.15.71:0/4214767190 >> v2:172.21.15.71:3300/0 conn(0x7f184415b490 0x7f184415ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.905+0000 7f184159a700 1 -- 172.21.15.71:0/4214767190 >> v1:172.21.15.72:6789/0 conn(0x7f18440d0260 legacy=0x7f1844087200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:42.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.905+0000 7f184159a700 1 -- 172.21.15.71:0/4214767190 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1844088020 con 0x7f18440cfc50 2023-10-06T01:40:42.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.905+0000 7f184159a700 1 -- 172.21.15.71:0/4214767190 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1184243524 0 0) 0x7f183c0017f0 con 0x7f18440cfc50 2023-10-06T01:40:42.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.905+0000 7f184159a700 1 -- 172.21.15.71:0/4214767190 >> v1:172.21.15.71:6789/0 conn(0x7f18440cfc50 legacy=0x7f1844087910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:42.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.905+0000 7f184159a700 1 --2- 172.21.15.71:0/4214767190 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f182c003bf0 0x7f182c003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.905+0000 7f184159a700 1 --2- 172.21.15.71:0/4214767190 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f182c004810 0x7f182c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.905+0000 7f184159a700 1 --2- 172.21.15.71:0/4214767190 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f182c005310 0x7f182c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.905+0000 7f184159a700 1 -- 172.21.15.71:0/4214767190 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f184415ef50 con 0x7f182c004810 2023-10-06T01:40:42.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.905+0000 7f184159a700 1 -- 172.21.15.71:0/4214767190 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f182c00c230 con 0x7f182c003bf0 2023-10-06T01:40:42.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.905+0000 7f184159a700 1 -- 172.21.15.71:0/4214767190 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f182c00c3f0 con 0x7f182c005310 2023-10-06T01:40:42.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.905+0000 7fe984768700 1 -- 172.21.15.71:0/963210860 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe97c0d06b0 msgr2=0x7fe97c0cf350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:42.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.905+0000 7fe984768700 1 --2- 172.21.15.71:0/963210860 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe97c0d06b0 0x7fe97c0cf350 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe978009860 tx=0x7fe9780091a0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.904+0000 7f497effd700 1 --2- 172.21.15.71:0/2559930071 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f49800af710 0x7f49800adb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:42.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.905+0000 7f497e7fc700 1 -- 172.21.15.71:0/2559930071 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3467311526 0 0) 0x7f4978001490 con 0x7f49800ae070 2023-10-06T01:40:42.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.905+0000 7f497effd700 1 -- 172.21.15.71:0/2559930071 >> v2:172.21.15.71:3300/0 conn(0x7f49801576a0 msgr2=0x7f49800cc820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:42.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.905+0000 7f497effd700 1 --2- 172.21.15.71:0/2559930071 >> v2:172.21.15.71:3300/0 conn(0x7f49801576a0 0x7f49800cc820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.905+0000 7f497effd700 1 -- 172.21.15.71:0/2559930071 >> v1:172.21.15.71:6789/0 conn(0x7f49800ae070 legacy=0x7f4980157a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:42.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.905+0000 7f497effd700 1 -- 172.21.15.71:0/2559930071 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f498006f4e0 con 0x7f49800af710 2023-10-06T01:40:42.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.905+0000 7fe984768700 1 -- 172.21.15.71:0/963210860 shutdown_connections 2023-10-06T01:40:42.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.905+0000 7fe984768700 1 --2- 172.21.15.71:0/963210860 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe97c0d06b0 0x7fe97c0cf350 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.905+0000 7fe984768700 1 -- 172.21.15.71:0/963210860 >> 172.21.15.71:0/963210860 conn(0x7fe97c06a220 msgr2=0x7fe97c06a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:42.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.904+0000 7f7276e32700 1 -- start start 2023-10-06T01:40:42.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.905+0000 7f7276e32700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f727006b7e0 0x7f72700b28a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.905+0000 7f7276e32700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f727006bbb0 0x7f72700ad160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.906+0000 7f7276e32700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f727006d1c0 0x7f72700b0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.906+0000 7f7276e32700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72700ad6a0 con 0x7f727006d1c0 2023-10-06T01:40:42.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.906+0000 7f7276e32700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72700b0760 con 0x7f727006bbb0 2023-10-06T01:40:42.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.906+0000 7f7276e32700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72700b1130 con 0x7f727006b7e0 2023-10-06T01:40:42.935 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.906+0000 7f432d324700 1 --2- 172.21.15.71:0/3939209294 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f432806e390 0x7f43280acb40 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f43240098e0 tx=0x7f43240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=210036efa62d14e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:42.935 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.906+0000 7f7274bce700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f727006b7e0 0x7f72700b28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:42.935 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.906+0000 7f7274bce700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f727006b7e0 0x7f72700b28a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.71:48860/0 (socket says 172.21.15.71:48860) 2023-10-06T01:40:42.935 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.906+0000 7f7274bce700 1 -- 172.21.15.71:0/2792921169 learned_addr learned my addr 172.21.15.71:0/2792921169 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:42.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.906+0000 7f7d1264b700 1 Processor -- start 2023-10-06T01:40:42.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.906+0000 7fe984768700 1 -- 172.21.15.71:0/963210860 shutdown_connections 2023-10-06T01:40:42.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.906+0000 7f726ffff700 1 --2- 172.21.15.71:0/2792921169 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f727006bbb0 0x7f72700ad160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:42.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.906+0000 7f1841d9b700 1 --2- 172.21.15.71:0/4214767190 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f182c004810 0x7f182c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:42.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.906+0000 7f497effd700 1 --2- 172.21.15.71:0/2559930071 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f49800af710 0x7f49800adb30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4968006d90 tx=0x7f49680091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9486968f4df557e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:42.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.906+0000 7f7d1264b700 1 -- start start 2023-10-06T01:40:42.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.906+0000 7f1842d9d700 1 --2- 172.21.15.71:0/4214767190 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f182c005310 0x7f182c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:42.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.906+0000 7f184259c700 1 --2- 172.21.15.71:0/4214767190 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f182c003bf0 0x7f182c003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:42.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.906+0000 7f72753cf700 1 --2- 172.21.15.71:0/2792921169 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f727006d1c0 0x7f72700b0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:42.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.906+0000 7f432cb23700 1 -- 172.21.15.71:0/3939209294 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4324009e80 con 0x7f432806e390 2023-10-06T01:40:42.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.906+0000 7f497e7fc700 1 -- 172.21.15.71:0/2559930071 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4968010380 con 0x7f49800af710 2023-10-06T01:40:42.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.906+0000 7f497e7fc700 1 -- 172.21.15.71:0/2559930071 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f496800b820 con 0x7f49800af710 2023-10-06T01:40:42.939 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.906+0000 7f497e7fc700 1 -- 172.21.15.71:0/2559930071 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f496800bbe0 con 0x7f49800af710 2023-10-06T01:40:42.939 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.906+0000 7f184259c700 1 -- 172.21.15.71:0/4214767190 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f182c005310 msgr2=0x7f182c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:42.939 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.906+0000 7f184259c700 1 --2- 172.21.15.71:0/4214767190 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f182c005310 0x7f182c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.939 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.906+0000 7f184259c700 1 -- 172.21.15.71:0/4214767190 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f182c004810 msgr2=0x7f182c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:42.939 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.906+0000 7f184259c700 1 --2- 172.21.15.71:0/4214767190 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f182c004810 0x7f182c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.939 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.906+0000 7f184259c700 1 -- 172.21.15.71:0/4214767190 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f182c003570 con 0x7f182c003bf0 2023-10-06T01:40:42.939 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.906+0000 7f1841d9b700 1 --2- 172.21.15.71:0/4214767190 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f182c004810 0x7f182c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:40:42.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.906+0000 7f726ffff700 1 -- 172.21.15.71:0/2792921169 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f727006b7e0 msgr2=0x7f72700b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:42.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.906+0000 7f726ffff700 1 --2- 172.21.15.71:0/2792921169 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f727006b7e0 0x7f72700b28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.907+0000 7f726ffff700 1 -- 172.21.15.71:0/2792921169 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f727006d1c0 msgr2=0x7f72700b0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:42.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.907+0000 7f726ffff700 1 --2- 172.21.15.71:0/2792921169 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f727006d1c0 0x7f72700b0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.907+0000 7f726ffff700 1 -- 172.21.15.71:0/2792921169 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7268009a20 con 0x7f727006bbb0 2023-10-06T01:40:42.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.907+0000 7f1842d9d700 1 -- 172.21.15.71:0/4214767190 reap_dead start 2023-10-06T01:40:42.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.905+0000 7f2f132ef700 1 -- start start 2023-10-06T01:40:42.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.907+0000 7f2f132ef700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2f0c06aac0 0x7f2f0c13c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.907+0000 7f2f132ef700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2f0c0ceaa0 0x7f2f0c1386d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.907+0000 7f2f132ef700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f0c15db80 0x7f2f0c0c7660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.907+0000 7f2f132ef700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0c13cd70 con 0x7f2f0c06aac0 2023-10-06T01:40:42.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.907+0000 7f2f132ef700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0c13d4a0 con 0x7f2f0c15db80 2023-10-06T01:40:42.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.907+0000 7f2f132ef700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0c138c10 con 0x7f2f0c0ceaa0 2023-10-06T01:40:42.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.907+0000 7f726ffff700 1 --2- 172.21.15.71:0/2792921169 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f727006bbb0 0x7f72700ad160 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f726400c580 tx=0x7f7264007d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:42.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.907+0000 7f184259c700 1 --2- 172.21.15.71:0/4214767190 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f182c003bf0 0x7f182c003fe0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f18340099c0 tx=0x7f1834009060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6115921c9a027d91 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:42.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.907+0000 7f2f1188c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f0c15db80 0x7f2f0c0c7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:42.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.907+0000 7f2f1188c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f0c15db80 0x7f2f0c0c7660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:56106/0 (socket says 172.21.15.71:56106) 2023-10-06T01:40:42.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.907+0000 7f2f1188c700 1 -- 172.21.15.71:0/91155829 learned_addr learned my addr 172.21.15.71:0/91155829 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:42.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.907+0000 7f2f1088a700 1 --2- 172.21.15.71:0/91155829 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2f0c0ceaa0 0x7f2f0c1386d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:42.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.906+0000 7fbb9259c700 1 --2- 172.21.15.71:0/613191943 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fbb74066f30 0x7fbb740693e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fbb88003080 tx=0x7fbb88016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:42.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.907+0000 7f7d1264b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7d0c0c8900 0x7f7d0c1449a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.907+0000 7f7d1264b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7d0c0c92b0 0x7f7d0c149100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.907+0000 7f7d1264b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d0c158da0 0x7f7d0c14f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.907+0000 7f7d1264b700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0c14a5b0 con 0x7f7d0c0c92b0 2023-10-06T01:40:42.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.907+0000 7f7d1264b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0c1499a0 con 0x7f7d0c158da0 2023-10-06T01:40:42.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.907+0000 7f7d1264b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0c149c80 con 0x7f7d0c0c8900 2023-10-06T01:40:42.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.907+0000 7f2f1088a700 1 -- 172.21.15.71:0/91155829 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f0c15db80 msgr2=0x7f2f0c0c7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:42.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.907+0000 7f2f1088a700 1 --2- 172.21.15.71:0/91155829 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f0c15db80 0x7f2f0c0c7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.907+0000 7f2f1088a700 1 -- 172.21.15.71:0/91155829 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2f0c06aac0 msgr2=0x7f2f0c13c830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T01:40:42.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.907+0000 7f2f1088a700 1 --2- 172.21.15.71:0/91155829 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2f0c06aac0 0x7f2f0c13c830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.907+0000 7f2f1088a700 1 -- 172.21.15.71:0/91155829 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f08009480 con 0x7f2f0c0ceaa0 2023-10-06T01:40:42.944 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.907+0000 7f2f1188c700 1 --2- 172.21.15.71:0/91155829 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f0c15db80 0x7f2f0c0c7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:40:42.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.906+0000 7fe984768700 1 -- 172.21.15.71:0/963210860 wait complete. 2023-10-06T01:40:42.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.907+0000 7f7d10be8700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d0c158da0 0x7f7d0c14f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:42.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.907+0000 7f7d0bfff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7d0c0c8900 0x7f7d0c1449a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:42.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.907+0000 7f7d10be8700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d0c158da0 0x7f7d0c14f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:56118/0 (socket says 172.21.15.71:56118) 2023-10-06T01:40:42.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.907+0000 7f7d10be8700 1 -- 172.21.15.71:0/2590689624 learned_addr learned my addr 172.21.15.71:0/2590689624 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:42.946 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.907+0000 7fe984768700 1 Processor -- start 2023-10-06T01:40:42.946 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.906+0000 7f432cb23700 1 -- 172.21.15.71:0/3939209294 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f432400b760 con 0x7f432806e390 2023-10-06T01:40:42.946 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.906+0000 7f432cb23700 1 -- 172.21.15.71:0/3939209294 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f432400bb20 con 0x7f432806e390 2023-10-06T01:40:42.946 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.907+0000 7f432fd89700 1 -- 172.21.15.71:0/3939209294 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f432806e390 msgr2=0x7f43280acb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:42.947 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.907+0000 7f432fd89700 1 --2- 172.21.15.71:0/3939209294 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f432806e390 0x7f43280acb40 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f43240098e0 tx=0x7f43240091a0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.947 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.907+0000 7f432fd89700 1 -- 172.21.15.71:0/3939209294 shutdown_connections 2023-10-06T01:40:42.947 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.907+0000 7f432fd89700 1 --2- 172.21.15.71:0/3939209294 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f432815ddc0 0x7f43280ad080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.947 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.907+0000 7f432fd89700 1 --2- 172.21.15.71:0/3939209294 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f432806e390 0x7f43280acb40 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.947 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.907+0000 7f432fd89700 1 -- 172.21.15.71:0/3939209294 >> 172.21.15.71:0/3939209294 conn(0x7f4328069110 msgr2=0x7f43280cbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:42.947 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.907+0000 7fe984768700 1 -- start start 2023-10-06T01:40:42.947 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.908+0000 7f2f1088a700 1 --2- 172.21.15.71:0/91155829 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2f0c0ceaa0 0x7f2f0c1386d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2efc00c880 tx=0x7f2efc008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:42.948 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.908+0000 7f7d10be8700 1 -- 172.21.15.71:0/2590689624 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7d0c0c8900 msgr2=0x7f7d0c1449a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:42.948 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.908+0000 7f7d10be8700 1 --2- 172.21.15.71:0/2590689624 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7d0c0c8900 0x7f7d0c1449a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.948 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.908+0000 7f7d10be8700 1 -- 172.21.15.71:0/2590689624 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7d0c0c92b0 msgr2=0x7f7d0c149100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:42.948 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.908+0000 7f7d10be8700 1 --2- 172.21.15.71:0/2590689624 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7d0c0c92b0 0x7f7d0c149100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.948 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.908+0000 7f432fd89700 1 -- 172.21.15.71:0/3939209294 shutdown_connections 2023-10-06T01:40:42.949 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.908+0000 7f7d10be8700 1 -- 172.21.15.71:0/2590689624 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d00009d80 con 0x7f7d0c158da0 2023-10-06T01:40:42.949 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.908+0000 7f7d0bfff700 1 --2- 172.21.15.71:0/2590689624 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7d0c0c8900 0x7f7d0c1449a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:40:42.949 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.908+0000 7f4985cd8700 1 -- 172.21.15.71:0/2559930071 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f49800af710 msgr2=0x7f49800adb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:42.949 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.908+0000 7f4985cd8700 1 --2- 172.21.15.71:0/2559930071 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f49800af710 0x7f49800adb30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4968006d90 tx=0x7f49680091a0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.950 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.908+0000 7f432fd89700 1 -- 172.21.15.71:0/3939209294 wait complete. 2023-10-06T01:40:42.950 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.908+0000 7f2f017fa700 1 -- 172.21.15.71:0/91155829 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2efc011600 con 0x7f2f0c0ceaa0 2023-10-06T01:40:42.950 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.908+0000 7f4985cd8700 1 -- 172.21.15.71:0/2559930071 shutdown_connections 2023-10-06T01:40:42.950 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.908+0000 7f4985cd8700 1 --2- 172.21.15.71:0/2559930071 >> v2:172.21.15.71:3300/0 conn(0x7f49801576a0 0x7f49800cc820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.950 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.908+0000 7f4985cd8700 1 --2- 172.21.15.71:0/2559930071 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f49800af710 0x7f49800adb30 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.951 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.908+0000 7f4985cd8700 1 -- 172.21.15.71:0/2559930071 >> 172.21.15.71:0/2559930071 conn(0x7f4980069110 msgr2=0x7f49800cbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:42.951 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.908+0000 7f2f132ef700 1 -- 172.21.15.71:0/91155829 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f0c13cf80 con 0x7f2f0c0ceaa0 2023-10-06T01:40:42.951 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.908+0000 7f7d10be8700 1 --2- 172.21.15.71:0/2590689624 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d0c158da0 0x7f7d0c14f2b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7d0400bfc0 tx=0x7f7d0400d040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:42.951 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.908+0000 7f2f017fa700 1 -- 172.21.15.71:0/91155829 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2efc011760 con 0x7f2f0c0ceaa0 2023-10-06T01:40:42.951 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.908+0000 7f2f017fa700 1 -- 172.21.15.71:0/91155829 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2efc011b40 con 0x7f2f0c0ceaa0 2023-10-06T01:40:42.951 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.908+0000 7f2f132ef700 1 -- 172.21.15.71:0/91155829 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f0c14a0e0 con 0x7f2f0c0ceaa0 2023-10-06T01:40:42.952 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.908+0000 7f4985cd8700 1 -- 172.21.15.71:0/2559930071 shutdown_connections 2023-10-06T01:40:42.952 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.908+0000 7f4985cd8700 1 -- 172.21.15.71:0/2559930071 wait complete. 2023-10-06T01:40:42.953 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.908+0000 7fe984768700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe97c0d0260 0x7fe97c06f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.953 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.908+0000 7fe984768700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe97c0d06b0 0x7fe97c0b24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.953 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.908+0000 7fe984768700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe97c15b490 0x7fe97c15c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.953 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.908+0000 7fe984768700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe97c0b0360 con 0x7fe97c0d0260 2023-10-06T01:40:42.953 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.908+0000 7fe984768700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe97c06f690 con 0x7fe97c0d06b0 2023-10-06T01:40:42.954 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.908+0000 7fe984768700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe97c0afd50 con 0x7fe97c15b490 2023-10-06T01:40:42.954 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.909+0000 7fe981d03700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe97c0d06b0 0x7fe97c0b24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:42.954 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.909+0000 7fe981d03700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe97c0d06b0 0x7fe97c0b24a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:56120/0 (socket says 172.21.15.71:56120) 2023-10-06T01:40:42.954 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.909+0000 7fe981d03700 1 -- 172.21.15.71:0/2995379887 learned_addr learned my addr 172.21.15.71:0/2995379887 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:42.954 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.909+0000 7fe982d05700 1 --2- 172.21.15.71:0/2995379887 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe97c15b490 0x7fe97c15c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:42.954 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.909+0000 7fe981d03700 1 -- 172.21.15.71:0/2995379887 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe97c15b490 msgr2=0x7fe97c15c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:42.954 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.909+0000 7fe981d03700 1 --2- 172.21.15.71:0/2995379887 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe97c15b490 0x7fe97c15c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.954 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.909+0000 7fe981d03700 1 -- 172.21.15.71:0/2995379887 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe97c0d0260 msgr2=0x7fe97c06f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:42.954 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.909+0000 7fe981d03700 1 --2- 172.21.15.71:0/2995379887 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe97c0d0260 0x7fe97c06f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.954 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.909+0000 7fe981d03700 1 -- 172.21.15.71:0/2995379887 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe978009420 con 0x7fe97c0d06b0 2023-10-06T01:40:42.954 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.909+0000 7fe981d03700 1 --2- 172.21.15.71:0/2995379887 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe97c0d06b0 0x7fe97c0b24a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe974001560 tx=0x7fe974007e90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:42.955 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.909+0000 7f2f132ef700 1 -- 172.21.15.71:0/91155829 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f0c06e590 con 0x7f2f0c0ceaa0 2023-10-06T01:40:42.955 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.909+0000 7f432fd89700 1 Processor -- start 2023-10-06T01:40:42.955 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.909+0000 7f432fd89700 1 -- start start 2023-10-06T01:40:42.955 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.909+0000 7f4985cd8700 1 Processor -- start 2023-10-06T01:40:42.956 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.909+0000 7f2f017fa700 1 -- 172.21.15.71:0/91155829 <== mon.2 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2efc018360 con 0x7f2f0c0ceaa0 2023-10-06T01:40:42.956 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.910+0000 7f4985cd8700 1 -- start start 2023-10-06T01:40:42.956 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.910+0000 7f2f017fa700 1 --2- 172.21.15.71:0/91155829 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f2ef0066f30 0x7f2ef00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.956 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.910+0000 7f2f017fa700 1 -- 172.21.15.71:0/91155829 <== mon.2 v2:172.21.15.72:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f2efc0847c0 con 0x7f2f0c0ceaa0 2023-10-06T01:40:42.957 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.910+0000 7f2f1108b700 1 --2- 172.21.15.71:0/91155829 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f2ef0066f30 0x7f2ef00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:42.957 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.910+0000 7f432fd89700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f432806e390 0x7f4328136330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.958 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.910+0000 7f432fd89700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f432815d9f0 0x7f4328146810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.958 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.910+0000 7f432fd89700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f432815ddc0 0x7f432814d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.958 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.910+0000 7f432fd89700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4328135ea0 con 0x7f432815d9f0 2023-10-06T01:40:42.958 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.910+0000 7f432fd89700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4328135870 con 0x7f432806e390 2023-10-06T01:40:42.958 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.910+0000 7f432fd89700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43281470f0 con 0x7f432815ddc0 2023-10-06T01:40:42.958 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.910+0000 7f432d324700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f432815d9f0 0x7f4328146810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:42.958 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.910+0000 7f432d324700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f432815d9f0 0x7f4328146810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47488/0 (socket says 172.21.15.71:47488) 2023-10-06T01:40:42.958 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.910+0000 7f432d324700 1 -- 172.21.15.71:0/3119133113 learned_addr learned my addr 172.21.15.71:0/3119133113 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:42.959 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.910+0000 7f7cf3fff700 1 -- 172.21.15.71:0/2590689624 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d04010040 con 0x7f7d0c158da0 2023-10-06T01:40:42.959 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.910+0000 7f184159a700 1 -- 172.21.15.71:0/4214767190 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1834012480 con 0x7f182c003bf0 2023-10-06T01:40:42.959 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.911+0000 7f184159a700 1 -- 172.21.15.71:0/4214767190 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18340125e0 con 0x7f182c003bf0 2023-10-06T01:40:42.959 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.911+0000 7f184159a700 1 -- 172.21.15.71:0/4214767190 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18340129a0 con 0x7f182c003bf0 2023-10-06T01:40:42.960 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.910+0000 7f7cf3fff700 1 -- 172.21.15.71:0/2590689624 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d0400b320 con 0x7f7d0c158da0 2023-10-06T01:40:42.960 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.911+0000 7f7d1264b700 1 -- 172.21.15.71:0/2590689624 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d0c149f60 con 0x7f7d0c158da0 2023-10-06T01:40:42.960 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.911+0000 7f7d1264b700 1 -- 172.21.15.71:0/2590689624 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d0c149640 con 0x7f7d0c158da0 2023-10-06T01:40:42.960 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.911+0000 7f7cf3fff700 1 -- 172.21.15.71:0/2590689624 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d0400eca0 con 0x7f7d0c158da0 2023-10-06T01:40:42.960 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.911+0000 7f4985cd8700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49800ae070 0x7f49800a6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.960 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.911+0000 7f4985cd8700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f49800af710 0x7f49800a44c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.960 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.911+0000 7f4985cd8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f49801576a0 0x7f4980150e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.961 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.911+0000 7f4985cd8700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49800a61f0 con 0x7f49800af710 2023-10-06T01:40:42.961 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.911+0000 7f4985cd8700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49800a56d0 con 0x7f49800ae070 2023-10-06T01:40:42.961 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.911+0000 7f4985cd8700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49800a4b50 con 0x7f49801576a0 2023-10-06T01:40:42.961 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.911+0000 7f497ffff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f49801576a0 0x7f4980150e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:42.961 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.911+0000 7f497ffff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f49801576a0 0x7f4980150e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.71:48916/0 (socket says 172.21.15.71:48916) 2023-10-06T01:40:42.961 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.911+0000 7f497ffff700 1 -- 172.21.15.71:0/3400537438 learned_addr learned my addr 172.21.15.71:0/3400537438 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:42.961 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.911+0000 7f497f7fe700 1 --2- 172.21.15.71:0/3400537438 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49800ae070 0x7f49800a6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:42.961 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.911+0000 7f497effd700 1 --2- 172.21.15.71:0/3400537438 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f49800af710 0x7f49800a44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:42.961 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.911+0000 7f497ffff700 1 -- 172.21.15.71:0/3400537438 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49800ae070 msgr2=0x7f49800a6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:42.961 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.911+0000 7f497ffff700 1 --2- 172.21.15.71:0/3400537438 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49800ae070 0x7f49800a6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.961 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.911+0000 7f497ffff700 1 -- 172.21.15.71:0/3400537438 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f49800af710 msgr2=0x7f49800a44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:42.961 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.912+0000 7f497ffff700 1 --2- 172.21.15.71:0/3400537438 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f49800af710 0x7f49800a44c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.962 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.912+0000 7f497ffff700 1 -- 172.21.15.71:0/3400537438 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4968009420 con 0x7f49801576a0 2023-10-06T01:40:42.962 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.910+0000 7f432e326700 1 --2- 172.21.15.71:0/3119133113 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f432815ddc0 0x7f432814d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:42.962 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.911+0000 7f432db25700 1 --2- 172.21.15.71:0/3119133113 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f432806e390 0x7f4328136330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:42.962 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.911+0000 7f432e326700 1 -- 172.21.15.71:0/3119133113 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f432806e390 msgr2=0x7f4328136330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:42.962 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.911+0000 7f432e326700 1 --2- 172.21.15.71:0/3119133113 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f432806e390 0x7f4328136330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.962 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.911+0000 7f432e326700 1 -- 172.21.15.71:0/3119133113 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f432815d9f0 msgr2=0x7f4328146810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:42.962 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.911+0000 7f432e326700 1 --2- 172.21.15.71:0/3119133113 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f432815d9f0 0x7f4328146810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.962 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.911+0000 7f432e326700 1 -- 172.21.15.71:0/3119133113 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4324009420 con 0x7f432815ddc0 2023-10-06T01:40:42.962 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.911+0000 7f432e326700 1 --2- 172.21.15.71:0/3119133113 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f432815ddc0 0x7f432814d5b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f431800b460 tx=0x7f4318006f40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:42.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.911+0000 7f1848d65700 1 -- 172.21.15.71:0/4214767190 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f182c003bf0 msgr2=0x7f182c003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:42.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.911+0000 7f1848d65700 1 --2- 172.21.15.71:0/4214767190 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f182c003bf0 0x7f182c003fe0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f18340099c0 tx=0x7f1834009060 comp rx=0 tx=0).stop 2023-10-06T01:40:42.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.911+0000 7fe9727fc700 1 -- 172.21.15.71:0/2995379887 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe974004dc0 con 0x7fe97c0d06b0 2023-10-06T01:40:42.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.911+0000 7fe9727fc700 1 -- 172.21.15.71:0/2995379887 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe97400a8d0 con 0x7fe97c0d06b0 2023-10-06T01:40:42.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.911+0000 7fe9727fc700 1 -- 172.21.15.71:0/2995379887 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe97400ac90 con 0x7fe97c0d06b0 2023-10-06T01:40:42.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.912+0000 7fe984768700 1 -- 172.21.15.71:0/2995379887 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe97c154420 con 0x7fe97c0d06b0 2023-10-06T01:40:42.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.912+0000 7fe984768700 1 -- 172.21.15.71:0/2995379887 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe97c0afff0 con 0x7fe97c0d06b0 2023-10-06T01:40:42.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.912+0000 7f497ffff700 1 --2- 172.21.15.71:0/3400537438 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f49801576a0 0x7f4980150e30 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f497800c890 tx=0x7f4978001670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:42.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.912+0000 7fbb827fc700 1 -- 172.21.15.71:0/613191943 <== mon.1 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbb8c0551f0 con 0x7fbb941574b0 2023-10-06T01:40:42.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.910+0000 7f726cff9700 1 -- 172.21.15.71:0/2792921169 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7264005c00 con 0x7f727006bbb0 2023-10-06T01:40:42.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.911+0000 7f726cff9700 1 -- 172.21.15.71:0/2792921169 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7264005d60 con 0x7f727006bbb0 2023-10-06T01:40:42.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.911+0000 7f726cff9700 1 -- 172.21.15.71:0/2792921169 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72640070d0 con 0x7f727006bbb0 2023-10-06T01:40:42.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.911+0000 7f7276e32700 1 -- 172.21.15.71:0/2792921169 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72700afe70 con 0x7f727006bbb0 2023-10-06T01:40:42.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.911+0000 7f7276e32700 1 -- 172.21.15.71:0/2792921169 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72700b03f0 con 0x7f727006bbb0 2023-10-06T01:40:42.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.912+0000 7f7d1264b700 1 -- 172.21.15.71:0/2590689624 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cec0052b0 con 0x7f7d0c158da0 2023-10-06T01:40:42.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.913+0000 7f1848d65700 1 -- 172.21.15.71:0/4214767190 shutdown_connections 2023-10-06T01:40:42.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.913+0000 7f1848d65700 1 --2- 172.21.15.71:0/4214767190 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f182c003bf0 0x7f182c003fe0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.913+0000 7f1848d65700 1 -- 172.21.15.71:0/4214767190 >> 172.21.15.71:0/4214767190 conn(0x7f184406a220 msgr2=0x7f184406a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:42.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.913+0000 7f7cf3fff700 1 -- 172.21.15.71:0/2590689624 <== mon.1 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7d04009760 con 0x7f7d0c158da0 2023-10-06T01:40:42.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.913+0000 7fe984768700 1 -- 172.21.15.71:0/2995379887 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe97c0afbb0 con 0x7fe97c0d06b0 2023-10-06T01:40:42.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.913+0000 7f7cf3fff700 1 --2- 172.21.15.71:0/2590689624 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7cf8066f30 0x7f7cf80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.913+0000 7f7cf3fff700 1 -- 172.21.15.71:0/2590689624 <== mon.1 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f7d04084a20 con 0x7f7d0c158da0 2023-10-06T01:40:42.967 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.912+0000 7f7276e32700 1 -- 172.21.15.71:0/2792921169 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72500052b0 con 0x7f727006bbb0 2023-10-06T01:40:42.967 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.913+0000 7f726cff9700 1 -- 172.21.15.71:0/2792921169 <== mon.1 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7264017020 con 0x7f727006bbb0 2023-10-06T01:40:42.967 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.913+0000 7f726cff9700 1 --2- 172.21.15.71:0/2792921169 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7254066f30 0x7f72540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.967 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.913+0000 7f726cff9700 1 -- 172.21.15.71:0/2792921169 <== mon.1 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f72640834c0 con 0x7f727006bbb0 2023-10-06T01:40:42.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.914+0000 7fe9727fc700 1 -- 172.21.15.71:0/2995379887 <== mon.1 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe974007150 con 0x7fe97c0d06b0 2023-10-06T01:40:42.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.914+0000 7f2f1108b700 1 --2- 172.21.15.71:0/91155829 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f2ef0066f30 0x7f2ef00693e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2f08009260 tx=0x7f2f08015000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:42.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.914+0000 7f1848d65700 1 -- 172.21.15.71:0/4214767190 shutdown_connections 2023-10-06T01:40:42.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.914+0000 7f1848d65700 1 -- 172.21.15.71:0/4214767190 wait complete. 2023-10-06T01:40:42.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.914+0000 7f7274bce700 1 --2- 172.21.15.71:0/2792921169 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7254066f30 0x7f72540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:42.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.914+0000 7f7d0bfff700 1 --2- 172.21.15.71:0/2590689624 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7cf8066f30 0x7f7cf80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:42.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.914+0000 7fe9727fc700 1 --2- 172.21.15.71:0/2995379887 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fe960066f30 0x7fe9600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.914+0000 7f7d0bfff700 1 --2- 172.21.15.71:0/2590689624 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7cf8066f30 0x7f7cf80693e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c14cb70 tx=0x7f7cfc0091a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:42.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.914+0000 7f7274bce700 1 --2- 172.21.15.71:0/2792921169 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7254066f30 0x7f72540693e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f725c006dc0 tx=0x7f725c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:42.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.914+0000 7fe982504700 1 --2- 172.21.15.71:0/2995379887 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fe960066f30 0x7fe9600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:42.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.914+0000 7fe9727fc700 1 -- 172.21.15.71:0/2995379887 <== mon.1 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fe9740842b0 con 0x7fe97c0d06b0 2023-10-06T01:40:42.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.915+0000 7f431dffb700 1 -- 172.21.15.71:0/3119133113 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f431800be80 con 0x7f432815ddc0 2023-10-06T01:40:42.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.915+0000 7fe982504700 1 --2- 172.21.15.71:0/2995379887 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fe960066f30 0x7fe9600693e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe97c15dc40 tx=0x7fe96c006c60 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:42.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.915+0000 7f49777fe700 1 -- 172.21.15.71:0/3400537438 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4978012630 con 0x7f49801576a0 2023-10-06T01:40:42.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.915+0000 7f49777fe700 1 -- 172.21.15.71:0/3400537438 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4978012790 con 0x7f49801576a0 2023-10-06T01:40:42.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.915+0000 7f4985cd8700 1 -- 172.21.15.71:0/3400537438 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49800a4e30 con 0x7f49801576a0 2023-10-06T01:40:42.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.915+0000 7f431dffb700 1 -- 172.21.15.71:0/3119133113 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f431800f510 con 0x7f432815ddc0 2023-10-06T01:40:42.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.915+0000 7f432fd89700 1 -- 172.21.15.71:0/3119133113 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43281473d0 con 0x7f432815ddc0 2023-10-06T01:40:42.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.915+0000 7f431dffb700 1 -- 172.21.15.71:0/3119133113 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f431800f8b0 con 0x7f432815ddc0 2023-10-06T01:40:42.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.915+0000 7f49777fe700 1 -- 172.21.15.71:0/3400537438 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4978012b50 con 0x7f49801576a0 2023-10-06T01:40:42.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.915+0000 7f4985cd8700 1 -- 172.21.15.71:0/3400537438 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49800a53f0 con 0x7f49801576a0 2023-10-06T01:40:42.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.915+0000 7f432fd89700 1 -- 172.21.15.71:0/3119133113 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4328146d50 con 0x7f432815ddc0 2023-10-06T01:40:42.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.915+0000 7f1848d65700 1 Processor -- start 2023-10-06T01:40:42.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.915+0000 7f1848d65700 1 -- start start 2023-10-06T01:40:42.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.916+0000 7f2f017fa700 1 -- 172.21.15.71:0/91155829 <== mon.2 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2efc0515e0 con 0x7f2f0c0ceaa0 2023-10-06T01:40:42.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.916+0000 7f4985cd8700 1 -- 172.21.15.71:0/3400537438 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f498006fcb0 con 0x7f49801576a0 2023-10-06T01:40:42.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.916+0000 7f1848d65700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f182c003bf0 0x7f184415dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.916+0000 7f1848d65700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f184416ef80 0x7f184416ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.916+0000 7f1848d65700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1844170ac0 0x7f18440cca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.916+0000 7f1848d65700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f184416edf0 con 0x7f184416ef80 2023-10-06T01:40:42.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.916+0000 7f1848d65700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18440afde0 con 0x7f1844170ac0 2023-10-06T01:40:42.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.916+0000 7f1848d65700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f184416e2f0 con 0x7f182c003bf0 2023-10-06T01:40:42.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.916+0000 7f431dffb700 1 -- 172.21.15.71:0/3119133113 <== mon.2 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f431800fc60 con 0x7f432815ddc0 2023-10-06T01:40:42.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.917+0000 7f1842d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1844170ac0 0x7f18440cca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:42.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.917+0000 7f1842d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1844170ac0 0x7f18440cca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:56150/0 (socket says 172.21.15.71:56150) 2023-10-06T01:40:42.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.917+0000 7f1842d9d700 1 -- 172.21.15.71:0/617976160 learned_addr learned my addr 172.21.15.71:0/617976160 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:42.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.917+0000 7f1841d9b700 1 --2- 172.21.15.71:0/617976160 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f184416ef80 0x7f184416ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:42.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.917+0000 7f432fd89700 1 -- 172.21.15.71:0/3119133113 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43080052b0 con 0x7f432815ddc0 2023-10-06T01:40:42.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.917+0000 7f184259c700 1 --2- 172.21.15.71:0/617976160 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f182c003bf0 0x7f184415dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:42.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.917+0000 7f431dffb700 1 --2- 172.21.15.71:0/3119133113 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f430c066f30 0x7f430c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.917+0000 7f431dffb700 1 -- 172.21.15.71:0/3119133113 <== mon.2 v2:172.21.15.72:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f43180842d0 con 0x7f432815ddc0 2023-10-06T01:40:42.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.917+0000 7f432db25700 1 --2- 172.21.15.71:0/3119133113 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f430c066f30 0x7f430c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:42.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.917+0000 7f1842d9d700 1 -- 172.21.15.71:0/617976160 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f182c003bf0 msgr2=0x7f184415dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:42.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.917+0000 7f1842d9d700 1 --2- 172.21.15.71:0/617976160 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f182c003bf0 0x7f184415dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.917+0000 7f1842d9d700 1 -- 172.21.15.71:0/617976160 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f184416ef80 msgr2=0x7f184416ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:42.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.917+0000 7f1842d9d700 1 --2- 172.21.15.71:0/617976160 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f184416ef80 0x7f184416ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:42.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.917+0000 7f1842d9d700 1 -- 172.21.15.71:0/617976160 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f184416e550 con 0x7f1844170ac0 2023-10-06T01:40:42.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.917+0000 7f1841d9b700 1 --2- 172.21.15.71:0/617976160 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f184416ef80 0x7f184416ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:40:42.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.917+0000 7f1842d9d700 1 --2- 172.21.15.71:0/617976160 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1844170ac0 0x7f18440cca30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f183c000f80 tx=0x7f183c002190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:42.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.918+0000 7f432db25700 1 --2- 172.21.15.71:0/3119133113 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f430c066f30 0x7f430c0693e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4320005c50 tx=0x7f4320009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:42.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.918+0000 7f7cf3fff700 1 -- 172.21.15.71:0/2590689624 <== mon.1 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7d040517b0 con 0x7f7d0c158da0 2023-10-06T01:40:42.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.918+0000 7f49777fe700 1 -- 172.21.15.71:0/3400537438 <== mon.2 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4978024420 con 0x7f49801576a0 2023-10-06T01:40:42.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.919+0000 7f49777fe700 1 --2- 172.21.15.71:0/3400537438 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f4960066f30 0x7f49600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.919+0000 7f497f7fe700 1 --2- 172.21.15.71:0/3400537438 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f4960066f30 0x7f49600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:42.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.919+0000 7f49777fe700 1 -- 172.21.15.71:0/3400537438 <== mon.2 v2:172.21.15.72:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f4978085150 con 0x7f49801576a0 2023-10-06T01:40:42.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.919+0000 7f497f7fe700 1 --2- 172.21.15.71:0/3400537438 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f4960066f30 0x7f49600693e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4970006fd0 tx=0x7f4970008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:42.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.921+0000 7f49777fe700 1 -- 172.21.15.71:0/3400537438 <== mon.2 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4978051f70 con 0x7f49801576a0 2023-10-06T01:40:42.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.922+0000 7f726cff9700 1 -- 172.21.15.71:0/2792921169 <== mon.1 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f72640495a0 con 0x7f727006bbb0 2023-10-06T01:40:42.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.926+0000 7f431dffb700 1 -- 172.21.15.71:0/3119133113 <== mon.2 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4318051170 con 0x7f432815ddc0 2023-10-06T01:40:42.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.927+0000 7fe9727fc700 1 -- 172.21.15.71:0/2995379887 <== mon.1 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe97c0afbb0 con 0x7fe97c0d06b0 2023-10-06T01:40:42.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.926+0000 7f18327fc700 1 -- 172.21.15.71:0/617976160 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f183c007ac0 con 0x7f1844170ac0 2023-10-06T01:40:42.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.926+0000 7f18327fc700 1 -- 172.21.15.71:0/617976160 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f183c00ac50 con 0x7f1844170ac0 2023-10-06T01:40:42.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.926+0000 7f1848d65700 1 -- 172.21.15.71:0/617976160 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f184416e830 con 0x7f1844170ac0 2023-10-06T01:40:42.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.926+0000 7f1848d65700 1 -- 172.21.15.71:0/617976160 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1844170f10 con 0x7f1844170ac0 2023-10-06T01:40:42.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.928+0000 7f18327fc700 1 -- 172.21.15.71:0/617976160 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f183c0133f0 con 0x7f1844170ac0 2023-10-06T01:40:42.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.928+0000 7f18327fc700 1 -- 172.21.15.71:0/617976160 <== mon.1 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f183c013800 con 0x7f1844170ac0 2023-10-06T01:40:42.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.929+0000 7f18327fc700 1 --2- 172.21.15.71:0/617976160 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f1824066f30 0x7f18240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:42.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.929+0000 7f18327fc700 1 -- 172.21.15.71:0/617976160 <== mon.1 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f183c085000 con 0x7f1844170ac0 2023-10-06T01:40:42.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.934+0000 7f1848d65700 1 -- 172.21.15.71:0/617976160 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18280052b0 con 0x7f1844170ac0 2023-10-06T01:40:42.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.937+0000 7f184259c700 1 --2- 172.21.15.71:0/617976160 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f1824066f30 0x7f18240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:42.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.937+0000 7f184259c700 1 --2- 172.21.15.71:0/617976160 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f1824066f30 0x7f18240693e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1834009150 tx=0x7f1834015000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:42.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:42.939+0000 7f18327fc700 1 -- 172.21.15.71:0/617976160 <== mon.1 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f183c051ee0 con 0x7f1844170ac0 2023-10-06T01:40:43.294 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.292+0000 7f2f132ef700 1 -- 172.21.15.71:0/91155829 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2f0c0c4470 con 0x7f2f0c0ceaa0 2023-10-06T01:40:43.295 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.294+0000 7f7d1264b700 1 -- 172.21.15.71:0/2590689624 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f7cec005830 con 0x7f7d0c158da0 2023-10-06T01:40:43.296 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.295+0000 7f2f017fa700 1 -- 172.21.15.71:0/91155829 <== mon.2 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2efc054c00 con 0x7f2f0c0ceaa0 2023-10-06T01:40:43.297 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.295+0000 7f7cf3fff700 1 -- 172.21.15.71:0/2590689624 <== mon.1 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7d0400b490 con 0x7f7d0c158da0 2023-10-06T01:40:43.297 INFO:teuthology.orchestra.run.smithi071.stdout:55834574857 2023-10-06T01:40:43.305 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.304+0000 7f2f132ef700 1 -- 172.21.15.71:0/91155829 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f2ef0066f30 msgr2=0x7f2ef00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:43.305 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.304+0000 7f2f132ef700 1 --2- 172.21.15.71:0/91155829 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f2ef0066f30 0x7f2ef00693e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2f08009260 tx=0x7f2f08015000 comp rx=0 tx=0).stop 2023-10-06T01:40:43.305 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.304+0000 7f2f132ef700 1 -- 172.21.15.71:0/91155829 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2f0c0ceaa0 msgr2=0x7f2f0c1386d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:43.306 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.304+0000 7f2f132ef700 1 --2- 172.21.15.71:0/91155829 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2f0c0ceaa0 0x7f2f0c1386d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2efc00c880 tx=0x7f2efc008040 comp rx=0 tx=0).stop 2023-10-06T01:40:43.306 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.304+0000 7f2f132ef700 1 -- 172.21.15.71:0/91155829 shutdown_connections 2023-10-06T01:40:43.306 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.304+0000 7f2f132ef700 1 --2- 172.21.15.71:0/91155829 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f2ef0066f30 0x7f2ef00693e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:43.306 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.304+0000 7f2f132ef700 1 --2- 172.21.15.71:0/91155829 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f0c15db80 0x7f2f0c0c7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:43.306 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.304+0000 7f2f132ef700 1 --2- 172.21.15.71:0/91155829 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2f0c06aac0 0x7f2f0c13c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:43.306 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.304+0000 7f2f132ef700 1 --2- 172.21.15.71:0/91155829 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2f0c0ceaa0 0x7f2f0c1386d0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:43.307 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.304+0000 7f2f132ef700 1 -- 172.21.15.71:0/91155829 >> 172.21.15.71:0/91155829 conn(0x7f2f0c067910 msgr2=0x7f2f0c14d540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:43.307 INFO:teuthology.orchestra.run.smithi071.stdout:55834574857 2023-10-06T01:40:43.307 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.305+0000 7fbb98b67700 1 -- 172.21.15.71:0/613191943 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fbb78005830 con 0x7fbb941574b0 2023-10-06T01:40:43.308 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.305+0000 7fbb827fc700 1 -- 172.21.15.71:0/613191943 <== mon.1 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbb8c067030 con 0x7fbb941574b0 2023-10-06T01:40:43.309 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.306+0000 7f7276e32700 1 -- 172.21.15.71:0/2792921169 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7250005830 con 0x7f727006bbb0 2023-10-06T01:40:43.309 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.307+0000 7f726cff9700 1 -- 172.21.15.71:0/2792921169 <== mon.1 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f72640502e0 con 0x7f727006bbb0 2023-10-06T01:40:43.312 INFO:teuthology.orchestra.run.smithi071.stdout:55834574857 2023-10-06T01:40:43.312 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.308+0000 7f7d1264b700 1 -- 172.21.15.71:0/2590689624 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7cf8066f30 msgr2=0x7f7cf80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:43.312 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.308+0000 7f7d1264b700 1 --2- 172.21.15.71:0/2590689624 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7cf8066f30 0x7f7cf80693e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c14cb70 tx=0x7f7cfc0091a0 comp rx=0 tx=0).stop 2023-10-06T01:40:43.312 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.308+0000 7f7d1264b700 1 -- 172.21.15.71:0/2590689624 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d0c158da0 msgr2=0x7f7d0c14f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:43.312 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.308+0000 7f7d1264b700 1 --2- 172.21.15.71:0/2590689624 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d0c158da0 0x7f7d0c14f2b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7d0400bfc0 tx=0x7f7d0400d040 comp rx=0 tx=0).stop 2023-10-06T01:40:43.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.308+0000 7f7d1264b700 1 -- 172.21.15.71:0/2590689624 shutdown_connections 2023-10-06T01:40:43.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.308+0000 7f7d1264b700 1 --2- 172.21.15.71:0/2590689624 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7cf8066f30 0x7f7cf80693e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:43.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.308+0000 7f7d1264b700 1 --2- 172.21.15.71:0/2590689624 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d0c158da0 0x7f7d0c14f2b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:43.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.308+0000 7f7d1264b700 1 --2- 172.21.15.71:0/2590689624 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7d0c0c8900 0x7f7d0c1449a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:43.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.308+0000 7f7d1264b700 1 --2- 172.21.15.71:0/2590689624 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7d0c0c92b0 0x7f7d0c149100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:43.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.308+0000 7f7d1264b700 1 -- 172.21.15.71:0/2590689624 >> 172.21.15.71:0/2590689624 conn(0x7f7d0c069110 msgr2=0x7f7d0c06ea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:43.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.308+0000 7f7d1264b700 1 -- 172.21.15.71:0/2590689624 shutdown_connections 2023-10-06T01:40:43.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.308+0000 7f7d1264b700 1 -- 172.21.15.71:0/2590689624 wait complete. 2023-10-06T01:40:43.314 INFO:teuthology.orchestra.run.smithi071.stdout:55834574857 2023-10-06T01:40:43.314 INFO:teuthology.orchestra.run.smithi071.stdout:55834574857 2023-10-06T01:40:43.314 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.307+0000 7f4985cd8700 1 -- 172.21.15.71:0/3400537438 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f49800ae4d0 con 0x7f49801576a0 2023-10-06T01:40:43.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.307+0000 7f49777fe700 1 -- 172.21.15.71:0/3400537438 <== mon.2 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f49800ae4d0 con 0x7f49801576a0 2023-10-06T01:40:43.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.310+0000 7f4985cd8700 1 -- 172.21.15.71:0/3400537438 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f4960066f30 msgr2=0x7f49600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:43.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.310+0000 7f4985cd8700 1 --2- 172.21.15.71:0/3400537438 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f4960066f30 0x7f49600693e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4970006fd0 tx=0x7f4970008040 comp rx=0 tx=0).stop 2023-10-06T01:40:43.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.310+0000 7f4985cd8700 1 -- 172.21.15.71:0/3400537438 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f49801576a0 msgr2=0x7f4980150e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:43.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.310+0000 7f4985cd8700 1 --2- 172.21.15.71:0/3400537438 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f49801576a0 0x7f4980150e30 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f497800c890 tx=0x7f4978001670 comp rx=0 tx=0).stop 2023-10-06T01:40:43.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.310+0000 7f4985cd8700 1 -- 172.21.15.71:0/3400537438 shutdown_connections 2023-10-06T01:40:43.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.310+0000 7f4985cd8700 1 --2- 172.21.15.71:0/3400537438 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f49801576a0 0x7f4980150e30 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:43.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.310+0000 7f4985cd8700 1 --2- 172.21.15.71:0/3400537438 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f4960066f30 0x7f49600693e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:43.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.310+0000 7f4985cd8700 1 --2- 172.21.15.71:0/3400537438 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49800ae070 0x7f49800a6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:43.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.310+0000 7f4985cd8700 1 --2- 172.21.15.71:0/3400537438 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f49800af710 0x7f49800a44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:43.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.310+0000 7f4985cd8700 1 -- 172.21.15.71:0/3400537438 >> 172.21.15.71:0/3400537438 conn(0x7f4980069110 msgr2=0x7f4980155f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:43.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.310+0000 7f4985cd8700 1 -- 172.21.15.71:0/3400537438 shutdown_connections 2023-10-06T01:40:43.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.310+0000 7f4985cd8700 1 -- 172.21.15.71:0/3400537438 wait complete. 2023-10-06T01:40:43.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.307+0000 7f2f132ef700 1 -- 172.21.15.71:0/91155829 shutdown_connections 2023-10-06T01:40:43.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.307+0000 7f2f132ef700 1 -- 172.21.15.71:0/91155829 wait complete. 2023-10-06T01:40:43.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.310+0000 7f7276e32700 1 -- 172.21.15.71:0/2792921169 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7254066f30 msgr2=0x7f72540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:43.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.310+0000 7f7276e32700 1 --2- 172.21.15.71:0/2792921169 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7254066f30 0x7f72540693e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f725c006dc0 tx=0x7f725c008040 comp rx=0 tx=0).stop 2023-10-06T01:40:43.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.310+0000 7f7276e32700 1 -- 172.21.15.71:0/2792921169 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f727006bbb0 msgr2=0x7f72700ad160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:43.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.310+0000 7f7276e32700 1 --2- 172.21.15.71:0/2792921169 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f727006bbb0 0x7f72700ad160 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f726400c580 tx=0x7f7264007d50 comp rx=0 tx=0).stop 2023-10-06T01:40:43.318 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.310+0000 7fe984768700 1 -- 172.21.15.71:0/2995379887 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fe97c0afbb0 con 0x7fe97c0d06b0 2023-10-06T01:40:43.318 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.313+0000 7fbb98b67700 1 -- 172.21.15.71:0/613191943 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fbb74066f30 msgr2=0x7fbb740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:43.318 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.313+0000 7fbb98b67700 1 --2- 172.21.15.71:0/613191943 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fbb74066f30 0x7fbb740693e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fbb88003080 tx=0x7fbb88016000 comp rx=0 tx=0).stop 2023-10-06T01:40:43.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.313+0000 7fbb98b67700 1 -- 172.21.15.71:0/613191943 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb941574b0 msgr2=0x7fbb9415b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:43.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.313+0000 7fbb98b67700 1 --2- 172.21.15.71:0/613191943 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb941574b0 0x7fbb9415b500 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c00bad0 tx=0x7fbb8c009780 comp rx=0 tx=0).stop 2023-10-06T01:40:43.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.313+0000 7fe9727fc700 1 -- 172.21.15.71:0/2995379887 <== mon.1 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe97c0afbb0 con 0x7fe97c0d06b0 2023-10-06T01:40:43.319 INFO:teuthology.orchestra.run.smithi071.stdout:55834574857 2023-10-06T01:40:43.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.314+0000 7f1848d65700 1 -- 172.21.15.71:0/617976160 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f1828005830 con 0x7f1844170ac0 2023-10-06T01:40:43.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.315+0000 7f7276e32700 1 -- 172.21.15.71:0/2792921169 shutdown_connections 2023-10-06T01:40:43.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.315+0000 7f7276e32700 1 --2- 172.21.15.71:0/2792921169 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f727006d1c0 0x7f72700b0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:43.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.315+0000 7f7276e32700 1 --2- 172.21.15.71:0/2792921169 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f727006b7e0 0x7f72700b28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:43.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.315+0000 7f7276e32700 1 --2- 172.21.15.71:0/2792921169 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7254066f30 0x7f72540693e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:43.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.315+0000 7f7276e32700 1 --2- 172.21.15.71:0/2792921169 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f727006bbb0 0x7f72700ad160 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:43.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.315+0000 7f7276e32700 1 -- 172.21.15.71:0/2792921169 >> 172.21.15.71:0/2792921169 conn(0x7f727006a260 msgr2=0x7f72701563c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:43.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.315+0000 7f18327fc700 1 -- 172.21.15.71:0/617976160 <== mon.1 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f183c055500 con 0x7f1844170ac0 2023-10-06T01:40:43.321 INFO:teuthology.orchestra.run.smithi071.stdout:55834574857 2023-10-06T01:40:43.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.316+0000 7fbb98b67700 1 -- 172.21.15.71:0/613191943 shutdown_connections 2023-10-06T01:40:43.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.316+0000 7fbb98b67700 1 --2- 172.21.15.71:0/613191943 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fbb74066f30 0x7fbb740693e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:43.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.316+0000 7fbb98b67700 1 --2- 172.21.15.71:0/613191943 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb941574b0 0x7fbb9415b500 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:43.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.316+0000 7fbb98b67700 1 --2- 172.21.15.71:0/613191943 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbb940b13f0 0x7fbb94153d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:43.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.316+0000 7fbb98b67700 1 --2- 172.21.15.71:0/613191943 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbb940c46e0 0x7fbb9415afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:43.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.316+0000 7fbb98b67700 1 -- 172.21.15.71:0/613191943 >> 172.21.15.71:0/613191943 conn(0x7fbb94067910 msgr2=0x7fbb94154870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:43.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.316+0000 7fe984768700 1 -- 172.21.15.71:0/2995379887 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fe960066f30 msgr2=0x7fe9600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:43.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.316+0000 7fe984768700 1 --2- 172.21.15.71:0/2995379887 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fe960066f30 0x7fe9600693e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe97c15dc40 tx=0x7fe96c006c60 comp rx=0 tx=0).stop 2023-10-06T01:40:43.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.317+0000 7fe984768700 1 -- 172.21.15.71:0/2995379887 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe97c0d06b0 msgr2=0x7fe97c0b24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:43.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.317+0000 7fe984768700 1 --2- 172.21.15.71:0/2995379887 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe97c0d06b0 0x7fe97c0b24a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe974001560 tx=0x7fe974007e90 comp rx=0 tx=0).stop 2023-10-06T01:40:43.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.317+0000 7f432fd89700 1 -- 172.21.15.71:0/3119133113 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f4308005830 con 0x7f432815ddc0 2023-10-06T01:40:43.324 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.317+0000 7fe984768700 1 -- 172.21.15.71:0/2995379887 shutdown_connections 2023-10-06T01:40:43.324 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.317+0000 7fe984768700 1 --2- 172.21.15.71:0/2995379887 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe97c15b490 0x7fe97c15c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:43.324 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.317+0000 7fe984768700 1 --2- 172.21.15.71:0/2995379887 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe97c0d0260 0x7fe97c06f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:43.325 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.317+0000 7fe984768700 1 --2- 172.21.15.71:0/2995379887 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fe960066f30 0x7fe9600693e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:43.325 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.317+0000 7fe984768700 1 --2- 172.21.15.71:0/2995379887 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe97c0d06b0 0x7fe97c0b24a0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:43.325 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.317+0000 7fe984768700 1 -- 172.21.15.71:0/2995379887 >> 172.21.15.71:0/2995379887 conn(0x7fe97c06a220 msgr2=0x7fe97c160b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:43.325 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.317+0000 7fe984768700 1 -- 172.21.15.71:0/2995379887 shutdown_connections 2023-10-06T01:40:43.325 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.317+0000 7fe984768700 1 -- 172.21.15.71:0/2995379887 wait complete. 2023-10-06T01:40:43.325 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.317+0000 7f431dffb700 1 -- 172.21.15.71:0/3119133113 <== mon.2 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4318054790 con 0x7f432815ddc0 2023-10-06T01:40:43.325 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.318+0000 7fbb98b67700 1 -- 172.21.15.71:0/613191943 shutdown_connections 2023-10-06T01:40:43.326 INFO:teuthology.orchestra.run.smithi071.stdout:55834574857 2023-10-06T01:40:43.326 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.319+0000 7f1848d65700 1 -- 172.21.15.71:0/617976160 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f1824066f30 msgr2=0x7f18240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:43.326 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.319+0000 7f1848d65700 1 --2- 172.21.15.71:0/617976160 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f1824066f30 0x7f18240693e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1834009150 tx=0x7f1834015000 comp rx=0 tx=0).stop 2023-10-06T01:40:43.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.319+0000 7f1848d65700 1 -- 172.21.15.71:0/617976160 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1844170ac0 msgr2=0x7f18440cca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:43.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.319+0000 7f1848d65700 1 --2- 172.21.15.71:0/617976160 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1844170ac0 0x7f18440cca30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f183c000f80 tx=0x7f183c002190 comp rx=0 tx=0).stop 2023-10-06T01:40:43.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.319+0000 7f1848d65700 1 -- 172.21.15.71:0/617976160 shutdown_connections 2023-10-06T01:40:43.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.319+0000 7f1848d65700 1 --2- 172.21.15.71:0/617976160 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f1824066f30 0x7f18240693e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:43.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.319+0000 7f1848d65700 1 --2- 172.21.15.71:0/617976160 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1844170ac0 0x7f18440cca30 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:43.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.319+0000 7f1848d65700 1 --2- 172.21.15.71:0/617976160 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f182c003bf0 0x7f184415dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:43.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.319+0000 7f1848d65700 1 --2- 172.21.15.71:0/617976160 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f184416ef80 0x7f184416ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:43.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.319+0000 7f1848d65700 1 -- 172.21.15.71:0/617976160 >> 172.21.15.71:0/617976160 conn(0x7f184406a220 msgr2=0x7f18440b3d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:43.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.319+0000 7f1848d65700 1 -- 172.21.15.71:0/617976160 shutdown_connections 2023-10-06T01:40:43.328 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.319+0000 7f1848d65700 1 -- 172.21.15.71:0/617976160 wait complete. 2023-10-06T01:40:43.328 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.320+0000 7fbb98b67700 1 -- 172.21.15.71:0/613191943 wait complete. 2023-10-06T01:40:43.328 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.325+0000 7f7276e32700 1 -- 172.21.15.71:0/2792921169 shutdown_connections 2023-10-06T01:40:43.329 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.325+0000 7f432fd89700 1 -- 172.21.15.71:0/3119133113 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f430c066f30 msgr2=0x7f430c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:43.329 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.325+0000 7f432fd89700 1 --2- 172.21.15.71:0/3119133113 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f430c066f30 0x7f430c0693e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4320005c50 tx=0x7f4320009040 comp rx=0 tx=0).stop 2023-10-06T01:40:43.330 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.325+0000 7f432fd89700 1 -- 172.21.15.71:0/3119133113 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f432815ddc0 msgr2=0x7f432814d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:43.330 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.325+0000 7f432fd89700 1 --2- 172.21.15.71:0/3119133113 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f432815ddc0 0x7f432814d5b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f431800b460 tx=0x7f4318006f40 comp rx=0 tx=0).stop 2023-10-06T01:40:43.330 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.325+0000 7f432fd89700 1 -- 172.21.15.71:0/3119133113 shutdown_connections 2023-10-06T01:40:43.330 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.325+0000 7f432fd89700 1 --2- 172.21.15.71:0/3119133113 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f432815ddc0 0x7f432814d5b0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:43.330 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.325+0000 7f432fd89700 1 --2- 172.21.15.71:0/3119133113 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f430c066f30 0x7f430c0693e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:43.330 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.325+0000 7f432fd89700 1 --2- 172.21.15.71:0/3119133113 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f432806e390 0x7f4328136330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:43.331 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.325+0000 7f432fd89700 1 --2- 172.21.15.71:0/3119133113 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f432815d9f0 0x7f4328146810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:43.331 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.325+0000 7f432fd89700 1 -- 172.21.15.71:0/3119133113 >> 172.21.15.71:0/3119133113 conn(0x7f4328069110 msgr2=0x7f43280cb5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:43.331 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.326+0000 7f432fd89700 1 -- 172.21.15.71:0/3119133113 shutdown_connections 2023-10-06T01:40:43.331 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.326+0000 7f432fd89700 1 -- 172.21.15.71:0/3119133113 wait complete. 2023-10-06T01:40:43.332 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.7 2023-10-06T01:40:43.332 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:43.329+0000 7f7276e32700 1 -- 172.21.15.71:0/2792921169 wait complete. 2023-10-06T01:40:43.334 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.2 2023-10-06T01:40:43.340 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.0 2023-10-06T01:40:43.341 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.6 2023-10-06T01:40:43.343 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.5 2023-10-06T01:40:43.352 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.1 2023-10-06T01:40:43.354 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.3 2023-10-06T01:40:43.354 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.4 2023-10-06T01:40:44.333 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-06T01:40:44.336 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-06T01:40:44.341 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-06T01:40:44.341 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-06T01:40:44.344 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-06T01:40:44.353 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-06T01:40:44.355 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-06T01:40:44.355 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-06T01:40:44.518 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.513+0000 7f0d8762c700 1 Processor -- start 2023-10-06T01:40:44.518 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.514+0000 7f0d8762c700 1 -- start start 2023-10-06T01:40:44.519 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.515+0000 7f0d8762c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f0d800ad250 0x7f0d801715e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:44.519 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.515+0000 7f0d8762c700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d8006f2c0 con 0x7f0d801666e0 2023-10-06T01:40:44.519 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.515+0000 7f0d8762c700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d8006ed00 con 0x7f0d80166310 2023-10-06T01:40:44.519 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.515+0000 7f0d8762c700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d800af030 con 0x7f0d800ad250 2023-10-06T01:40:44.519 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.515+0000 7f0d84bc7700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f0d801666e0 0x7f0d800acb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:59508/0 (socket says 172.21.15.71:59508) 2023-10-06T01:40:44.519 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.515+0000 7f0d84bc7700 1 -- 172.21.15.71:0/48278592 learned_addr learned my addr 172.21.15.71:0/48278592 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:40:44.519 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.516+0000 7f0d77fff700 1 -- 172.21.15.71:0/48278592 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2273670786 0 0) 0x7f0d8006f2c0 con 0x7f0d801666e0 2023-10-06T01:40:44.519 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.516+0000 7f0d77fff700 1 -- 172.21.15.71:0/48278592 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d6c003570 con 0x7f0d801666e0 2023-10-06T01:40:44.519 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.516+0000 7f0d77fff700 1 -- 172.21.15.71:0/48278592 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 879988046 0 0) 0x7f0d6c003570 con 0x7f0d801666e0 2023-10-06T01:40:44.520 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.516+0000 7f0d77fff700 1 -- 172.21.15.71:0/48278592 >> v2:172.21.15.71:3300/0 conn(0x7f0d800ad250 msgr2=0x7f0d801715e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:44.520 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.516+0000 7f0d85bc9700 1 --2- 172.21.15.71:0/48278592 >> v2:172.21.15.71:3300/0 conn(0x7f0d800ad250 0x7f0d801715e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:44.520 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.517+0000 7f0d77fff700 1 --2- 172.21.15.71:0/48278592 >> v2:172.21.15.71:3300/0 conn(0x7f0d800ad250 0x7f0d801715e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:44.520 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.517+0000 7f0d77fff700 1 -- 172.21.15.71:0/48278592 >> v1:172.21.15.72:6789/0 conn(0x7f0d80166310 legacy=0x7f0d8006e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:44.520 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.517+0000 7f0d77fff700 1 -- 172.21.15.71:0/48278592 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d8006efe0 con 0x7f0d801666e0 2023-10-06T01:40:44.521 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.517+0000 7f0d77fff700 1 -- 172.21.15.71:0/48278592 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1184243524 0 0) 0x7f0d7c001470 con 0x7f0d801666e0 2023-10-06T01:40:44.521 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.517+0000 7f0d77fff700 1 -- 172.21.15.71:0/48278592 >> v1:172.21.15.71:6789/0 conn(0x7f0d801666e0 legacy=0x7f0d800acb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:44.521 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.517+0000 7f0d77fff700 1 --2- 172.21.15.71:0/48278592 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0d6c003ae0 0x7f0d6c003ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:44.521 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.517+0000 7f0d77fff700 1 --2- 172.21.15.71:0/48278592 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d6c004810 0x7f0d6c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:44.521 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.517+0000 7f0d77fff700 1 --2- 172.21.15.71:0/48278592 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d6c0053c0 0x7f0d6c00ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:44.521 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.517+0000 7f0d77fff700 1 -- 172.21.15.71:0/48278592 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d800af030 con 0x7f0d6c004810 2023-10-06T01:40:44.521 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.517+0000 7f0d77fff700 1 -- 172.21.15.71:0/48278592 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d6c00c2c0 con 0x7f0d6c0053c0 2023-10-06T01:40:44.521 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.517+0000 7f0d77fff700 1 -- 172.21.15.71:0/48278592 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d6c00c480 con 0x7f0d6c003ae0 2023-10-06T01:40:44.521 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.517+0000 7f0d85bc9700 1 --2- 172.21.15.71:0/48278592 >> v2:172.21.15.71:3300/0 conn(0x7f0d800ad250 0x7f0d801715e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:40:44.521 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.517+0000 7f0d84bc7700 1 --2- 172.21.15.71:0/48278592 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d6c004810 0x7f0d6c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:44.521 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.517+0000 7f0d853c8700 1 --2- 172.21.15.71:0/48278592 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0d6c003ae0 0x7f0d6c003ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:44.521 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.517+0000 7f0d85bc9700 1 --2- 172.21.15.71:0/48278592 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d6c0053c0 0x7f0d6c00ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:44.521 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.518+0000 7f0d84bc7700 1 -- 172.21.15.71:0/48278592 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0d6c003ae0 msgr2=0x7f0d6c003ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:44.522 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.518+0000 7f0d84bc7700 1 --2- 172.21.15.71:0/48278592 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0d6c003ae0 0x7f0d6c003ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:44.522 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.518+0000 7f0d84bc7700 1 -- 172.21.15.71:0/48278592 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d6c0053c0 msgr2=0x7f0d6c00ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:44.522 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.518+0000 7f0d84bc7700 1 --2- 172.21.15.71:0/48278592 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d6c0053c0 0x7f0d6c00ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:44.522 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.518+0000 7f0d84bc7700 1 -- 172.21.15.71:0/48278592 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d8006efe0 con 0x7f0d6c004810 2023-10-06T01:40:44.522 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.518+0000 7f0d85bc9700 1 -- 172.21.15.71:0/48278592 reap_dead start 2023-10-06T01:40:44.523 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.518+0000 7f0d84bc7700 1 --2- 172.21.15.71:0/48278592 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d6c004810 0x7f0d6c004c80 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c00c3e0 tx=0x7f0d7c001e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ca34894d559a649 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:44.523 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.518+0000 7f0d77fff700 1 -- 172.21.15.71:0/48278592 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d7c00ccb0 con 0x7f0d6c004810 2023-10-06T01:40:44.523 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.518+0000 7f0d77fff700 1 -- 172.21.15.71:0/48278592 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d7c00ce10 con 0x7f0d6c004810 2023-10-06T01:40:44.523 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.518+0000 7f0d77fff700 1 -- 172.21.15.71:0/48278592 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d7c005b70 con 0x7f0d6c004810 2023-10-06T01:40:44.523 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.519+0000 7f0d8762c700 1 -- 172.21.15.71:0/48278592 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d6c004810 msgr2=0x7f0d6c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:44.523 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.519+0000 7f0d8762c700 1 --2- 172.21.15.71:0/48278592 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d6c004810 0x7f0d6c004c80 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c00c3e0 tx=0x7f0d7c001e60 comp rx=0 tx=0).stop 2023-10-06T01:40:44.523 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.520+0000 7f0d8762c700 1 -- 172.21.15.71:0/48278592 shutdown_connections 2023-10-06T01:40:44.523 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.520+0000 7f0d8762c700 1 --2- 172.21.15.71:0/48278592 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d6c004810 0x7f0d6c004c80 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:44.524 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.520+0000 7f0d8762c700 1 -- 172.21.15.71:0/48278592 >> 172.21.15.71:0/48278592 conn(0x7f0d80069110 msgr2=0x7f0d800cbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:44.524 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.520+0000 7f0d8762c700 1 -- 172.21.15.71:0/48278592 shutdown_connections 2023-10-06T01:40:44.524 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.520+0000 7f0d8762c700 1 -- 172.21.15.71:0/48278592 wait complete. 2023-10-06T01:40:44.524 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.521+0000 7f0db36f8700 1 Processor -- start 2023-10-06T01:40:44.524 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.522+0000 7f0d8762c700 1 Processor -- start 2023-10-06T01:40:44.525 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.521+0000 7f0db36f8700 1 -- start start 2023-10-06T01:40:44.525 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.522+0000 7f0db36f8700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0dac159590 0x7f0dac159a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:44.525 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.522+0000 7f0db36f8700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f0dac159f40 0x7f0dac0b0550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:44.525 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.522+0000 7f0db36f8700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dac0b00c0 con 0x7f0dac158da0 2023-10-06T01:40:44.525 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.522+0000 7f0db36f8700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dac15a380 con 0x7f0dac159f40 2023-10-06T01:40:44.525 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.522+0000 7f0db36f8700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dac0af790 con 0x7f0dac159590 2023-10-06T01:40:44.525 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.523+0000 7f0db1494700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f0dac158da0 0x7f0dac06ec70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.71:40712/0 (socket says 172.21.15.71:40712) 2023-10-06T01:40:44.525 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.523+0000 7f0db1494700 1 -- 172.21.15.71:0/1696824861 learned_addr learned my addr 172.21.15.71:0/1696824861 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:40:44.526 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.522+0000 7f0d8762c700 1 -- start start 2023-10-06T01:40:44.526 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.523+0000 7f0d8762c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d6c004810 0x7f0d8015cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:44.526 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.523+0000 7f0d8762c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0d80167960 0x7f0d80176bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:44.526 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.523+0000 7f0d8762c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d80167dd0 0x7f0d80177110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:44.526 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.523+0000 7f0d8762c700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8015e0f0 con 0x7f0d80167dd0 2023-10-06T01:40:44.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.523+0000 7f0d8762c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d80168dc0 con 0x7f0d6c004810 2023-10-06T01:40:44.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.523+0000 7f0d8762c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d801690a0 con 0x7f0d80167960 2023-10-06T01:40:44.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.524+0000 7f0d853c8700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d6c004810 0x7f0d8015cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:44.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.524+0000 7f0d853c8700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d6c004810 0x7f0d8015cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:56164/0 (socket says 172.21.15.71:56164) 2023-10-06T01:40:44.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.524+0000 7f0d853c8700 1 -- 172.21.15.71:0/1185565408 learned_addr learned my addr 172.21.15.71:0/1185565408 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:44.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.524+0000 7f0db1c95700 1 --2- 172.21.15.71:0/1696824861 >> v2:172.21.15.71:3300/0 conn(0x7f0dac159f40 0x7f0dac0b0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:44.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.524+0000 7f0d85bc9700 1 --2- 172.21.15.71:0/1185565408 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d80167dd0 0x7f0d80177110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:44.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.524+0000 7f0db1c95700 1 -- 172.21.15.71:0/1696824861 >> v2:172.21.15.72:3300/0 conn(0x7f0dac159590 msgr2=0x7f0dac159a00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T01:40:44.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.524+0000 7f0db1c95700 1 --2- 172.21.15.71:0/1696824861 >> v2:172.21.15.72:3300/0 conn(0x7f0dac159590 0x7f0dac159a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:44.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.524+0000 7f0db1c95700 1 -- 172.21.15.71:0/1696824861 >> v1:172.21.15.72:6789/0 conn(0x7f0dac158da0 legacy=0x7f0dac06ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:44.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.524+0000 7f0db1c95700 1 -- 172.21.15.71:0/1696824861 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dac0afa70 con 0x7f0dac159f40 2023-10-06T01:40:44.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.524+0000 7f0d84bc7700 1 --2- 172.21.15.71:0/1185565408 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0d80167960 0x7f0d80176bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:44.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.525+0000 7f0db1c95700 1 --2- 172.21.15.71:0/1696824861 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0dac159f40 0x7f0dac0b0550 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0dac15a660 tx=0x7f0da400a890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54a142f67be2dc29 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:44.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.525+0000 7f0d85bc9700 1 -- 172.21.15.71:0/1185565408 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0d80167960 msgr2=0x7f0d80176bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:44.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.525+0000 7f0d85bc9700 1 --2- 172.21.15.71:0/1185565408 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0d80167960 0x7f0d80176bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:44.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.525+0000 7f0d85bc9700 1 -- 172.21.15.71:0/1185565408 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d6c004810 msgr2=0x7f0d8015cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:44.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.525+0000 7f0d85bc9700 1 --2- 172.21.15.71:0/1185565408 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d6c004810 0x7f0d8015cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:44.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.525+0000 7f0d85bc9700 1 -- 172.21.15.71:0/1185565408 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d80169380 con 0x7f0d80167dd0 2023-10-06T01:40:44.530 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.526+0000 7f0d85bc9700 1 --2- 172.21.15.71:0/1185565408 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d80167dd0 0x7f0d80177110 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0d80065f80 tx=0x7f0d78007da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:44.530 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.525+0000 7f0da3fff700 1 -- 172.21.15.71:0/1696824861 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da400a2e0 con 0x7f0dac159f40 2023-10-06T01:40:44.530 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.525+0000 7f0da3fff700 1 -- 172.21.15.71:0/1696824861 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0da400cad0 con 0x7f0dac159f40 2023-10-06T01:40:44.530 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.525+0000 7f0da3fff700 1 -- 172.21.15.71:0/1696824861 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da4008450 con 0x7f0dac159f40 2023-10-06T01:40:44.530 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.526+0000 7f0db36f8700 1 -- 172.21.15.71:0/1696824861 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0dac159f40 msgr2=0x7f0dac0b0550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:44.530 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.526+0000 7f0db36f8700 1 --2- 172.21.15.71:0/1696824861 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0dac159f40 0x7f0dac0b0550 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0dac15a660 tx=0x7f0da400a890 comp rx=0 tx=0).stop 2023-10-06T01:40:44.531 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.526+0000 7f0d757fa700 1 -- 172.21.15.71:0/1185565408 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d7802b070 con 0x7f0d80167dd0 2023-10-06T01:40:44.531 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.526+0000 7f0d757fa700 1 -- 172.21.15.71:0/1185565408 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d7801f8a0 con 0x7f0d80167dd0 2023-10-06T01:40:44.531 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.526+0000 7f0d757fa700 1 -- 172.21.15.71:0/1185565408 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d7801fc60 con 0x7f0d80167dd0 2023-10-06T01:40:44.531 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.526+0000 7f0d8762c700 1 -- 172.21.15.71:0/1185565408 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d80169660 con 0x7f0d80167dd0 2023-10-06T01:40:44.531 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.526+0000 7f0d8762c700 1 -- 172.21.15.71:0/1185565408 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d80168970 con 0x7f0d80167dd0 2023-10-06T01:40:44.531 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.529+0000 7f0d757fa700 1 -- 172.21.15.71:0/1185565408 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0d78025660 con 0x7f0d80167dd0 2023-10-06T01:40:44.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.529+0000 7f0db36f8700 1 -- 172.21.15.71:0/1696824861 shutdown_connections 2023-10-06T01:40:44.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.529+0000 7f0db36f8700 1 --2- 172.21.15.71:0/1696824861 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0dac159f40 0x7f0dac0b0550 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:44.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.529+0000 7f0db36f8700 1 --2- 172.21.15.71:0/1696824861 >> v2:172.21.15.72:3300/0 conn(0x7f0dac159590 0x7f0dac159a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:44.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.529+0000 7f0db36f8700 1 -- 172.21.15.71:0/1696824861 >> 172.21.15.71:0/1696824861 conn(0x7f0dac069110 msgr2=0x7f0dac0cbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:44.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.529+0000 7f0db36f8700 1 -- 172.21.15.71:0/1696824861 shutdown_connections 2023-10-06T01:40:44.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.529+0000 7f0d757fa700 1 --2- 172.21.15.71:0/1185565408 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f0d64067000 0x7f0d640694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:44.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.529+0000 7f0d757fa700 1 -- 172.21.15.71:0/1185565408 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f0d78095c90 con 0x7f0d80167dd0 2023-10-06T01:40:44.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.529+0000 7f0db36f8700 1 -- 172.21.15.71:0/1696824861 wait complete. 2023-10-06T01:40:44.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.531+0000 7f0db36f8700 1 Processor -- start 2023-10-06T01:40:44.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.531+0000 7f0db36f8700 1 -- start start 2023-10-06T01:40:44.534 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.533+0000 7f0db36f8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0dac158da0 0x7f0dac14d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:44.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.533+0000 7f0db36f8700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0dac159590 0x7f0dac148490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:44.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.533+0000 7f0db36f8700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0dac159f40 0x7f0dac1458a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:44.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.533+0000 7f0db36f8700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dac1489d0 con 0x7f0dac159590 2023-10-06T01:40:44.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.533+0000 7f0db36f8700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dac14e8c0 con 0x7f0dac159f40 2023-10-06T01:40:44.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.533+0000 7f0db36f8700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dac14d820 con 0x7f0dac158da0 2023-10-06T01:40:44.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.533+0000 7f0db0c93700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0dac159590 0x7f0dac148490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:44.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.533+0000 7f0db0c93700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0dac159590 0x7f0dac148490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47584/0 (socket says 172.21.15.71:47584) 2023-10-06T01:40:44.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.533+0000 7f0db0c93700 1 -- 172.21.15.71:0/3302038514 learned_addr learned my addr 172.21.15.71:0/3302038514 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:44.536 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.533+0000 7f0db0c93700 1 -- 172.21.15.71:0/3302038514 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0dac158da0 msgr2=0x7f0dac14d190 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T01:40:44.536 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.533+0000 7f0db0c93700 1 --2- 172.21.15.71:0/3302038514 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0dac158da0 0x7f0dac14d190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:44.536 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.534+0000 7f0db0c93700 1 -- 172.21.15.71:0/3302038514 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0dac159f40 msgr2=0x7f0dac1458a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:44.536 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.534+0000 7f0db0c93700 1 --2- 172.21.15.71:0/3302038514 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0dac159f40 0x7f0dac1458a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:44.536 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.534+0000 7f0db0c93700 1 -- 172.21.15.71:0/3302038514 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0da400ab30 con 0x7f0dac159590 2023-10-06T01:40:44.536 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.534+0000 7f0d853c8700 1 --2- 172.21.15.71:0/1185565408 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f0d64067000 0x7f0d640694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:44.537 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.534+0000 7f0db0c93700 1 --2- 172.21.15.71:0/3302038514 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0dac159590 0x7f0dac148490 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0da800b600 tx=0x7f0da80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:44.537 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.535+0000 7f0da17fa700 1 -- 172.21.15.71:0/3302038514 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da800f510 con 0x7f0dac159590 2023-10-06T01:40:44.537 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.535+0000 7f0da17fa700 1 -- 172.21.15.71:0/3302038514 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0da800f6b0 con 0x7f0dac159590 2023-10-06T01:40:44.537 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.535+0000 7f0da17fa700 1 -- 172.21.15.71:0/3302038514 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da800fa70 con 0x7f0dac159590 2023-10-06T01:40:44.537 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.536+0000 7f0db36f8700 1 -- 172.21.15.71:0/3302038514 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dac14db00 con 0x7f0dac159590 2023-10-06T01:40:44.538 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.536+0000 7f0d853c8700 1 --2- 172.21.15.71:0/1185565408 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f0d64067000 0x7f0d640694b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0d70003ad0 tx=0x7f0d70009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:44.538 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.536+0000 7f0db36f8700 1 -- 172.21.15.71:0/3302038514 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dac14e0c0 con 0x7f0dac159590 2023-10-06T01:40:44.538 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.537+0000 7f0db36f8700 1 -- 172.21.15.71:0/3302038514 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dac06fcb0 con 0x7f0dac159590 2023-10-06T01:40:44.539 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.537+0000 7f0d8762c700 1 -- 172.21.15.71:0/1185565408 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d600052b0 con 0x7f0d80167dd0 2023-10-06T01:40:44.539 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.538+0000 7f0da17fa700 1 -- 172.21.15.71:0/3302038514 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0da801a400 con 0x7f0dac159590 2023-10-06T01:40:44.540 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.539+0000 7f0da17fa700 1 --2- 172.21.15.71:0/3302038514 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f0d90067050 0x7f0d90069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:44.540 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.539+0000 7f0da17fa700 1 -- 172.21.15.71:0/3302038514 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f0da8084440 con 0x7f0dac159590 2023-10-06T01:40:44.541 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.539+0000 7f0db1494700 1 --2- 172.21.15.71:0/3302038514 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f0d90067050 0x7f0d90069500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:44.541 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.540+0000 7f0db1494700 1 --2- 172.21.15.71:0/3302038514 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f0d90067050 0x7f0d90069500 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0d9c00b690 tx=0x7f0d9c005ad0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:44.548 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.547+0000 7f0d757fa700 1 -- 172.21.15.71:0/1185565408 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0d78066520 con 0x7f0d80167dd0 2023-10-06T01:40:44.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.555+0000 7f0da17fa700 1 -- 172.21.15.71:0/3302038514 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0da80512c0 con 0x7f0dac159590 2023-10-06T01:40:44.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.572+0000 7f4c0eac8700 1 Processor -- start 2023-10-06T01:40:44.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.572+0000 7f4c0eac8700 1 -- start start 2023-10-06T01:40:44.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.573+0000 7f4c0eac8700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4c0815d600 0x7f4c080c82d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:44.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.573+0000 7f4c0eac8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4c080c8810 0x7f4c080ca1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:44.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.573+0000 7f4c0eac8700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4c0815d9d0 0x7f4c080ca710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:44.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.573+0000 7f4c0eac8700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c080677b0 con 0x7f4c0815d9d0 2023-10-06T01:40:44.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.573+0000 7f4c0eac8700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c080c7e40 con 0x7f4c0815d600 2023-10-06T01:40:44.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.573+0000 7f4c0eac8700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c080c7860 con 0x7f4c080c8810 2023-10-06T01:40:44.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.573+0000 7f4c0e2c7700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4c0815d9d0 0x7f4c080ca710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:44.576 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.574+0000 7f4c0e2c7700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4c0815d9d0 0x7f4c080ca710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47588/0 (socket says 172.21.15.71:47588) 2023-10-06T01:40:44.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.574+0000 7f4c0e2c7700 1 -- 172.21.15.71:0/3048347030 learned_addr learned my addr 172.21.15.71:0/3048347030 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:44.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.574+0000 7f4c0d2c5700 1 --2- 172.21.15.71:0/3048347030 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4c080c8810 0x7f4c080ca1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:44.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.574+0000 7f4c0dac6700 1 --2- 172.21.15.71:0/3048347030 >> v2:172.21.15.72:3300/0 conn(0x7f4c0815d600 0x7f4c080c82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:44.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.574+0000 7f4c0e2c7700 1 -- 172.21.15.71:0/3048347030 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4c080c8810 msgr2=0x7f4c080ca1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:44.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.574+0000 7f4c0e2c7700 1 --2- 172.21.15.71:0/3048347030 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4c080c8810 0x7f4c080ca1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:44.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.574+0000 7f4c0e2c7700 1 -- 172.21.15.71:0/3048347030 >> v2:172.21.15.72:3300/0 conn(0x7f4c0815d600 msgr2=0x7f4c080c82d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:44.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.574+0000 7f4c0e2c7700 1 --2- 172.21.15.71:0/3048347030 >> v2:172.21.15.72:3300/0 conn(0x7f4c0815d600 0x7f4c080c82d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:44.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.574+0000 7f4c0e2c7700 1 -- 172.21.15.71:0/3048347030 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c08161f30 con 0x7f4c0815d9d0 2023-10-06T01:40:44.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.574+0000 7f4c0e2c7700 1 --2- 172.21.15.71:0/3048347030 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c0815d9d0 0x7f4c080ca710 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4c08063e30 tx=0x7f4c00009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a6dfb386b59eb30 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:44.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.575+0000 7f4c0cac4700 1 -- 172.21.15.71:0/3048347030 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c0000e070 con 0x7f4c0815d9d0 2023-10-06T01:40:44.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.575+0000 7f4c0cac4700 1 -- 172.21.15.71:0/3048347030 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c0000ba50 con 0x7f4c0815d9d0 2023-10-06T01:40:44.578 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.575+0000 7f4c0cac4700 1 -- 172.21.15.71:0/3048347030 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c000092e0 con 0x7f4c0815d9d0 2023-10-06T01:40:44.578 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.575+0000 7f4c0d2c5700 1 --2- 172.21.15.71:0/3048347030 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4c080c8810 0x7f4c080ca1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:40:44.578 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.576+0000 7f4c0eac8700 1 -- 172.21.15.71:0/3048347030 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c0815d9d0 msgr2=0x7f4c080ca710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:44.578 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.576+0000 7f4c0eac8700 1 --2- 172.21.15.71:0/3048347030 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c0815d9d0 0x7f4c080ca710 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4c08063e30 tx=0x7f4c00009840 comp rx=0 tx=0).stop 2023-10-06T01:40:44.578 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.576+0000 7f4c0eac8700 1 -- 172.21.15.71:0/3048347030 shutdown_connections 2023-10-06T01:40:44.578 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.576+0000 7f4c0eac8700 1 --2- 172.21.15.71:0/3048347030 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c0815d9d0 0x7f4c080ca710 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:44.579 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.576+0000 7f4c0eac8700 1 --2- 172.21.15.71:0/3048347030 >> v2:172.21.15.72:3300/0 conn(0x7f4c0815d600 0x7f4c080c82d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:44.579 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.576+0000 7f4c0eac8700 1 --2- 172.21.15.71:0/3048347030 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4c080c8810 0x7f4c080ca1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:44.579 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.576+0000 7f4c0eac8700 1 -- 172.21.15.71:0/3048347030 >> 172.21.15.71:0/3048347030 conn(0x7f4c080c9070 msgr2=0x7f4c080c9470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:44.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.579+0000 7f4c0eac8700 1 -- 172.21.15.71:0/3048347030 shutdown_connections 2023-10-06T01:40:44.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.579+0000 7f4c0eac8700 1 -- 172.21.15.71:0/3048347030 wait complete. 2023-10-06T01:40:44.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.580+0000 7f7cee6df700 1 Processor -- start 2023-10-06T01:40:44.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.580+0000 7f7cee6df700 1 -- start start 2023-10-06T01:40:44.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.581+0000 7f4c0eac8700 1 Processor -- start 2023-10-06T01:40:44.583 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.581+0000 7f4c0eac8700 1 -- start start 2023-10-06T01:40:44.583 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.581+0000 7f4c0eac8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4c080c8810 0x7f4c0814f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:44.583 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.581+0000 7f4c0eac8700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c0815d9d0 0x7f4c08147370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:44.583 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.581+0000 7f4c0eac8700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c0814fac0 0x7f4c0814ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:44.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.581+0000 7f4c0eac8700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0814e5d0 con 0x7f4c0815d9d0 2023-10-06T01:40:44.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.581+0000 7f4c0eac8700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0814ee70 con 0x7f4c0814fac0 2023-10-06T01:40:44.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.581+0000 7f4c0eac8700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c081478b0 con 0x7f4c080c8810 2023-10-06T01:40:44.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.582+0000 7f4c0d2c5700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c0815d9d0 0x7f4c08147370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:44.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.582+0000 7f4c0d2c5700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c0815d9d0 0x7f4c08147370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47596/0 (socket says 172.21.15.71:47596) 2023-10-06T01:40:44.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.582+0000 7f4c0d2c5700 1 -- 172.21.15.71:0/3170083940 learned_addr learned my addr 172.21.15.71:0/3170083940 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:44.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.582+0000 7f7cee6df700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7ce8157d40 0x7f7ce8158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:44.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.582+0000 7f7cee6df700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ce80c8ad0 con 0x7f7ce8068680 2023-10-06T01:40:44.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.582+0000 7f7cee6df700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ce806b730 con 0x7f7ce806c210 2023-10-06T01:40:44.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.582+0000 7f7cee6df700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ce806ba10 con 0x7f7ce8157d40 2023-10-06T01:40:44.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.582+0000 7f4c0dac6700 1 --2- 172.21.15.71:0/3170083940 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4c080c8810 0x7f4c0814f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:44.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.582+0000 7f7ce7fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7ce8157d40 0x7f7ce8158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:44.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.582+0000 7f7ce7fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7ce8157d40 0x7f7ce8158110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:56206/0 (socket says 172.21.15.71:56206) 2023-10-06T01:40:44.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.582+0000 7f7ce7fff700 1 -- 172.21.15.71:0/3797399102 learned_addr learned my addr 172.21.15.71:0/3797399102 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:44.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.582+0000 7f4c0dac6700 1 -- 172.21.15.71:0/3170083940 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c0814fac0 msgr2=0x7f4c0814ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:44.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.582+0000 7f4c0dac6700 1 --2- 172.21.15.71:0/3170083940 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c0814fac0 0x7f4c0814ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:44.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.582+0000 7f4c0dac6700 1 -- 172.21.15.71:0/3170083940 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c0815d9d0 msgr2=0x7f4c08147370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:44.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.582+0000 7f4c0dac6700 1 --2- 172.21.15.71:0/3170083940 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c0815d9d0 0x7f4c08147370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:44.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.582+0000 7f4c0dac6700 1 -- 172.21.15.71:0/3170083940 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c00009ae0 con 0x7f4c080c8810 2023-10-06T01:40:44.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.583+0000 7f4c0dac6700 1 --2- 172.21.15.71:0/3170083940 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4c080c8810 0x7f4c0814f300 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4c0806e720 tx=0x7f4bf8008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:44.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.583+0000 7f7ce6ffd700 1 -- 172.21.15.71:0/3797399102 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3263576930 0 0) 0x7f7ce80c8ad0 con 0x7f7ce8068680 2023-10-06T01:40:44.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.583+0000 7f7ce7fff700 1 -- 172.21.15.71:0/3797399102 >> v1:172.21.15.72:6789/0 conn(0x7f7ce806c210 legacy=0x7f7ce80c8010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:44.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.583+0000 7f7ce7fff700 1 -- 172.21.15.71:0/3797399102 >> v1:172.21.15.71:6789/0 conn(0x7f7ce8068680 legacy=0x7f7ce806cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:44.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.583+0000 7f7ce7fff700 1 -- 172.21.15.71:0/3797399102 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ce806bcf0 con 0x7f7ce8157d40 2023-10-06T01:40:44.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.583+0000 7f4bfdffb700 1 -- 172.21.15.71:0/3170083940 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf80125f0 con 0x7f4c080c8810 2023-10-06T01:40:44.588 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.583+0000 7f4bfdffb700 1 -- 172.21.15.71:0/3170083940 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bf8012770 con 0x7f4c080c8810 2023-10-06T01:40:44.588 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.583+0000 7f4bfdffb700 1 -- 172.21.15.71:0/3170083940 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf8012b30 con 0x7f4c080c8810 2023-10-06T01:40:44.588 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.583+0000 7f4c0eac8700 1 -- 172.21.15.71:0/3170083940 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c08150520 con 0x7f4c080c8810 2023-10-06T01:40:44.588 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.583+0000 7f7ce7fff700 1 --2- 172.21.15.71:0/3797399102 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ce8157d40 0x7f7ce8158110 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7cdc0099b0 tx=0x7f7cdc009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f14560c8be989eb9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:44.588 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.583+0000 7f7ce6ffd700 1 -- 172.21.15.71:0/3797399102 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cdc00b820 con 0x7f7ce8157d40 2023-10-06T01:40:44.588 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.583+0000 7f7ce6ffd700 1 -- 172.21.15.71:0/3797399102 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cdc00b980 con 0x7f7ce8157d40 2023-10-06T01:40:44.589 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.583+0000 7f7ce6ffd700 1 -- 172.21.15.71:0/3797399102 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cdc00bd00 con 0x7f7ce8157d40 2023-10-06T01:40:44.589 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.584+0000 7f7cee6df700 1 -- 172.21.15.71:0/3797399102 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ce8157d40 msgr2=0x7f7ce8158110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:44.589 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.584+0000 7f7cee6df700 1 --2- 172.21.15.71:0/3797399102 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ce8157d40 0x7f7ce8158110 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7cdc0099b0 tx=0x7f7cdc009250 comp rx=0 tx=0).stop 2023-10-06T01:40:44.589 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.583+0000 7f4c0eac8700 1 -- 172.21.15.71:0/3170083940 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c0814eb00 con 0x7f4c080c8810 2023-10-06T01:40:44.589 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.584+0000 7f7cee6df700 1 -- 172.21.15.71:0/3797399102 shutdown_connections 2023-10-06T01:40:44.589 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.584+0000 7f7cee6df700 1 --2- 172.21.15.71:0/3797399102 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ce8157d40 0x7f7ce8158110 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:44.589 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.584+0000 7f7cee6df700 1 -- 172.21.15.71:0/3797399102 >> 172.21.15.71:0/3797399102 conn(0x7f7ce806a260 msgr2=0x7f7ce80cd030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:44.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.584+0000 7f27ab5c2700 1 Processor -- start 2023-10-06T01:40:44.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.585+0000 7f4c0eac8700 1 -- 172.21.15.71:0/3170083940 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c0814f150 con 0x7f4c080c8810 2023-10-06T01:40:44.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.585+0000 7f4bfdffb700 1 -- 172.21.15.71:0/3170083940 <== mon.2 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4bf8013480 con 0x7f4c080c8810 2023-10-06T01:40:44.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.585+0000 7f4bfdffb700 1 --2- 172.21.15.71:0/3170083940 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f4bec067080 0x7f4bec069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:44.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.585+0000 7f4bfdffb700 1 -- 172.21.15.71:0/3170083940 <== mon.2 v2:172.21.15.72:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f4bf8084cd0 con 0x7f4c080c8810 2023-10-06T01:40:44.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.586+0000 7f4c0d2c5700 1 --2- 172.21.15.71:0/3170083940 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f4bec067080 0x7f4bec069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:44.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.585+0000 7f27ab5c2700 1 -- start start 2023-10-06T01:40:44.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.586+0000 7f27ab5c2700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f27a406bbb0 0x7f27a41565f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:44.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.586+0000 7f27ab5c2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f27a4156b30 0x7f27a4156f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:44.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.586+0000 7f27ab5c2700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27a40c90d0 con 0x7f27a406b7e0 2023-10-06T01:40:44.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.586+0000 7f27ab5c2700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27a40c7c60 con 0x7f27a406bbb0 2023-10-06T01:40:44.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.586+0000 7f27ab5c2700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27a40c7980 con 0x7f27a4156b30 2023-10-06T01:40:44.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.586+0000 7f27a935e700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f27a406b7e0 0x7f27a40cac00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:59528/0 (socket says 172.21.15.71:59528) 2023-10-06T01:40:44.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.586+0000 7f27a935e700 1 -- 172.21.15.71:0/1785684311 learned_addr learned my addr 172.21.15.71:0/1785684311 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:40:44.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.586+0000 7f27a8b5d700 1 --2- 172.21.15.71:0/1785684311 >> v2:172.21.15.72:3300/0 conn(0x7f27a406bbb0 0x7f27a41565f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:44.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.587+0000 7f4c0d2c5700 1 --2- 172.21.15.71:0/3170083940 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f4bec067080 0x7f4bec069530 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4c0815d130 tx=0x7f4c04008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:44.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.587+0000 7f27a8b5d700 1 -- 172.21.15.71:0/1785684311 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f27a4156b30 msgr2=0x7f27a4156f90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T01:40:44.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.587+0000 7f27a8b5d700 1 --2- 172.21.15.71:0/1785684311 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f27a4156b30 0x7f27a4156f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:44.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.587+0000 7f27a8b5d700 1 -- 172.21.15.71:0/1785684311 >> v1:172.21.15.71:6789/0 conn(0x7f27a406b7e0 legacy=0x7f27a40cac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:44.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.587+0000 7f27a8b5d700 1 -- 172.21.15.71:0/1785684311 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27a40c9350 con 0x7f27a406bbb0 2023-10-06T01:40:44.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.587+0000 7f27a8b5d700 1 --2- 172.21.15.71:0/1785684311 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27a406bbb0 0x7f27a41565f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f279c009e60 tx=0x7f279c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d17770552b055eeb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:44.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.589+0000 7f279bfff700 1 -- 172.21.15.71:0/1785684311 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f279c00e070 con 0x7f27a406bbb0 2023-10-06T01:40:44.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.589+0000 7f279bfff700 1 -- 172.21.15.71:0/1785684311 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f279c00bb30 con 0x7f27a406bbb0 2023-10-06T01:40:44.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.589+0000 7f279bfff700 1 -- 172.21.15.71:0/1785684311 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f279c012430 con 0x7f27a406bbb0 2023-10-06T01:40:44.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.590+0000 7f4bfdffb700 1 -- 172.21.15.71:0/3170083940 <== mon.2 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4bf808a020 con 0x7f4c080c8810 2023-10-06T01:40:44.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.590+0000 7f27ab5c2700 1 -- 172.21.15.71:0/1785684311 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27a406bbb0 msgr2=0x7f27a41565f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:44.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.590+0000 7f27ab5c2700 1 --2- 172.21.15.71:0/1785684311 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27a406bbb0 0x7f27a41565f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f279c009e60 tx=0x7f279c009780 comp rx=0 tx=0).stop 2023-10-06T01:40:44.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.590+0000 7f27ab5c2700 1 -- 172.21.15.71:0/1785684311 shutdown_connections 2023-10-06T01:40:44.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.590+0000 7f27ab5c2700 1 --2- 172.21.15.71:0/1785684311 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f27a4156b30 0x7f27a4156f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:44.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.590+0000 7f27ab5c2700 1 --2- 172.21.15.71:0/1785684311 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27a406bbb0 0x7f27a41565f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:44.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.590+0000 7f27ab5c2700 1 -- 172.21.15.71:0/1785684311 >> 172.21.15.71:0/1785684311 conn(0x7f27a406a260 msgr2=0x7f27a40cd030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:44.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.590+0000 7f27ab5c2700 1 -- 172.21.15.71:0/1785684311 shutdown_connections 2023-10-06T01:40:44.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.590+0000 7f27ab5c2700 1 -- 172.21.15.71:0/1785684311 wait complete. 2023-10-06T01:40:44.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.592+0000 7f27ab5c2700 1 Processor -- start 2023-10-06T01:40:44.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.592+0000 7f27ab5c2700 1 -- start start 2023-10-06T01:40:44.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.594+0000 7f27ab5c2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f27a406b7e0 0x7f27a4148290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:44.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.594+0000 7f27ab5c2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27a406bbb0 0x7f27a40c32c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:44.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.594+0000 7f27ab5c2700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27a4156b30 0x7f27a40c3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:44.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.594+0000 7f27ab5c2700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27a40ac750 con 0x7f27a4156b30 2023-10-06T01:40:44.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.594+0000 7f27ab5c2700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27a40aca30 con 0x7f27a406bbb0 2023-10-06T01:40:44.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.594+0000 7f27ab5c2700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27a414ed50 con 0x7f27a406b7e0 2023-10-06T01:40:44.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.594+0000 7f27a8b5d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27a406bbb0 0x7f27a40c32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:44.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.594+0000 7f27a8b5d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27a406bbb0 0x7f27a40c32c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:56218/0 (socket says 172.21.15.71:56218) 2023-10-06T01:40:44.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.594+0000 7f27a8b5d700 1 -- 172.21.15.71:0/1852276937 learned_addr learned my addr 172.21.15.71:0/1852276937 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:44.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.594+0000 7f27a9b5f700 1 --2- 172.21.15.71:0/1852276937 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27a4156b30 0x7f27a40c3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:44.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.594+0000 7f27a9b5f700 1 -- 172.21.15.71:0/1852276937 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f27a406b7e0 msgr2=0x7f27a4148290 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T01:40:44.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.594+0000 7f27a9b5f700 1 --2- 172.21.15.71:0/1852276937 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f27a406b7e0 0x7f27a4148290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:44.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.594+0000 7f27a9b5f700 1 -- 172.21.15.71:0/1852276937 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27a406bbb0 msgr2=0x7f27a40c32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:44.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.594+0000 7f27a9b5f700 1 --2- 172.21.15.71:0/1852276937 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27a406bbb0 0x7f27a40c32c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:44.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.594+0000 7f27a9b5f700 1 -- 172.21.15.71:0/1852276937 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f279c009a20 con 0x7f27a4156b30 2023-10-06T01:40:44.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.595+0000 7f27a9b5f700 1 --2- 172.21.15.71:0/1852276937 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27a4156b30 0x7f27a40c3800 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f27a000b490 tx=0x7f27a0006f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:44.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.595+0000 7f27997fa700 1 -- 172.21.15.71:0/1852276937 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27a000f510 con 0x7f27a4156b30 2023-10-06T01:40:44.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.595+0000 7f27ab5c2700 1 -- 172.21.15.71:0/1852276937 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27a414f030 con 0x7f27a4156b30 2023-10-06T01:40:44.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.595+0000 7f27ab5c2700 1 -- 172.21.15.71:0/1852276937 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27a41487d0 con 0x7f27a4156b30 2023-10-06T01:40:44.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.596+0000 7f27997fa700 1 -- 172.21.15.71:0/1852276937 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27a000f690 con 0x7f27a4156b30 2023-10-06T01:40:44.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.596+0000 7f27997fa700 1 -- 172.21.15.71:0/1852276937 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27a000fa50 con 0x7f27a4156b30 2023-10-06T01:40:44.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.596+0000 7f27ab5c2700 1 -- 172.21.15.71:0/1852276937 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27a406e700 con 0x7f27a4156b30 2023-10-06T01:40:44.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.599+0000 7f27997fa700 1 -- 172.21.15.71:0/1852276937 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f27a0024430 con 0x7f27a4156b30 2023-10-06T01:40:44.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.600+0000 7f27997fa700 1 --2- 172.21.15.71:0/1852276937 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f2788066f30 0x7f27880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:44.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.600+0000 7f27997fa700 1 -- 172.21.15.71:0/1852276937 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f27a0084f30 con 0x7f27a4156b30 2023-10-06T01:40:44.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.592+0000 7f7cee6df700 1 -- 172.21.15.71:0/3797399102 shutdown_connections 2023-10-06T01:40:44.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.592+0000 7f7cee6df700 1 -- 172.21.15.71:0/3797399102 wait complete. 2023-10-06T01:40:44.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.594+0000 7f7cee6df700 1 Processor -- start 2023-10-06T01:40:44.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.594+0000 7f7cee6df700 1 -- start start 2023-10-06T01:40:44.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.595+0000 7f7cee6df700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ce8068680 0x7f7ce817a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:44.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.595+0000 7f7cee6df700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ce8157d40 0x7f7ce8152f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:44.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.595+0000 7f7cee6df700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7ce80ae280 0x7f7ce80ae700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:44.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.595+0000 7f7cee6df700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce8086e70 con 0x7f7ce80ae280 2023-10-06T01:40:44.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.595+0000 7f7cee6df700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce80aec40 con 0x7f7ce8068680 2023-10-06T01:40:44.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.595+0000 7f7cee6df700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce8152a90 con 0x7f7ce8157d40 2023-10-06T01:40:44.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.595+0000 7f7cecc7c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7ce80ae280 0x7f7ce80ae700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:44.604 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.595+0000 7f7cecc7c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7ce80ae280 0x7f7ce80ae700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47618/0 (socket says 172.21.15.71:47618) 2023-10-06T01:40:44.604 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.595+0000 7f7ce77fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ce8157d40 0x7f7ce8152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:44.604 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.595+0000 7f7cecc7c700 1 -- 172.21.15.71:0/4133900169 learned_addr learned my addr 172.21.15.71:0/4133900169 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:44.604 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.596+0000 7f7cecc7c700 1 -- 172.21.15.71:0/4133900169 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ce8157d40 msgr2=0x7f7ce8152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:44.604 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.596+0000 7f7cecc7c700 1 --2- 172.21.15.71:0/4133900169 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ce8157d40 0x7f7ce8152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:44.604 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.596+0000 7f7cecc7c700 1 -- 172.21.15.71:0/4133900169 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ce8068680 msgr2=0x7f7ce817a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:44.604 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.596+0000 7f7cecc7c700 1 --2- 172.21.15.71:0/4133900169 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ce8068680 0x7f7ce817a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:44.604 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.596+0000 7f7cecc7c700 1 -- 172.21.15.71:0/4133900169 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cdc0094f0 con 0x7f7ce80ae280 2023-10-06T01:40:44.604 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.596+0000 7f7cecc7c700 1 --2- 172.21.15.71:0/4133900169 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7ce80ae280 0x7f7ce80ae700 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7ce000cb90 tx=0x7f7ce0001770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:44.604 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.596+0000 7f7ccffff700 1 -- 172.21.15.71:0/4133900169 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce0003030 con 0x7f7ce80ae280 2023-10-06T01:40:44.604 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.596+0000 7f7ccffff700 1 -- 172.21.15.71:0/4133900169 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ce000a760 con 0x7f7ce80ae280 2023-10-06T01:40:44.604 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.596+0000 7f7cee6df700 1 -- 172.21.15.71:0/4133900169 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ce817ae50 con 0x7f7ce80ae280 2023-10-06T01:40:44.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.596+0000 7f7ccffff700 1 -- 172.21.15.71:0/4133900169 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce000ab20 con 0x7f7ce80ae280 2023-10-06T01:40:44.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.597+0000 7f7cee6df700 1 -- 172.21.15.71:0/4133900169 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ce81521e0 con 0x7f7ce80ae280 2023-10-06T01:40:44.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.598+0000 7f7ccffff700 1 -- 172.21.15.71:0/4133900169 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7ce0012420 con 0x7f7ce80ae280 2023-10-06T01:40:44.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.598+0000 7f7ccffff700 1 --2- 172.21.15.71:0/4133900169 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7cd00ab000 0x7f7cd00ad4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:44.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.598+0000 7f7cee6df700 1 -- 172.21.15.71:0/4133900169 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ce806e700 con 0x7f7ce80ae280 2023-10-06T01:40:44.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.601+0000 7f7ce7fff700 1 --2- 172.21.15.71:0/4133900169 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7cd00ab000 0x7f7cd00ad4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:44.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.601+0000 7f27a935e700 1 --2- 172.21.15.71:0/1852276937 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f2788066f30 0x7f27880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:44.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.601+0000 7f7ce7fff700 1 --2- 172.21.15.71:0/4133900169 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7cd00ab000 0x7f7cd00ad4b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7cdc0099b0 tx=0x7f7cdc016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:44.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.602+0000 7f27a935e700 1 --2- 172.21.15.71:0/1852276937 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f2788066f30 0x7f27880693e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f27940058d0 tx=0x7f2794007a30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:44.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.603+0000 7f27997fa700 1 -- 172.21.15.71:0/1852276937 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f27a0051db0 con 0x7f27a4156b30 2023-10-06T01:40:44.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.603+0000 7f7ccffff700 1 -- 172.21.15.71:0/4133900169 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f7ce0004070 con 0x7f7ce80ae280 2023-10-06T01:40:44.608 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.607+0000 7fef72f51700 1 Processor -- start 2023-10-06T01:40:44.608 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.607+0000 7fbfe2f15700 1 Processor -- start 2023-10-06T01:40:44.609 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.607+0000 7fef72f51700 1 -- start start 2023-10-06T01:40:44.609 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.608+0000 7f7ccffff700 1 -- 172.21.15.71:0/4133900169 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7ce0089060 con 0x7f7ce80ae280 2023-10-06T01:40:44.610 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.608+0000 7fef72f51700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef6c156350 0x7fef6c15ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:44.610 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.608+0000 7fef72f51700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fef6c156720 0x7fef6c0adb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:44.610 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.608+0000 7fef72f51700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fef6c0c7f20 0x7fef6c0ae090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:44.610 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.608+0000 7fef72f51700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef6c0b00e0 con 0x7fef6c156720 2023-10-06T01:40:44.610 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.608+0000 7fef72f51700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef6c0c87c0 con 0x7fef6c0c7f20 2023-10-06T01:40:44.610 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.608+0000 7fef72f51700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef6c0b0960 con 0x7fef6c156350 2023-10-06T01:40:44.610 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.608+0000 7fef6bfff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fef6c156720 0x7fef6c0adb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:44.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.608+0000 7fef6bfff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fef6c156720 0x7fef6c0adb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47640/0 (socket says 172.21.15.71:47640) 2023-10-06T01:40:44.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.608+0000 7fef6bfff700 1 -- 172.21.15.71:0/2967720825 learned_addr learned my addr 172.21.15.71:0/2967720825 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:44.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.608+0000 7fef70ced700 1 --2- 172.21.15.71:0/2967720825 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef6c156350 0x7fef6c15ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:44.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.609+0000 7fef70ced700 1 -- 172.21.15.71:0/2967720825 >> v2:172.21.15.72:3300/0 conn(0x7fef6c0c7f20 msgr2=0x7fef6c0ae090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:44.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.609+0000 7fef70ced700 1 --2- 172.21.15.71:0/2967720825 >> v2:172.21.15.72:3300/0 conn(0x7fef6c0c7f20 0x7fef6c0ae090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:44.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.609+0000 7fef70ced700 1 -- 172.21.15.71:0/2967720825 >> v2:172.21.15.71:3300/0 conn(0x7fef6c156720 msgr2=0x7fef6c0adb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:44.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.609+0000 7fef70ced700 1 --2- 172.21.15.71:0/2967720825 >> v2:172.21.15.71:3300/0 conn(0x7fef6c156720 0x7fef6c0adb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:44.612 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.609+0000 7fef70ced700 1 -- 172.21.15.71:0/2967720825 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef6c15b090 con 0x7fef6c156350 2023-10-06T01:40:44.612 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.609+0000 7fef70ced700 1 --2- 172.21.15.71:0/2967720825 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef6c156350 0x7fef6c15ab50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fef6c0c83c0 tx=0x7fef64009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f05e3783b1c34df server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:44.613 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.602+0000 7f3d5129f700 1 Processor -- start 2023-10-06T01:40:44.613 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.602+0000 7f3d5129f700 1 -- start start 2023-10-06T01:40:44.613 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.603+0000 7f3d5129f700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f3d4c1664c0 0x7f3d4c0aee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:44.613 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.603+0000 7f3d5129f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3d4c168870 0x7f3d4c16fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:44.613 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.603+0000 7f3d5129f700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d4c0b0690 con 0x7f3d4c0af3b0 2023-10-06T01:40:44.613 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.603+0000 7f3d5129f700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d4c0ae710 con 0x7f3d4c1664c0 2023-10-06T01:40:44.613 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.603+0000 7f3d5129f700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d4c0ad870 con 0x7f3d4c168870 2023-10-06T01:40:44.613 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.603+0000 7f3d4affd700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f3d4c1664c0 0x7f3d4c0aee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:44.613 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.603+0000 7f3d4affd700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f3d4c1664c0 0x7f3d4c0aee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47634/0 (socket says 172.21.15.71:47634) 2023-10-06T01:40:44.613 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.603+0000 7f3d4affd700 1 -- 172.21.15.71:0/1364582048 learned_addr learned my addr 172.21.15.71:0/1364582048 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:44.613 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.603+0000 7f3d4b7fe700 1 --2- 172.21.15.71:0/1364582048 >> v2:172.21.15.72:3300/0 conn(0x7f3d4c168870 0x7f3d4c16fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:44.614 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.604+0000 7f3d49ffb700 1 -- 172.21.15.71:0/1364582048 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2523744318 0 0) 0x7f3d4c0b0690 con 0x7f3d4c0af3b0 2023-10-06T01:40:44.614 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.611+0000 7f3d49ffb700 1 -- 172.21.15.71:0/1364582048 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d34003570 con 0x7f3d4c0af3b0 2023-10-06T01:40:44.614 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.611+0000 7f3d4affd700 1 -- 172.21.15.71:0/1364582048 >> v2:172.21.15.72:3300/0 conn(0x7f3d4c168870 msgr2=0x7f3d4c16fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:44.614 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.611+0000 7f3d4affd700 1 --2- 172.21.15.71:0/1364582048 >> v2:172.21.15.72:3300/0 conn(0x7f3d4c168870 0x7f3d4c16fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:44.614 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.611+0000 7f3d4affd700 1 -- 172.21.15.71:0/1364582048 >> v1:172.21.15.72:6789/0 conn(0x7f3d4c0af3b0 legacy=0x7f3d4c166890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:44.614 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.611+0000 7f3d4affd700 1 -- 172.21.15.71:0/1364582048 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d4c0af820 con 0x7f3d4c1664c0 2023-10-06T01:40:44.615 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.611+0000 7fef6b7fe700 1 -- 172.21.15.71:0/2967720825 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef6400e070 con 0x7fef6c156350 2023-10-06T01:40:44.615 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.611+0000 7fef6b7fe700 1 -- 172.21.15.71:0/2967720825 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef6400bb60 con 0x7fef6c156350 2023-10-06T01:40:44.615 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.611+0000 7fef6b7fe700 1 -- 172.21.15.71:0/2967720825 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef64012430 con 0x7fef6c156350 2023-10-06T01:40:44.615 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.612+0000 7fef72f51700 1 -- 172.21.15.71:0/2967720825 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef6c156350 msgr2=0x7fef6c15ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:44.615 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.612+0000 7fef72f51700 1 --2- 172.21.15.71:0/2967720825 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef6c156350 0x7fef6c15ab50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fef6c0c83c0 tx=0x7fef64009780 comp rx=0 tx=0).stop 2023-10-06T01:40:44.615 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.612+0000 7fef72f51700 1 -- 172.21.15.71:0/2967720825 shutdown_connections 2023-10-06T01:40:44.615 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.612+0000 7fef72f51700 1 --2- 172.21.15.71:0/2967720825 >> v2:172.21.15.72:3300/0 conn(0x7fef6c0c7f20 0x7fef6c0ae090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:44.615 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.612+0000 7fef72f51700 1 --2- 172.21.15.71:0/2967720825 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef6c156350 0x7fef6c15ab50 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:44.615 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.612+0000 7fef72f51700 1 --2- 172.21.15.71:0/2967720825 >> v2:172.21.15.71:3300/0 conn(0x7fef6c156720 0x7fef6c0adb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:44.615 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.612+0000 7fef72f51700 1 -- 172.21.15.71:0/2967720825 >> 172.21.15.71:0/2967720825 conn(0x7fef6c069110 msgr2=0x7fef6c0cbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:44.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.611+0000 7f3d4affd700 1 --2- 172.21.15.71:0/1364582048 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3d4c1664c0 0x7f3d4c0aee70 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c06e140 tx=0x7f3d3c009b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9edbedd07646de43 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:44.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.612+0000 7f3d49ffb700 1 -- 172.21.15.71:0/1364582048 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d3c00e070 con 0x7f3d4c1664c0 2023-10-06T01:40:44.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.612+0000 7f3d49ffb700 1 -- 172.21.15.71:0/1364582048 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d3c007ac0 con 0x7f3d4c1664c0 2023-10-06T01:40:44.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.612+0000 7f3d49ffb700 1 -- 172.21.15.71:0/1364582048 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d3c007e60 con 0x7f3d4c1664c0 2023-10-06T01:40:44.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.612+0000 7fef72f51700 1 -- 172.21.15.71:0/2967720825 shutdown_connections 2023-10-06T01:40:44.616 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.613+0000 7f3d5129f700 1 -- 172.21.15.71:0/1364582048 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3d4c1664c0 msgr2=0x7f3d4c0aee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:44.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.613+0000 7f3d5129f700 1 --2- 172.21.15.71:0/1364582048 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3d4c1664c0 0x7f3d4c0aee70 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c06e140 tx=0x7f3d3c009b70 comp rx=0 tx=0).stop 2023-10-06T01:40:44.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.612+0000 7fef72f51700 1 -- 172.21.15.71:0/2967720825 wait complete. 2023-10-06T01:40:44.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.612+0000 7fbfe2f15700 1 -- start start 2023-10-06T01:40:44.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.614+0000 7fbfe2f15700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbfdc06c920 0x7fbfdc0688b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:44.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.614+0000 7fbfe2f15700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfdc0ca680 con 0x7fbfdc155600 2023-10-06T01:40:44.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.614+0000 7fbfe2f15700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfdc0ca350 con 0x7fbfdc1559d0 2023-10-06T01:40:44.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.614+0000 7fbfe2f15700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfdc069620 con 0x7fbfdc06c920 2023-10-06T01:40:44.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.614+0000 7fef72f51700 1 Processor -- start 2023-10-06T01:40:44.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.614+0000 7fbfe0cb1700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fbfdc155600 0x7fbfdc06c210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:59538/0 (socket says 172.21.15.71:59538) 2023-10-06T01:40:44.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.614+0000 7fbfe0cb1700 1 -- 172.21.15.71:0/209568929 learned_addr learned my addr 172.21.15.71:0/209568929 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:40:44.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.614+0000 7f3d5129f700 1 -- 172.21.15.71:0/1364582048 shutdown_connections 2023-10-06T01:40:44.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.614+0000 7f3d5129f700 1 --2- 172.21.15.71:0/1364582048 >> v2:172.21.15.72:3300/0 conn(0x7f3d4c168870 0x7f3d4c16fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:44.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.614+0000 7f3d5129f700 1 --2- 172.21.15.71:0/1364582048 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3d4c1664c0 0x7f3d4c0aee70 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:44.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.614+0000 7f3d5129f700 1 -- 172.21.15.71:0/1364582048 >> 172.21.15.71:0/1364582048 conn(0x7f3d4c0cbda0 msgr2=0x7f3d4c0cc1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:44.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.615+0000 7f3d5129f700 1 -- 172.21.15.71:0/1364582048 shutdown_connections 2023-10-06T01:40:44.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.614+0000 7fef72f51700 1 -- start start 2023-10-06T01:40:44.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.615+0000 7fef72f51700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef6c0c7f20 0x7fef6c0cc250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:44.620 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.615+0000 7fef72f51700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef6c156350 0x7fef6c1598b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:44.620 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.615+0000 7fef72f51700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef6c156720 0x7fef6c175ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:44.620 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.615+0000 7fef72f51700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef6c156b70 con 0x7fef6c156350 2023-10-06T01:40:44.620 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.615+0000 7fef72f51700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef6c159df0 con 0x7fef6c0c7f20 2023-10-06T01:40:44.620 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.615+0000 7fef72f51700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef6c0cc840 con 0x7fef6c156720 2023-10-06T01:40:44.620 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.615+0000 7f3d5129f700 1 -- 172.21.15.71:0/1364582048 wait complete. 2023-10-06T01:40:44.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.615+0000 7fef6bfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef6c156350 0x7fef6c1598b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:44.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.615+0000 7fef6bfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef6c156350 0x7fef6c1598b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47650/0 (socket says 172.21.15.71:47650) 2023-10-06T01:40:44.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.615+0000 7fef6bfff700 1 -- 172.21.15.71:0/2392709634 learned_addr learned my addr 172.21.15.71:0/2392709634 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:44.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.615+0000 7fef6bfff700 1 -- 172.21.15.71:0/2392709634 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef6c156720 msgr2=0x7fef6c175ee0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T01:40:44.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.615+0000 7fef6bfff700 1 --2- 172.21.15.71:0/2392709634 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef6c156720 0x7fef6c175ee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:44.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.615+0000 7fef6bfff700 1 -- 172.21.15.71:0/2392709634 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef6c0c7f20 msgr2=0x7fef6c0cc250 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T01:40:44.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.615+0000 7fef6bfff700 1 --2- 172.21.15.71:0/2392709634 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef6c0c7f20 0x7fef6c0cc250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:44.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.615+0000 7fef6bfff700 1 -- 172.21.15.71:0/2392709634 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef64009a20 con 0x7fef6c156350 2023-10-06T01:40:44.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.616+0000 7fef6bfff700 1 --2- 172.21.15.71:0/2392709634 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef6c156350 0x7fef6c1598b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fef5c00ebb0 tx=0x7fef5c00b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:44.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.617+0000 7f3d5129f700 1 Processor -- start 2023-10-06T01:40:44.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.617+0000 7f3d5129f700 1 -- start start 2023-10-06T01:40:44.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.617+0000 7f3d5129f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d4c0af3b0 0x7f3d4c086330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:44.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.617+0000 7f3d5129f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3d4c1664c0 0x7f3d4c0ab410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:44.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.617+0000 7f3d5129f700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3d4c168870 0x7f3d4c0ab950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:44.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.617+0000 7f3d5129f700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4c086870 con 0x7f3d4c168870 2023-10-06T01:40:44.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.617+0000 7f3d5129f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4c16f7d0 con 0x7f3d4c0af3b0 2023-10-06T01:40:44.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.617+0000 7f3d5129f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4c0a92a0 con 0x7f3d4c1664c0 2023-10-06T01:40:44.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.618+0000 7fbfdb7fe700 1 -- 172.21.15.71:0/209568929 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4106261691 0 0) 0x7fbfdc0ca680 con 0x7fbfdc155600 2023-10-06T01:40:44.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.618+0000 7fbfdb7fe700 1 -- 172.21.15.71:0/209568929 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbfc4003570 con 0x7fbfdc155600 2023-10-06T01:40:44.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.618+0000 7fbfdbfff700 1 --2- 172.21.15.71:0/209568929 >> v2:172.21.15.72:3300/0 conn(0x7fbfdc06c920 0x7fbfdc0688b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:44.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.618+0000 7fbfdb7fe700 1 -- 172.21.15.71:0/209568929 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1201328423 0 0) 0x7fbfc4003570 con 0x7fbfdc155600 2023-10-06T01:40:44.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.618+0000 7fbfdb7fe700 1 -- 172.21.15.71:0/209568929 >> v2:172.21.15.72:3300/0 conn(0x7fbfdc06c920 msgr2=0x7fbfdc0688b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:44.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.618+0000 7fbfdb7fe700 1 --2- 172.21.15.71:0/209568929 >> v2:172.21.15.72:3300/0 conn(0x7fbfdc06c920 0x7fbfdc0688b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:44.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.618+0000 7fbfdb7fe700 1 -- 172.21.15.71:0/209568929 >> v1:172.21.15.72:6789/0 conn(0x7fbfdc1559d0 legacy=0x7fbfdc068df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:44.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.618+0000 7fbfdb7fe700 1 -- 172.21.15.71:0/209568929 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfdc069900 con 0x7fbfdc155600 2023-10-06T01:40:44.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.618+0000 7fbfdb7fe700 1 -- 172.21.15.71:0/209568929 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1184243524 0 0) 0x7fbfd40017f0 con 0x7fbfdc155600 2023-10-06T01:40:44.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.618+0000 7fbfdb7fe700 1 -- 172.21.15.71:0/209568929 >> v1:172.21.15.71:6789/0 conn(0x7fbfdc155600 legacy=0x7fbfdc06c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:44.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.618+0000 7fbfdb7fe700 1 --2- 172.21.15.71:0/209568929 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbfc4003a60 0x7fbfc4003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:44.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.618+0000 7fbfdb7fe700 1 --2- 172.21.15.71:0/209568929 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfc4004810 0x7fbfc4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:44.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.618+0000 7fbfdb7fe700 1 --2- 172.21.15.71:0/209568929 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbfc4005210 0x7fbfc400fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:44.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.618+0000 7fbfdb7fe700 1 -- 172.21.15.71:0/209568929 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfdc069620 con 0x7fbfc4003a60 2023-10-06T01:40:44.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.618+0000 7fbfdb7fe700 1 -- 172.21.15.71:0/209568929 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc4010510 con 0x7fbfc4004810 2023-10-06T01:40:44.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.618+0000 7fbfdb7fe700 1 -- 172.21.15.71:0/209568929 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc4007ac0 con 0x7fbfc4005210 2023-10-06T01:40:44.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.618+0000 7fbfdbfff700 1 --2- 172.21.15.71:0/209568929 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfc4004810 0x7fbfc4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:44.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.618+0000 7fbfe0cb1700 1 --2- 172.21.15.71:0/209568929 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbfc4003a60 0x7fbfc4003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:44.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.619+0000 7fbfdbfff700 1 -- 172.21.15.71:0/209568929 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbfc4005210 msgr2=0x7fbfc400fe70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T01:40:44.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.619+0000 7fbfdbfff700 1 --2- 172.21.15.71:0/209568929 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbfc4005210 0x7fbfc400fe70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:44.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.619+0000 7fbfdbfff700 1 -- 172.21.15.71:0/209568929 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbfc4003a60 msgr2=0x7fbfc4003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:44.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.619+0000 7fbfdbfff700 1 --2- 172.21.15.71:0/209568929 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbfc4003a60 0x7fbfc4003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:44.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.619+0000 7fbfdbfff700 1 -- 172.21.15.71:0/209568929 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfc4003570 con 0x7fbfc4004810 2023-10-06T01:40:44.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.619+0000 7fbfdbfff700 1 --2- 172.21.15.71:0/209568929 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfc4004810 0x7fbfc4004c80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbfd000bd80 tx=0x7fbfd000f040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e88ac3d43a7b070 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:44.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.619+0000 7fbfdb7fe700 1 -- 172.21.15.71:0/209568929 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd000b770 con 0x7fbfc4004810 2023-10-06T01:40:44.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.619+0000 7fbfdb7fe700 1 -- 172.21.15.71:0/209568929 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfd000db40 con 0x7fbfc4004810 2023-10-06T01:40:44.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.619+0000 7fbfdb7fe700 1 -- 172.21.15.71:0/209568929 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd0016460 con 0x7fbfc4004810 2023-10-06T01:40:44.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.620+0000 7fbfe2f15700 1 -- 172.21.15.71:0/209568929 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfc4004810 msgr2=0x7fbfc4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:44.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.620+0000 7fbfe2f15700 1 --2- 172.21.15.71:0/209568929 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfc4004810 0x7fbfc4004c80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbfd000bd80 tx=0x7fbfd000f040 comp rx=0 tx=0).stop 2023-10-06T01:40:44.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.621+0000 7f3d4b7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3d4c168870 0x7f3d4c0ab950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:44.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.621+0000 7f3d4b7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3d4c168870 0x7f3d4c0ab950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47654/0 (socket says 172.21.15.71:47654) 2023-10-06T01:40:44.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.621+0000 7f3d4b7fe700 1 -- 172.21.15.71:0/2615053352 learned_addr learned my addr 172.21.15.71:0/2615053352 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:44.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.621+0000 7f3d4b7fe700 1 -- 172.21.15.71:0/2615053352 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3d4c1664c0 msgr2=0x7f3d4c0ab410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:44.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.621+0000 7f3d4b7fe700 1 --2- 172.21.15.71:0/2615053352 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3d4c1664c0 0x7f3d4c0ab410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:44.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.621+0000 7f3d4b7fe700 1 -- 172.21.15.71:0/2615053352 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d4c0af3b0 msgr2=0x7f3d4c086330 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T01:40:44.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.621+0000 7f3d4b7fe700 1 --2- 172.21.15.71:0/2615053352 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d4c0af3b0 0x7f3d4c086330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:44.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.621+0000 7f3d4b7fe700 1 -- 172.21.15.71:0/2615053352 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d3c009e10 con 0x7f3d4c168870 2023-10-06T01:40:44.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.621+0000 7f3d4b7fe700 1 --2- 172.21.15.71:0/2615053352 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3d4c168870 0x7f3d4c0ab950 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3d4400cd80 tx=0x7f3d44006160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:44.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.621+0000 7f3d32ffd700 1 -- 172.21.15.71:0/2615053352 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d44011040 con 0x7f3d4c168870 2023-10-06T01:40:44.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.621+0000 7f3d32ffd700 1 -- 172.21.15.71:0/2615053352 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d44007cd0 con 0x7f3d4c168870 2023-10-06T01:40:44.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.621+0000 7f3d32ffd700 1 -- 172.21.15.71:0/2615053352 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d44016670 con 0x7f3d4c168870 2023-10-06T01:40:44.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.622+0000 7f3d5129f700 1 -- 172.21.15.71:0/2615053352 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d4c0a8970 con 0x7f3d4c168870 2023-10-06T01:40:44.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.622+0000 7f3d5129f700 1 -- 172.21.15.71:0/2615053352 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d4c0a8f30 con 0x7f3d4c168870 2023-10-06T01:40:44.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.623+0000 7f3d5129f700 1 -- 172.21.15.71:0/2615053352 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d4c06d3f0 con 0x7f3d4c168870 2023-10-06T01:40:44.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.623+0000 7f3d32ffd700 1 -- 172.21.15.71:0/2615053352 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3d440153e0 con 0x7f3d4c168870 2023-10-06T01:40:44.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.624+0000 7f3d32ffd700 1 --2- 172.21.15.71:0/2615053352 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f3d38066f30 0x7f3d380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:44.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.624+0000 7f3d32ffd700 1 -- 172.21.15.71:0/2615053352 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f3d44084d80 con 0x7f3d4c168870 2023-10-06T01:40:44.630 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.625+0000 7fef68ff9700 1 -- 172.21.15.71:0/2392709634 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef5c00db70 con 0x7fef6c156350 2023-10-06T01:40:44.630 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.625+0000 7fef72f51700 1 -- 172.21.15.71:0/2392709634 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef6c0ccb20 con 0x7fef6c156350 2023-10-06T01:40:44.630 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.625+0000 7fef72f51700 1 -- 172.21.15.71:0/2392709634 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef6c1570a0 con 0x7fef6c156350 2023-10-06T01:40:44.630 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.627+0000 7fbfe14b2700 1 -- 172.21.15.71:0/209568929 reap_dead start 2023-10-06T01:40:44.630 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.627+0000 7fbfe2f15700 1 -- 172.21.15.71:0/209568929 shutdown_connections 2023-10-06T01:40:44.630 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.627+0000 7fbfe2f15700 1 -- 172.21.15.71:0/209568929 >> 172.21.15.71:0/209568929 conn(0x7fbfdc0c9cc0 msgr2=0x7fbfdc06acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:44.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.627+0000 7fbfe2f15700 1 -- 172.21.15.71:0/209568929 shutdown_connections 2023-10-06T01:40:44.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.628+0000 7f3d4affd700 1 --2- 172.21.15.71:0/2615053352 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f3d38066f30 0x7f3d380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:44.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.625+0000 7fef68ff9700 1 -- 172.21.15.71:0/2392709634 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef5c00dcd0 con 0x7fef6c156350 2023-10-06T01:40:44.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.629+0000 7fef68ff9700 1 -- 172.21.15.71:0/2392709634 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef5c010670 con 0x7fef6c156350 2023-10-06T01:40:44.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.630+0000 7f3d32ffd700 1 -- 172.21.15.71:0/2615053352 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3d44051ba0 con 0x7f3d4c168870 2023-10-06T01:40:44.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.630+0000 7f3d4affd700 1 --2- 172.21.15.71:0/2615053352 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f3d38066f30 0x7f3d380693e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c06e140 tx=0x7f3d3c018000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:44.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.630+0000 7fef68ff9700 1 -- 172.21.15.71:0/2392709634 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fef5c010a20 con 0x7fef6c156350 2023-10-06T01:40:44.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.631+0000 7fef68ff9700 1 --2- 172.21.15.71:0/2392709634 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fef58067000 0x7fef580694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:44.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.631+0000 7fef68ff9700 1 -- 172.21.15.71:0/2392709634 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fef5c084f90 con 0x7fef6c156350 2023-10-06T01:40:44.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.634+0000 7fef72f51700 1 -- 172.21.15.71:0/2392709634 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef6c06fcb0 con 0x7fef6c156350 2023-10-06T01:40:44.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.636+0000 7fef70ced700 1 --2- 172.21.15.71:0/2392709634 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fef58067000 0x7fef580694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:44.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.636+0000 7fef70ced700 1 --2- 172.21.15.71:0/2392709634 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fef58067000 0x7fef580694b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fef640097c0 tx=0x7fef64019000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:44.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.638+0000 7fbfe2f15700 1 -- 172.21.15.71:0/209568929 wait complete. 2023-10-06T01:40:44.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.639+0000 7fbfe2f15700 1 Processor -- start 2023-10-06T01:40:44.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.640+0000 7fef68ff9700 1 -- 172.21.15.71:0/2392709634 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fef5c051e30 con 0x7fef6c156350 2023-10-06T01:40:44.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.640+0000 7fbfe2f15700 1 -- start start 2023-10-06T01:40:44.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.641+0000 7fbfe2f15700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbfdc14f900 0x7fbfdc177970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:44.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.641+0000 7fbfe2f15700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfdc0af520 0x7fbfdc0c1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:44.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.641+0000 7fbfe2f15700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbfdc0c23b0 0x7fbfdc156330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:44.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.641+0000 7fbfe2f15700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfdc0c2850 con 0x7fbfdc14f900 2023-10-06T01:40:44.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.641+0000 7fbfe2f15700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfdc155ea0 con 0x7fbfdc0af520 2023-10-06T01:40:44.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.641+0000 7fbfe2f15700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfdc0afd70 con 0x7fbfdc0c23b0 2023-10-06T01:40:44.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.641+0000 7fbfe0cb1700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbfdc14f900 0x7fbfdc177970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:44.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.641+0000 7fbfe0cb1700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbfdc14f900 0x7fbfdc177970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47672/0 (socket says 172.21.15.71:47672) 2023-10-06T01:40:44.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.641+0000 7fbfe0cb1700 1 -- 172.21.15.71:0/1209161771 learned_addr learned my addr 172.21.15.71:0/1209161771 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:44.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.641+0000 7fbfe0cb1700 1 -- 172.21.15.71:0/1209161771 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbfdc0c23b0 msgr2=0x7fbfdc156330 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T01:40:44.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.641+0000 7fbfe0cb1700 1 --2- 172.21.15.71:0/1209161771 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbfdc0c23b0 0x7fbfdc156330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:44.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.641+0000 7fbfe0cb1700 1 -- 172.21.15.71:0/1209161771 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfdc0af520 msgr2=0x7fbfdc0c1e70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T01:40:44.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.641+0000 7fbfe0cb1700 1 --2- 172.21.15.71:0/1209161771 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfdc0af520 0x7fbfdc0c1e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:44.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.641+0000 7fbfe0cb1700 1 -- 172.21.15.71:0/1209161771 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfdc0b0050 con 0x7fbfdc14f900 2023-10-06T01:40:44.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.642+0000 7fbfe0cb1700 1 --2- 172.21.15.71:0/1209161771 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbfdc14f900 0x7fbfdc177970 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fbfd40013d0 tx=0x7fbfd4000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:44.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.642+0000 7fbfd8ff9700 1 -- 172.21.15.71:0/1209161771 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd4012590 con 0x7fbfdc14f900 2023-10-06T01:40:44.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.642+0000 7fbfd8ff9700 1 -- 172.21.15.71:0/1209161771 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfd40126f0 con 0x7fbfdc14f900 2023-10-06T01:40:44.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.642+0000 7fbfd8ff9700 1 -- 172.21.15.71:0/1209161771 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd4012ab0 con 0x7fbfdc14f900 2023-10-06T01:40:44.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.642+0000 7fbfe2f15700 1 -- 172.21.15.71:0/1209161771 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfdc0b0330 con 0x7fbfdc14f900 2023-10-06T01:40:44.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.642+0000 7fbfe2f15700 1 -- 172.21.15.71:0/1209161771 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfdc14fcd0 con 0x7fbfdc14f900 2023-10-06T01:40:44.646 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.644+0000 7fbfd8ff9700 1 -- 172.21.15.71:0/1209161771 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbfd401d460 con 0x7fbfdc14f900 2023-10-06T01:40:44.646 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.644+0000 7fbfd8ff9700 1 --2- 172.21.15.71:0/1209161771 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fbfc4068c70 0x7fbfc406b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:44.646 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.645+0000 7fbfd8ff9700 1 -- 172.21.15.71:0/1209161771 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fbfd40855d0 con 0x7fbfdc14f900 2023-10-06T01:40:44.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.649+0000 7fbfdbfff700 1 --2- 172.21.15.71:0/1209161771 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fbfc4068c70 0x7fbfc406b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:44.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.649+0000 7fbfe2f15700 1 -- 172.21.15.71:0/1209161771 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfc80052e0 con 0x7fbfdc14f900 2023-10-06T01:40:44.651 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.650+0000 7fbfdbfff700 1 --2- 172.21.15.71:0/1209161771 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fbfc4068c70 0x7fbfc406b120 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc0c3c90 tx=0x7fbfd0016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:44.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.658+0000 7fbfd8ff9700 1 -- 172.21.15.71:0/1209161771 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbfd40523f0 con 0x7fbfdc14f900 2023-10-06T01:40:44.935 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.933+0000 7f0d8762c700 1 -- 172.21.15.71:0/1185565408 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0d60005560 con 0x7f0d80167dd0 2023-10-06T01:40:44.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.935+0000 7f0d757fa700 1 -- 172.21.15.71:0/1185565408 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0d780660b0 con 0x7f0d80167dd0 2023-10-06T01:40:44.939 INFO:teuthology.orchestra.run.smithi071.stdout:55834574859 2023-10-06T01:40:44.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.938+0000 7f0d8762c700 1 -- 172.21.15.71:0/1185565408 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f0d64067000 msgr2=0x7f0d640694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:44.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.938+0000 7f0d8762c700 1 --2- 172.21.15.71:0/1185565408 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f0d64067000 0x7f0d640694b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0d70003ad0 tx=0x7f0d70009040 comp rx=0 tx=0).stop 2023-10-06T01:40:44.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.938+0000 7f0d8762c700 1 -- 172.21.15.71:0/1185565408 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d80167dd0 msgr2=0x7f0d80177110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:44.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.938+0000 7f0d8762c700 1 --2- 172.21.15.71:0/1185565408 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d80167dd0 0x7f0d80177110 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0d80065f80 tx=0x7f0d78007da0 comp rx=0 tx=0).stop 2023-10-06T01:40:44.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.939+0000 7f0d8762c700 1 -- 172.21.15.71:0/1185565408 shutdown_connections 2023-10-06T01:40:44.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.939+0000 7f0d8762c700 1 --2- 172.21.15.71:0/1185565408 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d80167dd0 0x7f0d80177110 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:44.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.939+0000 7f0d8762c700 1 --2- 172.21.15.71:0/1185565408 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f0d64067000 0x7f0d640694b0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:44.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.939+0000 7f0d8762c700 1 --2- 172.21.15.71:0/1185565408 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d6c004810 0x7f0d8015cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:44.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.939+0000 7f0d8762c700 1 --2- 172.21.15.71:0/1185565408 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0d80167960 0x7f0d80176bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:44.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.939+0000 7f0d8762c700 1 -- 172.21.15.71:0/1185565408 >> 172.21.15.71:0/1185565408 conn(0x7f0d80069110 msgr2=0x7f0d80163620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:44.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.939+0000 7f0d8762c700 1 -- 172.21.15.71:0/1185565408 shutdown_connections 2023-10-06T01:40:44.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.940+0000 7f0d8762c700 1 -- 172.21.15.71:0/1185565408 wait complete. 2023-10-06T01:40:44.946 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.945+0000 7f0db36f8700 1 -- 172.21.15.71:0/3302038514 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f0dac063b70 con 0x7f0dac159590 2023-10-06T01:40:44.947 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.945+0000 7f0da17fa700 1 -- 172.21.15.71:0/3302038514 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0da80548e0 con 0x7f0dac159590 2023-10-06T01:40:44.950 INFO:teuthology.orchestra.run.smithi071.stdout:55834574858 2023-10-06T01:40:44.951 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.949+0000 7f0db36f8700 1 -- 172.21.15.71:0/3302038514 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f0d90067050 msgr2=0x7f0d90069500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:44.951 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.949+0000 7f0db36f8700 1 --2- 172.21.15.71:0/3302038514 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f0d90067050 0x7f0d90069500 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0d9c00b690 tx=0x7f0d9c005ad0 comp rx=0 tx=0).stop 2023-10-06T01:40:44.951 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.949+0000 7f0db36f8700 1 -- 172.21.15.71:0/3302038514 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0dac159590 msgr2=0x7f0dac148490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:44.951 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.949+0000 7f0db36f8700 1 --2- 172.21.15.71:0/3302038514 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0dac159590 0x7f0dac148490 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0da800b600 tx=0x7f0da80091a0 comp rx=0 tx=0).stop 2023-10-06T01:40:44.951 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.950+0000 7f0db36f8700 1 -- 172.21.15.71:0/3302038514 shutdown_connections 2023-10-06T01:40:44.952 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.950+0000 7f0db36f8700 1 --2- 172.21.15.71:0/3302038514 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f0d90067050 0x7f0d90069500 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:44.952 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.950+0000 7f0db36f8700 1 --2- 172.21.15.71:0/3302038514 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0dac159f40 0x7f0dac1458a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:44.952 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.950+0000 7f0db36f8700 1 --2- 172.21.15.71:0/3302038514 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0dac158da0 0x7f0dac14d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:44.952 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.950+0000 7f0db36f8700 1 --2- 172.21.15.71:0/3302038514 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0dac159590 0x7f0dac148490 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:44.952 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.950+0000 7f0db36f8700 1 -- 172.21.15.71:0/3302038514 >> 172.21.15.71:0/3302038514 conn(0x7f0dac069110 msgr2=0x7f0dac0b1210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:44.952 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.951+0000 7f0db36f8700 1 -- 172.21.15.71:0/3302038514 shutdown_connections 2023-10-06T01:40:44.953 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.951+0000 7f0db36f8700 1 -- 172.21.15.71:0/3302038514 wait complete. 2023-10-06T01:40:44.960 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574859 for osd.2 2023-10-06T01:40:44.960 DEBUG:teuthology.parallel:result is None 2023-10-06T01:40:44.970 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.7 2023-10-06T01:40:44.971 DEBUG:teuthology.parallel:result is None 2023-10-06T01:40:44.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.974+0000 7f4c0eac8700 1 -- 172.21.15.71:0/3170083940 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4c08068420 con 0x7f4c080c8810 2023-10-06T01:40:44.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.975+0000 7f4bfdffb700 1 -- 172.21.15.71:0/3170083940 <== mon.2 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4bf8051af0 con 0x7f4c080c8810 2023-10-06T01:40:44.977 INFO:teuthology.orchestra.run.smithi071.stdout:55834574858 2023-10-06T01:40:44.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.977+0000 7f4c0eac8700 1 -- 172.21.15.71:0/3170083940 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f4bec067080 msgr2=0x7f4bec069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:44.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.977+0000 7f4c0eac8700 1 --2- 172.21.15.71:0/3170083940 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f4bec067080 0x7f4bec069530 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4c0815d130 tx=0x7f4c04008040 comp rx=0 tx=0).stop 2023-10-06T01:40:44.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.977+0000 7f4c0eac8700 1 -- 172.21.15.71:0/3170083940 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4c080c8810 msgr2=0x7f4c0814f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:44.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.977+0000 7f4c0eac8700 1 --2- 172.21.15.71:0/3170083940 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4c080c8810 0x7f4c0814f300 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4c0806e720 tx=0x7f4bf8008040 comp rx=0 tx=0).stop 2023-10-06T01:40:44.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.977+0000 7f4c0eac8700 1 -- 172.21.15.71:0/3170083940 shutdown_connections 2023-10-06T01:40:44.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.977+0000 7f4c0eac8700 1 --2- 172.21.15.71:0/3170083940 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f4bec067080 0x7f4bec069530 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:44.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.978+0000 7f4c0eac8700 1 --2- 172.21.15.71:0/3170083940 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4c0814fac0 0x7f4c0814ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:44.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.978+0000 7f4c0eac8700 1 --2- 172.21.15.71:0/3170083940 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4c080c8810 0x7f4c0814f300 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:44.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.978+0000 7f4c0eac8700 1 --2- 172.21.15.71:0/3170083940 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c0815d9d0 0x7f4c08147370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:44.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.978+0000 7f4c0eac8700 1 -- 172.21.15.71:0/3170083940 >> 172.21.15.71:0/3170083940 conn(0x7f4c080c9070 msgr2=0x7f4c080adeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:44.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.978+0000 7f4c0eac8700 1 -- 172.21.15.71:0/3170083940 shutdown_connections 2023-10-06T01:40:44.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.978+0000 7f4c0eac8700 1 -- 172.21.15.71:0/3170083940 wait complete. 2023-10-06T01:40:44.986 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.985+0000 7f27ab5c2700 1 -- 172.21.15.71:0/1852276937 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f27a40acba0 con 0x7f27a4156b30 2023-10-06T01:40:44.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.985+0000 7f27997fa700 1 -- 172.21.15.71:0/1852276937 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f27a00553d0 con 0x7f27a4156b30 2023-10-06T01:40:44.987 INFO:teuthology.orchestra.run.smithi071.stdout:55834574858 2023-10-06T01:40:44.989 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.987+0000 7f27ab5c2700 1 -- 172.21.15.71:0/1852276937 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f2788066f30 msgr2=0x7f27880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:44.989 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.987+0000 7f27ab5c2700 1 --2- 172.21.15.71:0/1852276937 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f2788066f30 0x7f27880693e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f27940058d0 tx=0x7f2794007a30 comp rx=0 tx=0).stop 2023-10-06T01:40:44.989 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.987+0000 7f27ab5c2700 1 -- 172.21.15.71:0/1852276937 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27a4156b30 msgr2=0x7f27a40c3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:44.989 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.987+0000 7f27ab5c2700 1 --2- 172.21.15.71:0/1852276937 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27a4156b30 0x7f27a40c3800 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f27a000b490 tx=0x7f27a0006f50 comp rx=0 tx=0).stop 2023-10-06T01:40:44.991 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.0 2023-10-06T01:40:44.992 DEBUG:teuthology.parallel:result is None 2023-10-06T01:40:44.992 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.991+0000 7f27ab5c2700 1 -- 172.21.15.71:0/1852276937 shutdown_connections 2023-10-06T01:40:44.992 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.991+0000 7f27ab5c2700 1 --2- 172.21.15.71:0/1852276937 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27a4156b30 0x7f27a40c3800 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:44.992 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.991+0000 7f27ab5c2700 1 --2- 172.21.15.71:0/1852276937 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f27a406b7e0 0x7f27a4148290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:44.993 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.991+0000 7f27ab5c2700 1 --2- 172.21.15.71:0/1852276937 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f2788066f30 0x7f27880693e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:44.993 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.991+0000 7f27ab5c2700 1 --2- 172.21.15.71:0/1852276937 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27a406bbb0 0x7f27a40c32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:44.993 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.991+0000 7f27ab5c2700 1 -- 172.21.15.71:0/1852276937 >> 172.21.15.71:0/1852276937 conn(0x7f27a406a260 msgr2=0x7f27a4151a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:44.993 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.991+0000 7f27ab5c2700 1 -- 172.21.15.71:0/1852276937 shutdown_connections 2023-10-06T01:40:44.993 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.991+0000 7f27ab5c2700 1 -- 172.21.15.71:0/1852276937 wait complete. 2023-10-06T01:40:44.994 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.992+0000 7f7cee6df700 1 -- 172.21.15.71:0/4133900169 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f7ce8152bd0 con 0x7f7ce80ae280 2023-10-06T01:40:44.994 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.993+0000 7f7ccffff700 1 -- 172.21.15.71:0/4133900169 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7ce0050df0 con 0x7f7ce80ae280 2023-10-06T01:40:44.995 INFO:teuthology.orchestra.run.smithi071.stdout:55834574858 2023-10-06T01:40:44.997 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.996+0000 7f7cee6df700 1 -- 172.21.15.71:0/4133900169 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7cd00ab000 msgr2=0x7f7cd00ad4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:44.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.996+0000 7f7cee6df700 1 --2- 172.21.15.71:0/4133900169 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7cd00ab000 0x7f7cd00ad4b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7cdc0099b0 tx=0x7f7cdc016000 comp rx=0 tx=0).stop 2023-10-06T01:40:44.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.996+0000 7f7cee6df700 1 -- 172.21.15.71:0/4133900169 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7ce80ae280 msgr2=0x7f7ce80ae700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:44.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.996+0000 7f7cee6df700 1 --2- 172.21.15.71:0/4133900169 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7ce80ae280 0x7f7ce80ae700 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7ce000cb90 tx=0x7f7ce0001770 comp rx=0 tx=0).stop 2023-10-06T01:40:44.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.997+0000 7f7cee6df700 1 -- 172.21.15.71:0/4133900169 shutdown_connections 2023-10-06T01:40:44.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.997+0000 7f7cee6df700 1 --2- 172.21.15.71:0/4133900169 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7ce80ae280 0x7f7ce80ae700 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:44.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.997+0000 7f7cee6df700 1 --2- 172.21.15.71:0/4133900169 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7cd00ab000 0x7f7cd00ad4b0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:44.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.997+0000 7f7cee6df700 1 --2- 172.21.15.71:0/4133900169 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7ce8068680 0x7f7ce817a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:44.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.997+0000 7f7cee6df700 1 --2- 172.21.15.71:0/4133900169 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ce8157d40 0x7f7ce8152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:44.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.997+0000 7f7cee6df700 1 -- 172.21.15.71:0/4133900169 >> 172.21.15.71:0/4133900169 conn(0x7f7ce806a260 msgr2=0x7f7ce80cc250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:44.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.998+0000 7f7cee6df700 1 -- 172.21.15.71:0/4133900169 shutdown_connections 2023-10-06T01:40:44.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:44.998+0000 7f7cee6df700 1 -- 172.21.15.71:0/4133900169 wait complete. 2023-10-06T01:40:45.005 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.1 2023-10-06T01:40:45.005 DEBUG:teuthology.parallel:result is None 2023-10-06T01:40:45.017 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.5 2023-10-06T01:40:45.017 DEBUG:teuthology.parallel:result is None 2023-10-06T01:40:45.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.018+0000 7f3d5129f700 1 -- 172.21.15.71:0/2615053352 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f3d4c0a9410 con 0x7f3d4c168870 2023-10-06T01:40:45.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.018+0000 7f3d32ffd700 1 -- 172.21.15.71:0/2615053352 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3d4401b090 con 0x7f3d4c168870 2023-10-06T01:40:45.020 INFO:teuthology.orchestra.run.smithi071.stdout:55834574859 2023-10-06T01:40:45.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.020+0000 7f3d5129f700 1 -- 172.21.15.71:0/2615053352 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f3d38066f30 msgr2=0x7f3d380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:45.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.020+0000 7f3d5129f700 1 --2- 172.21.15.71:0/2615053352 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f3d38066f30 0x7f3d380693e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c06e140 tx=0x7f3d3c018000 comp rx=0 tx=0).stop 2023-10-06T01:40:45.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.020+0000 7f3d5129f700 1 -- 172.21.15.71:0/2615053352 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3d4c168870 msgr2=0x7f3d4c0ab950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:45.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.020+0000 7f3d5129f700 1 --2- 172.21.15.71:0/2615053352 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3d4c168870 0x7f3d4c0ab950 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3d4400cd80 tx=0x7f3d44006160 comp rx=0 tx=0).stop 2023-10-06T01:40:45.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.020+0000 7f3d5129f700 1 -- 172.21.15.71:0/2615053352 shutdown_connections 2023-10-06T01:40:45.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.020+0000 7f3d5129f700 1 --2- 172.21.15.71:0/2615053352 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3d4c168870 0x7f3d4c0ab950 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:45.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.020+0000 7f3d5129f700 1 --2- 172.21.15.71:0/2615053352 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f3d38066f30 0x7f3d380693e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:45.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.020+0000 7f3d5129f700 1 --2- 172.21.15.71:0/2615053352 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d4c0af3b0 0x7f3d4c086330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:45.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.020+0000 7f3d5129f700 1 --2- 172.21.15.71:0/2615053352 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3d4c1664c0 0x7f3d4c0ab410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:45.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.020+0000 7f3d5129f700 1 -- 172.21.15.71:0/2615053352 >> 172.21.15.71:0/2615053352 conn(0x7f3d4c0cbda0 msgr2=0x7f3d4c168d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:45.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.020+0000 7f3d5129f700 1 -- 172.21.15.71:0/2615053352 shutdown_connections 2023-10-06T01:40:45.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.020+0000 7f3d5129f700 1 -- 172.21.15.71:0/2615053352 wait complete. 2023-10-06T01:40:45.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.030+0000 7fef72f51700 1 -- 172.21.15.71:0/2392709634 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fef6c149000 con 0x7fef6c156350 2023-10-06T01:40:45.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.030+0000 7fef68ff9700 1 -- 172.21.15.71:0/2392709634 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fef5c055450 con 0x7fef6c156350 2023-10-06T01:40:45.032 INFO:teuthology.orchestra.run.smithi071.stdout:55834574858 2023-10-06T01:40:45.033 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574859 for osd.4 2023-10-06T01:40:45.034 DEBUG:teuthology.parallel:result is None 2023-10-06T01:40:45.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.034+0000 7fef72f51700 1 -- 172.21.15.71:0/2392709634 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fef58067000 msgr2=0x7fef580694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:45.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.034+0000 7fef72f51700 1 --2- 172.21.15.71:0/2392709634 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fef58067000 0x7fef580694b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fef640097c0 tx=0x7fef64019000 comp rx=0 tx=0).stop 2023-10-06T01:40:45.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.034+0000 7fef72f51700 1 -- 172.21.15.71:0/2392709634 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef6c156350 msgr2=0x7fef6c1598b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:45.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.034+0000 7fef72f51700 1 --2- 172.21.15.71:0/2392709634 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef6c156350 0x7fef6c1598b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fef5c00ebb0 tx=0x7fef5c00b4f0 comp rx=0 tx=0).stop 2023-10-06T01:40:45.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.034+0000 7fef72f51700 1 -- 172.21.15.71:0/2392709634 shutdown_connections 2023-10-06T01:40:45.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.034+0000 7fef72f51700 1 --2- 172.21.15.71:0/2392709634 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef6c156720 0x7fef6c175ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:45.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.034+0000 7fef72f51700 1 --2- 172.21.15.71:0/2392709634 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fef58067000 0x7fef580694b0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:45.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.034+0000 7fef72f51700 1 --2- 172.21.15.71:0/2392709634 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef6c0c7f20 0x7fef6c0cc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:45.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.034+0000 7fef72f51700 1 --2- 172.21.15.71:0/2392709634 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef6c156350 0x7fef6c1598b0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:45.036 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.034+0000 7fef72f51700 1 -- 172.21.15.71:0/2392709634 >> 172.21.15.71:0/2392709634 conn(0x7fef6c069110 msgr2=0x7fef6c149b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:45.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.034+0000 7fef72f51700 1 -- 172.21.15.71:0/2392709634 shutdown_connections 2023-10-06T01:40:45.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.034+0000 7fef72f51700 1 -- 172.21.15.71:0/2392709634 wait complete. 2023-10-06T01:40:45.051 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.049+0000 7fbfe2f15700 1 -- 172.21.15.71:0/1209161771 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fbfc8005860 con 0x7fbfdc14f900 2023-10-06T01:40:45.051 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.050+0000 7fbfd8ff9700 1 -- 172.21.15.71:0/1209161771 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbfd4059020 con 0x7fbfdc14f900 2023-10-06T01:40:45.052 INFO:teuthology.orchestra.run.smithi071.stdout:55834574858 2023-10-06T01:40:45.052 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.3 2023-10-06T01:40:45.053 DEBUG:teuthology.parallel:result is None 2023-10-06T01:40:45.054 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.052+0000 7fbfe2f15700 1 -- 172.21.15.71:0/1209161771 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fbfc4068c70 msgr2=0x7fbfc406b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:45.054 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.052+0000 7fbfe2f15700 1 --2- 172.21.15.71:0/1209161771 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fbfc4068c70 0x7fbfc406b120 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc0c3c90 tx=0x7fbfd0016000 comp rx=0 tx=0).stop 2023-10-06T01:40:45.054 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.052+0000 7fbfe2f15700 1 -- 172.21.15.71:0/1209161771 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbfdc14f900 msgr2=0x7fbfdc177970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:45.054 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.052+0000 7fbfe2f15700 1 --2- 172.21.15.71:0/1209161771 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbfdc14f900 0x7fbfdc177970 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fbfd40013d0 tx=0x7fbfd4000f40 comp rx=0 tx=0).stop 2023-10-06T01:40:45.054 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.052+0000 7fbfe2f15700 1 -- 172.21.15.71:0/1209161771 shutdown_connections 2023-10-06T01:40:45.054 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.052+0000 7fbfe2f15700 1 --2- 172.21.15.71:0/1209161771 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbfdc0c23b0 0x7fbfdc156330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:45.055 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.052+0000 7fbfe2f15700 1 --2- 172.21.15.71:0/1209161771 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbfdc14f900 0x7fbfdc177970 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:45.055 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.052+0000 7fbfe2f15700 1 --2- 172.21.15.71:0/1209161771 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fbfc4068c70 0x7fbfc406b120 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:45.055 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.052+0000 7fbfe2f15700 1 --2- 172.21.15.71:0/1209161771 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbfdc0af520 0x7fbfdc0c1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:45.055 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.052+0000 7fbfe2f15700 1 -- 172.21.15.71:0/1209161771 >> 172.21.15.71:0/1209161771 conn(0x7fbfdc0c9cc0 msgr2=0x7fbfdc154640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:45.055 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.052+0000 7fbfe2f15700 1 -- 172.21.15.71:0/1209161771 shutdown_connections 2023-10-06T01:40:45.055 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.052+0000 7fbfe2f15700 1 -- 172.21.15.71:0/1209161771 wait complete. 2023-10-06T01:40:45.065 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.6 2023-10-06T01:40:45.065 DEBUG:teuthology.parallel:result is None 2023-10-06T01:40:45.065 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-06T01:40:45.065 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T01:40:45.219 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.217+0000 7feb8359e700 1 Processor -- start 2023-10-06T01:40:45.219 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.217+0000 7feb8359e700 1 -- start start 2023-10-06T01:40:45.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.218+0000 7feb8359e700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7feb84159400 0x7feb840ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:45.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.218+0000 7feb8359e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb840d05d0 0x7feb840b39f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:45.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.218+0000 7feb8359e700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb840b3560 con 0x7feb840cd030 2023-10-06T01:40:45.222 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.218+0000 7feb8359e700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb840cf6f0 con 0x7feb84159400 2023-10-06T01:40:45.222 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.218+0000 7feb8359e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb840cf9d0 con 0x7feb840d05d0 2023-10-06T01:40:45.222 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.218+0000 7feb8259c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7feb84159400 0x7feb840ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:45.222 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.218+0000 7feb8259c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7feb84159400 0x7feb840ccaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47680/0 (socket says 172.21.15.71:47680) 2023-10-06T01:40:45.222 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.218+0000 7feb8259c700 1 -- 172.21.15.71:0/2232528302 learned_addr learned my addr 172.21.15.71:0/2232528302 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:45.222 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.218+0000 7feb82d9d700 1 --2- 172.21.15.71:0/2232528302 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb840d05d0 0x7feb840b39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:45.222 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.218+0000 7feb8259c700 1 -- 172.21.15.71:0/2232528302 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb840d05d0 msgr2=0x7feb840b39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:45.222 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.218+0000 7feb8259c700 1 --2- 172.21.15.71:0/2232528302 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb840d05d0 0x7feb840b39f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:45.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.218+0000 7feb8259c700 1 -- 172.21.15.71:0/2232528302 >> v1:172.21.15.72:6789/0 conn(0x7feb840cd030 legacy=0x7feb840cfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:45.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.218+0000 7feb8259c700 1 -- 172.21.15.71:0/2232528302 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb840b2f10 con 0x7feb84159400 2023-10-06T01:40:45.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.218+0000 7feb8259c700 1 --2- 172.21.15.71:0/2232528302 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feb84159400 0x7feb840ccaf0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7feb74009f70 tx=0x7feb74009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=308385fd539628d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:45.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.218+0000 7feb81d9b700 1 -- 172.21.15.71:0/2232528302 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7400e070 con 0x7feb84159400 2023-10-06T01:40:45.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.218+0000 7feb81d9b700 1 -- 172.21.15.71:0/2232528302 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb7400ba90 con 0x7feb84159400 2023-10-06T01:40:45.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.218+0000 7feb81d9b700 1 -- 172.21.15.71:0/2232528302 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb740092e0 con 0x7feb84159400 2023-10-06T01:40:45.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.219+0000 7feb8359e700 1 -- 172.21.15.71:0/2232528302 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feb84159400 msgr2=0x7feb840ccaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:45.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.219+0000 7feb8359e700 1 --2- 172.21.15.71:0/2232528302 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feb84159400 0x7feb840ccaf0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7feb74009f70 tx=0x7feb74009840 comp rx=0 tx=0).stop 2023-10-06T01:40:45.224 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.219+0000 7feb8359e700 1 -- 172.21.15.71:0/2232528302 shutdown_connections 2023-10-06T01:40:45.225 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.219+0000 7feb8359e700 1 --2- 172.21.15.71:0/2232528302 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb840d05d0 0x7feb840b39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:45.225 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.219+0000 7feb8359e700 1 --2- 172.21.15.71:0/2232528302 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feb84159400 0x7feb840ccaf0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:45.225 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.219+0000 7feb8359e700 1 -- 172.21.15.71:0/2232528302 >> 172.21.15.71:0/2232528302 conn(0x7feb8406ac10 msgr2=0x7feb84068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:45.225 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.219+0000 7feb8359e700 1 -- 172.21.15.71:0/2232528302 shutdown_connections 2023-10-06T01:40:45.225 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.219+0000 7feb8359e700 1 -- 172.21.15.71:0/2232528302 wait complete. 2023-10-06T01:40:45.228 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.220+0000 7feb8359e700 1 Processor -- start 2023-10-06T01:40:45.228 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.220+0000 7feb8359e700 1 -- start start 2023-10-06T01:40:45.228 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.221+0000 7feb8359e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feb840cd030 0x7feb8414bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:45.228 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.221+0000 7feb8359e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb840d05d0 0x7feb8414dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:45.228 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.221+0000 7feb8359e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb84159400 0x7feb840b39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:45.228 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.221+0000 7feb8359e700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb8414c310 con 0x7feb840cd030 2023-10-06T01:40:45.228 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.221+0000 7feb8359e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb841500e0 con 0x7feb84159400 2023-10-06T01:40:45.228 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.221+0000 7feb8359e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb8414d030 con 0x7feb840d05d0 2023-10-06T01:40:45.228 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.221+0000 7feb8259c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feb840cd030 0x7feb8414bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:45.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.221+0000 7feb8259c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feb840cd030 0x7feb8414bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47688/0 (socket says 172.21.15.71:47688) 2023-10-06T01:40:45.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.221+0000 7feb8259c700 1 -- 172.21.15.71:0/829330750 learned_addr learned my addr 172.21.15.71:0/829330750 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:45.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.221+0000 7feb79d9b700 1 --2- 172.21.15.71:0/829330750 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb840d05d0 0x7feb8414dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:45.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.221+0000 7feb82d9d700 1 --2- 172.21.15.71:0/829330750 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb84159400 0x7feb840b39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:45.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.221+0000 7feb8259c700 1 -- 172.21.15.71:0/829330750 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb840d05d0 msgr2=0x7feb8414dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:45.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.221+0000 7feb8259c700 1 --2- 172.21.15.71:0/829330750 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb840d05d0 0x7feb8414dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:45.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.221+0000 7feb8259c700 1 -- 172.21.15.71:0/829330750 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb84159400 msgr2=0x7feb840b39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:45.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.221+0000 7feb8259c700 1 --2- 172.21.15.71:0/829330750 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb84159400 0x7feb840b39f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:45.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.221+0000 7feb8259c700 1 -- 172.21.15.71:0/829330750 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb74009ae0 con 0x7feb840cd030 2023-10-06T01:40:45.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.221+0000 7feb82d9d700 1 --2- 172.21.15.71:0/829330750 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb84159400 0x7feb840b39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:40:45.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.221+0000 7feb8259c700 1 --2- 172.21.15.71:0/829330750 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feb840cd030 0x7feb8414bdd0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7feb840b2b80 tx=0x7feb74017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:45.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.222+0000 7feb7affd700 1 -- 172.21.15.71:0/829330750 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb74012a20 con 0x7feb840cd030 2023-10-06T01:40:45.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.222+0000 7feb7affd700 1 -- 172.21.15.71:0/829330750 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb74012b80 con 0x7feb840cd030 2023-10-06T01:40:45.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.222+0000 7feb7affd700 1 -- 172.21.15.71:0/829330750 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7401d420 con 0x7feb840cd030 2023-10-06T01:40:45.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.222+0000 7feb8359e700 1 -- 172.21.15.71:0/829330750 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb8414e990 con 0x7feb840cd030 2023-10-06T01:40:45.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.222+0000 7feb8359e700 1 -- 172.21.15.71:0/829330750 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb8414ec10 con 0x7feb840cd030 2023-10-06T01:40:45.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.223+0000 7feb8359e700 1 -- 172.21.15.71:0/829330750 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb840cf220 con 0x7feb840cd030 2023-10-06T01:40:45.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.223+0000 7feb7affd700 1 -- 172.21.15.71:0/829330750 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7feb7401d810 con 0x7feb840cd030 2023-10-06T01:40:45.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.223+0000 7feb7affd700 1 --2- 172.21.15.71:0/829330750 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7feb64066f30 0x7feb640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:45.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.223+0000 7feb7affd700 1 -- 172.21.15.71:0/829330750 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7feb740860c0 con 0x7feb840cd030 2023-10-06T01:40:45.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.223+0000 7feb79d9b700 1 --2- 172.21.15.71:0/829330750 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7feb64066f30 0x7feb640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:45.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.224+0000 7feb79d9b700 1 --2- 172.21.15.71:0/829330750 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7feb64066f30 0x7feb640693e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7feb84167600 tx=0x7feb6c007ea0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:45.231 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.228+0000 7feb7affd700 1 -- 172.21.15.71:0/829330750 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feb74052ee0 con 0x7feb840cd030 2023-10-06T01:40:45.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.409+0000 7feb8359e700 1 -- 172.21.15.71:0/829330750 --> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7feb840b3280 con 0x7feb64066f30 2023-10-06T01:40:45.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.418+0000 7feb7affd700 1 -- 172.21.15.71:0/829330750 <== mgr.4107 v2:172.21.15.71:6832/90436 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367328 (secure 0 0 0) 0x7feb840b3280 con 0x7feb64066f30 2023-10-06T01:40:45.424 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:40:45.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.422+0000 7feb8359e700 1 -- 172.21.15.71:0/829330750 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7feb64066f30 msgr2=0x7feb640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:45.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.422+0000 7feb8359e700 1 --2- 172.21.15.71:0/829330750 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7feb64066f30 0x7feb640693e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7feb84167600 tx=0x7feb6c007ea0 comp rx=0 tx=0).stop 2023-10-06T01:40:45.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.422+0000 7feb8359e700 1 -- 172.21.15.71:0/829330750 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feb840cd030 msgr2=0x7feb8414bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:45.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.422+0000 7feb8359e700 1 --2- 172.21.15.71:0/829330750 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feb840cd030 0x7feb8414bdd0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7feb840b2b80 tx=0x7feb74017000 comp rx=0 tx=0).stop 2023-10-06T01:40:45.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.422+0000 7feb8359e700 1 -- 172.21.15.71:0/829330750 shutdown_connections 2023-10-06T01:40:45.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.422+0000 7feb8359e700 1 --2- 172.21.15.71:0/829330750 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7feb64066f30 0x7feb640693e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:45.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.422+0000 7feb8359e700 1 --2- 172.21.15.71:0/829330750 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb84159400 0x7feb840b39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:45.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.422+0000 7feb8359e700 1 --2- 172.21.15.71:0/829330750 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feb840cd030 0x7feb8414bdd0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:45.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.422+0000 7feb8359e700 1 --2- 172.21.15.71:0/829330750 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb840d05d0 0x7feb8414dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:45.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.422+0000 7feb8359e700 1 -- 172.21.15.71:0/829330750 >> 172.21.15.71:0/829330750 conn(0x7feb8406ac10 msgr2=0x7feb840cfec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:45.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.422+0000 7feb8359e700 1 -- 172.21.15.71:0/829330750 shutdown_connections 2023-10-06T01:40:45.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.422+0000 7feb8359e700 1 -- 172.21.15.71:0/829330750 wait complete. 2023-10-06T01:40:45.428 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2023-10-06T01:40:45.435 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2023-10-06T01:40:44.568877+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594852,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381796,"kb_used_data":3492,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752592924,"statfs":{"total":773094113280,"available":770655154176,"internally_reserved":0,"allocated":3575808,"data_stored":2145327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2178,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004288"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.827077+0000","last_change":"2023-10-06T01:40:21.784720+0000","last_active":"2023-10-06T01:40:25.827077+0000","last_peered":"2023-10-06T01:40:25.827077+0000","last_clean":"2023-10-06T01:40:25.827077+0000","last_became_active":"2023-10-06T01:40:21.784463+0000","last_became_peered":"2023-10-06T01:40:21.784463+0000","last_unstale":"2023-10-06T01:40:25.827077+0000","last_undegraded":"2023-10-06T01:40:25.827077+0000","last_fullsized":"2023-10-06T01:40:25.827077+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:06:11.014583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821980+0000","last_change":"2023-10-06T01:40:21.795765+0000","last_active":"2023-10-06T01:40:25.821980+0000","last_peered":"2023-10-06T01:40:25.821980+0000","last_clean":"2023-10-06T01:40:25.821980+0000","last_became_active":"2023-10-06T01:40:21.795508+0000","last_became_peered":"2023-10-06T01:40:21.795508+0000","last_unstale":"2023-10-06T01:40:25.821980+0000","last_undegraded":"2023-10-06T01:40:25.821980+0000","last_fullsized":"2023-10-06T01:40:25.821980+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:24:04.737047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.829737+0000","last_change":"2023-10-06T01:40:21.801764+0000","last_active":"2023-10-06T01:40:25.829737+0000","last_peered":"2023-10-06T01:40:25.829737+0000","last_clean":"2023-10-06T01:40:25.829737+0000","last_became_active":"2023-10-06T01:40:21.801511+0000","last_became_peered":"2023-10-06T01:40:21.801511+0000","last_unstale":"2023-10-06T01:40:25.829737+0000","last_undegraded":"2023-10-06T01:40:25.829737+0000","last_fullsized":"2023-10-06T01:40:25.829737+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:53:19.501226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.824060+0000","last_change":"2023-10-06T01:40:21.796935+0000","last_active":"2023-10-06T01:40:25.824060+0000","last_peered":"2023-10-06T01:40:25.824060+0000","last_clean":"2023-10-06T01:40:25.824060+0000","last_became_active":"2023-10-06T01:40:21.796664+0000","last_became_peered":"2023-10-06T01:40:21.796664+0000","last_unstale":"2023-10-06T01:40:25.824060+0000","last_undegraded":"2023-10-06T01:40:25.824060+0000","last_fullsized":"2023-10-06T01:40:25.824060+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:18:43.064747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.838848+0000","last_change":"2023-10-06T01:40:21.798926+0000","last_active":"2023-10-06T01:40:25.838848+0000","last_peered":"2023-10-06T01:40:25.838848+0000","last_clean":"2023-10-06T01:40:25.838848+0000","last_became_active":"2023-10-06T01:40:21.798342+0000","last_became_peered":"2023-10-06T01:40:21.798342+0000","last_unstale":"2023-10-06T01:40:25.838848+0000","last_undegraded":"2023-10-06T01:40:25.838848+0000","last_fullsized":"2023-10-06T01:40:25.838848+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:29:36.526509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.832097+0000","last_change":"2023-10-06T01:40:21.801493+0000","last_active":"2023-10-06T01:40:25.832097+0000","last_peered":"2023-10-06T01:40:25.832097+0000","last_clean":"2023-10-06T01:40:25.832097+0000","last_became_active":"2023-10-06T01:40:21.801200+0000","last_became_peered":"2023-10-06T01:40:21.801200+0000","last_unstale":"2023-10-06T01:40:25.832097+0000","last_undegraded":"2023-10-06T01:40:25.832097+0000","last_fullsized":"2023-10-06T01:40:25.832097+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:16:01.004830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.836158+0000","last_change":"2023-10-06T01:40:21.797032+0000","last_active":"2023-10-06T01:40:25.836158+0000","last_peered":"2023-10-06T01:40:25.836158+0000","last_clean":"2023-10-06T01:40:25.836158+0000","last_became_active":"2023-10-06T01:40:21.796712+0000","last_became_peered":"2023-10-06T01:40:21.796712+0000","last_unstale":"2023-10-06T01:40:25.836158+0000","last_undegraded":"2023-10-06T01:40:25.836158+0000","last_fullsized":"2023-10-06T01:40:25.836158+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:04.038873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821476+0000","last_change":"2023-10-06T01:40:21.791132+0000","last_active":"2023-10-06T01:40:25.821476+0000","last_peered":"2023-10-06T01:40:25.821476+0000","last_clean":"2023-10-06T01:40:25.821476+0000","last_became_active":"2023-10-06T01:40:21.790446+0000","last_became_peered":"2023-10-06T01:40:21.790446+0000","last_unstale":"2023-10-06T01:40:25.821476+0000","last_undegraded":"2023-10-06T01:40:25.821476+0000","last_fullsized":"2023-10-06T01:40:25.821476+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:40:45.624442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.839970+0000","last_change":"2023-10-06T01:40:21.793869+0000","last_active":"2023-10-06T01:40:25.839970+0000","last_peered":"2023-10-06T01:40:25.839970+0000","last_clean":"2023-10-06T01:40:25.839970+0000","last_became_active":"2023-10-06T01:40:21.793596+0000","last_became_peered":"2023-10-06T01:40:21.793596+0000","last_unstale":"2023-10-06T01:40:25.839970+0000","last_undegraded":"2023-10-06T01:40:25.839970+0000","last_fullsized":"2023-10-06T01:40:25.839970+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:24:04.737047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.822068+0000","last_change":"2023-10-06T01:40:21.798541+0000","last_active":"2023-10-06T01:40:25.822068+0000","last_peered":"2023-10-06T01:40:25.822068+0000","last_clean":"2023-10-06T01:40:25.822068+0000","last_became_active":"2023-10-06T01:40:21.798271+0000","last_became_peered":"2023-10-06T01:40:21.798271+0000","last_unstale":"2023-10-06T01:40:25.822068+0000","last_undegraded":"2023-10-06T01:40:25.822068+0000","last_fullsized":"2023-10-06T01:40:25.822068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:14:30.814494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.829653+0000","last_change":"2023-10-06T01:40:21.798043+0000","last_active":"2023-10-06T01:40:25.829653+0000","last_peered":"2023-10-06T01:40:25.829653+0000","last_clean":"2023-10-06T01:40:25.829653+0000","last_became_active":"2023-10-06T01:40:21.797768+0000","last_became_peered":"2023-10-06T01:40:21.797768+0000","last_unstale":"2023-10-06T01:40:25.829653+0000","last_undegraded":"2023-10-06T01:40:25.829653+0000","last_fullsized":"2023-10-06T01:40:25.829653+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:39:44.521327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.826805+0000","last_change":"2023-10-06T01:40:21.783366+0000","last_active":"2023-10-06T01:40:25.826805+0000","last_peered":"2023-10-06T01:40:25.826805+0000","last_clean":"2023-10-06T01:40:25.826805+0000","last_became_active":"2023-10-06T01:40:21.783102+0000","last_became_peered":"2023-10-06T01:40:21.783102+0000","last_unstale":"2023-10-06T01:40:25.826805+0000","last_undegraded":"2023-10-06T01:40:25.826805+0000","last_fullsized":"2023-10-06T01:40:25.826805+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:22:12.634757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.826660+0000","last_change":"2023-10-06T01:40:21.789603+0000","last_active":"2023-10-06T01:40:25.826660+0000","last_peered":"2023-10-06T01:40:25.826660+0000","last_clean":"2023-10-06T01:40:25.826660+0000","last_became_active":"2023-10-06T01:40:21.789423+0000","last_became_peered":"2023-10-06T01:40:21.789423+0000","last_unstale":"2023-10-06T01:40:25.826660+0000","last_undegraded":"2023-10-06T01:40:25.826660+0000","last_fullsized":"2023-10-06T01:40:25.826660+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:26:04.581987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821407+0000","last_change":"2023-10-06T01:40:21.786154+0000","last_active":"2023-10-06T01:40:25.821407+0000","last_peered":"2023-10-06T01:40:25.821407+0000","last_clean":"2023-10-06T01:40:25.821407+0000","last_became_active":"2023-10-06T01:40:21.785883+0000","last_became_peered":"2023-10-06T01:40:21.785883+0000","last_unstale":"2023-10-06T01:40:25.821407+0000","last_undegraded":"2023-10-06T01:40:25.821407+0000","last_fullsized":"2023-10-06T01:40:25.821407+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:58:41.783343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.835961+0000","last_change":"2023-10-06T01:40:21.794272+0000","last_active":"2023-10-06T01:40:25.835961+0000","last_peered":"2023-10-06T01:40:25.835961+0000","last_clean":"2023-10-06T01:40:25.835961+0000","last_became_active":"2023-10-06T01:40:21.794004+0000","last_became_peered":"2023-10-06T01:40:21.794004+0000","last_unstale":"2023-10-06T01:40:25.835961+0000","last_undegraded":"2023-10-06T01:40:25.835961+0000","last_fullsized":"2023-10-06T01:40:25.835961+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:14:30.814494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.830236+0000","last_change":"2023-10-06T01:40:21.799382+0000","last_active":"2023-10-06T01:40:25.830236+0000","last_peered":"2023-10-06T01:40:25.830236+0000","last_clean":"2023-10-06T01:40:25.830236+0000","last_became_active":"2023-10-06T01:40:21.799078+0000","last_became_peered":"2023-10-06T01:40:21.799078+0000","last_unstale":"2023-10-06T01:40:25.830236+0000","last_undegraded":"2023-10-06T01:40:25.830236+0000","last_fullsized":"2023-10-06T01:40:25.830236+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:09:24.820551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.840050+0000","last_change":"2023-10-06T01:40:21.793399+0000","last_active":"2023-10-06T01:40:25.840050+0000","last_peered":"2023-10-06T01:40:25.840050+0000","last_clean":"2023-10-06T01:40:25.840050+0000","last_became_active":"2023-10-06T01:40:21.793155+0000","last_became_peered":"2023-10-06T01:40:21.793155+0000","last_unstale":"2023-10-06T01:40:25.840050+0000","last_undegraded":"2023-10-06T01:40:25.840050+0000","last_fullsized":"2023-10-06T01:40:25.840050+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:58:41.783343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.827729+0000","last_change":"2023-10-06T01:40:21.796081+0000","last_active":"2023-10-06T01:40:25.827729+0000","last_peered":"2023-10-06T01:40:25.827729+0000","last_clean":"2023-10-06T01:40:25.827729+0000","last_became_active":"2023-10-06T01:40:21.795755+0000","last_became_peered":"2023-10-06T01:40:21.795755+0000","last_unstale":"2023-10-06T01:40:25.827729+0000","last_undegraded":"2023-10-06T01:40:25.827729+0000","last_fullsized":"2023-10-06T01:40:25.827729+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:26:01.813573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.826585+0000","last_change":"2023-10-06T01:40:21.783713+0000","last_active":"2023-10-06T01:40:25.826585+0000","last_peered":"2023-10-06T01:40:25.826585+0000","last_clean":"2023-10-06T01:40:25.826585+0000","last_became_active":"2023-10-06T01:40:21.783410+0000","last_became_peered":"2023-10-06T01:40:21.783410+0000","last_unstale":"2023-10-06T01:40:25.826585+0000","last_undegraded":"2023-10-06T01:40:25.826585+0000","last_fullsized":"2023-10-06T01:40:25.826585+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:08:57.248267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.830504+0000","last_change":"2023-10-06T01:40:21.784490+0000","last_active":"2023-10-06T01:40:25.830504+0000","last_peered":"2023-10-06T01:40:25.830504+0000","last_clean":"2023-10-06T01:40:25.830504+0000","last_became_active":"2023-10-06T01:40:21.783963+0000","last_became_peered":"2023-10-06T01:40:21.783963+0000","last_unstale":"2023-10-06T01:40:25.830504+0000","last_undegraded":"2023-10-06T01:40:25.830504+0000","last_fullsized":"2023-10-06T01:40:25.830504+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:57:45.536353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.827932+0000","last_change":"2023-10-06T01:40:21.800162+0000","last_active":"2023-10-06T01:40:25.827932+0000","last_peered":"2023-10-06T01:40:25.827932+0000","last_clean":"2023-10-06T01:40:25.827932+0000","last_became_active":"2023-10-06T01:40:21.799563+0000","last_became_peered":"2023-10-06T01:40:21.799563+0000","last_unstale":"2023-10-06T01:40:25.827932+0000","last_undegraded":"2023-10-06T01:40:25.827932+0000","last_fullsized":"2023-10-06T01:40:25.827932+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:26:58.497171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.838626+0000","last_change":"2023-10-06T01:40:21.794761+0000","last_active":"2023-10-06T01:40:25.838626+0000","last_peered":"2023-10-06T01:40:25.838626+0000","last_clean":"2023-10-06T01:40:25.838626+0000","last_became_active":"2023-10-06T01:40:21.794528+0000","last_became_peered":"2023-10-06T01:40:21.794528+0000","last_unstale":"2023-10-06T01:40:25.838626+0000","last_undegraded":"2023-10-06T01:40:25.838626+0000","last_fullsized":"2023-10-06T01:40:25.838626+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:40:45.624442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821624+0000","last_change":"2023-10-06T01:40:21.797159+0000","last_active":"2023-10-06T01:40:25.821624+0000","last_peered":"2023-10-06T01:40:25.821624+0000","last_clean":"2023-10-06T01:40:25.821624+0000","last_became_active":"2023-10-06T01:40:21.796930+0000","last_became_peered":"2023-10-06T01:40:21.796930+0000","last_unstale":"2023-10-06T01:40:25.821624+0000","last_undegraded":"2023-10-06T01:40:25.821624+0000","last_fullsized":"2023-10-06T01:40:25.821624+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:14:30.814494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.831663+0000","last_change":"2023-10-06T01:40:21.800667+0000","last_active":"2023-10-06T01:40:25.831663+0000","last_peered":"2023-10-06T01:40:25.831663+0000","last_clean":"2023-10-06T01:40:25.831663+0000","last_became_active":"2023-10-06T01:40:21.799665+0000","last_became_peered":"2023-10-06T01:40:21.799665+0000","last_unstale":"2023-10-06T01:40:25.831663+0000","last_undegraded":"2023-10-06T01:40:25.831663+0000","last_fullsized":"2023-10-06T01:40:25.831663+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:29:36.526509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.829892+0000","last_change":"2023-10-06T01:40:21.795383+0000","last_active":"2023-10-06T01:40:25.829892+0000","last_peered":"2023-10-06T01:40:25.829892+0000","last_clean":"2023-10-06T01:40:25.829892+0000","last_became_active":"2023-10-06T01:40:21.794463+0000","last_became_peered":"2023-10-06T01:40:21.794463+0000","last_unstale":"2023-10-06T01:40:25.829892+0000","last_undegraded":"2023-10-06T01:40:25.829892+0000","last_fullsized":"2023-10-06T01:40:25.829892+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:15:52.031555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.827471+0000","last_change":"2023-10-06T01:40:21.787299+0000","last_active":"2023-10-06T01:40:25.827471+0000","last_peered":"2023-10-06T01:40:25.827471+0000","last_clean":"2023-10-06T01:40:25.827471+0000","last_became_active":"2023-10-06T01:40:21.786459+0000","last_became_peered":"2023-10-06T01:40:21.786459+0000","last_unstale":"2023-10-06T01:40:25.827471+0000","last_undegraded":"2023-10-06T01:40:25.827471+0000","last_fullsized":"2023-10-06T01:40:25.827471+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:29:49.863294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.822035+0000","last_change":"2023-10-06T01:40:21.798180+0000","last_active":"2023-10-06T01:40:25.822035+0000","last_peered":"2023-10-06T01:40:25.822035+0000","last_clean":"2023-10-06T01:40:25.822035+0000","last_became_active":"2023-10-06T01:40:21.797919+0000","last_became_peered":"2023-10-06T01:40:21.797919+0000","last_unstale":"2023-10-06T01:40:25.822035+0000","last_undegraded":"2023-10-06T01:40:25.822035+0000","last_fullsized":"2023-10-06T01:40:25.822035+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:29:36.526509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.853335+0000","last_change":"2023-10-06T01:40:25.847570+0000","last_active":"2023-10-06T01:40:25.853335+0000","last_peered":"2023-10-06T01:40:25.853335+0000","last_clean":"2023-10-06T01:40:25.853335+0000","last_became_active":"2023-10-06T01:40:25.843197+0000","last_became_peered":"2023-10-06T01:40:25.843197+0000","last_unstale":"2023-10-06T01:40:25.853335+0000","last_undegraded":"2023-10-06T01:40:25.853335+0000","last_fullsized":"2023-10-06T01:40:25.853335+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:44:41.539390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.832007+0000","last_change":"2023-10-06T01:40:20.794740+0000","last_active":"2023-10-06T01:40:25.832007+0000","last_peered":"2023-10-06T01:40:25.832007+0000","last_clean":"2023-10-06T01:40:25.832007+0000","last_became_active":"2023-10-06T01:40:20.794508+0000","last_became_peered":"2023-10-06T01:40:20.794508+0000","last_unstale":"2023-10-06T01:40:25.832007+0000","last_undegraded":"2023-10-06T01:40:25.832007+0000","last_fullsized":"2023-10-06T01:40:25.832007+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:28:17.373431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821586+0000","last_change":"2023-10-06T01:40:21.792738+0000","last_active":"2023-10-06T01:40:25.821586+0000","last_peered":"2023-10-06T01:40:25.821586+0000","last_clean":"2023-10-06T01:40:25.821586+0000","last_became_active":"2023-10-06T01:40:21.792508+0000","last_became_peered":"2023-10-06T01:40:21.792508+0000","last_unstale":"2023-10-06T01:40:25.821586+0000","last_undegraded":"2023-10-06T01:40:25.821586+0000","last_fullsized":"2023-10-06T01:40:25.821586+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:04.038873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.847437+0000","last_change":"2023-10-06T01:40:25.841407+0000","last_active":"2023-10-06T01:40:25.847437+0000","last_peered":"2023-10-06T01:40:25.847437+0000","last_clean":"2023-10-06T01:40:25.847437+0000","last_became_active":"2023-10-06T01:40:25.840998+0000","last_became_peered":"2023-10-06T01:40:25.840998+0000","last_unstale":"2023-10-06T01:40:25.847437+0000","last_undegraded":"2023-10-06T01:40:25.847437+0000","last_fullsized":"2023-10-06T01:40:25.847437+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:24:24.646258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.829628+0000","last_change":"2023-10-06T01:40:20.784535+0000","last_active":"2023-10-06T01:40:25.829628+0000","last_peered":"2023-10-06T01:40:25.829628+0000","last_clean":"2023-10-06T01:40:25.829628+0000","last_became_active":"2023-10-06T01:40:20.784266+0000","last_became_peered":"2023-10-06T01:40:20.784266+0000","last_unstale":"2023-10-06T01:40:25.829628+0000","last_undegraded":"2023-10-06T01:40:25.829628+0000","last_fullsized":"2023-10-06T01:40:25.829628+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:05:51.063526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.839509+0000","last_change":"2023-10-06T01:40:21.796914+0000","last_active":"2023-10-06T01:40:25.839509+0000","last_peered":"2023-10-06T01:40:25.839509+0000","last_clean":"2023-10-06T01:40:25.839509+0000","last_became_active":"2023-10-06T01:40:21.796645+0000","last_became_peered":"2023-10-06T01:40:21.796645+0000","last_unstale":"2023-10-06T01:40:25.839509+0000","last_undegraded":"2023-10-06T01:40:25.839509+0000","last_fullsized":"2023-10-06T01:40:25.839509+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:26:01.813573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.859114+0000","last_change":"2023-10-06T01:40:25.852718+0000","last_active":"2023-10-06T01:40:25.859114+0000","last_peered":"2023-10-06T01:40:25.859114+0000","last_clean":"2023-10-06T01:40:25.859114+0000","last_became_active":"2023-10-06T01:40:25.852410+0000","last_became_peered":"2023-10-06T01:40:25.852410+0000","last_unstale":"2023-10-06T01:40:25.859114+0000","last_undegraded":"2023-10-06T01:40:25.859114+0000","last_fullsized":"2023-10-06T01:40:25.859114+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:51:20.741996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.822073+0000","last_change":"2023-10-06T01:40:20.791628+0000","last_active":"2023-10-06T01:40:25.822073+0000","last_peered":"2023-10-06T01:40:25.822073+0000","last_clean":"2023-10-06T01:40:25.822073+0000","last_became_active":"2023-10-06T01:40:20.791350+0000","last_became_peered":"2023-10-06T01:40:20.791350+0000","last_unstale":"2023-10-06T01:40:25.822073+0000","last_undegraded":"2023-10-06T01:40:25.822073+0000","last_fullsized":"2023-10-06T01:40:25.822073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:40:52.187918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.824300+0000","last_change":"2023-10-06T01:40:21.784888+0000","last_active":"2023-10-06T01:40:25.824300+0000","last_peered":"2023-10-06T01:40:25.824300+0000","last_clean":"2023-10-06T01:40:25.824300+0000","last_became_active":"2023-10-06T01:40:21.784543+0000","last_became_peered":"2023-10-06T01:40:21.784543+0000","last_unstale":"2023-10-06T01:40:25.824300+0000","last_undegraded":"2023-10-06T01:40:25.824300+0000","last_fullsized":"2023-10-06T01:40:25.824300+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:22:12.634757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.852270+0000","last_change":"2023-10-06T01:40:25.846891+0000","last_active":"2023-10-06T01:40:25.852270+0000","last_peered":"2023-10-06T01:40:25.852270+0000","last_clean":"2023-10-06T01:40:25.852270+0000","last_became_active":"2023-10-06T01:40:25.846500+0000","last_became_peered":"2023-10-06T01:40:25.846500+0000","last_unstale":"2023-10-06T01:40:25.852270+0000","last_undegraded":"2023-10-06T01:40:25.852270+0000","last_fullsized":"2023-10-06T01:40:25.852270+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:08:08.709318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.840125+0000","last_change":"2023-10-06T01:40:20.792032+0000","last_active":"2023-10-06T01:40:25.840125+0000","last_peered":"2023-10-06T01:40:25.840125+0000","last_clean":"2023-10-06T01:40:25.840125+0000","last_became_active":"2023-10-06T01:40:20.791755+0000","last_became_peered":"2023-10-06T01:40:20.791755+0000","last_unstale":"2023-10-06T01:40:25.840125+0000","last_undegraded":"2023-10-06T01:40:25.840125+0000","last_fullsized":"2023-10-06T01:40:25.840125+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:26:03.577908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821783+0000","last_change":"2023-10-06T01:40:21.784165+0000","last_active":"2023-10-06T01:40:25.821783+0000","last_peered":"2023-10-06T01:40:25.821783+0000","last_clean":"2023-10-06T01:40:25.821783+0000","last_became_active":"2023-10-06T01:40:21.783915+0000","last_became_peered":"2023-10-06T01:40:21.783915+0000","last_unstale":"2023-10-06T01:40:25.821783+0000","last_undegraded":"2023-10-06T01:40:25.821783+0000","last_fullsized":"2023-10-06T01:40:25.821783+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:24:04.737047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.854974+0000","last_change":"2023-10-06T01:40:25.844941+0000","last_active":"2023-10-06T01:40:25.854974+0000","last_peered":"2023-10-06T01:40:25.854974+0000","last_clean":"2023-10-06T01:40:25.854974+0000","last_became_active":"2023-10-06T01:40:25.844514+0000","last_became_peered":"2023-10-06T01:40:25.844514+0000","last_unstale":"2023-10-06T01:40:25.854974+0000","last_undegraded":"2023-10-06T01:40:25.854974+0000","last_fullsized":"2023-10-06T01:40:25.854974+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:47:01.253527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821998+0000","last_change":"2023-10-06T01:40:20.791960+0000","last_active":"2023-10-06T01:40:25.821998+0000","last_peered":"2023-10-06T01:40:25.821998+0000","last_clean":"2023-10-06T01:40:25.821998+0000","last_became_active":"2023-10-06T01:40:20.791726+0000","last_became_peered":"2023-10-06T01:40:20.791726+0000","last_unstale":"2023-10-06T01:40:25.821998+0000","last_undegraded":"2023-10-06T01:40:25.821998+0000","last_fullsized":"2023-10-06T01:40:25.821998+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:26:03.577908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821717+0000","last_change":"2023-10-06T01:40:21.788771+0000","last_active":"2023-10-06T01:40:25.821717+0000","last_peered":"2023-10-06T01:40:25.821717+0000","last_clean":"2023-10-06T01:40:25.821717+0000","last_became_active":"2023-10-06T01:40:21.788485+0000","last_became_peered":"2023-10-06T01:40:21.788485+0000","last_unstale":"2023-10-06T01:40:25.821717+0000","last_undegraded":"2023-10-06T01:40:25.821717+0000","last_fullsized":"2023-10-06T01:40:25.821717+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:26:01.813573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.856408+0000","last_change":"2023-10-06T01:40:25.843843+0000","last_active":"2023-10-06T01:40:25.856408+0000","last_peered":"2023-10-06T01:40:25.856408+0000","last_clean":"2023-10-06T01:40:25.856408+0000","last_became_active":"2023-10-06T01:40:25.843513+0000","last_became_peered":"2023-10-06T01:40:25.843513+0000","last_unstale":"2023-10-06T01:40:25.856408+0000","last_undegraded":"2023-10-06T01:40:25.856408+0000","last_fullsized":"2023-10-06T01:40:25.856408+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:45.054717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.829858+0000","last_change":"2023-10-06T01:40:20.794114+0000","last_active":"2023-10-06T01:40:25.829858+0000","last_peered":"2023-10-06T01:40:25.829858+0000","last_clean":"2023-10-06T01:40:25.829858+0000","last_became_active":"2023-10-06T01:40:20.793858+0000","last_became_peered":"2023-10-06T01:40:20.793858+0000","last_unstale":"2023-10-06T01:40:25.829858+0000","last_undegraded":"2023-10-06T01:40:25.829858+0000","last_fullsized":"2023-10-06T01:40:25.829858+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:18:42.060669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.827126+0000","last_change":"2023-10-06T01:40:21.794943+0000","last_active":"2023-10-06T01:40:25.827126+0000","last_peered":"2023-10-06T01:40:25.827126+0000","last_clean":"2023-10-06T01:40:25.827126+0000","last_became_active":"2023-10-06T01:40:21.794481+0000","last_became_peered":"2023-10-06T01:40:21.794481+0000","last_unstale":"2023-10-06T01:40:25.827126+0000","last_undegraded":"2023-10-06T01:40:25.827126+0000","last_fullsized":"2023-10-06T01:40:25.827126+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:29:36.526509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.853325+0000","last_change":"2023-10-06T01:40:25.844703+0000","last_active":"2023-10-06T01:40:25.853325+0000","last_peered":"2023-10-06T01:40:25.853325+0000","last_clean":"2023-10-06T01:40:25.853325+0000","last_became_active":"2023-10-06T01:40:25.844372+0000","last_became_peered":"2023-10-06T01:40:25.844372+0000","last_unstale":"2023-10-06T01:40:25.853325+0000","last_undegraded":"2023-10-06T01:40:25.853325+0000","last_fullsized":"2023-10-06T01:40:25.853325+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:09:02.303009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'9","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T01:40:31.572781+0000","last_change":"2023-10-06T01:40:20.794127+0000","last_active":"2023-10-06T01:40:31.572781+0000","last_peered":"2023-10-06T01:40:31.572781+0000","last_clean":"2023-10-06T01:40:31.572781+0000","last_became_active":"2023-10-06T01:40:20.793873+0000","last_became_peered":"2023-10-06T01:40:20.793873+0000","last_unstale":"2023-10-06T01:40:31.572781+0000","last_undegraded":"2023-10-06T01:40:31.572781+0000","last_fullsized":"2023-10-06T01:40:31.572781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:05:51.063526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3714,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.830525+0000","last_change":"2023-10-06T01:40:21.783742+0000","last_active":"2023-10-06T01:40:25.830525+0000","last_peered":"2023-10-06T01:40:25.830525+0000","last_clean":"2023-10-06T01:40:25.830525+0000","last_became_active":"2023-10-06T01:40:21.783474+0000","last_became_peered":"2023-10-06T01:40:21.783474+0000","last_unstale":"2023-10-06T01:40:25.830525+0000","last_undegraded":"2023-10-06T01:40:25.830525+0000","last_fullsized":"2023-10-06T01:40:25.830525+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:40:45.624442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.855108+0000","last_change":"2023-10-06T01:40:25.850810+0000","last_active":"2023-10-06T01:40:25.855108+0000","last_peered":"2023-10-06T01:40:25.855108+0000","last_clean":"2023-10-06T01:40:25.855108+0000","last_became_active":"2023-10-06T01:40:25.850440+0000","last_became_peered":"2023-10-06T01:40:25.850440+0000","last_unstale":"2023-10-06T01:40:25.855108+0000","last_undegraded":"2023-10-06T01:40:25.855108+0000","last_fullsized":"2023-10-06T01:40:25.855108+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:12:18.042310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.827851+0000","last_change":"2023-10-06T01:40:20.795471+0000","last_active":"2023-10-06T01:40:25.827851+0000","last_peered":"2023-10-06T01:40:25.827851+0000","last_clean":"2023-10-06T01:40:25.827851+0000","last_became_active":"2023-10-06T01:40:20.795162+0000","last_became_peered":"2023-10-06T01:40:20.795162+0000","last_unstale":"2023-10-06T01:40:25.827851+0000","last_undegraded":"2023-10-06T01:40:25.827851+0000","last_fullsized":"2023-10-06T01:40:25.827851+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:42:39.472271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.822047+0000","last_change":"2023-10-06T01:40:21.792919+0000","last_active":"2023-10-06T01:40:25.822047+0000","last_peered":"2023-10-06T01:40:25.822047+0000","last_clean":"2023-10-06T01:40:25.822047+0000","last_became_active":"2023-10-06T01:40:21.792603+0000","last_became_peered":"2023-10-06T01:40:21.792603+0000","last_unstale":"2023-10-06T01:40:25.822047+0000","last_undegraded":"2023-10-06T01:40:25.822047+0000","last_fullsized":"2023-10-06T01:40:25.822047+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:58:41.783343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.842053+0000","last_change":"2023-10-06T01:40:25.837982+0000","last_active":"2023-10-06T01:40:25.842053+0000","last_peered":"2023-10-06T01:40:25.842053+0000","last_clean":"2023-10-06T01:40:25.842053+0000","last_became_active":"2023-10-06T01:40:25.837550+0000","last_became_peered":"2023-10-06T01:40:25.837550+0000","last_unstale":"2023-10-06T01:40:25.842053+0000","last_undegraded":"2023-10-06T01:40:25.842053+0000","last_fullsized":"2023-10-06T01:40:25.842053+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:44:33.571977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.838551+0000","last_change":"2023-10-06T01:40:20.791355+0000","last_active":"2023-10-06T01:40:25.838551+0000","last_peered":"2023-10-06T01:40:25.838551+0000","last_clean":"2023-10-06T01:40:25.838551+0000","last_became_active":"2023-10-06T01:40:20.791101+0000","last_became_peered":"2023-10-06T01:40:20.791101+0000","last_unstale":"2023-10-06T01:40:25.838551+0000","last_undegraded":"2023-10-06T01:40:25.838551+0000","last_fullsized":"2023-10-06T01:40:25.838551+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:36.984892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821895+0000","last_change":"2023-10-06T01:40:21.798155+0000","last_active":"2023-10-06T01:40:25.821895+0000","last_peered":"2023-10-06T01:40:25.821895+0000","last_clean":"2023-10-06T01:40:25.821895+0000","last_became_active":"2023-10-06T01:40:21.797870+0000","last_became_peered":"2023-10-06T01:40:21.797870+0000","last_unstale":"2023-10-06T01:40:25.821895+0000","last_undegraded":"2023-10-06T01:40:25.821895+0000","last_fullsized":"2023-10-06T01:40:25.821895+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:04.038873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.856540+0000","last_change":"2023-10-06T01:40:25.845625+0000","last_active":"2023-10-06T01:40:25.856540+0000","last_peered":"2023-10-06T01:40:25.856540+0000","last_clean":"2023-10-06T01:40:25.856540+0000","last_became_active":"2023-10-06T01:40:25.845267+0000","last_became_peered":"2023-10-06T01:40:25.845267+0000","last_unstale":"2023-10-06T01:40:25.856540+0000","last_undegraded":"2023-10-06T01:40:25.856540+0000","last_fullsized":"2023-10-06T01:40:25.856540+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:22:48.941644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.836049+0000","last_change":"2023-10-06T01:40:20.795272+0000","last_active":"2023-10-06T01:40:25.836049+0000","last_peered":"2023-10-06T01:40:25.836049+0000","last_clean":"2023-10-06T01:40:25.836049+0000","last_became_active":"2023-10-06T01:40:20.795001+0000","last_became_peered":"2023-10-06T01:40:20.795001+0000","last_unstale":"2023-10-06T01:40:25.836049+0000","last_undegraded":"2023-10-06T01:40:25.836049+0000","last_fullsized":"2023-10-06T01:40:25.836049+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:08:56.244189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.839584+0000","last_change":"2023-10-06T01:40:21.793411+0000","last_active":"2023-10-06T01:40:25.839584+0000","last_peered":"2023-10-06T01:40:25.839584+0000","last_clean":"2023-10-06T01:40:25.839584+0000","last_became_active":"2023-10-06T01:40:21.793189+0000","last_became_peered":"2023-10-06T01:40:21.793189+0000","last_unstale":"2023-10-06T01:40:25.839584+0000","last_undegraded":"2023-10-06T01:40:25.839584+0000","last_fullsized":"2023-10-06T01:40:25.839584+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:39:44.521327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.848998+0000","last_change":"2023-10-06T01:40:25.844926+0000","last_active":"2023-10-06T01:40:25.848998+0000","last_peered":"2023-10-06T01:40:25.848998+0000","last_clean":"2023-10-06T01:40:25.848998+0000","last_became_active":"2023-10-06T01:40:25.844538+0000","last_became_peered":"2023-10-06T01:40:25.844538+0000","last_unstale":"2023-10-06T01:40:25.848998+0000","last_undegraded":"2023-10-06T01:40:25.848998+0000","last_fullsized":"2023-10-06T01:40:25.848998+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:09:02.303009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.822780+0000","last_change":"2023-10-06T01:40:20.791595+0000","last_active":"2023-10-06T01:40:25.822780+0000","last_peered":"2023-10-06T01:40:25.822780+0000","last_clean":"2023-10-06T01:40:25.822780+0000","last_became_active":"2023-10-06T01:40:20.791307+0000","last_became_peered":"2023-10-06T01:40:20.791307+0000","last_unstale":"2023-10-06T01:40:25.822780+0000","last_undegraded":"2023-10-06T01:40:25.822780+0000","last_fullsized":"2023-10-06T01:40:25.822780+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:28:17.373431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.822628+0000","last_change":"2023-10-06T01:40:21.799944+0000","last_active":"2023-10-06T01:40:25.822628+0000","last_peered":"2023-10-06T01:40:25.822628+0000","last_clean":"2023-10-06T01:40:25.822628+0000","last_became_active":"2023-10-06T01:40:21.799450+0000","last_became_peered":"2023-10-06T01:40:21.799450+0000","last_unstale":"2023-10-06T01:40:25.822628+0000","last_undegraded":"2023-10-06T01:40:25.822628+0000","last_fullsized":"2023-10-06T01:40:25.822628+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:40:45.624442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.855175+0000","last_change":"2023-10-06T01:40:25.846371+0000","last_active":"2023-10-06T01:40:25.855175+0000","last_peered":"2023-10-06T01:40:25.855175+0000","last_clean":"2023-10-06T01:40:25.855175+0000","last_became_active":"2023-10-06T01:40:25.845988+0000","last_became_peered":"2023-10-06T01:40:25.845988+0000","last_unstale":"2023-10-06T01:40:25.855175+0000","last_undegraded":"2023-10-06T01:40:25.855175+0000","last_fullsized":"2023-10-06T01:40:25.855175+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:51:20.741996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.831872+0000","last_change":"2023-10-06T01:40:20.794690+0000","last_active":"2023-10-06T01:40:25.831872+0000","last_peered":"2023-10-06T01:40:25.831872+0000","last_clean":"2023-10-06T01:40:25.831872+0000","last_became_active":"2023-10-06T01:40:20.794423+0000","last_became_peered":"2023-10-06T01:40:20.794423+0000","last_unstale":"2023-10-06T01:40:25.831872+0000","last_undegraded":"2023-10-06T01:40:25.831872+0000","last_fullsized":"2023-10-06T01:40:25.831872+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:22:11.630679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821326+0000","last_change":"2023-10-06T01:40:21.799103+0000","last_active":"2023-10-06T01:40:25.821326+0000","last_peered":"2023-10-06T01:40:25.821326+0000","last_clean":"2023-10-06T01:40:25.821326+0000","last_became_active":"2023-10-06T01:40:21.798863+0000","last_became_peered":"2023-10-06T01:40:21.798863+0000","last_unstale":"2023-10-06T01:40:25.821326+0000","last_undegraded":"2023-10-06T01:40:25.821326+0000","last_fullsized":"2023-10-06T01:40:25.821326+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:26:58.497171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.850182+0000","last_change":"2023-10-06T01:40:25.843557+0000","last_active":"2023-10-06T01:40:25.850182+0000","last_peered":"2023-10-06T01:40:25.850182+0000","last_clean":"2023-10-06T01:40:25.850182+0000","last_became_active":"2023-10-06T01:40:25.843195+0000","last_became_peered":"2023-10-06T01:40:25.843195+0000","last_unstale":"2023-10-06T01:40:25.850182+0000","last_undegraded":"2023-10-06T01:40:25.850182+0000","last_fullsized":"2023-10-06T01:40:25.850182+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:53:23.550542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.835869+0000","last_change":"2023-10-06T01:40:20.796455+0000","last_active":"2023-10-06T01:40:25.835869+0000","last_peered":"2023-10-06T01:40:25.835869+0000","last_clean":"2023-10-06T01:40:25.835869+0000","last_became_active":"2023-10-06T01:40:20.796167+0000","last_became_peered":"2023-10-06T01:40:20.796167+0000","last_unstale":"2023-10-06T01:40:25.835869+0000","last_undegraded":"2023-10-06T01:40:25.835869+0000","last_fullsized":"2023-10-06T01:40:25.835869+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:06:10.010505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.834708+0000","last_change":"2023-10-06T01:40:21.797847+0000","last_active":"2023-10-06T01:40:25.834708+0000","last_peered":"2023-10-06T01:40:25.834708+0000","last_clean":"2023-10-06T01:40:25.834708+0000","last_became_active":"2023-10-06T01:40:21.797521+0000","last_became_peered":"2023-10-06T01:40:21.797521+0000","last_unstale":"2023-10-06T01:40:25.834708+0000","last_undegraded":"2023-10-06T01:40:25.834708+0000","last_fullsized":"2023-10-06T01:40:25.834708+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:50:29.699833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.856330+0000","last_change":"2023-10-06T01:40:25.848998+0000","last_active":"2023-10-06T01:40:25.856330+0000","last_peered":"2023-10-06T01:40:25.856330+0000","last_clean":"2023-10-06T01:40:25.856330+0000","last_became_active":"2023-10-06T01:40:25.848631+0000","last_became_peered":"2023-10-06T01:40:25.848631+0000","last_unstale":"2023-10-06T01:40:25.856330+0000","last_undegraded":"2023-10-06T01:40:25.856330+0000","last_fullsized":"2023-10-06T01:40:25.856330+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:56:06.324200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.830063+0000","last_change":"2023-10-06T01:40:20.794592+0000","last_active":"2023-10-06T01:40:25.830063+0000","last_peered":"2023-10-06T01:40:25.830063+0000","last_clean":"2023-10-06T01:40:25.830063+0000","last_became_active":"2023-10-06T01:40:20.794349+0000","last_became_peered":"2023-10-06T01:40:20.794349+0000","last_unstale":"2023-10-06T01:40:25.830063+0000","last_undegraded":"2023-10-06T01:40:25.830063+0000","last_fullsized":"2023-10-06T01:40:25.830063+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:54:11.553661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.822918+0000","last_change":"2023-10-06T01:40:21.794642+0000","last_active":"2023-10-06T01:40:25.822918+0000","last_peered":"2023-10-06T01:40:25.822918+0000","last_clean":"2023-10-06T01:40:25.822918+0000","last_became_active":"2023-10-06T01:40:21.794359+0000","last_became_peered":"2023-10-06T01:40:21.794359+0000","last_unstale":"2023-10-06T01:40:25.822918+0000","last_undegraded":"2023-10-06T01:40:25.822918+0000","last_fullsized":"2023-10-06T01:40:25.822918+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:42:40.476349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.845522+0000","last_change":"2023-10-06T01:40:25.836956+0000","last_active":"2023-10-06T01:40:25.845522+0000","last_peered":"2023-10-06T01:40:25.845522+0000","last_clean":"2023-10-06T01:40:25.845522+0000","last_became_active":"2023-10-06T01:40:25.836541+0000","last_became_peered":"2023-10-06T01:40:25.836541+0000","last_unstale":"2023-10-06T01:40:25.845522+0000","last_undegraded":"2023-10-06T01:40:25.845522+0000","last_fullsized":"2023-10-06T01:40:25.845522+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:16:05.054146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821650+0000","last_change":"2023-10-06T01:40:20.782445+0000","last_active":"2023-10-06T01:40:25.821650+0000","last_peered":"2023-10-06T01:40:25.821650+0000","last_clean":"2023-10-06T01:40:25.821650+0000","last_became_active":"2023-10-06T01:40:20.782183+0000","last_became_peered":"2023-10-06T01:40:20.782183+0000","last_unstale":"2023-10-06T01:40:25.821650+0000","last_undegraded":"2023-10-06T01:40:25.821650+0000","last_fullsized":"2023-10-06T01:40:25.821650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:36.984892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.839193+0000","last_change":"2023-10-06T01:40:21.798980+0000","last_active":"2023-10-06T01:40:25.839193+0000","last_peered":"2023-10-06T01:40:25.839193+0000","last_clean":"2023-10-06T01:40:25.839193+0000","last_became_active":"2023-10-06T01:40:21.798613+0000","last_became_peered":"2023-10-06T01:40:21.798613+0000","last_unstale":"2023-10-06T01:40:25.839193+0000","last_undegraded":"2023-10-06T01:40:25.839193+0000","last_fullsized":"2023-10-06T01:40:25.839193+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:24:20.596942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.845551+0000","last_change":"2023-10-06T01:40:25.833310+0000","last_active":"2023-10-06T01:40:25.845551+0000","last_peered":"2023-10-06T01:40:25.845551+0000","last_clean":"2023-10-06T01:40:25.845551+0000","last_became_active":"2023-10-06T01:40:25.832963+0000","last_became_peered":"2023-10-06T01:40:25.832963+0000","last_unstale":"2023-10-06T01:40:25.845551+0000","last_undegraded":"2023-10-06T01:40:25.845551+0000","last_fullsized":"2023-10-06T01:40:25.845551+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:23:12.621079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821512+0000","last_change":"2023-10-06T01:40:20.791754+0000","last_active":"2023-10-06T01:40:25.821512+0000","last_peered":"2023-10-06T01:40:25.821512+0000","last_clean":"2023-10-06T01:40:25.821512+0000","last_became_active":"2023-10-06T01:40:20.791494+0000","last_became_peered":"2023-10-06T01:40:20.791494+0000","last_unstale":"2023-10-06T01:40:25.821512+0000","last_undegraded":"2023-10-06T01:40:25.821512+0000","last_fullsized":"2023-10-06T01:40:25.821512+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:05:51.063526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.830148+0000","last_change":"2023-10-06T01:40:21.785721+0000","last_active":"2023-10-06T01:40:25.830148+0000","last_peered":"2023-10-06T01:40:25.830148+0000","last_clean":"2023-10-06T01:40:25.830148+0000","last_became_active":"2023-10-06T01:40:21.785449+0000","last_became_peered":"2023-10-06T01:40:21.785449+0000","last_unstale":"2023-10-06T01:40:25.830148+0000","last_undegraded":"2023-10-06T01:40:25.830148+0000","last_fullsized":"2023-10-06T01:40:25.830148+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:08:04.660002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.844791+0000","last_change":"2023-10-06T01:40:25.840556+0000","last_active":"2023-10-06T01:40:25.844791+0000","last_peered":"2023-10-06T01:40:25.844791+0000","last_clean":"2023-10-06T01:40:25.844791+0000","last_became_active":"2023-10-06T01:40:25.839952+0000","last_became_peered":"2023-10-06T01:40:25.839952+0000","last_unstale":"2023-10-06T01:40:25.844791+0000","last_undegraded":"2023-10-06T01:40:25.844791+0000","last_fullsized":"2023-10-06T01:40:25.844791+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:47:01.253527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.823012+0000","last_change":"2023-10-06T01:40:20.789868+0000","last_active":"2023-10-06T01:40:25.823012+0000","last_peered":"2023-10-06T01:40:25.823012+0000","last_clean":"2023-10-06T01:40:25.823012+0000","last_became_active":"2023-10-06T01:40:20.789583+0000","last_became_peered":"2023-10-06T01:40:20.789583+0000","last_unstale":"2023-10-06T01:40:25.823012+0000","last_undegraded":"2023-10-06T01:40:25.823012+0000","last_fullsized":"2023-10-06T01:40:25.823012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:33:03.922009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.829487+0000","last_change":"2023-10-06T01:40:21.782892+0000","last_active":"2023-10-06T01:40:25.829487+0000","last_peered":"2023-10-06T01:40:25.829487+0000","last_clean":"2023-10-06T01:40:25.829487+0000","last_became_active":"2023-10-06T01:40:21.782614+0000","last_became_peered":"2023-10-06T01:40:21.782614+0000","last_unstale":"2023-10-06T01:40:25.829487+0000","last_undegraded":"2023-10-06T01:40:25.829487+0000","last_fullsized":"2023-10-06T01:40:25.829487+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:29:36.526509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.848904+0000","last_change":"2023-10-06T01:40:25.843490+0000","last_active":"2023-10-06T01:40:25.848904+0000","last_peered":"2023-10-06T01:40:25.848904+0000","last_clean":"2023-10-06T01:40:25.848904+0000","last_became_active":"2023-10-06T01:40:25.843088+0000","last_became_peered":"2023-10-06T01:40:25.843088+0000","last_unstale":"2023-10-06T01:40:25.848904+0000","last_undegraded":"2023-10-06T01:40:25.848904+0000","last_fullsized":"2023-10-06T01:40:25.848904+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:56:02.016770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.834508+0000","last_change":"2023-10-06T01:40:20.789056+0000","last_active":"2023-10-06T01:40:25.834508+0000","last_peered":"2023-10-06T01:40:25.834508+0000","last_clean":"2023-10-06T01:40:25.834508+0000","last_became_active":"2023-10-06T01:40:20.788196+0000","last_became_peered":"2023-10-06T01:40:20.788196+0000","last_unstale":"2023-10-06T01:40:25.834508+0000","last_undegraded":"2023-10-06T01:40:25.834508+0000","last_fullsized":"2023-10-06T01:40:25.834508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:33:03.922009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.827836+0000","last_change":"2023-10-06T01:40:21.797206+0000","last_active":"2023-10-06T01:40:25.827836+0000","last_peered":"2023-10-06T01:40:25.827836+0000","last_clean":"2023-10-06T01:40:25.827836+0000","last_became_active":"2023-10-06T01:40:21.796922+0000","last_became_peered":"2023-10-06T01:40:21.796922+0000","last_unstale":"2023-10-06T01:40:25.827836+0000","last_undegraded":"2023-10-06T01:40:25.827836+0000","last_fullsized":"2023-10-06T01:40:25.827836+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:23:41.001172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.843834+0000","last_change":"2023-10-06T01:40:25.839765+0000","last_active":"2023-10-06T01:40:25.843834+0000","last_peered":"2023-10-06T01:40:25.843834+0000","last_clean":"2023-10-06T01:40:25.843834+0000","last_became_active":"2023-10-06T01:40:25.839357+0000","last_became_peered":"2023-10-06T01:40:25.839357+0000","last_unstale":"2023-10-06T01:40:25.843834+0000","last_undegraded":"2023-10-06T01:40:25.843834+0000","last_fullsized":"2023-10-06T01:40:25.843834+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:19:13.535733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821700+0000","last_change":"2023-10-06T01:40:20.794748+0000","last_active":"2023-10-06T01:40:25.821700+0000","last_peered":"2023-10-06T01:40:25.821700+0000","last_clean":"2023-10-06T01:40:25.821700+0000","last_became_active":"2023-10-06T01:40:20.794480+0000","last_became_peered":"2023-10-06T01:40:20.794480+0000","last_unstale":"2023-10-06T01:40:25.821700+0000","last_undegraded":"2023-10-06T01:40:25.821700+0000","last_fullsized":"2023-10-06T01:40:25.821700+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:28:17.373431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.830047+0000","last_change":"2023-10-06T01:40:21.787258+0000","last_active":"2023-10-06T01:40:25.830047+0000","last_peered":"2023-10-06T01:40:25.830047+0000","last_clean":"2023-10-06T01:40:25.830047+0000","last_became_active":"2023-10-06T01:40:21.786664+0000","last_became_peered":"2023-10-06T01:40:21.786664+0000","last_unstale":"2023-10-06T01:40:25.830047+0000","last_undegraded":"2023-10-06T01:40:25.830047+0000","last_fullsized":"2023-10-06T01:40:25.830047+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:14:30.814494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.850996+0000","last_change":"2023-10-06T01:40:25.844637+0000","last_active":"2023-10-06T01:40:25.850996+0000","last_peered":"2023-10-06T01:40:25.850996+0000","last_clean":"2023-10-06T01:40:25.850996+0000","last_became_active":"2023-10-06T01:40:25.844052+0000","last_became_peered":"2023-10-06T01:40:25.844052+0000","last_unstale":"2023-10-06T01:40:25.850996+0000","last_undegraded":"2023-10-06T01:40:25.850996+0000","last_fullsized":"2023-10-06T01:40:25.850996+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:22:48.941644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.827265+0000","last_change":"2023-10-06T01:40:16.930992+0000","last_active":"2023-10-06T01:40:25.827265+0000","last_peered":"2023-10-06T01:40:25.827265+0000","last_clean":"2023-10-06T01:40:25.827265+0000","last_became_active":"2023-10-06T01:40:16.930707+0000","last_became_peered":"2023-10-06T01:40:16.930707+0000","last_unstale":"2023-10-06T01:40:25.827265+0000","last_undegraded":"2023-10-06T01:40:25.827265+0000","last_fullsized":"2023-10-06T01:40:25.827265+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:52:43.316071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821862+0000","last_change":"2023-10-06T01:40:20.784967+0000","last_active":"2023-10-06T01:40:25.821862+0000","last_peered":"2023-10-06T01:40:25.821862+0000","last_clean":"2023-10-06T01:40:25.821862+0000","last_became_active":"2023-10-06T01:40:20.784588+0000","last_became_peered":"2023-10-06T01:40:20.784588+0000","last_unstale":"2023-10-06T01:40:25.821862+0000","last_undegraded":"2023-10-06T01:40:25.821862+0000","last_fullsized":"2023-10-06T01:40:25.821862+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:05:51.063526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.826944+0000","last_change":"2023-10-06T01:40:21.794725+0000","last_active":"2023-10-06T01:40:25.826944+0000","last_peered":"2023-10-06T01:40:25.826944+0000","last_clean":"2023-10-06T01:40:25.826944+0000","last_became_active":"2023-10-06T01:40:21.794189+0000","last_became_peered":"2023-10-06T01:40:21.794189+0000","last_unstale":"2023-10-06T01:40:25.826944+0000","last_undegraded":"2023-10-06T01:40:25.826944+0000","last_fullsized":"2023-10-06T01:40:25.826944+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:04.038873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.859101+0000","last_change":"2023-10-06T01:40:25.851461+0000","last_active":"2023-10-06T01:40:25.859101+0000","last_peered":"2023-10-06T01:40:25.859101+0000","last_clean":"2023-10-06T01:40:25.859101+0000","last_became_active":"2023-10-06T01:40:25.851161+0000","last_became_peered":"2023-10-06T01:40:25.851161+0000","last_unstale":"2023-10-06T01:40:25.859101+0000","last_undegraded":"2023-10-06T01:40:25.859101+0000","last_fullsized":"2023-10-06T01:40:25.859101+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:29:43.044116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821491+0000","last_change":"2023-10-06T01:40:16.651019+0000","last_active":"2023-10-06T01:40:25.821491+0000","last_peered":"2023-10-06T01:40:25.821491+0000","last_clean":"2023-10-06T01:40:25.821491+0000","last_became_active":"2023-10-06T01:40:16.650628+0000","last_became_peered":"2023-10-06T01:40:16.650628+0000","last_unstale":"2023-10-06T01:40:25.821491+0000","last_undegraded":"2023-10-06T01:40:25.821491+0000","last_fullsized":"2023-10-06T01:40:25.821491+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:11:57.218984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.830606+0000","last_change":"2023-10-06T01:40:20.791834+0000","last_active":"2023-10-06T01:40:25.830606+0000","last_peered":"2023-10-06T01:40:25.830606+0000","last_clean":"2023-10-06T01:40:25.830606+0000","last_became_active":"2023-10-06T01:40:20.791553+0000","last_became_peered":"2023-10-06T01:40:20.791553+0000","last_unstale":"2023-10-06T01:40:25.830606+0000","last_undegraded":"2023-10-06T01:40:25.830606+0000","last_fullsized":"2023-10-06T01:40:25.830606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:40:52.187918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.827267+0000","last_change":"2023-10-06T01:40:21.787773+0000","last_active":"2023-10-06T01:40:25.827267+0000","last_peered":"2023-10-06T01:40:25.827267+0000","last_clean":"2023-10-06T01:40:25.827267+0000","last_became_active":"2023-10-06T01:40:21.787517+0000","last_became_peered":"2023-10-06T01:40:21.787517+0000","last_unstale":"2023-10-06T01:40:25.827267+0000","last_undegraded":"2023-10-06T01:40:25.827267+0000","last_fullsized":"2023-10-06T01:40:25.827267+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:58:41.783343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.849217+0000","last_change":"2023-10-06T01:40:25.844473+0000","last_active":"2023-10-06T01:40:25.849217+0000","last_peered":"2023-10-06T01:40:25.849217+0000","last_clean":"2023-10-06T01:40:25.849217+0000","last_became_active":"2023-10-06T01:40:25.844126+0000","last_became_peered":"2023-10-06T01:40:25.844126+0000","last_unstale":"2023-10-06T01:40:25.849217+0000","last_undegraded":"2023-10-06T01:40:25.849217+0000","last_fullsized":"2023-10-06T01:40:25.849217+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:08:08.709318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.826313+0000","last_change":"2023-10-06T01:40:16.781596+0000","last_active":"2023-10-06T01:40:25.826313+0000","last_peered":"2023-10-06T01:40:25.826313+0000","last_clean":"2023-10-06T01:40:25.826313+0000","last_became_active":"2023-10-06T01:40:16.781352+0000","last_became_peered":"2023-10-06T01:40:16.781352+0000","last_unstale":"2023-10-06T01:40:25.826313+0000","last_undegraded":"2023-10-06T01:40:25.826313+0000","last_fullsized":"2023-10-06T01:40:25.826313+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:52:43.316071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.825380+0000","last_change":"2023-10-06T01:40:20.783263+0000","last_active":"2023-10-06T01:40:25.825380+0000","last_peered":"2023-10-06T01:40:25.825380+0000","last_clean":"2023-10-06T01:40:25.825380+0000","last_became_active":"2023-10-06T01:40:20.781142+0000","last_became_peered":"2023-10-06T01:40:20.781142+0000","last_unstale":"2023-10-06T01:40:25.825380+0000","last_undegraded":"2023-10-06T01:40:25.825380+0000","last_fullsized":"2023-10-06T01:40:25.825380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:28:17.373431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.829970+0000","last_change":"2023-10-06T01:40:21.795215+0000","last_active":"2023-10-06T01:40:25.829970+0000","last_peered":"2023-10-06T01:40:25.829970+0000","last_clean":"2023-10-06T01:40:25.829970+0000","last_became_active":"2023-10-06T01:40:21.794141+0000","last_became_peered":"2023-10-06T01:40:21.794141+0000","last_unstale":"2023-10-06T01:40:25.829970+0000","last_undegraded":"2023-10-06T01:40:25.829970+0000","last_fullsized":"2023-10-06T01:40:25.829970+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:24:04.737047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.855244+0000","last_change":"2023-10-06T01:40:25.849723+0000","last_active":"2023-10-06T01:40:25.855244+0000","last_peered":"2023-10-06T01:40:25.855244+0000","last_clean":"2023-10-06T01:40:25.855244+0000","last_became_active":"2023-10-06T01:40:25.849315+0000","last_became_peered":"2023-10-06T01:40:25.849315+0000","last_unstale":"2023-10-06T01:40:25.855244+0000","last_undegraded":"2023-10-06T01:40:25.855244+0000","last_fullsized":"2023-10-06T01:40:25.855244+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:09:02.303009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821589+0000","last_change":"2023-10-06T01:40:16.650826+0000","last_active":"2023-10-06T01:40:25.821589+0000","last_peered":"2023-10-06T01:40:25.821589+0000","last_clean":"2023-10-06T01:40:25.821589+0000","last_became_active":"2023-10-06T01:40:16.650469+0000","last_became_peered":"2023-10-06T01:40:16.650469+0000","last_unstale":"2023-10-06T01:40:25.821589+0000","last_undegraded":"2023-10-06T01:40:25.821589+0000","last_fullsized":"2023-10-06T01:40:25.821589+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:50:23.628212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":170,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.828939+0000","last_change":"2023-10-06T01:40:10.645512+0000","last_active":"2023-10-06T01:40:25.828939+0000","last_peered":"2023-10-06T01:40:25.828939+0000","last_clean":"2023-10-06T01:40:25.828939+0000","last_became_active":"2023-10-06T01:40:10.644601+0000","last_became_peered":"2023-10-06T01:40:10.644601+0000","last_unstale":"2023-10-06T01:40:25.828939+0000","last_undegraded":"2023-10-06T01:40:25.828939+0000","last_fullsized":"2023-10-06T01:40:25.828939+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:09.580865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:09.580865+0000","last_clean_scrub_stamp":"2023-10-06T01:40:09.580865+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:05:28.268591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821362+0000","last_change":"2023-10-06T01:40:20.787092+0000","last_active":"2023-10-06T01:40:25.821362+0000","last_peered":"2023-10-06T01:40:25.821362+0000","last_clean":"2023-10-06T01:40:25.821362+0000","last_became_active":"2023-10-06T01:40:20.786835+0000","last_became_peered":"2023-10-06T01:40:20.786835+0000","last_unstale":"2023-10-06T01:40:25.821362+0000","last_undegraded":"2023-10-06T01:40:25.821362+0000","last_fullsized":"2023-10-06T01:40:25.821362+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:36.984892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.824208+0000","last_change":"2023-10-06T01:40:21.800342+0000","last_active":"2023-10-06T01:40:25.824208+0000","last_peered":"2023-10-06T01:40:25.824208+0000","last_clean":"2023-10-06T01:40:25.824208+0000","last_became_active":"2023-10-06T01:40:21.800077+0000","last_became_peered":"2023-10-06T01:40:21.800077+0000","last_unstale":"2023-10-06T01:40:25.824208+0000","last_undegraded":"2023-10-06T01:40:25.824208+0000","last_fullsized":"2023-10-06T01:40:25.824208+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:16:08.450725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.849960+0000","last_change":"2023-10-06T01:40:25.846010+0000","last_active":"2023-10-06T01:40:25.849960+0000","last_peered":"2023-10-06T01:40:25.849960+0000","last_clean":"2023-10-06T01:40:25.849960+0000","last_became_active":"2023-10-06T01:40:25.845564+0000","last_became_peered":"2023-10-06T01:40:25.845564+0000","last_unstale":"2023-10-06T01:40:25.849960+0000","last_undegraded":"2023-10-06T01:40:25.849960+0000","last_fullsized":"2023-10-06T01:40:25.849960+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:45.054717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.829152+0000","last_change":"2023-10-06T01:40:16.651332+0000","last_active":"2023-10-06T01:40:25.829152+0000","last_peered":"2023-10-06T01:40:25.829152+0000","last_clean":"2023-10-06T01:40:25.829152+0000","last_became_active":"2023-10-06T01:40:16.651049+0000","last_became_peered":"2023-10-06T01:40:16.651049+0000","last_unstale":"2023-10-06T01:40:25.829152+0000","last_undegraded":"2023-10-06T01:40:25.829152+0000","last_fullsized":"2023-10-06T01:40:25.829152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:11:57.218984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.838433+0000","last_change":"2023-10-06T01:40:20.793541+0000","last_active":"2023-10-06T01:40:25.838433+0000","last_peered":"2023-10-06T01:40:25.838433+0000","last_clean":"2023-10-06T01:40:25.838433+0000","last_became_active":"2023-10-06T01:40:20.793304+0000","last_became_peered":"2023-10-06T01:40:20.793304+0000","last_unstale":"2023-10-06T01:40:25.838433+0000","last_undegraded":"2023-10-06T01:40:25.838433+0000","last_fullsized":"2023-10-06T01:40:25.838433+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:05:51.063526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.839355+0000","last_change":"2023-10-06T01:40:21.797984+0000","last_active":"2023-10-06T01:40:25.839355+0000","last_peered":"2023-10-06T01:40:25.839355+0000","last_clean":"2023-10-06T01:40:25.839355+0000","last_became_active":"2023-10-06T01:40:21.797701+0000","last_became_peered":"2023-10-06T01:40:21.797701+0000","last_unstale":"2023-10-06T01:40:25.839355+0000","last_undegraded":"2023-10-06T01:40:25.839355+0000","last_fullsized":"2023-10-06T01:40:25.839355+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:26:58.497171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.840837+0000","last_change":"2023-10-06T01:40:25.838729+0000","last_active":"2023-10-06T01:40:25.840837+0000","last_peered":"2023-10-06T01:40:25.840837+0000","last_clean":"2023-10-06T01:40:25.840837+0000","last_became_active":"2023-10-06T01:40:25.838267+0000","last_became_peered":"2023-10-06T01:40:25.838267+0000","last_unstale":"2023-10-06T01:40:25.840837+0000","last_undegraded":"2023-10-06T01:40:25.840837+0000","last_fullsized":"2023-10-06T01:40:25.840837+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:50:33.749149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.829955+0000","last_change":"2023-10-06T01:40:16.931106+0000","last_active":"2023-10-06T01:40:25.829955+0000","last_peered":"2023-10-06T01:40:25.829955+0000","last_clean":"2023-10-06T01:40:25.829955+0000","last_became_active":"2023-10-06T01:40:16.930830+0000","last_became_peered":"2023-10-06T01:40:16.930830+0000","last_unstale":"2023-10-06T01:40:25.829955+0000","last_undegraded":"2023-10-06T01:40:25.829955+0000","last_fullsized":"2023-10-06T01:40:25.829955+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:50:23.628212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.827373+0000","last_change":"2023-10-06T01:40:20.788225+0000","last_active":"2023-10-06T01:40:25.827373+0000","last_peered":"2023-10-06T01:40:25.827373+0000","last_clean":"2023-10-06T01:40:25.827373+0000","last_became_active":"2023-10-06T01:40:20.787925+0000","last_became_peered":"2023-10-06T01:40:20.787925+0000","last_unstale":"2023-10-06T01:40:25.827373+0000","last_undegraded":"2023-10-06T01:40:25.827373+0000","last_fullsized":"2023-10-06T01:40:25.827373+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:40:52.187918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.838984+0000","last_change":"2023-10-06T01:40:21.798835+0000","last_active":"2023-10-06T01:40:25.838984+0000","last_peered":"2023-10-06T01:40:25.838984+0000","last_clean":"2023-10-06T01:40:25.838984+0000","last_became_active":"2023-10-06T01:40:21.798060+0000","last_became_peered":"2023-10-06T01:40:21.798060+0000","last_unstale":"2023-10-06T01:40:25.838984+0000","last_undegraded":"2023-10-06T01:40:25.838984+0000","last_fullsized":"2023-10-06T01:40:25.838984+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:04.038873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.853092+0000","last_change":"2023-10-06T01:40:25.842785+0000","last_active":"2023-10-06T01:40:25.853092+0000","last_peered":"2023-10-06T01:40:25.853092+0000","last_clean":"2023-10-06T01:40:25.853092+0000","last_became_active":"2023-10-06T01:40:25.842386+0000","last_became_peered":"2023-10-06T01:40:25.842386+0000","last_unstale":"2023-10-06T01:40:25.853092+0000","last_undegraded":"2023-10-06T01:40:25.853092+0000","last_fullsized":"2023-10-06T01:40:25.853092+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:21.192762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.822713+0000","last_change":"2023-10-06T01:40:20.791442+0000","last_active":"2023-10-06T01:40:25.822713+0000","last_peered":"2023-10-06T01:40:25.822713+0000","last_clean":"2023-10-06T01:40:25.822713+0000","last_became_active":"2023-10-06T01:40:20.791169+0000","last_became_peered":"2023-10-06T01:40:20.791169+0000","last_unstale":"2023-10-06T01:40:25.822713+0000","last_undegraded":"2023-10-06T01:40:25.822713+0000","last_fullsized":"2023-10-06T01:40:25.822713+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:26:03.577908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.827531+0000","last_change":"2023-10-06T01:40:16.649379+0000","last_active":"2023-10-06T01:40:25.827531+0000","last_peered":"2023-10-06T01:40:25.827531+0000","last_clean":"2023-10-06T01:40:25.827531+0000","last_became_active":"2023-10-06T01:40:16.649147+0000","last_became_peered":"2023-10-06T01:40:16.649147+0000","last_unstale":"2023-10-06T01:40:25.827531+0000","last_undegraded":"2023-10-06T01:40:25.827531+0000","last_fullsized":"2023-10-06T01:40:25.827531+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:11:57.218984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821612+0000","last_change":"2023-10-06T01:40:21.797861+0000","last_active":"2023-10-06T01:40:25.821612+0000","last_peered":"2023-10-06T01:40:25.821612+0000","last_clean":"2023-10-06T01:40:25.821612+0000","last_became_active":"2023-10-06T01:40:21.797626+0000","last_became_peered":"2023-10-06T01:40:21.797626+0000","last_unstale":"2023-10-06T01:40:25.821612+0000","last_undegraded":"2023-10-06T01:40:25.821612+0000","last_fullsized":"2023-10-06T01:40:25.821612+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:24:20.596942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.856358+0000","last_change":"2023-10-06T01:40:25.843290+0000","last_active":"2023-10-06T01:40:25.856358+0000","last_peered":"2023-10-06T01:40:25.856358+0000","last_clean":"2023-10-06T01:40:25.856358+0000","last_became_active":"2023-10-06T01:40:25.842953+0000","last_became_peered":"2023-10-06T01:40:25.842953+0000","last_unstale":"2023-10-06T01:40:25.856358+0000","last_undegraded":"2023-10-06T01:40:25.856358+0000","last_fullsized":"2023-10-06T01:40:25.856358+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:12:18.042310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.824283+0000","last_change":"2023-10-06T01:40:16.651477+0000","last_active":"2023-10-06T01:40:25.824283+0000","last_peered":"2023-10-06T01:40:25.824283+0000","last_clean":"2023-10-06T01:40:25.824283+0000","last_became_active":"2023-10-06T01:40:16.651190+0000","last_became_peered":"2023-10-06T01:40:16.651190+0000","last_unstale":"2023-10-06T01:40:25.824283+0000","last_undegraded":"2023-10-06T01:40:25.824283+0000","last_fullsized":"2023-10-06T01:40:25.824283+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:45:47.422876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"26'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:26.761975+0000","last_change":"2023-10-06T01:40:20.794641+0000","last_active":"2023-10-06T01:40:26.761975+0000","last_peered":"2023-10-06T01:40:26.761975+0000","last_clean":"2023-10-06T01:40:26.761975+0000","last_became_active":"2023-10-06T01:40:20.794360+0000","last_became_peered":"2023-10-06T01:40:20.794360+0000","last_unstale":"2023-10-06T01:40:26.761975+0000","last_undegraded":"2023-10-06T01:40:26.761975+0000","last_fullsized":"2023-10-06T01:40:26.761975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:40:52.187918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.834606+0000","last_change":"2023-10-06T01:40:21.791810+0000","last_active":"2023-10-06T01:40:25.834606+0000","last_peered":"2023-10-06T01:40:25.834606+0000","last_clean":"2023-10-06T01:40:25.834606+0000","last_became_active":"2023-10-06T01:40:21.791555+0000","last_became_peered":"2023-10-06T01:40:21.791555+0000","last_unstale":"2023-10-06T01:40:25.834606+0000","last_undegraded":"2023-10-06T01:40:25.834606+0000","last_fullsized":"2023-10-06T01:40:25.834606+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:24:20.596942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.856682+0000","last_change":"2023-10-06T01:40:25.849400+0000","last_active":"2023-10-06T01:40:25.856682+0000","last_peered":"2023-10-06T01:40:25.856682+0000","last_clean":"2023-10-06T01:40:25.856682+0000","last_became_active":"2023-10-06T01:40:25.849029+0000","last_became_peered":"2023-10-06T01:40:25.849029+0000","last_unstale":"2023-10-06T01:40:25.856682+0000","last_undegraded":"2023-10-06T01:40:25.856682+0000","last_fullsized":"2023-10-06T01:40:25.856682+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:33:05.597649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.839064+0000","last_change":"2023-10-06T01:40:20.794942+0000","last_active":"2023-10-06T01:40:25.839064+0000","last_peered":"2023-10-06T01:40:25.839064+0000","last_clean":"2023-10-06T01:40:25.839064+0000","last_became_active":"2023-10-06T01:40:20.794667+0000","last_became_peered":"2023-10-06T01:40:20.794667+0000","last_unstale":"2023-10-06T01:40:25.839064+0000","last_undegraded":"2023-10-06T01:40:25.839064+0000","last_fullsized":"2023-10-06T01:40:25.839064+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:28:17.373431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.827341+0000","last_change":"2023-10-06T01:40:21.784757+0000","last_active":"2023-10-06T01:40:25.827341+0000","last_peered":"2023-10-06T01:40:25.827341+0000","last_clean":"2023-10-06T01:40:25.827341+0000","last_became_active":"2023-10-06T01:40:21.784512+0000","last_became_peered":"2023-10-06T01:40:21.784512+0000","last_unstale":"2023-10-06T01:40:25.827341+0000","last_undegraded":"2023-10-06T01:40:25.827341+0000","last_fullsized":"2023-10-06T01:40:25.827341+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:37.988970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.854971+0000","last_change":"2023-10-06T01:40:25.844934+0000","last_active":"2023-10-06T01:40:25.854971+0000","last_peered":"2023-10-06T01:40:25.854971+0000","last_clean":"2023-10-06T01:40:25.854971+0000","last_became_active":"2023-10-06T01:40:25.844548+0000","last_became_peered":"2023-10-06T01:40:25.844548+0000","last_unstale":"2023-10-06T01:40:25.854971+0000","last_undegraded":"2023-10-06T01:40:25.854971+0000","last_fullsized":"2023-10-06T01:40:25.854971+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:22:48.941644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821739+0000","last_change":"2023-10-06T01:40:20.795699+0000","last_active":"2023-10-06T01:40:25.821739+0000","last_peered":"2023-10-06T01:40:25.821739+0000","last_clean":"2023-10-06T01:40:25.821739+0000","last_became_active":"2023-10-06T01:40:20.795401+0000","last_became_peered":"2023-10-06T01:40:20.795401+0000","last_unstale":"2023-10-06T01:40:25.821739+0000","last_undegraded":"2023-10-06T01:40:25.821739+0000","last_fullsized":"2023-10-06T01:40:25.821739+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:08:56.244189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.830737+0000","last_change":"2023-10-06T01:40:21.796905+0000","last_active":"2023-10-06T01:40:25.830737+0000","last_peered":"2023-10-06T01:40:25.830737+0000","last_clean":"2023-10-06T01:40:25.830737+0000","last_became_active":"2023-10-06T01:40:21.796623+0000","last_became_peered":"2023-10-06T01:40:21.796623+0000","last_unstale":"2023-10-06T01:40:25.830737+0000","last_undegraded":"2023-10-06T01:40:25.830737+0000","last_fullsized":"2023-10-06T01:40:25.830737+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:14:52.758971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.849027+0000","last_change":"2023-10-06T01:40:25.846338+0000","last_active":"2023-10-06T01:40:25.849027+0000","last_peered":"2023-10-06T01:40:25.849027+0000","last_clean":"2023-10-06T01:40:25.849027+0000","last_became_active":"2023-10-06T01:40:25.845938+0000","last_became_peered":"2023-10-06T01:40:25.845938+0000","last_unstale":"2023-10-06T01:40:25.849027+0000","last_undegraded":"2023-10-06T01:40:25.849027+0000","last_fullsized":"2023-10-06T01:40:25.849027+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:44:33.571977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821259+0000","last_change":"2023-10-06T01:40:20.790034+0000","last_active":"2023-10-06T01:40:25.821259+0000","last_peered":"2023-10-06T01:40:25.821259+0000","last_clean":"2023-10-06T01:40:25.821259+0000","last_became_active":"2023-10-06T01:40:20.789692+0000","last_became_peered":"2023-10-06T01:40:20.789692+0000","last_unstale":"2023-10-06T01:40:25.821259+0000","last_undegraded":"2023-10-06T01:40:25.821259+0000","last_fullsized":"2023-10-06T01:40:25.821259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:06:10.010505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.831832+0000","last_change":"2023-10-06T01:40:21.790538+0000","last_active":"2023-10-06T01:40:25.831832+0000","last_peered":"2023-10-06T01:40:25.831832+0000","last_clean":"2023-10-06T01:40:25.831832+0000","last_became_active":"2023-10-06T01:40:21.790281+0000","last_became_peered":"2023-10-06T01:40:21.790281+0000","last_unstale":"2023-10-06T01:40:25.831832+0000","last_undegraded":"2023-10-06T01:40:25.831832+0000","last_fullsized":"2023-10-06T01:40:25.831832+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:26:58.497171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.853306+0000","last_change":"2023-10-06T01:40:25.845691+0000","last_active":"2023-10-06T01:40:25.853306+0000","last_peered":"2023-10-06T01:40:25.853306+0000","last_clean":"2023-10-06T01:40:25.853306+0000","last_became_active":"2023-10-06T01:40:25.843152+0000","last_became_peered":"2023-10-06T01:40:25.843152+0000","last_unstale":"2023-10-06T01:40:25.853306+0000","last_undegraded":"2023-10-06T01:40:25.853306+0000","last_fullsized":"2023-10-06T01:40:25.853306+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:05:21.358447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821427+0000","last_change":"2023-10-06T01:40:20.787411+0000","last_active":"2023-10-06T01:40:25.821427+0000","last_peered":"2023-10-06T01:40:25.821427+0000","last_clean":"2023-10-06T01:40:25.821427+0000","last_became_active":"2023-10-06T01:40:20.787144+0000","last_became_peered":"2023-10-06T01:40:20.787144+0000","last_unstale":"2023-10-06T01:40:25.821427+0000","last_undegraded":"2023-10-06T01:40:25.821427+0000","last_fullsized":"2023-10-06T01:40:25.821427+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:22:22.604958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821801+0000","last_change":"2023-10-06T01:40:21.783499+0000","last_active":"2023-10-06T01:40:25.821801+0000","last_peered":"2023-10-06T01:40:25.821801+0000","last_clean":"2023-10-06T01:40:25.821801+0000","last_became_active":"2023-10-06T01:40:21.783032+0000","last_became_peered":"2023-10-06T01:40:21.783032+0000","last_unstale":"2023-10-06T01:40:25.821801+0000","last_undegraded":"2023-10-06T01:40:25.821801+0000","last_fullsized":"2023-10-06T01:40:25.821801+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:26:58.497171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.856721+0000","last_change":"2023-10-06T01:40:25.852998+0000","last_active":"2023-10-06T01:40:25.856721+0000","last_peered":"2023-10-06T01:40:25.856721+0000","last_clean":"2023-10-06T01:40:25.856721+0000","last_became_active":"2023-10-06T01:40:25.852607+0000","last_became_peered":"2023-10-06T01:40:25.852607+0000","last_unstale":"2023-10-06T01:40:25.856721+0000","last_undegraded":"2023-10-06T01:40:25.856721+0000","last_fullsized":"2023-10-06T01:40:25.856721+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:22:48.941644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.840188+0000","last_change":"2023-10-06T01:40:20.791988+0000","last_active":"2023-10-06T01:40:25.840188+0000","last_peered":"2023-10-06T01:40:25.840188+0000","last_clean":"2023-10-06T01:40:25.840188+0000","last_became_active":"2023-10-06T01:40:20.791712+0000","last_became_peered":"2023-10-06T01:40:20.791712+0000","last_unstale":"2023-10-06T01:40:25.840188+0000","last_undegraded":"2023-10-06T01:40:25.840188+0000","last_fullsized":"2023-10-06T01:40:25.840188+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:08:56.244189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.830146+0000","last_change":"2023-10-06T01:40:21.797245+0000","last_active":"2023-10-06T01:40:25.830146+0000","last_peered":"2023-10-06T01:40:25.830146+0000","last_clean":"2023-10-06T01:40:25.830146+0000","last_became_active":"2023-10-06T01:40:21.796983+0000","last_became_peered":"2023-10-06T01:40:21.796983+0000","last_unstale":"2023-10-06T01:40:25.830146+0000","last_undegraded":"2023-10-06T01:40:25.830146+0000","last_fullsized":"2023-10-06T01:40:25.830146+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:56:02.274884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.822902+0000","last_change":"2023-10-06T01:40:21.778624+0000","last_active":"2023-10-06T01:40:25.822902+0000","last_peered":"2023-10-06T01:40:25.822902+0000","last_clean":"2023-10-06T01:40:25.822902+0000","last_became_active":"2023-10-06T01:40:21.778327+0000","last_became_peered":"2023-10-06T01:40:21.778327+0000","last_unstale":"2023-10-06T01:40:25.822902+0000","last_undegraded":"2023-10-06T01:40:25.822902+0000","last_fullsized":"2023-10-06T01:40:25.822902+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:54:12.557739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821944+0000","last_change":"2023-10-06T01:40:21.784238+0000","last_active":"2023-10-06T01:40:25.821944+0000","last_peered":"2023-10-06T01:40:25.821944+0000","last_clean":"2023-10-06T01:40:25.821944+0000","last_became_active":"2023-10-06T01:40:21.783952+0000","last_became_peered":"2023-10-06T01:40:21.783952+0000","last_unstale":"2023-10-06T01:40:25.821944+0000","last_undegraded":"2023-10-06T01:40:25.821944+0000","last_fullsized":"2023-10-06T01:40:25.821944+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:29:36.526509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.832179+0000","last_change":"2023-10-06T01:40:21.797310+0000","last_active":"2023-10-06T01:40:25.832179+0000","last_peered":"2023-10-06T01:40:25.832179+0000","last_clean":"2023-10-06T01:40:25.832179+0000","last_became_active":"2023-10-06T01:40:21.797085+0000","last_became_peered":"2023-10-06T01:40:21.797085+0000","last_unstale":"2023-10-06T01:40:25.832179+0000","last_undegraded":"2023-10-06T01:40:25.832179+0000","last_fullsized":"2023-10-06T01:40:25.832179+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:23:08.571763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821415+0000","last_change":"2023-10-06T01:40:21.797623+0000","last_active":"2023-10-06T01:40:25.821415+0000","last_peered":"2023-10-06T01:40:25.821415+0000","last_clean":"2023-10-06T01:40:25.821415+0000","last_became_active":"2023-10-06T01:40:21.797365+0000","last_became_peered":"2023-10-06T01:40:21.797365+0000","last_unstale":"2023-10-06T01:40:25.821415+0000","last_undegraded":"2023-10-06T01:40:25.821415+0000","last_fullsized":"2023-10-06T01:40:25.821415+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:39:44.521327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.827357+0000","last_change":"2023-10-06T01:40:21.791795+0000","last_active":"2023-10-06T01:40:25.827357+0000","last_peered":"2023-10-06T01:40:25.827357+0000","last_clean":"2023-10-06T01:40:25.827357+0000","last_became_active":"2023-10-06T01:40:21.791427+0000","last_became_peered":"2023-10-06T01:40:21.791427+0000","last_unstale":"2023-10-06T01:40:25.827357+0000","last_undegraded":"2023-10-06T01:40:25.827357+0000","last_fullsized":"2023-10-06T01:40:25.827357+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:26:58.497171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4484,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298180,"kb_used_data":892,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073660,"statfs":{"total":96636764160,"available":96331427840,"internally_reserved":0,"allocated":913408,"data_stored":713871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297572,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074268,"statfs":{"total":96636764160,"available":96332050432,"internally_reserved":0,"allocated":290816,"data_stored":119573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297572,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074268,"statfs":{"total":96636764160,"available":96332050432,"internally_reserved":0,"allocated":290816,"data_stored":119573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34499999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.311}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298152,"kb_used_data":864,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073688,"statfs":{"total":96636764160,"available":96331456512,"internally_reserved":0,"allocated":884736,"data_stored":709534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]}]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297572,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074268,"statfs":{"total":96636764160,"available":96332050432,"internally_reserved":0,"allocated":290816,"data_stored":119573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297576,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074264,"statfs":{"total":96636764160,"available":96332046336,"internally_reserved":0,"allocated":294912,"data_stored":119663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.311}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297592,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074248,"statfs":{"total":96636764160,"available":96332029952,"internally_reserved":0,"allocated":311296,"data_stored":123343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0549999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.0780000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.149}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]}]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297580,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074260,"statfs":{"total":96636764160,"available":96332042240,"internally_reserved":0,"allocated":299008,"data_stored":120197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28299999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T01:40:45.443 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T01:40:45.589 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.587+0000 7f44b0b9d700 1 Processor -- start 2023-10-06T01:40:45.589 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.587+0000 7f44b0b9d700 1 -- start start 2023-10-06T01:40:45.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.588+0000 7f44b0b9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f44ac0af4e0 0x7f44ac0b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:45.590 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.588+0000 7f44b0b9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f44ac0af8b0 0x7f44ac0b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:45.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.588+0000 7f44b0b9d700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44ac15e190 con 0x7f44ac15d460 2023-10-06T01:40:45.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.588+0000 7f44b0b9d700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44ac0b1910 con 0x7f44ac0af8b0 2023-10-06T01:40:45.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.588+0000 7f44b0b9d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44ac15dfb0 con 0x7f44ac0af4e0 2023-10-06T01:40:45.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.588+0000 7f44a1d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f44ac0af8b0 0x7f44ac0b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:45.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.588+0000 7f44aa59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f44ac0af4e0 0x7f44ac0b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:45.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.588+0000 7f44aad9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f44ac15d460 0x7f44ac15d8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.71:40774/0 (socket says 172.21.15.71:40774) 2023-10-06T01:40:45.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.588+0000 7f44aad9d700 1 -- 172.21.15.71:0/3954060039 learned_addr learned my addr 172.21.15.71:0/3954060039 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:40:45.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.589+0000 7f44aa59c700 1 -- 172.21.15.71:0/3954060039 >> v2:172.21.15.72:3300/0 conn(0x7f44ac0af8b0 msgr2=0x7f44ac0b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:45.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.589+0000 7f44aa59c700 1 --2- 172.21.15.71:0/3954060039 >> v2:172.21.15.72:3300/0 conn(0x7f44ac0af8b0 0x7f44ac0b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:45.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.589+0000 7f44aa59c700 1 -- 172.21.15.71:0/3954060039 >> v1:172.21.15.72:6789/0 conn(0x7f44ac15d460 legacy=0x7f44ac15d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:45.591 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.589+0000 7f44aa59c700 1 -- 172.21.15.71:0/3954060039 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44ac0cb650 con 0x7f44ac0af4e0 2023-10-06T01:40:45.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.589+0000 7f44aa59c700 1 --2- 172.21.15.71:0/3954060039 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f44ac0af4e0 0x7f44ac0b20e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f449c0098e0 tx=0x7f449c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b660b5ee35106ab5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:45.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.589+0000 7f44a9d9b700 1 -- 172.21.15.71:0/3954060039 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f449c00b640 con 0x7f44ac0af4e0 2023-10-06T01:40:45.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.589+0000 7f44a9d9b700 1 -- 172.21.15.71:0/3954060039 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f449c00b7a0 con 0x7f44ac0af4e0 2023-10-06T01:40:45.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.589+0000 7f44a9d9b700 1 -- 172.21.15.71:0/3954060039 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f449c00bb40 con 0x7f44ac0af4e0 2023-10-06T01:40:45.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.589+0000 7f44b0b9d700 1 -- 172.21.15.71:0/3954060039 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f44ac0af4e0 msgr2=0x7f44ac0b20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:45.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.589+0000 7f44b0b9d700 1 --2- 172.21.15.71:0/3954060039 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f44ac0af4e0 0x7f44ac0b20e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f449c0098e0 tx=0x7f449c0091a0 comp rx=0 tx=0).stop 2023-10-06T01:40:45.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.589+0000 7f44b0b9d700 1 -- 172.21.15.71:0/3954060039 shutdown_connections 2023-10-06T01:40:45.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.589+0000 7f44b0b9d700 1 --2- 172.21.15.71:0/3954060039 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f44ac0af4e0 0x7f44ac0b20e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:45.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.589+0000 7f44b0b9d700 1 --2- 172.21.15.71:0/3954060039 >> v2:172.21.15.72:3300/0 conn(0x7f44ac0af8b0 0x7f44ac0b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:45.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.589+0000 7f44b0b9d700 1 -- 172.21.15.71:0/3954060039 >> 172.21.15.71:0/3954060039 conn(0x7f44ac068680 msgr2=0x7f44ac068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:45.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.589+0000 7f44b0b9d700 1 -- 172.21.15.71:0/3954060039 shutdown_connections 2023-10-06T01:40:45.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.590+0000 7f44b0b9d700 1 -- 172.21.15.71:0/3954060039 wait complete. 2023-10-06T01:40:45.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.591+0000 7f44b0b9d700 1 Processor -- start 2023-10-06T01:40:45.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.591+0000 7f44b0b9d700 1 -- start start 2023-10-06T01:40:45.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.591+0000 7f44b0b9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44ac0af4e0 0x7f44ac169950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:45.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.591+0000 7f44b0b9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f44ac0af8b0 0x7f44ac0b3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:45.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.591+0000 7f44b0b9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f44ac15d460 0x7f44ac150690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:45.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.591+0000 7f44b0b9d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44ac152680 con 0x7f44ac15d460 2023-10-06T01:40:45.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.591+0000 7f44b0b9d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44ac0b4420 con 0x7f44ac0af4e0 2023-10-06T01:40:45.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.591+0000 7f44b0b9d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44ac0b4700 con 0x7f44ac0af8b0 2023-10-06T01:40:45.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.592+0000 7f44aad9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f44ac15d460 0x7f44ac150690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:45.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.592+0000 7f44aad9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f44ac15d460 0x7f44ac150690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47704/0 (socket says 172.21.15.71:47704) 2023-10-06T01:40:45.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.592+0000 7f44aad9d700 1 -- 172.21.15.71:0/3703720735 learned_addr learned my addr 172.21.15.71:0/3703720735 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:45.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.592+0000 7f44aa59c700 1 --2- 172.21.15.71:0/3703720735 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44ac0af4e0 0x7f44ac169950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:45.596 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.592+0000 7f44a1d9b700 1 --2- 172.21.15.71:0/3703720735 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f44ac0af8b0 0x7f44ac0b3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:45.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.592+0000 7f44aad9d700 1 -- 172.21.15.71:0/3703720735 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f44ac0af8b0 msgr2=0x7f44ac0b3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:45.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.592+0000 7f44aad9d700 1 --2- 172.21.15.71:0/3703720735 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f44ac0af8b0 0x7f44ac0b3a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:45.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.592+0000 7f44aad9d700 1 -- 172.21.15.71:0/3703720735 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44ac0af4e0 msgr2=0x7f44ac169950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:45.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.592+0000 7f44aad9d700 1 --2- 172.21.15.71:0/3703720735 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44ac0af4e0 0x7f44ac169950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:45.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.592+0000 7f44aad9d700 1 -- 172.21.15.71:0/3703720735 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f449c009420 con 0x7f44ac15d460 2023-10-06T01:40:45.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.592+0000 7f44aad9d700 1 --2- 172.21.15.71:0/3703720735 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f44ac15d460 0x7f44ac150690 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f44a400cc70 tx=0x7f44a4001a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:45.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.592+0000 7f44a2ffd700 1 -- 172.21.15.71:0/3703720735 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a400a830 con 0x7f44ac15d460 2023-10-06T01:40:45.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.592+0000 7f44a2ffd700 1 -- 172.21.15.71:0/3703720735 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44a400a9b0 con 0x7f44ac15d460 2023-10-06T01:40:45.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.592+0000 7f44b0b9d700 1 -- 172.21.15.71:0/3703720735 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44ac0b49e0 con 0x7f44ac15d460 2023-10-06T01:40:45.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.592+0000 7f44a2ffd700 1 -- 172.21.15.71:0/3703720735 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a400ad70 con 0x7f44ac15d460 2023-10-06T01:40:45.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.592+0000 7f44b0b9d700 1 -- 172.21.15.71:0/3703720735 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44ac169e90 con 0x7f44ac15d460 2023-10-06T01:40:45.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.593+0000 7f44b0b9d700 1 -- 172.21.15.71:0/3703720735 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44ac1524c0 con 0x7f44ac15d460 2023-10-06T01:40:45.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.594+0000 7f44a2ffd700 1 -- 172.21.15.71:0/3703720735 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f44a4007300 con 0x7f44ac15d460 2023-10-06T01:40:45.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.594+0000 7f44a2ffd700 1 --2- 172.21.15.71:0/3703720735 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f448c066f30 0x7f448c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:45.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.594+0000 7f44a2ffd700 1 -- 172.21.15.71:0/3703720735 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f44a4084bc0 con 0x7f44ac15d460 2023-10-06T01:40:45.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.594+0000 7f44aa59c700 1 --2- 172.21.15.71:0/3703720735 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f448c066f30 0x7f448c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:45.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.594+0000 7f44aa59c700 1 --2- 172.21.15.71:0/3703720735 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f448c066f30 0x7f448c0693e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f449c0091e0 tx=0x7f449c017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:45.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.598+0000 7f44a2ffd700 1 -- 172.21.15.71:0/3703720735 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f44ac1524c0 con 0x7f44ac15d460 2023-10-06T01:40:45.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.778+0000 7f44b0b9d700 1 -- 172.21.15.71:0/3703720735 --> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f44ac1524c0 con 0x7f448c066f30 2023-10-06T01:40:45.790 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.788+0000 7f44a2ffd700 1 -- 172.21.15.71:0/3703720735 <== mgr.4107 v2:172.21.15.71:6832/90436 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367328 (secure 0 0 0) 0x7f44ac1524c0 con 0x7f448c066f30 2023-10-06T01:40:45.794 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:40:45.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.792+0000 7f44b0b9d700 1 -- 172.21.15.71:0/3703720735 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f448c066f30 msgr2=0x7f448c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:45.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.792+0000 7f44b0b9d700 1 --2- 172.21.15.71:0/3703720735 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f448c066f30 0x7f448c0693e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f449c0091e0 tx=0x7f449c017000 comp rx=0 tx=0).stop 2023-10-06T01:40:45.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.792+0000 7f44b0b9d700 1 -- 172.21.15.71:0/3703720735 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f44ac15d460 msgr2=0x7f44ac150690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:45.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.792+0000 7f44b0b9d700 1 --2- 172.21.15.71:0/3703720735 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f44ac15d460 0x7f44ac150690 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f44a400cc70 tx=0x7f44a4001a10 comp rx=0 tx=0).stop 2023-10-06T01:40:45.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.792+0000 7f44b0b9d700 1 -- 172.21.15.71:0/3703720735 shutdown_connections 2023-10-06T01:40:45.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.792+0000 7f44b0b9d700 1 --2- 172.21.15.71:0/3703720735 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f44ac15d460 0x7f44ac150690 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:45.798 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.792+0000 7f44b0b9d700 1 --2- 172.21.15.71:0/3703720735 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f448c066f30 0x7f448c0693e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:45.798 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.792+0000 7f44b0b9d700 1 --2- 172.21.15.71:0/3703720735 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44ac0af4e0 0x7f44ac169950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:45.798 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.792+0000 7f44b0b9d700 1 --2- 172.21.15.71:0/3703720735 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f44ac0af8b0 0x7f44ac0b3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:45.798 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.792+0000 7f44b0b9d700 1 -- 172.21.15.71:0/3703720735 >> 172.21.15.71:0/3703720735 conn(0x7f44ac068680 msgr2=0x7f44ac0d0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:45.798 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.792+0000 7f44b0b9d700 1 -- 172.21.15.71:0/3703720735 shutdown_connections 2023-10-06T01:40:45.798 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.792+0000 7f44b0b9d700 1 -- 172.21.15.71:0/3703720735 wait complete. 2023-10-06T01:40:45.798 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2023-10-06T01:40:45.806 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2023-10-06T01:40:44.568877+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594852,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381796,"kb_used_data":3492,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752592924,"statfs":{"total":773094113280,"available":770655154176,"internally_reserved":0,"allocated":3575808,"data_stored":2145327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2178,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004288"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.827077+0000","last_change":"2023-10-06T01:40:21.784720+0000","last_active":"2023-10-06T01:40:25.827077+0000","last_peered":"2023-10-06T01:40:25.827077+0000","last_clean":"2023-10-06T01:40:25.827077+0000","last_became_active":"2023-10-06T01:40:21.784463+0000","last_became_peered":"2023-10-06T01:40:21.784463+0000","last_unstale":"2023-10-06T01:40:25.827077+0000","last_undegraded":"2023-10-06T01:40:25.827077+0000","last_fullsized":"2023-10-06T01:40:25.827077+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:06:11.014583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821980+0000","last_change":"2023-10-06T01:40:21.795765+0000","last_active":"2023-10-06T01:40:25.821980+0000","last_peered":"2023-10-06T01:40:25.821980+0000","last_clean":"2023-10-06T01:40:25.821980+0000","last_became_active":"2023-10-06T01:40:21.795508+0000","last_became_peered":"2023-10-06T01:40:21.795508+0000","last_unstale":"2023-10-06T01:40:25.821980+0000","last_undegraded":"2023-10-06T01:40:25.821980+0000","last_fullsized":"2023-10-06T01:40:25.821980+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:24:04.737047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.829737+0000","last_change":"2023-10-06T01:40:21.801764+0000","last_active":"2023-10-06T01:40:25.829737+0000","last_peered":"2023-10-06T01:40:25.829737+0000","last_clean":"2023-10-06T01:40:25.829737+0000","last_became_active":"2023-10-06T01:40:21.801511+0000","last_became_peered":"2023-10-06T01:40:21.801511+0000","last_unstale":"2023-10-06T01:40:25.829737+0000","last_undegraded":"2023-10-06T01:40:25.829737+0000","last_fullsized":"2023-10-06T01:40:25.829737+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:53:19.501226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.824060+0000","last_change":"2023-10-06T01:40:21.796935+0000","last_active":"2023-10-06T01:40:25.824060+0000","last_peered":"2023-10-06T01:40:25.824060+0000","last_clean":"2023-10-06T01:40:25.824060+0000","last_became_active":"2023-10-06T01:40:21.796664+0000","last_became_peered":"2023-10-06T01:40:21.796664+0000","last_unstale":"2023-10-06T01:40:25.824060+0000","last_undegraded":"2023-10-06T01:40:25.824060+0000","last_fullsized":"2023-10-06T01:40:25.824060+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:18:43.064747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.838848+0000","last_change":"2023-10-06T01:40:21.798926+0000","last_active":"2023-10-06T01:40:25.838848+0000","last_peered":"2023-10-06T01:40:25.838848+0000","last_clean":"2023-10-06T01:40:25.838848+0000","last_became_active":"2023-10-06T01:40:21.798342+0000","last_became_peered":"2023-10-06T01:40:21.798342+0000","last_unstale":"2023-10-06T01:40:25.838848+0000","last_undegraded":"2023-10-06T01:40:25.838848+0000","last_fullsized":"2023-10-06T01:40:25.838848+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:29:36.526509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.832097+0000","last_change":"2023-10-06T01:40:21.801493+0000","last_active":"2023-10-06T01:40:25.832097+0000","last_peered":"2023-10-06T01:40:25.832097+0000","last_clean":"2023-10-06T01:40:25.832097+0000","last_became_active":"2023-10-06T01:40:21.801200+0000","last_became_peered":"2023-10-06T01:40:21.801200+0000","last_unstale":"2023-10-06T01:40:25.832097+0000","last_undegraded":"2023-10-06T01:40:25.832097+0000","last_fullsized":"2023-10-06T01:40:25.832097+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:16:01.004830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.836158+0000","last_change":"2023-10-06T01:40:21.797032+0000","last_active":"2023-10-06T01:40:25.836158+0000","last_peered":"2023-10-06T01:40:25.836158+0000","last_clean":"2023-10-06T01:40:25.836158+0000","last_became_active":"2023-10-06T01:40:21.796712+0000","last_became_peered":"2023-10-06T01:40:21.796712+0000","last_unstale":"2023-10-06T01:40:25.836158+0000","last_undegraded":"2023-10-06T01:40:25.836158+0000","last_fullsized":"2023-10-06T01:40:25.836158+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:04.038873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821476+0000","last_change":"2023-10-06T01:40:21.791132+0000","last_active":"2023-10-06T01:40:25.821476+0000","last_peered":"2023-10-06T01:40:25.821476+0000","last_clean":"2023-10-06T01:40:25.821476+0000","last_became_active":"2023-10-06T01:40:21.790446+0000","last_became_peered":"2023-10-06T01:40:21.790446+0000","last_unstale":"2023-10-06T01:40:25.821476+0000","last_undegraded":"2023-10-06T01:40:25.821476+0000","last_fullsized":"2023-10-06T01:40:25.821476+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:40:45.624442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.839970+0000","last_change":"2023-10-06T01:40:21.793869+0000","last_active":"2023-10-06T01:40:25.839970+0000","last_peered":"2023-10-06T01:40:25.839970+0000","last_clean":"2023-10-06T01:40:25.839970+0000","last_became_active":"2023-10-06T01:40:21.793596+0000","last_became_peered":"2023-10-06T01:40:21.793596+0000","last_unstale":"2023-10-06T01:40:25.839970+0000","last_undegraded":"2023-10-06T01:40:25.839970+0000","last_fullsized":"2023-10-06T01:40:25.839970+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:24:04.737047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.822068+0000","last_change":"2023-10-06T01:40:21.798541+0000","last_active":"2023-10-06T01:40:25.822068+0000","last_peered":"2023-10-06T01:40:25.822068+0000","last_clean":"2023-10-06T01:40:25.822068+0000","last_became_active":"2023-10-06T01:40:21.798271+0000","last_became_peered":"2023-10-06T01:40:21.798271+0000","last_unstale":"2023-10-06T01:40:25.822068+0000","last_undegraded":"2023-10-06T01:40:25.822068+0000","last_fullsized":"2023-10-06T01:40:25.822068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:14:30.814494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.829653+0000","last_change":"2023-10-06T01:40:21.798043+0000","last_active":"2023-10-06T01:40:25.829653+0000","last_peered":"2023-10-06T01:40:25.829653+0000","last_clean":"2023-10-06T01:40:25.829653+0000","last_became_active":"2023-10-06T01:40:21.797768+0000","last_became_peered":"2023-10-06T01:40:21.797768+0000","last_unstale":"2023-10-06T01:40:25.829653+0000","last_undegraded":"2023-10-06T01:40:25.829653+0000","last_fullsized":"2023-10-06T01:40:25.829653+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:39:44.521327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.826805+0000","last_change":"2023-10-06T01:40:21.783366+0000","last_active":"2023-10-06T01:40:25.826805+0000","last_peered":"2023-10-06T01:40:25.826805+0000","last_clean":"2023-10-06T01:40:25.826805+0000","last_became_active":"2023-10-06T01:40:21.783102+0000","last_became_peered":"2023-10-06T01:40:21.783102+0000","last_unstale":"2023-10-06T01:40:25.826805+0000","last_undegraded":"2023-10-06T01:40:25.826805+0000","last_fullsized":"2023-10-06T01:40:25.826805+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:22:12.634757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.826660+0000","last_change":"2023-10-06T01:40:21.789603+0000","last_active":"2023-10-06T01:40:25.826660+0000","last_peered":"2023-10-06T01:40:25.826660+0000","last_clean":"2023-10-06T01:40:25.826660+0000","last_became_active":"2023-10-06T01:40:21.789423+0000","last_became_peered":"2023-10-06T01:40:21.789423+0000","last_unstale":"2023-10-06T01:40:25.826660+0000","last_undegraded":"2023-10-06T01:40:25.826660+0000","last_fullsized":"2023-10-06T01:40:25.826660+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:26:04.581987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821407+0000","last_change":"2023-10-06T01:40:21.786154+0000","last_active":"2023-10-06T01:40:25.821407+0000","last_peered":"2023-10-06T01:40:25.821407+0000","last_clean":"2023-10-06T01:40:25.821407+0000","last_became_active":"2023-10-06T01:40:21.785883+0000","last_became_peered":"2023-10-06T01:40:21.785883+0000","last_unstale":"2023-10-06T01:40:25.821407+0000","last_undegraded":"2023-10-06T01:40:25.821407+0000","last_fullsized":"2023-10-06T01:40:25.821407+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:58:41.783343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.835961+0000","last_change":"2023-10-06T01:40:21.794272+0000","last_active":"2023-10-06T01:40:25.835961+0000","last_peered":"2023-10-06T01:40:25.835961+0000","last_clean":"2023-10-06T01:40:25.835961+0000","last_became_active":"2023-10-06T01:40:21.794004+0000","last_became_peered":"2023-10-06T01:40:21.794004+0000","last_unstale":"2023-10-06T01:40:25.835961+0000","last_undegraded":"2023-10-06T01:40:25.835961+0000","last_fullsized":"2023-10-06T01:40:25.835961+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:14:30.814494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.830236+0000","last_change":"2023-10-06T01:40:21.799382+0000","last_active":"2023-10-06T01:40:25.830236+0000","last_peered":"2023-10-06T01:40:25.830236+0000","last_clean":"2023-10-06T01:40:25.830236+0000","last_became_active":"2023-10-06T01:40:21.799078+0000","last_became_peered":"2023-10-06T01:40:21.799078+0000","last_unstale":"2023-10-06T01:40:25.830236+0000","last_undegraded":"2023-10-06T01:40:25.830236+0000","last_fullsized":"2023-10-06T01:40:25.830236+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:09:24.820551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.840050+0000","last_change":"2023-10-06T01:40:21.793399+0000","last_active":"2023-10-06T01:40:25.840050+0000","last_peered":"2023-10-06T01:40:25.840050+0000","last_clean":"2023-10-06T01:40:25.840050+0000","last_became_active":"2023-10-06T01:40:21.793155+0000","last_became_peered":"2023-10-06T01:40:21.793155+0000","last_unstale":"2023-10-06T01:40:25.840050+0000","last_undegraded":"2023-10-06T01:40:25.840050+0000","last_fullsized":"2023-10-06T01:40:25.840050+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:58:41.783343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.827729+0000","last_change":"2023-10-06T01:40:21.796081+0000","last_active":"2023-10-06T01:40:25.827729+0000","last_peered":"2023-10-06T01:40:25.827729+0000","last_clean":"2023-10-06T01:40:25.827729+0000","last_became_active":"2023-10-06T01:40:21.795755+0000","last_became_peered":"2023-10-06T01:40:21.795755+0000","last_unstale":"2023-10-06T01:40:25.827729+0000","last_undegraded":"2023-10-06T01:40:25.827729+0000","last_fullsized":"2023-10-06T01:40:25.827729+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:26:01.813573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.826585+0000","last_change":"2023-10-06T01:40:21.783713+0000","last_active":"2023-10-06T01:40:25.826585+0000","last_peered":"2023-10-06T01:40:25.826585+0000","last_clean":"2023-10-06T01:40:25.826585+0000","last_became_active":"2023-10-06T01:40:21.783410+0000","last_became_peered":"2023-10-06T01:40:21.783410+0000","last_unstale":"2023-10-06T01:40:25.826585+0000","last_undegraded":"2023-10-06T01:40:25.826585+0000","last_fullsized":"2023-10-06T01:40:25.826585+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:08:57.248267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.830504+0000","last_change":"2023-10-06T01:40:21.784490+0000","last_active":"2023-10-06T01:40:25.830504+0000","last_peered":"2023-10-06T01:40:25.830504+0000","last_clean":"2023-10-06T01:40:25.830504+0000","last_became_active":"2023-10-06T01:40:21.783963+0000","last_became_peered":"2023-10-06T01:40:21.783963+0000","last_unstale":"2023-10-06T01:40:25.830504+0000","last_undegraded":"2023-10-06T01:40:25.830504+0000","last_fullsized":"2023-10-06T01:40:25.830504+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:57:45.536353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.827932+0000","last_change":"2023-10-06T01:40:21.800162+0000","last_active":"2023-10-06T01:40:25.827932+0000","last_peered":"2023-10-06T01:40:25.827932+0000","last_clean":"2023-10-06T01:40:25.827932+0000","last_became_active":"2023-10-06T01:40:21.799563+0000","last_became_peered":"2023-10-06T01:40:21.799563+0000","last_unstale":"2023-10-06T01:40:25.827932+0000","last_undegraded":"2023-10-06T01:40:25.827932+0000","last_fullsized":"2023-10-06T01:40:25.827932+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:26:58.497171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.838626+0000","last_change":"2023-10-06T01:40:21.794761+0000","last_active":"2023-10-06T01:40:25.838626+0000","last_peered":"2023-10-06T01:40:25.838626+0000","last_clean":"2023-10-06T01:40:25.838626+0000","last_became_active":"2023-10-06T01:40:21.794528+0000","last_became_peered":"2023-10-06T01:40:21.794528+0000","last_unstale":"2023-10-06T01:40:25.838626+0000","last_undegraded":"2023-10-06T01:40:25.838626+0000","last_fullsized":"2023-10-06T01:40:25.838626+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:40:45.624442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821624+0000","last_change":"2023-10-06T01:40:21.797159+0000","last_active":"2023-10-06T01:40:25.821624+0000","last_peered":"2023-10-06T01:40:25.821624+0000","last_clean":"2023-10-06T01:40:25.821624+0000","last_became_active":"2023-10-06T01:40:21.796930+0000","last_became_peered":"2023-10-06T01:40:21.796930+0000","last_unstale":"2023-10-06T01:40:25.821624+0000","last_undegraded":"2023-10-06T01:40:25.821624+0000","last_fullsized":"2023-10-06T01:40:25.821624+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:14:30.814494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.831663+0000","last_change":"2023-10-06T01:40:21.800667+0000","last_active":"2023-10-06T01:40:25.831663+0000","last_peered":"2023-10-06T01:40:25.831663+0000","last_clean":"2023-10-06T01:40:25.831663+0000","last_became_active":"2023-10-06T01:40:21.799665+0000","last_became_peered":"2023-10-06T01:40:21.799665+0000","last_unstale":"2023-10-06T01:40:25.831663+0000","last_undegraded":"2023-10-06T01:40:25.831663+0000","last_fullsized":"2023-10-06T01:40:25.831663+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:29:36.526509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.829892+0000","last_change":"2023-10-06T01:40:21.795383+0000","last_active":"2023-10-06T01:40:25.829892+0000","last_peered":"2023-10-06T01:40:25.829892+0000","last_clean":"2023-10-06T01:40:25.829892+0000","last_became_active":"2023-10-06T01:40:21.794463+0000","last_became_peered":"2023-10-06T01:40:21.794463+0000","last_unstale":"2023-10-06T01:40:25.829892+0000","last_undegraded":"2023-10-06T01:40:25.829892+0000","last_fullsized":"2023-10-06T01:40:25.829892+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:15:52.031555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.827471+0000","last_change":"2023-10-06T01:40:21.787299+0000","last_active":"2023-10-06T01:40:25.827471+0000","last_peered":"2023-10-06T01:40:25.827471+0000","last_clean":"2023-10-06T01:40:25.827471+0000","last_became_active":"2023-10-06T01:40:21.786459+0000","last_became_peered":"2023-10-06T01:40:21.786459+0000","last_unstale":"2023-10-06T01:40:25.827471+0000","last_undegraded":"2023-10-06T01:40:25.827471+0000","last_fullsized":"2023-10-06T01:40:25.827471+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:29:49.863294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.822035+0000","last_change":"2023-10-06T01:40:21.798180+0000","last_active":"2023-10-06T01:40:25.822035+0000","last_peered":"2023-10-06T01:40:25.822035+0000","last_clean":"2023-10-06T01:40:25.822035+0000","last_became_active":"2023-10-06T01:40:21.797919+0000","last_became_peered":"2023-10-06T01:40:21.797919+0000","last_unstale":"2023-10-06T01:40:25.822035+0000","last_undegraded":"2023-10-06T01:40:25.822035+0000","last_fullsized":"2023-10-06T01:40:25.822035+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:29:36.526509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.853335+0000","last_change":"2023-10-06T01:40:25.847570+0000","last_active":"2023-10-06T01:40:25.853335+0000","last_peered":"2023-10-06T01:40:25.853335+0000","last_clean":"2023-10-06T01:40:25.853335+0000","last_became_active":"2023-10-06T01:40:25.843197+0000","last_became_peered":"2023-10-06T01:40:25.843197+0000","last_unstale":"2023-10-06T01:40:25.853335+0000","last_undegraded":"2023-10-06T01:40:25.853335+0000","last_fullsized":"2023-10-06T01:40:25.853335+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:44:41.539390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.832007+0000","last_change":"2023-10-06T01:40:20.794740+0000","last_active":"2023-10-06T01:40:25.832007+0000","last_peered":"2023-10-06T01:40:25.832007+0000","last_clean":"2023-10-06T01:40:25.832007+0000","last_became_active":"2023-10-06T01:40:20.794508+0000","last_became_peered":"2023-10-06T01:40:20.794508+0000","last_unstale":"2023-10-06T01:40:25.832007+0000","last_undegraded":"2023-10-06T01:40:25.832007+0000","last_fullsized":"2023-10-06T01:40:25.832007+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:28:17.373431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821586+0000","last_change":"2023-10-06T01:40:21.792738+0000","last_active":"2023-10-06T01:40:25.821586+0000","last_peered":"2023-10-06T01:40:25.821586+0000","last_clean":"2023-10-06T01:40:25.821586+0000","last_became_active":"2023-10-06T01:40:21.792508+0000","last_became_peered":"2023-10-06T01:40:21.792508+0000","last_unstale":"2023-10-06T01:40:25.821586+0000","last_undegraded":"2023-10-06T01:40:25.821586+0000","last_fullsized":"2023-10-06T01:40:25.821586+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:04.038873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.847437+0000","last_change":"2023-10-06T01:40:25.841407+0000","last_active":"2023-10-06T01:40:25.847437+0000","last_peered":"2023-10-06T01:40:25.847437+0000","last_clean":"2023-10-06T01:40:25.847437+0000","last_became_active":"2023-10-06T01:40:25.840998+0000","last_became_peered":"2023-10-06T01:40:25.840998+0000","last_unstale":"2023-10-06T01:40:25.847437+0000","last_undegraded":"2023-10-06T01:40:25.847437+0000","last_fullsized":"2023-10-06T01:40:25.847437+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:24:24.646258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.829628+0000","last_change":"2023-10-06T01:40:20.784535+0000","last_active":"2023-10-06T01:40:25.829628+0000","last_peered":"2023-10-06T01:40:25.829628+0000","last_clean":"2023-10-06T01:40:25.829628+0000","last_became_active":"2023-10-06T01:40:20.784266+0000","last_became_peered":"2023-10-06T01:40:20.784266+0000","last_unstale":"2023-10-06T01:40:25.829628+0000","last_undegraded":"2023-10-06T01:40:25.829628+0000","last_fullsized":"2023-10-06T01:40:25.829628+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:05:51.063526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.839509+0000","last_change":"2023-10-06T01:40:21.796914+0000","last_active":"2023-10-06T01:40:25.839509+0000","last_peered":"2023-10-06T01:40:25.839509+0000","last_clean":"2023-10-06T01:40:25.839509+0000","last_became_active":"2023-10-06T01:40:21.796645+0000","last_became_peered":"2023-10-06T01:40:21.796645+0000","last_unstale":"2023-10-06T01:40:25.839509+0000","last_undegraded":"2023-10-06T01:40:25.839509+0000","last_fullsized":"2023-10-06T01:40:25.839509+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:26:01.813573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.859114+0000","last_change":"2023-10-06T01:40:25.852718+0000","last_active":"2023-10-06T01:40:25.859114+0000","last_peered":"2023-10-06T01:40:25.859114+0000","last_clean":"2023-10-06T01:40:25.859114+0000","last_became_active":"2023-10-06T01:40:25.852410+0000","last_became_peered":"2023-10-06T01:40:25.852410+0000","last_unstale":"2023-10-06T01:40:25.859114+0000","last_undegraded":"2023-10-06T01:40:25.859114+0000","last_fullsized":"2023-10-06T01:40:25.859114+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:51:20.741996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.822073+0000","last_change":"2023-10-06T01:40:20.791628+0000","last_active":"2023-10-06T01:40:25.822073+0000","last_peered":"2023-10-06T01:40:25.822073+0000","last_clean":"2023-10-06T01:40:25.822073+0000","last_became_active":"2023-10-06T01:40:20.791350+0000","last_became_peered":"2023-10-06T01:40:20.791350+0000","last_unstale":"2023-10-06T01:40:25.822073+0000","last_undegraded":"2023-10-06T01:40:25.822073+0000","last_fullsized":"2023-10-06T01:40:25.822073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:40:52.187918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.824300+0000","last_change":"2023-10-06T01:40:21.784888+0000","last_active":"2023-10-06T01:40:25.824300+0000","last_peered":"2023-10-06T01:40:25.824300+0000","last_clean":"2023-10-06T01:40:25.824300+0000","last_became_active":"2023-10-06T01:40:21.784543+0000","last_became_peered":"2023-10-06T01:40:21.784543+0000","last_unstale":"2023-10-06T01:40:25.824300+0000","last_undegraded":"2023-10-06T01:40:25.824300+0000","last_fullsized":"2023-10-06T01:40:25.824300+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:22:12.634757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.852270+0000","last_change":"2023-10-06T01:40:25.846891+0000","last_active":"2023-10-06T01:40:25.852270+0000","last_peered":"2023-10-06T01:40:25.852270+0000","last_clean":"2023-10-06T01:40:25.852270+0000","last_became_active":"2023-10-06T01:40:25.846500+0000","last_became_peered":"2023-10-06T01:40:25.846500+0000","last_unstale":"2023-10-06T01:40:25.852270+0000","last_undegraded":"2023-10-06T01:40:25.852270+0000","last_fullsized":"2023-10-06T01:40:25.852270+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:08:08.709318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.840125+0000","last_change":"2023-10-06T01:40:20.792032+0000","last_active":"2023-10-06T01:40:25.840125+0000","last_peered":"2023-10-06T01:40:25.840125+0000","last_clean":"2023-10-06T01:40:25.840125+0000","last_became_active":"2023-10-06T01:40:20.791755+0000","last_became_peered":"2023-10-06T01:40:20.791755+0000","last_unstale":"2023-10-06T01:40:25.840125+0000","last_undegraded":"2023-10-06T01:40:25.840125+0000","last_fullsized":"2023-10-06T01:40:25.840125+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:26:03.577908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821783+0000","last_change":"2023-10-06T01:40:21.784165+0000","last_active":"2023-10-06T01:40:25.821783+0000","last_peered":"2023-10-06T01:40:25.821783+0000","last_clean":"2023-10-06T01:40:25.821783+0000","last_became_active":"2023-10-06T01:40:21.783915+0000","last_became_peered":"2023-10-06T01:40:21.783915+0000","last_unstale":"2023-10-06T01:40:25.821783+0000","last_undegraded":"2023-10-06T01:40:25.821783+0000","last_fullsized":"2023-10-06T01:40:25.821783+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:24:04.737047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.854974+0000","last_change":"2023-10-06T01:40:25.844941+0000","last_active":"2023-10-06T01:40:25.854974+0000","last_peered":"2023-10-06T01:40:25.854974+0000","last_clean":"2023-10-06T01:40:25.854974+0000","last_became_active":"2023-10-06T01:40:25.844514+0000","last_became_peered":"2023-10-06T01:40:25.844514+0000","last_unstale":"2023-10-06T01:40:25.854974+0000","last_undegraded":"2023-10-06T01:40:25.854974+0000","last_fullsized":"2023-10-06T01:40:25.854974+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:47:01.253527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821998+0000","last_change":"2023-10-06T01:40:20.791960+0000","last_active":"2023-10-06T01:40:25.821998+0000","last_peered":"2023-10-06T01:40:25.821998+0000","last_clean":"2023-10-06T01:40:25.821998+0000","last_became_active":"2023-10-06T01:40:20.791726+0000","last_became_peered":"2023-10-06T01:40:20.791726+0000","last_unstale":"2023-10-06T01:40:25.821998+0000","last_undegraded":"2023-10-06T01:40:25.821998+0000","last_fullsized":"2023-10-06T01:40:25.821998+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:26:03.577908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821717+0000","last_change":"2023-10-06T01:40:21.788771+0000","last_active":"2023-10-06T01:40:25.821717+0000","last_peered":"2023-10-06T01:40:25.821717+0000","last_clean":"2023-10-06T01:40:25.821717+0000","last_became_active":"2023-10-06T01:40:21.788485+0000","last_became_peered":"2023-10-06T01:40:21.788485+0000","last_unstale":"2023-10-06T01:40:25.821717+0000","last_undegraded":"2023-10-06T01:40:25.821717+0000","last_fullsized":"2023-10-06T01:40:25.821717+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:26:01.813573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.856408+0000","last_change":"2023-10-06T01:40:25.843843+0000","last_active":"2023-10-06T01:40:25.856408+0000","last_peered":"2023-10-06T01:40:25.856408+0000","last_clean":"2023-10-06T01:40:25.856408+0000","last_became_active":"2023-10-06T01:40:25.843513+0000","last_became_peered":"2023-10-06T01:40:25.843513+0000","last_unstale":"2023-10-06T01:40:25.856408+0000","last_undegraded":"2023-10-06T01:40:25.856408+0000","last_fullsized":"2023-10-06T01:40:25.856408+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:45.054717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.829858+0000","last_change":"2023-10-06T01:40:20.794114+0000","last_active":"2023-10-06T01:40:25.829858+0000","last_peered":"2023-10-06T01:40:25.829858+0000","last_clean":"2023-10-06T01:40:25.829858+0000","last_became_active":"2023-10-06T01:40:20.793858+0000","last_became_peered":"2023-10-06T01:40:20.793858+0000","last_unstale":"2023-10-06T01:40:25.829858+0000","last_undegraded":"2023-10-06T01:40:25.829858+0000","last_fullsized":"2023-10-06T01:40:25.829858+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:18:42.060669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.827126+0000","last_change":"2023-10-06T01:40:21.794943+0000","last_active":"2023-10-06T01:40:25.827126+0000","last_peered":"2023-10-06T01:40:25.827126+0000","last_clean":"2023-10-06T01:40:25.827126+0000","last_became_active":"2023-10-06T01:40:21.794481+0000","last_became_peered":"2023-10-06T01:40:21.794481+0000","last_unstale":"2023-10-06T01:40:25.827126+0000","last_undegraded":"2023-10-06T01:40:25.827126+0000","last_fullsized":"2023-10-06T01:40:25.827126+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:29:36.526509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.853325+0000","last_change":"2023-10-06T01:40:25.844703+0000","last_active":"2023-10-06T01:40:25.853325+0000","last_peered":"2023-10-06T01:40:25.853325+0000","last_clean":"2023-10-06T01:40:25.853325+0000","last_became_active":"2023-10-06T01:40:25.844372+0000","last_became_peered":"2023-10-06T01:40:25.844372+0000","last_unstale":"2023-10-06T01:40:25.853325+0000","last_undegraded":"2023-10-06T01:40:25.853325+0000","last_fullsized":"2023-10-06T01:40:25.853325+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:09:02.303009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'9","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T01:40:31.572781+0000","last_change":"2023-10-06T01:40:20.794127+0000","last_active":"2023-10-06T01:40:31.572781+0000","last_peered":"2023-10-06T01:40:31.572781+0000","last_clean":"2023-10-06T01:40:31.572781+0000","last_became_active":"2023-10-06T01:40:20.793873+0000","last_became_peered":"2023-10-06T01:40:20.793873+0000","last_unstale":"2023-10-06T01:40:31.572781+0000","last_undegraded":"2023-10-06T01:40:31.572781+0000","last_fullsized":"2023-10-06T01:40:31.572781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:05:51.063526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3714,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.830525+0000","last_change":"2023-10-06T01:40:21.783742+0000","last_active":"2023-10-06T01:40:25.830525+0000","last_peered":"2023-10-06T01:40:25.830525+0000","last_clean":"2023-10-06T01:40:25.830525+0000","last_became_active":"2023-10-06T01:40:21.783474+0000","last_became_peered":"2023-10-06T01:40:21.783474+0000","last_unstale":"2023-10-06T01:40:25.830525+0000","last_undegraded":"2023-10-06T01:40:25.830525+0000","last_fullsized":"2023-10-06T01:40:25.830525+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:40:45.624442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.855108+0000","last_change":"2023-10-06T01:40:25.850810+0000","last_active":"2023-10-06T01:40:25.855108+0000","last_peered":"2023-10-06T01:40:25.855108+0000","last_clean":"2023-10-06T01:40:25.855108+0000","last_became_active":"2023-10-06T01:40:25.850440+0000","last_became_peered":"2023-10-06T01:40:25.850440+0000","last_unstale":"2023-10-06T01:40:25.855108+0000","last_undegraded":"2023-10-06T01:40:25.855108+0000","last_fullsized":"2023-10-06T01:40:25.855108+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:12:18.042310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.827851+0000","last_change":"2023-10-06T01:40:20.795471+0000","last_active":"2023-10-06T01:40:25.827851+0000","last_peered":"2023-10-06T01:40:25.827851+0000","last_clean":"2023-10-06T01:40:25.827851+0000","last_became_active":"2023-10-06T01:40:20.795162+0000","last_became_peered":"2023-10-06T01:40:20.795162+0000","last_unstale":"2023-10-06T01:40:25.827851+0000","last_undegraded":"2023-10-06T01:40:25.827851+0000","last_fullsized":"2023-10-06T01:40:25.827851+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:42:39.472271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.822047+0000","last_change":"2023-10-06T01:40:21.792919+0000","last_active":"2023-10-06T01:40:25.822047+0000","last_peered":"2023-10-06T01:40:25.822047+0000","last_clean":"2023-10-06T01:40:25.822047+0000","last_became_active":"2023-10-06T01:40:21.792603+0000","last_became_peered":"2023-10-06T01:40:21.792603+0000","last_unstale":"2023-10-06T01:40:25.822047+0000","last_undegraded":"2023-10-06T01:40:25.822047+0000","last_fullsized":"2023-10-06T01:40:25.822047+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:58:41.783343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.842053+0000","last_change":"2023-10-06T01:40:25.837982+0000","last_active":"2023-10-06T01:40:25.842053+0000","last_peered":"2023-10-06T01:40:25.842053+0000","last_clean":"2023-10-06T01:40:25.842053+0000","last_became_active":"2023-10-06T01:40:25.837550+0000","last_became_peered":"2023-10-06T01:40:25.837550+0000","last_unstale":"2023-10-06T01:40:25.842053+0000","last_undegraded":"2023-10-06T01:40:25.842053+0000","last_fullsized":"2023-10-06T01:40:25.842053+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:44:33.571977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.838551+0000","last_change":"2023-10-06T01:40:20.791355+0000","last_active":"2023-10-06T01:40:25.838551+0000","last_peered":"2023-10-06T01:40:25.838551+0000","last_clean":"2023-10-06T01:40:25.838551+0000","last_became_active":"2023-10-06T01:40:20.791101+0000","last_became_peered":"2023-10-06T01:40:20.791101+0000","last_unstale":"2023-10-06T01:40:25.838551+0000","last_undegraded":"2023-10-06T01:40:25.838551+0000","last_fullsized":"2023-10-06T01:40:25.838551+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:36.984892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821895+0000","last_change":"2023-10-06T01:40:21.798155+0000","last_active":"2023-10-06T01:40:25.821895+0000","last_peered":"2023-10-06T01:40:25.821895+0000","last_clean":"2023-10-06T01:40:25.821895+0000","last_became_active":"2023-10-06T01:40:21.797870+0000","last_became_peered":"2023-10-06T01:40:21.797870+0000","last_unstale":"2023-10-06T01:40:25.821895+0000","last_undegraded":"2023-10-06T01:40:25.821895+0000","last_fullsized":"2023-10-06T01:40:25.821895+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:04.038873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.856540+0000","last_change":"2023-10-06T01:40:25.845625+0000","last_active":"2023-10-06T01:40:25.856540+0000","last_peered":"2023-10-06T01:40:25.856540+0000","last_clean":"2023-10-06T01:40:25.856540+0000","last_became_active":"2023-10-06T01:40:25.845267+0000","last_became_peered":"2023-10-06T01:40:25.845267+0000","last_unstale":"2023-10-06T01:40:25.856540+0000","last_undegraded":"2023-10-06T01:40:25.856540+0000","last_fullsized":"2023-10-06T01:40:25.856540+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:22:48.941644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.836049+0000","last_change":"2023-10-06T01:40:20.795272+0000","last_active":"2023-10-06T01:40:25.836049+0000","last_peered":"2023-10-06T01:40:25.836049+0000","last_clean":"2023-10-06T01:40:25.836049+0000","last_became_active":"2023-10-06T01:40:20.795001+0000","last_became_peered":"2023-10-06T01:40:20.795001+0000","last_unstale":"2023-10-06T01:40:25.836049+0000","last_undegraded":"2023-10-06T01:40:25.836049+0000","last_fullsized":"2023-10-06T01:40:25.836049+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:08:56.244189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.839584+0000","last_change":"2023-10-06T01:40:21.793411+0000","last_active":"2023-10-06T01:40:25.839584+0000","last_peered":"2023-10-06T01:40:25.839584+0000","last_clean":"2023-10-06T01:40:25.839584+0000","last_became_active":"2023-10-06T01:40:21.793189+0000","last_became_peered":"2023-10-06T01:40:21.793189+0000","last_unstale":"2023-10-06T01:40:25.839584+0000","last_undegraded":"2023-10-06T01:40:25.839584+0000","last_fullsized":"2023-10-06T01:40:25.839584+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:39:44.521327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.848998+0000","last_change":"2023-10-06T01:40:25.844926+0000","last_active":"2023-10-06T01:40:25.848998+0000","last_peered":"2023-10-06T01:40:25.848998+0000","last_clean":"2023-10-06T01:40:25.848998+0000","last_became_active":"2023-10-06T01:40:25.844538+0000","last_became_peered":"2023-10-06T01:40:25.844538+0000","last_unstale":"2023-10-06T01:40:25.848998+0000","last_undegraded":"2023-10-06T01:40:25.848998+0000","last_fullsized":"2023-10-06T01:40:25.848998+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:09:02.303009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.822780+0000","last_change":"2023-10-06T01:40:20.791595+0000","last_active":"2023-10-06T01:40:25.822780+0000","last_peered":"2023-10-06T01:40:25.822780+0000","last_clean":"2023-10-06T01:40:25.822780+0000","last_became_active":"2023-10-06T01:40:20.791307+0000","last_became_peered":"2023-10-06T01:40:20.791307+0000","last_unstale":"2023-10-06T01:40:25.822780+0000","last_undegraded":"2023-10-06T01:40:25.822780+0000","last_fullsized":"2023-10-06T01:40:25.822780+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:28:17.373431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.822628+0000","last_change":"2023-10-06T01:40:21.799944+0000","last_active":"2023-10-06T01:40:25.822628+0000","last_peered":"2023-10-06T01:40:25.822628+0000","last_clean":"2023-10-06T01:40:25.822628+0000","last_became_active":"2023-10-06T01:40:21.799450+0000","last_became_peered":"2023-10-06T01:40:21.799450+0000","last_unstale":"2023-10-06T01:40:25.822628+0000","last_undegraded":"2023-10-06T01:40:25.822628+0000","last_fullsized":"2023-10-06T01:40:25.822628+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:40:45.624442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.855175+0000","last_change":"2023-10-06T01:40:25.846371+0000","last_active":"2023-10-06T01:40:25.855175+0000","last_peered":"2023-10-06T01:40:25.855175+0000","last_clean":"2023-10-06T01:40:25.855175+0000","last_became_active":"2023-10-06T01:40:25.845988+0000","last_became_peered":"2023-10-06T01:40:25.845988+0000","last_unstale":"2023-10-06T01:40:25.855175+0000","last_undegraded":"2023-10-06T01:40:25.855175+0000","last_fullsized":"2023-10-06T01:40:25.855175+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:51:20.741996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.831872+0000","last_change":"2023-10-06T01:40:20.794690+0000","last_active":"2023-10-06T01:40:25.831872+0000","last_peered":"2023-10-06T01:40:25.831872+0000","last_clean":"2023-10-06T01:40:25.831872+0000","last_became_active":"2023-10-06T01:40:20.794423+0000","last_became_peered":"2023-10-06T01:40:20.794423+0000","last_unstale":"2023-10-06T01:40:25.831872+0000","last_undegraded":"2023-10-06T01:40:25.831872+0000","last_fullsized":"2023-10-06T01:40:25.831872+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:22:11.630679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821326+0000","last_change":"2023-10-06T01:40:21.799103+0000","last_active":"2023-10-06T01:40:25.821326+0000","last_peered":"2023-10-06T01:40:25.821326+0000","last_clean":"2023-10-06T01:40:25.821326+0000","last_became_active":"2023-10-06T01:40:21.798863+0000","last_became_peered":"2023-10-06T01:40:21.798863+0000","last_unstale":"2023-10-06T01:40:25.821326+0000","last_undegraded":"2023-10-06T01:40:25.821326+0000","last_fullsized":"2023-10-06T01:40:25.821326+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:26:58.497171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.850182+0000","last_change":"2023-10-06T01:40:25.843557+0000","last_active":"2023-10-06T01:40:25.850182+0000","last_peered":"2023-10-06T01:40:25.850182+0000","last_clean":"2023-10-06T01:40:25.850182+0000","last_became_active":"2023-10-06T01:40:25.843195+0000","last_became_peered":"2023-10-06T01:40:25.843195+0000","last_unstale":"2023-10-06T01:40:25.850182+0000","last_undegraded":"2023-10-06T01:40:25.850182+0000","last_fullsized":"2023-10-06T01:40:25.850182+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:53:23.550542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.835869+0000","last_change":"2023-10-06T01:40:20.796455+0000","last_active":"2023-10-06T01:40:25.835869+0000","last_peered":"2023-10-06T01:40:25.835869+0000","last_clean":"2023-10-06T01:40:25.835869+0000","last_became_active":"2023-10-06T01:40:20.796167+0000","last_became_peered":"2023-10-06T01:40:20.796167+0000","last_unstale":"2023-10-06T01:40:25.835869+0000","last_undegraded":"2023-10-06T01:40:25.835869+0000","last_fullsized":"2023-10-06T01:40:25.835869+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:06:10.010505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.834708+0000","last_change":"2023-10-06T01:40:21.797847+0000","last_active":"2023-10-06T01:40:25.834708+0000","last_peered":"2023-10-06T01:40:25.834708+0000","last_clean":"2023-10-06T01:40:25.834708+0000","last_became_active":"2023-10-06T01:40:21.797521+0000","last_became_peered":"2023-10-06T01:40:21.797521+0000","last_unstale":"2023-10-06T01:40:25.834708+0000","last_undegraded":"2023-10-06T01:40:25.834708+0000","last_fullsized":"2023-10-06T01:40:25.834708+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:50:29.699833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.856330+0000","last_change":"2023-10-06T01:40:25.848998+0000","last_active":"2023-10-06T01:40:25.856330+0000","last_peered":"2023-10-06T01:40:25.856330+0000","last_clean":"2023-10-06T01:40:25.856330+0000","last_became_active":"2023-10-06T01:40:25.848631+0000","last_became_peered":"2023-10-06T01:40:25.848631+0000","last_unstale":"2023-10-06T01:40:25.856330+0000","last_undegraded":"2023-10-06T01:40:25.856330+0000","last_fullsized":"2023-10-06T01:40:25.856330+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:56:06.324200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.830063+0000","last_change":"2023-10-06T01:40:20.794592+0000","last_active":"2023-10-06T01:40:25.830063+0000","last_peered":"2023-10-06T01:40:25.830063+0000","last_clean":"2023-10-06T01:40:25.830063+0000","last_became_active":"2023-10-06T01:40:20.794349+0000","last_became_peered":"2023-10-06T01:40:20.794349+0000","last_unstale":"2023-10-06T01:40:25.830063+0000","last_undegraded":"2023-10-06T01:40:25.830063+0000","last_fullsized":"2023-10-06T01:40:25.830063+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:54:11.553661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.822918+0000","last_change":"2023-10-06T01:40:21.794642+0000","last_active":"2023-10-06T01:40:25.822918+0000","last_peered":"2023-10-06T01:40:25.822918+0000","last_clean":"2023-10-06T01:40:25.822918+0000","last_became_active":"2023-10-06T01:40:21.794359+0000","last_became_peered":"2023-10-06T01:40:21.794359+0000","last_unstale":"2023-10-06T01:40:25.822918+0000","last_undegraded":"2023-10-06T01:40:25.822918+0000","last_fullsized":"2023-10-06T01:40:25.822918+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:42:40.476349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.845522+0000","last_change":"2023-10-06T01:40:25.836956+0000","last_active":"2023-10-06T01:40:25.845522+0000","last_peered":"2023-10-06T01:40:25.845522+0000","last_clean":"2023-10-06T01:40:25.845522+0000","last_became_active":"2023-10-06T01:40:25.836541+0000","last_became_peered":"2023-10-06T01:40:25.836541+0000","last_unstale":"2023-10-06T01:40:25.845522+0000","last_undegraded":"2023-10-06T01:40:25.845522+0000","last_fullsized":"2023-10-06T01:40:25.845522+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:16:05.054146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821650+0000","last_change":"2023-10-06T01:40:20.782445+0000","last_active":"2023-10-06T01:40:25.821650+0000","last_peered":"2023-10-06T01:40:25.821650+0000","last_clean":"2023-10-06T01:40:25.821650+0000","last_became_active":"2023-10-06T01:40:20.782183+0000","last_became_peered":"2023-10-06T01:40:20.782183+0000","last_unstale":"2023-10-06T01:40:25.821650+0000","last_undegraded":"2023-10-06T01:40:25.821650+0000","last_fullsized":"2023-10-06T01:40:25.821650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:36.984892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.839193+0000","last_change":"2023-10-06T01:40:21.798980+0000","last_active":"2023-10-06T01:40:25.839193+0000","last_peered":"2023-10-06T01:40:25.839193+0000","last_clean":"2023-10-06T01:40:25.839193+0000","last_became_active":"2023-10-06T01:40:21.798613+0000","last_became_peered":"2023-10-06T01:40:21.798613+0000","last_unstale":"2023-10-06T01:40:25.839193+0000","last_undegraded":"2023-10-06T01:40:25.839193+0000","last_fullsized":"2023-10-06T01:40:25.839193+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:24:20.596942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.845551+0000","last_change":"2023-10-06T01:40:25.833310+0000","last_active":"2023-10-06T01:40:25.845551+0000","last_peered":"2023-10-06T01:40:25.845551+0000","last_clean":"2023-10-06T01:40:25.845551+0000","last_became_active":"2023-10-06T01:40:25.832963+0000","last_became_peered":"2023-10-06T01:40:25.832963+0000","last_unstale":"2023-10-06T01:40:25.845551+0000","last_undegraded":"2023-10-06T01:40:25.845551+0000","last_fullsized":"2023-10-06T01:40:25.845551+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:23:12.621079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821512+0000","last_change":"2023-10-06T01:40:20.791754+0000","last_active":"2023-10-06T01:40:25.821512+0000","last_peered":"2023-10-06T01:40:25.821512+0000","last_clean":"2023-10-06T01:40:25.821512+0000","last_became_active":"2023-10-06T01:40:20.791494+0000","last_became_peered":"2023-10-06T01:40:20.791494+0000","last_unstale":"2023-10-06T01:40:25.821512+0000","last_undegraded":"2023-10-06T01:40:25.821512+0000","last_fullsized":"2023-10-06T01:40:25.821512+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:05:51.063526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.830148+0000","last_change":"2023-10-06T01:40:21.785721+0000","last_active":"2023-10-06T01:40:25.830148+0000","last_peered":"2023-10-06T01:40:25.830148+0000","last_clean":"2023-10-06T01:40:25.830148+0000","last_became_active":"2023-10-06T01:40:21.785449+0000","last_became_peered":"2023-10-06T01:40:21.785449+0000","last_unstale":"2023-10-06T01:40:25.830148+0000","last_undegraded":"2023-10-06T01:40:25.830148+0000","last_fullsized":"2023-10-06T01:40:25.830148+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:08:04.660002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.844791+0000","last_change":"2023-10-06T01:40:25.840556+0000","last_active":"2023-10-06T01:40:25.844791+0000","last_peered":"2023-10-06T01:40:25.844791+0000","last_clean":"2023-10-06T01:40:25.844791+0000","last_became_active":"2023-10-06T01:40:25.839952+0000","last_became_peered":"2023-10-06T01:40:25.839952+0000","last_unstale":"2023-10-06T01:40:25.844791+0000","last_undegraded":"2023-10-06T01:40:25.844791+0000","last_fullsized":"2023-10-06T01:40:25.844791+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:47:01.253527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.823012+0000","last_change":"2023-10-06T01:40:20.789868+0000","last_active":"2023-10-06T01:40:25.823012+0000","last_peered":"2023-10-06T01:40:25.823012+0000","last_clean":"2023-10-06T01:40:25.823012+0000","last_became_active":"2023-10-06T01:40:20.789583+0000","last_became_peered":"2023-10-06T01:40:20.789583+0000","last_unstale":"2023-10-06T01:40:25.823012+0000","last_undegraded":"2023-10-06T01:40:25.823012+0000","last_fullsized":"2023-10-06T01:40:25.823012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:33:03.922009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.829487+0000","last_change":"2023-10-06T01:40:21.782892+0000","last_active":"2023-10-06T01:40:25.829487+0000","last_peered":"2023-10-06T01:40:25.829487+0000","last_clean":"2023-10-06T01:40:25.829487+0000","last_became_active":"2023-10-06T01:40:21.782614+0000","last_became_peered":"2023-10-06T01:40:21.782614+0000","last_unstale":"2023-10-06T01:40:25.829487+0000","last_undegraded":"2023-10-06T01:40:25.829487+0000","last_fullsized":"2023-10-06T01:40:25.829487+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:29:36.526509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.848904+0000","last_change":"2023-10-06T01:40:25.843490+0000","last_active":"2023-10-06T01:40:25.848904+0000","last_peered":"2023-10-06T01:40:25.848904+0000","last_clean":"2023-10-06T01:40:25.848904+0000","last_became_active":"2023-10-06T01:40:25.843088+0000","last_became_peered":"2023-10-06T01:40:25.843088+0000","last_unstale":"2023-10-06T01:40:25.848904+0000","last_undegraded":"2023-10-06T01:40:25.848904+0000","last_fullsized":"2023-10-06T01:40:25.848904+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:56:02.016770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.834508+0000","last_change":"2023-10-06T01:40:20.789056+0000","last_active":"2023-10-06T01:40:25.834508+0000","last_peered":"2023-10-06T01:40:25.834508+0000","last_clean":"2023-10-06T01:40:25.834508+0000","last_became_active":"2023-10-06T01:40:20.788196+0000","last_became_peered":"2023-10-06T01:40:20.788196+0000","last_unstale":"2023-10-06T01:40:25.834508+0000","last_undegraded":"2023-10-06T01:40:25.834508+0000","last_fullsized":"2023-10-06T01:40:25.834508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:33:03.922009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.827836+0000","last_change":"2023-10-06T01:40:21.797206+0000","last_active":"2023-10-06T01:40:25.827836+0000","last_peered":"2023-10-06T01:40:25.827836+0000","last_clean":"2023-10-06T01:40:25.827836+0000","last_became_active":"2023-10-06T01:40:21.796922+0000","last_became_peered":"2023-10-06T01:40:21.796922+0000","last_unstale":"2023-10-06T01:40:25.827836+0000","last_undegraded":"2023-10-06T01:40:25.827836+0000","last_fullsized":"2023-10-06T01:40:25.827836+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:23:41.001172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.843834+0000","last_change":"2023-10-06T01:40:25.839765+0000","last_active":"2023-10-06T01:40:25.843834+0000","last_peered":"2023-10-06T01:40:25.843834+0000","last_clean":"2023-10-06T01:40:25.843834+0000","last_became_active":"2023-10-06T01:40:25.839357+0000","last_became_peered":"2023-10-06T01:40:25.839357+0000","last_unstale":"2023-10-06T01:40:25.843834+0000","last_undegraded":"2023-10-06T01:40:25.843834+0000","last_fullsized":"2023-10-06T01:40:25.843834+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:19:13.535733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821700+0000","last_change":"2023-10-06T01:40:20.794748+0000","last_active":"2023-10-06T01:40:25.821700+0000","last_peered":"2023-10-06T01:40:25.821700+0000","last_clean":"2023-10-06T01:40:25.821700+0000","last_became_active":"2023-10-06T01:40:20.794480+0000","last_became_peered":"2023-10-06T01:40:20.794480+0000","last_unstale":"2023-10-06T01:40:25.821700+0000","last_undegraded":"2023-10-06T01:40:25.821700+0000","last_fullsized":"2023-10-06T01:40:25.821700+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:28:17.373431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.830047+0000","last_change":"2023-10-06T01:40:21.787258+0000","last_active":"2023-10-06T01:40:25.830047+0000","last_peered":"2023-10-06T01:40:25.830047+0000","last_clean":"2023-10-06T01:40:25.830047+0000","last_became_active":"2023-10-06T01:40:21.786664+0000","last_became_peered":"2023-10-06T01:40:21.786664+0000","last_unstale":"2023-10-06T01:40:25.830047+0000","last_undegraded":"2023-10-06T01:40:25.830047+0000","last_fullsized":"2023-10-06T01:40:25.830047+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:14:30.814494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.850996+0000","last_change":"2023-10-06T01:40:25.844637+0000","last_active":"2023-10-06T01:40:25.850996+0000","last_peered":"2023-10-06T01:40:25.850996+0000","last_clean":"2023-10-06T01:40:25.850996+0000","last_became_active":"2023-10-06T01:40:25.844052+0000","last_became_peered":"2023-10-06T01:40:25.844052+0000","last_unstale":"2023-10-06T01:40:25.850996+0000","last_undegraded":"2023-10-06T01:40:25.850996+0000","last_fullsized":"2023-10-06T01:40:25.850996+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:22:48.941644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.827265+0000","last_change":"2023-10-06T01:40:16.930992+0000","last_active":"2023-10-06T01:40:25.827265+0000","last_peered":"2023-10-06T01:40:25.827265+0000","last_clean":"2023-10-06T01:40:25.827265+0000","last_became_active":"2023-10-06T01:40:16.930707+0000","last_became_peered":"2023-10-06T01:40:16.930707+0000","last_unstale":"2023-10-06T01:40:25.827265+0000","last_undegraded":"2023-10-06T01:40:25.827265+0000","last_fullsized":"2023-10-06T01:40:25.827265+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:52:43.316071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821862+0000","last_change":"2023-10-06T01:40:20.784967+0000","last_active":"2023-10-06T01:40:25.821862+0000","last_peered":"2023-10-06T01:40:25.821862+0000","last_clean":"2023-10-06T01:40:25.821862+0000","last_became_active":"2023-10-06T01:40:20.784588+0000","last_became_peered":"2023-10-06T01:40:20.784588+0000","last_unstale":"2023-10-06T01:40:25.821862+0000","last_undegraded":"2023-10-06T01:40:25.821862+0000","last_fullsized":"2023-10-06T01:40:25.821862+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:05:51.063526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.826944+0000","last_change":"2023-10-06T01:40:21.794725+0000","last_active":"2023-10-06T01:40:25.826944+0000","last_peered":"2023-10-06T01:40:25.826944+0000","last_clean":"2023-10-06T01:40:25.826944+0000","last_became_active":"2023-10-06T01:40:21.794189+0000","last_became_peered":"2023-10-06T01:40:21.794189+0000","last_unstale":"2023-10-06T01:40:25.826944+0000","last_undegraded":"2023-10-06T01:40:25.826944+0000","last_fullsized":"2023-10-06T01:40:25.826944+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:04.038873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.859101+0000","last_change":"2023-10-06T01:40:25.851461+0000","last_active":"2023-10-06T01:40:25.859101+0000","last_peered":"2023-10-06T01:40:25.859101+0000","last_clean":"2023-10-06T01:40:25.859101+0000","last_became_active":"2023-10-06T01:40:25.851161+0000","last_became_peered":"2023-10-06T01:40:25.851161+0000","last_unstale":"2023-10-06T01:40:25.859101+0000","last_undegraded":"2023-10-06T01:40:25.859101+0000","last_fullsized":"2023-10-06T01:40:25.859101+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:29:43.044116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821491+0000","last_change":"2023-10-06T01:40:16.651019+0000","last_active":"2023-10-06T01:40:25.821491+0000","last_peered":"2023-10-06T01:40:25.821491+0000","last_clean":"2023-10-06T01:40:25.821491+0000","last_became_active":"2023-10-06T01:40:16.650628+0000","last_became_peered":"2023-10-06T01:40:16.650628+0000","last_unstale":"2023-10-06T01:40:25.821491+0000","last_undegraded":"2023-10-06T01:40:25.821491+0000","last_fullsized":"2023-10-06T01:40:25.821491+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:11:57.218984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.830606+0000","last_change":"2023-10-06T01:40:20.791834+0000","last_active":"2023-10-06T01:40:25.830606+0000","last_peered":"2023-10-06T01:40:25.830606+0000","last_clean":"2023-10-06T01:40:25.830606+0000","last_became_active":"2023-10-06T01:40:20.791553+0000","last_became_peered":"2023-10-06T01:40:20.791553+0000","last_unstale":"2023-10-06T01:40:25.830606+0000","last_undegraded":"2023-10-06T01:40:25.830606+0000","last_fullsized":"2023-10-06T01:40:25.830606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:40:52.187918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.827267+0000","last_change":"2023-10-06T01:40:21.787773+0000","last_active":"2023-10-06T01:40:25.827267+0000","last_peered":"2023-10-06T01:40:25.827267+0000","last_clean":"2023-10-06T01:40:25.827267+0000","last_became_active":"2023-10-06T01:40:21.787517+0000","last_became_peered":"2023-10-06T01:40:21.787517+0000","last_unstale":"2023-10-06T01:40:25.827267+0000","last_undegraded":"2023-10-06T01:40:25.827267+0000","last_fullsized":"2023-10-06T01:40:25.827267+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:58:41.783343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.849217+0000","last_change":"2023-10-06T01:40:25.844473+0000","last_active":"2023-10-06T01:40:25.849217+0000","last_peered":"2023-10-06T01:40:25.849217+0000","last_clean":"2023-10-06T01:40:25.849217+0000","last_became_active":"2023-10-06T01:40:25.844126+0000","last_became_peered":"2023-10-06T01:40:25.844126+0000","last_unstale":"2023-10-06T01:40:25.849217+0000","last_undegraded":"2023-10-06T01:40:25.849217+0000","last_fullsized":"2023-10-06T01:40:25.849217+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:08:08.709318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.826313+0000","last_change":"2023-10-06T01:40:16.781596+0000","last_active":"2023-10-06T01:40:25.826313+0000","last_peered":"2023-10-06T01:40:25.826313+0000","last_clean":"2023-10-06T01:40:25.826313+0000","last_became_active":"2023-10-06T01:40:16.781352+0000","last_became_peered":"2023-10-06T01:40:16.781352+0000","last_unstale":"2023-10-06T01:40:25.826313+0000","last_undegraded":"2023-10-06T01:40:25.826313+0000","last_fullsized":"2023-10-06T01:40:25.826313+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:52:43.316071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.825380+0000","last_change":"2023-10-06T01:40:20.783263+0000","last_active":"2023-10-06T01:40:25.825380+0000","last_peered":"2023-10-06T01:40:25.825380+0000","last_clean":"2023-10-06T01:40:25.825380+0000","last_became_active":"2023-10-06T01:40:20.781142+0000","last_became_peered":"2023-10-06T01:40:20.781142+0000","last_unstale":"2023-10-06T01:40:25.825380+0000","last_undegraded":"2023-10-06T01:40:25.825380+0000","last_fullsized":"2023-10-06T01:40:25.825380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:28:17.373431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.829970+0000","last_change":"2023-10-06T01:40:21.795215+0000","last_active":"2023-10-06T01:40:25.829970+0000","last_peered":"2023-10-06T01:40:25.829970+0000","last_clean":"2023-10-06T01:40:25.829970+0000","last_became_active":"2023-10-06T01:40:21.794141+0000","last_became_peered":"2023-10-06T01:40:21.794141+0000","last_unstale":"2023-10-06T01:40:25.829970+0000","last_undegraded":"2023-10-06T01:40:25.829970+0000","last_fullsized":"2023-10-06T01:40:25.829970+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:24:04.737047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.855244+0000","last_change":"2023-10-06T01:40:25.849723+0000","last_active":"2023-10-06T01:40:25.855244+0000","last_peered":"2023-10-06T01:40:25.855244+0000","last_clean":"2023-10-06T01:40:25.855244+0000","last_became_active":"2023-10-06T01:40:25.849315+0000","last_became_peered":"2023-10-06T01:40:25.849315+0000","last_unstale":"2023-10-06T01:40:25.855244+0000","last_undegraded":"2023-10-06T01:40:25.855244+0000","last_fullsized":"2023-10-06T01:40:25.855244+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:09:02.303009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821589+0000","last_change":"2023-10-06T01:40:16.650826+0000","last_active":"2023-10-06T01:40:25.821589+0000","last_peered":"2023-10-06T01:40:25.821589+0000","last_clean":"2023-10-06T01:40:25.821589+0000","last_became_active":"2023-10-06T01:40:16.650469+0000","last_became_peered":"2023-10-06T01:40:16.650469+0000","last_unstale":"2023-10-06T01:40:25.821589+0000","last_undegraded":"2023-10-06T01:40:25.821589+0000","last_fullsized":"2023-10-06T01:40:25.821589+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:50:23.628212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":170,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.828939+0000","last_change":"2023-10-06T01:40:10.645512+0000","last_active":"2023-10-06T01:40:25.828939+0000","last_peered":"2023-10-06T01:40:25.828939+0000","last_clean":"2023-10-06T01:40:25.828939+0000","last_became_active":"2023-10-06T01:40:10.644601+0000","last_became_peered":"2023-10-06T01:40:10.644601+0000","last_unstale":"2023-10-06T01:40:25.828939+0000","last_undegraded":"2023-10-06T01:40:25.828939+0000","last_fullsized":"2023-10-06T01:40:25.828939+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:09.580865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:09.580865+0000","last_clean_scrub_stamp":"2023-10-06T01:40:09.580865+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:05:28.268591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821362+0000","last_change":"2023-10-06T01:40:20.787092+0000","last_active":"2023-10-06T01:40:25.821362+0000","last_peered":"2023-10-06T01:40:25.821362+0000","last_clean":"2023-10-06T01:40:25.821362+0000","last_became_active":"2023-10-06T01:40:20.786835+0000","last_became_peered":"2023-10-06T01:40:20.786835+0000","last_unstale":"2023-10-06T01:40:25.821362+0000","last_undegraded":"2023-10-06T01:40:25.821362+0000","last_fullsized":"2023-10-06T01:40:25.821362+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:36.984892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.824208+0000","last_change":"2023-10-06T01:40:21.800342+0000","last_active":"2023-10-06T01:40:25.824208+0000","last_peered":"2023-10-06T01:40:25.824208+0000","last_clean":"2023-10-06T01:40:25.824208+0000","last_became_active":"2023-10-06T01:40:21.800077+0000","last_became_peered":"2023-10-06T01:40:21.800077+0000","last_unstale":"2023-10-06T01:40:25.824208+0000","last_undegraded":"2023-10-06T01:40:25.824208+0000","last_fullsized":"2023-10-06T01:40:25.824208+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:16:08.450725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.849960+0000","last_change":"2023-10-06T01:40:25.846010+0000","last_active":"2023-10-06T01:40:25.849960+0000","last_peered":"2023-10-06T01:40:25.849960+0000","last_clean":"2023-10-06T01:40:25.849960+0000","last_became_active":"2023-10-06T01:40:25.845564+0000","last_became_peered":"2023-10-06T01:40:25.845564+0000","last_unstale":"2023-10-06T01:40:25.849960+0000","last_undegraded":"2023-10-06T01:40:25.849960+0000","last_fullsized":"2023-10-06T01:40:25.849960+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:45.054717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.829152+0000","last_change":"2023-10-06T01:40:16.651332+0000","last_active":"2023-10-06T01:40:25.829152+0000","last_peered":"2023-10-06T01:40:25.829152+0000","last_clean":"2023-10-06T01:40:25.829152+0000","last_became_active":"2023-10-06T01:40:16.651049+0000","last_became_peered":"2023-10-06T01:40:16.651049+0000","last_unstale":"2023-10-06T01:40:25.829152+0000","last_undegraded":"2023-10-06T01:40:25.829152+0000","last_fullsized":"2023-10-06T01:40:25.829152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:11:57.218984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.838433+0000","last_change":"2023-10-06T01:40:20.793541+0000","last_active":"2023-10-06T01:40:25.838433+0000","last_peered":"2023-10-06T01:40:25.838433+0000","last_clean":"2023-10-06T01:40:25.838433+0000","last_became_active":"2023-10-06T01:40:20.793304+0000","last_became_peered":"2023-10-06T01:40:20.793304+0000","last_unstale":"2023-10-06T01:40:25.838433+0000","last_undegraded":"2023-10-06T01:40:25.838433+0000","last_fullsized":"2023-10-06T01:40:25.838433+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:05:51.063526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.839355+0000","last_change":"2023-10-06T01:40:21.797984+0000","last_active":"2023-10-06T01:40:25.839355+0000","last_peered":"2023-10-06T01:40:25.839355+0000","last_clean":"2023-10-06T01:40:25.839355+0000","last_became_active":"2023-10-06T01:40:21.797701+0000","last_became_peered":"2023-10-06T01:40:21.797701+0000","last_unstale":"2023-10-06T01:40:25.839355+0000","last_undegraded":"2023-10-06T01:40:25.839355+0000","last_fullsized":"2023-10-06T01:40:25.839355+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:26:58.497171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.840837+0000","last_change":"2023-10-06T01:40:25.838729+0000","last_active":"2023-10-06T01:40:25.840837+0000","last_peered":"2023-10-06T01:40:25.840837+0000","last_clean":"2023-10-06T01:40:25.840837+0000","last_became_active":"2023-10-06T01:40:25.838267+0000","last_became_peered":"2023-10-06T01:40:25.838267+0000","last_unstale":"2023-10-06T01:40:25.840837+0000","last_undegraded":"2023-10-06T01:40:25.840837+0000","last_fullsized":"2023-10-06T01:40:25.840837+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:50:33.749149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.829955+0000","last_change":"2023-10-06T01:40:16.931106+0000","last_active":"2023-10-06T01:40:25.829955+0000","last_peered":"2023-10-06T01:40:25.829955+0000","last_clean":"2023-10-06T01:40:25.829955+0000","last_became_active":"2023-10-06T01:40:16.930830+0000","last_became_peered":"2023-10-06T01:40:16.930830+0000","last_unstale":"2023-10-06T01:40:25.829955+0000","last_undegraded":"2023-10-06T01:40:25.829955+0000","last_fullsized":"2023-10-06T01:40:25.829955+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:50:23.628212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.827373+0000","last_change":"2023-10-06T01:40:20.788225+0000","last_active":"2023-10-06T01:40:25.827373+0000","last_peered":"2023-10-06T01:40:25.827373+0000","last_clean":"2023-10-06T01:40:25.827373+0000","last_became_active":"2023-10-06T01:40:20.787925+0000","last_became_peered":"2023-10-06T01:40:20.787925+0000","last_unstale":"2023-10-06T01:40:25.827373+0000","last_undegraded":"2023-10-06T01:40:25.827373+0000","last_fullsized":"2023-10-06T01:40:25.827373+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:40:52.187918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.838984+0000","last_change":"2023-10-06T01:40:21.798835+0000","last_active":"2023-10-06T01:40:25.838984+0000","last_peered":"2023-10-06T01:40:25.838984+0000","last_clean":"2023-10-06T01:40:25.838984+0000","last_became_active":"2023-10-06T01:40:21.798060+0000","last_became_peered":"2023-10-06T01:40:21.798060+0000","last_unstale":"2023-10-06T01:40:25.838984+0000","last_undegraded":"2023-10-06T01:40:25.838984+0000","last_fullsized":"2023-10-06T01:40:25.838984+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:04.038873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.853092+0000","last_change":"2023-10-06T01:40:25.842785+0000","last_active":"2023-10-06T01:40:25.853092+0000","last_peered":"2023-10-06T01:40:25.853092+0000","last_clean":"2023-10-06T01:40:25.853092+0000","last_became_active":"2023-10-06T01:40:25.842386+0000","last_became_peered":"2023-10-06T01:40:25.842386+0000","last_unstale":"2023-10-06T01:40:25.853092+0000","last_undegraded":"2023-10-06T01:40:25.853092+0000","last_fullsized":"2023-10-06T01:40:25.853092+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:49:21.192762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.822713+0000","last_change":"2023-10-06T01:40:20.791442+0000","last_active":"2023-10-06T01:40:25.822713+0000","last_peered":"2023-10-06T01:40:25.822713+0000","last_clean":"2023-10-06T01:40:25.822713+0000","last_became_active":"2023-10-06T01:40:20.791169+0000","last_became_peered":"2023-10-06T01:40:20.791169+0000","last_unstale":"2023-10-06T01:40:25.822713+0000","last_undegraded":"2023-10-06T01:40:25.822713+0000","last_fullsized":"2023-10-06T01:40:25.822713+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:26:03.577908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.827531+0000","last_change":"2023-10-06T01:40:16.649379+0000","last_active":"2023-10-06T01:40:25.827531+0000","last_peered":"2023-10-06T01:40:25.827531+0000","last_clean":"2023-10-06T01:40:25.827531+0000","last_became_active":"2023-10-06T01:40:16.649147+0000","last_became_peered":"2023-10-06T01:40:16.649147+0000","last_unstale":"2023-10-06T01:40:25.827531+0000","last_undegraded":"2023-10-06T01:40:25.827531+0000","last_fullsized":"2023-10-06T01:40:25.827531+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:11:57.218984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821612+0000","last_change":"2023-10-06T01:40:21.797861+0000","last_active":"2023-10-06T01:40:25.821612+0000","last_peered":"2023-10-06T01:40:25.821612+0000","last_clean":"2023-10-06T01:40:25.821612+0000","last_became_active":"2023-10-06T01:40:21.797626+0000","last_became_peered":"2023-10-06T01:40:21.797626+0000","last_unstale":"2023-10-06T01:40:25.821612+0000","last_undegraded":"2023-10-06T01:40:25.821612+0000","last_fullsized":"2023-10-06T01:40:25.821612+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:24:20.596942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.856358+0000","last_change":"2023-10-06T01:40:25.843290+0000","last_active":"2023-10-06T01:40:25.856358+0000","last_peered":"2023-10-06T01:40:25.856358+0000","last_clean":"2023-10-06T01:40:25.856358+0000","last_became_active":"2023-10-06T01:40:25.842953+0000","last_became_peered":"2023-10-06T01:40:25.842953+0000","last_unstale":"2023-10-06T01:40:25.856358+0000","last_undegraded":"2023-10-06T01:40:25.856358+0000","last_fullsized":"2023-10-06T01:40:25.856358+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:12:18.042310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.824283+0000","last_change":"2023-10-06T01:40:16.651477+0000","last_active":"2023-10-06T01:40:25.824283+0000","last_peered":"2023-10-06T01:40:25.824283+0000","last_clean":"2023-10-06T01:40:25.824283+0000","last_became_active":"2023-10-06T01:40:16.651190+0000","last_became_peered":"2023-10-06T01:40:16.651190+0000","last_unstale":"2023-10-06T01:40:25.824283+0000","last_undegraded":"2023-10-06T01:40:25.824283+0000","last_fullsized":"2023-10-06T01:40:25.824283+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:45:47.422876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"26'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:26.761975+0000","last_change":"2023-10-06T01:40:20.794641+0000","last_active":"2023-10-06T01:40:26.761975+0000","last_peered":"2023-10-06T01:40:26.761975+0000","last_clean":"2023-10-06T01:40:26.761975+0000","last_became_active":"2023-10-06T01:40:20.794360+0000","last_became_peered":"2023-10-06T01:40:20.794360+0000","last_unstale":"2023-10-06T01:40:26.761975+0000","last_undegraded":"2023-10-06T01:40:26.761975+0000","last_fullsized":"2023-10-06T01:40:26.761975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:40:52.187918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.834606+0000","last_change":"2023-10-06T01:40:21.791810+0000","last_active":"2023-10-06T01:40:25.834606+0000","last_peered":"2023-10-06T01:40:25.834606+0000","last_clean":"2023-10-06T01:40:25.834606+0000","last_became_active":"2023-10-06T01:40:21.791555+0000","last_became_peered":"2023-10-06T01:40:21.791555+0000","last_unstale":"2023-10-06T01:40:25.834606+0000","last_undegraded":"2023-10-06T01:40:25.834606+0000","last_fullsized":"2023-10-06T01:40:25.834606+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:24:20.596942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.856682+0000","last_change":"2023-10-06T01:40:25.849400+0000","last_active":"2023-10-06T01:40:25.856682+0000","last_peered":"2023-10-06T01:40:25.856682+0000","last_clean":"2023-10-06T01:40:25.856682+0000","last_became_active":"2023-10-06T01:40:25.849029+0000","last_became_peered":"2023-10-06T01:40:25.849029+0000","last_unstale":"2023-10-06T01:40:25.856682+0000","last_undegraded":"2023-10-06T01:40:25.856682+0000","last_fullsized":"2023-10-06T01:40:25.856682+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:33:05.597649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.839064+0000","last_change":"2023-10-06T01:40:20.794942+0000","last_active":"2023-10-06T01:40:25.839064+0000","last_peered":"2023-10-06T01:40:25.839064+0000","last_clean":"2023-10-06T01:40:25.839064+0000","last_became_active":"2023-10-06T01:40:20.794667+0000","last_became_peered":"2023-10-06T01:40:20.794667+0000","last_unstale":"2023-10-06T01:40:25.839064+0000","last_undegraded":"2023-10-06T01:40:25.839064+0000","last_fullsized":"2023-10-06T01:40:25.839064+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:28:17.373431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.827341+0000","last_change":"2023-10-06T01:40:21.784757+0000","last_active":"2023-10-06T01:40:25.827341+0000","last_peered":"2023-10-06T01:40:25.827341+0000","last_clean":"2023-10-06T01:40:25.827341+0000","last_became_active":"2023-10-06T01:40:21.784512+0000","last_became_peered":"2023-10-06T01:40:21.784512+0000","last_unstale":"2023-10-06T01:40:25.827341+0000","last_undegraded":"2023-10-06T01:40:25.827341+0000","last_fullsized":"2023-10-06T01:40:25.827341+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:37.988970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.854971+0000","last_change":"2023-10-06T01:40:25.844934+0000","last_active":"2023-10-06T01:40:25.854971+0000","last_peered":"2023-10-06T01:40:25.854971+0000","last_clean":"2023-10-06T01:40:25.854971+0000","last_became_active":"2023-10-06T01:40:25.844548+0000","last_became_peered":"2023-10-06T01:40:25.844548+0000","last_unstale":"2023-10-06T01:40:25.854971+0000","last_undegraded":"2023-10-06T01:40:25.854971+0000","last_fullsized":"2023-10-06T01:40:25.854971+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:22:48.941644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821739+0000","last_change":"2023-10-06T01:40:20.795699+0000","last_active":"2023-10-06T01:40:25.821739+0000","last_peered":"2023-10-06T01:40:25.821739+0000","last_clean":"2023-10-06T01:40:25.821739+0000","last_became_active":"2023-10-06T01:40:20.795401+0000","last_became_peered":"2023-10-06T01:40:20.795401+0000","last_unstale":"2023-10-06T01:40:25.821739+0000","last_undegraded":"2023-10-06T01:40:25.821739+0000","last_fullsized":"2023-10-06T01:40:25.821739+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:08:56.244189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.830737+0000","last_change":"2023-10-06T01:40:21.796905+0000","last_active":"2023-10-06T01:40:25.830737+0000","last_peered":"2023-10-06T01:40:25.830737+0000","last_clean":"2023-10-06T01:40:25.830737+0000","last_became_active":"2023-10-06T01:40:21.796623+0000","last_became_peered":"2023-10-06T01:40:21.796623+0000","last_unstale":"2023-10-06T01:40:25.830737+0000","last_undegraded":"2023-10-06T01:40:25.830737+0000","last_fullsized":"2023-10-06T01:40:25.830737+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:14:52.758971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.849027+0000","last_change":"2023-10-06T01:40:25.846338+0000","last_active":"2023-10-06T01:40:25.849027+0000","last_peered":"2023-10-06T01:40:25.849027+0000","last_clean":"2023-10-06T01:40:25.849027+0000","last_became_active":"2023-10-06T01:40:25.845938+0000","last_became_peered":"2023-10-06T01:40:25.845938+0000","last_unstale":"2023-10-06T01:40:25.849027+0000","last_undegraded":"2023-10-06T01:40:25.849027+0000","last_fullsized":"2023-10-06T01:40:25.849027+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:44:33.571977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821259+0000","last_change":"2023-10-06T01:40:20.790034+0000","last_active":"2023-10-06T01:40:25.821259+0000","last_peered":"2023-10-06T01:40:25.821259+0000","last_clean":"2023-10-06T01:40:25.821259+0000","last_became_active":"2023-10-06T01:40:20.789692+0000","last_became_peered":"2023-10-06T01:40:20.789692+0000","last_unstale":"2023-10-06T01:40:25.821259+0000","last_undegraded":"2023-10-06T01:40:25.821259+0000","last_fullsized":"2023-10-06T01:40:25.821259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:06:10.010505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.831832+0000","last_change":"2023-10-06T01:40:21.790538+0000","last_active":"2023-10-06T01:40:25.831832+0000","last_peered":"2023-10-06T01:40:25.831832+0000","last_clean":"2023-10-06T01:40:25.831832+0000","last_became_active":"2023-10-06T01:40:21.790281+0000","last_became_peered":"2023-10-06T01:40:21.790281+0000","last_unstale":"2023-10-06T01:40:25.831832+0000","last_undegraded":"2023-10-06T01:40:25.831832+0000","last_fullsized":"2023-10-06T01:40:25.831832+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:26:58.497171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.853306+0000","last_change":"2023-10-06T01:40:25.845691+0000","last_active":"2023-10-06T01:40:25.853306+0000","last_peered":"2023-10-06T01:40:25.853306+0000","last_clean":"2023-10-06T01:40:25.853306+0000","last_became_active":"2023-10-06T01:40:25.843152+0000","last_became_peered":"2023-10-06T01:40:25.843152+0000","last_unstale":"2023-10-06T01:40:25.853306+0000","last_undegraded":"2023-10-06T01:40:25.853306+0000","last_fullsized":"2023-10-06T01:40:25.853306+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:05:21.358447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821427+0000","last_change":"2023-10-06T01:40:20.787411+0000","last_active":"2023-10-06T01:40:25.821427+0000","last_peered":"2023-10-06T01:40:25.821427+0000","last_clean":"2023-10-06T01:40:25.821427+0000","last_became_active":"2023-10-06T01:40:20.787144+0000","last_became_peered":"2023-10-06T01:40:20.787144+0000","last_unstale":"2023-10-06T01:40:25.821427+0000","last_undegraded":"2023-10-06T01:40:25.821427+0000","last_fullsized":"2023-10-06T01:40:25.821427+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:22:22.604958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821801+0000","last_change":"2023-10-06T01:40:21.783499+0000","last_active":"2023-10-06T01:40:25.821801+0000","last_peered":"2023-10-06T01:40:25.821801+0000","last_clean":"2023-10-06T01:40:25.821801+0000","last_became_active":"2023-10-06T01:40:21.783032+0000","last_became_peered":"2023-10-06T01:40:21.783032+0000","last_unstale":"2023-10-06T01:40:25.821801+0000","last_undegraded":"2023-10-06T01:40:25.821801+0000","last_fullsized":"2023-10-06T01:40:25.821801+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:26:58.497171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.856721+0000","last_change":"2023-10-06T01:40:25.852998+0000","last_active":"2023-10-06T01:40:25.856721+0000","last_peered":"2023-10-06T01:40:25.856721+0000","last_clean":"2023-10-06T01:40:25.856721+0000","last_became_active":"2023-10-06T01:40:25.852607+0000","last_became_peered":"2023-10-06T01:40:25.852607+0000","last_unstale":"2023-10-06T01:40:25.856721+0000","last_undegraded":"2023-10-06T01:40:25.856721+0000","last_fullsized":"2023-10-06T01:40:25.856721+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:24.811924+0000","last_clean_scrub_stamp":"2023-10-06T01:40:24.811924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:22:48.941644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.840188+0000","last_change":"2023-10-06T01:40:20.791988+0000","last_active":"2023-10-06T01:40:25.840188+0000","last_peered":"2023-10-06T01:40:25.840188+0000","last_clean":"2023-10-06T01:40:25.840188+0000","last_became_active":"2023-10-06T01:40:20.791712+0000","last_became_peered":"2023-10-06T01:40:20.791712+0000","last_unstale":"2023-10-06T01:40:25.840188+0000","last_undegraded":"2023-10-06T01:40:25.840188+0000","last_fullsized":"2023-10-06T01:40:25.840188+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.758529+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.758529+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:08:56.244189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.830146+0000","last_change":"2023-10-06T01:40:21.797245+0000","last_active":"2023-10-06T01:40:25.830146+0000","last_peered":"2023-10-06T01:40:25.830146+0000","last_clean":"2023-10-06T01:40:25.830146+0000","last_became_active":"2023-10-06T01:40:21.796983+0000","last_became_peered":"2023-10-06T01:40:21.796983+0000","last_unstale":"2023-10-06T01:40:25.830146+0000","last_undegraded":"2023-10-06T01:40:25.830146+0000","last_fullsized":"2023-10-06T01:40:25.830146+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:56:02.274884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.822902+0000","last_change":"2023-10-06T01:40:21.778624+0000","last_active":"2023-10-06T01:40:25.822902+0000","last_peered":"2023-10-06T01:40:25.822902+0000","last_clean":"2023-10-06T01:40:25.822902+0000","last_became_active":"2023-10-06T01:40:21.778327+0000","last_became_peered":"2023-10-06T01:40:21.778327+0000","last_unstale":"2023-10-06T01:40:25.822902+0000","last_undegraded":"2023-10-06T01:40:25.822902+0000","last_fullsized":"2023-10-06T01:40:25.822902+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:54:12.557739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821944+0000","last_change":"2023-10-06T01:40:21.784238+0000","last_active":"2023-10-06T01:40:25.821944+0000","last_peered":"2023-10-06T01:40:25.821944+0000","last_clean":"2023-10-06T01:40:25.821944+0000","last_became_active":"2023-10-06T01:40:21.783952+0000","last_became_peered":"2023-10-06T01:40:21.783952+0000","last_unstale":"2023-10-06T01:40:25.821944+0000","last_undegraded":"2023-10-06T01:40:25.821944+0000","last_fullsized":"2023-10-06T01:40:25.821944+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:29:36.526509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.832179+0000","last_change":"2023-10-06T01:40:21.797310+0000","last_active":"2023-10-06T01:40:25.832179+0000","last_peered":"2023-10-06T01:40:25.832179+0000","last_clean":"2023-10-06T01:40:25.832179+0000","last_became_active":"2023-10-06T01:40:21.797085+0000","last_became_peered":"2023-10-06T01:40:21.797085+0000","last_unstale":"2023-10-06T01:40:25.832179+0000","last_undegraded":"2023-10-06T01:40:25.832179+0000","last_fullsized":"2023-10-06T01:40:25.832179+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:23:08.571763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.821415+0000","last_change":"2023-10-06T01:40:21.797623+0000","last_active":"2023-10-06T01:40:25.821415+0000","last_peered":"2023-10-06T01:40:25.821415+0000","last_clean":"2023-10-06T01:40:25.821415+0000","last_became_active":"2023-10-06T01:40:21.797365+0000","last_became_peered":"2023-10-06T01:40:21.797365+0000","last_unstale":"2023-10-06T01:40:25.821415+0000","last_undegraded":"2023-10-06T01:40:25.821415+0000","last_fullsized":"2023-10-06T01:40:25.821415+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:39:44.521327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T01:40:25.827357+0000","last_change":"2023-10-06T01:40:21.791795+0000","last_active":"2023-10-06T01:40:25.827357+0000","last_peered":"2023-10-06T01:40:25.827357+0000","last_clean":"2023-10-06T01:40:25.827357+0000","last_became_active":"2023-10-06T01:40:21.791427+0000","last_became_peered":"2023-10-06T01:40:21.791427+0000","last_unstale":"2023-10-06T01:40:25.827357+0000","last_undegraded":"2023-10-06T01:40:25.827357+0000","last_fullsized":"2023-10-06T01:40:25.827357+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.762608+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.762608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:26:58.497171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4484,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298180,"kb_used_data":892,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073660,"statfs":{"total":96636764160,"available":96331427840,"internally_reserved":0,"allocated":913408,"data_stored":713871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297572,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074268,"statfs":{"total":96636764160,"available":96332050432,"internally_reserved":0,"allocated":290816,"data_stored":119573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297572,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074268,"statfs":{"total":96636764160,"available":96332050432,"internally_reserved":0,"allocated":290816,"data_stored":119573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34499999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.311}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298152,"kb_used_data":864,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073688,"statfs":{"total":96636764160,"available":96331456512,"internally_reserved":0,"allocated":884736,"data_stored":709534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]}]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297572,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074268,"statfs":{"total":96636764160,"available":96332050432,"internally_reserved":0,"allocated":290816,"data_stored":119573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297576,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074264,"statfs":{"total":96636764160,"available":96332046336,"internally_reserved":0,"allocated":294912,"data_stored":119663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.311}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297592,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074248,"statfs":{"total":96636764160,"available":96332029952,"internally_reserved":0,"allocated":311296,"data_stored":123343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0549999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.0780000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.149}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]}]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297580,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074260,"statfs":{"total":96636764160,"available":96332042240,"internally_reserved":0,"allocated":299008,"data_stored":120197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28299999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T01:40:45.815 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-06T01:40:45.815 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-06T01:40:45.815 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-06T01:40:45.815 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-06T01:40:45.959 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.958+0000 7f0923d56700 1 Processor -- start 2023-10-06T01:40:45.959 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.958+0000 7f0923d56700 1 -- start start 2023-10-06T01:40:45.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.958+0000 7f0923d56700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f091c1596d0 0x7f091c159aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:45.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.959+0000 7f0923d56700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f091c15d490 con 0x7f091c0c5540 2023-10-06T01:40:45.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.959+0000 7f0923d56700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f091c15a390 con 0x7f091c0c59c0 2023-10-06T01:40:45.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.959+0000 7f0923d56700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f091c15a670 con 0x7f091c1596d0 2023-10-06T01:40:45.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.959+0000 7f09212f1700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f091c0c5540 0x7f091c0cb530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:59554/0 (socket says 172.21.15.71:59554) 2023-10-06T01:40:45.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.959+0000 7f09212f1700 1 -- 172.21.15.71:0/3279459151 learned_addr learned my addr 172.21.15.71:0/3279459151 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:40:45.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.959+0000 7f0921af2700 1 --2- 172.21.15.71:0/3279459151 >> v2:172.21.15.72:3300/0 conn(0x7f091c1596d0 0x7f091c159aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:45.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.959+0000 7f0920af0700 1 -- 172.21.15.71:0/3279459151 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3215506001 0 0) 0x7f091c15d490 con 0x7f091c0c5540 2023-10-06T01:40:45.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.959+0000 7f0920af0700 1 -- 172.21.15.71:0/3279459151 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0908003570 con 0x7f091c0c5540 2023-10-06T01:40:45.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.959+0000 7f0920af0700 1 -- 172.21.15.71:0/3279459151 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1359932935 0 0) 0x7f0908003570 con 0x7f091c0c5540 2023-10-06T01:40:45.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.959+0000 7f0920af0700 1 -- 172.21.15.71:0/3279459151 >> v2:172.21.15.72:3300/0 conn(0x7f091c1596d0 msgr2=0x7f091c159aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:45.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.959+0000 7f0920af0700 1 --2- 172.21.15.71:0/3279459151 >> v2:172.21.15.72:3300/0 conn(0x7f091c1596d0 0x7f091c159aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:45.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.959+0000 7f0920af0700 1 -- 172.21.15.71:0/3279459151 >> v1:172.21.15.72:6789/0 conn(0x7f091c0c59c0 legacy=0x7f091c15d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:45.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.959+0000 7f0920af0700 1 -- 172.21.15.71:0/3279459151 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f091c15a950 con 0x7f091c0c5540 2023-10-06T01:40:45.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.959+0000 7f0920af0700 1 -- 172.21.15.71:0/3279459151 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1184243524 0 0) 0x7f090c001470 con 0x7f091c0c5540 2023-10-06T01:40:45.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.959+0000 7f0920af0700 1 -- 172.21.15.71:0/3279459151 >> v1:172.21.15.71:6789/0 conn(0x7f091c0c5540 legacy=0x7f091c0cb530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:45.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.959+0000 7f0920af0700 1 --2- 172.21.15.71:0/3279459151 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0908003a60 0x7f0908003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:45.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.959+0000 7f0920af0700 1 --2- 172.21.15.71:0/3279459151 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0908004810 0x7f0908004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:45.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.959+0000 7f0920af0700 1 --2- 172.21.15.71:0/3279459151 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09080051c0 0x7f090800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:45.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.959+0000 7f0920af0700 1 -- 172.21.15.71:0/3279459151 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f091c15a670 con 0x7f09080051c0 2023-10-06T01:40:45.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.959+0000 7f0920af0700 1 -- 172.21.15.71:0/3279459151 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f090800c050 con 0x7f0908004810 2023-10-06T01:40:45.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.959+0000 7f0920af0700 1 -- 172.21.15.71:0/3279459151 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f090800c210 con 0x7f0908003a60 2023-10-06T01:40:45.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.959+0000 7f0921af2700 1 --2- 172.21.15.71:0/3279459151 >> v2:172.21.15.72:3300/0 conn(0x7f091c1596d0 0x7f091c159aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:40:45.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.959+0000 7f09222f3700 1 --2- 172.21.15.71:0/3279459151 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09080051c0 0x7f090800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:45.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.960+0000 7f09212f1700 1 --2- 172.21.15.71:0/3279459151 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0908004810 0x7f0908004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:45.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.960+0000 7f0921af2700 1 --2- 172.21.15.71:0/3279459151 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0908003a60 0x7f0908003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:45.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.960+0000 7f09222f3700 1 -- 172.21.15.71:0/3279459151 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0908003a60 msgr2=0x7f0908003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:45.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.960+0000 7f09222f3700 1 --2- 172.21.15.71:0/3279459151 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0908003a60 0x7f0908003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:45.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.960+0000 7f09222f3700 1 -- 172.21.15.71:0/3279459151 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0908004810 msgr2=0x7f0908004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:45.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.960+0000 7f09222f3700 1 --2- 172.21.15.71:0/3279459151 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0908004810 0x7f0908004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:45.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.960+0000 7f09222f3700 1 -- 172.21.15.71:0/3279459151 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0908003570 con 0x7f09080051c0 2023-10-06T01:40:45.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.960+0000 7f09222f3700 1 -- 172.21.15.71:0/3279459151 reap_dead start 2023-10-06T01:40:45.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.960+0000 7f09222f3700 1 --2- 172.21.15.71:0/3279459151 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09080051c0 0x7f090800ba60 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f09140019a0 tx=0x7f0914007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ac74f02bb0bbcfd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:45.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.960+0000 7f0920af0700 1 -- 172.21.15.71:0/3279459151 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f091400c5d0 con 0x7f09080051c0 2023-10-06T01:40:45.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.960+0000 7f0920af0700 1 -- 172.21.15.71:0/3279459151 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f091400c730 con 0x7f09080051c0 2023-10-06T01:40:45.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.960+0000 7f0920af0700 1 -- 172.21.15.71:0/3279459151 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f091400cad0 con 0x7f09080051c0 2023-10-06T01:40:45.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.961+0000 7f0923d56700 1 -- 172.21.15.71:0/3279459151 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09080051c0 msgr2=0x7f090800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:45.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.961+0000 7f0923d56700 1 --2- 172.21.15.71:0/3279459151 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09080051c0 0x7f090800ba60 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f09140019a0 tx=0x7f0914007d10 comp rx=0 tx=0).stop 2023-10-06T01:40:45.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.961+0000 7f0923d56700 1 -- 172.21.15.71:0/3279459151 shutdown_connections 2023-10-06T01:40:45.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.961+0000 7f0923d56700 1 --2- 172.21.15.71:0/3279459151 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09080051c0 0x7f090800ba60 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:45.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.961+0000 7f0923d56700 1 -- 172.21.15.71:0/3279459151 >> 172.21.15.71:0/3279459151 conn(0x7f091c068680 msgr2=0x7f091c068a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:45.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.961+0000 7f0923d56700 1 -- 172.21.15.71:0/3279459151 shutdown_connections 2023-10-06T01:40:45.967 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.961+0000 7f0923d56700 1 -- 172.21.15.71:0/3279459151 wait complete. 2023-10-06T01:40:45.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.962+0000 7f0923d56700 1 Processor -- start 2023-10-06T01:40:45.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.962+0000 7f0923d56700 1 -- start start 2023-10-06T01:40:45.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.962+0000 7f0923d56700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09080051c0 0x7f091c140e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:45.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.962+0000 7f0923d56700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f091c0b30e0 0x7f091c0b3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:45.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.962+0000 7f0923d56700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f091c0b1b70 0x7f091c0b1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:45.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.962+0000 7f0923d56700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f091c0b3a90 con 0x7f091c0b30e0 2023-10-06T01:40:45.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.962+0000 7f0923d56700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f091c0c81b0 con 0x7f09080051c0 2023-10-06T01:40:45.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.962+0000 7f0923d56700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f091c0b28a0 con 0x7f091c0b1b70 2023-10-06T01:40:45.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.962+0000 7f09212f1700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f091c0b30e0 0x7f091c0b3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:45.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.963+0000 7f09212f1700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f091c0b30e0 0x7f091c0b3550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47730/0 (socket says 172.21.15.71:47730) 2023-10-06T01:40:45.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.963+0000 7f09212f1700 1 -- 172.21.15.71:0/2187842243 learned_addr learned my addr 172.21.15.71:0/2187842243 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:45.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.963+0000 7f0921af2700 1 --2- 172.21.15.71:0/2187842243 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09080051c0 0x7f091c140e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:45.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.963+0000 7f09222f3700 1 --2- 172.21.15.71:0/2187842243 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f091c0b1b70 0x7f091c0b1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:45.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.963+0000 7f09212f1700 1 -- 172.21.15.71:0/2187842243 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f091c0b1b70 msgr2=0x7f091c0b1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:45.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.963+0000 7f09212f1700 1 --2- 172.21.15.71:0/2187842243 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f091c0b1b70 0x7f091c0b1ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:45.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.963+0000 7f09212f1700 1 -- 172.21.15.71:0/2187842243 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09080051c0 msgr2=0x7f091c140e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:45.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.963+0000 7f09212f1700 1 --2- 172.21.15.71:0/2187842243 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09080051c0 0x7f091c140e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:45.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.963+0000 7f09212f1700 1 -- 172.21.15.71:0/2187842243 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f091c0c7b60 con 0x7f091c0b30e0 2023-10-06T01:40:45.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.963+0000 7f0921af2700 1 --2- 172.21.15.71:0/2187842243 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09080051c0 0x7f091c140e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:40:45.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.963+0000 7f09212f1700 1 --2- 172.21.15.71:0/2187842243 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f091c0b30e0 0x7f091c0b3550 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f090c007410 tx=0x7f090c001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:45.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.963+0000 7f0911ffb700 1 -- 172.21.15.71:0/2187842243 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090c018030 con 0x7f091c0b30e0 2023-10-06T01:40:45.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.963+0000 7f0911ffb700 1 -- 172.21.15.71:0/2187842243 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f090c00f870 con 0x7f091c0b30e0 2023-10-06T01:40:45.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.963+0000 7f0923d56700 1 -- 172.21.15.71:0/2187842243 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f091c0c7e40 con 0x7f091c0b30e0 2023-10-06T01:40:45.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.963+0000 7f0911ffb700 1 -- 172.21.15.71:0/2187842243 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090c00fc30 con 0x7f091c0b30e0 2023-10-06T01:40:45.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.963+0000 7f0923d56700 1 -- 172.21.15.71:0/2187842243 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f091c141390 con 0x7f091c0b30e0 2023-10-06T01:40:45.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.964+0000 7f0923d56700 1 -- 172.21.15.71:0/2187842243 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f091c088aa0 con 0x7f091c0b30e0 2023-10-06T01:40:45.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.965+0000 7f0911ffb700 1 -- 172.21.15.71:0/2187842243 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f090c01b070 con 0x7f091c0b30e0 2023-10-06T01:40:45.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.965+0000 7f0911ffb700 1 --2- 172.21.15.71:0/2187842243 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f0900066f30 0x7f09000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:45.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.965+0000 7f0921af2700 1 --2- 172.21.15.71:0/2187842243 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f0900066f30 0x7f09000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:45.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.965+0000 7f0911ffb700 1 -- 172.21.15.71:0/2187842243 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f090c019070 con 0x7f091c0b30e0 2023-10-06T01:40:45.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.965+0000 7f0921af2700 1 --2- 172.21.15.71:0/2187842243 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f0900066f30 0x7f09000693e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f09180094a0 tx=0x7f091800b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:45.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:45.969+0000 7f0911ffb700 1 -- 172.21.15.71:0/2187842243 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f090c051850 con 0x7f091c0b30e0 2023-10-06T01:40:46.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.193+0000 7f0923d56700 1 -- 172.21.15.71:0/2187842243 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f091c0c82f0 con 0x7f091c0b30e0 2023-10-06T01:40:46.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.193+0000 7f0911ffb700 1 -- 172.21.15.71:0/2187842243 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f090c054e70 con 0x7f091c0b30e0 2023-10-06T01:40:46.195 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:40:46.195 INFO:teuthology.orchestra.run.smithi071.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-06T01:40:46.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.195+0000 7f0923d56700 1 -- 172.21.15.71:0/2187842243 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f0900066f30 msgr2=0x7f09000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:46.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.195+0000 7f0923d56700 1 --2- 172.21.15.71:0/2187842243 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f0900066f30 0x7f09000693e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f09180094a0 tx=0x7f091800b040 comp rx=0 tx=0).stop 2023-10-06T01:40:46.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.195+0000 7f0923d56700 1 -- 172.21.15.71:0/2187842243 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f091c0b30e0 msgr2=0x7f091c0b3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:46.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.195+0000 7f0923d56700 1 --2- 172.21.15.71:0/2187842243 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f091c0b30e0 0x7f091c0b3550 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f090c007410 tx=0x7f090c001e70 comp rx=0 tx=0).stop 2023-10-06T01:40:46.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.195+0000 7f0923d56700 1 -- 172.21.15.71:0/2187842243 shutdown_connections 2023-10-06T01:40:46.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.195+0000 7f0923d56700 1 --2- 172.21.15.71:0/2187842243 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f091c0b1b70 0x7f091c0b1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:46.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.195+0000 7f0923d56700 1 --2- 172.21.15.71:0/2187842243 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f0900066f30 0x7f09000693e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:46.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.195+0000 7f0923d56700 1 --2- 172.21.15.71:0/2187842243 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09080051c0 0x7f091c140e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:46.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.195+0000 7f0923d56700 1 --2- 172.21.15.71:0/2187842243 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f091c0b30e0 0x7f091c0b3550 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:46.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.195+0000 7f0923d56700 1 -- 172.21.15.71:0/2187842243 >> 172.21.15.71:0/2187842243 conn(0x7f091c068680 msgr2=0x7f091c0ceb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:46.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.195+0000 7f0923d56700 1 -- 172.21.15.71:0/2187842243 shutdown_connections 2023-10-06T01:40:46.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.195+0000 7f0923d56700 1 -- 172.21.15.71:0/2187842243 wait complete. 2023-10-06T01:40:46.209 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-06T01:40:46.209 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:40:46.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.322+0000 7f8fb9a28700 1 Processor -- start 2023-10-06T01:40:46.324 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.322+0000 7f8fb9a28700 1 -- start start 2023-10-06T01:40:46.326 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.323+0000 7f8fb9a28700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8fb40af4e0 0x7f8fb40b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:46.326 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.323+0000 7f8fb9a28700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f8fb40af8b0 0x7f8fb40b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:46.326 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.323+0000 7f8fb9a28700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8fb415d460 0x7f8fb415d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:46.326 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.323+0000 7f8fb9a28700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fb40b1910 con 0x7f8fb40af8b0 2023-10-06T01:40:46.326 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.323+0000 7f8fb9a28700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fb415e190 con 0x7f8fb40af4e0 2023-10-06T01:40:46.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.323+0000 7f8fb9a28700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb40cb650 con 0x7f8fb415d460 2023-10-06T01:40:46.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.323+0000 7f8fb27fc700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f8fb40af8b0 0x7f8fb40b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:46.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.323+0000 7f8fb27fc700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f8fb40af8b0 0x7f8fb40b2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47734/0 (socket says 172.21.15.71:47734) 2023-10-06T01:40:46.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.323+0000 7f8fb27fc700 1 -- 172.21.15.71:0/172457072 learned_addr learned my addr 172.21.15.71:0/172457072 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:46.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.323+0000 7f8fb37fe700 1 --2- 172.21.15.71:0/172457072 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8fb415d460 0x7f8fb415d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:46.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.323+0000 7f8fb2ffd700 1 --2- 172.21.15.71:0/172457072 >> v2:172.21.15.72:3300/0 conn(0x7f8fb40af4e0 0x7f8fb40b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:46.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.323+0000 7f8fb27fc700 1 -- 172.21.15.71:0/172457072 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8fb415d460 msgr2=0x7f8fb415d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:46.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.323+0000 7f8fb27fc700 1 --2- 172.21.15.71:0/172457072 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8fb415d460 0x7f8fb415d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:46.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.323+0000 7f8fb27fc700 1 -- 172.21.15.71:0/172457072 >> v2:172.21.15.72:3300/0 conn(0x7f8fb40af4e0 msgr2=0x7f8fb40b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:46.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.323+0000 7f8fb27fc700 1 --2- 172.21.15.71:0/172457072 >> v2:172.21.15.72:3300/0 conn(0x7f8fb40af4e0 0x7f8fb40b20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:46.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.323+0000 7f8fb27fc700 1 -- 172.21.15.71:0/172457072 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fb40b2b60 con 0x7f8fb40af8b0 2023-10-06T01:40:46.328 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.323+0000 7f8fb27fc700 1 --2- 172.21.15.71:0/172457072 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8fb40af8b0 0x7f8fb40b2620 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8fb40d1360 tx=0x7f8fa8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d30c95b4f2424e4b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:46.328 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.323+0000 7f8fb1ffb700 1 -- 172.21.15.71:0/172457072 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa800b860 con 0x7f8fb40af8b0 2023-10-06T01:40:46.328 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.323+0000 7f8fb1ffb700 1 -- 172.21.15.71:0/172457072 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fa800b9c0 con 0x7f8fb40af8b0 2023-10-06T01:40:46.328 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.323+0000 7f8fb1ffb700 1 -- 172.21.15.71:0/172457072 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa800bd60 con 0x7f8fb40af8b0 2023-10-06T01:40:46.328 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.324+0000 7f8fb9a28700 1 -- 172.21.15.71:0/172457072 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8fb40af8b0 msgr2=0x7f8fb40b2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:46.328 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.324+0000 7f8fb9a28700 1 --2- 172.21.15.71:0/172457072 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8fb40af8b0 0x7f8fb40b2620 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8fb40d1360 tx=0x7f8fa8009250 comp rx=0 tx=0).stop 2023-10-06T01:40:46.328 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.324+0000 7f8fb9a28700 1 -- 172.21.15.71:0/172457072 shutdown_connections 2023-10-06T01:40:46.329 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.324+0000 7f8fb9a28700 1 --2- 172.21.15.71:0/172457072 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8fb415d460 0x7f8fb415d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:46.329 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.324+0000 7f8fb9a28700 1 --2- 172.21.15.71:0/172457072 >> v2:172.21.15.72:3300/0 conn(0x7f8fb40af4e0 0x7f8fb40b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:46.329 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.324+0000 7f8fb9a28700 1 --2- 172.21.15.71:0/172457072 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8fb40af8b0 0x7f8fb40b2620 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:46.329 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.324+0000 7f8fb9a28700 1 -- 172.21.15.71:0/172457072 >> 172.21.15.71:0/172457072 conn(0x7f8fb4068680 msgr2=0x7f8fb4068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:46.329 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.324+0000 7f8fb9a28700 1 -- 172.21.15.71:0/172457072 shutdown_connections 2023-10-06T01:40:46.330 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.324+0000 7f8fb9a28700 1 -- 172.21.15.71:0/172457072 wait complete. 2023-10-06T01:40:46.333 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.325+0000 7f8fb9a28700 1 Processor -- start 2023-10-06T01:40:46.333 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.325+0000 7f8fb9a28700 1 -- start start 2023-10-06T01:40:46.333 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.326+0000 7f8fb9a28700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8fb40af4e0 0x7f8fb40c7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:46.333 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.326+0000 7f8fb9a28700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8fb40af8b0 0x7f8fb40cfc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:46.333 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.326+0000 7f8fb9a28700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8fb415d460 0x7f8fb40d0150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:46.334 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.326+0000 7f8fb9a28700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb40ca170 con 0x7f8fb415d460 2023-10-06T01:40:46.334 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.326+0000 7f8fb9a28700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb41591d0 con 0x7f8fb40af4e0 2023-10-06T01:40:46.334 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.326+0000 7f8fb9a28700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb40d0760 con 0x7f8fb40af8b0 2023-10-06T01:40:46.334 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.326+0000 7f8fb37fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8fb415d460 0x7f8fb40d0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:46.334 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.326+0000 7f8fb37fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8fb415d460 0x7f8fb40d0150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47744/0 (socket says 172.21.15.71:47744) 2023-10-06T01:40:46.334 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.326+0000 7f8fb37fe700 1 -- 172.21.15.71:0/4026311799 learned_addr learned my addr 172.21.15.71:0/4026311799 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:46.334 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.326+0000 7f8fb2ffd700 1 --2- 172.21.15.71:0/4026311799 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8fb40af4e0 0x7f8fb40c7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:46.334 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.326+0000 7f8fb27fc700 1 --2- 172.21.15.71:0/4026311799 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8fb40af8b0 0x7f8fb40cfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:46.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.326+0000 7f8fb37fe700 1 -- 172.21.15.71:0/4026311799 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8fb40af8b0 msgr2=0x7f8fb40cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:46.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.326+0000 7f8fb37fe700 1 --2- 172.21.15.71:0/4026311799 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8fb40af8b0 0x7f8fb40cfc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:46.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.326+0000 7f8fb37fe700 1 -- 172.21.15.71:0/4026311799 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8fb40af4e0 msgr2=0x7f8fb40c7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:46.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.326+0000 7f8fb37fe700 1 --2- 172.21.15.71:0/4026311799 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8fb40af4e0 0x7f8fb40c7f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:46.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.326+0000 7f8fb37fe700 1 -- 172.21.15.71:0/4026311799 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fa80094f0 con 0x7f8fb415d460 2023-10-06T01:40:46.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.326+0000 7f8fb2ffd700 1 --2- 172.21.15.71:0/4026311799 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8fb40af4e0 0x7f8fb40c7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:40:46.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.326+0000 7f8fb37fe700 1 --2- 172.21.15.71:0/4026311799 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8fb415d460 0x7f8fb40d0150 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8fac007f20 tx=0x7f8fac009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:46.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.327+0000 7f8f9affd700 1 -- 172.21.15.71:0/4026311799 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fac00eca0 con 0x7f8fb415d460 2023-10-06T01:40:46.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.327+0000 7f8f9affd700 1 -- 172.21.15.71:0/4026311799 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fac00ee20 con 0x7f8fb415d460 2023-10-06T01:40:46.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.327+0000 7f8fb9a28700 1 -- 172.21.15.71:0/4026311799 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fb40d0a40 con 0x7f8fb415d460 2023-10-06T01:40:46.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.327+0000 7f8f9affd700 1 -- 172.21.15.71:0/4026311799 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fac014670 con 0x7f8fb415d460 2023-10-06T01:40:46.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.327+0000 7f8fb9a28700 1 -- 172.21.15.71:0/4026311799 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fb4159750 con 0x7f8fb415d460 2023-10-06T01:40:46.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.328+0000 7f8fb9a28700 1 -- 172.21.15.71:0/4026311799 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fb4088aa0 con 0x7f8fb415d460 2023-10-06T01:40:46.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.328+0000 7f8f9affd700 1 -- 172.21.15.71:0/4026311799 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8fac0149e0 con 0x7f8fb415d460 2023-10-06T01:40:46.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.328+0000 7f8f9affd700 1 --2- 172.21.15.71:0/4026311799 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f8fa0066f30 0x7f8fa00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:46.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.328+0000 7f8f9affd700 1 -- 172.21.15.71:0/4026311799 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f8fac0850e0 con 0x7f8fb415d460 2023-10-06T01:40:46.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.328+0000 7f8fb2ffd700 1 --2- 172.21.15.71:0/4026311799 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f8fa0066f30 0x7f8fa00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:46.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.329+0000 7f8fb2ffd700 1 --2- 172.21.15.71:0/4026311799 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f8fa0066f30 0x7f8fa00693e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8fa4006fd0 tx=0x7f8fa4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:46.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.332+0000 7f8f9affd700 1 -- 172.21.15.71:0/4026311799 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8fac051f00 con 0x7f8fb415d460 2023-10-06T01:40:46.516 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.515+0000 7f8fb9a28700 1 -- 172.21.15.71:0/4026311799 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8fb40cad20 con 0x7f8fb415d460 2023-10-06T01:40:46.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.516+0000 7f8f9affd700 1 -- 172.21.15.71:0/4026311799 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18659 (secure 0 0 0) 0x7f8fac055520 con 0x7f8fb415d460 2023-10-06T01:40:46.518 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:40:46.518 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":27,"fsid":"1fbf1bd2-f9b4-4599-bea2-f4aa920e9a56","created":"2023-10-06T01:39:57.016957+0000","modified":"2023-10-06T01:40:26.202441+0000","last_up_change":"2023-10-06T01:40:08.571643+0000","last_in_change":"2023-10-06T01:39:59.462741+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T01:40:08.610349+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T01:40:15.387434+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T01:40:19.640459+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T01:40:20.116883+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T01:40:23.830129+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cf059188-fb20-4dbf-95db-dcf57b213d03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":90670},{"type":"v1","addr":"172.21.15.71:6817","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":90670},{"type":"v1","addr":"172.21.15.71:6819","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":90670},{"type":"v1","addr":"172.21.15.71:6823","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":90670},{"type":"v1","addr":"172.21.15.71:6821","nonce":90670}]},"public_addr":"172.21.15.71:6817/90670","cluster_addr":"172.21.15.71:6819/90670","heartbeat_back_addr":"172.21.15.71:6823/90670","heartbeat_front_addr":"172.21.15.71:6821/90670","state":["exists","up"]},{"osd":1,"uuid":"0cff0aae-1799-4fe0-b610-54cf0813c0e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":90669},{"type":"v1","addr":"172.21.15.71:6809","nonce":90669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":90669},{"type":"v1","addr":"172.21.15.71:6811","nonce":90669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":90669},{"type":"v1","addr":"172.21.15.71:6815","nonce":90669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":90669},{"type":"v1","addr":"172.21.15.71:6813","nonce":90669}]},"public_addr":"172.21.15.71:6809/90669","cluster_addr":"172.21.15.71:6811/90669","heartbeat_back_addr":"172.21.15.71:6815/90669","heartbeat_front_addr":"172.21.15.71:6813/90669","state":["exists","up"]},{"osd":2,"uuid":"88d61ddc-9031-44e1-ba8c-546a41e7c8ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":90679},{"type":"v1","addr":"172.21.15.71:6825","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":90679},{"type":"v1","addr":"172.21.15.71:6827","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":90679},{"type":"v1","addr":"172.21.15.71:6831","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":90679},{"type":"v1","addr":"172.21.15.71:6829","nonce":90679}]},"public_addr":"172.21.15.71:6825/90679","cluster_addr":"172.21.15.71:6827/90679","heartbeat_back_addr":"172.21.15.71:6831/90679","heartbeat_front_addr":"172.21.15.71:6829/90679","state":["exists","up"]},{"osd":3,"uuid":"11ed92b7-960b-4a30-a889-a61d3eeb86f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":90668},{"type":"v1","addr":"172.21.15.71:6801","nonce":90668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":90668},{"type":"v1","addr":"172.21.15.71:6803","nonce":90668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":90668},{"type":"v1","addr":"172.21.15.71:6807","nonce":90668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":90668},{"type":"v1","addr":"172.21.15.71:6805","nonce":90668}]},"public_addr":"172.21.15.71:6801/90668","cluster_addr":"172.21.15.71:6803/90668","heartbeat_back_addr":"172.21.15.71:6807/90668","heartbeat_front_addr":"172.21.15.71:6805/90668","state":["exists","up"]},{"osd":4,"uuid":"ae4df784-abdf-4ddf-aefa-780f3ddafef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":90917},{"type":"v1","addr":"172.21.15.72:6801","nonce":90917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":90917},{"type":"v1","addr":"172.21.15.72:6803","nonce":90917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":90917},{"type":"v1","addr":"172.21.15.72:6807","nonce":90917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":90917},{"type":"v1","addr":"172.21.15.72:6805","nonce":90917}]},"public_addr":"172.21.15.72:6801/90917","cluster_addr":"172.21.15.72:6803/90917","heartbeat_back_addr":"172.21.15.72:6807/90917","heartbeat_front_addr":"172.21.15.72:6805/90917","state":["exists","up"]},{"osd":5,"uuid":"5ef0790f-001e-458f-a05b-efae216cf435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":90941},{"type":"v1","addr":"172.21.15.72:6817","nonce":90941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":90941},{"type":"v1","addr":"172.21.15.72:6819","nonce":90941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":90941},{"type":"v1","addr":"172.21.15.72:6827","nonce":90941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":90941},{"type":"v1","addr":"172.21.15.72:6823","nonce":90941}]},"public_addr":"172.21.15.72:6817/90941","cluster_addr":"172.21.15.72:6819/90941","heartbeat_back_addr":"172.21.15.72:6827/90941","heartbeat_front_addr":"172.21.15.72:6823/90941","state":["exists","up"]},{"osd":6,"uuid":"8705aef1-9ae8-4e54-a3c4-c2909fa0ceb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":90918},{"type":"v1","addr":"172.21.15.72:6809","nonce":90918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":90918},{"type":"v1","addr":"172.21.15.72:6811","nonce":90918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":90918},{"type":"v1","addr":"172.21.15.72:6815","nonce":90918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":90918},{"type":"v1","addr":"172.21.15.72:6813","nonce":90918}]},"public_addr":"172.21.15.72:6809/90918","cluster_addr":"172.21.15.72:6811/90918","heartbeat_back_addr":"172.21.15.72:6815/90918","heartbeat_front_addr":"172.21.15.72:6813/90918","state":["exists","up"]},{"osd":7,"uuid":"364c5119-6b13-4c75-b3f0-15e165eff86a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":90948},{"type":"v1","addr":"172.21.15.72:6822","nonce":90948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":90948},{"type":"v1","addr":"172.21.15.72:6826","nonce":90948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":90948},{"type":"v1","addr":"172.21.15.72:6831","nonce":90948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":90948},{"type":"v1","addr":"172.21.15.72:6829","nonce":90948}]},"public_addr":"172.21.15.72:6822/90948","cluster_addr":"172.21.15.72:6826/90948","heartbeat_back_addr":"172.21.15.72:6831/90948","heartbeat_front_addr":"172.21.15.72:6829/90948","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.642976+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.645372+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.619116+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.663042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.599163+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.646411+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.631545+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.669821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:40:46.520 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.518+0000 7f8fb9a28700 1 -- 172.21.15.71:0/4026311799 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f8fa0066f30 msgr2=0x7f8fa00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:46.520 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.518+0000 7f8fb9a28700 1 --2- 172.21.15.71:0/4026311799 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f8fa0066f30 0x7f8fa00693e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8fa4006fd0 tx=0x7f8fa4008040 comp rx=0 tx=0).stop 2023-10-06T01:40:46.520 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.518+0000 7f8fb9a28700 1 -- 172.21.15.71:0/4026311799 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8fb415d460 msgr2=0x7f8fb40d0150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:46.520 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.518+0000 7f8fb9a28700 1 --2- 172.21.15.71:0/4026311799 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8fb415d460 0x7f8fb40d0150 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8fac007f20 tx=0x7f8fac009860 comp rx=0 tx=0).stop 2023-10-06T01:40:46.520 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.518+0000 7f8fb9a28700 1 -- 172.21.15.71:0/4026311799 shutdown_connections 2023-10-06T01:40:46.520 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.518+0000 7f8fb9a28700 1 --2- 172.21.15.71:0/4026311799 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8fb415d460 0x7f8fb40d0150 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:46.520 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.518+0000 7f8fb9a28700 1 --2- 172.21.15.71:0/4026311799 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f8fa0066f30 0x7f8fa00693e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:46.520 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.518+0000 7f8fb9a28700 1 --2- 172.21.15.71:0/4026311799 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8fb40af4e0 0x7f8fb40c7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:46.520 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.518+0000 7f8fb9a28700 1 --2- 172.21.15.71:0/4026311799 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8fb40af8b0 0x7f8fb40cfc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:46.521 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.518+0000 7f8fb9a28700 1 -- 172.21.15.71:0/4026311799 >> 172.21.15.71:0/4026311799 conn(0x7f8fb4068680 msgr2=0x7f8fb40afca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:46.521 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.518+0000 7f8fb9a28700 1 -- 172.21.15.71:0/4026311799 shutdown_connections 2023-10-06T01:40:46.521 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.518+0000 7f8fb9a28700 1 -- 172.21.15.71:0/4026311799 wait complete. 2023-10-06T01:40:46.532 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T01:40:08.610349+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T01:40:15.387434+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T01:40:19.640459+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T01:40:20.116883+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-06T01:40:23.830129+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T01:40:46.532 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T01:40:46.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.648+0000 7f5ee4c90700 1 Processor -- start 2023-10-06T01:40:46.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.648+0000 7f5ee4c90700 1 -- start start 2023-10-06T01:40:46.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.649+0000 7f5ee4c90700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5ee006a910 0x7f5ee006ad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:46.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.649+0000 7f5ee4c90700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ee006a1a0 con 0x7f5ee00cc740 2023-10-06T01:40:46.653 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.649+0000 7f5ee4c90700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ee006a480 con 0x7f5ee015cae0 2023-10-06T01:40:46.653 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.649+0000 7f5ee4c90700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee00c8e40 con 0x7f5ee006a910 2023-10-06T01:40:46.653 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.649+0000 7f5eded9d700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f5ee00cc740 0x7f5ee00ccbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:59570/0 (socket says 172.21.15.71:59570) 2023-10-06T01:40:46.653 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.649+0000 7f5eded9d700 1 -- 172.21.15.71:0/75668489 learned_addr learned my addr 172.21.15.71:0/75668489 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:40:46.653 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.649+0000 7f5ed5d9b700 1 --2- 172.21.15.71:0/75668489 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5ee006a910 0x7f5ee006ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:46.653 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.649+0000 7f5eddd9b700 1 -- 172.21.15.71:0/75668489 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 659741601 0 0) 0x7f5ee006a1a0 con 0x7f5ee00cc740 2023-10-06T01:40:46.653 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.649+0000 7f5eddd9b700 1 -- 172.21.15.71:0/75668489 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ecc003570 con 0x7f5ee00cc740 2023-10-06T01:40:46.653 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.649+0000 7f5eddd9b700 1 -- 172.21.15.71:0/75668489 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1867249451 0 0) 0x7f5ee006a480 con 0x7f5ee015cae0 2023-10-06T01:40:46.653 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.649+0000 7f5eddd9b700 1 -- 172.21.15.71:0/75668489 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ee006a1a0 con 0x7f5ee015cae0 2023-10-06T01:40:46.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.650+0000 7f5ed5d9b700 1 -- 172.21.15.71:0/75668489 >> v1:172.21.15.72:6789/0 conn(0x7f5ee015cae0 legacy=0x7f5ee00c8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:46.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.650+0000 7f5ed5d9b700 1 -- 172.21.15.71:0/75668489 >> v1:172.21.15.71:6789/0 conn(0x7f5ee00cc740 legacy=0x7f5ee00ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:46.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.650+0000 7f5ed5d9b700 1 -- 172.21.15.71:0/75668489 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ee00c3f40 con 0x7f5ee006a910 2023-10-06T01:40:46.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.650+0000 7f5ed5d9b700 1 --2- 172.21.15.71:0/75668489 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5ee006a910 0x7f5ee006ad60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5ec8009910 tx=0x7f5ec80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d3019aaad0a5c6f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:46.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.650+0000 7f5eddd9b700 1 -- 172.21.15.71:0/75668489 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec8011630 con 0x7f5ee006a910 2023-10-06T01:40:46.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.650+0000 7f5eddd9b700 1 -- 172.21.15.71:0/75668489 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ec8011790 con 0x7f5ee006a910 2023-10-06T01:40:46.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.650+0000 7f5eddd9b700 1 -- 172.21.15.71:0/75668489 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec8011b10 con 0x7f5ee006a910 2023-10-06T01:40:46.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.650+0000 7f5ee4c90700 1 -- 172.21.15.71:0/75668489 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5ee006a910 msgr2=0x7f5ee006ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:46.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.650+0000 7f5ee4c90700 1 --2- 172.21.15.71:0/75668489 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5ee006a910 0x7f5ee006ad60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5ec8009910 tx=0x7f5ec80091a0 comp rx=0 tx=0).stop 2023-10-06T01:40:46.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.650+0000 7f5ee4c90700 1 -- 172.21.15.71:0/75668489 shutdown_connections 2023-10-06T01:40:46.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.650+0000 7f5ee4c90700 1 --2- 172.21.15.71:0/75668489 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5ee006a910 0x7f5ee006ad60 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:46.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.650+0000 7f5ee4c90700 1 -- 172.21.15.71:0/75668489 >> 172.21.15.71:0/75668489 conn(0x7f5ee0067910 msgr2=0x7f5ee00ce0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:46.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.650+0000 7f5ee4c90700 1 -- 172.21.15.71:0/75668489 shutdown_connections 2023-10-06T01:40:46.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.650+0000 7f5ee4c90700 1 -- 172.21.15.71:0/75668489 wait complete. 2023-10-06T01:40:46.657 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.652+0000 7f5ee4c90700 1 Processor -- start 2023-10-06T01:40:46.657 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.652+0000 7f5ee4c90700 1 -- start start 2023-10-06T01:40:46.657 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.652+0000 7f5ee4c90700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5ee006a910 0x7f5ee00b26f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:46.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.652+0000 7f5ee4c90700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ee00cc740 0x7f5ee00b2c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:46.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.652+0000 7f5ee4c90700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ee015cae0 0x7f5ee016a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:46.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.652+0000 7f5ee4c90700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee016b800 con 0x7f5ee015cae0 2023-10-06T01:40:46.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.652+0000 7f5ee4c90700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee00b32e0 con 0x7f5ee00cc740 2023-10-06T01:40:46.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.652+0000 7f5ee4c90700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee00b35c0 con 0x7f5ee006a910 2023-10-06T01:40:46.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.652+0000 7f5eded9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ee015cae0 0x7f5ee016a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:46.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.653+0000 7f5eded9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ee015cae0 0x7f5ee016a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47746/0 (socket says 172.21.15.71:47746) 2023-10-06T01:40:46.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.653+0000 7f5eded9d700 1 -- 172.21.15.71:0/3172315242 learned_addr learned my addr 172.21.15.71:0/3172315242 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:46.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.653+0000 7f5ed5d9b700 1 --2- 172.21.15.71:0/3172315242 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ee00cc740 0x7f5ee00b2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:46.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.653+0000 7f5ede59c700 1 --2- 172.21.15.71:0/3172315242 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5ee006a910 0x7f5ee00b26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:46.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.653+0000 7f5eded9d700 1 -- 172.21.15.71:0/3172315242 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5ee006a910 msgr2=0x7f5ee00b26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:46.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.653+0000 7f5eded9d700 1 --2- 172.21.15.71:0/3172315242 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5ee006a910 0x7f5ee00b26f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:46.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.653+0000 7f5eded9d700 1 -- 172.21.15.71:0/3172315242 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ee00cc740 msgr2=0x7f5ee00b2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:46.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.653+0000 7f5eded9d700 1 --2- 172.21.15.71:0/3172315242 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ee00cc740 0x7f5ee00b2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:46.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.653+0000 7f5eded9d700 1 -- 172.21.15.71:0/3172315242 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ec8009420 con 0x7f5ee015cae0 2023-10-06T01:40:46.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.653+0000 7f5eded9d700 1 --2- 172.21.15.71:0/3172315242 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ee015cae0 0x7f5ee016a150 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5ed800cd00 tx=0x7f5ed8001ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:46.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.653+0000 7f5ed6ffd700 1 -- 172.21.15.71:0/3172315242 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed800ce00 con 0x7f5ee015cae0 2023-10-06T01:40:46.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.653+0000 7f5ed6ffd700 1 -- 172.21.15.71:0/3172315242 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ed800aac0 con 0x7f5ee015cae0 2023-10-06T01:40:46.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.653+0000 7f5ee4c90700 1 -- 172.21.15.71:0/3172315242 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ee016b490 con 0x7f5ee015cae0 2023-10-06T01:40:46.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.653+0000 7f5ed6ffd700 1 -- 172.21.15.71:0/3172315242 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed800ae80 con 0x7f5ee015cae0 2023-10-06T01:40:46.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.653+0000 7f5ee4c90700 1 -- 172.21.15.71:0/3172315242 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ee016a690 con 0x7f5ee015cae0 2023-10-06T01:40:46.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.654+0000 7f5ee4c90700 1 -- 172.21.15.71:0/3172315242 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ee016b2f0 con 0x7f5ee015cae0 2023-10-06T01:40:46.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.655+0000 7f5ed6ffd700 1 -- 172.21.15.71:0/3172315242 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5ed8007300 con 0x7f5ee015cae0 2023-10-06T01:40:46.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.655+0000 7f5ed6ffd700 1 --2- 172.21.15.71:0/3172315242 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f5ec0066f30 0x7f5ec00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:46.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.655+0000 7f5ed6ffd700 1 -- 172.21.15.71:0/3172315242 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f5ed8084cd0 con 0x7f5ee015cae0 2023-10-06T01:40:46.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.655+0000 7f5ede59c700 1 --2- 172.21.15.71:0/3172315242 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f5ec0066f30 0x7f5ec00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:46.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.655+0000 7f5ede59c700 1 --2- 172.21.15.71:0/3172315242 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f5ec0066f30 0x7f5ec00693e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5ed0000c00 tx=0x7f5ed0007d20 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:46.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.659+0000 7f5ed6ffd700 1 -- 172.21.15.71:0/3172315242 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5ee016b2f0 con 0x7f5ee015cae0 2023-10-06T01:40:46.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.845+0000 7f5ee4c90700 1 -- 172.21.15.71:0/3172315242 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5ee016b2f0 con 0x7f5ee015cae0 2023-10-06T01:40:46.847 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.846+0000 7f5ed6ffd700 1 -- 172.21.15.71:0/3172315242 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5ee016b2f0 con 0x7f5ee015cae0 2023-10-06T01:40:46.848 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 1 2023-10-06T01:40:46.850 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.848+0000 7f5ee4c90700 1 -- 172.21.15.71:0/3172315242 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f5ec0066f30 msgr2=0x7f5ec00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:46.850 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.848+0000 7f5ee4c90700 1 --2- 172.21.15.71:0/3172315242 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f5ec0066f30 0x7f5ec00693e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5ed0000c00 tx=0x7f5ed0007d20 comp rx=0 tx=0).stop 2023-10-06T01:40:46.850 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.848+0000 7f5ee4c90700 1 -- 172.21.15.71:0/3172315242 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ee015cae0 msgr2=0x7f5ee016a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:46.850 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.848+0000 7f5ee4c90700 1 --2- 172.21.15.71:0/3172315242 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ee015cae0 0x7f5ee016a150 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5ed800cd00 tx=0x7f5ed8001ac0 comp rx=0 tx=0).stop 2023-10-06T01:40:46.851 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.848+0000 7f5ee4c90700 1 -- 172.21.15.71:0/3172315242 shutdown_connections 2023-10-06T01:40:46.851 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.848+0000 7f5ee4c90700 1 --2- 172.21.15.71:0/3172315242 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ee015cae0 0x7f5ee016a150 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:46.851 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.848+0000 7f5ee4c90700 1 --2- 172.21.15.71:0/3172315242 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5ee006a910 0x7f5ee00b26f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:46.851 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.848+0000 7f5ee4c90700 1 --2- 172.21.15.71:0/3172315242 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f5ec0066f30 0x7f5ec00693e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:46.851 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.848+0000 7f5ee4c90700 1 --2- 172.21.15.71:0/3172315242 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ee00cc740 0x7f5ee00b2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:46.851 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.848+0000 7f5ee4c90700 1 -- 172.21.15.71:0/3172315242 >> 172.21.15.71:0/3172315242 conn(0x7f5ee0067910 msgr2=0x7f5ee0069710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:46.851 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.848+0000 7f5ee4c90700 1 -- 172.21.15.71:0/3172315242 shutdown_connections 2023-10-06T01:40:46.851 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.848+0000 7f5ee4c90700 1 -- 172.21.15.71:0/3172315242 wait complete. 2023-10-06T01:40:46.862 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T01:40:46.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.977+0000 7fc2f3f2a700 1 Processor -- start 2023-10-06T01:40:46.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.978+0000 7fc2f3f2a700 1 -- start start 2023-10-06T01:40:46.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.978+0000 7fc2f3f2a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc2ec06c460 0x7fc2ec15da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:46.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.978+0000 7fc2f3f2a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc2ec0c7840 0x7fc2ec158f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:46.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.978+0000 7fc2f3f2a700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2ec0c7cb0 con 0x7fc2ec06c830 2023-10-06T01:40:46.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.979+0000 7fc2f3f2a700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2ec15dfc0 con 0x7fc2ec0c7840 2023-10-06T01:40:46.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.979+0000 7fc2f3f2a700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2ec0c7f90 con 0x7fc2ec06c460 2023-10-06T01:40:46.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.979+0000 7fc2f14c5700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc2ec0c7840 0x7fc2ec158f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:46.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.979+0000 7fc2f24c7700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fc2ec06c830 0x7fc2ec1594a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:59578/0 (socket says 172.21.15.71:59578) 2023-10-06T01:40:46.983 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.979+0000 7fc2f24c7700 1 -- 172.21.15.71:0/502952473 learned_addr learned my addr 172.21.15.71:0/502952473 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:40:46.983 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.979+0000 7fc2f1cc6700 1 --2- 172.21.15.71:0/502952473 >> v2:172.21.15.72:3300/0 conn(0x7fc2ec06c460 0x7fc2ec15da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:46.983 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.979+0000 7fc2f14c5700 1 -- 172.21.15.71:0/502952473 >> v2:172.21.15.72:3300/0 conn(0x7fc2ec06c460 msgr2=0x7fc2ec15da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:46.983 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.979+0000 7fc2f14c5700 1 --2- 172.21.15.71:0/502952473 >> v2:172.21.15.72:3300/0 conn(0x7fc2ec06c460 0x7fc2ec15da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:46.983 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.979+0000 7fc2f14c5700 1 -- 172.21.15.71:0/502952473 >> v1:172.21.15.71:6789/0 conn(0x7fc2ec06c830 legacy=0x7fc2ec1594a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:46.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.979+0000 7fc2f14c5700 1 -- 172.21.15.71:0/502952473 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2ec0c8270 con 0x7fc2ec0c7840 2023-10-06T01:40:46.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.979+0000 7fc2f0cc4700 1 -- 172.21.15.71:0/502952473 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2069441578 0 0) 0x7fc2ec0c7cb0 con 0x7fc2ec06c830 2023-10-06T01:40:46.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.979+0000 7fc2f14c5700 1 --2- 172.21.15.71:0/502952473 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2ec0c7840 0x7fc2ec158f60 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc0098e0 tx=0x7fc2dc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f285196fb6817547 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:46.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.979+0000 7fc2f0cc4700 1 -- 172.21.15.71:0/502952473 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc011630 con 0x7fc2ec0c7840 2023-10-06T01:40:46.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.979+0000 7fc2f0cc4700 1 -- 172.21.15.71:0/502952473 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2dc011790 con 0x7fc2ec0c7840 2023-10-06T01:40:46.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.979+0000 7fc2f0cc4700 1 -- 172.21.15.71:0/502952473 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc011b30 con 0x7fc2ec0c7840 2023-10-06T01:40:46.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.980+0000 7fc2f3f2a700 1 -- 172.21.15.71:0/502952473 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2ec0c7840 msgr2=0x7fc2ec158f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:46.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.980+0000 7fc2f3f2a700 1 --2- 172.21.15.71:0/502952473 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2ec0c7840 0x7fc2ec158f60 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc0098e0 tx=0x7fc2dc0091a0 comp rx=0 tx=0).stop 2023-10-06T01:40:46.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.980+0000 7fc2f3f2a700 1 -- 172.21.15.71:0/502952473 shutdown_connections 2023-10-06T01:40:46.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.980+0000 7fc2f3f2a700 1 --2- 172.21.15.71:0/502952473 >> v2:172.21.15.72:3300/0 conn(0x7fc2ec06c460 0x7fc2ec15da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:46.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.980+0000 7fc2f3f2a700 1 --2- 172.21.15.71:0/502952473 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2ec0c7840 0x7fc2ec158f60 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:46.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.980+0000 7fc2f3f2a700 1 -- 172.21.15.71:0/502952473 >> 172.21.15.71:0/502952473 conn(0x7fc2ec0c9cc0 msgr2=0x7fc2ec06acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:46.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.980+0000 7fc2f3f2a700 1 -- 172.21.15.71:0/502952473 shutdown_connections 2023-10-06T01:40:46.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.980+0000 7fc2f3f2a700 1 -- 172.21.15.71:0/502952473 wait complete. 2023-10-06T01:40:46.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.981+0000 7fc2f3f2a700 1 Processor -- start 2023-10-06T01:40:46.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.981+0000 7fc2f3f2a700 1 -- start start 2023-10-06T01:40:46.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.982+0000 7fc2f3f2a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc2ec06c460 0x7fc2ec1502b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:46.988 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.982+0000 7fc2f3f2a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2ec06c830 0x7fc2ec0c6430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:46.988 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.982+0000 7fc2f3f2a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2ec0c7840 0x7fc2ec14eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:46.988 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.982+0000 7fc2f3f2a700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ec0b1e60 con 0x7fc2ec0c7840 2023-10-06T01:40:46.988 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.982+0000 7fc2f3f2a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ec0c6970 con 0x7fc2ec06c830 2023-10-06T01:40:46.988 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.982+0000 7fc2f3f2a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ec0b10a0 con 0x7fc2ec06c460 2023-10-06T01:40:46.988 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.982+0000 7fc2f24c7700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2ec0c7840 0x7fc2ec14eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:46.988 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.982+0000 7fc2f24c7700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2ec0c7840 0x7fc2ec14eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47758/0 (socket says 172.21.15.71:47758) 2023-10-06T01:40:46.988 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.982+0000 7fc2f24c7700 1 -- 172.21.15.71:0/3933071723 learned_addr learned my addr 172.21.15.71:0/3933071723 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:46.988 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.982+0000 7fc2f14c5700 1 --2- 172.21.15.71:0/3933071723 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2ec06c830 0x7fc2ec0c6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:46.988 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.982+0000 7fc2f1cc6700 1 --2- 172.21.15.71:0/3933071723 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc2ec06c460 0x7fc2ec1502b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:46.989 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.982+0000 7fc2f24c7700 1 -- 172.21.15.71:0/3933071723 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc2ec06c460 msgr2=0x7fc2ec1502b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:46.989 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.982+0000 7fc2f24c7700 1 --2- 172.21.15.71:0/3933071723 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc2ec06c460 0x7fc2ec1502b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:46.989 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.982+0000 7fc2f24c7700 1 -- 172.21.15.71:0/3933071723 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2ec06c830 msgr2=0x7fc2ec0c6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:46.989 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.982+0000 7fc2f24c7700 1 --2- 172.21.15.71:0/3933071723 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2ec06c830 0x7fc2ec0c6430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:46.989 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.982+0000 7fc2f24c7700 1 -- 172.21.15.71:0/3933071723 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2dc009420 con 0x7fc2ec0c7840 2023-10-06T01:40:46.989 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.982+0000 7fc2f1cc6700 1 --2- 172.21.15.71:0/3933071723 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc2ec06c460 0x7fc2ec1502b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:40:46.989 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.982+0000 7fc2f24c7700 1 --2- 172.21.15.71:0/3933071723 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2ec0c7840 0x7fc2ec14eed0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc2e400c7e0 tx=0x7fc2e4007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:46.989 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.982+0000 7fc2e1ffb700 1 -- 172.21.15.71:0/3933071723 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e4005c00 con 0x7fc2ec0c7840 2023-10-06T01:40:46.989 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.982+0000 7fc2e1ffb700 1 -- 172.21.15.71:0/3933071723 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2e4005d80 con 0x7fc2ec0c7840 2023-10-06T01:40:46.989 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.982+0000 7fc2e1ffb700 1 -- 172.21.15.71:0/3933071723 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e4007320 con 0x7fc2ec0c7840 2023-10-06T01:40:46.989 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.982+0000 7fc2f3f2a700 1 -- 172.21.15.71:0/3933071723 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2ec0b1380 con 0x7fc2ec0c7840 2023-10-06T01:40:46.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.983+0000 7fc2f3f2a700 1 -- 172.21.15.71:0/3933071723 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2ec0b1940 con 0x7fc2ec0c7840 2023-10-06T01:40:46.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.984+0000 7fc2f3f2a700 1 -- 172.21.15.71:0/3933071723 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2ec0b1b60 con 0x7fc2ec0c7840 2023-10-06T01:40:46.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.984+0000 7fc2e1ffb700 1 -- 172.21.15.71:0/3933071723 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc2e401b3b0 con 0x7fc2ec0c7840 2023-10-06T01:40:46.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.984+0000 7fc2e1ffb700 1 --2- 172.21.15.71:0/3933071723 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fc2d0066f30 0x7fc2d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:46.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.984+0000 7fc2e1ffb700 1 -- 172.21.15.71:0/3933071723 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fc2e4083e80 con 0x7fc2ec0c7840 2023-10-06T01:40:46.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.984+0000 7fc2f1cc6700 1 --2- 172.21.15.71:0/3933071723 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fc2d0066f30 0x7fc2d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:46.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.985+0000 7fc2f1cc6700 1 --2- 172.21.15.71:0/3933071723 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fc2d0066f30 0x7fc2d00693e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc2e80076c0 tx=0x7fc2e800b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:46.991 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:46.989+0000 7fc2e1ffb700 1 -- 172.21.15.71:0/3933071723 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc2e4050ca0 con 0x7fc2ec0c7840 2023-10-06T01:40:47.172 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.170+0000 7fc2f3f2a700 1 -- 172.21.15.71:0/3933071723 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc2ec0c8550 con 0x7fc2ec0c7840 2023-10-06T01:40:47.172 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.170+0000 7fc2e1ffb700 1 -- 172.21.15.71:0/3933071723 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc2e4017070 con 0x7fc2ec0c7840 2023-10-06T01:40:47.172 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 8 2023-10-06T01:40:47.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.172+0000 7fc2f3f2a700 1 -- 172.21.15.71:0/3933071723 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fc2d0066f30 msgr2=0x7fc2d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:47.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.172+0000 7fc2f3f2a700 1 --2- 172.21.15.71:0/3933071723 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fc2d0066f30 0x7fc2d00693e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc2e80076c0 tx=0x7fc2e800b040 comp rx=0 tx=0).stop 2023-10-06T01:40:47.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.172+0000 7fc2f3f2a700 1 -- 172.21.15.71:0/3933071723 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2ec0c7840 msgr2=0x7fc2ec14eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:47.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.172+0000 7fc2f3f2a700 1 --2- 172.21.15.71:0/3933071723 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2ec0c7840 0x7fc2ec14eed0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc2e400c7e0 tx=0x7fc2e4007d90 comp rx=0 tx=0).stop 2023-10-06T01:40:47.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.172+0000 7fc2f3f2a700 1 -- 172.21.15.71:0/3933071723 shutdown_connections 2023-10-06T01:40:47.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.172+0000 7fc2f3f2a700 1 --2- 172.21.15.71:0/3933071723 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2ec0c7840 0x7fc2ec14eed0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:47.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.172+0000 7fc2f3f2a700 1 --2- 172.21.15.71:0/3933071723 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc2ec06c460 0x7fc2ec1502b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:47.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.172+0000 7fc2f3f2a700 1 --2- 172.21.15.71:0/3933071723 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fc2d0066f30 0x7fc2d00693e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:47.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.172+0000 7fc2f3f2a700 1 --2- 172.21.15.71:0/3933071723 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2ec06c830 0x7fc2ec0c6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:47.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.172+0000 7fc2f3f2a700 1 -- 172.21.15.71:0/3933071723 >> 172.21.15.71:0/3933071723 conn(0x7fc2ec0c9cc0 msgr2=0x7fc2ec0cb580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:47.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.172+0000 7fc2f3f2a700 1 -- 172.21.15.71:0/3933071723 shutdown_connections 2023-10-06T01:40:47.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.172+0000 7fc2f3f2a700 1 -- 172.21.15.71:0/3933071723 wait complete. 2023-10-06T01:40:47.186 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T01:40:47.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.301+0000 7fce7ffff700 1 Processor -- start 2023-10-06T01:40:47.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.301+0000 7fce7ffff700 1 -- start start 2023-10-06T01:40:47.307 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.303+0000 7fce7ffff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fce8006e030 0x7fce80157180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:47.307 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.303+0000 7fce7ffff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce80069790 con 0x7fce8006dc60 2023-10-06T01:40:47.307 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.303+0000 7fce7ffff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce800c8c00 con 0x7fce8006cf40 2023-10-06T01:40:47.307 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.303+0000 7fce7ffff700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce8015aa50 con 0x7fce8006e030 2023-10-06T01:40:47.307 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.303+0000 7fce7effd700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fce8006dc60 0x7fce80159ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:59582/0 (socket says 172.21.15.71:59582) 2023-10-06T01:40:47.307 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.303+0000 7fce7effd700 1 -- 172.21.15.71:0/185320036 learned_addr learned my addr 172.21.15.71:0/185320036 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:40:47.307 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.303+0000 7fce7f7fe700 1 --2- 172.21.15.71:0/185320036 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fce8006e030 0x7fce80157180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:47.307 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.303+0000 7fce7dffb700 1 -- 172.21.15.71:0/185320036 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2189107285 0 0) 0x7fce80069790 con 0x7fce8006dc60 2023-10-06T01:40:47.307 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.303+0000 7fce7dffb700 1 -- 172.21.15.71:0/185320036 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce68003570 con 0x7fce8006dc60 2023-10-06T01:40:47.308 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.303+0000 7fce7dffb700 1 -- 172.21.15.71:0/185320036 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 141695195 0 0) 0x7fce68003570 con 0x7fce8006dc60 2023-10-06T01:40:47.308 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.303+0000 7fce7dffb700 1 -- 172.21.15.71:0/185320036 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fce8006e030 msgr2=0x7fce80157180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:47.308 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.303+0000 7fce7dffb700 1 --2- 172.21.15.71:0/185320036 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fce8006e030 0x7fce80157180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:47.308 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.303+0000 7fce7dffb700 1 -- 172.21.15.71:0/185320036 >> v1:172.21.15.72:6789/0 conn(0x7fce8006cf40 legacy=0x7fce80156a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:47.308 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.303+0000 7fce7dffb700 1 -- 172.21.15.71:0/185320036 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce8015a1c0 con 0x7fce8006dc60 2023-10-06T01:40:47.308 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.303+0000 7fce7dffb700 1 -- 172.21.15.71:0/185320036 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1184243524 0 0) 0x7fce700017f0 con 0x7fce8006dc60 2023-10-06T01:40:47.308 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.303+0000 7fce7dffb700 1 -- 172.21.15.71:0/185320036 >> v1:172.21.15.71:6789/0 conn(0x7fce8006dc60 legacy=0x7fce80159ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:47.308 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.303+0000 7fce7dffb700 1 --2- 172.21.15.71:0/185320036 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fce68003a90 0x7fce68003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:47.308 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.303+0000 7fce7dffb700 1 --2- 172.21.15.71:0/185320036 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fce8006e030 0x7fce68004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:47.308 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.303+0000 7fce7dffb700 1 --2- 172.21.15.71:0/185320036 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce68004d50 0x7fce680051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:47.309 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.303+0000 7fce7dffb700 1 -- 172.21.15.71:0/185320036 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce8015aa50 con 0x7fce68004d50 2023-10-06T01:40:47.309 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.303+0000 7fce7dffb700 1 -- 172.21.15.71:0/185320036 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce6800bb10 con 0x7fce68003a90 2023-10-06T01:40:47.309 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.303+0000 7fce7dffb700 1 -- 172.21.15.71:0/185320036 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce6800bcd0 con 0x7fce8006e030 2023-10-06T01:40:47.309 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.303+0000 7fce7f7fe700 1 --2- 172.21.15.71:0/185320036 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce68004d50 0x7fce680051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:47.309 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.303+0000 7fce7effd700 1 --2- 172.21.15.71:0/185320036 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fce68003a90 0x7fce68003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:47.309 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.303+0000 7fce7e7fc700 1 --2- 172.21.15.71:0/185320036 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fce8006e030 0x7fce68004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:47.309 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.303+0000 7fce7f7fe700 1 -- 172.21.15.71:0/185320036 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fce8006e030 msgr2=0x7fce68004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:47.309 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.303+0000 7fce7f7fe700 1 --2- 172.21.15.71:0/185320036 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fce8006e030 0x7fce68004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:47.309 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.303+0000 7fce7f7fe700 1 -- 172.21.15.71:0/185320036 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fce68003a90 msgr2=0x7fce68003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:47.309 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.303+0000 7fce7f7fe700 1 --2- 172.21.15.71:0/185320036 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fce68003a90 0x7fce68003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:47.309 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.303+0000 7fce7f7fe700 1 -- 172.21.15.71:0/185320036 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce68003570 con 0x7fce68004d50 2023-10-06T01:40:47.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.303+0000 7fce7f7fe700 1 --2- 172.21.15.71:0/185320036 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce68004d50 0x7fce680051c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fce78009c00 tx=0x7fce780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90e0403ba1b363d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:47.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.303+0000 7fce7dffb700 1 -- 172.21.15.71:0/185320036 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce7800e710 con 0x7fce68004d50 2023-10-06T01:40:47.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.303+0000 7fce7dffb700 1 -- 172.21.15.71:0/185320036 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce7800e870 con 0x7fce68004d50 2023-10-06T01:40:47.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.303+0000 7fce7dffb700 1 -- 172.21.15.71:0/185320036 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce7800ec30 con 0x7fce68004d50 2023-10-06T01:40:47.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.304+0000 7fce7ffff700 1 -- 172.21.15.71:0/185320036 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce68004d50 msgr2=0x7fce680051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:47.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.304+0000 7fce7ffff700 1 --2- 172.21.15.71:0/185320036 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce68004d50 0x7fce680051c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fce78009c00 tx=0x7fce780091a0 comp rx=0 tx=0).stop 2023-10-06T01:40:47.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.304+0000 7fce7f7fe700 1 -- 172.21.15.71:0/185320036 reap_dead start 2023-10-06T01:40:47.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.304+0000 7fce7ffff700 1 -- 172.21.15.71:0/185320036 shutdown_connections 2023-10-06T01:40:47.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.304+0000 7fce7ffff700 1 -- 172.21.15.71:0/185320036 >> 172.21.15.71:0/185320036 conn(0x7fce800cea20 msgr2=0x7fce8006c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:47.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.304+0000 7fce7ffff700 1 -- 172.21.15.71:0/185320036 shutdown_connections 2023-10-06T01:40:47.311 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.304+0000 7fce7ffff700 1 -- 172.21.15.71:0/185320036 wait complete. 2023-10-06T01:40:47.311 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.305+0000 7fce7ffff700 1 Processor -- start 2023-10-06T01:40:47.311 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.305+0000 7fce7ffff700 1 -- start start 2023-10-06T01:40:47.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.306+0000 7fce7ffff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fce8016c800 0x7fce8016cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:47.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.306+0000 7fce7ffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce8016ae40 0x7fce800b2f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:47.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.306+0000 7fce7ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fce800b34c0 0x7fce800c6e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:47.314 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.306+0000 7fce7ffff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce800c69a0 con 0x7fce8016ae40 2023-10-06T01:40:47.314 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.306+0000 7fce7ffff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce8016ab60 con 0x7fce800b34c0 2023-10-06T01:40:47.314 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.306+0000 7fce7ffff700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce800c6070 con 0x7fce8016c800 2023-10-06T01:40:47.314 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.306+0000 7fce7e7fc700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce8016ae40 0x7fce800b2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:47.314 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.306+0000 7fce7e7fc700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce8016ae40 0x7fce800b2f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47778/0 (socket says 172.21.15.71:47778) 2023-10-06T01:40:47.314 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.306+0000 7fce7e7fc700 1 -- 172.21.15.71:0/3625179968 learned_addr learned my addr 172.21.15.71:0/3625179968 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:47.314 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.306+0000 7fce7f7fe700 1 --2- 172.21.15.71:0/3625179968 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fce800b34c0 0x7fce800c6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:47.314 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.306+0000 7fce7effd700 1 --2- 172.21.15.71:0/3625179968 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fce8016c800 0x7fce8016cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:47.314 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.306+0000 7fce7e7fc700 1 -- 172.21.15.71:0/3625179968 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fce8016c800 msgr2=0x7fce8016cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:47.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.306+0000 7fce7e7fc700 1 --2- 172.21.15.71:0/3625179968 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fce8016c800 0x7fce8016cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:47.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.306+0000 7fce7e7fc700 1 -- 172.21.15.71:0/3625179968 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fce800b34c0 msgr2=0x7fce800c6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:47.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.306+0000 7fce7e7fc700 1 --2- 172.21.15.71:0/3625179968 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fce800b34c0 0x7fce800c6e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:47.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.306+0000 7fce7e7fc700 1 -- 172.21.15.71:0/3625179968 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce800c6350 con 0x7fce8016ae40 2023-10-06T01:40:47.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.306+0000 7fce7e7fc700 1 --2- 172.21.15.71:0/3625179968 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce8016ae40 0x7fce800b2f80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fce7400f900 tx=0x7fce74007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:47.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.307+0000 7fce66ffd700 1 -- 172.21.15.71:0/3625179968 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce74013600 con 0x7fce8016ae40 2023-10-06T01:40:47.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.307+0000 7fce66ffd700 1 -- 172.21.15.71:0/3625179968 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce74013760 con 0x7fce8016ae40 2023-10-06T01:40:47.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.307+0000 7fce7ffff700 1 -- 172.21.15.71:0/3625179968 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce800c6630 con 0x7fce8016ae40 2023-10-06T01:40:47.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.307+0000 7fce66ffd700 1 -- 172.21.15.71:0/3625179968 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce74013b20 con 0x7fce8016ae40 2023-10-06T01:40:47.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.307+0000 7fce7ffff700 1 -- 172.21.15.71:0/3625179968 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce8016b2b0 con 0x7fce8016ae40 2023-10-06T01:40:47.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.307+0000 7fce7ffff700 1 -- 172.21.15.71:0/3625179968 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce80064ee0 con 0x7fce8016ae40 2023-10-06T01:40:47.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.308+0000 7fce66ffd700 1 -- 172.21.15.71:0/3625179968 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fce7401c400 con 0x7fce8016ae40 2023-10-06T01:40:47.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.308+0000 7fce66ffd700 1 --2- 172.21.15.71:0/3625179968 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fce6c066f30 0x7fce6c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:47.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.308+0000 7fce66ffd700 1 -- 172.21.15.71:0/3625179968 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fce74084bb0 con 0x7fce8016ae40 2023-10-06T01:40:47.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.308+0000 7fce7effd700 1 --2- 172.21.15.71:0/3625179968 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fce6c066f30 0x7fce6c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:47.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.309+0000 7fce7effd700 1 --2- 172.21.15.71:0/3625179968 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fce6c066f30 0x7fce6c0693e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fce70002250 tx=0x7fce70006040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:47.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.313+0000 7fce66ffd700 1 -- 172.21.15.71:0/3625179968 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fce74051a80 con 0x7fce8016ae40 2023-10-06T01:40:47.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.493+0000 7fce7ffff700 1 -- 172.21.15.71:0/3625179968 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fce80064aa0 con 0x7fce8016ae40 2023-10-06T01:40:47.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.494+0000 7fce66ffd700 1 -- 172.21.15.71:0/3625179968 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fce740170a0 con 0x7fce8016ae40 2023-10-06T01:40:47.496 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 32 2023-10-06T01:40:47.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.495+0000 7fce7ffff700 1 -- 172.21.15.71:0/3625179968 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fce6c066f30 msgr2=0x7fce6c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:47.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.495+0000 7fce7ffff700 1 --2- 172.21.15.71:0/3625179968 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fce6c066f30 0x7fce6c0693e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fce70002250 tx=0x7fce70006040 comp rx=0 tx=0).stop 2023-10-06T01:40:47.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.495+0000 7fce7ffff700 1 -- 172.21.15.71:0/3625179968 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce8016ae40 msgr2=0x7fce800b2f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:47.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.495+0000 7fce7ffff700 1 --2- 172.21.15.71:0/3625179968 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce8016ae40 0x7fce800b2f80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fce7400f900 tx=0x7fce74007d30 comp rx=0 tx=0).stop 2023-10-06T01:40:47.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.495+0000 7fce7ffff700 1 -- 172.21.15.71:0/3625179968 shutdown_connections 2023-10-06T01:40:47.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.495+0000 7fce7ffff700 1 --2- 172.21.15.71:0/3625179968 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fce6c066f30 0x7fce6c0693e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:47.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.496+0000 7fce7ffff700 1 --2- 172.21.15.71:0/3625179968 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fce800b34c0 0x7fce800c6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:47.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.496+0000 7fce7ffff700 1 --2- 172.21.15.71:0/3625179968 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fce8016c800 0x7fce8016cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:47.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.496+0000 7fce7ffff700 1 --2- 172.21.15.71:0/3625179968 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce8016ae40 0x7fce800b2f80 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:47.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.496+0000 7fce7ffff700 1 -- 172.21.15.71:0/3625179968 >> 172.21.15.71:0/3625179968 conn(0x7fce800cea20 msgr2=0x7fce800cc510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:47.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.496+0000 7fce7ffff700 1 -- 172.21.15.71:0/3625179968 shutdown_connections 2023-10-06T01:40:47.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.496+0000 7fce7ffff700 1 -- 172.21.15.71:0/3625179968 wait complete. 2023-10-06T01:40:47.509 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T01:40:47.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.624+0000 7f851423b700 1 Processor -- start 2023-10-06T01:40:47.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.624+0000 7f851423b700 1 -- start start 2023-10-06T01:40:47.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.625+0000 7f851423b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f850c0d0400 0x7f850c0b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:47.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.625+0000 7f851423b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f850c0ccd40 0x7f850c0cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:47.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.625+0000 7f851423b700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f850c0b6170 con 0x7f850c0cf7e0 2023-10-06T01:40:47.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.625+0000 7f851423b700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f850c15dd40 con 0x7f850c0ccd40 2023-10-06T01:40:47.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.625+0000 7f851423b700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f850c15e020 con 0x7f850c0d0400 2023-10-06T01:40:47.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.625+0000 7f85117d6700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f850c0ccd40 0x7f850c0cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:47.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.625+0000 7f85117d6700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f850c0ccd40 0x7f850c0cf2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47786/0 (socket says 172.21.15.71:47786) 2023-10-06T01:40:47.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.625+0000 7f85117d6700 1 -- 172.21.15.71:0/1237118028 learned_addr learned my addr 172.21.15.71:0/1237118028 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:47.630 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.625+0000 7f8511fd7700 1 --2- 172.21.15.71:0/1237118028 >> v2:172.21.15.72:3300/0 conn(0x7f850c0d0400 0x7f850c0b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:47.630 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.625+0000 7f85117d6700 1 -- 172.21.15.71:0/1237118028 >> v2:172.21.15.72:3300/0 conn(0x7f850c0d0400 msgr2=0x7f850c0b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:47.630 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.625+0000 7f85117d6700 1 --2- 172.21.15.71:0/1237118028 >> v2:172.21.15.72:3300/0 conn(0x7f850c0d0400 0x7f850c0b5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:47.630 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.625+0000 7f85117d6700 1 -- 172.21.15.71:0/1237118028 >> v1:172.21.15.72:6789/0 conn(0x7f850c0cf7e0 legacy=0x7f850c0b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:47.630 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.625+0000 7f85117d6700 1 -- 172.21.15.71:0/1237118028 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f850c0ceaa0 con 0x7f850c0ccd40 2023-10-06T01:40:47.630 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.626+0000 7f85117d6700 1 --2- 172.21.15.71:0/1237118028 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f850c0ccd40 0x7f850c0cf2a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f850c088f30 tx=0x7f84fc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8b6d271b28c99bd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:47.630 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.626+0000 7f8510fd5700 1 -- 172.21.15.71:0/1237118028 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84fc009e70 con 0x7f850c0ccd40 2023-10-06T01:40:47.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.626+0000 7f8510fd5700 1 -- 172.21.15.71:0/1237118028 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84fc00b860 con 0x7f850c0ccd40 2023-10-06T01:40:47.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.626+0000 7f8510fd5700 1 -- 172.21.15.71:0/1237118028 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84fc00bc00 con 0x7f850c0ccd40 2023-10-06T01:40:47.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.626+0000 7f851423b700 1 -- 172.21.15.71:0/1237118028 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f850c0ccd40 msgr2=0x7f850c0cf2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:47.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.626+0000 7f851423b700 1 --2- 172.21.15.71:0/1237118028 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f850c0ccd40 0x7f850c0cf2a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f850c088f30 tx=0x7f84fc009250 comp rx=0 tx=0).stop 2023-10-06T01:40:47.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.626+0000 7f851423b700 1 -- 172.21.15.71:0/1237118028 shutdown_connections 2023-10-06T01:40:47.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.626+0000 7f851423b700 1 --2- 172.21.15.71:0/1237118028 >> v2:172.21.15.72:3300/0 conn(0x7f850c0d0400 0x7f850c0b5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:47.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.626+0000 7f851423b700 1 --2- 172.21.15.71:0/1237118028 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f850c0ccd40 0x7f850c0cf2a0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:47.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.626+0000 7f851423b700 1 -- 172.21.15.71:0/1237118028 >> 172.21.15.71:0/1237118028 conn(0x7f850c06a220 msgr2=0x7f850c06a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:47.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.626+0000 7f851423b700 1 -- 172.21.15.71:0/1237118028 shutdown_connections 2023-10-06T01:40:47.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.626+0000 7f851423b700 1 -- 172.21.15.71:0/1237118028 wait complete. 2023-10-06T01:40:47.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.627+0000 7f851423b700 1 Processor -- start 2023-10-06T01:40:47.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.628+0000 7f851423b700 1 -- start start 2023-10-06T01:40:47.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.628+0000 7f851423b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f850c0ccd40 0x7f850c16a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:47.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.628+0000 7f851423b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f850c0cf7e0 0x7f850c155140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:47.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.628+0000 7f851423b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f850c0d0400 0x7f850c155680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:47.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.628+0000 7f851423b700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f850c153990 con 0x7f850c0d0400 2023-10-06T01:40:47.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.628+0000 7f851423b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f850c15ad00 con 0x7f850c0ccd40 2023-10-06T01:40:47.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.628+0000 7f851423b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f850c16ada0 con 0x7f850c0cf7e0 2023-10-06T01:40:47.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.628+0000 7f85127d8700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f850c0d0400 0x7f850c155680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:47.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.628+0000 7f85127d8700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f850c0d0400 0x7f850c155680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47794/0 (socket says 172.21.15.71:47794) 2023-10-06T01:40:47.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.628+0000 7f85127d8700 1 -- 172.21.15.71:0/1779331073 learned_addr learned my addr 172.21.15.71:0/1779331073 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:47.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.628+0000 7f8511fd7700 1 --2- 172.21.15.71:0/1779331073 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f850c0ccd40 0x7f850c16a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:47.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.628+0000 7f85117d6700 1 --2- 172.21.15.71:0/1779331073 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f850c0cf7e0 0x7f850c155140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:47.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.629+0000 7f85127d8700 1 -- 172.21.15.71:0/1779331073 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f850c0cf7e0 msgr2=0x7f850c155140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:47.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.629+0000 7f85127d8700 1 --2- 172.21.15.71:0/1779331073 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f850c0cf7e0 0x7f850c155140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:47.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.629+0000 7f85127d8700 1 -- 172.21.15.71:0/1779331073 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f850c0ccd40 msgr2=0x7f850c16a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:47.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.629+0000 7f85127d8700 1 --2- 172.21.15.71:0/1779331073 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f850c0ccd40 0x7f850c16a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:47.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.629+0000 7f85127d8700 1 -- 172.21.15.71:0/1779331073 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84fc0094f0 con 0x7f850c0d0400 2023-10-06T01:40:47.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.629+0000 7f85117d6700 1 --2- 172.21.15.71:0/1779331073 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f850c0cf7e0 0x7f850c155140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:40:47.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.629+0000 7f85127d8700 1 --2- 172.21.15.71:0/1779331073 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f850c0d0400 0x7f850c155680 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f850400c560 tx=0x7f8504007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:47.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.629+0000 7f8501ffb700 1 -- 172.21.15.71:0/1779331073 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8504011590 con 0x7f850c0d0400 2023-10-06T01:40:47.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.629+0000 7f8501ffb700 1 -- 172.21.15.71:0/1779331073 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85040116f0 con 0x7f850c0d0400 2023-10-06T01:40:47.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.629+0000 7f851423b700 1 -- 172.21.15.71:0/1779331073 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f850c159e10 con 0x7f850c0d0400 2023-10-06T01:40:47.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.629+0000 7f8501ffb700 1 -- 172.21.15.71:0/1779331073 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8504011ab0 con 0x7f850c0d0400 2023-10-06T01:40:47.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.629+0000 7f851423b700 1 -- 172.21.15.71:0/1779331073 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f850c15a3d0 con 0x7f850c0d0400 2023-10-06T01:40:47.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.630+0000 7f851423b700 1 -- 172.21.15.71:0/1779331073 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f850c088760 con 0x7f850c0d0400 2023-10-06T01:40:47.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.630+0000 7f8501ffb700 1 -- 172.21.15.71:0/1779331073 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f850401b3b0 con 0x7f850c0d0400 2023-10-06T01:40:47.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.631+0000 7f8501ffb700 1 --2- 172.21.15.71:0/1779331073 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f84f0066f30 0x7f84f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:47.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.631+0000 7f8501ffb700 1 -- 172.21.15.71:0/1779331073 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f8504083de0 con 0x7f850c0d0400 2023-10-06T01:40:47.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.631+0000 7f8511fd7700 1 --2- 172.21.15.71:0/1779331073 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f84f0066f30 0x7f84f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:47.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.631+0000 7f8511fd7700 1 --2- 172.21.15.71:0/1779331073 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f84f0066f30 0x7f84f00693e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f850800f510 tx=0x7f850800b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:47.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.635+0000 7f8501ffb700 1 -- 172.21.15.71:0/1779331073 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8504050c00 con 0x7f850c0d0400 2023-10-06T01:40:47.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.819+0000 7f851423b700 1 -- 172.21.15.71:0/1779331073 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f850c15ae40 con 0x7f850c0d0400 2023-10-06T01:40:47.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.820+0000 7f8501ffb700 1 -- 172.21.15.71:0/1779331073 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8504017070 con 0x7f850c0d0400 2023-10-06T01:40:47.821 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 64 2023-10-06T01:40:47.823 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.822+0000 7f851423b700 1 -- 172.21.15.71:0/1779331073 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f84f0066f30 msgr2=0x7f84f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:47.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.822+0000 7f851423b700 1 --2- 172.21.15.71:0/1779331073 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f84f0066f30 0x7f84f00693e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f850800f510 tx=0x7f850800b040 comp rx=0 tx=0).stop 2023-10-06T01:40:47.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.822+0000 7f851423b700 1 -- 172.21.15.71:0/1779331073 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f850c0d0400 msgr2=0x7f850c155680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:47.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.822+0000 7f851423b700 1 --2- 172.21.15.71:0/1779331073 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f850c0d0400 0x7f850c155680 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f850400c560 tx=0x7f8504007ef0 comp rx=0 tx=0).stop 2023-10-06T01:40:47.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.822+0000 7f851423b700 1 -- 172.21.15.71:0/1779331073 shutdown_connections 2023-10-06T01:40:47.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.822+0000 7f851423b700 1 --2- 172.21.15.71:0/1779331073 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f850c0d0400 0x7f850c155680 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:47.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.822+0000 7f851423b700 1 --2- 172.21.15.71:0/1779331073 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f84f0066f30 0x7f84f00693e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:47.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.822+0000 7f851423b700 1 --2- 172.21.15.71:0/1779331073 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f850c0ccd40 0x7f850c16a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:47.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.822+0000 7f851423b700 1 --2- 172.21.15.71:0/1779331073 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f850c0cf7e0 0x7f850c155140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:47.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.822+0000 7f851423b700 1 -- 172.21.15.71:0/1779331073 >> 172.21.15.71:0/1779331073 conn(0x7f850c06a220 msgr2=0x7f850c0b4ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:47.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.822+0000 7f851423b700 1 -- 172.21.15.71:0/1779331073 shutdown_connections 2023-10-06T01:40:47.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.822+0000 7f851423b700 1 -- 172.21.15.71:0/1779331073 wait complete. 2023-10-06T01:40:47.835 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-06T01:40:47.953 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.953+0000 7f9fec85b700 1 Processor -- start 2023-10-06T01:40:47.954 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.953+0000 7f9fec85b700 1 -- start start 2023-10-06T01:40:47.960 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.954+0000 7f9fec85b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9fe80ccd40 0x7f9fe80cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:47.961 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.954+0000 7f9fec85b700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fe815dd40 con 0x7f9fe80d0400 2023-10-06T01:40:47.961 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.954+0000 7f9fec85b700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fe815e020 con 0x7f9fe80cf7e0 2023-10-06T01:40:47.961 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.954+0000 7f9fec85b700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fe80ceaa0 con 0x7f9fe80ccd40 2023-10-06T01:40:47.961 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.954+0000 7f9fe659c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f9fe80d0400 0x7f9fe80b5c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:59586/0 (socket says 172.21.15.71:59586) 2023-10-06T01:40:47.961 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.954+0000 7f9fe659c700 1 -- 172.21.15.71:0/2812173442 learned_addr learned my addr 172.21.15.71:0/2812173442 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:40:47.961 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.954+0000 7f9fe5d9b700 1 -- 172.21.15.71:0/2812173442 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 317170449 0 0) 0x7f9fe815dd40 con 0x7f9fe80d0400 2023-10-06T01:40:47.961 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.954+0000 7f9fe5d9b700 1 -- 172.21.15.71:0/2812173442 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9fd4003570 con 0x7f9fe80d0400 2023-10-06T01:40:47.961 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.954+0000 7f9fdffff700 1 --2- 172.21.15.71:0/2812173442 >> v2:172.21.15.72:3300/0 conn(0x7f9fe80ccd40 0x7f9fe80cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:47.961 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.954+0000 7f9fe5d9b700 1 -- 172.21.15.71:0/2812173442 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 81010133 0 0) 0x7f9fd4003570 con 0x7f9fe80d0400 2023-10-06T01:40:47.961 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.954+0000 7f9fe5d9b700 1 -- 172.21.15.71:0/2812173442 >> v2:172.21.15.72:3300/0 conn(0x7f9fe80ccd40 msgr2=0x7f9fe80cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:47.962 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.954+0000 7f9fe5d9b700 1 --2- 172.21.15.71:0/2812173442 >> v2:172.21.15.72:3300/0 conn(0x7f9fe80ccd40 0x7f9fe80cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:47.962 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.954+0000 7f9fe5d9b700 1 -- 172.21.15.71:0/2812173442 >> v1:172.21.15.72:6789/0 conn(0x7f9fe80cf7e0 legacy=0x7f9fe80b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:47.962 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.954+0000 7f9fe5d9b700 1 -- 172.21.15.71:0/2812173442 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fe80ced80 con 0x7f9fe80d0400 2023-10-06T01:40:47.962 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.954+0000 7f9fe5d9b700 1 -- 172.21.15.71:0/2812173442 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1184243524 0 0) 0x7f9fd80015f0 con 0x7f9fe80d0400 2023-10-06T01:40:47.962 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.954+0000 7f9fe5d9b700 1 -- 172.21.15.71:0/2812173442 >> v1:172.21.15.71:6789/0 conn(0x7f9fe80d0400 legacy=0x7f9fe80b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:47.962 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.954+0000 7f9fe5d9b700 1 --2- 172.21.15.71:0/2812173442 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9fd4003a60 0x7f9fd4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:47.962 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.954+0000 7f9fe5d9b700 1 --2- 172.21.15.71:0/2812173442 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9fd4004810 0x7f9fd4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:47.962 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.954+0000 7f9fe5d9b700 1 --2- 172.21.15.71:0/2812173442 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9fd40051c0 0x7f9fd400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:47.962 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.954+0000 7f9fe5d9b700 1 -- 172.21.15.71:0/2812173442 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe80ceaa0 con 0x7f9fd40051c0 2023-10-06T01:40:47.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.954+0000 7f9fe5d9b700 1 -- 172.21.15.71:0/2812173442 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd400c0d0 con 0x7f9fd4003a60 2023-10-06T01:40:47.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.954+0000 7f9fe5d9b700 1 -- 172.21.15.71:0/2812173442 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd400c290 con 0x7f9fd4004810 2023-10-06T01:40:47.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.954+0000 7f9fe6d9d700 1 --2- 172.21.15.71:0/2812173442 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9fd40051c0 0x7f9fd400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:47.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.954+0000 7f9fe659c700 1 --2- 172.21.15.71:0/2812173442 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9fd4003a60 0x7f9fd4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:47.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.954+0000 7f9fdffff700 1 --2- 172.21.15.71:0/2812173442 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9fd4004810 0x7f9fd4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:47.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.955+0000 7f9fe6d9d700 1 -- 172.21.15.71:0/2812173442 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9fd4004810 msgr2=0x7f9fd4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:47.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.955+0000 7f9fe6d9d700 1 --2- 172.21.15.71:0/2812173442 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9fd4004810 0x7f9fd4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:47.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.955+0000 7f9fe6d9d700 1 -- 172.21.15.71:0/2812173442 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9fd4003a60 msgr2=0x7f9fd4003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:47.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.955+0000 7f9fe6d9d700 1 --2- 172.21.15.71:0/2812173442 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9fd4003a60 0x7f9fd4003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:47.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.955+0000 7f9fe6d9d700 1 -- 172.21.15.71:0/2812173442 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fd4003570 con 0x7f9fd40051c0 2023-10-06T01:40:47.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.955+0000 7f9fe6d9d700 1 -- 172.21.15.71:0/2812173442 reap_dead start 2023-10-06T01:40:47.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.955+0000 7f9fe6d9d700 1 --2- 172.21.15.71:0/2812173442 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9fd40051c0 0x7f9fd400ba60 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9fe0001fc0 tx=0x7f9fe0001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4236d0bb30e7608 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:47.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.955+0000 7f9fe5d9b700 1 -- 172.21.15.71:0/2812173442 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe0001950 con 0x7f9fd40051c0 2023-10-06T01:40:47.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.955+0000 7f9fe5d9b700 1 -- 172.21.15.71:0/2812173442 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fe000c8b0 con 0x7f9fd40051c0 2023-10-06T01:40:47.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.955+0000 7f9fe5d9b700 1 -- 172.21.15.71:0/2812173442 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe000cc90 con 0x7f9fd40051c0 2023-10-06T01:40:47.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.955+0000 7f9fec85b700 1 -- 172.21.15.71:0/2812173442 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9fd40051c0 msgr2=0x7f9fd400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:47.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.955+0000 7f9fec85b700 1 --2- 172.21.15.71:0/2812173442 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9fd40051c0 0x7f9fd400ba60 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9fe0001fc0 tx=0x7f9fe0001640 comp rx=0 tx=0).stop 2023-10-06T01:40:47.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.956+0000 7f9fec85b700 1 -- 172.21.15.71:0/2812173442 shutdown_connections 2023-10-06T01:40:47.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.956+0000 7f9fec85b700 1 --2- 172.21.15.71:0/2812173442 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9fd40051c0 0x7f9fd400ba60 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:47.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.956+0000 7f9fec85b700 1 -- 172.21.15.71:0/2812173442 >> 172.21.15.71:0/2812173442 conn(0x7f9fe806a220 msgr2=0x7f9fe806a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:47.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.956+0000 7f9fec85b700 1 -- 172.21.15.71:0/2812173442 shutdown_connections 2023-10-06T01:40:47.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.956+0000 7f9fec85b700 1 -- 172.21.15.71:0/2812173442 wait complete. 2023-10-06T01:40:47.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.957+0000 7f9fec85b700 1 Processor -- start 2023-10-06T01:40:47.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.957+0000 7f9fec85b700 1 -- start start 2023-10-06T01:40:47.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.957+0000 7f9fec85b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9fd40051c0 0x7f9fe81534f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:47.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.957+0000 7f9fec85b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9fe815c0e0 0x7f9fe80c6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:47.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.957+0000 7f9fec85b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9fe815c550 0x7f9fe80c70f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:47.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.957+0000 7f9fec85b700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe80c67f0 con 0x7f9fe815c0e0 2023-10-06T01:40:47.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.957+0000 7f9fec85b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe80c5ac0 con 0x7f9fd40051c0 2023-10-06T01:40:47.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.957+0000 7f9fec85b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe8153a30 con 0x7f9fe815c550 2023-10-06T01:40:47.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.957+0000 7f9fdffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9fe815c0e0 0x7f9fe80c6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:47.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.957+0000 7f9fdffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9fe815c0e0 0x7f9fe80c6bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47804/0 (socket says 172.21.15.71:47804) 2023-10-06T01:40:47.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.957+0000 7f9fdffff700 1 -- 172.21.15.71:0/1429972878 learned_addr learned my addr 172.21.15.71:0/1429972878 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:47.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.958+0000 7f9fe659c700 1 --2- 172.21.15.71:0/1429972878 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9fd40051c0 0x7f9fe81534f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:47.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.958+0000 7f9fe6d9d700 1 --2- 172.21.15.71:0/1429972878 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9fe815c550 0x7f9fe80c70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:47.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.958+0000 7f9fdffff700 1 -- 172.21.15.71:0/1429972878 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9fe815c550 msgr2=0x7f9fe80c70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:47.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.958+0000 7f9fdffff700 1 --2- 172.21.15.71:0/1429972878 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9fe815c550 0x7f9fe80c70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:47.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.958+0000 7f9fdffff700 1 -- 172.21.15.71:0/1429972878 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9fd40051c0 msgr2=0x7f9fe81534f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:47.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.958+0000 7f9fdffff700 1 --2- 172.21.15.71:0/1429972878 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9fd40051c0 0x7f9fe81534f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:47.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.958+0000 7f9fdffff700 1 -- 172.21.15.71:0/1429972878 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fe80c5cb0 con 0x7f9fe815c0e0 2023-10-06T01:40:47.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.958+0000 7f9fdffff700 1 --2- 172.21.15.71:0/1429972878 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9fe815c0e0 0x7f9fe80c6bb0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9fd0006ac0 tx=0x7f9fd00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:47.967 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.958+0000 7f9fde7fc700 1 -- 172.21.15.71:0/1429972878 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd0011ec0 con 0x7f9fe815c0e0 2023-10-06T01:40:47.967 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.958+0000 7f9fde7fc700 1 -- 172.21.15.71:0/1429972878 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fd000f940 con 0x7f9fe815c0e0 2023-10-06T01:40:47.967 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.958+0000 7f9fec85b700 1 -- 172.21.15.71:0/1429972878 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fe80c5f50 con 0x7f9fe815c0e0 2023-10-06T01:40:47.967 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.958+0000 7f9fde7fc700 1 -- 172.21.15.71:0/1429972878 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd000fcc0 con 0x7f9fe815c0e0 2023-10-06T01:40:47.967 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.958+0000 7f9fec85b700 1 -- 172.21.15.71:0/1429972878 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fe80c6510 con 0x7f9fe815c0e0 2023-10-06T01:40:47.967 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.959+0000 7f9fec85b700 1 -- 172.21.15.71:0/1429972878 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fe8159e70 con 0x7f9fe815c0e0 2023-10-06T01:40:47.967 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.959+0000 7f9fde7fc700 1 -- 172.21.15.71:0/1429972878 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9fd0014650 con 0x7f9fe815c0e0 2023-10-06T01:40:47.967 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.960+0000 7f9fde7fc700 1 --2- 172.21.15.71:0/1429972878 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f9fc8066f30 0x7f9fc80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:47.967 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.960+0000 7f9fde7fc700 1 -- 172.21.15.71:0/1429972878 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f9fd0018030 con 0x7f9fe815c0e0 2023-10-06T01:40:47.967 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.960+0000 7f9fe659c700 1 --2- 172.21.15.71:0/1429972878 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f9fc8066f30 0x7f9fc80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:47.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.960+0000 7f9fe659c700 1 --2- 172.21.15.71:0/1429972878 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f9fc8066f30 0x7f9fc80693e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9fd8007a30 tx=0x7f9fd8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:47.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:47.964+0000 7f9fde7fc700 1 -- 172.21.15.71:0/1429972878 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9fd0055b80 con 0x7f9fe815c0e0 2023-10-06T01:40:48.144 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.143+0000 7f9fec85b700 1 -- 172.21.15.71:0/1429972878 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f9fe80ce6c0 con 0x7f9fe815c0e0 2023-10-06T01:40:48.145 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.144+0000 7f9fde7fc700 1 -- 172.21.15.71:0/1429972878 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f9fd0055710 con 0x7f9fe815c0e0 2023-10-06T01:40:48.145 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 32 2023-10-06T01:40:48.147 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.146+0000 7f9fec85b700 1 -- 172.21.15.71:0/1429972878 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f9fc8066f30 msgr2=0x7f9fc80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:48.147 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.146+0000 7f9fec85b700 1 --2- 172.21.15.71:0/1429972878 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f9fc8066f30 0x7f9fc80693e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9fd8007a30 tx=0x7f9fd8009040 comp rx=0 tx=0).stop 2023-10-06T01:40:48.147 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.146+0000 7f9fec85b700 1 -- 172.21.15.71:0/1429972878 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9fe815c0e0 msgr2=0x7f9fe80c6bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:48.147 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.146+0000 7f9fec85b700 1 --2- 172.21.15.71:0/1429972878 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9fe815c0e0 0x7f9fe80c6bb0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9fd0006ac0 tx=0x7f9fd00091a0 comp rx=0 tx=0).stop 2023-10-06T01:40:48.147 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.146+0000 7f9fec85b700 1 -- 172.21.15.71:0/1429972878 shutdown_connections 2023-10-06T01:40:48.147 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.146+0000 7f9fec85b700 1 --2- 172.21.15.71:0/1429972878 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9fe815c550 0x7f9fe80c70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:48.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.146+0000 7f9fec85b700 1 --2- 172.21.15.71:0/1429972878 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f9fc8066f30 0x7f9fc80693e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:48.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.146+0000 7f9fec85b700 1 --2- 172.21.15.71:0/1429972878 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9fd40051c0 0x7f9fe81534f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:48.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.146+0000 7f9fec85b700 1 --2- 172.21.15.71:0/1429972878 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9fe815c0e0 0x7f9fe80c6bb0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:48.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.146+0000 7f9fec85b700 1 -- 172.21.15.71:0/1429972878 >> 172.21.15.71:0/1429972878 conn(0x7f9fe806a220 msgr2=0x7f9fe80b4d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:48.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.146+0000 7f9fec85b700 1 -- 172.21.15.71:0/1429972878 shutdown_connections 2023-10-06T01:40:48.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.146+0000 7f9fec85b700 1 -- 172.21.15.71:0/1429972878 wait complete. 2023-10-06T01:40:48.159 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T01:40:48.272 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.272+0000 7f9ea1778700 1 Processor -- start 2023-10-06T01:40:48.273 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.272+0000 7f9ea1778700 1 -- start start 2023-10-06T01:40:48.275 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.273+0000 7f9ea1778700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9e9c0b27f0 0x7f9e9c15db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:48.275 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.273+0000 7f9ea1778700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e9c15e190 con 0x7f9e9c0af8b0 2023-10-06T01:40:48.275 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.273+0000 7f9ea1778700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e9c0cb650 con 0x7f9e9c0af4e0 2023-10-06T01:40:48.275 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.273+0000 7f9ea1778700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e9c0b1910 con 0x7f9e9c0b27f0 2023-10-06T01:40:48.275 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.273+0000 7f9e9a7fc700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f9e9c0af8b0 0x7f9e9c15d460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:59594/0 (socket says 172.21.15.71:59594) 2023-10-06T01:40:48.276 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.273+0000 7f9e9a7fc700 1 -- 172.21.15.71:0/145554460 learned_addr learned my addr 172.21.15.71:0/145554460 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:40:48.276 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.273+0000 7f9e9b7fe700 1 --2- 172.21.15.71:0/145554460 >> v2:172.21.15.72:3300/0 conn(0x7f9e9c0b27f0 0x7f9e9c15db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:48.276 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.273+0000 7f9e99ffb700 1 -- 172.21.15.71:0/145554460 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 134286151 0 0) 0x7f9e9c15e190 con 0x7f9e9c0af8b0 2023-10-06T01:40:48.276 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.273+0000 7f9e99ffb700 1 -- 172.21.15.71:0/145554460 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e84003570 con 0x7f9e9c0af8b0 2023-10-06T01:40:48.276 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.273+0000 7f9e99ffb700 1 -- 172.21.15.71:0/145554460 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1886832359 0 0) 0x7f9e9c0cb650 con 0x7f9e9c0af4e0 2023-10-06T01:40:48.276 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.273+0000 7f9e99ffb700 1 -- 172.21.15.71:0/145554460 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e9c15e190 con 0x7f9e9c0af4e0 2023-10-06T01:40:48.276 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.273+0000 7f9e9b7fe700 1 -- 172.21.15.71:0/145554460 >> v1:172.21.15.72:6789/0 conn(0x7f9e9c0af4e0 legacy=0x7f9e9c0b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:48.276 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.273+0000 7f9e9b7fe700 1 -- 172.21.15.71:0/145554460 >> v1:172.21.15.71:6789/0 conn(0x7f9e9c0af8b0 legacy=0x7f9e9c15d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:48.276 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.273+0000 7f9e99ffb700 1 -- 172.21.15.71:0/145554460 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1910006016 0 0) 0x7f9e84003570 con 0x7f9e9c0af8b0 2023-10-06T01:40:48.276 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.273+0000 7f9e9b7fe700 1 -- 172.21.15.71:0/145554460 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e9c0ccaf0 con 0x7f9e9c0b27f0 2023-10-06T01:40:48.276 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.273+0000 7f9e9b7fe700 1 --2- 172.21.15.71:0/145554460 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e9c0b27f0 0x7f9e9c15db70 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9e94009e60 tx=0x7f9e94009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3761eb869dd4a47c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:48.276 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.274+0000 7f9e99ffb700 1 -- 172.21.15.71:0/145554460 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e9400e070 con 0x7f9e9c0b27f0 2023-10-06T01:40:48.277 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.274+0000 7f9e99ffb700 1 -- 172.21.15.71:0/145554460 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e9400b7a0 con 0x7f9e9c0b27f0 2023-10-06T01:40:48.277 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.274+0000 7f9e99ffb700 1 -- 172.21.15.71:0/145554460 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e90001470 con 0x7f9e9c0b27f0 2023-10-06T01:40:48.277 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.274+0000 7f9ea1778700 1 -- 172.21.15.71:0/145554460 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e9c0b27f0 msgr2=0x7f9e9c15db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:48.277 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.274+0000 7f9ea1778700 1 --2- 172.21.15.71:0/145554460 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e9c0b27f0 0x7f9e9c15db70 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9e94009e60 tx=0x7f9e94009780 comp rx=0 tx=0).stop 2023-10-06T01:40:48.277 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.274+0000 7f9ea1778700 1 -- 172.21.15.71:0/145554460 shutdown_connections 2023-10-06T01:40:48.277 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.274+0000 7f9ea1778700 1 --2- 172.21.15.71:0/145554460 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e9c0b27f0 0x7f9e9c15db70 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:48.277 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.274+0000 7f9ea1778700 1 -- 172.21.15.71:0/145554460 >> 172.21.15.71:0/145554460 conn(0x7f9e9c068680 msgr2=0x7f9e9c068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:48.277 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.274+0000 7f9ea1778700 1 -- 172.21.15.71:0/145554460 shutdown_connections 2023-10-06T01:40:48.277 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.274+0000 7f9ea1778700 1 -- 172.21.15.71:0/145554460 wait complete. 2023-10-06T01:40:48.280 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.275+0000 7f9ea1778700 1 Processor -- start 2023-10-06T01:40:48.280 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.275+0000 7f9ea1778700 1 -- start start 2023-10-06T01:40:48.280 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.276+0000 7f9ea1778700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e9c0af4e0 0x7f9e9c0c7300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:48.280 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.276+0000 7f9ea1778700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e9c0af8b0 0x7f9e9c151300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:48.280 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.276+0000 7f9ea1778700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9e9c0b27f0 0x7f9e9c0cde20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:48.280 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.276+0000 7f9ea1778700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9c16d640 con 0x7f9e9c0af4e0 2023-10-06T01:40:48.281 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.276+0000 7f9ea1778700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9c0ce990 con 0x7f9e9c0af8b0 2023-10-06T01:40:48.281 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.276+0000 7f9ea1778700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9c0cec70 con 0x7f9e9c0b27f0 2023-10-06T01:40:48.281 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.276+0000 7f9e9affd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e9c0af4e0 0x7f9e9c0c7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:48.281 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.276+0000 7f9e9affd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e9c0af4e0 0x7f9e9c0c7300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47812/0 (socket says 172.21.15.71:47812) 2023-10-06T01:40:48.281 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.276+0000 7f9e9affd700 1 -- 172.21.15.71:0/764475882 learned_addr learned my addr 172.21.15.71:0/764475882 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:48.281 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.276+0000 7f9e9b7fe700 1 --2- 172.21.15.71:0/764475882 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9e9c0b27f0 0x7f9e9c0cde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:48.281 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.276+0000 7f9e9a7fc700 1 --2- 172.21.15.71:0/764475882 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e9c0af8b0 0x7f9e9c151300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:48.281 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.276+0000 7f9e9affd700 1 -- 172.21.15.71:0/764475882 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9e9c0b27f0 msgr2=0x7f9e9c0cde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:48.281 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.276+0000 7f9e9affd700 1 --2- 172.21.15.71:0/764475882 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9e9c0b27f0 0x7f9e9c0cde20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:48.281 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.277+0000 7f9e9affd700 1 -- 172.21.15.71:0/764475882 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e9c0af8b0 msgr2=0x7f9e9c151300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:48.281 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.277+0000 7f9e9affd700 1 --2- 172.21.15.71:0/764475882 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e9c0af8b0 0x7f9e9c151300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:48.282 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.277+0000 7f9e9affd700 1 -- 172.21.15.71:0/764475882 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e94009a20 con 0x7f9e9c0af4e0 2023-10-06T01:40:48.282 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.277+0000 7f9e9a7fc700 1 --2- 172.21.15.71:0/764475882 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e9c0af8b0 0x7f9e9c151300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:40:48.282 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.277+0000 7f9e9affd700 1 --2- 172.21.15.71:0/764475882 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e9c0af4e0 0x7f9e9c0c7300 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c00c790 tx=0x7f9e8c007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:48.282 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.277+0000 7f9e82ffd700 1 -- 172.21.15.71:0/764475882 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e8c010510 con 0x7f9e9c0af4e0 2023-10-06T01:40:48.282 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.277+0000 7f9e82ffd700 1 -- 172.21.15.71:0/764475882 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e8c010670 con 0x7f9e9c0af4e0 2023-10-06T01:40:48.282 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.277+0000 7f9ea1778700 1 -- 172.21.15.71:0/764475882 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e9c0cf6a0 con 0x7f9e9c0af4e0 2023-10-06T01:40:48.282 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.277+0000 7f9e82ffd700 1 -- 172.21.15.71:0/764475882 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e8c010a10 con 0x7f9e9c0af4e0 2023-10-06T01:40:48.282 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.277+0000 7f9ea1778700 1 -- 172.21.15.71:0/764475882 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e9c0cfc60 con 0x7f9e9c0af4e0 2023-10-06T01:40:48.282 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.278+0000 7f9ea1778700 1 -- 172.21.15.71:0/764475882 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e9c0b5ff0 con 0x7f9e9c0af4e0 2023-10-06T01:40:48.282 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.278+0000 7f9e82ffd700 1 -- 172.21.15.71:0/764475882 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9e8c01b400 con 0x7f9e9c0af4e0 2023-10-06T01:40:48.282 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.278+0000 7f9e82ffd700 1 --2- 172.21.15.71:0/764475882 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f9e88066f30 0x7f9e880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:48.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.279+0000 7f9e82ffd700 1 -- 172.21.15.71:0/764475882 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f9e8c084780 con 0x7f9e9c0af4e0 2023-10-06T01:40:48.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.279+0000 7f9e9a7fc700 1 --2- 172.21.15.71:0/764475882 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f9e88066f30 0x7f9e880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:48.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.279+0000 7f9e9a7fc700 1 --2- 172.21.15.71:0/764475882 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f9e88066f30 0x7f9e880693e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9e900015a0 tx=0x7f9e90009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:48.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.283+0000 7f9e82ffd700 1 -- 172.21.15.71:0/764475882 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9e8c0515a0 con 0x7f9e9c0af4e0 2023-10-06T01:40:48.507 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.507+0000 7f9ea1778700 1 -- 172.21.15.71:0/764475882 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9e9c0cad20 con 0x7f9e9c0af4e0 2023-10-06T01:40:48.508 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.507+0000 7f9e82ffd700 1 -- 172.21.15.71:0/764475882 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4590 (secure 0 0 0) 0x7f9e8c054bc0 con 0x7f9e9c0af4e0 2023-10-06T01:40:48.508 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:40:48.508 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6836/274053969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":274053969},{"type":"v1","addr":"172.21.15.71:6836","nonce":274053969}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/4158221694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6835","nonce":4158221694},{"type":"v1","addr":"172.21.15.71:6837","nonce":4158221694}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/1094581488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":1094581488},{"type":"v1","addr":"172.21.15.72:6835","nonce":1094581488}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T01:40:21.151426+0000","modified":"2023-10-06T01:40:39.857922+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4315},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4315":{"gid":4315,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6834/2361644634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6833","nonce":2361644634},{"type":"v1","addr":"172.21.15.72:6834","nonce":2361644634}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T01:40:48.510 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.509+0000 7f9ea1778700 1 -- 172.21.15.71:0/764475882 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f9e88066f30 msgr2=0x7f9e880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:48.510 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.509+0000 7f9ea1778700 1 --2- 172.21.15.71:0/764475882 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f9e88066f30 0x7f9e880693e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9e900015a0 tx=0x7f9e90009040 comp rx=0 tx=0).stop 2023-10-06T01:40:48.510 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.509+0000 7f9ea1778700 1 -- 172.21.15.71:0/764475882 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e9c0af4e0 msgr2=0x7f9e9c0c7300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:48.511 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.509+0000 7f9ea1778700 1 --2- 172.21.15.71:0/764475882 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e9c0af4e0 0x7f9e9c0c7300 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c00c790 tx=0x7f9e8c007e10 comp rx=0 tx=0).stop 2023-10-06T01:40:48.511 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.509+0000 7f9ea1778700 1 -- 172.21.15.71:0/764475882 shutdown_connections 2023-10-06T01:40:48.511 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.509+0000 7f9ea1778700 1 --2- 172.21.15.71:0/764475882 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9e9c0b27f0 0x7f9e9c0cde20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:48.511 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.509+0000 7f9ea1778700 1 --2- 172.21.15.71:0/764475882 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e9c0af4e0 0x7f9e9c0c7300 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:48.511 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.509+0000 7f9ea1778700 1 --2- 172.21.15.71:0/764475882 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f9e88066f30 0x7f9e880693e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:48.511 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.509+0000 7f9ea1778700 1 --2- 172.21.15.71:0/764475882 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e9c0af8b0 0x7f9e9c151300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:48.511 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.509+0000 7f9ea1778700 1 -- 172.21.15.71:0/764475882 >> 172.21.15.71:0/764475882 conn(0x7f9e9c068680 msgr2=0x7f9e9c15d230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:48.511 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.509+0000 7f9ea1778700 1 -- 172.21.15.71:0/764475882 shutdown_connections 2023-10-06T01:40:48.511 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.509+0000 7f9ea1778700 1 -- 172.21.15.71:0/764475882 wait complete. 2023-10-06T01:40:48.512 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 9 2023-10-06T01:40:48.522 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:40:48.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.635+0000 7fca07f55700 1 Processor -- start 2023-10-06T01:40:48.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.635+0000 7fca07f55700 1 -- start start 2023-10-06T01:40:48.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.636+0000 7fca07f55700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fca000af4e0 0x7fca000b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:48.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.636+0000 7fca07f55700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fca0015db70 0x7fca000b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:48.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.636+0000 7fca07f55700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca0015e190 con 0x7fca000af8b0 2023-10-06T01:40:48.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.636+0000 7fca07f55700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca000b1910 con 0x7fca000af4e0 2023-10-06T01:40:48.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.636+0000 7fca07f55700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca0015dfa0 con 0x7fca0015db70 2023-10-06T01:40:48.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.636+0000 7fca05cf1700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fca000af4e0 0x7fca000b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:48.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.636+0000 7fca054f0700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fca000af8b0 0x7fca0015d460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:59598/0 (socket says 172.21.15.71:59598) 2023-10-06T01:40:48.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.636+0000 7fca054f0700 1 -- 172.21.15.71:0/1110694728 learned_addr learned my addr 172.21.15.71:0/1110694728 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:40:48.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.636+0000 7fca064f2700 1 --2- 172.21.15.71:0/1110694728 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fca0015db70 0x7fca000b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:48.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.636+0000 7fca05cf1700 1 -- 172.21.15.71:0/1110694728 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fca0015db70 msgr2=0x7fca000b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:48.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.636+0000 7fca05cf1700 1 --2- 172.21.15.71:0/1110694728 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fca0015db70 0x7fca000b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:48.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.636+0000 7fca05cf1700 1 -- 172.21.15.71:0/1110694728 >> v1:172.21.15.71:6789/0 conn(0x7fca000af8b0 legacy=0x7fca0015d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:48.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.636+0000 7fca05cf1700 1 -- 172.21.15.71:0/1110694728 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca000cb650 con 0x7fca000af4e0 2023-10-06T01:40:48.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.636+0000 7fca04cef700 1 -- 172.21.15.71:0/1110694728 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 291344813 0 0) 0x7fca0015e190 con 0x7fca000af8b0 2023-10-06T01:40:48.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.636+0000 7fca05cf1700 1 --2- 172.21.15.71:0/1110694728 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca000af4e0 0x7fca000b20e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc9f8009e60 tx=0x7fc9f8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a38f26e9084d2f50 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:48.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.636+0000 7fca04cef700 1 -- 172.21.15.71:0/1110694728 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9f800e070 con 0x7fca000af4e0 2023-10-06T01:40:48.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.637+0000 7fca04cef700 1 -- 172.21.15.71:0/1110694728 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9f800bc30 con 0x7fca000af4e0 2023-10-06T01:40:48.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.637+0000 7fca04cef700 1 -- 172.21.15.71:0/1110694728 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9f8012430 con 0x7fca000af4e0 2023-10-06T01:40:48.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.637+0000 7fca07f55700 1 -- 172.21.15.71:0/1110694728 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca000af4e0 msgr2=0x7fca000b20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:48.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.637+0000 7fca07f55700 1 --2- 172.21.15.71:0/1110694728 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca000af4e0 0x7fca000b20e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc9f8009e60 tx=0x7fc9f8009780 comp rx=0 tx=0).stop 2023-10-06T01:40:48.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.637+0000 7fca07f55700 1 -- 172.21.15.71:0/1110694728 shutdown_connections 2023-10-06T01:40:48.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.637+0000 7fca07f55700 1 --2- 172.21.15.71:0/1110694728 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fca0015db70 0x7fca000b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:48.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.637+0000 7fca07f55700 1 --2- 172.21.15.71:0/1110694728 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca000af4e0 0x7fca000b20e0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:48.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.637+0000 7fca07f55700 1 -- 172.21.15.71:0/1110694728 >> 172.21.15.71:0/1110694728 conn(0x7fca00068680 msgr2=0x7fca00068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:48.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.637+0000 7fca07f55700 1 -- 172.21.15.71:0/1110694728 shutdown_connections 2023-10-06T01:40:48.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.637+0000 7fca07f55700 1 -- 172.21.15.71:0/1110694728 wait complete. 2023-10-06T01:40:48.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.638+0000 7fca07f55700 1 Processor -- start 2023-10-06T01:40:48.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.638+0000 7fca07f55700 1 -- start start 2023-10-06T01:40:48.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.639+0000 7fca07f55700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fca000af4e0 0x7fca001595d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:48.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.639+0000 7fca07f55700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca000af8b0 0x7fca000a89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:48.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.639+0000 7fca07f55700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca0015db70 0x7fca000a8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:48.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.639+0000 7fca07f55700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca0016a8c0 con 0x7fca0015db70 2023-10-06T01:40:48.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.639+0000 7fca07f55700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca00159b10 con 0x7fca000af8b0 2023-10-06T01:40:48.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.639+0000 7fca07f55700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca00169cf0 con 0x7fca000af4e0 2023-10-06T01:40:48.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.639+0000 7fca064f2700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca0015db70 0x7fca000a8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:48.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.639+0000 7fca064f2700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca0015db70 0x7fca000a8ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47830/0 (socket says 172.21.15.71:47830) 2023-10-06T01:40:48.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.639+0000 7fca064f2700 1 -- 172.21.15.71:0/2742621942 learned_addr learned my addr 172.21.15.71:0/2742621942 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:48.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.639+0000 7fca05cf1700 1 --2- 172.21.15.71:0/2742621942 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fca000af4e0 0x7fca001595d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:48.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.639+0000 7fca054f0700 1 --2- 172.21.15.71:0/2742621942 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca000af8b0 0x7fca000a89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:48.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.639+0000 7fca064f2700 1 -- 172.21.15.71:0/2742621942 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fca000af4e0 msgr2=0x7fca001595d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:48.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.639+0000 7fca064f2700 1 --2- 172.21.15.71:0/2742621942 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fca000af4e0 0x7fca001595d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:48.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.639+0000 7fca064f2700 1 -- 172.21.15.71:0/2742621942 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca000af8b0 msgr2=0x7fca000a89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:48.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.639+0000 7fca064f2700 1 --2- 172.21.15.71:0/2742621942 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca000af8b0 0x7fca000a89a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:48.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.639+0000 7fca064f2700 1 -- 172.21.15.71:0/2742621942 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9f8009a20 con 0x7fca0015db70 2023-10-06T01:40:48.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.640+0000 7fca064f2700 1 --2- 172.21.15.71:0/2742621942 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca0015db70 0x7fca000a8ee0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc9f000d890 tx=0x7fc9f0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:48.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.640+0000 7fc9fdffb700 1 -- 172.21.15.71:0/2742621942 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9f00125f0 con 0x7fca0015db70 2023-10-06T01:40:48.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.640+0000 7fc9fdffb700 1 -- 172.21.15.71:0/2742621942 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9f0012770 con 0x7fca0015db70 2023-10-06T01:40:48.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.640+0000 7fca07f55700 1 -- 172.21.15.71:0/2742621942 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca00169f90 con 0x7fca0015db70 2023-10-06T01:40:48.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.640+0000 7fc9fdffb700 1 -- 172.21.15.71:0/2742621942 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9f0012b30 con 0x7fca0015db70 2023-10-06T01:40:48.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.640+0000 7fca07f55700 1 -- 172.21.15.71:0/2742621942 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca0016a550 con 0x7fca0015db70 2023-10-06T01:40:48.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.641+0000 7fca07f55700 1 -- 172.21.15.71:0/2742621942 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca00088aa0 con 0x7fca0015db70 2023-10-06T01:40:48.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.641+0000 7fc9fdffb700 1 -- 172.21.15.71:0/2742621942 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc9f001e460 con 0x7fca0015db70 2023-10-06T01:40:48.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.642+0000 7fc9fdffb700 1 --2- 172.21.15.71:0/2742621942 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fc9ec066fb0 0x7fc9ec069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:48.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.642+0000 7fc9fdffb700 1 -- 172.21.15.71:0/2742621942 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fc9f0084f20 con 0x7fca0015db70 2023-10-06T01:40:48.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.642+0000 7fca05cf1700 1 --2- 172.21.15.71:0/2742621942 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fc9ec066fb0 0x7fc9ec069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:48.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.642+0000 7fca05cf1700 1 --2- 172.21.15.71:0/2742621942 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fc9ec066fb0 0x7fc9ec069460 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc9f8009e60 tx=0x7fc9f8019000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:48.646 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.646+0000 7fc9fdffb700 1 -- 172.21.15.71:0/2742621942 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc9f0051ca0 con 0x7fca0015db70 2023-10-06T01:40:48.833 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.833+0000 7fca07f55700 1 -- 172.21.15.71:0/2742621942 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fca000b0910 con 0x7fca0015db70 2023-10-06T01:40:48.834 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.833+0000 7fc9fdffb700 1 -- 172.21.15.71:0/2742621942 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18659 (secure 0 0 0) 0x7fc9f00552c0 con 0x7fca0015db70 2023-10-06T01:40:48.834 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:40:48.835 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":27,"fsid":"1fbf1bd2-f9b4-4599-bea2-f4aa920e9a56","created":"2023-10-06T01:39:57.016957+0000","modified":"2023-10-06T01:40:26.202441+0000","last_up_change":"2023-10-06T01:40:08.571643+0000","last_in_change":"2023-10-06T01:39:59.462741+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T01:40:08.610349+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T01:40:15.387434+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T01:40:19.640459+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T01:40:20.116883+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T01:40:23.830129+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cf059188-fb20-4dbf-95db-dcf57b213d03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":90670},{"type":"v1","addr":"172.21.15.71:6817","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":90670},{"type":"v1","addr":"172.21.15.71:6819","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":90670},{"type":"v1","addr":"172.21.15.71:6823","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":90670},{"type":"v1","addr":"172.21.15.71:6821","nonce":90670}]},"public_addr":"172.21.15.71:6817/90670","cluster_addr":"172.21.15.71:6819/90670","heartbeat_back_addr":"172.21.15.71:6823/90670","heartbeat_front_addr":"172.21.15.71:6821/90670","state":["exists","up"]},{"osd":1,"uuid":"0cff0aae-1799-4fe0-b610-54cf0813c0e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":90669},{"type":"v1","addr":"172.21.15.71:6809","nonce":90669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":90669},{"type":"v1","addr":"172.21.15.71:6811","nonce":90669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":90669},{"type":"v1","addr":"172.21.15.71:6815","nonce":90669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":90669},{"type":"v1","addr":"172.21.15.71:6813","nonce":90669}]},"public_addr":"172.21.15.71:6809/90669","cluster_addr":"172.21.15.71:6811/90669","heartbeat_back_addr":"172.21.15.71:6815/90669","heartbeat_front_addr":"172.21.15.71:6813/90669","state":["exists","up"]},{"osd":2,"uuid":"88d61ddc-9031-44e1-ba8c-546a41e7c8ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":90679},{"type":"v1","addr":"172.21.15.71:6825","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":90679},{"type":"v1","addr":"172.21.15.71:6827","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":90679},{"type":"v1","addr":"172.21.15.71:6831","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":90679},{"type":"v1","addr":"172.21.15.71:6829","nonce":90679}]},"public_addr":"172.21.15.71:6825/90679","cluster_addr":"172.21.15.71:6827/90679","heartbeat_back_addr":"172.21.15.71:6831/90679","heartbeat_front_addr":"172.21.15.71:6829/90679","state":["exists","up"]},{"osd":3,"uuid":"11ed92b7-960b-4a30-a889-a61d3eeb86f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":90668},{"type":"v1","addr":"172.21.15.71:6801","nonce":90668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":90668},{"type":"v1","addr":"172.21.15.71:6803","nonce":90668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":90668},{"type":"v1","addr":"172.21.15.71:6807","nonce":90668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":90668},{"type":"v1","addr":"172.21.15.71:6805","nonce":90668}]},"public_addr":"172.21.15.71:6801/90668","cluster_addr":"172.21.15.71:6803/90668","heartbeat_back_addr":"172.21.15.71:6807/90668","heartbeat_front_addr":"172.21.15.71:6805/90668","state":["exists","up"]},{"osd":4,"uuid":"ae4df784-abdf-4ddf-aefa-780f3ddafef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":90917},{"type":"v1","addr":"172.21.15.72:6801","nonce":90917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":90917},{"type":"v1","addr":"172.21.15.72:6803","nonce":90917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":90917},{"type":"v1","addr":"172.21.15.72:6807","nonce":90917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":90917},{"type":"v1","addr":"172.21.15.72:6805","nonce":90917}]},"public_addr":"172.21.15.72:6801/90917","cluster_addr":"172.21.15.72:6803/90917","heartbeat_back_addr":"172.21.15.72:6807/90917","heartbeat_front_addr":"172.21.15.72:6805/90917","state":["exists","up"]},{"osd":5,"uuid":"5ef0790f-001e-458f-a05b-efae216cf435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":90941},{"type":"v1","addr":"172.21.15.72:6817","nonce":90941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":90941},{"type":"v1","addr":"172.21.15.72:6819","nonce":90941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":90941},{"type":"v1","addr":"172.21.15.72:6827","nonce":90941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":90941},{"type":"v1","addr":"172.21.15.72:6823","nonce":90941}]},"public_addr":"172.21.15.72:6817/90941","cluster_addr":"172.21.15.72:6819/90941","heartbeat_back_addr":"172.21.15.72:6827/90941","heartbeat_front_addr":"172.21.15.72:6823/90941","state":["exists","up"]},{"osd":6,"uuid":"8705aef1-9ae8-4e54-a3c4-c2909fa0ceb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":90918},{"type":"v1","addr":"172.21.15.72:6809","nonce":90918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":90918},{"type":"v1","addr":"172.21.15.72:6811","nonce":90918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":90918},{"type":"v1","addr":"172.21.15.72:6815","nonce":90918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":90918},{"type":"v1","addr":"172.21.15.72:6813","nonce":90918}]},"public_addr":"172.21.15.72:6809/90918","cluster_addr":"172.21.15.72:6811/90918","heartbeat_back_addr":"172.21.15.72:6815/90918","heartbeat_front_addr":"172.21.15.72:6813/90918","state":["exists","up"]},{"osd":7,"uuid":"364c5119-6b13-4c75-b3f0-15e165eff86a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":90948},{"type":"v1","addr":"172.21.15.72:6822","nonce":90948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":90948},{"type":"v1","addr":"172.21.15.72:6826","nonce":90948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":90948},{"type":"v1","addr":"172.21.15.72:6831","nonce":90948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":90948},{"type":"v1","addr":"172.21.15.72:6829","nonce":90948}]},"public_addr":"172.21.15.72:6822/90948","cluster_addr":"172.21.15.72:6826/90948","heartbeat_back_addr":"172.21.15.72:6831/90948","heartbeat_front_addr":"172.21.15.72:6829/90948","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.642976+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.645372+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.619116+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.663042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.599163+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.646411+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.631545+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.669821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:40:48.836 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.835+0000 7fca07f55700 1 -- 172.21.15.71:0/2742621942 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fc9ec066fb0 msgr2=0x7fc9ec069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:48.836 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.835+0000 7fca07f55700 1 --2- 172.21.15.71:0/2742621942 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fc9ec066fb0 0x7fc9ec069460 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc9f8009e60 tx=0x7fc9f8019000 comp rx=0 tx=0).stop 2023-10-06T01:40:48.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.835+0000 7fca07f55700 1 -- 172.21.15.71:0/2742621942 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca0015db70 msgr2=0x7fca000a8ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:48.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.835+0000 7fca07f55700 1 --2- 172.21.15.71:0/2742621942 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca0015db70 0x7fca000a8ee0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc9f000d890 tx=0x7fc9f0008040 comp rx=0 tx=0).stop 2023-10-06T01:40:48.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.835+0000 7fca07f55700 1 -- 172.21.15.71:0/2742621942 shutdown_connections 2023-10-06T01:40:48.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.835+0000 7fca07f55700 1 --2- 172.21.15.71:0/2742621942 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fca0015db70 0x7fca000a8ee0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:48.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.835+0000 7fca07f55700 1 --2- 172.21.15.71:0/2742621942 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fca000af4e0 0x7fca001595d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:48.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.835+0000 7fca07f55700 1 --2- 172.21.15.71:0/2742621942 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fc9ec066fb0 0x7fc9ec069460 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:48.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.835+0000 7fca07f55700 1 --2- 172.21.15.71:0/2742621942 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca000af8b0 0x7fca000a89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:48.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.835+0000 7fca07f55700 1 -- 172.21.15.71:0/2742621942 >> 172.21.15.71:0/2742621942 conn(0x7fca00068680 msgr2=0x7fca000b49e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:48.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.835+0000 7fca07f55700 1 -- 172.21.15.71:0/2742621942 shutdown_connections 2023-10-06T01:40:48.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.835+0000 7fca07f55700 1 -- 172.21.15.71:0/2742621942 wait complete. 2023-10-06T01:40:48.848 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T01:40:08.610349+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T01:40:15.387434+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T01:40:19.640459+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T01:40:20.116883+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-06T01:40:23.830129+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T01:40:48.849 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T01:40:48.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.968+0000 7f504c922700 1 Processor -- start 2023-10-06T01:40:48.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.968+0000 7f504c922700 1 -- start start 2023-10-06T01:40:48.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.969+0000 7f504c922700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f50480ccd40 0x7f50480cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:48.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.969+0000 7f504c922700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f504815dd40 con 0x7f50480d0400 2023-10-06T01:40:48.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.969+0000 7f504c922700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f504815e020 con 0x7f50480cf7e0 2023-10-06T01:40:48.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.969+0000 7f504c922700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50480ceaa0 con 0x7f50480ccd40 2023-10-06T01:40:48.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.969+0000 7f504659c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f50480d0400 0x7f50480b5c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:59614/0 (socket says 172.21.15.71:59614) 2023-10-06T01:40:48.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.969+0000 7f504659c700 1 -- 172.21.15.71:0/2783716914 learned_addr learned my addr 172.21.15.71:0/2783716914 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:40:48.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.969+0000 7f5045d9b700 1 --2- 172.21.15.71:0/2783716914 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f50480ccd40 0x7f50480cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:48.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.969+0000 7f504559a700 1 -- 172.21.15.71:0/2783716914 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4262558929 0 0) 0x7f504815dd40 con 0x7f50480d0400 2023-10-06T01:40:48.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.969+0000 7f504559a700 1 -- 172.21.15.71:0/2783716914 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5030003570 con 0x7f50480d0400 2023-10-06T01:40:48.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.969+0000 7f504559a700 1 -- 172.21.15.71:0/2783716914 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 764778599 0 0) 0x7f5030003570 con 0x7f50480d0400 2023-10-06T01:40:48.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.969+0000 7f504559a700 1 -- 172.21.15.71:0/2783716914 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f50480ccd40 msgr2=0x7f50480cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:48.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.969+0000 7f504559a700 1 --2- 172.21.15.71:0/2783716914 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f50480ccd40 0x7f50480cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:48.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.969+0000 7f504559a700 1 -- 172.21.15.71:0/2783716914 >> v1:172.21.15.72:6789/0 conn(0x7f50480cf7e0 legacy=0x7f50480b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:48.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.969+0000 7f504559a700 1 -- 172.21.15.71:0/2783716914 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50480ced80 con 0x7f50480d0400 2023-10-06T01:40:48.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.969+0000 7f504559a700 1 -- 172.21.15.71:0/2783716914 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1184243524 0 0) 0x7f50380015f0 con 0x7f50480d0400 2023-10-06T01:40:48.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.969+0000 7f504559a700 1 -- 172.21.15.71:0/2783716914 >> v1:172.21.15.71:6789/0 conn(0x7f50480d0400 legacy=0x7f50480b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:48.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.969+0000 7f504559a700 1 --2- 172.21.15.71:0/2783716914 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f50480ccd40 0x7f5030003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:48.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.969+0000 7f504559a700 1 --2- 172.21.15.71:0/2783716914 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5030003fd0 0x7f5030004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:48.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.969+0000 7f504559a700 1 --2- 172.21.15.71:0/2783716914 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5030004d50 0x7f50300051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:48.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.970+0000 7f504559a700 1 -- 172.21.15.71:0/2783716914 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50480ceaa0 con 0x7f5030004d50 2023-10-06T01:40:48.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.970+0000 7f504559a700 1 -- 172.21.15.71:0/2783716914 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f503000bb40 con 0x7f5030003fd0 2023-10-06T01:40:48.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.970+0000 7f504559a700 1 -- 172.21.15.71:0/2783716914 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f503000bd00 con 0x7f50480ccd40 2023-10-06T01:40:48.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.970+0000 7f5046d9d700 1 --2- 172.21.15.71:0/2783716914 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5030004d50 0x7f50300051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:48.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.970+0000 7f504659c700 1 --2- 172.21.15.71:0/2783716914 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f50480ccd40 0x7f5030003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:48.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.970+0000 7f5045d9b700 1 --2- 172.21.15.71:0/2783716914 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5030003fd0 0x7f5030004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:48.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.970+0000 7f5046d9d700 1 -- 172.21.15.71:0/2783716914 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f50480ccd40 msgr2=0x7f5030003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:48.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.970+0000 7f5046d9d700 1 --2- 172.21.15.71:0/2783716914 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f50480ccd40 0x7f5030003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:48.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.970+0000 7f5046d9d700 1 -- 172.21.15.71:0/2783716914 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5030003fd0 msgr2=0x7f5030004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:48.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.970+0000 7f5046d9d700 1 --2- 172.21.15.71:0/2783716914 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5030003fd0 0x7f5030004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:48.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.970+0000 7f5046d9d700 1 -- 172.21.15.71:0/2783716914 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5030003570 con 0x7f5030004d50 2023-10-06T01:40:48.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.970+0000 7f5046d9d700 1 --2- 172.21.15.71:0/2783716914 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5030004d50 0x7f50300051c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f50400020a0 tx=0x7f50400016d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63f44c35e79f16bc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:48.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.970+0000 7f504559a700 1 -- 172.21.15.71:0/2783716914 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50400019e0 con 0x7f5030004d50 2023-10-06T01:40:48.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.970+0000 7f504559a700 1 -- 172.21.15.71:0/2783716914 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f504000c8b0 con 0x7f5030004d50 2023-10-06T01:40:48.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.970+0000 7f504559a700 1 -- 172.21.15.71:0/2783716914 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f504000cc50 con 0x7f5030004d50 2023-10-06T01:40:48.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.971+0000 7f504c922700 1 -- 172.21.15.71:0/2783716914 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5030004d50 msgr2=0x7f50300051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:48.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.971+0000 7f504c922700 1 --2- 172.21.15.71:0/2783716914 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5030004d50 0x7f50300051c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f50400020a0 tx=0x7f50400016d0 comp rx=0 tx=0).stop 2023-10-06T01:40:48.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.971+0000 7f5046d9d700 1 -- 172.21.15.71:0/2783716914 reap_dead start 2023-10-06T01:40:48.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.971+0000 7f504c922700 1 -- 172.21.15.71:0/2783716914 shutdown_connections 2023-10-06T01:40:48.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.971+0000 7f504c922700 1 -- 172.21.15.71:0/2783716914 >> 172.21.15.71:0/2783716914 conn(0x7f504806a220 msgr2=0x7f504806a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:48.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.971+0000 7f504c922700 1 -- 172.21.15.71:0/2783716914 shutdown_connections 2023-10-06T01:40:48.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.971+0000 7f504c922700 1 -- 172.21.15.71:0/2783716914 wait complete. 2023-10-06T01:40:48.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.972+0000 7f504c922700 1 Processor -- start 2023-10-06T01:40:48.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.972+0000 7f504c922700 1 -- start start 2023-10-06T01:40:48.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.972+0000 7f504c922700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5030004d50 0x7f50480b20b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:48.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.972+0000 7f504c922700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5048151f20 0x7f504816ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:48.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.972+0000 7f504c922700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f504815afc0 0x7f504815b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:48.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.973+0000 7f504c922700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f504815b980 con 0x7f504815afc0 2023-10-06T01:40:48.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.973+0000 7f504c922700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50480b14a0 con 0x7f5048151f20 2023-10-06T01:40:48.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.973+0000 7f504c922700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50480b0890 con 0x7f5030004d50 2023-10-06T01:40:48.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.973+0000 7f5046d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f504815afc0 0x7f504815b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:48.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.973+0000 7f5046d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f504815afc0 0x7f504815b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47848/0 (socket says 172.21.15.71:47848) 2023-10-06T01:40:48.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.973+0000 7f5046d9d700 1 -- 172.21.15.71:0/3512144522 learned_addr learned my addr 172.21.15.71:0/3512144522 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:48.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.973+0000 7f504659c700 1 --2- 172.21.15.71:0/3512144522 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5030004d50 0x7f50480b20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:48.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.973+0000 7f5045d9b700 1 --2- 172.21.15.71:0/3512144522 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5048151f20 0x7f504816ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:48.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.973+0000 7f5046d9d700 1 -- 172.21.15.71:0/3512144522 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5030004d50 msgr2=0x7f50480b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:48.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.973+0000 7f5046d9d700 1 --2- 172.21.15.71:0/3512144522 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5030004d50 0x7f50480b20b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:48.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.973+0000 7f5046d9d700 1 -- 172.21.15.71:0/3512144522 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5048151f20 msgr2=0x7f504816ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:48.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.973+0000 7f5046d9d700 1 --2- 172.21.15.71:0/3512144522 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5048151f20 0x7f504816ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:48.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.973+0000 7f5046d9d700 1 -- 172.21.15.71:0/3512144522 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50480b0b70 con 0x7f504815afc0 2023-10-06T01:40:48.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.973+0000 7f504659c700 1 --2- 172.21.15.71:0/3512144522 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5030004d50 0x7f50480b20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:40:48.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.973+0000 7f5045d9b700 1 --2- 172.21.15.71:0/3512144522 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5048151f20 0x7f504816ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:40:48.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.973+0000 7f5046d9d700 1 --2- 172.21.15.71:0/3512144522 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f504815afc0 0x7f504815b440 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5040012000 tx=0x7f5040016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:48.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.973+0000 7f50367fc700 1 -- 172.21.15.71:0/3512144522 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f504000c6d0 con 0x7f504815afc0 2023-10-06T01:40:48.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.973+0000 7f50367fc700 1 -- 172.21.15.71:0/3512144522 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5040022070 con 0x7f504815afc0 2023-10-06T01:40:48.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.973+0000 7f504c922700 1 -- 172.21.15.71:0/3512144522 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50480b0e50 con 0x7f504815afc0 2023-10-06T01:40:48.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.973+0000 7f50367fc700 1 -- 172.21.15.71:0/3512144522 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f504000cc30 con 0x7f504815afc0 2023-10-06T01:40:48.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.973+0000 7f504c922700 1 -- 172.21.15.71:0/3512144522 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50480b25f0 con 0x7f504815afc0 2023-10-06T01:40:48.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.974+0000 7f504c922700 1 -- 172.21.15.71:0/3512144522 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50480b1610 con 0x7f504815afc0 2023-10-06T01:40:48.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.975+0000 7f50367fc700 1 -- 172.21.15.71:0/3512144522 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f504001e430 con 0x7f504815afc0 2023-10-06T01:40:48.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.975+0000 7f50367fc700 1 --2- 172.21.15.71:0/3512144522 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f5028066f30 0x7f50280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:48.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.975+0000 7f50367fc700 1 -- 172.21.15.71:0/3512144522 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f5040086760 con 0x7f504815afc0 2023-10-06T01:40:48.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.975+0000 7f504659c700 1 --2- 172.21.15.71:0/3512144522 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f5028066f30 0x7f50280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:48.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.975+0000 7f504659c700 1 --2- 172.21.15.71:0/3512144522 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f5028066f30 0x7f50280693e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5038001260 tx=0x7f5038009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:48.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:48.979+0000 7f50367fc700 1 -- 172.21.15.71:0/3512144522 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5040053580 con 0x7f504815afc0 2023-10-06T01:40:49.161 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.160+0000 7f504c922700 1 -- 172.21.15.71:0/3512144522 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f50480ce6c0 con 0x7f504815afc0 2023-10-06T01:40:49.161 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.161+0000 7f50367fc700 1 -- 172.21.15.71:0/3512144522 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5040056ba0 con 0x7f504815afc0 2023-10-06T01:40:49.161 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 1 2023-10-06T01:40:49.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.162+0000 7f504c922700 1 -- 172.21.15.71:0/3512144522 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f5028066f30 msgr2=0x7f50280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:49.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.162+0000 7f504c922700 1 --2- 172.21.15.71:0/3512144522 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f5028066f30 0x7f50280693e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5038001260 tx=0x7f5038009040 comp rx=0 tx=0).stop 2023-10-06T01:40:49.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.162+0000 7f504c922700 1 -- 172.21.15.71:0/3512144522 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f504815afc0 msgr2=0x7f504815b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:49.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.162+0000 7f504c922700 1 --2- 172.21.15.71:0/3512144522 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f504815afc0 0x7f504815b440 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5040012000 tx=0x7f5040016000 comp rx=0 tx=0).stop 2023-10-06T01:40:49.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.163+0000 7f504c922700 1 -- 172.21.15.71:0/3512144522 shutdown_connections 2023-10-06T01:40:49.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.163+0000 7f504c922700 1 --2- 172.21.15.71:0/3512144522 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f504815afc0 0x7f504815b440 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:49.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.163+0000 7f504c922700 1 --2- 172.21.15.71:0/3512144522 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5030004d50 0x7f50480b20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:49.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.163+0000 7f504c922700 1 --2- 172.21.15.71:0/3512144522 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f5028066f30 0x7f50280693e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:49.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.163+0000 7f504c922700 1 --2- 172.21.15.71:0/3512144522 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5048151f20 0x7f504816ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:49.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.163+0000 7f504c922700 1 -- 172.21.15.71:0/3512144522 >> 172.21.15.71:0/3512144522 conn(0x7f504806a220 msgr2=0x7f5048153a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:49.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.163+0000 7f504c922700 1 -- 172.21.15.71:0/3512144522 shutdown_connections 2023-10-06T01:40:49.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.163+0000 7f504c922700 1 -- 172.21.15.71:0/3512144522 wait complete. 2023-10-06T01:40:49.175 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T01:40:49.293 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.292+0000 7fce4f78e700 1 Processor -- start 2023-10-06T01:40:49.293 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.292+0000 7fce4f78e700 1 -- start start 2023-10-06T01:40:49.297 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.293+0000 7fce4f78e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fce480ccd40 0x7fce480cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:49.297 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.293+0000 7fce4f78e700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce4815dd40 con 0x7fce480d0400 2023-10-06T01:40:49.297 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.293+0000 7fce4f78e700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce4815e020 con 0x7fce480cf7e0 2023-10-06T01:40:49.297 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.293+0000 7fce4f78e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce480ceaa0 con 0x7fce480ccd40 2023-10-06T01:40:49.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.293+0000 7fce4d52a700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fce480d0400 0x7fce480b5c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:59622/0 (socket says 172.21.15.71:59622) 2023-10-06T01:40:49.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.293+0000 7fce4d52a700 1 -- 172.21.15.71:0/1955309001 learned_addr learned my addr 172.21.15.71:0/1955309001 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:40:49.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.293+0000 7fce4cd29700 1 --2- 172.21.15.71:0/1955309001 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fce480ccd40 0x7fce480cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:49.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.293+0000 7fce3ffff700 1 -- 172.21.15.71:0/1955309001 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 988245342 0 0) 0x7fce4815dd40 con 0x7fce480d0400 2023-10-06T01:40:49.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.294+0000 7fce3ffff700 1 -- 172.21.15.71:0/1955309001 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce34003570 con 0x7fce480d0400 2023-10-06T01:40:49.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.294+0000 7fce3ffff700 1 -- 172.21.15.71:0/1955309001 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1293446623 0 0) 0x7fce34003570 con 0x7fce480d0400 2023-10-06T01:40:49.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.294+0000 7fce3ffff700 1 -- 172.21.15.71:0/1955309001 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fce480ccd40 msgr2=0x7fce480cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:49.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.294+0000 7fce3ffff700 1 --2- 172.21.15.71:0/1955309001 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fce480ccd40 0x7fce480cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:49.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.294+0000 7fce3ffff700 1 -- 172.21.15.71:0/1955309001 >> v1:172.21.15.72:6789/0 conn(0x7fce480cf7e0 legacy=0x7fce480b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:49.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.294+0000 7fce3ffff700 1 -- 172.21.15.71:0/1955309001 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce480ced80 con 0x7fce480d0400 2023-10-06T01:40:49.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.294+0000 7fce3ffff700 1 -- 172.21.15.71:0/1955309001 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1184243524 0 0) 0x7fce440015f0 con 0x7fce480d0400 2023-10-06T01:40:49.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.294+0000 7fce3ffff700 1 -- 172.21.15.71:0/1955309001 >> v1:172.21.15.71:6789/0 conn(0x7fce480d0400 legacy=0x7fce480b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:49.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.294+0000 7fce3ffff700 1 --2- 172.21.15.71:0/1955309001 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fce34003a90 0x7fce34003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:49.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.294+0000 7fce3ffff700 1 --2- 172.21.15.71:0/1955309001 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fce480ccd40 0x7fce34004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:49.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.294+0000 7fce3ffff700 1 --2- 172.21.15.71:0/1955309001 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce34004d50 0x7fce340051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:49.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.294+0000 7fce3ffff700 1 -- 172.21.15.71:0/1955309001 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce480ceaa0 con 0x7fce34004d50 2023-10-06T01:40:49.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.294+0000 7fce3ffff700 1 -- 172.21.15.71:0/1955309001 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce3400bb40 con 0x7fce34003a90 2023-10-06T01:40:49.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.294+0000 7fce3ffff700 1 -- 172.21.15.71:0/1955309001 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce3400bd00 con 0x7fce480ccd40 2023-10-06T01:40:49.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.294+0000 7fce4dd2b700 1 --2- 172.21.15.71:0/1955309001 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce34004d50 0x7fce340051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:49.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.294+0000 7fce4d52a700 1 --2- 172.21.15.71:0/1955309001 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fce34003a90 0x7fce34003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:49.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.294+0000 7fce4cd29700 1 --2- 172.21.15.71:0/1955309001 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fce480ccd40 0x7fce34004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:49.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.294+0000 7fce4dd2b700 1 -- 172.21.15.71:0/1955309001 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fce480ccd40 msgr2=0x7fce34004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:49.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.294+0000 7fce4dd2b700 1 --2- 172.21.15.71:0/1955309001 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fce480ccd40 0x7fce34004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:49.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.294+0000 7fce4dd2b700 1 -- 172.21.15.71:0/1955309001 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fce34003a90 msgr2=0x7fce34003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:49.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.294+0000 7fce4dd2b700 1 --2- 172.21.15.71:0/1955309001 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fce34003a90 0x7fce34003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:49.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.294+0000 7fce4dd2b700 1 -- 172.21.15.71:0/1955309001 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce34003570 con 0x7fce34004d50 2023-10-06T01:40:49.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.294+0000 7fce4dd2b700 1 --2- 172.21.15.71:0/1955309001 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce34004d50 0x7fce340051c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fce400020a0 tx=0x7fce400016d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd2a785b69e0ade server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:49.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.294+0000 7fce3ffff700 1 -- 172.21.15.71:0/1955309001 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce400019e0 con 0x7fce34004d50 2023-10-06T01:40:49.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.295+0000 7fce3ffff700 1 -- 172.21.15.71:0/1955309001 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce4000c8b0 con 0x7fce34004d50 2023-10-06T01:40:49.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.295+0000 7fce3ffff700 1 -- 172.21.15.71:0/1955309001 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce4000cc50 con 0x7fce34004d50 2023-10-06T01:40:49.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.295+0000 7fce4f78e700 1 -- 172.21.15.71:0/1955309001 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce34004d50 msgr2=0x7fce340051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:49.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.295+0000 7fce4f78e700 1 --2- 172.21.15.71:0/1955309001 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce34004d50 0x7fce340051c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fce400020a0 tx=0x7fce400016d0 comp rx=0 tx=0).stop 2023-10-06T01:40:49.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.295+0000 7fce4dd2b700 1 -- 172.21.15.71:0/1955309001 reap_dead start 2023-10-06T01:40:49.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.295+0000 7fce4f78e700 1 -- 172.21.15.71:0/1955309001 shutdown_connections 2023-10-06T01:40:49.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.295+0000 7fce4f78e700 1 -- 172.21.15.71:0/1955309001 >> 172.21.15.71:0/1955309001 conn(0x7fce4806a220 msgr2=0x7fce4806a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:49.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.295+0000 7fce4f78e700 1 -- 172.21.15.71:0/1955309001 shutdown_connections 2023-10-06T01:40:49.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.295+0000 7fce4f78e700 1 -- 172.21.15.71:0/1955309001 wait complete. 2023-10-06T01:40:49.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.296+0000 7fce4f78e700 1 Processor -- start 2023-10-06T01:40:49.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.296+0000 7fce4f78e700 1 -- start start 2023-10-06T01:40:49.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.297+0000 7fce4f78e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fce48153150 0x7fce480c6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:49.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.297+0000 7fce4f78e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fce48153520 0x7fce480b44e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:49.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.297+0000 7fce4f78e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce480c6cc0 0x7fce480b4a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:49.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.297+0000 7fce4f78e700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce4815a180 con 0x7fce480c6cc0 2023-10-06T01:40:49.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.297+0000 7fce4f78e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce4815a460 con 0x7fce48153520 2023-10-06T01:40:49.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.297+0000 7fce4f78e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce4815a740 con 0x7fce48153150 2023-10-06T01:40:49.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.297+0000 7fce4dd2b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce480c6cc0 0x7fce480b4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:49.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.297+0000 7fce4dd2b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce480c6cc0 0x7fce480b4a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47864/0 (socket says 172.21.15.71:47864) 2023-10-06T01:40:49.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.297+0000 7fce4dd2b700 1 -- 172.21.15.71:0/815603567 learned_addr learned my addr 172.21.15.71:0/815603567 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:49.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.297+0000 7fce4d52a700 1 --2- 172.21.15.71:0/815603567 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fce48153150 0x7fce480c6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:49.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.297+0000 7fce4cd29700 1 --2- 172.21.15.71:0/815603567 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fce48153520 0x7fce480b44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:49.305 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.297+0000 7fce4dd2b700 1 -- 172.21.15.71:0/815603567 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fce48153150 msgr2=0x7fce480c6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:49.305 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.297+0000 7fce4dd2b700 1 --2- 172.21.15.71:0/815603567 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fce48153150 0x7fce480c6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:49.305 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.297+0000 7fce4dd2b700 1 -- 172.21.15.71:0/815603567 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fce48153520 msgr2=0x7fce480b44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:49.305 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.297+0000 7fce4dd2b700 1 --2- 172.21.15.71:0/815603567 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fce48153520 0x7fce480b44e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:49.305 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.297+0000 7fce4dd2b700 1 -- 172.21.15.71:0/815603567 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce4815aa20 con 0x7fce480c6cc0 2023-10-06T01:40:49.305 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.297+0000 7fce4cd29700 1 --2- 172.21.15.71:0/815603567 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fce48153520 0x7fce480b44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:40:49.305 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.298+0000 7fce4dd2b700 1 --2- 172.21.15.71:0/815603567 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce480c6cc0 0x7fce480b4a20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fce3400bb10 tx=0x7fce40016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:49.305 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.298+0000 7fce3d7fa700 1 -- 172.21.15.71:0/815603567 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce400019e0 con 0x7fce480c6cc0 2023-10-06T01:40:49.305 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.298+0000 7fce3d7fa700 1 -- 172.21.15.71:0/815603567 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce40007860 con 0x7fce480c6cc0 2023-10-06T01:40:49.305 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.298+0000 7fce4f78e700 1 -- 172.21.15.71:0/815603567 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce4815ad00 con 0x7fce480c6cc0 2023-10-06T01:40:49.305 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.298+0000 7fce3d7fa700 1 -- 172.21.15.71:0/815603567 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce4001e430 con 0x7fce480c6cc0 2023-10-06T01:40:49.305 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.298+0000 7fce4f78e700 1 -- 172.21.15.71:0/815603567 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce48169dc0 con 0x7fce480c6cc0 2023-10-06T01:40:49.306 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.299+0000 7fce4f78e700 1 -- 172.21.15.71:0/815603567 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce480c5100 con 0x7fce480c6cc0 2023-10-06T01:40:49.306 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.299+0000 7fce3d7fa700 1 -- 172.21.15.71:0/815603567 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fce4001e7e0 con 0x7fce480c6cc0 2023-10-06T01:40:49.306 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.299+0000 7fce3d7fa700 1 --2- 172.21.15.71:0/815603567 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fce2c066f30 0x7fce2c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:49.306 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.299+0000 7fce3d7fa700 1 -- 172.21.15.71:0/815603567 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fce400867a0 con 0x7fce480c6cc0 2023-10-06T01:40:49.306 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.299+0000 7fce4d52a700 1 --2- 172.21.15.71:0/815603567 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fce2c066f30 0x7fce2c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:49.306 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.300+0000 7fce4d52a700 1 --2- 172.21.15.71:0/815603567 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fce2c066f30 0x7fce2c0693e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fce44007a10 tx=0x7fce44009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:49.306 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.304+0000 7fce3d7fa700 1 -- 172.21.15.71:0/815603567 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fce480c5100 con 0x7fce480c6cc0 2023-10-06T01:40:49.487 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.486+0000 7fce4f78e700 1 -- 172.21.15.71:0/815603567 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fce480c5100 con 0x7fce480c6cc0 2023-10-06T01:40:49.487 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.486+0000 7fce3d7fa700 1 -- 172.21.15.71:0/815603567 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7fce480c5100 con 0x7fce480c6cc0 2023-10-06T01:40:49.487 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 8 2023-10-06T01:40:49.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.488+0000 7fce4f78e700 1 -- 172.21.15.71:0/815603567 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fce2c066f30 msgr2=0x7fce2c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:49.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.488+0000 7fce4f78e700 1 --2- 172.21.15.71:0/815603567 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fce2c066f30 0x7fce2c0693e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fce44007a10 tx=0x7fce44009040 comp rx=0 tx=0).stop 2023-10-06T01:40:49.490 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.488+0000 7fce4f78e700 1 -- 172.21.15.71:0/815603567 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce480c6cc0 msgr2=0x7fce480b4a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:49.490 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.488+0000 7fce4f78e700 1 --2- 172.21.15.71:0/815603567 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce480c6cc0 0x7fce480b4a20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fce3400bb10 tx=0x7fce40016000 comp rx=0 tx=0).stop 2023-10-06T01:40:49.490 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.489+0000 7fce4f78e700 1 -- 172.21.15.71:0/815603567 shutdown_connections 2023-10-06T01:40:49.490 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.489+0000 7fce4f78e700 1 --2- 172.21.15.71:0/815603567 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fce480c6cc0 0x7fce480b4a20 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:49.490 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.489+0000 7fce4f78e700 1 --2- 172.21.15.71:0/815603567 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fce48153150 0x7fce480c6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:49.490 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.489+0000 7fce4f78e700 1 --2- 172.21.15.71:0/815603567 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fce2c066f30 0x7fce2c0693e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:49.490 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.489+0000 7fce4f78e700 1 --2- 172.21.15.71:0/815603567 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fce48153520 0x7fce480b44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:49.490 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.489+0000 7fce4f78e700 1 -- 172.21.15.71:0/815603567 >> 172.21.15.71:0/815603567 conn(0x7fce4806a220 msgr2=0x7fce480b3aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:49.490 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.489+0000 7fce4f78e700 1 -- 172.21.15.71:0/815603567 shutdown_connections 2023-10-06T01:40:49.490 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.489+0000 7fce4f78e700 1 -- 172.21.15.71:0/815603567 wait complete. 2023-10-06T01:40:49.501 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T01:40:49.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.618+0000 7f6842b9e700 1 Processor -- start 2023-10-06T01:40:49.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.618+0000 7f6842b9e700 1 -- start start 2023-10-06T01:40:49.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.619+0000 7f6842b9e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f683c0d0400 0x7f683c0b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:49.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.619+0000 7f6842b9e700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f683c0ccd40 0x7f683c0cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:49.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.619+0000 7f6842b9e700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f683c0b6170 con 0x7f683c0cf7e0 2023-10-06T01:40:49.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.619+0000 7f6842b9e700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f683c15dd40 con 0x7f683c0ccd40 2023-10-06T01:40:49.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.619+0000 7f6842b9e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f683c15e020 con 0x7f683c0d0400 2023-10-06T01:40:49.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.619+0000 7f6833fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f683c0ccd40 0x7f683c0cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:49.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.619+0000 7f6833fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f683c0ccd40 0x7f683c0cf2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52346/0 (socket says 172.21.15.71:52346) 2023-10-06T01:40:49.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.619+0000 7f6833fff700 1 -- 172.21.15.71:0/1488756322 learned_addr learned my addr 172.21.15.71:0/1488756322 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:49.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.619+0000 7f684093a700 1 --2- 172.21.15.71:0/1488756322 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f683c0d0400 0x7f683c0b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:49.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.619+0000 7f684113b700 1 --1- 172.21.15.71:0/1488756322 >> v1:172.21.15.72:6789/0 conn(0x7f683c0cf7e0 0x7f683c0b3aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.71:35468/0 (socket says 172.21.15.71:35468) 2023-10-06T01:40:49.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.619+0000 7f68337fe700 1 -- 172.21.15.71:0/1488756322 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 12378060 0 0) 0x7f683c0b6170 con 0x7f683c0cf7e0 2023-10-06T01:40:49.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.619+0000 7f6833fff700 1 -- 172.21.15.71:0/1488756322 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f683c0d0400 msgr2=0x7f683c0b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:49.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.619+0000 7f6833fff700 1 --2- 172.21.15.71:0/1488756322 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f683c0d0400 0x7f683c0b5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:49.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.619+0000 7f6833fff700 1 -- 172.21.15.71:0/1488756322 >> v1:172.21.15.72:6789/0 conn(0x7f683c0cf7e0 legacy=0x7f683c0b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:49.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.620+0000 7f6833fff700 1 -- 172.21.15.71:0/1488756322 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f683c0ceaa0 con 0x7f683c0ccd40 2023-10-06T01:40:49.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.620+0000 7f684093a700 1 --2- 172.21.15.71:0/1488756322 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f683c0d0400 0x7f683c0b5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:40:49.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.620+0000 7f6833fff700 1 --2- 172.21.15.71:0/1488756322 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f683c0ccd40 0x7f683c0cf2a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f682c0099b0 tx=0x7f682c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0f62b817f6e8a3b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:49.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.620+0000 7f68337fe700 1 -- 172.21.15.71:0/1488756322 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f682c009ea0 con 0x7f683c0ccd40 2023-10-06T01:40:49.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.620+0000 7f68337fe700 1 -- 172.21.15.71:0/1488756322 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f682c00b860 con 0x7f683c0ccd40 2023-10-06T01:40:49.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.620+0000 7f68337fe700 1 -- 172.21.15.71:0/1488756322 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f682c00bc00 con 0x7f683c0ccd40 2023-10-06T01:40:49.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.620+0000 7f6842b9e700 1 -- 172.21.15.71:0/1488756322 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f683c0ccd40 msgr2=0x7f683c0cf2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:49.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.620+0000 7f6842b9e700 1 --2- 172.21.15.71:0/1488756322 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f683c0ccd40 0x7f683c0cf2a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f682c0099b0 tx=0x7f682c009250 comp rx=0 tx=0).stop 2023-10-06T01:40:49.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.620+0000 7f6842b9e700 1 -- 172.21.15.71:0/1488756322 shutdown_connections 2023-10-06T01:40:49.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.620+0000 7f6842b9e700 1 --2- 172.21.15.71:0/1488756322 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f683c0d0400 0x7f683c0b5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:49.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.620+0000 7f6842b9e700 1 --2- 172.21.15.71:0/1488756322 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f683c0ccd40 0x7f683c0cf2a0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:49.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.620+0000 7f6842b9e700 1 -- 172.21.15.71:0/1488756322 >> 172.21.15.71:0/1488756322 conn(0x7f683c06a220 msgr2=0x7f683c06a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:49.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.620+0000 7f6842b9e700 1 -- 172.21.15.71:0/1488756322 shutdown_connections 2023-10-06T01:40:49.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.620+0000 7f6842b9e700 1 -- 172.21.15.71:0/1488756322 wait complete. 2023-10-06T01:40:49.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.621+0000 7f6842b9e700 1 Processor -- start 2023-10-06T01:40:49.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.622+0000 7f6842b9e700 1 -- start start 2023-10-06T01:40:49.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.622+0000 7f6842b9e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f683c0ccd40 0x7f683c0c5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:49.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.622+0000 7f6842b9e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f683c0cf7e0 0x7f683c147f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:49.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.622+0000 7f6842b9e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f683c0d0400 0x7f683c0b1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:49.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.622+0000 7f6842b9e700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f683c0c5ff0 con 0x7f683c0cf7e0 2023-10-06T01:40:49.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.622+0000 7f6842b9e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f683c159800 con 0x7f683c0ccd40 2023-10-06T01:40:49.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.622+0000 7f6842b9e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f683c15a9e0 con 0x7f683c0d0400 2023-10-06T01:40:49.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.622+0000 7f6833fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f683c0cf7e0 0x7f683c147f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:49.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.622+0000 7f6833fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f683c0cf7e0 0x7f683c147f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52362/0 (socket says 172.21.15.71:52362) 2023-10-06T01:40:49.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.622+0000 7f6833fff700 1 -- 172.21.15.71:0/3958868904 learned_addr learned my addr 172.21.15.71:0/3958868904 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:49.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.622+0000 7f684093a700 1 --2- 172.21.15.71:0/3958868904 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f683c0ccd40 0x7f683c0c5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:49.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.622+0000 7f684113b700 1 --2- 172.21.15.71:0/3958868904 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f683c0d0400 0x7f683c0b1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:49.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.623+0000 7f6833fff700 1 -- 172.21.15.71:0/3958868904 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f683c0d0400 msgr2=0x7f683c0b1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:49.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.623+0000 7f6833fff700 1 --2- 172.21.15.71:0/3958868904 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f683c0d0400 0x7f683c0b1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:49.629 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.623+0000 7f6833fff700 1 -- 172.21.15.71:0/3958868904 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f683c0ccd40 msgr2=0x7f683c0c5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:49.630 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.623+0000 7f6833fff700 1 --2- 172.21.15.71:0/3958868904 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f683c0ccd40 0x7f683c0c5ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:49.630 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.623+0000 7f6833fff700 1 -- 172.21.15.71:0/3958868904 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6838009a20 con 0x7f683c0cf7e0 2023-10-06T01:40:49.630 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.623+0000 7f6833fff700 1 --2- 172.21.15.71:0/3958868904 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f683c0cf7e0 0x7f683c147f80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f683c0883f0 tx=0x7f682c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:49.630 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.623+0000 7f6830ff9700 1 -- 172.21.15.71:0/3958868904 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f682c000d10 con 0x7f683c0cf7e0 2023-10-06T01:40:49.630 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.623+0000 7f6830ff9700 1 -- 172.21.15.71:0/3958868904 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f682c00bbe0 con 0x7f683c0cf7e0 2023-10-06T01:40:49.630 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.623+0000 7f6830ff9700 1 -- 172.21.15.71:0/3958868904 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f682c011690 con 0x7f683c0cf7e0 2023-10-06T01:40:49.630 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.623+0000 7f6842b9e700 1 -- 172.21.15.71:0/3958868904 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f682c0094f0 con 0x7f683c0cf7e0 2023-10-06T01:40:49.630 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.623+0000 7f6842b9e700 1 -- 172.21.15.71:0/3958868904 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f683c159d80 con 0x7f683c0cf7e0 2023-10-06T01:40:49.630 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.624+0000 7f6842b9e700 1 -- 172.21.15.71:0/3958868904 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f683c088760 con 0x7f683c0cf7e0 2023-10-06T01:40:49.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.624+0000 7f6830ff9700 1 -- 172.21.15.71:0/3958868904 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f682c011ac0 con 0x7f683c0cf7e0 2023-10-06T01:40:49.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.625+0000 7f6830ff9700 1 --2- 172.21.15.71:0/3958868904 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f6828066f30 0x7f68280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:49.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.625+0000 7f6830ff9700 1 -- 172.21.15.71:0/3958868904 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f682c086160 con 0x7f683c0cf7e0 2023-10-06T01:40:49.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.625+0000 7f684093a700 1 --2- 172.21.15.71:0/3958868904 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f6828066f30 0x7f68280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:49.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.625+0000 7f684093a700 1 --2- 172.21.15.71:0/3958868904 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f6828066f30 0x7f68280693e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f683800f6a0 tx=0x7f683800b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:49.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.629+0000 7f6830ff9700 1 -- 172.21.15.71:0/3958868904 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f682c052f80 con 0x7f683c0cf7e0 2023-10-06T01:40:49.812 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.812+0000 7f6842b9e700 1 -- 172.21.15.71:0/3958868904 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f683c0ced80 con 0x7f683c0cf7e0 2023-10-06T01:40:49.813 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.812+0000 7f6830ff9700 1 -- 172.21.15.71:0/3958868904 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f682c0565a0 con 0x7f683c0cf7e0 2023-10-06T01:40:49.813 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 32 2023-10-06T01:40:49.815 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.814+0000 7f6842b9e700 1 -- 172.21.15.71:0/3958868904 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f6828066f30 msgr2=0x7f68280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:49.815 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.814+0000 7f6842b9e700 1 --2- 172.21.15.71:0/3958868904 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f6828066f30 0x7f68280693e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f683800f6a0 tx=0x7f683800b040 comp rx=0 tx=0).stop 2023-10-06T01:40:49.815 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.814+0000 7f6842b9e700 1 -- 172.21.15.71:0/3958868904 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f683c0cf7e0 msgr2=0x7f683c147f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:49.815 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.814+0000 7f6842b9e700 1 --2- 172.21.15.71:0/3958868904 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f683c0cf7e0 0x7f683c147f80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f683c0883f0 tx=0x7f682c017000 comp rx=0 tx=0).stop 2023-10-06T01:40:49.815 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.814+0000 7f6842b9e700 1 -- 172.21.15.71:0/3958868904 shutdown_connections 2023-10-06T01:40:49.815 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.814+0000 7f6842b9e700 1 --2- 172.21.15.71:0/3958868904 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f683c0d0400 0x7f683c0b1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:49.815 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.814+0000 7f6842b9e700 1 --2- 172.21.15.71:0/3958868904 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f6828066f30 0x7f68280693e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:49.815 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.814+0000 7f6842b9e700 1 --2- 172.21.15.71:0/3958868904 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f683c0ccd40 0x7f683c0c5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:49.815 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.814+0000 7f6842b9e700 1 --2- 172.21.15.71:0/3958868904 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f683c0cf7e0 0x7f683c147f80 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:49.816 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.814+0000 7f6842b9e700 1 -- 172.21.15.71:0/3958868904 >> 172.21.15.71:0/3958868904 conn(0x7f683c06a220 msgr2=0x7f683c0b58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:49.816 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.814+0000 7f6842b9e700 1 -- 172.21.15.71:0/3958868904 shutdown_connections 2023-10-06T01:40:49.816 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.814+0000 7f6842b9e700 1 -- 172.21.15.71:0/3958868904 wait complete. 2023-10-06T01:40:49.826 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T01:40:49.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.944+0000 7f26a307f700 1 Processor -- start 2023-10-06T01:40:49.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.944+0000 7f26a307f700 1 -- start start 2023-10-06T01:40:49.948 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.945+0000 7f26a307f700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f269c0af3f0 0x7f269c15a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:49.948 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.945+0000 7f26a307f700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f269c15a170 con 0x7f269c159960 2023-10-06T01:40:49.948 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.945+0000 7f26a307f700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f269c0caeb0 con 0x7f269c0af7c0 2023-10-06T01:40:49.949 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.945+0000 7f26a307f700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f269c15db80 con 0x7f269c0af3f0 2023-10-06T01:40:49.949 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.945+0000 7f26a0e1b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f269c0af3f0 0x7f269c15a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:49.949 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.945+0000 7f26a161c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f269c159960 0x7f269c068680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:54562/0 (socket says 172.21.15.71:54562) 2023-10-06T01:40:49.949 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.945+0000 7f26a0e1b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f269c0af3f0 0x7f269c15a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52378/0 (socket says 172.21.15.71:52378) 2023-10-06T01:40:49.949 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.945+0000 7f26a161c700 1 -- 172.21.15.71:0/4041857129 learned_addr learned my addr 172.21.15.71:0/4041857129 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:40:49.949 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.946+0000 7f26a0e1b700 1 -- 172.21.15.71:0/4041857129 >> v1:172.21.15.72:6789/0 conn(0x7f269c0af7c0 legacy=0x7f269c15d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:49.949 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.946+0000 7f26a0e1b700 1 -- 172.21.15.71:0/4041857129 >> v1:172.21.15.71:6789/0 conn(0x7f269c159960 legacy=0x7f269c068680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:49.949 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.946+0000 7f26a0e1b700 1 -- 172.21.15.71:0/4041857129 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f269c15de60 con 0x7f269c0af3f0 2023-10-06T01:40:49.949 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.946+0000 7f26a0e1b700 1 --2- 172.21.15.71:0/4041857129 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f269c0af3f0 0x7f269c15a600 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f26980098e0 tx=0x7f26980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cf716d8b01eb9a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:49.949 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.946+0000 7f26937fe700 1 -- 172.21.15.71:0/4041857129 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2698009e80 con 0x7f269c0af3f0 2023-10-06T01:40:49.950 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.946+0000 7f26937fe700 1 -- 172.21.15.71:0/4041857129 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f269800b820 con 0x7f269c0af3f0 2023-10-06T01:40:49.950 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.946+0000 7f26937fe700 1 -- 172.21.15.71:0/4041857129 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f269800bba0 con 0x7f269c0af3f0 2023-10-06T01:40:49.950 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.946+0000 7f26a307f700 1 -- 172.21.15.71:0/4041857129 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f269c0af3f0 msgr2=0x7f269c15a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:49.950 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.946+0000 7f26a307f700 1 --2- 172.21.15.71:0/4041857129 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f269c0af3f0 0x7f269c15a600 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f26980098e0 tx=0x7f26980091a0 comp rx=0 tx=0).stop 2023-10-06T01:40:49.950 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.946+0000 7f26a307f700 1 -- 172.21.15.71:0/4041857129 shutdown_connections 2023-10-06T01:40:49.950 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.946+0000 7f26a307f700 1 --2- 172.21.15.71:0/4041857129 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f269c0af3f0 0x7f269c15a600 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:49.950 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.946+0000 7f26a307f700 1 -- 172.21.15.71:0/4041857129 >> 172.21.15.71:0/4041857129 conn(0x7f269c06a260 msgr2=0x7f269c0cd030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:49.950 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.947+0000 7f26a307f700 1 -- 172.21.15.71:0/4041857129 shutdown_connections 2023-10-06T01:40:49.950 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.947+0000 7f26a307f700 1 -- 172.21.15.71:0/4041857129 wait complete. 2023-10-06T01:40:49.951 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.948+0000 7f26a307f700 1 Processor -- start 2023-10-06T01:40:49.951 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.948+0000 7f26a307f700 1 -- start start 2023-10-06T01:40:49.953 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.948+0000 7f26a307f700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f269c0af3f0 0x7f269c0b2880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:49.954 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.948+0000 7f26a307f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f269c159960 0x7f269c1699a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:49.954 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.948+0000 7f26a307f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f269c145a50 0x7f269c0b1460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:49.954 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.948+0000 7f26a307f700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f269c169ee0 con 0x7f269c0af3f0 2023-10-06T01:40:49.954 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.948+0000 7f26a307f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f269c0b0fd0 con 0x7f269c145a50 2023-10-06T01:40:49.954 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.948+0000 7f26a307f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f269c16a110 con 0x7f269c159960 2023-10-06T01:40:49.954 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.948+0000 7f26a0e1b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f269c0af3f0 0x7f269c0b2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:49.954 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.949+0000 7f26a0e1b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f269c0af3f0 0x7f269c0b2880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52382/0 (socket says 172.21.15.71:52382) 2023-10-06T01:40:49.954 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.949+0000 7f26a0e1b700 1 -- 172.21.15.71:0/3522953618 learned_addr learned my addr 172.21.15.71:0/3522953618 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:49.954 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.949+0000 7f26a161c700 1 --2- 172.21.15.71:0/3522953618 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f269c145a50 0x7f269c0b1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:49.955 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.949+0000 7f2693fff700 1 --2- 172.21.15.71:0/3522953618 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f269c159960 0x7f269c1699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:49.955 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.949+0000 7f26a0e1b700 1 -- 172.21.15.71:0/3522953618 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f269c159960 msgr2=0x7f269c1699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:49.955 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.949+0000 7f26a0e1b700 1 --2- 172.21.15.71:0/3522953618 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f269c159960 0x7f269c1699a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:49.955 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.949+0000 7f26a0e1b700 1 -- 172.21.15.71:0/3522953618 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f269c145a50 msgr2=0x7f269c0b1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:49.955 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.949+0000 7f26a0e1b700 1 --2- 172.21.15.71:0/3522953618 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f269c145a50 0x7f269c0b1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:49.955 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.949+0000 7f26a0e1b700 1 -- 172.21.15.71:0/3522953618 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2698009420 con 0x7f269c0af3f0 2023-10-06T01:40:49.955 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.949+0000 7f26a161c700 1 --2- 172.21.15.71:0/3522953618 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f269c145a50 0x7f269c0b1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:40:49.955 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.949+0000 7f26a0e1b700 1 --2- 172.21.15.71:0/3522953618 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f269c0af3f0 0x7f269c0b2880 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f26980030c0 tx=0x7f2698016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:49.955 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.949+0000 7f2690ff9700 1 -- 172.21.15.71:0/3522953618 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f269800ba10 con 0x7f269c0af3f0 2023-10-06T01:40:49.955 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.949+0000 7f2690ff9700 1 -- 172.21.15.71:0/3522953618 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2698020070 con 0x7f269c0af3f0 2023-10-06T01:40:49.956 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.949+0000 7f2690ff9700 1 -- 172.21.15.71:0/3522953618 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f269801b6a0 con 0x7f269c0af3f0 2023-10-06T01:40:49.956 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.949+0000 7f26a307f700 1 -- 172.21.15.71:0/3522953618 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f269c16a3f0 con 0x7f269c0af3f0 2023-10-06T01:40:49.956 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.949+0000 7f26a307f700 1 -- 172.21.15.71:0/3522953618 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f269c145ef0 con 0x7f269c0af3f0 2023-10-06T01:40:49.956 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.950+0000 7f26a307f700 1 -- 172.21.15.71:0/3522953618 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f269c0b0da0 con 0x7f269c0af3f0 2023-10-06T01:40:49.956 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.950+0000 7f2690ff9700 1 -- 172.21.15.71:0/3522953618 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2698022030 con 0x7f269c0af3f0 2023-10-06T01:40:49.956 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.951+0000 7f2690ff9700 1 --2- 172.21.15.71:0/3522953618 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f2688066f30 0x7f26880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:49.956 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.951+0000 7f2690ff9700 1 -- 172.21.15.71:0/3522953618 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f26980868e0 con 0x7f269c0af3f0 2023-10-06T01:40:49.956 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.951+0000 7f2693fff700 1 --2- 172.21.15.71:0/3522953618 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f2688066f30 0x7f26880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:49.956 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.951+0000 7f2693fff700 1 --2- 172.21.15.71:0/3522953618 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f2688066f30 0x7f26880693e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f269c15e160 tx=0x7f268c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:49.957 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:49.955+0000 7f2690ff9700 1 -- 172.21.15.71:0/3522953618 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f269c0b0da0 con 0x7f269c0af3f0 2023-10-06T01:40:50.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.137+0000 7f26a307f700 1 -- 172.21.15.71:0/3522953618 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f269c0b0da0 con 0x7f269c0af3f0 2023-10-06T01:40:50.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.137+0000 7f2690ff9700 1 -- 172.21.15.71:0/3522953618 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f269c0b0da0 con 0x7f269c0af3f0 2023-10-06T01:40:50.138 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 64 2023-10-06T01:40:50.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.139+0000 7f26a307f700 1 -- 172.21.15.71:0/3522953618 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f2688066f30 msgr2=0x7f26880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:50.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.139+0000 7f26a307f700 1 --2- 172.21.15.71:0/3522953618 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f2688066f30 0x7f26880693e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f269c15e160 tx=0x7f268c009040 comp rx=0 tx=0).stop 2023-10-06T01:40:50.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.139+0000 7f26a307f700 1 -- 172.21.15.71:0/3522953618 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f269c0af3f0 msgr2=0x7f269c0b2880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:50.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.139+0000 7f26a307f700 1 --2- 172.21.15.71:0/3522953618 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f269c0af3f0 0x7f269c0b2880 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f26980030c0 tx=0x7f2698016000 comp rx=0 tx=0).stop 2023-10-06T01:40:50.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.139+0000 7f26a307f700 1 -- 172.21.15.71:0/3522953618 shutdown_connections 2023-10-06T01:40:50.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.139+0000 7f26a307f700 1 --2- 172.21.15.71:0/3522953618 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f2688066f30 0x7f26880693e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:50.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.139+0000 7f26a307f700 1 --2- 172.21.15.71:0/3522953618 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f269c145a50 0x7f269c0b1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:50.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.139+0000 7f26a307f700 1 --2- 172.21.15.71:0/3522953618 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f269c0af3f0 0x7f269c0b2880 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:50.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.139+0000 7f26a307f700 1 --2- 172.21.15.71:0/3522953618 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f269c159960 0x7f269c1699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:50.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.139+0000 7f26a307f700 1 -- 172.21.15.71:0/3522953618 >> 172.21.15.71:0/3522953618 conn(0x7f269c06a260 msgr2=0x7f269c0c1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:50.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.139+0000 7f26a307f700 1 -- 172.21.15.71:0/3522953618 shutdown_connections 2023-10-06T01:40:50.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.139+0000 7f26a307f700 1 -- 172.21.15.71:0/3522953618 wait complete. 2023-10-06T01:40:50.152 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-06T01:40:50.268 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.268+0000 7feea17c4700 1 Processor -- start 2023-10-06T01:40:50.269 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.268+0000 7feea17c4700 1 -- start start 2023-10-06T01:40:50.271 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.269+0000 7feea17c4700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fee9c0cc3d0 0x7fee9c0c4440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:50.271 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.269+0000 7feea17c4700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee9c0c3b40 con 0x7fee9c0c3fd0 2023-10-06T01:40:50.271 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.269+0000 7feea17c4700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee9c0c2f30 con 0x7fee9c1574b0 2023-10-06T01:40:50.271 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.269+0000 7feea17c4700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee9c0c4980 con 0x7fee9c0cc3d0 2023-10-06T01:40:50.271 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.269+0000 7fee9b7fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fee9c0cc3d0 0x7fee9c0c4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:50.271 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.269+0000 7fee9a7fc700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fee9c0c3fd0 0x7fee9c0cbcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:54574/0 (socket says 172.21.15.71:54574) 2023-10-06T01:40:50.271 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.269+0000 7fee9a7fc700 1 -- 172.21.15.71:0/46242070 learned_addr learned my addr 172.21.15.71:0/46242070 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:40:50.271 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.269+0000 7fee9b7fe700 1 -- 172.21.15.71:0/46242070 >> v1:172.21.15.72:6789/0 conn(0x7fee9c1574b0 legacy=0x7fee9c0b0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:50.271 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.269+0000 7fee9b7fe700 1 -- 172.21.15.71:0/46242070 >> v1:172.21.15.71:6789/0 conn(0x7fee9c0c3fd0 legacy=0x7fee9c0cbcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:50.272 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.269+0000 7fee9b7fe700 1 -- 172.21.15.71:0/46242070 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee9c0c3210 con 0x7fee9c0cc3d0 2023-10-06T01:40:50.272 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.269+0000 7fee99ffb700 1 -- 172.21.15.71:0/46242070 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2067653511 0 0) 0x7fee9c0c3b40 con 0x7fee9c0c3fd0 2023-10-06T01:40:50.272 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.269+0000 7fee9b7fe700 1 --2- 172.21.15.71:0/46242070 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee9c0cc3d0 0x7fee9c0c4440 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fee94009e60 tx=0x7fee94009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f92211ae730d207 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:50.272 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.269+0000 7fee99ffb700 1 -- 172.21.15.71:0/46242070 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9400e070 con 0x7fee9c0cc3d0 2023-10-06T01:40:50.272 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.269+0000 7fee99ffb700 1 -- 172.21.15.71:0/46242070 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee9400bbf0 con 0x7fee9c0cc3d0 2023-10-06T01:40:50.272 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.269+0000 7fee99ffb700 1 -- 172.21.15.71:0/46242070 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee94012430 con 0x7fee9c0cc3d0 2023-10-06T01:40:50.272 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.270+0000 7feea17c4700 1 -- 172.21.15.71:0/46242070 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee9c0cc3d0 msgr2=0x7fee9c0c4440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:50.272 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.270+0000 7feea17c4700 1 --2- 172.21.15.71:0/46242070 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee9c0cc3d0 0x7fee9c0c4440 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fee94009e60 tx=0x7fee94009780 comp rx=0 tx=0).stop 2023-10-06T01:40:50.272 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.270+0000 7feea17c4700 1 -- 172.21.15.71:0/46242070 shutdown_connections 2023-10-06T01:40:50.272 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.270+0000 7feea17c4700 1 --2- 172.21.15.71:0/46242070 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee9c0cc3d0 0x7fee9c0c4440 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:50.273 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.270+0000 7feea17c4700 1 -- 172.21.15.71:0/46242070 >> 172.21.15.71:0/46242070 conn(0x7fee9c067910 msgr2=0x7fee9c0ce0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:50.273 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.270+0000 7feea17c4700 1 -- 172.21.15.71:0/46242070 shutdown_connections 2023-10-06T01:40:50.273 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.270+0000 7feea17c4700 1 -- 172.21.15.71:0/46242070 wait complete. 2023-10-06T01:40:50.275 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.271+0000 7feea17c4700 1 Processor -- start 2023-10-06T01:40:50.276 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.271+0000 7feea17c4700 1 -- start start 2023-10-06T01:40:50.276 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.272+0000 7feea17c4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fee9c0c3fd0 0x7fee9c15afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:50.276 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.272+0000 7feea17c4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee9c0cc3d0 0x7fee9c141ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:50.276 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.272+0000 7feea17c4700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee9c1574b0 0x7fee9c0ca890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:50.276 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.272+0000 7feea17c4700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee9c158690 con 0x7fee9c1574b0 2023-10-06T01:40:50.276 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.272+0000 7feea17c4700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee9c157df0 con 0x7fee9c0cc3d0 2023-10-06T01:40:50.276 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.272+0000 7feea17c4700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee9c1580d0 con 0x7fee9c0c3fd0 2023-10-06T01:40:50.276 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.272+0000 7fee9b7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee9c1574b0 0x7fee9c0ca890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:50.276 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.272+0000 7fee9b7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee9c1574b0 0x7fee9c0ca890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52392/0 (socket says 172.21.15.71:52392) 2023-10-06T01:40:50.276 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.272+0000 7fee9b7fe700 1 -- 172.21.15.71:0/3533173376 learned_addr learned my addr 172.21.15.71:0/3533173376 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:50.277 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.272+0000 7fee9affd700 1 --2- 172.21.15.71:0/3533173376 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fee9c0c3fd0 0x7fee9c15afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:50.277 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.272+0000 7fee9a7fc700 1 --2- 172.21.15.71:0/3533173376 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee9c0cc3d0 0x7fee9c141ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:50.277 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.272+0000 7fee9b7fe700 1 -- 172.21.15.71:0/3533173376 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fee9c0c3fd0 msgr2=0x7fee9c15afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:50.277 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.272+0000 7fee9b7fe700 1 --2- 172.21.15.71:0/3533173376 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fee9c0c3fd0 0x7fee9c15afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:50.277 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.272+0000 7fee9b7fe700 1 -- 172.21.15.71:0/3533173376 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee9c0cc3d0 msgr2=0x7fee9c141ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:50.277 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.272+0000 7fee9b7fe700 1 --2- 172.21.15.71:0/3533173376 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee9c0cc3d0 0x7fee9c141ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:50.277 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.272+0000 7fee9b7fe700 1 -- 172.21.15.71:0/3533173376 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee94009a20 con 0x7fee9c1574b0 2023-10-06T01:40:50.277 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.272+0000 7fee9a7fc700 1 --2- 172.21.15.71:0/3533173376 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee9c0cc3d0 0x7fee9c141ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:40:50.277 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.272+0000 7fee9b7fe700 1 --2- 172.21.15.71:0/3533173376 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee9c1574b0 0x7fee9c0ca890 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fee94003000 tx=0x7fee94018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:50.277 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.272+0000 7fee82ffd700 1 -- 172.21.15.71:0/3533173376 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9401e640 con 0x7fee9c1574b0 2023-10-06T01:40:50.278 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.273+0000 7fee82ffd700 1 -- 172.21.15.71:0/3533173376 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee9401e7a0 con 0x7fee9c1574b0 2023-10-06T01:40:50.278 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.273+0000 7fee82ffd700 1 -- 172.21.15.71:0/3533173376 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9401eb40 con 0x7fee9c1574b0 2023-10-06T01:40:50.278 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.273+0000 7feea17c4700 1 -- 172.21.15.71:0/3533173376 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee9c1583b0 con 0x7fee9c1574b0 2023-10-06T01:40:50.278 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.273+0000 7feea17c4700 1 -- 172.21.15.71:0/3533173376 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee9c142010 con 0x7fee9c1574b0 2023-10-06T01:40:50.278 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.274+0000 7feea17c4700 1 -- 172.21.15.71:0/3533173376 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee9c06e590 con 0x7fee9c1574b0 2023-10-06T01:40:50.278 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.274+0000 7fee82ffd700 1 -- 172.21.15.71:0/3533173376 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fee94024070 con 0x7fee9c1574b0 2023-10-06T01:40:50.278 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.274+0000 7fee82ffd700 1 --2- 172.21.15.71:0/3533173376 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fee88066f30 0x7fee880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:50.278 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.274+0000 7fee82ffd700 1 -- 172.21.15.71:0/3533173376 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fee94087480 con 0x7fee9c1574b0 2023-10-06T01:40:50.278 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.274+0000 7fee9affd700 1 --2- 172.21.15.71:0/3533173376 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fee88066f30 0x7fee880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:50.278 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.275+0000 7fee9affd700 1 --2- 172.21.15.71:0/3533173376 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fee88066f30 0x7fee880693e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fee8c009930 tx=0x7fee8c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:50.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.279+0000 7fee82ffd700 1 -- 172.21.15.71:0/3533173376 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fee94054200 con 0x7fee9c1574b0 2023-10-06T01:40:50.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.459+0000 7feea17c4700 1 -- 172.21.15.71:0/3533173376 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fee9c0c34f0 con 0x7fee9c1574b0 2023-10-06T01:40:50.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.459+0000 7fee82ffd700 1 -- 172.21.15.71:0/3533173376 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7fee94057820 con 0x7fee9c1574b0 2023-10-06T01:40:50.461 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 32 2023-10-06T01:40:50.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.461+0000 7feea17c4700 1 -- 172.21.15.71:0/3533173376 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fee88066f30 msgr2=0x7fee880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:50.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.461+0000 7feea17c4700 1 --2- 172.21.15.71:0/3533173376 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fee88066f30 0x7fee880693e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fee8c009930 tx=0x7fee8c008040 comp rx=0 tx=0).stop 2023-10-06T01:40:50.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.461+0000 7feea17c4700 1 -- 172.21.15.71:0/3533173376 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee9c1574b0 msgr2=0x7fee9c0ca890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:50.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.461+0000 7feea17c4700 1 --2- 172.21.15.71:0/3533173376 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee9c1574b0 0x7fee9c0ca890 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fee94003000 tx=0x7fee94018000 comp rx=0 tx=0).stop 2023-10-06T01:40:50.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.461+0000 7feea17c4700 1 -- 172.21.15.71:0/3533173376 shutdown_connections 2023-10-06T01:40:50.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.461+0000 7feea17c4700 1 --2- 172.21.15.71:0/3533173376 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee9c1574b0 0x7fee9c0ca890 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:50.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.461+0000 7feea17c4700 1 --2- 172.21.15.71:0/3533173376 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fee9c0c3fd0 0x7fee9c15afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:50.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.461+0000 7feea17c4700 1 --2- 172.21.15.71:0/3533173376 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fee88066f30 0x7fee880693e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:50.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.461+0000 7feea17c4700 1 --2- 172.21.15.71:0/3533173376 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fee9c0cc3d0 0x7fee9c141ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:50.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.461+0000 7feea17c4700 1 -- 172.21.15.71:0/3533173376 >> 172.21.15.71:0/3533173376 conn(0x7fee9c067910 msgr2=0x7fee9c0b0eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:50.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.462+0000 7feea17c4700 1 -- 172.21.15.71:0/3533173376 shutdown_connections 2023-10-06T01:40:50.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.462+0000 7feea17c4700 1 -- 172.21.15.71:0/3533173376 wait complete. 2023-10-06T01:40:50.474 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T01:40:50.589 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.588+0000 7fcd618c6700 1 Processor -- start 2023-10-06T01:40:50.589 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.588+0000 7fcd618c6700 1 -- start start 2023-10-06T01:40:50.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.589+0000 7fcd618c6700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fcd5c159280 0x7fcd5c06f410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:50.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.589+0000 7fcd618c6700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcd5c159650 0x7fcd5c068680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:50.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.589+0000 7fcd618c6700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd5c0c8340 con 0x7fcd5c06f950 2023-10-06T01:40:50.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.589+0000 7fcd618c6700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd5c0c7a10 con 0x7fcd5c159280 2023-10-06T01:40:50.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.589+0000 7fcd618c6700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5c0c7cf0 con 0x7fcd5c159650 2023-10-06T01:40:50.592 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.589+0000 7fcd608c4700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fcd5c159280 0x7fcd5c06f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:50.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.589+0000 7fcd608c4700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fcd5c159280 0x7fcd5c06f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52400/0 (socket says 172.21.15.71:52400) 2023-10-06T01:40:50.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.589+0000 7fcd608c4700 1 -- 172.21.15.71:0/3133381742 learned_addr learned my addr 172.21.15.71:0/3133381742 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:50.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.589+0000 7fcd53fff700 1 --2- 172.21.15.71:0/3133381742 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcd5c159650 0x7fcd5c068680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:50.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.589+0000 7fcd608c4700 1 -- 172.21.15.71:0/3133381742 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcd5c159650 msgr2=0x7fcd5c068680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:50.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.589+0000 7fcd608c4700 1 --2- 172.21.15.71:0/3133381742 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcd5c159650 0x7fcd5c068680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:50.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.589+0000 7fcd608c4700 1 -- 172.21.15.71:0/3133381742 >> v1:172.21.15.72:6789/0 conn(0x7fcd5c06f950 legacy=0x7fcd5c15cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:50.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.589+0000 7fcd608c4700 1 -- 172.21.15.71:0/3133381742 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd5c0c7fd0 con 0x7fcd5c159280 2023-10-06T01:40:50.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.589+0000 7fcd53fff700 1 --2- 172.21.15.71:0/3133381742 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcd5c159650 0x7fcd5c068680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:40:50.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.590+0000 7fcd608c4700 1 --2- 172.21.15.71:0/3133381742 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcd5c159280 0x7fcd5c06f410 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fcd580099b0 tx=0x7fcd58009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27755c98764f795b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:50.593 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.590+0000 7fcd537fe700 1 -- 172.21.15.71:0/3133381742 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd5800b820 con 0x7fcd5c159280 2023-10-06T01:40:50.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.590+0000 7fcd537fe700 1 -- 172.21.15.71:0/3133381742 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd5800b980 con 0x7fcd5c159280 2023-10-06T01:40:50.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.590+0000 7fcd537fe700 1 -- 172.21.15.71:0/3133381742 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd5800bd20 con 0x7fcd5c159280 2023-10-06T01:40:50.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.590+0000 7fcd618c6700 1 -- 172.21.15.71:0/3133381742 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcd5c159280 msgr2=0x7fcd5c06f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:50.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.590+0000 7fcd618c6700 1 --2- 172.21.15.71:0/3133381742 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcd5c159280 0x7fcd5c06f410 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fcd580099b0 tx=0x7fcd58009250 comp rx=0 tx=0).stop 2023-10-06T01:40:50.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.590+0000 7fcd618c6700 1 -- 172.21.15.71:0/3133381742 shutdown_connections 2023-10-06T01:40:50.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.590+0000 7fcd618c6700 1 --2- 172.21.15.71:0/3133381742 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcd5c159280 0x7fcd5c06f410 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:50.594 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.590+0000 7fcd618c6700 1 --2- 172.21.15.71:0/3133381742 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcd5c159650 0x7fcd5c068680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:50.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.590+0000 7fcd618c6700 1 -- 172.21.15.71:0/3133381742 >> 172.21.15.71:0/3133381742 conn(0x7fcd5c0c9070 msgr2=0x7fcd5c0c9470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:50.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.590+0000 7fcd618c6700 1 -- 172.21.15.71:0/3133381742 shutdown_connections 2023-10-06T01:40:50.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.590+0000 7fcd618c6700 1 -- 172.21.15.71:0/3133381742 wait complete. 2023-10-06T01:40:50.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.591+0000 7fcd618c6700 1 Processor -- start 2023-10-06T01:40:50.595 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.592+0000 7fcd618c6700 1 -- start start 2023-10-06T01:40:50.597 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.592+0000 7fcd618c6700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd5c06f950 0x7fcd5c0c4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:50.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.592+0000 7fcd618c6700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcd5c159280 0x7fcd5c16d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:50.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.592+0000 7fcd618c6700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcd5c15af00 0x7fcd5c16deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:50.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.592+0000 7fcd618c6700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5c15c480 con 0x7fcd5c159280 2023-10-06T01:40:50.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.592+0000 7fcd618c6700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5c15b3e0 con 0x7fcd5c06f950 2023-10-06T01:40:50.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.592+0000 7fcd618c6700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5c15b6c0 con 0x7fcd5c15af00 2023-10-06T01:40:50.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.592+0000 7fcd53fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcd5c159280 0x7fcd5c16d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:50.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.592+0000 7fcd53fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcd5c159280 0x7fcd5c16d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52410/0 (socket says 172.21.15.71:52410) 2023-10-06T01:40:50.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.592+0000 7fcd53fff700 1 -- 172.21.15.71:0/3032860952 learned_addr learned my addr 172.21.15.71:0/3032860952 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:50.598 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.593+0000 7fcd610c5700 1 --2- 172.21.15.71:0/3032860952 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcd5c15af00 0x7fcd5c16deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:50.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.593+0000 7fcd608c4700 1 --2- 172.21.15.71:0/3032860952 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd5c06f950 0x7fcd5c0c4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:50.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.593+0000 7fcd53fff700 1 -- 172.21.15.71:0/3032860952 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcd5c15af00 msgr2=0x7fcd5c16deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:50.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.593+0000 7fcd53fff700 1 --2- 172.21.15.71:0/3032860952 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcd5c15af00 0x7fcd5c16deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:50.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.593+0000 7fcd53fff700 1 -- 172.21.15.71:0/3032860952 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd5c06f950 msgr2=0x7fcd5c0c4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:50.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.593+0000 7fcd53fff700 1 --2- 172.21.15.71:0/3032860952 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd5c06f950 0x7fcd5c0c4340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:50.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.593+0000 7fcd53fff700 1 -- 172.21.15.71:0/3032860952 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd580094f0 con 0x7fcd5c159280 2023-10-06T01:40:50.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.593+0000 7fcd608c4700 1 --2- 172.21.15.71:0/3032860952 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd5c06f950 0x7fcd5c0c4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:40:50.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.593+0000 7fcd610c5700 1 --2- 172.21.15.71:0/3032860952 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcd5c15af00 0x7fcd5c16deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:40:50.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.593+0000 7fcd53fff700 1 --2- 172.21.15.71:0/3032860952 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcd5c159280 0x7fcd5c16d970 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c00c850 tx=0x7fcd4c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:50.599 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.593+0000 7fcd50ff9700 1 -- 172.21.15.71:0/3032860952 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4c011600 con 0x7fcd5c159280 2023-10-06T01:40:50.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.593+0000 7fcd50ff9700 1 -- 172.21.15.71:0/3032860952 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd4c011760 con 0x7fcd5c159280 2023-10-06T01:40:50.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.593+0000 7fcd618c6700 1 -- 172.21.15.71:0/3032860952 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd5c15b9a0 con 0x7fcd5c159280 2023-10-06T01:40:50.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.593+0000 7fcd50ff9700 1 -- 172.21.15.71:0/3032860952 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4c011b00 con 0x7fcd5c159280 2023-10-06T01:40:50.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.593+0000 7fcd618c6700 1 -- 172.21.15.71:0/3032860952 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd5c15bf60 con 0x7fcd5c159280 2023-10-06T01:40:50.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.594+0000 7fcd618c6700 1 -- 172.21.15.71:0/3032860952 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd5c06dc70 con 0x7fcd5c159280 2023-10-06T01:40:50.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.594+0000 7fcd50ff9700 1 -- 172.21.15.71:0/3032860952 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcd4c0073b0 con 0x7fcd5c159280 2023-10-06T01:40:50.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.595+0000 7fcd50ff9700 1 --2- 172.21.15.71:0/3032860952 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fcd48066f30 0x7fcd480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:50.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.595+0000 7fcd50ff9700 1 -- 172.21.15.71:0/3032860952 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fcd4c084960 con 0x7fcd5c159280 2023-10-06T01:40:50.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.595+0000 7fcd608c4700 1 --2- 172.21.15.71:0/3032860952 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fcd48066f30 0x7fcd480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:50.600 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.595+0000 7fcd608c4700 1 --2- 172.21.15.71:0/3032860952 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fcd48066f30 0x7fcd480693e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fcd580099b0 tx=0x7fcd58016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:50.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.599+0000 7fcd50ff9700 1 -- 172.21.15.71:0/3032860952 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcd4c051780 con 0x7fcd5c159280 2023-10-06T01:40:50.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.827+0000 7fcd618c6700 1 -- 172.21.15.71:0/3032860952 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcd5c068420 con 0x7fcd5c159280 2023-10-06T01:40:50.828 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.827+0000 7fcd50ff9700 1 -- 172.21.15.71:0/3032860952 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4590 (secure 0 0 0) 0x7fcd4c054da0 con 0x7fcd5c159280 2023-10-06T01:40:50.828 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:40:50.828 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6836/274053969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":274053969},{"type":"v1","addr":"172.21.15.71:6836","nonce":274053969}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/4158221694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6835","nonce":4158221694},{"type":"v1","addr":"172.21.15.71:6837","nonce":4158221694}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/1094581488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":1094581488},{"type":"v1","addr":"172.21.15.72:6835","nonce":1094581488}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T01:40:21.151426+0000","modified":"2023-10-06T01:40:39.857922+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4315},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4315":{"gid":4315,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6834/2361644634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6833","nonce":2361644634},{"type":"v1","addr":"172.21.15.72:6834","nonce":2361644634}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T01:40:50.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.829+0000 7fcd618c6700 1 -- 172.21.15.71:0/3032860952 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fcd48066f30 msgr2=0x7fcd480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:50.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.829+0000 7fcd618c6700 1 --2- 172.21.15.71:0/3032860952 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fcd48066f30 0x7fcd480693e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fcd580099b0 tx=0x7fcd58016000 comp rx=0 tx=0).stop 2023-10-06T01:40:50.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.829+0000 7fcd618c6700 1 -- 172.21.15.71:0/3032860952 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcd5c159280 msgr2=0x7fcd5c16d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:50.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.829+0000 7fcd618c6700 1 --2- 172.21.15.71:0/3032860952 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcd5c159280 0x7fcd5c16d970 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c00c850 tx=0x7fcd4c008040 comp rx=0 tx=0).stop 2023-10-06T01:40:50.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.829+0000 7fcd618c6700 1 -- 172.21.15.71:0/3032860952 shutdown_connections 2023-10-06T01:40:50.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.829+0000 7fcd618c6700 1 --2- 172.21.15.71:0/3032860952 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcd5c15af00 0x7fcd5c16deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:50.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.829+0000 7fcd618c6700 1 --2- 172.21.15.71:0/3032860952 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fcd48066f30 0x7fcd480693e0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:50.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.829+0000 7fcd618c6700 1 --2- 172.21.15.71:0/3032860952 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd5c06f950 0x7fcd5c0c4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:50.832 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.829+0000 7fcd618c6700 1 --2- 172.21.15.71:0/3032860952 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcd5c159280 0x7fcd5c16d970 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:50.832 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.829+0000 7fcd618c6700 1 -- 172.21.15.71:0/3032860952 >> 172.21.15.71:0/3032860952 conn(0x7fcd5c0c9070 msgr2=0x7fcd5c156220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:50.832 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.829+0000 7fcd618c6700 1 -- 172.21.15.71:0/3032860952 shutdown_connections 2023-10-06T01:40:50.832 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.829+0000 7fcd618c6700 1 -- 172.21.15.71:0/3032860952 wait complete. 2023-10-06T01:40:50.832 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 9 2023-10-06T01:40:50.842 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:40:50.957 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.956+0000 7f274fbf8700 1 Processor -- start 2023-10-06T01:40:50.957 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.957+0000 7f274fbf8700 1 -- start start 2023-10-06T01:40:50.959 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.957+0000 7f274fbf8700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f27480af4e0 0x7f27480b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:50.960 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.957+0000 7f274fbf8700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f274815db70 0x7f27480b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:50.960 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.957+0000 7f274fbf8700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f274815e190 con 0x7f27480af8b0 2023-10-06T01:40:50.960 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.957+0000 7f274fbf8700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27480b1910 con 0x7f274815db70 2023-10-06T01:40:50.960 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.957+0000 7f274fbf8700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f274815dfa0 con 0x7f27480af4e0 2023-10-06T01:40:50.960 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.957+0000 7f274e195700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f274815db70 0x7f27480b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:50.960 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.957+0000 7f274d193700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f27480af8b0 0x7f274815d460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:54584/0 (socket says 172.21.15.71:54584) 2023-10-06T01:40:50.960 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.957+0000 7f274d193700 1 -- 172.21.15.71:0/4215830142 learned_addr learned my addr 172.21.15.71:0/4215830142 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:40:50.960 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.958+0000 7f274d994700 1 --2- 172.21.15.71:0/4215830142 >> v2:172.21.15.72:3300/0 conn(0x7f27480af4e0 0x7f27480b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:50.960 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.958+0000 7f274e195700 1 -- 172.21.15.71:0/4215830142 >> v2:172.21.15.72:3300/0 conn(0x7f27480af4e0 msgr2=0x7f27480b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:50.960 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.958+0000 7f274e195700 1 --2- 172.21.15.71:0/4215830142 >> v2:172.21.15.72:3300/0 conn(0x7f27480af4e0 0x7f27480b20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:50.961 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.958+0000 7f274e195700 1 -- 172.21.15.71:0/4215830142 >> v1:172.21.15.71:6789/0 conn(0x7f27480af8b0 legacy=0x7f274815d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:50.961 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.958+0000 7f274e195700 1 -- 172.21.15.71:0/4215830142 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27480cb650 con 0x7f274815db70 2023-10-06T01:40:50.961 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.958+0000 7f274c992700 1 -- 172.21.15.71:0/4215830142 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 259663984 0 0) 0x7f274815e190 con 0x7f27480af8b0 2023-10-06T01:40:50.961 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.958+0000 7f274e195700 1 --2- 172.21.15.71:0/4215830142 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f274815db70 0x7f27480b2620 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f27480d1360 tx=0x7f27400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79d9f1ffbfd7b93c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:50.961 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.958+0000 7f274c992700 1 -- 172.21.15.71:0/4215830142 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2740011630 con 0x7f274815db70 2023-10-06T01:40:50.961 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.958+0000 7f274c992700 1 -- 172.21.15.71:0/4215830142 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2740011790 con 0x7f274815db70 2023-10-06T01:40:50.961 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.958+0000 7f274c992700 1 -- 172.21.15.71:0/4215830142 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2740011b30 con 0x7f274815db70 2023-10-06T01:40:50.961 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.958+0000 7f274fbf8700 1 -- 172.21.15.71:0/4215830142 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f274815db70 msgr2=0x7f27480b2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:50.961 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.958+0000 7f274fbf8700 1 --2- 172.21.15.71:0/4215830142 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f274815db70 0x7f27480b2620 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f27480d1360 tx=0x7f27400091a0 comp rx=0 tx=0).stop 2023-10-06T01:40:50.961 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.959+0000 7f274fbf8700 1 -- 172.21.15.71:0/4215830142 shutdown_connections 2023-10-06T01:40:50.961 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.959+0000 7f274fbf8700 1 --2- 172.21.15.71:0/4215830142 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f274815db70 0x7f27480b2620 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:50.961 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.959+0000 7f274fbf8700 1 --2- 172.21.15.71:0/4215830142 >> v2:172.21.15.72:3300/0 conn(0x7f27480af4e0 0x7f27480b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:50.962 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.959+0000 7f274fbf8700 1 -- 172.21.15.71:0/4215830142 >> 172.21.15.71:0/4215830142 conn(0x7f2748068680 msgr2=0x7f2748068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:50.962 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.959+0000 7f274fbf8700 1 -- 172.21.15.71:0/4215830142 shutdown_connections 2023-10-06T01:40:50.962 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.959+0000 7f274fbf8700 1 -- 172.21.15.71:0/4215830142 wait complete. 2023-10-06T01:40:50.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.960+0000 7f274fbf8700 1 Processor -- start 2023-10-06T01:40:50.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.960+0000 7f274fbf8700 1 -- start start 2023-10-06T01:40:50.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.960+0000 7f274fbf8700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27480af4e0 0x7f27480d0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:50.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.960+0000 7f274fbf8700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27480af8b0 0x7f274814b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:50.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.960+0000 7f274fbf8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f274815db70 0x7f27480b4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:50.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.960+0000 7f274fbf8700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27480a6d20 con 0x7f27480af8b0 2023-10-06T01:40:50.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.960+0000 7f274fbf8700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f274814bf20 con 0x7f27480af4e0 2023-10-06T01:40:50.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.960+0000 7f274fbf8700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f274816a5e0 con 0x7f274815db70 2023-10-06T01:40:50.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.961+0000 7f274d193700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27480af8b0 0x7f274814b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:50.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.961+0000 7f274d193700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27480af8b0 0x7f274814b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52416/0 (socket says 172.21.15.71:52416) 2023-10-06T01:40:50.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.961+0000 7f274d193700 1 -- 172.21.15.71:0/3337171051 learned_addr learned my addr 172.21.15.71:0/3337171051 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:50.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.961+0000 7f274d994700 1 --2- 172.21.15.71:0/3337171051 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27480af4e0 0x7f27480d0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:50.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.961+0000 7f274e195700 1 --2- 172.21.15.71:0/3337171051 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f274815db70 0x7f27480b4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:50.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.961+0000 7f274d193700 1 -- 172.21.15.71:0/3337171051 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f274815db70 msgr2=0x7f27480b4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:50.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.961+0000 7f274d193700 1 --2- 172.21.15.71:0/3337171051 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f274815db70 0x7f27480b4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:50.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.961+0000 7f274d193700 1 -- 172.21.15.71:0/3337171051 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27480af4e0 msgr2=0x7f27480d0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:50.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.961+0000 7f274d193700 1 --2- 172.21.15.71:0/3337171051 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27480af4e0 0x7f27480d0980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:50.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.961+0000 7f274d193700 1 -- 172.21.15.71:0/3337171051 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2740009420 con 0x7f27480af8b0 2023-10-06T01:40:50.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.961+0000 7f274d193700 1 --2- 172.21.15.71:0/3337171051 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27480af8b0 0x7f274814b9e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f273800c810 tx=0x7f2738007db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:50.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.961+0000 7f273dffb700 1 -- 172.21.15.71:0/3337171051 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2738005c00 con 0x7f27480af8b0 2023-10-06T01:40:50.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.961+0000 7f273dffb700 1 -- 172.21.15.71:0/3337171051 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2738005d60 con 0x7f27480af8b0 2023-10-06T01:40:50.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.961+0000 7f274fbf8700 1 -- 172.21.15.71:0/3337171051 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f274816a8c0 con 0x7f27480af8b0 2023-10-06T01:40:50.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.961+0000 7f273dffb700 1 -- 172.21.15.71:0/3337171051 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2738007300 con 0x7f27480af8b0 2023-10-06T01:40:50.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.961+0000 7f274fbf8700 1 -- 172.21.15.71:0/3337171051 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f274816ae80 con 0x7f27480af8b0 2023-10-06T01:40:50.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.962+0000 7f274fbf8700 1 -- 172.21.15.71:0/3337171051 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27480a6e60 con 0x7f27480af8b0 2023-10-06T01:40:50.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.962+0000 7f273dffb700 1 -- 172.21.15.71:0/3337171051 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f273801b3b0 con 0x7f27480af8b0 2023-10-06T01:40:50.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.963+0000 7f273dffb700 1 --2- 172.21.15.71:0/3337171051 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f272c066f30 0x7f272c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:50.967 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.963+0000 7f273dffb700 1 -- 172.21.15.71:0/3337171051 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f2738083e40 con 0x7f27480af8b0 2023-10-06T01:40:50.967 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.963+0000 7f274d994700 1 --2- 172.21.15.71:0/3337171051 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f272c066f30 0x7f272c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:50.967 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.963+0000 7f274d994700 1 --2- 172.21.15.71:0/3337171051 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f272c066f30 0x7f272c0693e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2744009fd0 tx=0x7f274400b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:50.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:50.967+0000 7f273dffb700 1 -- 172.21.15.71:0/3337171051 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f27480a6e60 con 0x7f27480af8b0 2023-10-06T01:40:51.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:51.151+0000 7f274fbf8700 1 -- 172.21.15.71:0/3337171051 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f27480a6e60 con 0x7f27480af8b0 2023-10-06T01:40:51.152 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:51.152+0000 7f273dffb700 1 -- 172.21.15.71:0/3337171051 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18659 (secure 0 0 0) 0x7f27480a6e60 con 0x7f27480af8b0 2023-10-06T01:40:51.153 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:40:51.153 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":27,"fsid":"1fbf1bd2-f9b4-4599-bea2-f4aa920e9a56","created":"2023-10-06T01:39:57.016957+0000","modified":"2023-10-06T01:40:26.202441+0000","last_up_change":"2023-10-06T01:40:08.571643+0000","last_in_change":"2023-10-06T01:39:59.462741+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T01:40:08.610349+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T01:40:15.387434+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T01:40:19.640459+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T01:40:20.116883+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T01:40:23.830129+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cf059188-fb20-4dbf-95db-dcf57b213d03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":90670},{"type":"v1","addr":"172.21.15.71:6817","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":90670},{"type":"v1","addr":"172.21.15.71:6819","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":90670},{"type":"v1","addr":"172.21.15.71:6823","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":90670},{"type":"v1","addr":"172.21.15.71:6821","nonce":90670}]},"public_addr":"172.21.15.71:6817/90670","cluster_addr":"172.21.15.71:6819/90670","heartbeat_back_addr":"172.21.15.71:6823/90670","heartbeat_front_addr":"172.21.15.71:6821/90670","state":["exists","up"]},{"osd":1,"uuid":"0cff0aae-1799-4fe0-b610-54cf0813c0e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":90669},{"type":"v1","addr":"172.21.15.71:6809","nonce":90669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":90669},{"type":"v1","addr":"172.21.15.71:6811","nonce":90669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":90669},{"type":"v1","addr":"172.21.15.71:6815","nonce":90669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":90669},{"type":"v1","addr":"172.21.15.71:6813","nonce":90669}]},"public_addr":"172.21.15.71:6809/90669","cluster_addr":"172.21.15.71:6811/90669","heartbeat_back_addr":"172.21.15.71:6815/90669","heartbeat_front_addr":"172.21.15.71:6813/90669","state":["exists","up"]},{"osd":2,"uuid":"88d61ddc-9031-44e1-ba8c-546a41e7c8ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":90679},{"type":"v1","addr":"172.21.15.71:6825","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":90679},{"type":"v1","addr":"172.21.15.71:6827","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":90679},{"type":"v1","addr":"172.21.15.71:6831","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":90679},{"type":"v1","addr":"172.21.15.71:6829","nonce":90679}]},"public_addr":"172.21.15.71:6825/90679","cluster_addr":"172.21.15.71:6827/90679","heartbeat_back_addr":"172.21.15.71:6831/90679","heartbeat_front_addr":"172.21.15.71:6829/90679","state":["exists","up"]},{"osd":3,"uuid":"11ed92b7-960b-4a30-a889-a61d3eeb86f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":90668},{"type":"v1","addr":"172.21.15.71:6801","nonce":90668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":90668},{"type":"v1","addr":"172.21.15.71:6803","nonce":90668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":90668},{"type":"v1","addr":"172.21.15.71:6807","nonce":90668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":90668},{"type":"v1","addr":"172.21.15.71:6805","nonce":90668}]},"public_addr":"172.21.15.71:6801/90668","cluster_addr":"172.21.15.71:6803/90668","heartbeat_back_addr":"172.21.15.71:6807/90668","heartbeat_front_addr":"172.21.15.71:6805/90668","state":["exists","up"]},{"osd":4,"uuid":"ae4df784-abdf-4ddf-aefa-780f3ddafef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":90917},{"type":"v1","addr":"172.21.15.72:6801","nonce":90917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":90917},{"type":"v1","addr":"172.21.15.72:6803","nonce":90917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":90917},{"type":"v1","addr":"172.21.15.72:6807","nonce":90917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":90917},{"type":"v1","addr":"172.21.15.72:6805","nonce":90917}]},"public_addr":"172.21.15.72:6801/90917","cluster_addr":"172.21.15.72:6803/90917","heartbeat_back_addr":"172.21.15.72:6807/90917","heartbeat_front_addr":"172.21.15.72:6805/90917","state":["exists","up"]},{"osd":5,"uuid":"5ef0790f-001e-458f-a05b-efae216cf435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":90941},{"type":"v1","addr":"172.21.15.72:6817","nonce":90941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":90941},{"type":"v1","addr":"172.21.15.72:6819","nonce":90941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":90941},{"type":"v1","addr":"172.21.15.72:6827","nonce":90941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":90941},{"type":"v1","addr":"172.21.15.72:6823","nonce":90941}]},"public_addr":"172.21.15.72:6817/90941","cluster_addr":"172.21.15.72:6819/90941","heartbeat_back_addr":"172.21.15.72:6827/90941","heartbeat_front_addr":"172.21.15.72:6823/90941","state":["exists","up"]},{"osd":6,"uuid":"8705aef1-9ae8-4e54-a3c4-c2909fa0ceb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":90918},{"type":"v1","addr":"172.21.15.72:6809","nonce":90918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":90918},{"type":"v1","addr":"172.21.15.72:6811","nonce":90918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":90918},{"type":"v1","addr":"172.21.15.72:6815","nonce":90918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":90918},{"type":"v1","addr":"172.21.15.72:6813","nonce":90918}]},"public_addr":"172.21.15.72:6809/90918","cluster_addr":"172.21.15.72:6811/90918","heartbeat_back_addr":"172.21.15.72:6815/90918","heartbeat_front_addr":"172.21.15.72:6813/90918","state":["exists","up"]},{"osd":7,"uuid":"364c5119-6b13-4c75-b3f0-15e165eff86a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":90948},{"type":"v1","addr":"172.21.15.72:6822","nonce":90948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":90948},{"type":"v1","addr":"172.21.15.72:6826","nonce":90948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":90948},{"type":"v1","addr":"172.21.15.72:6831","nonce":90948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":90948},{"type":"v1","addr":"172.21.15.72:6829","nonce":90948}]},"public_addr":"172.21.15.72:6822/90948","cluster_addr":"172.21.15.72:6826/90948","heartbeat_back_addr":"172.21.15.72:6831/90948","heartbeat_front_addr":"172.21.15.72:6829/90948","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.642976+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.645372+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.619116+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.663042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.599163+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.646411+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.631545+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.669821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:40:51.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:51.154+0000 7f274fbf8700 1 -- 172.21.15.71:0/3337171051 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f272c066f30 msgr2=0x7f272c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:51.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:51.154+0000 7f274fbf8700 1 --2- 172.21.15.71:0/3337171051 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f272c066f30 0x7f272c0693e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2744009fd0 tx=0x7f274400b040 comp rx=0 tx=0).stop 2023-10-06T01:40:51.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:51.154+0000 7f274fbf8700 1 -- 172.21.15.71:0/3337171051 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27480af8b0 msgr2=0x7f274814b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:51.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:51.154+0000 7f274fbf8700 1 --2- 172.21.15.71:0/3337171051 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27480af8b0 0x7f274814b9e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f273800c810 tx=0x7f2738007db0 comp rx=0 tx=0).stop 2023-10-06T01:40:51.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:51.154+0000 7f274fbf8700 1 -- 172.21.15.71:0/3337171051 shutdown_connections 2023-10-06T01:40:51.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:51.154+0000 7f274fbf8700 1 --2- 172.21.15.71:0/3337171051 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f274815db70 0x7f27480b4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:51.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:51.154+0000 7f274fbf8700 1 --2- 172.21.15.71:0/3337171051 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f272c066f30 0x7f272c0693e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:51.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:51.154+0000 7f274fbf8700 1 --2- 172.21.15.71:0/3337171051 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27480af4e0 0x7f27480d0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:51.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:51.154+0000 7f274fbf8700 1 --2- 172.21.15.71:0/3337171051 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27480af8b0 0x7f274814b9e0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:51.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:51.154+0000 7f274fbf8700 1 -- 172.21.15.71:0/3337171051 >> 172.21.15.71:0/3337171051 conn(0x7f2748068680 msgr2=0x7f2748068a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:51.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:51.154+0000 7f274fbf8700 1 -- 172.21.15.71:0/3337171051 shutdown_connections 2023-10-06T01:40:51.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:51.154+0000 7f274fbf8700 1 -- 172.21.15.71:0/3337171051 wait complete. 2023-10-06T01:40:51.167 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T01:40:51.281 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:51.280+0000 7ff4dab2d700 1 Processor -- start 2023-10-06T01:40:51.281 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:51.280+0000 7ff4dab2d700 1 -- start start 2023-10-06T01:40:51.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:51.281+0000 7ff4dab2d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff4d40af4e0 0x7ff4d40b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:51.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:51.281+0000 7ff4dab2d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff4d415db70 0x7ff4d40b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:51.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:51.281+0000 7ff4dab2d700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4d415e190 con 0x7ff4d40af8b0 2023-10-06T01:40:51.284 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:51.281+0000 7ff4dab2d700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4d40b1910 con 0x7ff4d40af4e0 2023-10-06T01:40:51.284 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:51.281+0000 7ff4dab2d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d415dfa0 con 0x7ff4d415db70 2023-10-06T01:40:51.284 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:51.281+0000 7ff4d90ca700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff4d415db70 0x7ff4d40b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:51.284 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:51.281+0000 7ff4d90ca700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff4d415db70 0x7ff4d40b2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.71:39438/0 (socket says 172.21.15.71:39438) 2023-10-06T01:40:51.284 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:51.281+0000 7ff4d90ca700 1 -- 172.21.15.71:0/3478484996 learned_addr learned my addr 172.21.15.71:0/3478484996 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:51.284 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:51.281+0000 7ff4d88c9700 1 --2- 172.21.15.71:0/3478484996 >> v2:172.21.15.72:3300/0 conn(0x7ff4d40af4e0 0x7ff4d40b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:51.284 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:51.281+0000 7ff4d90ca700 1 -- 172.21.15.71:0/3478484996 >> v2:172.21.15.72:3300/0 conn(0x7ff4d40af4e0 msgr2=0x7ff4d40b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:51.284 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:51.281+0000 7ff4d90ca700 1 --2- 172.21.15.71:0/3478484996 >> v2:172.21.15.72:3300/0 conn(0x7ff4d40af4e0 0x7ff4d40b20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:51.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:51.281+0000 7ff4d90ca700 1 -- 172.21.15.71:0/3478484996 >> v1:172.21.15.72:6789/0 conn(0x7ff4d40af8b0 legacy=0x7ff4d415d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:51.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:51.281+0000 7ff4d90ca700 1 -- 172.21.15.71:0/3478484996 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4d40cb650 con 0x7ff4d415db70 2023-10-06T01:40:51.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:51.281+0000 7ff4d37fe700 1 -- 172.21.15.71:0/3478484996 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1003144234 0 0) 0x7ff4d415e190 con 0x7ff4d40af8b0 2023-10-06T01:40:51.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:51.282+0000 7ff4d90ca700 1 --2- 172.21.15.71:0/3478484996 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff4d415db70 0x7ff4d40b2620 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff4cc009f20 tx=0x7ff4cc009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7bc608a81dae816a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:51.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:51.282+0000 7ff4d37fe700 1 -- 172.21.15.71:0/3478484996 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4cc00e070 con 0x7ff4d415db70 2023-10-06T01:40:51.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:51.282+0000 7ff4d37fe700 1 -- 172.21.15.71:0/3478484996 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4cc00b9d0 con 0x7ff4d415db70 2023-10-06T01:40:51.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:51.282+0000 7ff4d37fe700 1 -- 172.21.15.71:0/3478484996 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4cc0092e0 con 0x7ff4d415db70 2023-10-06T01:40:51.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:51.282+0000 7ff4dab2d700 1 -- 172.21.15.71:0/3478484996 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff4d415db70 msgr2=0x7ff4d40b2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:51.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:51.282+0000 7ff4dab2d700 1 --2- 172.21.15.71:0/3478484996 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff4d415db70 0x7ff4d40b2620 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff4cc009f20 tx=0x7ff4cc009840 comp rx=0 tx=0).stop 2023-10-06T01:40:51.286 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:51.282+0000 7ff4dab2d700 1 -- 172.21.15.71:0/3478484996 shutdown_connections 2023-10-06T01:40:51.286 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:51.282+0000 7ff4dab2d700 1 --2- 172.21.15.71:0/3478484996 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff4d415db70 0x7ff4d40b2620 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:51.286 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:51.282+0000 7ff4dab2d700 1 --2- 172.21.15.71:0/3478484996 >> v2:172.21.15.72:3300/0 conn(0x7ff4d40af4e0 0x7ff4d40b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:51.286 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:51.282+0000 7ff4dab2d700 1 -- 172.21.15.71:0/3478484996 >> 172.21.15.71:0/3478484996 conn(0x7ff4d4068680 msgr2=0x7ff4d4068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:51.286 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:51.282+0000 7ff4dab2d700 1 -- 172.21.15.71:0/3478484996 shutdown_connections 2023-10-06T01:40:51.286 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:51.282+0000 7ff4dab2d700 1 -- 172.21.15.71:0/3478484996 wait complete. 2023-10-06T01:40:51.289 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:51.283+0000 7ff4dab2d700 1 Processor -- start 2023-10-06T01:40:51.289 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:51.284+0000 7ff4dab2d700 1 -- start start 2023-10-06T01:40:51.289 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:51.284+0000 7ff4dab2d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff4d40af4e0 0x7ff4d4153b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:51.289 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:51.284+0000 7ff4dab2d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4d40af8b0 0x7ff4d4153580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:51.289 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:51.284+0000 7ff4dab2d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff4d415db70 0x7ff4d40c78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:51.289 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:51.284+0000 7ff4dab2d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d40cdfe0 con 0x7ff4d415db70 2023-10-06T01:40:51.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:51.284+0000 7ff4dab2d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d40c9bd0 con 0x7ff4d40af8b0 2023-10-06T01:40:51.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:51.284+0000 7ff4dab2d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d40c9e40 con 0x7ff4d40af4e0 2023-10-06T01:40:51.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:51.284+0000 7ff4d90ca700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff4d415db70 0x7ff4d40c78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:51.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:51.284+0000 7ff4d90ca700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff4d415db70 0x7ff4d40c78c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52426/0 (socket says 172.21.15.71:52426) 2023-10-06T01:40:51.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:51.284+0000 7ff4d90ca700 1 -- 172.21.15.71:0/3526078439 learned_addr learned my addr 172.21.15.71:0/3526078439 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:51.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:51.284+0000 7ff4d3fff700 1 --2- 172.21.15.71:0/3526078439 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4d40af8b0 0x7ff4d4153580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:51.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:51.284+0000 7ff4d88c9700 1 --2- 172.21.15.71:0/3526078439 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff4d40af4e0 0x7ff4d4153b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:51.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:51.285+0000 7ff4d90ca700 1 -- 172.21.15.71:0/3526078439 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff4d40af4e0 msgr2=0x7ff4d4153b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:51.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:51.285+0000 7ff4d90ca700 1 --2- 172.21.15.71:0/3526078439 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff4d40af4e0 0x7ff4d4153b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:51.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:51.285+0000 7ff4d90ca700 1 -- 172.21.15.71:0/3526078439 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4d40af8b0 msgr2=0x7ff4d4153580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:51.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:51.285+0000 7ff4d90ca700 1 --2- 172.21.15.71:0/3526078439 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4d40af8b0 0x7ff4d4153580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:51.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:51.285+0000 7ff4d90ca700 1 -- 172.21.15.71:0/3526078439 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4cc009ae0 con 0x7ff4d415db70 2023-10-06T01:40:51.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:51.285+0000 7ff4d90ca700 1 --2- 172.21.15.71:0/3526078439 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff4d415db70 0x7ff4d40c78c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff4cc00b610 tx=0x7ff4cc018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:51.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:51.285+0000 7ff4d0ff9700 1 -- 172.21.15.71:0/3526078439 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4cc0094e0 con 0x7ff4d415db70 2023-10-06T01:40:51.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:51.285+0000 7ff4d0ff9700 1 -- 172.21.15.71:0/3526078439 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4cc007ac0 con 0x7ff4d415db70 2023-10-06T01:40:51.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:51.285+0000 7ff4dab2d700 1 -- 172.21.15.71:0/3526078439 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4d40ca120 con 0x7ff4d415db70 2023-10-06T01:40:51.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:51.285+0000 7ff4d0ff9700 1 -- 172.21.15.71:0/3526078439 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4cc007e80 con 0x7ff4d415db70 2023-10-06T01:40:51.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:51.285+0000 7ff4dab2d700 1 -- 172.21.15.71:0/3526078439 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4d40c8590 con 0x7ff4d415db70 2023-10-06T01:40:51.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:51.286+0000 7ff4dab2d700 1 -- 172.21.15.71:0/3526078439 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4d40b04a0 con 0x7ff4d415db70 2023-10-06T01:40:51.292 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:51.286+0000 7ff4d0ff9700 1 -- 172.21.15.71:0/3526078439 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff4cc003040 con 0x7ff4d415db70 2023-10-06T01:40:51.292 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:51.287+0000 7ff4d0ff9700 1 --2- 172.21.15.71:0/3526078439 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7ff4b8066f30 0x7ff4b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:51.292 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:51.287+0000 7ff4d0ff9700 1 -- 172.21.15.71:0/3526078439 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7ff4cc086a70 con 0x7ff4d415db70 2023-10-06T01:40:51.292 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:51.287+0000 7ff4d88c9700 1 --2- 172.21.15.71:0/3526078439 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7ff4b8066f30 0x7ff4b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:51.292 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:51.287+0000 7ff4d88c9700 1 --2- 172.21.15.71:0/3526078439 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7ff4b8066f30 0x7ff4b80693e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff4c8009d10 tx=0x7ff4c80091a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:51.292 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:51.291+0000 7ff4d0ff9700 1 -- 172.21.15.71:0/3526078439 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff4cc0537f0 con 0x7ff4d415db70 2023-10-06T01:40:51.317 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T01:40:51.319 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T01:40:51.520 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:51.520+0000 7ff4dab2d700 1 -- 172.21.15.71:0/3526078439 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff4d40b0f90 con 0x7ff4d415db70 2023-10-06T01:40:51.521 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:51.520+0000 7ff4d0ff9700 1 -- 172.21.15.71:0/3526078439 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4590 (secure 0 0 0) 0x7ff4cc056e10 con 0x7ff4d415db70 2023-10-06T01:40:51.522 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:40:51.522 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6836/274053969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":274053969},{"type":"v1","addr":"172.21.15.71:6836","nonce":274053969}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/4158221694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6835","nonce":4158221694},{"type":"v1","addr":"172.21.15.71:6837","nonce":4158221694}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/1094581488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":1094581488},{"type":"v1","addr":"172.21.15.72:6835","nonce":1094581488}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T01:40:21.151426+0000","modified":"2023-10-06T01:40:39.857922+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4315},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4315":{"gid":4315,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6834/2361644634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6833","nonce":2361644634},{"type":"v1","addr":"172.21.15.72:6834","nonce":2361644634}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T01:40:51.523 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:51.522+0000 7ff4dab2d700 1 -- 172.21.15.71:0/3526078439 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7ff4b8066f30 msgr2=0x7ff4b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:51.523 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:51.522+0000 7ff4dab2d700 1 --2- 172.21.15.71:0/3526078439 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7ff4b8066f30 0x7ff4b80693e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff4c8009d10 tx=0x7ff4c80091a0 comp rx=0 tx=0).stop 2023-10-06T01:40:51.523 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:51.522+0000 7ff4dab2d700 1 -- 172.21.15.71:0/3526078439 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff4d415db70 msgr2=0x7ff4d40c78c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:51.523 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:51.522+0000 7ff4dab2d700 1 --2- 172.21.15.71:0/3526078439 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff4d415db70 0x7ff4d40c78c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff4cc00b610 tx=0x7ff4cc018000 comp rx=0 tx=0).stop 2023-10-06T01:40:51.524 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:51.522+0000 7ff4dab2d700 1 -- 172.21.15.71:0/3526078439 shutdown_connections 2023-10-06T01:40:51.524 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:51.522+0000 7ff4dab2d700 1 --2- 172.21.15.71:0/3526078439 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff4d415db70 0x7ff4d40c78c0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:51.524 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:51.522+0000 7ff4dab2d700 1 --2- 172.21.15.71:0/3526078439 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff4d40af4e0 0x7ff4d4153b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:51.524 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:51.522+0000 7ff4dab2d700 1 --2- 172.21.15.71:0/3526078439 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7ff4b8066f30 0x7ff4b80693e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:51.524 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:51.522+0000 7ff4dab2d700 1 --2- 172.21.15.71:0/3526078439 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4d40af8b0 0x7ff4d4153580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:51.524 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:51.522+0000 7ff4dab2d700 1 -- 172.21.15.71:0/3526078439 >> 172.21.15.71:0/3526078439 conn(0x7ff4d4068680 msgr2=0x7ff4d4154c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:51.524 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:51.522+0000 7ff4dab2d700 1 -- 172.21.15.71:0/3526078439 shutdown_connections 2023-10-06T01:40:51.525 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:51.522+0000 7ff4dab2d700 1 -- 172.21.15.71:0/3526078439 wait complete. 2023-10-06T01:40:51.525 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 9 2023-10-06T01:40:51.937 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T01:40:21.151426+0000', 'modified': '2023-10-06T01:40:39.857922+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4315}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4315': {'gid': 4315, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.72:6834/2361644634', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.72:6833', 'nonce': 2361644634}, {'type': 'v1', 'addr': '172.21.15.72:6834', 'nonce': 2361644634}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T01:40:51.937 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T01:40:51.938 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-06T01:40:52.054 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.053+0000 7f0fedf60700 1 Processor -- start 2023-10-06T01:40:52.054 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.053+0000 7f0fedf60700 1 -- start start 2023-10-06T01:40:52.056 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.054+0000 7f0fedf60700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0fe8159280 0x7f0fe806f410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:52.056 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.054+0000 7f0fedf60700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f0fe8159650 0x7f0fe8068680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:52.057 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.054+0000 7f0fedf60700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fe806f950 0x7f0fe8068bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:52.057 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.054+0000 7f0fedf60700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fe80c8340 con 0x7f0fe8159650 2023-10-06T01:40:52.057 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.054+0000 7f0fedf60700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fe80c7a10 con 0x7f0fe8159280 2023-10-06T01:40:52.057 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.054+0000 7f0fedf60700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe80c7cf0 con 0x7f0fe806f950 2023-10-06T01:40:52.057 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.054+0000 7f0fe7fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f0fe8159650 0x7f0fe8068680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:52.057 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.054+0000 7f0fe7fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f0fe8159650 0x7f0fe8068680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52430/0 (socket says 172.21.15.71:52430) 2023-10-06T01:40:52.057 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.054+0000 7f0fe7fff700 1 -- 172.21.15.71:0/3734846768 learned_addr learned my addr 172.21.15.71:0/3734846768 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:52.057 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.054+0000 7f0fed75f700 1 --2- 172.21.15.71:0/3734846768 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fe806f950 0x7f0fe8068bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:52.057 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.054+0000 7f0fecf5e700 1 --2- 172.21.15.71:0/3734846768 >> v2:172.21.15.72:3300/0 conn(0x7f0fe8159280 0x7f0fe806f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:52.057 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.054+0000 7f0fe7fff700 1 -- 172.21.15.71:0/3734846768 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fe806f950 msgr2=0x7f0fe8068bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:52.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.054+0000 7f0fe7fff700 1 --2- 172.21.15.71:0/3734846768 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fe806f950 0x7f0fe8068bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:52.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.054+0000 7f0fe7fff700 1 -- 172.21.15.71:0/3734846768 >> v2:172.21.15.72:3300/0 conn(0x7f0fe8159280 msgr2=0x7f0fe806f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:52.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.054+0000 7f0fe7fff700 1 --2- 172.21.15.71:0/3734846768 >> v2:172.21.15.72:3300/0 conn(0x7f0fe8159280 0x7f0fe806f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:52.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.054+0000 7f0fe7fff700 1 -- 172.21.15.71:0/3734846768 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fe80c7fd0 con 0x7f0fe8159650 2023-10-06T01:40:52.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.055+0000 7f0fecf5e700 1 --2- 172.21.15.71:0/3734846768 >> v2:172.21.15.72:3300/0 conn(0x7f0fe8159280 0x7f0fe806f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:40:52.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.055+0000 7f0fe7fff700 1 --2- 172.21.15.71:0/3734846768 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0fe8159650 0x7f0fe8068680 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0fe80cc560 tx=0x7f0fd4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=332b662f7fd69004 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:52.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.055+0000 7f0fe77fe700 1 -- 172.21.15.71:0/3734846768 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fd400b860 con 0x7f0fe8159650 2023-10-06T01:40:52.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.055+0000 7f0fe77fe700 1 -- 172.21.15.71:0/3734846768 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fd400b9c0 con 0x7f0fe8159650 2023-10-06T01:40:52.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.055+0000 7f0fe77fe700 1 -- 172.21.15.71:0/3734846768 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fd400bd60 con 0x7f0fe8159650 2023-10-06T01:40:52.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.055+0000 7f0fedf60700 1 -- 172.21.15.71:0/3734846768 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0fe8159650 msgr2=0x7f0fe8068680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:52.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.055+0000 7f0fedf60700 1 --2- 172.21.15.71:0/3734846768 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0fe8159650 0x7f0fe8068680 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0fe80cc560 tx=0x7f0fd4009250 comp rx=0 tx=0).stop 2023-10-06T01:40:52.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.055+0000 7f0fedf60700 1 -- 172.21.15.71:0/3734846768 shutdown_connections 2023-10-06T01:40:52.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.055+0000 7f0fedf60700 1 --2- 172.21.15.71:0/3734846768 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fe806f950 0x7f0fe8068bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:52.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.055+0000 7f0fedf60700 1 --2- 172.21.15.71:0/3734846768 >> v2:172.21.15.72:3300/0 conn(0x7f0fe8159280 0x7f0fe806f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:52.060 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.055+0000 7f0fedf60700 1 --2- 172.21.15.71:0/3734846768 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0fe8159650 0x7f0fe8068680 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:52.060 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.055+0000 7f0fedf60700 1 -- 172.21.15.71:0/3734846768 >> 172.21.15.71:0/3734846768 conn(0x7f0fe80c9070 msgr2=0x7f0fe80c9470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:52.060 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.055+0000 7f0fedf60700 1 -- 172.21.15.71:0/3734846768 shutdown_connections 2023-10-06T01:40:52.060 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.055+0000 7f0fedf60700 1 -- 172.21.15.71:0/3734846768 wait complete. 2023-10-06T01:40:52.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.056+0000 7f0fedf60700 1 Processor -- start 2023-10-06T01:40:52.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.057+0000 7f0fedf60700 1 -- start start 2023-10-06T01:40:52.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.057+0000 7f0fedf60700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fe806f950 0x7f0fe80c4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:52.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.057+0000 7f0fedf60700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fe8159280 0x7f0fe80c36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:52.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.057+0000 7f0fedf60700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0fe8169b40 0x7f0fe815b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:52.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.057+0000 7f0fedf60700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe80c48c0 con 0x7f0fe8169b40 2023-10-06T01:40:52.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.057+0000 7f0fedf60700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe80c3cb0 con 0x7f0fe8159280 2023-10-06T01:40:52.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.057+0000 7f0fedf60700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe80c3f90 con 0x7f0fe806f950 2023-10-06T01:40:52.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.057+0000 7f0fed75f700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0fe8169b40 0x7f0fe815b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:52.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.057+0000 7f0fed75f700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0fe8169b40 0x7f0fe815b500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52442/0 (socket says 172.21.15.71:52442) 2023-10-06T01:40:52.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.057+0000 7f0fed75f700 1 -- 172.21.15.71:0/2468830283 learned_addr learned my addr 172.21.15.71:0/2468830283 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:52.073 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.057+0000 7f0fecf5e700 1 --2- 172.21.15.71:0/2468830283 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fe806f950 0x7f0fe80c4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:52.073 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.058+0000 7f0fe7fff700 1 --2- 172.21.15.71:0/2468830283 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fe8159280 0x7f0fe80c36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:52.073 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.058+0000 7f0fed75f700 1 -- 172.21.15.71:0/2468830283 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fe806f950 msgr2=0x7f0fe80c4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:52.073 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.058+0000 7f0fed75f700 1 --2- 172.21.15.71:0/2468830283 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fe806f950 0x7f0fe80c4d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:52.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.058+0000 7f0fed75f700 1 -- 172.21.15.71:0/2468830283 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fe8159280 msgr2=0x7f0fe80c36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:52.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.058+0000 7f0fed75f700 1 --2- 172.21.15.71:0/2468830283 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fe8159280 0x7f0fe80c36b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:52.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.058+0000 7f0fed75f700 1 -- 172.21.15.71:0/2468830283 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fd40094f0 con 0x7f0fe8169b40 2023-10-06T01:40:52.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.058+0000 7f0fed75f700 1 --2- 172.21.15.71:0/2468830283 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0fe8169b40 0x7f0fe815b500 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0fe0007f20 tx=0x7f0fe00098a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:52.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.058+0000 7f0fe4ff9700 1 -- 172.21.15.71:0/2468830283 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe000eb90 con 0x7f0fe8169b40 2023-10-06T01:40:52.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.058+0000 7f0fe4ff9700 1 -- 172.21.15.71:0/2468830283 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fe000ed10 con 0x7f0fe8169b40 2023-10-06T01:40:52.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.058+0000 7f0fe4ff9700 1 -- 172.21.15.71:0/2468830283 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe0014670 con 0x7f0fe8169b40 2023-10-06T01:40:52.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.058+0000 7f0fedf60700 1 -- 172.21.15.71:0/2468830283 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fe80c4270 con 0x7f0fe8169b40 2023-10-06T01:40:52.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.058+0000 7f0fedf60700 1 -- 172.21.15.71:0/2468830283 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fe815ba40 con 0x7f0fe8169b40 2023-10-06T01:40:52.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.059+0000 7f0fe4ff9700 1 -- 172.21.15.71:0/2468830283 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0fe0014a60 con 0x7f0fe8169b40 2023-10-06T01:40:52.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.060+0000 7f0fe4ff9700 1 --2- 172.21.15.71:0/2468830283 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f0fcc066f30 0x7f0fcc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:52.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.060+0000 7f0fe4ff9700 1 -- 172.21.15.71:0/2468830283 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f0fe0084f30 con 0x7f0fe8169b40 2023-10-06T01:40:52.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.060+0000 7f0fecf5e700 1 --2- 172.21.15.71:0/2468830283 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f0fcc066f30 0x7f0fcc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:52.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.060+0000 7f0fecf5e700 1 --2- 172.21.15.71:0/2468830283 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f0fcc066f30 0x7f0fcc0693e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0fdc00adc0 tx=0x7f0fdc006f90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:52.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.062+0000 7f0ff84bab80 1 Processor -- start 2023-10-06T01:40:52.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.062+0000 7f0ff84bab80 1 -- start start 2023-10-06T01:40:52.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.062+0000 7f0ff84bab80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d6625a6e50 0x55d662581cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:52.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.062+0000 7f0ff84bab80 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55d6625872c0 0x55d662582200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:52.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.062+0000 7f0ff84bab80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d662588a10 0x55d662582740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:52.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.062+0000 7f0ff84bab80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6624dca70 con 0x55d662588a10 2023-10-06T01:40:52.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.062+0000 7f0ff84bab80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6624da270 con 0x55d6625a6e50 2023-10-06T01:40:52.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.062+0000 7f0ff84bab80 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d6624d6060 con 0x55d6625872c0 2023-10-06T01:40:52.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.062+0000 7f0fed75f700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d662588a10 0x55d662582740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:52.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.063+0000 7f0fed75f700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d662588a10 0x55d662582740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52458/0 (socket says 172.21.15.71:52458) 2023-10-06T01:40:52.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.063+0000 7f0fed75f700 1 -- 172.21.15.71:0/56527959 learned_addr learned my addr 172.21.15.71:0/56527959 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:52.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.063+0000 7f0fecf5e700 1 --2- 172.21.15.71:0/56527959 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d6625a6e50 0x55d662581cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:52.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.063+0000 7f0fe7fff700 1 --2- 172.21.15.71:0/56527959 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55d6625872c0 0x55d662582200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:52.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.063+0000 7f0fed75f700 1 -- 172.21.15.71:0/56527959 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55d6625872c0 msgr2=0x55d662582200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:52.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.063+0000 7f0fed75f700 1 --2- 172.21.15.71:0/56527959 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55d6625872c0 0x55d662582200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:52.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.063+0000 7f0fed75f700 1 -- 172.21.15.71:0/56527959 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d6625a6e50 msgr2=0x55d662581cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:52.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.063+0000 7f0fed75f700 1 --2- 172.21.15.71:0/56527959 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d6625a6e50 0x55d662581cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:52.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.063+0000 7f0fed75f700 1 -- 172.21.15.71:0/56527959 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d662370270 con 0x55d662588a10 2023-10-06T01:40:52.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.063+0000 7f0fecf5e700 1 --2- 172.21.15.71:0/56527959 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d6625a6e50 0x55d662581cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:40:52.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.063+0000 7f0fe7fff700 1 --2- 172.21.15.71:0/56527959 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55d6625872c0 0x55d662582200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:40:52.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.063+0000 7f0fed75f700 1 --2- 172.21.15.71:0/56527959 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d662588a10 0x55d662582740 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0fe000c040 tx=0x7f0fe0082f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f74b419afe56d60 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:52.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.063+0000 7f0fd1ffb700 1 -- 172.21.15.71:0/56527959 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe0051d50 con 0x55d662588a10 2023-10-06T01:40:52.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.063+0000 7f0fd1ffb700 1 -- 172.21.15.71:0/56527959 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fe0055a10 con 0x55d662588a10 2023-10-06T01:40:52.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.063+0000 7f0fd1ffb700 1 -- 172.21.15.71:0/56527959 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe0058c60 con 0x55d662588a10 2023-10-06T01:40:52.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.064+0000 7f0ff84bab80 1 -- 172.21.15.71:0/56527959 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d662588a10 msgr2=0x55d662582740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:52.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.064+0000 7f0ff84bab80 1 --2- 172.21.15.71:0/56527959 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d662588a10 0x55d662582740 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0fe000c040 tx=0x7f0fe0082f60 comp rx=0 tx=0).stop 2023-10-06T01:40:52.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.064+0000 7f0ff84bab80 1 -- 172.21.15.71:0/56527959 shutdown_connections 2023-10-06T01:40:52.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.064+0000 7f0ff84bab80 1 --2- 172.21.15.71:0/56527959 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d662588a10 0x55d662582740 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:52.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.064+0000 7f0ff84bab80 1 --2- 172.21.15.71:0/56527959 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d6625a6e50 0x55d662581cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:52.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.064+0000 7f0ff84bab80 1 --2- 172.21.15.71:0/56527959 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55d6625872c0 0x55d662582200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:52.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.064+0000 7f0ff84bab80 1 -- 172.21.15.71:0/56527959 >> 172.21.15.71:0/56527959 conn(0x55d662586e80 msgr2=0x55d6625876b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:52.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.064+0000 7f0ff84bab80 1 -- 172.21.15.71:0/56527959 shutdown_connections 2023-10-06T01:40:52.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.064+0000 7f0ff84bab80 1 -- 172.21.15.71:0/56527959 wait complete. 2023-10-06T01:40:52.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.064+0000 7f0ff84bab80 1 -- start start 2023-10-06T01:40:52.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.064+0000 7f0ff84bab80 1 Processor -- start 2023-10-06T01:40:52.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.065+0000 7f0ff84bab80 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55d6625872c0 0x55d6625ae9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:52.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.065+0000 7f0ff84bab80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d662588a10 0x55d6625cd550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:52.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.065+0000 7f0ff84bab80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d6625a6e50 0x55d6625cef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:52.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.065+0000 7f0ff84bab80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d662481890 con 0x55d6625a6e50 2023-10-06T01:40:52.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.065+0000 7f0ff84bab80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d66249cea0 con 0x55d662588a10 2023-10-06T01:40:52.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.065+0000 7f0ff84bab80 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d662358e30 con 0x55d6625872c0 2023-10-06T01:40:52.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.065+0000 7f0ff84bab80 10 client.0 _ll_register_callbacks cb 0x55d662549020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T01:40:52.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.065+0000 7f0fed75f700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d6625a6e50 0x55d6625cef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:52.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.065+0000 7f0fed75f700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d6625a6e50 0x55d6625cef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52474/0 (socket says 172.21.15.71:52474) 2023-10-06T01:40:52.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.065+0000 7f0fed75f700 1 -- 172.21.15.71:0/43403086 learned_addr learned my addr 172.21.15.71:0/43403086 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:52.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.065+0000 7f0fecf5e700 1 --2- 172.21.15.71:0/43403086 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55d6625872c0 0x55d6625ae9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:52.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.065+0000 7f0fe7fff700 1 --2- 172.21.15.71:0/43403086 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d662588a10 0x55d6625cd550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:52.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.066+0000 7f0fed75f700 1 -- 172.21.15.71:0/43403086 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55d6625872c0 msgr2=0x55d6625ae9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:52.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.066+0000 7f0fed75f700 1 --2- 172.21.15.71:0/43403086 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55d6625872c0 0x55d6625ae9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:52.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.066+0000 7f0fed75f700 1 -- 172.21.15.71:0/43403086 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d662588a10 msgr2=0x55d6625cd550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:52.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.066+0000 7f0fed75f700 1 --2- 172.21.15.71:0/43403086 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d662588a10 0x55d6625cd550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:52.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.066+0000 7f0fed75f700 1 -- 172.21.15.71:0/43403086 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fe815ba40 con 0x55d6625a6e50 2023-10-06T01:40:52.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.066+0000 7f0fed75f700 1 --2- 172.21.15.71:0/43403086 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d6625a6e50 0x55d6625cef00 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0fe00830e0 tx=0x7f0fe006d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8893392ad103e09 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:52.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.066+0000 7f0fc6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2023-10-06T01:40:52.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.066+0000 7f0fc6ffd700 1 -- 172.21.15.71:0/43403086 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe0054f00 con 0x55d6625a6e50 2023-10-06T01:40:52.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.066+0000 7f0fc6ffd700 1 -- 172.21.15.71:0/43403086 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f0fe0055060 con 0x55d6625a6e50 2023-10-06T01:40:52.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.066+0000 7f0ff84bab80 1 -- 172.21.15.71:0/43403086 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d66257a940 con 0x55d6625a6e50 2023-10-06T01:40:52.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.066+0000 7f0fc6ffd700 1 -- 172.21.15.71:0/43403086 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0fe005c730 con 0x55d6625a6e50 2023-10-06T01:40:52.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.066+0000 7f0ff84bab80 10 client.4782 fetch_fsmap learned FSMap version 9 2023-10-06T01:40:52.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.066+0000 7f0ff84bab80 1 -- 172.21.15.71:0/43403086 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x55d662312fe0 con 0x55d6625a6e50 2023-10-06T01:40:52.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.066+0000 7f0fc6ffd700 1 -- 172.21.15.71:0/43403086 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d66257a940 con 0x55d6625a6e50 2023-10-06T01:40:52.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.066+0000 7f0fc6ffd700 1 -- 172.21.15.71:0/43403086 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 9) v1 ==== 3108+0+0 (secure 0 0 0) 0x7f0fe0012b90 con 0x55d6625a6e50 2023-10-06T01:40:52.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.066+0000 7f0ff84bab80 10 client.4782 fetch_fsmap finished waiting for FSMap version 9 2023-10-06T01:40:52.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.066+0000 7f0ff84bab80 10 client.4782 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-06T01:40:52.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.066+0000 7f0ff84bab80 20 client.4782 populate_metadata read hostname 'smithi071' 2023-10-06T01:40:52.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.066+0000 7f0ff84bab80 1 --2- 172.21.15.71:0/43403086 >> [v2:172.21.15.72:6833/2361644634,v1:172.21.15.72:6834/2361644634] conn(0x55d6625b42c0 0x55d6625b4690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:52.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.066+0000 7f0ff84bab80 4 client.4782 mds_command: new command op to 4315 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T01:40:52.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.066+0000 7f0ff84bab80 1 -- 172.21.15.71:0/43403086 --> [v2:172.21.15.72:6833/2361644634,v1:172.21.15.72:6834/2361644634] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d662557870 con 0x55d6625b42c0 2023-10-06T01:40:52.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.067+0000 7f0fecf5e700 1 --2- 172.21.15.71:0/43403086 >> [v2:172.21.15.72:6833/2361644634,v1:172.21.15.72:6834/2361644634] conn(0x55d6625b42c0 0x55d6625b4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:52.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.067+0000 7f0fecf5e700 1 --2- 172.21.15.71:0/43403086 >> [v2:172.21.15.72:6833/2361644634,v1:172.21.15.72:6834/2361644634] conn(0x55d6625b42c0 0x55d6625b4690 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d0c44a64cad296d4 server_cookie=d29f0bedc517a555 in_seq=0 out_seq=0 2023-10-06T01:40:52.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.067+0000 7f0fc6ffd700 10 client.4782 ms_handle_connect on v2:172.21.15.72:6833/2361644634 2023-10-06T01:40:52.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.067+0000 7f0fc6ffd700 1 -- 172.21.15.71:0/43403086 <== mds.0 v2:172.21.15.72:6833/2361644634 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55d662557870 con 0x55d6625b42c0 2023-10-06T01:40:52.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.067+0000 7f0fc6ffd700 10 client.4782 handle_command_reply: tid=0 2023-10-06T01:40:52.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.068+0000 7f0ff84bab80 1 client.4782 shutdown 2023-10-06T01:40:52.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.068+0000 7f0ff84bab80 1 -- 172.21.15.71:0/43403086 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d6625a6e50 msgr2=0x55d6625cef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:52.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.068+0000 7f0ff84bab80 1 --2- 172.21.15.71:0/43403086 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d6625a6e50 0x55d6625cef00 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0fe00830e0 tx=0x7f0fe006d000 comp rx=0 tx=0).stop 2023-10-06T01:40:52.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.068+0000 7f0ff84bab80 1 -- 172.21.15.71:0/43403086 shutdown_connections 2023-10-06T01:40:52.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.068+0000 7f0ff84bab80 1 --2- 172.21.15.71:0/43403086 >> [v2:172.21.15.72:6833/2361644634,v1:172.21.15.72:6834/2361644634] conn(0x55d6625b42c0 0x55d6625b4690 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:52.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.068+0000 7f0ff84bab80 1 --2- 172.21.15.71:0/43403086 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d6625a6e50 0x55d6625cef00 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:52.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.068+0000 7f0ff84bab80 1 --2- 172.21.15.71:0/43403086 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55d6625872c0 0x55d6625ae9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:52.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.068+0000 7f0fc6ffd700 0 client.4782 ms_handle_reset on v2:172.21.15.72:6833/2361644634 2023-10-06T01:40:52.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.068+0000 7f0ff84bab80 1 --2- 172.21.15.71:0/43403086 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d662588a10 0x55d6625cd550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:52.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.068+0000 7f0ff84bab80 1 -- 172.21.15.71:0/43403086 >> 172.21.15.71:0/43403086 conn(0x55d662586e80 msgr2=0x55d66257c400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:52.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.068+0000 7f0ff84bab80 1 -- 172.21.15.71:0/43403086 shutdown_connections 2023-10-06T01:40:52.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.068+0000 7f0ff84bab80 1 -- 172.21.15.71:0/43403086 wait complete. 2023-10-06T01:40:52.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.068+0000 7f0ff84bab80 20 client.4782 trim_cache size 0 max 16384 2023-10-06T01:40:52.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.084+0000 7f0ff84bab80 1 Processor -- start 2023-10-06T01:40:52.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.084+0000 7f0ff84bab80 1 -- start start 2023-10-06T01:40:52.087 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.085+0000 7f0ff84bab80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d6625872c0 0x55d662585c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:52.087 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.085+0000 7f0ff84bab80 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55d662588a10 0x55d662586160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:52.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.085+0000 7f0ff84bab80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d6625a6e50 0x55d6625ce860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:52.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.085+0000 7f0ff84bab80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6625ee9f0 con 0x55d6625a6e50 2023-10-06T01:40:52.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.085+0000 7f0ff84bab80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d662583960 con 0x55d6625872c0 2023-10-06T01:40:52.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.085+0000 7f0ff84bab80 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d66255e1e0 con 0x55d662588a10 2023-10-06T01:40:52.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.085+0000 7f0fed75f700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d6625a6e50 0x55d6625ce860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:52.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.085+0000 7f0fed75f700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d6625a6e50 0x55d6625ce860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52486/0 (socket says 172.21.15.71:52486) 2023-10-06T01:40:52.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.085+0000 7f0fed75f700 1 -- 172.21.15.71:0/2583023881 learned_addr learned my addr 172.21.15.71:0/2583023881 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:52.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.085+0000 7f0fed75f700 1 -- 172.21.15.71:0/2583023881 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55d662588a10 msgr2=0x55d662586160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:52.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.085+0000 7f0fed75f700 1 --2- 172.21.15.71:0/2583023881 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55d662588a10 0x55d662586160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:52.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.085+0000 7f0fecf5e700 1 --2- 172.21.15.71:0/2583023881 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d6625872c0 0x55d662585c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:52.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.085+0000 7f0fed75f700 1 -- 172.21.15.71:0/2583023881 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d6625872c0 msgr2=0x55d662585c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:52.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.085+0000 7f0fed75f700 1 --2- 172.21.15.71:0/2583023881 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d6625872c0 0x55d662585c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:52.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.085+0000 7f0fed75f700 1 -- 172.21.15.71:0/2583023881 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d6624a4780 con 0x55d6625a6e50 2023-10-06T01:40:52.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.086+0000 7f0fed75f700 1 --2- 172.21.15.71:0/2583023881 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d6625a6e50 0x55d6625ce860 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0fe0007ef0 tx=0x7f0fe007e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f49511cf7b38217f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:52.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.086+0000 7f0fd27fc700 1 -- 172.21.15.71:0/2583023881 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe0058c60 con 0x55d6625a6e50 2023-10-06T01:40:52.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.086+0000 7f0fd27fc700 1 -- 172.21.15.71:0/2583023881 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fe0083110 con 0x55d6625a6e50 2023-10-06T01:40:52.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.086+0000 7f0fd27fc700 1 -- 172.21.15.71:0/2583023881 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe0012b90 con 0x55d6625a6e50 2023-10-06T01:40:52.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.086+0000 7f0ff84bab80 1 -- 172.21.15.71:0/2583023881 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d6625a6e50 msgr2=0x55d6625ce860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:52.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.086+0000 7f0ff84bab80 1 --2- 172.21.15.71:0/2583023881 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d6625a6e50 0x55d6625ce860 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0fe0007ef0 tx=0x7f0fe007e000 comp rx=0 tx=0).stop 2023-10-06T01:40:52.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.086+0000 7f0ff84bab80 1 -- 172.21.15.71:0/2583023881 shutdown_connections 2023-10-06T01:40:52.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.086+0000 7f0ff84bab80 1 --2- 172.21.15.71:0/2583023881 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d6625a6e50 0x55d6625ce860 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:52.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.086+0000 7f0ff84bab80 1 --2- 172.21.15.71:0/2583023881 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d6625872c0 0x55d662585c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:52.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.086+0000 7f0ff84bab80 1 --2- 172.21.15.71:0/2583023881 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55d662588a10 0x55d662586160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:52.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.086+0000 7f0ff84bab80 1 -- 172.21.15.71:0/2583023881 >> 172.21.15.71:0/2583023881 conn(0x55d662586e80 msgr2=0x55d662587690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:52.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.086+0000 7f0ff84bab80 1 -- 172.21.15.71:0/2583023881 shutdown_connections 2023-10-06T01:40:52.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.086+0000 7f0ff84bab80 1 -- 172.21.15.71:0/2583023881 wait complete. 2023-10-06T01:40:52.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.087+0000 7f0ff84bab80 1 -- start start 2023-10-06T01:40:52.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.087+0000 7f0ff84bab80 1 Processor -- start 2023-10-06T01:40:52.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.088+0000 7f0ff84bab80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d6625872c0 0x55d662631070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:52.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.088+0000 7f0ff84bab80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d662588a10 0x55d6625aae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:52.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.088+0000 7f0ff84bab80 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55d6625a6e50 0x55d6625e5980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:52.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.088+0000 7f0ff84bab80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6625ab890 con 0x55d662588a10 2023-10-06T01:40:52.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.088+0000 7f0ff84bab80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6625d9910 con 0x55d6625872c0 2023-10-06T01:40:52.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.088+0000 7f0ff84bab80 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d6625ab3c0 con 0x55d6625a6e50 2023-10-06T01:40:52.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.088+0000 7f0ff84bab80 10 client.0 _ll_register_callbacks cb 0x55d662549020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T01:40:52.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.088+0000 7f0fe7fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d662588a10 0x55d6625aae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:52.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.088+0000 7f0fe7fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d662588a10 0x55d6625aae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52488/0 (socket says 172.21.15.71:52488) 2023-10-06T01:40:52.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.088+0000 7f0fe7fff700 1 -- 172.21.15.71:0/396200563 learned_addr learned my addr 172.21.15.71:0/396200563 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:52.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.088+0000 7f0fecf5e700 1 --2- 172.21.15.71:0/396200563 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d6625872c0 0x55d662631070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:52.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.088+0000 7f0fed75f700 1 --2- 172.21.15.71:0/396200563 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55d6625a6e50 0x55d6625e5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:52.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.088+0000 7f0fe7fff700 1 -- 172.21.15.71:0/396200563 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55d6625a6e50 msgr2=0x55d6625e5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:52.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.088+0000 7f0fe7fff700 1 --2- 172.21.15.71:0/396200563 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55d6625a6e50 0x55d6625e5980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:52.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.088+0000 7f0fe7fff700 1 -- 172.21.15.71:0/396200563 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d6625872c0 msgr2=0x55d662631070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:52.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.088+0000 7f0fe7fff700 1 --2- 172.21.15.71:0/396200563 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d6625872c0 0x55d662631070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:52.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.088+0000 7f0fe7fff700 1 -- 172.21.15.71:0/396200563 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d662312fe0 con 0x55d662588a10 2023-10-06T01:40:52.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.088+0000 7f0fe7fff700 1 --2- 172.21.15.71:0/396200563 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d662588a10 0x55d6625aae80 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0fd4006fa0 tx=0x7f0fd4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abc1e5fddec346a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:52.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.088+0000 7f0fc6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2023-10-06T01:40:52.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.088+0000 7f0fc6ffd700 1 -- 172.21.15.71:0/396200563 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fd4021050 con 0x55d662588a10 2023-10-06T01:40:52.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.088+0000 7f0ff84bab80 1 -- 172.21.15.71:0/396200563 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0fe0055a10 con 0x55d662588a10 2023-10-06T01:40:52.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.088+0000 7f0fc6ffd700 1 -- 172.21.15.71:0/396200563 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f0fd4011630 con 0x55d662588a10 2023-10-06T01:40:52.096 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.089+0000 7f0fc6ffd700 1 -- 172.21.15.71:0/396200563 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0fd4011a00 con 0x55d662588a10 2023-10-06T01:40:52.096 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.089+0000 7f0ff84bab80 10 client.4788 fetch_fsmap learned FSMap version 9 2023-10-06T01:40:52.096 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.089+0000 7f0ff84bab80 1 -- 172.21.15.71:0/396200563 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x55d66248b470 con 0x55d662588a10 2023-10-06T01:40:52.096 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.089+0000 7f0fc6ffd700 1 -- 172.21.15.71:0/396200563 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fe0055a10 con 0x55d662588a10 2023-10-06T01:40:52.096 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.089+0000 7f0fc6ffd700 1 -- 172.21.15.71:0/396200563 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 9) v1 ==== 3108+0+0 (secure 0 0 0) 0x7f0fd4011b60 con 0x55d662588a10 2023-10-06T01:40:52.096 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.089+0000 7f0ff84bab80 10 client.4788 fetch_fsmap finished waiting for FSMap version 9 2023-10-06T01:40:52.096 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.089+0000 7f0ff84bab80 10 client.4788 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-06T01:40:52.096 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.089+0000 7f0ff84bab80 20 client.4788 populate_metadata read hostname 'smithi071' 2023-10-06T01:40:52.096 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.089+0000 7f0ff84bab80 1 --2- 172.21.15.71:0/396200563 >> [v2:172.21.15.72:6833/2361644634,v1:172.21.15.72:6834/2361644634] conn(0x55d662582eb0 0x55d6625b1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:52.096 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.089+0000 7f0ff84bab80 4 client.4788 mds_command: new command op to 4315 tid=0[{"prefix": "status"}] 2023-10-06T01:40:52.096 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.089+0000 7f0ff84bab80 1 -- 172.21.15.71:0/396200563 --> [v2:172.21.15.72:6833/2361644634,v1:172.21.15.72:6834/2361644634] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55d662478e00 con 0x55d662582eb0 2023-10-06T01:40:52.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.089+0000 7f0fecf5e700 1 --2- 172.21.15.71:0/396200563 >> [v2:172.21.15.72:6833/2361644634,v1:172.21.15.72:6834/2361644634] conn(0x55d662582eb0 0x55d6625b1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:52.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.089+0000 7f0fc6ffd700 10 client.4788 ms_handle_connect on v2:172.21.15.72:6833/2361644634 2023-10-06T01:40:52.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.089+0000 7f0fecf5e700 1 --2- 172.21.15.71:0/396200563 >> [v2:172.21.15.72:6833/2361644634,v1:172.21.15.72:6834/2361644634] conn(0x55d662582eb0 0x55d6625b1b90 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c4ea8518ede99eb4 server_cookie=6eb2e9bd0d55016d in_seq=0 out_seq=0 2023-10-06T01:40:52.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.090+0000 7f0fc6ffd700 1 -- 172.21.15.71:0/396200563 <== mds.0 v2:172.21.15.72:6833/2361644634 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+318 (crc 0 0 0) 0x55d662478e00 con 0x55d662582eb0 2023-10-06T01:40:52.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.090+0000 7f0fc6ffd700 10 client.4788 handle_command_reply: tid=0 2023-10-06T01:40:52.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.090+0000 7f0ff84bab80 1 client.4788 shutdown 2023-10-06T01:40:52.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.090+0000 7f0ff84bab80 1 -- 172.21.15.71:0/396200563 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d662588a10 msgr2=0x55d6625aae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:52.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.090+0000 7f0ff84bab80 1 --2- 172.21.15.71:0/396200563 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d662588a10 0x55d6625aae80 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0fd4006fa0 tx=0x7f0fd4017000 comp rx=0 tx=0).stop 2023-10-06T01:40:52.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.090+0000 7f0ff84bab80 1 -- 172.21.15.71:0/396200563 shutdown_connections 2023-10-06T01:40:52.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.090+0000 7f0ff84bab80 1 --2- 172.21.15.71:0/396200563 >> [v2:172.21.15.72:6833/2361644634,v1:172.21.15.72:6834/2361644634] conn(0x55d662582eb0 0x55d6625b1b90 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:52.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.090+0000 7f0ff84bab80 1 --2- 172.21.15.71:0/396200563 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55d6625a6e50 0x55d6625e5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:52.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.090+0000 7f0ff84bab80 1 --2- 172.21.15.71:0/396200563 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d6625872c0 0x55d662631070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:52.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.090+0000 7f0fc6ffd700 0 client.4788 ms_handle_reset on v2:172.21.15.72:6833/2361644634 2023-10-06T01:40:52.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.090+0000 7f0ff84bab80 1 --2- 172.21.15.71:0/396200563 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d662588a10 0x55d6625aae80 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:52.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.090+0000 7f0ff84bab80 1 -- 172.21.15.71:0/396200563 >> 172.21.15.71:0/396200563 conn(0x55d662586e80 msgr2=0x55d6625b4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:52.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.090+0000 7f0ff84bab80 1 -- 172.21.15.71:0/396200563 shutdown_connections 2023-10-06T01:40:52.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.090+0000 7f0ff84bab80 1 -- 172.21.15.71:0/396200563 wait complete. 2023-10-06T01:40:52.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.090+0000 7f0ff84bab80 20 client.4788 trim_cache size 0 max 16384 2023-10-06T01:40:52.098 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2023-10-06T01:40:52.098 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster_fsid": "1fbf1bd2-f9b4-4599-bea2-f4aa920e9a56", 2023-10-06T01:40:52.099 INFO:teuthology.orchestra.run.smithi071.stdout: "whoami": 0, 2023-10-06T01:40:52.099 INFO:teuthology.orchestra.run.smithi071.stdout: "id": 4315, 2023-10-06T01:40:52.099 INFO:teuthology.orchestra.run.smithi071.stdout: "want_state": "up:active", 2023-10-06T01:40:52.099 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "up:active", 2023-10-06T01:40:52.099 INFO:teuthology.orchestra.run.smithi071.stdout: "fs_name": "cephfs", 2023-10-06T01:40:52.099 INFO:teuthology.orchestra.run.smithi071.stdout: "rank_uptime": 30.319118263, 2023-10-06T01:40:52.099 INFO:teuthology.orchestra.run.smithi071.stdout: "mdsmap_epoch": 9, 2023-10-06T01:40:52.099 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_epoch": 27, 2023-10-06T01:40:52.099 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_epoch_barrier": 27, 2023-10-06T01:40:52.099 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 35.336829064 2023-10-06T01:40:52.099 INFO:teuthology.orchestra.run.smithi071.stdout:} 2023-10-06T01:40:52.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.090+0000 7f0fedf60700 1 -- 172.21.15.71:0/2468830283 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f0fcc066f30 msgr2=0x7f0fcc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:52.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.090+0000 7f0fedf60700 1 --2- 172.21.15.71:0/2468830283 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f0fcc066f30 0x7f0fcc0693e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0fdc00adc0 tx=0x7f0fdc006f90 comp rx=0 tx=0).stop 2023-10-06T01:40:52.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.090+0000 7f0fedf60700 1 -- 172.21.15.71:0/2468830283 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0fe8169b40 msgr2=0x7f0fe815b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:52.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.090+0000 7f0fedf60700 1 --2- 172.21.15.71:0/2468830283 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0fe8169b40 0x7f0fe815b500 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0fe0007f20 tx=0x7f0fe00098a0 comp rx=0 tx=0).stop 2023-10-06T01:40:52.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.090+0000 7f0fedf60700 1 -- 172.21.15.71:0/2468830283 shutdown_connections 2023-10-06T01:40:52.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.090+0000 7f0fedf60700 1 --2- 172.21.15.71:0/2468830283 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0fe8169b40 0x7f0fe815b500 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:52.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.090+0000 7f0fedf60700 1 --2- 172.21.15.71:0/2468830283 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fe806f950 0x7f0fe80c4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:52.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.090+0000 7f0fedf60700 1 --2- 172.21.15.71:0/2468830283 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f0fcc066f30 0x7f0fcc0693e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:52.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.090+0000 7f0fedf60700 1 --2- 172.21.15.71:0/2468830283 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fe8159280 0x7f0fe80c36b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:52.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.091+0000 7f0fedf60700 1 -- 172.21.15.71:0/2468830283 >> 172.21.15.71:0/2468830283 conn(0x7f0fe80c9070 msgr2=0x7f0fe80c1f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:52.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.091+0000 7f0fedf60700 1 -- 172.21.15.71:0/2468830283 shutdown_connections 2023-10-06T01:40:52.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.091+0000 7f0fedf60700 1 -- 172.21.15.71:0/2468830283 wait complete. 2023-10-06T01:40:52.103 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-10-06T01:40:52.115 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-10-06T01:40:52.115 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-10-06T01:40:52.116 INFO:tasks.ceph_fuse:client.0 config is {} 2023-10-06T01:40:52.116 INFO:tasks.ceph_fuse:client.2 config is {} 2023-10-06T01:40:52.116 INFO:tasks.ceph_fuse:client.1 config is {} 2023-10-06T01:40:52.116 INFO:tasks.ceph_fuse:client.3 config is {} 2023-10-06T01:40:52.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:40:52.116 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list 2023-10-06T01:40:52.134 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:40:52.134 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link delete ceph-brx 2023-10-06T01:40:52.206 INFO:teuthology.orchestra.run.smithi072.stderr:Cannot find device "ceph-brx" 2023-10-06T01:40:52.207 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T01:40:52.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:40:52.208 DEBUG:teuthology.orchestra.run.smithi071:> ip netns list 2023-10-06T01:40:52.223 INFO:teuthology.orchestra.run.smithi071.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-10-06T01:40:52.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:40:52.223 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-06T01:40:52.302 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:40:52.302 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link delete ceph-brx 2023-10-06T01:40:52.400 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-10-06T01:40:52.400 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T01:40:52.515 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.514+0000 7f69b8848700 1 Processor -- start 2023-10-06T01:40:52.515 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.514+0000 7f69b8848700 1 -- start start 2023-10-06T01:40:52.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.515+0000 7f69b8848700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f69b415a980 0x7f69b40b2220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:52.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.515+0000 7f69b8848700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f69b40b3a90 0x7f69b40980c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:52.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.515+0000 7f69b8848700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69b4067f00 con 0x7f69b40b0f70 2023-10-06T01:40:52.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.515+0000 7f69b8848700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69b4097c30 con 0x7f69b40b3a90 2023-10-06T01:40:52.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.515+0000 7f69b8848700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69b40af940 con 0x7f69b415a980 2023-10-06T01:40:52.518 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.515+0000 7f69b359e700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f69b40b3a90 0x7f69b40980c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:52.518 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.515+0000 7f69b2d9d700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f69b40b0f70 0x7f69b415a270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:54598/0 (socket says 172.21.15.71:54598) 2023-10-06T01:40:52.518 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.515+0000 7f69b2d9d700 1 -- 172.21.15.71:0/2380879159 learned_addr learned my addr 172.21.15.71:0/2380879159 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:40:52.518 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.515+0000 7f69aa59c700 1 --2- 172.21.15.71:0/2380879159 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f69b415a980 0x7f69b40b2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:52.518 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.515+0000 7f69b359e700 1 -- 172.21.15.71:0/2380879159 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f69b415a980 msgr2=0x7f69b40b2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:52.518 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.515+0000 7f69b359e700 1 --2- 172.21.15.71:0/2380879159 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f69b415a980 0x7f69b40b2220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:52.518 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.515+0000 7f69b359e700 1 -- 172.21.15.71:0/2380879159 >> v1:172.21.15.71:6789/0 conn(0x7f69b40b0f70 legacy=0x7f69b415a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:52.518 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.515+0000 7f69b359e700 1 -- 172.21.15.71:0/2380879159 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69b40afc00 con 0x7f69b40b3a90 2023-10-06T01:40:52.518 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.515+0000 7f69b259c700 1 -- 172.21.15.71:0/2380879159 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2231495202 0 0) 0x7f69b4067f00 con 0x7f69b40b0f70 2023-10-06T01:40:52.518 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.515+0000 7f69b359e700 1 --2- 172.21.15.71:0/2380879159 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f69b40b3a90 0x7f69b40980c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f69ac009e60 tx=0x7f69ac009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ad2d76e4531459d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:52.518 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.515+0000 7f69b259c700 1 -- 172.21.15.71:0/2380879159 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69ac00e070 con 0x7f69b40b3a90 2023-10-06T01:40:52.519 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.516+0000 7f69b259c700 1 -- 172.21.15.71:0/2380879159 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69ac00bcc0 con 0x7f69b40b3a90 2023-10-06T01:40:52.519 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.516+0000 7f69b259c700 1 -- 172.21.15.71:0/2380879159 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69ac012680 con 0x7f69b40b3a90 2023-10-06T01:40:52.519 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.516+0000 7f69b8848700 1 -- 172.21.15.71:0/2380879159 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f69b40b3a90 msgr2=0x7f69b40980c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:52.519 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.516+0000 7f69b8848700 1 --2- 172.21.15.71:0/2380879159 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f69b40b3a90 0x7f69b40980c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f69ac009e60 tx=0x7f69ac009780 comp rx=0 tx=0).stop 2023-10-06T01:40:52.519 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.516+0000 7f69b8848700 1 -- 172.21.15.71:0/2380879159 shutdown_connections 2023-10-06T01:40:52.519 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.516+0000 7f69b8848700 1 --2- 172.21.15.71:0/2380879159 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f69b40b3a90 0x7f69b40980c0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:52.519 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.516+0000 7f69b8848700 1 --2- 172.21.15.71:0/2380879159 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f69b415a980 0x7f69b40b2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:52.519 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.516+0000 7f69b8848700 1 -- 172.21.15.71:0/2380879159 >> 172.21.15.71:0/2380879159 conn(0x7f69b4067910 msgr2=0x7f69b40cdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:52.519 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.516+0000 7f69b8848700 1 -- 172.21.15.71:0/2380879159 shutdown_connections 2023-10-06T01:40:52.519 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.516+0000 7f69b8848700 1 -- 172.21.15.71:0/2380879159 wait complete. 2023-10-06T01:40:52.522 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.517+0000 7f69b8848700 1 Processor -- start 2023-10-06T01:40:52.522 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.517+0000 7f69b8848700 1 -- start start 2023-10-06T01:40:52.522 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.518+0000 7f69b8848700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f69b40b0f70 0x7f69b40c7b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:52.522 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.518+0000 7f69b8848700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69b40b3a90 0x7f69b414dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:52.522 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.518+0000 7f69b8848700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f69b415a980 0x7f69b416d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:52.522 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.518+0000 7f69b8848700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69b406a5c0 con 0x7f69b415a980 2023-10-06T01:40:52.522 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.518+0000 7f69b8848700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69b416dab0 con 0x7f69b40b3a90 2023-10-06T01:40:52.522 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.518+0000 7f69b8848700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69b4069cb0 con 0x7f69b40b0f70 2023-10-06T01:40:52.523 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.518+0000 7f69b359e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f69b415a980 0x7f69b416d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:52.523 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.518+0000 7f69b359e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f69b415a980 0x7f69b416d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52510/0 (socket says 172.21.15.71:52510) 2023-10-06T01:40:52.523 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.518+0000 7f69b359e700 1 -- 172.21.15.71:0/1095222701 learned_addr learned my addr 172.21.15.71:0/1095222701 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:52.523 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.518+0000 7f69b2d9d700 1 --2- 172.21.15.71:0/1095222701 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f69b40b0f70 0x7f69b40c7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:52.523 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.518+0000 7f69aa59c700 1 --2- 172.21.15.71:0/1095222701 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69b40b3a90 0x7f69b414dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:52.523 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.518+0000 7f69b359e700 1 -- 172.21.15.71:0/1095222701 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f69b40b0f70 msgr2=0x7f69b40c7b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:52.523 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.518+0000 7f69b359e700 1 --2- 172.21.15.71:0/1095222701 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f69b40b0f70 0x7f69b40c7b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:52.523 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.518+0000 7f69b359e700 1 -- 172.21.15.71:0/1095222701 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69b40b3a90 msgr2=0x7f69b414dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:52.523 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.518+0000 7f69b359e700 1 --2- 172.21.15.71:0/1095222701 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69b40b3a90 0x7f69b414dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:52.523 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.518+0000 7f69b359e700 1 -- 172.21.15.71:0/1095222701 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69ac009a20 con 0x7f69b415a980 2023-10-06T01:40:52.523 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.518+0000 7f69b2d9d700 1 --2- 172.21.15.71:0/1095222701 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f69b40b0f70 0x7f69b40c7b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:40:52.523 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.518+0000 7f69aa59c700 1 --2- 172.21.15.71:0/1095222701 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69b40b3a90 0x7f69b414dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:40:52.524 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.518+0000 7f69b359e700 1 --2- 172.21.15.71:0/1095222701 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f69b415a980 0x7f69b416d570 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f69ac00b6c0 tx=0x7f69ac019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:52.524 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.519+0000 7f69ab7fe700 1 -- 172.21.15.71:0/1095222701 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69ac012ea0 con 0x7f69b415a980 2023-10-06T01:40:52.524 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.519+0000 7f69ab7fe700 1 -- 172.21.15.71:0/1095222701 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69ac01d630 con 0x7f69b415a980 2023-10-06T01:40:52.524 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.519+0000 7f69b8848700 1 -- 172.21.15.71:0/1095222701 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69b40c8100 con 0x7f69b415a980 2023-10-06T01:40:52.524 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.519+0000 7f69ab7fe700 1 -- 172.21.15.71:0/1095222701 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69ac01d9d0 con 0x7f69b415a980 2023-10-06T01:40:52.524 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.519+0000 7f69b8848700 1 -- 172.21.15.71:0/1095222701 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69b406a250 con 0x7f69b415a980 2023-10-06T01:40:52.524 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.520+0000 7f69b8848700 1 -- 172.21.15.71:0/1095222701 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69b406a770 con 0x7f69b415a980 2023-10-06T01:40:52.524 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.520+0000 7f69ab7fe700 1 -- 172.21.15.71:0/1095222701 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f69ac024070 con 0x7f69b415a980 2023-10-06T01:40:52.524 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.520+0000 7f69ab7fe700 1 --2- 172.21.15.71:0/1095222701 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f6994066f30 0x7f69940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:52.524 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.520+0000 7f69ab7fe700 1 -- 172.21.15.71:0/1095222701 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f69ac087330 con 0x7f69b415a980 2023-10-06T01:40:52.524 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.520+0000 7f69b2d9d700 1 --2- 172.21.15.71:0/1095222701 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f6994066f30 0x7f69940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:52.524 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.521+0000 7f69b2d9d700 1 --2- 172.21.15.71:0/1095222701 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f6994066f30 0x7f69940693e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f69a4001360 tx=0x7f69a4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:52.525 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.525+0000 7f69ab7fe700 1 -- 172.21.15.71:0/1095222701 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f69b406a770 con 0x7f69b415a980 2023-10-06T01:40:52.755 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.754+0000 7f69b8848700 1 -- 172.21.15.71:0/1095222701 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f69b40ad5f0 con 0x7f69b415a980 2023-10-06T01:40:52.755 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.754+0000 7f69ab7fe700 1 -- 172.21.15.71:0/1095222701 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f69ac057be0 con 0x7f69b415a980 2023-10-06T01:40:52.755 INFO:teuthology.orchestra.run.smithi071.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-06T01:40:52.757 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.756+0000 7f69b8848700 1 -- 172.21.15.71:0/1095222701 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f6994066f30 msgr2=0x7f69940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:52.757 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.756+0000 7f69b8848700 1 --2- 172.21.15.71:0/1095222701 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f6994066f30 0x7f69940693e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f69a4001360 tx=0x7f69a4009040 comp rx=0 tx=0).stop 2023-10-06T01:40:52.758 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.756+0000 7f69b8848700 1 -- 172.21.15.71:0/1095222701 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f69b415a980 msgr2=0x7f69b416d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:52.758 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.756+0000 7f69b8848700 1 --2- 172.21.15.71:0/1095222701 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f69b415a980 0x7f69b416d570 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f69ac00b6c0 tx=0x7f69ac019000 comp rx=0 tx=0).stop 2023-10-06T01:40:52.758 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.756+0000 7f69b8848700 1 -- 172.21.15.71:0/1095222701 shutdown_connections 2023-10-06T01:40:52.758 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.756+0000 7f69b8848700 1 --2- 172.21.15.71:0/1095222701 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f69b415a980 0x7f69b416d570 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:52.758 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.757+0000 7f69b8848700 1 --2- 172.21.15.71:0/1095222701 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f69b40b0f70 0x7f69b40c7b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:52.758 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.757+0000 7f69b8848700 1 --2- 172.21.15.71:0/1095222701 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f6994066f30 0x7f69940693e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:52.758 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.757+0000 7f69b8848700 1 --2- 172.21.15.71:0/1095222701 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69b40b3a90 0x7f69b414dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:52.758 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.757+0000 7f69b8848700 1 -- 172.21.15.71:0/1095222701 >> 172.21.15.71:0/1095222701 conn(0x7f69b4067910 msgr2=0x7f69b41596c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:52.758 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.757+0000 7f69b8848700 1 -- 172.21.15.71:0/1095222701 shutdown_connections 2023-10-06T01:40:52.758 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:52.757+0000 7f69b8848700 1 -- 172.21.15.71:0/1095222701 wait complete. 2023-10-06T01:40:52.769 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T01:40:52.769 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T01:40:52.769 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi071.front.sepia.ceph.com 2023-10-06T01:40:52.769 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T01:40:52.769 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T01:40:52.770 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T01:40:52.770 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T01:40:52.770 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T01:40:52.770 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T01:40:52.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:40:52.770 DEBUG:teuthology.orchestra.run.smithi071:> ip addr 2023-10-06T01:40:52.785 INFO:teuthology.orchestra.run.smithi071.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T01:40:52.785 INFO:teuthology.orchestra.run.smithi071.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T01:40:52.785 INFO:teuthology.orchestra.run.smithi071.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T01:40:52.785 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:40:52.785 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 ::1/128 scope host 2023-10-06T01:40:52.785 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:40:52.785 INFO:teuthology.orchestra.run.smithi071.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T01:40:52.786 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:d8:aa:4a brd ff:ff:ff:ff:ff:ff 2023-10-06T01:40:52.786 INFO:teuthology.orchestra.run.smithi071.stdout: altname enp7s0f0 2023-10-06T01:40:52.786 INFO:teuthology.orchestra.run.smithi071.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T01:40:52.786 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:d8:aa:4b brd ff:ff:ff:ff:ff:ff 2023-10-06T01:40:52.786 INFO:teuthology.orchestra.run.smithi071.stdout: altname enp7s0f1 2023-10-06T01:40:52.786 INFO:teuthology.orchestra.run.smithi071.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T01:40:52.786 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:8f:d7:64 brd ff:ff:ff:ff:ff:ff 2023-10-06T01:40:52.786 INFO:teuthology.orchestra.run.smithi071.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T01:40:52.786 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:8f:d7:65 brd ff:ff:ff:ff:ff:ff 2023-10-06T01:40:52.786 INFO:teuthology.orchestra.run.smithi071.stdout: inet 172.21.15.71/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T01:40:52.786 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft 42322sec preferred_lft 42322sec 2023-10-06T01:40:52.787 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::ec4:7aff:fe8f:d765/64 scope link 2023-10-06T01:40:52.787 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:40:52.787 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-06T01:40:52.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:40:52.787 DEBUG:teuthology.orchestra.run.smithi071:> (cd / && exec bash -c ' 2023-10-06T01:40:52.787 DEBUG:teuthology.orchestra.run.smithi071:> set -e 2023-10-06T01:40:52.787 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link add name ceph-brx type bridge 2023-10-06T01:40:52.787 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip addr flush dev ceph-brx 2023-10-06T01:40:52.787 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link set ceph-brx up 2023-10-06T01:40:52.787 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-06T01:40:52.788 DEBUG:teuthology.orchestra.run.smithi071:> ') 2023-10-06T01:40:52.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:40:52.896 DEBUG:teuthology.orchestra.run.smithi071:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T01:40:52.919 INFO:teuthology.orchestra.run.smithi071.stdout:1 2023-10-06T01:40:52.920 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:40:52.921 DEBUG:teuthology.orchestra.run.smithi071:> route 2023-10-06T01:40:52.977 INFO:teuthology.orchestra.run.smithi071.stdout:Kernel IP routing table 2023-10-06T01:40:52.977 INFO:teuthology.orchestra.run.smithi071.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T01:40:52.977 INFO:teuthology.orchestra.run.smithi071.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T01:40:52.977 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T01:40:52.977 INFO:teuthology.orchestra.run.smithi071.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T01:40:52.978 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:40:52.978 DEBUG:teuthology.orchestra.run.smithi071:> (cd / && exec bash -c ' 2023-10-06T01:40:52.978 DEBUG:teuthology.orchestra.run.smithi071:> set -e 2023-10-06T01:40:52.978 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T01:40:52.978 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T01:40:52.978 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T01:40:52.978 DEBUG:teuthology.orchestra.run.smithi071:> ') 2023-10-06T01:40:53.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:40:53.078 DEBUG:teuthology.orchestra.run.smithi071:> ip netns list 2023-10-06T01:40:53.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:40:53.092 DEBUG:teuthology.orchestra.run.smithi071:> ip netns list-id 2023-10-06T01:40:53.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:40:53.147 DEBUG:teuthology.orchestra.run.smithi071:> (cd / && exec bash -c ' 2023-10-06T01:40:53.147 DEBUG:teuthology.orchestra.run.smithi071:> set -e 2023-10-06T01:40:53.147 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T01:40:53.147 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-10-06T01:40:53.147 DEBUG:teuthology.orchestra.run.smithi071:> ') 2023-10-06T01:40:53.235 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-10-06T01:40:53.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:40:53.236 DEBUG:teuthology.orchestra.run.smithi071:> (cd / && exec bash -c ' 2023-10-06T01:40:53.236 DEBUG:teuthology.orchestra.run.smithi071:> set -e 2023-10-06T01:40:53.236 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-10-06T01:40:53.236 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-06T01:40:53.236 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-10-06T01:40:53.236 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-10-06T01:40:53.236 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-10-06T01:40:53.236 DEBUG:teuthology.orchestra.run.smithi071:> ') 2023-10-06T01:40:53.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:40:53.419 DEBUG:teuthology.orchestra.run.smithi071:> (cd / && exec bash -c ' 2023-10-06T01:40:53.419 DEBUG:teuthology.orchestra.run.smithi071:> set -e 2023-10-06T01:40:53.419 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link set brx.0 up 2023-10-06T01:40:53.420 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link set dev brx.0 master ceph-brx 2023-10-06T01:40:53.420 DEBUG:teuthology.orchestra.run.smithi071:> ') 2023-10-06T01:40:53.512 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-06T01:40:53.512 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T01:40:53.512 DEBUG:teuthology.orchestra.run.smithi071:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T01:40:53.526 INFO:teuthology.orchestra.run.smithi071.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T01:40:53.527 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T01:40:53.527 DEBUG:teuthology.orchestra.run.smithi071:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T01:40:53.580 DEBUG:teuthology.orchestra.run.smithi071:> sudo modprobe fuse 2023-10-06T01:40:53.645 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T01:40:53.645 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T01:40:53.709 INFO:teuthology.orchestra.run.smithi071.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T01:40:53.710 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T01:40:53.711 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T01:40:53.711 DEBUG:teuthology.orchestra.run.smithi071:> ls /sys/fs/fuse/connections 2023-10-06T01:40:53.766 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T01:40:53.766 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-06T01:40:53.809 DEBUG:teuthology.orchestra.run.smithi071:> sudo modprobe fuse 2023-10-06T01:40:53.832 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T01:40:53.833 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T01:40:53.890 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi071.stderr:2023-10-06T01:40:53.889+0000 7f3291fac540 -1 init, newargv = 0x55af69024d90 newargc=15 2023-10-06T01:40:53.890 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi071.stderr:ceph-fuse[101143]: starting ceph client 2023-10-06T01:40:53.894 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi071.stderr:ceph-fuse[101143]: starting fuse 2023-10-06T01:40:53.897 INFO:teuthology.orchestra.run.smithi071.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T01:40:53.899 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T01:40:53.899 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T01:40:53.899 DEBUG:teuthology.orchestra.run.smithi071:> ls /sys/fs/fuse/connections 2023-10-06T01:40:53.955 INFO:teuthology.orchestra.run.smithi071.stdout:46 2023-10-06T01:40:53.955 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-10-06T01:40:53.956 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T01:40:53.956 DEBUG:teuthology.orchestra.run.smithi071:> import glob 2023-10-06T01:40:53.956 DEBUG:teuthology.orchestra.run.smithi071:> import re 2023-10-06T01:40:53.956 DEBUG:teuthology.orchestra.run.smithi071:> import os 2023-10-06T01:40:53.956 DEBUG:teuthology.orchestra.run.smithi071:> import subprocess 2023-10-06T01:40:53.956 DEBUG:teuthology.orchestra.run.smithi071:> 2023-10-06T01:40:53.956 DEBUG:teuthology.orchestra.run.smithi071:> def _find_admin_socket(client_name): 2023-10-06T01:40:53.956 DEBUG:teuthology.orchestra.run.smithi071:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-06T01:40:53.956 DEBUG:teuthology.orchestra.run.smithi071:> files = glob.glob(asok_path) 2023-10-06T01:40:53.956 DEBUG:teuthology.orchestra.run.smithi071:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-06T01:40:53.957 DEBUG:teuthology.orchestra.run.smithi071:> 2023-10-06T01:40:53.957 DEBUG:teuthology.orchestra.run.smithi071:> # Given a non-glob path, it better be there 2023-10-06T01:40:53.957 DEBUG:teuthology.orchestra.run.smithi071:> if "*" not in asok_path: 2023-10-06T01:40:53.957 DEBUG:teuthology.orchestra.run.smithi071:> assert(len(files) == 1) 2023-10-06T01:40:53.957 DEBUG:teuthology.orchestra.run.smithi071:> return files[0] 2023-10-06T01:40:53.957 DEBUG:teuthology.orchestra.run.smithi071:> 2023-10-06T01:40:53.957 DEBUG:teuthology.orchestra.run.smithi071:> for f in files: 2023-10-06T01:40:53.957 DEBUG:teuthology.orchestra.run.smithi071:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T01:40:53.957 DEBUG:teuthology.orchestra.run.smithi071:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T01:40:53.957 DEBUG:teuthology.orchestra.run.smithi071:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T01:40:53.957 DEBUG:teuthology.orchestra.run.smithi071:> contents = proc_f.read() 2023-10-06T01:40:53.957 DEBUG:teuthology.orchestra.run.smithi071:> if mountpoint in contents: 2023-10-06T01:40:53.957 DEBUG:teuthology.orchestra.run.smithi071:> return f 2023-10-06T01:40:53.958 DEBUG:teuthology.orchestra.run.smithi071:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T01:40:53.958 DEBUG:teuthology.orchestra.run.smithi071:> 2023-10-06T01:40:53.958 DEBUG:teuthology.orchestra.run.smithi071:> print(_find_admin_socket("client.0")) 2023-10-06T01:40:53.958 DEBUG:teuthology.orchestra.run.smithi071:> ' 2023-10-06T01:40:54.076 INFO:teuthology.orchestra.run.smithi071.stdout:/var/run/ceph/ceph-client.0.101143.asok 2023-10-06T01:40:54.259 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.101143.asok 2023-10-06T01:40:54.259 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T01:40:54.259 DEBUG:teuthology.orchestra.run.smithi071:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.101143.asok status 2023-10-06T01:40:54.408 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2023-10-06T01:40:54.408 INFO:teuthology.orchestra.run.smithi071.stdout: "metadata": { 2023-10-06T01:40:54.408 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_sha1": "736ac5ba72cb47af7d6f6666b1e100f7e20a20e2", 2023-10-06T01:40:54.408 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_version": "ceph version 17.2.6-1296-g736ac5ba (736ac5ba72cb47af7d6f6666b1e100f7e20a20e2) quincy (stable)", 2023-10-06T01:40:54.408 INFO:teuthology.orchestra.run.smithi071.stdout: "entity_id": "0", 2023-10-06T01:40:54.408 INFO:teuthology.orchestra.run.smithi071.stdout: "hostname": "smithi071", 2023-10-06T01:40:54.408 INFO:teuthology.orchestra.run.smithi071.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-06T01:40:54.408 INFO:teuthology.orchestra.run.smithi071.stdout: "pid": "101143", 2023-10-06T01:40:54.409 INFO:teuthology.orchestra.run.smithi071.stdout: "root": "/" 2023-10-06T01:40:54.409 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-06T01:40:54.409 INFO:teuthology.orchestra.run.smithi071.stdout: "dentry_count": 0, 2023-10-06T01:40:54.409 INFO:teuthology.orchestra.run.smithi071.stdout: "dentry_pinned_count": 0, 2023-10-06T01:40:54.409 INFO:teuthology.orchestra.run.smithi071.stdout: "id": 4803, 2023-10-06T01:40:54.409 INFO:teuthology.orchestra.run.smithi071.stdout: "inst": { 2023-10-06T01:40:54.409 INFO:teuthology.orchestra.run.smithi071.stdout: "name": { 2023-10-06T01:40:54.409 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "client", 2023-10-06T01:40:54.409 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 4803 2023-10-06T01:40:54.409 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-06T01:40:54.409 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": { 2023-10-06T01:40:54.409 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2023-10-06T01:40:54.410 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "192.168.0.1:0", 2023-10-06T01:40:54.410 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 898109021 2023-10-06T01:40:54.410 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-06T01:40:54.410 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-06T01:40:54.410 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": { 2023-10-06T01:40:54.410 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2023-10-06T01:40:54.410 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "192.168.0.1:0", 2023-10-06T01:40:54.410 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 898109021 2023-10-06T01:40:54.410 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-06T01:40:54.410 INFO:teuthology.orchestra.run.smithi071.stdout: "inst_str": "client.4803 192.168.0.1:0/898109021", 2023-10-06T01:40:54.410 INFO:teuthology.orchestra.run.smithi071.stdout: "addr_str": "192.168.0.1:0/898109021", 2023-10-06T01:40:54.411 INFO:teuthology.orchestra.run.smithi071.stdout: "inode_count": 1, 2023-10-06T01:40:54.411 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_epoch": 9, 2023-10-06T01:40:54.411 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_epoch": 27, 2023-10-06T01:40:54.411 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_epoch_barrier": 0, 2023-10-06T01:40:54.411 INFO:teuthology.orchestra.run.smithi071.stdout: "blocklisted": false, 2023-10-06T01:40:54.411 INFO:teuthology.orchestra.run.smithi071.stdout: "fs_name": "cephfs" 2023-10-06T01:40:54.411 INFO:teuthology.orchestra.run.smithi071.stdout:} 2023-10-06T01:40:54.418 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T01:40:54.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:54.531+0000 7f3786c59700 1 Processor -- start 2023-10-06T01:40:54.532 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:54.531+0000 7f3786c59700 1 -- start start 2023-10-06T01:40:54.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:54.532+0000 7f3786c59700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f37800af4e0 0x7f37800b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:54.536 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:54.532+0000 7f3786c59700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f378015e190 con 0x7f37800af8b0 2023-10-06T01:40:54.536 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:54.532+0000 7f3786c59700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37800cb650 con 0x7f378015db70 2023-10-06T01:40:54.536 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:54.532+0000 7f3786c59700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37800b1910 con 0x7f37800af4e0 2023-10-06T01:40:54.536 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:54.532+0000 7f377ffff700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f37800af8b0 0x7f378015d460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:54610/0 (socket says 172.21.15.71:54610) 2023-10-06T01:40:54.536 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:54.532+0000 7f377ffff700 1 -- 172.21.15.71:0/4282316121 learned_addr learned my addr 172.21.15.71:0/4282316121 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:40:54.536 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:54.532+0000 7f377f7fe700 1 -- 172.21.15.71:0/4282316121 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 382831584 0 0) 0x7f378015e190 con 0x7f37800af8b0 2023-10-06T01:40:54.536 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:54.532+0000 7f377f7fe700 1 -- 172.21.15.71:0/4282316121 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3770003570 con 0x7f37800af8b0 2023-10-06T01:40:54.536 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:54.532+0000 7f37849f5700 1 --2- 172.21.15.71:0/4282316121 >> v2:172.21.15.72:3300/0 conn(0x7f37800af4e0 0x7f37800b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:54.536 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:54.533+0000 7f377f7fe700 1 -- 172.21.15.71:0/4282316121 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3853504197 0 0) 0x7f3770003570 con 0x7f37800af8b0 2023-10-06T01:40:54.536 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:54.533+0000 7f377f7fe700 1 -- 172.21.15.71:0/4282316121 >> v2:172.21.15.72:3300/0 conn(0x7f37800af4e0 msgr2=0x7f37800b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:54.536 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:54.533+0000 7f377f7fe700 1 --2- 172.21.15.71:0/4282316121 >> v2:172.21.15.72:3300/0 conn(0x7f37800af4e0 0x7f37800b20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:54.537 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:54.533+0000 7f377f7fe700 1 -- 172.21.15.71:0/4282316121 >> v1:172.21.15.72:6789/0 conn(0x7f378015db70 legacy=0x7f37800cbae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:54.537 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:54.533+0000 7f377f7fe700 1 -- 172.21.15.71:0/4282316121 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37800cad20 con 0x7f37800af8b0 2023-10-06T01:40:54.537 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:54.533+0000 7f377f7fe700 1 -- 172.21.15.71:0/4282316121 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1184243524 0 0) 0x7f376c001470 con 0x7f37800af8b0 2023-10-06T01:40:54.537 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:54.533+0000 7f377f7fe700 1 -- 172.21.15.71:0/4282316121 >> v1:172.21.15.71:6789/0 conn(0x7f37800af8b0 legacy=0x7f378015d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:54.537 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:54.533+0000 7f377f7fe700 1 --2- 172.21.15.71:0/4282316121 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3770003a60 0x7f3770003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:54.537 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:54.533+0000 7f377f7fe700 1 --2- 172.21.15.71:0/4282316121 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3770004810 0x7f3770004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:54.537 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:54.533+0000 7f377f7fe700 1 --2- 172.21.15.71:0/4282316121 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37700051c0 0x7f377000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:54.537 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:54.533+0000 7f377f7fe700 1 -- 172.21.15.71:0/4282316121 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37800b1910 con 0x7f37700051c0 2023-10-06T01:40:54.537 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:54.533+0000 7f377f7fe700 1 -- 172.21.15.71:0/4282316121 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f377000c160 con 0x7f3770004810 2023-10-06T01:40:54.537 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:54.533+0000 7f377f7fe700 1 -- 172.21.15.71:0/4282316121 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f377000c320 con 0x7f3770003a60 2023-10-06T01:40:54.537 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:54.533+0000 7f37851f6700 1 --2- 172.21.15.71:0/4282316121 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37700051c0 0x7f377000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:54.538 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:54.533+0000 7f37849f5700 1 --2- 172.21.15.71:0/4282316121 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3770003a60 0x7f3770003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:54.538 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:54.533+0000 7f377ffff700 1 --2- 172.21.15.71:0/4282316121 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3770004810 0x7f3770004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:54.538 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:54.533+0000 7f37851f6700 1 -- 172.21.15.71:0/4282316121 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3770003a60 msgr2=0x7f3770003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:54.538 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:54.533+0000 7f37851f6700 1 --2- 172.21.15.71:0/4282316121 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3770003a60 0x7f3770003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:54.538 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:54.533+0000 7f37851f6700 1 -- 172.21.15.71:0/4282316121 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3770004810 msgr2=0x7f3770004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:54.538 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:54.533+0000 7f37851f6700 1 --2- 172.21.15.71:0/4282316121 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3770004810 0x7f3770004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:54.538 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:54.533+0000 7f37851f6700 1 -- 172.21.15.71:0/4282316121 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3770003570 con 0x7f37700051c0 2023-10-06T01:40:54.538 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:54.533+0000 7f37851f6700 1 -- 172.21.15.71:0/4282316121 reap_dead start 2023-10-06T01:40:54.538 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:54.533+0000 7f37851f6700 1 --2- 172.21.15.71:0/4282316121 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37700051c0 0x7f377000ba60 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3778001fc0 tx=0x7f3778001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3123cb8985abbb4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:54.538 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:54.533+0000 7f377f7fe700 1 -- 172.21.15.71:0/4282316121 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3778001950 con 0x7f37700051c0 2023-10-06T01:40:54.538 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:54.533+0000 7f377f7fe700 1 -- 172.21.15.71:0/4282316121 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f377800c8b0 con 0x7f37700051c0 2023-10-06T01:40:54.538 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:54.533+0000 7f377f7fe700 1 -- 172.21.15.71:0/4282316121 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377800cc50 con 0x7f37700051c0 2023-10-06T01:40:54.539 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:54.534+0000 7f3786c59700 1 -- 172.21.15.71:0/4282316121 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37700051c0 msgr2=0x7f377000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:54.539 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:54.534+0000 7f3786c59700 1 --2- 172.21.15.71:0/4282316121 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37700051c0 0x7f377000ba60 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3778001fc0 tx=0x7f3778001640 comp rx=0 tx=0).stop 2023-10-06T01:40:54.539 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:54.534+0000 7f3786c59700 1 -- 172.21.15.71:0/4282316121 shutdown_connections 2023-10-06T01:40:54.539 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:54.534+0000 7f3786c59700 1 --2- 172.21.15.71:0/4282316121 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37700051c0 0x7f377000ba60 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:54.539 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:54.534+0000 7f3786c59700 1 -- 172.21.15.71:0/4282316121 >> 172.21.15.71:0/4282316121 conn(0x7f3780068680 msgr2=0x7f3780068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:54.539 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:54.534+0000 7f3786c59700 1 -- 172.21.15.71:0/4282316121 shutdown_connections 2023-10-06T01:40:54.539 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:54.534+0000 7f3786c59700 1 -- 172.21.15.71:0/4282316121 wait complete. 2023-10-06T01:40:54.539 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:54.535+0000 7f3786c59700 1 Processor -- start 2023-10-06T01:40:54.542 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:54.535+0000 7f3786c59700 1 -- start start 2023-10-06T01:40:54.542 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:54.536+0000 7f3786c59700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37700051c0 0x7f378014d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:54.542 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:54.536+0000 7f3786c59700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37800cefe0 0x7f37800cf450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:54.542 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:54.536+0000 7f3786c59700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f37800b4e90 0x7f37800b5310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:54.542 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:54.536+0000 7f3786c59700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f378014de90 con 0x7f37700051c0 2023-10-06T01:40:54.542 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:54.536+0000 7f3786c59700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f378016b3a0 con 0x7f37800cefe0 2023-10-06T01:40:54.542 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:54.536+0000 7f3786c59700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37800b3df0 con 0x7f37800b4e90 2023-10-06T01:40:54.542 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:54.536+0000 7f37849f5700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37700051c0 0x7f378014d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:54.542 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:54.536+0000 7f37849f5700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37700051c0 0x7f378014d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52528/0 (socket says 172.21.15.71:52528) 2023-10-06T01:40:54.542 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:54.536+0000 7f37849f5700 1 -- 172.21.15.71:0/653580902 learned_addr learned my addr 172.21.15.71:0/653580902 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:54.543 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:54.536+0000 7f377ffff700 1 --2- 172.21.15.71:0/653580902 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37800cefe0 0x7f37800cf450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:54.543 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:54.536+0000 7f37851f6700 1 --2- 172.21.15.71:0/653580902 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f37800b4e90 0x7f37800b5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:54.543 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:54.536+0000 7f37849f5700 1 -- 172.21.15.71:0/653580902 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f37800b4e90 msgr2=0x7f37800b5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:54.543 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:54.536+0000 7f37849f5700 1 --2- 172.21.15.71:0/653580902 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f37800b4e90 0x7f37800b5310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:54.543 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:54.536+0000 7f37849f5700 1 -- 172.21.15.71:0/653580902 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37800cefe0 msgr2=0x7f37800cf450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:54.543 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:54.536+0000 7f37849f5700 1 --2- 172.21.15.71:0/653580902 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37800cefe0 0x7f37800cf450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:54.543 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:54.536+0000 7f37849f5700 1 -- 172.21.15.71:0/653580902 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37800b40d0 con 0x7f37700051c0 2023-10-06T01:40:54.543 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:54.537+0000 7f37849f5700 1 --2- 172.21.15.71:0/653580902 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37700051c0 0x7f378014d950 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3774006ac0 tx=0x7f37740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:54.543 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:54.537+0000 7f377cff9700 1 -- 172.21.15.71:0/653580902 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377400fa10 con 0x7f37700051c0 2023-10-06T01:40:54.543 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:54.537+0000 7f377cff9700 1 -- 172.21.15.71:0/653580902 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f377400fb70 con 0x7f37700051c0 2023-10-06T01:40:54.543 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:54.537+0000 7f3786c59700 1 -- 172.21.15.71:0/653580902 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37800b43b0 con 0x7f37700051c0 2023-10-06T01:40:54.543 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:54.537+0000 7f377cff9700 1 -- 172.21.15.71:0/653580902 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3774014440 con 0x7f37700051c0 2023-10-06T01:40:54.544 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:54.537+0000 7f3786c59700 1 -- 172.21.15.71:0/653580902 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37800b4970 con 0x7f37700051c0 2023-10-06T01:40:54.544 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:54.538+0000 7f3786c59700 1 -- 172.21.15.71:0/653580902 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3780088aa0 con 0x7f37700051c0 2023-10-06T01:40:54.544 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:54.538+0000 7f377cff9700 1 -- 172.21.15.71:0/653580902 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3774014830 con 0x7f37700051c0 2023-10-06T01:40:54.544 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:54.539+0000 7f377cff9700 1 --2- 172.21.15.71:0/653580902 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f3764066f30 0x7f37640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:54.544 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:54.539+0000 7f377ffff700 1 --2- 172.21.15.71:0/653580902 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f3764066f30 0x7f37640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:54.544 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:54.539+0000 7f377cff9700 1 -- 172.21.15.71:0/653580902 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f3774018030 con 0x7f37700051c0 2023-10-06T01:40:54.544 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:54.539+0000 7f377ffff700 1 --2- 172.21.15.71:0/653580902 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f3764066f30 0x7f37640693e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f376c0015a0 tx=0x7f376c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:54.544 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:54.543+0000 7f377cff9700 1 -- 172.21.15.71:0/653580902 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f37740521a0 con 0x7f37700051c0 2023-10-06T01:40:54.775 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:54.773+0000 7f3786c59700 1 -- 172.21.15.71:0/653580902 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f37800cd8f0 con 0x7f37700051c0 2023-10-06T01:40:54.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:54.774+0000 7f377cff9700 1 -- 172.21.15.71:0/653580902 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f37740557c0 con 0x7f37700051c0 2023-10-06T01:40:54.776 INFO:teuthology.orchestra.run.smithi071.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-06T01:40:54.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:54.776+0000 7f3786c59700 1 -- 172.21.15.71:0/653580902 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f3764066f30 msgr2=0x7f37640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:54.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:54.776+0000 7f3786c59700 1 --2- 172.21.15.71:0/653580902 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f3764066f30 0x7f37640693e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f376c0015a0 tx=0x7f376c009040 comp rx=0 tx=0).stop 2023-10-06T01:40:54.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:54.776+0000 7f3786c59700 1 -- 172.21.15.71:0/653580902 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37700051c0 msgr2=0x7f378014d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:54.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:54.776+0000 7f3786c59700 1 --2- 172.21.15.71:0/653580902 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37700051c0 0x7f378014d950 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3774006ac0 tx=0x7f37740091a0 comp rx=0 tx=0).stop 2023-10-06T01:40:54.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:54.776+0000 7f3786c59700 1 -- 172.21.15.71:0/653580902 shutdown_connections 2023-10-06T01:40:54.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:54.776+0000 7f3786c59700 1 --2- 172.21.15.71:0/653580902 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f37800b4e90 0x7f37800b5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:54.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:54.776+0000 7f3786c59700 1 --2- 172.21.15.71:0/653580902 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37700051c0 0x7f378014d950 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:54.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:54.776+0000 7f3786c59700 1 --2- 172.21.15.71:0/653580902 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f3764066f30 0x7f37640693e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:54.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:54.776+0000 7f3786c59700 1 --2- 172.21.15.71:0/653580902 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f37800cefe0 0x7f37800cf450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:54.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:54.776+0000 7f3786c59700 1 -- 172.21.15.71:0/653580902 >> 172.21.15.71:0/653580902 conn(0x7f3780068680 msgr2=0x7f37800b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:54.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:54.776+0000 7f3786c59700 1 -- 172.21.15.71:0/653580902 shutdown_connections 2023-10-06T01:40:54.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:54.776+0000 7f3786c59700 1 -- 172.21.15.71:0/653580902 wait complete. 2023-10-06T01:40:54.788 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T01:40:54.788 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T01:40:54.788 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi071.front.sepia.ceph.com 2023-10-06T01:40:54.788 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-10-06T01:40:54.789 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-10-06T01:40:54.789 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T01:40:54.789 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T01:40:54.789 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T01:40:54.789 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-10-06T01:40:54.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:40:54.789 DEBUG:teuthology.orchestra.run.smithi071:> ip addr 2023-10-06T01:40:54.804 INFO:teuthology.orchestra.run.smithi071.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T01:40:54.804 INFO:teuthology.orchestra.run.smithi071.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T01:40:54.804 INFO:teuthology.orchestra.run.smithi071.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T01:40:54.804 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:40:54.804 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 ::1/128 scope host 2023-10-06T01:40:54.804 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:40:54.805 INFO:teuthology.orchestra.run.smithi071.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T01:40:54.805 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:d8:aa:4a brd ff:ff:ff:ff:ff:ff 2023-10-06T01:40:54.805 INFO:teuthology.orchestra.run.smithi071.stdout: altname enp7s0f0 2023-10-06T01:40:54.805 INFO:teuthology.orchestra.run.smithi071.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T01:40:54.805 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:d8:aa:4b brd ff:ff:ff:ff:ff:ff 2023-10-06T01:40:54.805 INFO:teuthology.orchestra.run.smithi071.stdout: altname enp7s0f1 2023-10-06T01:40:54.805 INFO:teuthology.orchestra.run.smithi071.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T01:40:54.805 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:8f:d7:64 brd ff:ff:ff:ff:ff:ff 2023-10-06T01:40:54.805 INFO:teuthology.orchestra.run.smithi071.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T01:40:54.805 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:8f:d7:65 brd ff:ff:ff:ff:ff:ff 2023-10-06T01:40:54.806 INFO:teuthology.orchestra.run.smithi071.stdout: inet 172.21.15.71/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T01:40:54.806 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft 42320sec preferred_lft 42320sec 2023-10-06T01:40:54.806 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::ec4:7aff:fe8f:d765/64 scope link 2023-10-06T01:40:54.806 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:40:54.806 INFO:teuthology.orchestra.run.smithi071.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T01:40:54.806 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 26:9a:64:34:3b:3a brd ff:ff:ff:ff:ff:ff 2023-10-06T01:40:54.806 INFO:teuthology.orchestra.run.smithi071.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T01:40:54.806 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:40:54.806 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::44c7:acff:febb:6c0/64 scope link 2023-10-06T01:40:54.806 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:40:54.807 INFO:teuthology.orchestra.run.smithi071.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T01:40:54.807 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 26:9a:64:34:3b:3a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T01:40:54.807 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::249a:64ff:fe34:3b3a/64 scope link tentative 2023-10-06T01:40:54.807 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:40:54.807 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:40:54.807 DEBUG:teuthology.orchestra.run.smithi071:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T01:40:54.869 INFO:teuthology.orchestra.run.smithi071.stdout:1 2023-10-06T01:40:54.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:40:54.870 DEBUG:teuthology.orchestra.run.smithi071:> route 2023-10-06T01:40:54.927 INFO:teuthology.orchestra.run.smithi071.stdout:Kernel IP routing table 2023-10-06T01:40:54.927 INFO:teuthology.orchestra.run.smithi071.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T01:40:54.928 INFO:teuthology.orchestra.run.smithi071.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T01:40:54.928 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T01:40:54.928 INFO:teuthology.orchestra.run.smithi071.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T01:40:54.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:40:54.928 DEBUG:teuthology.orchestra.run.smithi071:> (cd / && exec bash -c ' 2023-10-06T01:40:54.929 DEBUG:teuthology.orchestra.run.smithi071:> set -e 2023-10-06T01:40:54.929 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T01:40:54.929 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T01:40:54.929 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T01:40:54.929 DEBUG:teuthology.orchestra.run.smithi071:> ') 2023-10-06T01:40:55.027 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:40:55.027 DEBUG:teuthology.orchestra.run.smithi071:> ip netns list 2023-10-06T01:40:55.041 INFO:teuthology.orchestra.run.smithi071.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T01:40:55.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:40:55.042 DEBUG:teuthology.orchestra.run.smithi071:> ip netns list-id 2023-10-06T01:40:55.095 INFO:teuthology.orchestra.run.smithi071.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-10-06T01:40:55.096 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:40:55.096 DEBUG:teuthology.orchestra.run.smithi071:> (cd / && exec bash -c ' 2023-10-06T01:40:55.096 DEBUG:teuthology.orchestra.run.smithi071:> set -e 2023-10-06T01:40:55.096 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T01:40:55.096 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-10-06T01:40:55.096 DEBUG:teuthology.orchestra.run.smithi071:> ') 2023-10-06T01:40:55.184 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:40:55.184 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-06T01:40:55.221 INFO:teuthology.orchestra.run.smithi071.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T01:40:55.222 INFO:teuthology.orchestra.run.smithi071.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T01:40:55.222 INFO:teuthology.orchestra.run.smithi071.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T01:40:55.222 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:40:55.222 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 ::1/128 scope host 2023-10-06T01:40:55.223 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:40:55.223 INFO:teuthology.orchestra.run.smithi071.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T01:40:55.223 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 76:90:12:f5:8f:f0 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-06T01:40:55.223 INFO:teuthology.orchestra.run.smithi071.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-06T01:40:55.223 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:40:55.223 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::7490:12ff:fef5:8ff0/64 scope link tentative 2023-10-06T01:40:55.224 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:40:55.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:40:55.236 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-06T01:40:55.316 INFO:teuthology.orchestra.run.smithi071.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T01:40:55.316 INFO:teuthology.orchestra.run.smithi071.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T01:40:55.316 INFO:teuthology.orchestra.run.smithi071.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T01:40:55.317 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:40:55.317 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 ::1/128 scope host 2023-10-06T01:40:55.317 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:40:55.317 INFO:teuthology.orchestra.run.smithi071.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T01:40:55.317 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 76:90:12:f5:8f:f0 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-06T01:40:55.317 INFO:teuthology.orchestra.run.smithi071.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-06T01:40:55.317 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:40:55.317 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::7490:12ff:fef5:8ff0/64 scope link tentative 2023-10-06T01:40:55.317 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:40:55.327 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-10-06T01:40:55.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:40:55.327 DEBUG:teuthology.orchestra.run.smithi071:> (cd / && exec bash -c ' 2023-10-06T01:40:55.328 DEBUG:teuthology.orchestra.run.smithi071:> set -e 2023-10-06T01:40:55.328 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-10-06T01:40:55.328 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-06T01:40:55.328 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-10-06T01:40:55.328 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-10-06T01:40:55.328 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-10-06T01:40:55.328 DEBUG:teuthology.orchestra.run.smithi071:> ') 2023-10-06T01:40:55.552 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:40:55.552 DEBUG:teuthology.orchestra.run.smithi071:> (cd / && exec bash -c ' 2023-10-06T01:40:55.552 DEBUG:teuthology.orchestra.run.smithi071:> set -e 2023-10-06T01:40:55.552 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link set brx.1 up 2023-10-06T01:40:55.552 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link set dev brx.1 master ceph-brx 2023-10-06T01:40:55.552 DEBUG:teuthology.orchestra.run.smithi071:> ') 2023-10-06T01:40:55.644 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2023-10-06T01:40:55.644 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T01:40:55.644 DEBUG:teuthology.orchestra.run.smithi071:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-10-06T01:40:55.659 INFO:teuthology.orchestra.run.smithi071.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-10-06T01:40:55.659 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T01:40:55.659 DEBUG:teuthology.orchestra.run.smithi071:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-10-06T01:40:55.713 DEBUG:teuthology.orchestra.run.smithi071:> sudo modprobe fuse 2023-10-06T01:40:55.778 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T01:40:55.778 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T01:40:55.842 INFO:teuthology.orchestra.run.smithi071.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T01:40:55.844 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T01:40:55.844 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T01:40:55.845 DEBUG:teuthology.orchestra.run.smithi071:> ls /sys/fs/fuse/connections 2023-10-06T01:40:55.899 INFO:teuthology.orchestra.run.smithi071.stdout:46 2023-10-06T01:40:55.899 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [46] 2023-10-06T01:40:55.899 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2023-10-06T01:40:55.942 DEBUG:teuthology.orchestra.run.smithi071:> sudo modprobe fuse 2023-10-06T01:40:55.966 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T01:40:55.966 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T01:40:56.023 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi071.stderr:2023-10-06T01:40:56.022+0000 7fb649e67540 -1 init, newargv = 0x560cb4ef29b0 newargc=15 2023-10-06T01:40:56.023 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi071.stderr:ceph-fuse[101689]: starting ceph client 2023-10-06T01:40:56.027 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi071.stderr:ceph-fuse[101689]: starting fuse 2023-10-06T01:40:56.032 INFO:teuthology.orchestra.run.smithi071.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T01:40:56.033 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T01:40:56.034 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T01:40:56.034 DEBUG:teuthology.orchestra.run.smithi071:> ls /sys/fs/fuse/connections 2023-10-06T01:40:56.089 INFO:teuthology.orchestra.run.smithi071.stdout:46 2023-10-06T01:40:56.089 INFO:teuthology.orchestra.run.smithi071.stdout:48 2023-10-06T01:40:56.089 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46, 48] 2023-10-06T01:40:56.090 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T01:40:56.090 DEBUG:teuthology.orchestra.run.smithi071:> import glob 2023-10-06T01:40:56.090 DEBUG:teuthology.orchestra.run.smithi071:> import re 2023-10-06T01:40:56.090 DEBUG:teuthology.orchestra.run.smithi071:> import os 2023-10-06T01:40:56.090 DEBUG:teuthology.orchestra.run.smithi071:> import subprocess 2023-10-06T01:40:56.090 DEBUG:teuthology.orchestra.run.smithi071:> 2023-10-06T01:40:56.090 DEBUG:teuthology.orchestra.run.smithi071:> def _find_admin_socket(client_name): 2023-10-06T01:40:56.090 DEBUG:teuthology.orchestra.run.smithi071:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2023-10-06T01:40:56.091 DEBUG:teuthology.orchestra.run.smithi071:> files = glob.glob(asok_path) 2023-10-06T01:40:56.091 DEBUG:teuthology.orchestra.run.smithi071:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2023-10-06T01:40:56.091 DEBUG:teuthology.orchestra.run.smithi071:> 2023-10-06T01:40:56.091 DEBUG:teuthology.orchestra.run.smithi071:> # Given a non-glob path, it better be there 2023-10-06T01:40:56.091 DEBUG:teuthology.orchestra.run.smithi071:> if "*" not in asok_path: 2023-10-06T01:40:56.091 DEBUG:teuthology.orchestra.run.smithi071:> assert(len(files) == 1) 2023-10-06T01:40:56.091 DEBUG:teuthology.orchestra.run.smithi071:> return files[0] 2023-10-06T01:40:56.091 DEBUG:teuthology.orchestra.run.smithi071:> 2023-10-06T01:40:56.091 DEBUG:teuthology.orchestra.run.smithi071:> for f in files: 2023-10-06T01:40:56.091 DEBUG:teuthology.orchestra.run.smithi071:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T01:40:56.091 DEBUG:teuthology.orchestra.run.smithi071:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T01:40:56.091 DEBUG:teuthology.orchestra.run.smithi071:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T01:40:56.091 DEBUG:teuthology.orchestra.run.smithi071:> contents = proc_f.read() 2023-10-06T01:40:56.092 DEBUG:teuthology.orchestra.run.smithi071:> if mountpoint in contents: 2023-10-06T01:40:56.092 DEBUG:teuthology.orchestra.run.smithi071:> return f 2023-10-06T01:40:56.092 DEBUG:teuthology.orchestra.run.smithi071:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T01:40:56.092 DEBUG:teuthology.orchestra.run.smithi071:> 2023-10-06T01:40:56.092 DEBUG:teuthology.orchestra.run.smithi071:> print(_find_admin_socket("client.2")) 2023-10-06T01:40:56.092 DEBUG:teuthology.orchestra.run.smithi071:> ' 2023-10-06T01:40:56.209 INFO:teuthology.orchestra.run.smithi071.stdout:/var/run/ceph/ceph-client.2.101689.asok 2023-10-06T01:40:56.392 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.101689.asok 2023-10-06T01:40:56.393 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T01:40:56.393 DEBUG:teuthology.orchestra.run.smithi071:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.101689.asok status 2023-10-06T01:40:56.541 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2023-10-06T01:40:56.542 INFO:teuthology.orchestra.run.smithi071.stdout: "metadata": { 2023-10-06T01:40:56.542 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_sha1": "736ac5ba72cb47af7d6f6666b1e100f7e20a20e2", 2023-10-06T01:40:56.542 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_version": "ceph version 17.2.6-1296-g736ac5ba (736ac5ba72cb47af7d6f6666b1e100f7e20a20e2) quincy (stable)", 2023-10-06T01:40:56.542 INFO:teuthology.orchestra.run.smithi071.stdout: "entity_id": "2", 2023-10-06T01:40:56.542 INFO:teuthology.orchestra.run.smithi071.stdout: "hostname": "smithi071", 2023-10-06T01:40:56.542 INFO:teuthology.orchestra.run.smithi071.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2023-10-06T01:40:56.543 INFO:teuthology.orchestra.run.smithi071.stdout: "pid": "101689", 2023-10-06T01:40:56.543 INFO:teuthology.orchestra.run.smithi071.stdout: "root": "/" 2023-10-06T01:40:56.543 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-06T01:40:56.543 INFO:teuthology.orchestra.run.smithi071.stdout: "dentry_count": 0, 2023-10-06T01:40:56.543 INFO:teuthology.orchestra.run.smithi071.stdout: "dentry_pinned_count": 0, 2023-10-06T01:40:56.543 INFO:teuthology.orchestra.run.smithi071.stdout: "id": 4815, 2023-10-06T01:40:56.543 INFO:teuthology.orchestra.run.smithi071.stdout: "inst": { 2023-10-06T01:40:56.543 INFO:teuthology.orchestra.run.smithi071.stdout: "name": { 2023-10-06T01:40:56.544 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "client", 2023-10-06T01:40:56.544 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 4815 2023-10-06T01:40:56.544 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-06T01:40:56.544 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": { 2023-10-06T01:40:56.544 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2023-10-06T01:40:56.544 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "192.168.0.2:0", 2023-10-06T01:40:56.544 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 1503403862 2023-10-06T01:40:56.545 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-06T01:40:56.545 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-06T01:40:56.545 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": { 2023-10-06T01:40:56.545 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2023-10-06T01:40:56.545 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "192.168.0.2:0", 2023-10-06T01:40:56.545 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 1503403862 2023-10-06T01:40:56.545 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-06T01:40:56.545 INFO:teuthology.orchestra.run.smithi071.stdout: "inst_str": "client.4815 192.168.0.2:0/1503403862", 2023-10-06T01:40:56.546 INFO:teuthology.orchestra.run.smithi071.stdout: "addr_str": "192.168.0.2:0/1503403862", 2023-10-06T01:40:56.546 INFO:teuthology.orchestra.run.smithi071.stdout: "inode_count": 1, 2023-10-06T01:40:56.546 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_epoch": 9, 2023-10-06T01:40:56.546 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_epoch": 27, 2023-10-06T01:40:56.546 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_epoch_barrier": 0, 2023-10-06T01:40:56.546 INFO:teuthology.orchestra.run.smithi071.stdout: "blocklisted": false, 2023-10-06T01:40:56.546 INFO:teuthology.orchestra.run.smithi071.stdout: "fs_name": "cephfs" 2023-10-06T01:40:56.546 INFO:teuthology.orchestra.run.smithi071.stdout:} 2023-10-06T01:40:56.551 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T01:40:56.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:56.666+0000 7f939b968700 1 Processor -- start 2023-10-06T01:40:56.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:56.667+0000 7f939b968700 1 -- start start 2023-10-06T01:40:56.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:56.667+0000 7f939b968700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f93940af250 0x7f93940ad5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:56.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:56.667+0000 7f939b968700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f93940c9f40 0x7f93940ccfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:56.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:56.667+0000 7f939b968700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f93940af620 0x7f93940cd510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:56.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:56.667+0000 7f939b968700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9394069550 con 0x7f93940af250 2023-10-06T01:40:56.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:56.667+0000 7f939b968700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93940adb30 con 0x7f93940c9f40 2023-10-06T01:40:56.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:56.667+0000 7f939b968700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93940add80 con 0x7f93940af620 2023-10-06T01:40:56.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:56.668+0000 7f9399704700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f93940af250 0x7f93940ad5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:56.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:56.668+0000 7f9399704700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f93940af250 0x7f93940ad5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52538/0 (socket says 172.21.15.71:52538) 2023-10-06T01:40:56.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:56.668+0000 7f9399704700 1 -- 172.21.15.71:0/4279890440 learned_addr learned my addr 172.21.15.71:0/4279890440 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:56.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:56.668+0000 7f9399f05700 1 --2- 172.21.15.71:0/4279890440 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f93940af620 0x7f93940cd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:56.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:56.668+0000 7f9398f03700 1 --2- 172.21.15.71:0/4279890440 >> v2:172.21.15.72:3300/0 conn(0x7f93940c9f40 0x7f93940ccfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:56.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:56.668+0000 7f9399704700 1 -- 172.21.15.71:0/4279890440 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f93940af620 msgr2=0x7f93940cd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:56.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:56.668+0000 7f9399704700 1 --2- 172.21.15.71:0/4279890440 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f93940af620 0x7f93940cd510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:56.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:56.668+0000 7f9399704700 1 -- 172.21.15.71:0/4279890440 >> v2:172.21.15.72:3300/0 conn(0x7f93940c9f40 msgr2=0x7f93940ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:56.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:56.668+0000 7f9399704700 1 --2- 172.21.15.71:0/4279890440 >> v2:172.21.15.72:3300/0 conn(0x7f93940c9f40 0x7f93940ccfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:56.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:56.668+0000 7f9399704700 1 -- 172.21.15.71:0/4279890440 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93940ae060 con 0x7f93940af250 2023-10-06T01:40:56.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:56.668+0000 7f9399704700 1 --2- 172.21.15.71:0/4279890440 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93940af250 0x7f93940ad5f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f93940c9310 tx=0x7f9390009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89bd0dd40ebbd41c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:56.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:56.668+0000 7f938bfff700 1 -- 172.21.15.71:0/4279890440 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f939000b640 con 0x7f93940af250 2023-10-06T01:40:56.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:56.668+0000 7f938bfff700 1 -- 172.21.15.71:0/4279890440 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f939000b7a0 con 0x7f93940af250 2023-10-06T01:40:56.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:56.668+0000 7f938bfff700 1 -- 172.21.15.71:0/4279890440 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f939000bb60 con 0x7f93940af250 2023-10-06T01:40:56.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:56.669+0000 7f939b968700 1 -- 172.21.15.71:0/4279890440 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93940af250 msgr2=0x7f93940ad5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:56.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:56.669+0000 7f939b968700 1 --2- 172.21.15.71:0/4279890440 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93940af250 0x7f93940ad5f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f93940c9310 tx=0x7f9390009250 comp rx=0 tx=0).stop 2023-10-06T01:40:56.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:56.669+0000 7f939b968700 1 -- 172.21.15.71:0/4279890440 shutdown_connections 2023-10-06T01:40:56.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:56.669+0000 7f939b968700 1 --2- 172.21.15.71:0/4279890440 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93940af250 0x7f93940ad5f0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:56.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:56.669+0000 7f939b968700 1 --2- 172.21.15.71:0/4279890440 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f93940af620 0x7f93940cd510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:56.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:56.669+0000 7f939b968700 1 --2- 172.21.15.71:0/4279890440 >> v2:172.21.15.72:3300/0 conn(0x7f93940c9f40 0x7f93940ccfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:56.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:56.669+0000 7f939b968700 1 -- 172.21.15.71:0/4279890440 >> 172.21.15.71:0/4279890440 conn(0x7f9394069790 msgr2=0x7f9394069b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:56.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:56.669+0000 7f939b968700 1 -- 172.21.15.71:0/4279890440 shutdown_connections 2023-10-06T01:40:56.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:56.669+0000 7f939b968700 1 -- 172.21.15.71:0/4279890440 wait complete. 2023-10-06T01:40:56.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:56.670+0000 7f939b968700 1 Processor -- start 2023-10-06T01:40:56.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:56.670+0000 7f939b968700 1 -- start start 2023-10-06T01:40:56.677 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:56.671+0000 7f939b968700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f93940af250 0x7f9394149fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:56.677 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:56.671+0000 7f939b968700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93940af620 0x7f93940c6b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:56.677 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:56.671+0000 7f939b968700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93940c9f40 0x7f93940b1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:56.677 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:56.671+0000 7f939b968700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93940c5b00 con 0x7f93940af620 2023-10-06T01:40:56.677 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:56.671+0000 7f939b968700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93940c6680 con 0x7f93940c9f40 2023-10-06T01:40:56.677 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:56.671+0000 7f939b968700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93940c5d50 con 0x7f93940af250 2023-10-06T01:40:56.677 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:56.671+0000 7f9398f03700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93940af620 0x7f93940c6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:56.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:56.671+0000 7f9398f03700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93940af620 0x7f93940c6b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52546/0 (socket says 172.21.15.71:52546) 2023-10-06T01:40:56.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:56.671+0000 7f9398f03700 1 -- 172.21.15.71:0/3490332587 learned_addr learned my addr 172.21.15.71:0/3490332587 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:56.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:56.671+0000 7f9399704700 1 --2- 172.21.15.71:0/3490332587 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f93940af250 0x7f9394149fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:56.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:56.671+0000 7f9399f05700 1 --2- 172.21.15.71:0/3490332587 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93940c9f40 0x7f93940b1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:56.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:56.671+0000 7f9398f03700 1 -- 172.21.15.71:0/3490332587 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f93940af250 msgr2=0x7f9394149fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:56.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:56.671+0000 7f9398f03700 1 --2- 172.21.15.71:0/3490332587 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f93940af250 0x7f9394149fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:56.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:56.671+0000 7f9398f03700 1 -- 172.21.15.71:0/3490332587 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93940c9f40 msgr2=0x7f93940b1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:56.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:56.671+0000 7f9398f03700 1 --2- 172.21.15.71:0/3490332587 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93940c9f40 0x7f93940b1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:56.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:56.671+0000 7f9398f03700 1 -- 172.21.15.71:0/3490332587 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93900094f0 con 0x7f93940af620 2023-10-06T01:40:56.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:56.671+0000 7f9398f03700 1 --2- 172.21.15.71:0/3490332587 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93940af620 0x7f93940c6b10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f938400ec80 tx=0x7f93840091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:56.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:56.672+0000 7f93897fa700 1 -- 172.21.15.71:0/3490332587 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f938400c850 con 0x7f93940af620 2023-10-06T01:40:56.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:56.672+0000 7f93897fa700 1 -- 172.21.15.71:0/3490332587 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f938400c9b0 con 0x7f93940af620 2023-10-06T01:40:56.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:56.672+0000 7f939b968700 1 -- 172.21.15.71:0/3490332587 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93940c6030 con 0x7f93940af620 2023-10-06T01:40:56.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:56.672+0000 7f93897fa700 1 -- 172.21.15.71:0/3490332587 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f938400cd50 con 0x7f93940af620 2023-10-06T01:40:56.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:56.672+0000 7f939b968700 1 -- 172.21.15.71:0/3490332587 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f939414a520 con 0x7f93940af620 2023-10-06T01:40:56.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:56.672+0000 7f939b968700 1 -- 172.21.15.71:0/3490332587 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93940c67f0 con 0x7f93940af620 2023-10-06T01:40:56.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:56.673+0000 7f93897fa700 1 -- 172.21.15.71:0/3490332587 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9384013680 con 0x7f93940af620 2023-10-06T01:40:56.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:56.673+0000 7f93897fa700 1 --2- 172.21.15.71:0/3490332587 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f9378066f30 0x7f93780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:56.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:56.673+0000 7f93897fa700 1 -- 172.21.15.71:0/3490332587 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f9384084ba0 con 0x7f93940af620 2023-10-06T01:40:56.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:56.673+0000 7f9399704700 1 --2- 172.21.15.71:0/3490332587 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f9378066f30 0x7f93780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:56.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:56.674+0000 7f9399704700 1 --2- 172.21.15.71:0/3490332587 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f9378066f30 0x7f93780693e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f93940c9310 tx=0x7f9390017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:56.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:56.677+0000 7f93897fa700 1 -- 172.21.15.71:0/3490332587 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f93840519c0 con 0x7f93940af620 2023-10-06T01:40:56.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:56.909+0000 7f939b968700 1 -- 172.21.15.71:0/3490332587 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f93940ae8f0 con 0x7f93940af620 2023-10-06T01:40:56.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:56.909+0000 7f93897fa700 1 -- 172.21.15.71:0/3490332587 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f9384054fe0 con 0x7f93940af620 2023-10-06T01:40:56.911 INFO:teuthology.orchestra.run.smithi071.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-06T01:40:56.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:56.911+0000 7f939b968700 1 -- 172.21.15.71:0/3490332587 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f9378066f30 msgr2=0x7f93780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:56.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:56.911+0000 7f939b968700 1 --2- 172.21.15.71:0/3490332587 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f9378066f30 0x7f93780693e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f93940c9310 tx=0x7f9390017000 comp rx=0 tx=0).stop 2023-10-06T01:40:56.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:56.911+0000 7f939b968700 1 -- 172.21.15.71:0/3490332587 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93940af620 msgr2=0x7f93940c6b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:56.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:56.911+0000 7f939b968700 1 --2- 172.21.15.71:0/3490332587 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93940af620 0x7f93940c6b10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f938400ec80 tx=0x7f93840091a0 comp rx=0 tx=0).stop 2023-10-06T01:40:56.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:56.911+0000 7f939b968700 1 -- 172.21.15.71:0/3490332587 shutdown_connections 2023-10-06T01:40:56.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:56.911+0000 7f939b968700 1 --2- 172.21.15.71:0/3490332587 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f9378066f30 0x7f93780693e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:56.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:56.911+0000 7f939b968700 1 --2- 172.21.15.71:0/3490332587 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93940c9f40 0x7f93940b1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:56.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:56.911+0000 7f939b968700 1 --2- 172.21.15.71:0/3490332587 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f93940af250 0x7f9394149fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:56.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:56.911+0000 7f939b968700 1 --2- 172.21.15.71:0/3490332587 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93940af620 0x7f93940c6b10 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:56.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:56.911+0000 7f939b968700 1 -- 172.21.15.71:0/3490332587 >> 172.21.15.71:0/3490332587 conn(0x7f9394069790 msgr2=0x7f93940cd7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:56.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:56.911+0000 7f939b968700 1 -- 172.21.15.71:0/3490332587 shutdown_connections 2023-10-06T01:40:56.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:56.912+0000 7f939b968700 1 -- 172.21.15.71:0/3490332587 wait complete. 2023-10-06T01:40:56.924 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T01:40:56.924 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T01:40:56.924 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi072.front.sepia.ceph.com 2023-10-06T01:40:56.924 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-06T01:40:56.924 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-06T01:40:56.925 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T01:40:56.925 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T01:40:56.925 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T01:40:56.925 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-06T01:40:56.925 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:40:56.925 DEBUG:teuthology.orchestra.run.smithi072:> ip addr 2023-10-06T01:40:56.943 INFO:teuthology.orchestra.run.smithi072.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T01:40:56.944 INFO:teuthology.orchestra.run.smithi072.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T01:40:56.944 INFO:teuthology.orchestra.run.smithi072.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T01:40:56.944 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:40:56.944 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 ::1/128 scope host 2023-10-06T01:40:56.944 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:40:56.944 INFO:teuthology.orchestra.run.smithi072.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T01:40:56.945 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f4 brd ff:ff:ff:ff:ff:ff 2023-10-06T01:40:56.945 INFO:teuthology.orchestra.run.smithi072.stdout: altname enp7s0f0 2023-10-06T01:40:56.945 INFO:teuthology.orchestra.run.smithi072.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T01:40:56.945 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f5 brd ff:ff:ff:ff:ff:ff 2023-10-06T01:40:56.945 INFO:teuthology.orchestra.run.smithi072.stdout: altname enp7s0f1 2023-10-06T01:40:56.945 INFO:teuthology.orchestra.run.smithi072.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T01:40:56.945 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:64 brd ff:ff:ff:ff:ff:ff 2023-10-06T01:40:56.945 INFO:teuthology.orchestra.run.smithi072.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T01:40:56.945 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:65 brd ff:ff:ff:ff:ff:ff 2023-10-06T01:40:56.946 INFO:teuthology.orchestra.run.smithi072.stdout: inet 172.21.15.72/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T01:40:56.946 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft 42328sec preferred_lft 42328sec 2023-10-06T01:40:56.946 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::ec4:7aff:fe8f:b765/64 scope link 2023-10-06T01:40:56.946 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:40:56.946 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-06T01:40:56.946 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:40:56.947 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-10-06T01:40:56.947 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-10-06T01:40:56.947 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link add name ceph-brx type bridge 2023-10-06T01:40:56.947 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip addr flush dev ceph-brx 2023-10-06T01:40:56.947 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set ceph-brx up 2023-10-06T01:40:56.947 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-06T01:40:56.947 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-10-06T01:40:57.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:40:57.110 DEBUG:teuthology.orchestra.run.smithi072:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T01:40:57.135 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-06T01:40:57.136 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:40:57.137 DEBUG:teuthology.orchestra.run.smithi072:> route 2023-10-06T01:40:57.207 INFO:teuthology.orchestra.run.smithi072.stdout:Kernel IP routing table 2023-10-06T01:40:57.207 INFO:teuthology.orchestra.run.smithi072.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T01:40:57.207 INFO:teuthology.orchestra.run.smithi072.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T01:40:57.207 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T01:40:57.207 INFO:teuthology.orchestra.run.smithi072.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T01:40:57.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:40:57.208 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-10-06T01:40:57.208 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-10-06T01:40:57.208 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T01:40:57.208 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T01:40:57.208 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T01:40:57.208 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-10-06T01:40:57.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:40:57.471 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list 2023-10-06T01:40:57.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:40:57.486 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list-id 2023-10-06T01:40:57.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:40:57.540 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-10-06T01:40:57.540 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-10-06T01:40:57.540 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T01:40:57.540 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-10-06T01:40:57.540 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-10-06T01:40:57.629 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-10-06T01:40:57.629 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:40:57.629 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-10-06T01:40:57.629 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-10-06T01:40:57.629 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-10-06T01:40:57.629 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-06T01:40:57.629 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-10-06T01:40:57.630 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-10-06T01:40:57.630 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-10-06T01:40:57.630 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-10-06T01:40:57.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:40:57.843 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-10-06T01:40:57.843 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-10-06T01:40:57.843 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set brx.0 up 2023-10-06T01:40:57.843 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set dev brx.0 master ceph-brx 2023-10-06T01:40:57.843 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-10-06T01:40:57.935 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-10-06T01:40:57.935 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T01:40:57.935 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-06T01:40:57.949 INFO:teuthology.orchestra.run.smithi072.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-06T01:40:57.950 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T01:40:57.950 DEBUG:teuthology.orchestra.run.smithi072:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-06T01:40:58.003 DEBUG:teuthology.orchestra.run.smithi072:> sudo modprobe fuse 2023-10-06T01:40:58.068 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T01:40:58.068 DEBUG:teuthology.orchestra.run.smithi072:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T01:40:58.132 INFO:teuthology.orchestra.run.smithi072.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T01:40:58.133 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T01:40:58.134 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T01:40:58.134 DEBUG:teuthology.orchestra.run.smithi072:> ls /sys/fs/fuse/connections 2023-10-06T01:40:58.189 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T01:40:58.190 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-10-06T01:40:58.231 DEBUG:teuthology.orchestra.run.smithi072:> sudo modprobe fuse 2023-10-06T01:40:58.255 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T01:40:58.256 DEBUG:teuthology.orchestra.run.smithi072:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T01:40:58.320 INFO:teuthology.orchestra.run.smithi072.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T01:40:58.322 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T01:40:58.322 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T01:40:58.323 DEBUG:teuthology.orchestra.run.smithi072:> ls /sys/fs/fuse/connections 2023-10-06T01:40:58.323 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi072.stderr:2023-10-06T01:40:58.321+0000 7f01d1f0e540 -1 init, newargv = 0x55fe40721960 newargc=15 2023-10-06T01:40:58.323 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi072.stderr:ceph-fuse[97462]: starting ceph client 2023-10-06T01:40:58.326 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi072.stderr:ceph-fuse[97462]: starting fuse 2023-10-06T01:40:58.340 INFO:teuthology.orchestra.run.smithi072.stdout:46 2023-10-06T01:40:58.340 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-10-06T01:40:58.341 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T01:40:58.341 DEBUG:teuthology.orchestra.run.smithi072:> import glob 2023-10-06T01:40:58.341 DEBUG:teuthology.orchestra.run.smithi072:> import re 2023-10-06T01:40:58.341 DEBUG:teuthology.orchestra.run.smithi072:> import os 2023-10-06T01:40:58.341 DEBUG:teuthology.orchestra.run.smithi072:> import subprocess 2023-10-06T01:40:58.342 DEBUG:teuthology.orchestra.run.smithi072:> 2023-10-06T01:40:58.342 DEBUG:teuthology.orchestra.run.smithi072:> def _find_admin_socket(client_name): 2023-10-06T01:40:58.342 DEBUG:teuthology.orchestra.run.smithi072:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-10-06T01:40:58.342 DEBUG:teuthology.orchestra.run.smithi072:> files = glob.glob(asok_path) 2023-10-06T01:40:58.342 DEBUG:teuthology.orchestra.run.smithi072:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-10-06T01:40:58.343 DEBUG:teuthology.orchestra.run.smithi072:> 2023-10-06T01:40:58.343 DEBUG:teuthology.orchestra.run.smithi072:> # Given a non-glob path, it better be there 2023-10-06T01:40:58.343 DEBUG:teuthology.orchestra.run.smithi072:> if "*" not in asok_path: 2023-10-06T01:40:58.343 DEBUG:teuthology.orchestra.run.smithi072:> assert(len(files) == 1) 2023-10-06T01:40:58.343 DEBUG:teuthology.orchestra.run.smithi072:> return files[0] 2023-10-06T01:40:58.343 DEBUG:teuthology.orchestra.run.smithi072:> 2023-10-06T01:40:58.343 DEBUG:teuthology.orchestra.run.smithi072:> for f in files: 2023-10-06T01:40:58.344 DEBUG:teuthology.orchestra.run.smithi072:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T01:40:58.344 DEBUG:teuthology.orchestra.run.smithi072:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T01:40:58.344 DEBUG:teuthology.orchestra.run.smithi072:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T01:40:58.344 DEBUG:teuthology.orchestra.run.smithi072:> contents = proc_f.read() 2023-10-06T01:40:58.344 DEBUG:teuthology.orchestra.run.smithi072:> if mountpoint in contents: 2023-10-06T01:40:58.344 DEBUG:teuthology.orchestra.run.smithi072:> return f 2023-10-06T01:40:58.344 DEBUG:teuthology.orchestra.run.smithi072:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T01:40:58.345 DEBUG:teuthology.orchestra.run.smithi072:> 2023-10-06T01:40:58.345 DEBUG:teuthology.orchestra.run.smithi072:> print(_find_admin_socket("client.1")) 2023-10-06T01:40:58.345 DEBUG:teuthology.orchestra.run.smithi072:> ' 2023-10-06T01:40:58.460 INFO:teuthology.orchestra.run.smithi072.stdout:/var/run/ceph/ceph-client.1.97462.asok 2023-10-06T01:40:58.643 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.97462.asok 2023-10-06T01:40:58.643 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T01:40:58.643 DEBUG:teuthology.orchestra.run.smithi072:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.97462.asok status 2023-10-06T01:40:58.794 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-10-06T01:40:58.794 INFO:teuthology.orchestra.run.smithi072.stdout: "metadata": { 2023-10-06T01:40:58.794 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph_sha1": "736ac5ba72cb47af7d6f6666b1e100f7e20a20e2", 2023-10-06T01:40:58.794 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph_version": "ceph version 17.2.6-1296-g736ac5ba (736ac5ba72cb47af7d6f6666b1e100f7e20a20e2) quincy (stable)", 2023-10-06T01:40:58.794 INFO:teuthology.orchestra.run.smithi072.stdout: "entity_id": "1", 2023-10-06T01:40:58.794 INFO:teuthology.orchestra.run.smithi072.stdout: "hostname": "smithi072", 2023-10-06T01:40:58.794 INFO:teuthology.orchestra.run.smithi072.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-10-06T01:40:58.795 INFO:teuthology.orchestra.run.smithi072.stdout: "pid": "97462", 2023-10-06T01:40:58.795 INFO:teuthology.orchestra.run.smithi072.stdout: "root": "/" 2023-10-06T01:40:58.795 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-10-06T01:40:58.795 INFO:teuthology.orchestra.run.smithi072.stdout: "dentry_count": 0, 2023-10-06T01:40:58.795 INFO:teuthology.orchestra.run.smithi072.stdout: "dentry_pinned_count": 0, 2023-10-06T01:40:58.795 INFO:teuthology.orchestra.run.smithi072.stdout: "id": 4598, 2023-10-06T01:40:58.795 INFO:teuthology.orchestra.run.smithi072.stdout: "inst": { 2023-10-06T01:40:58.796 INFO:teuthology.orchestra.run.smithi072.stdout: "name": { 2023-10-06T01:40:58.796 INFO:teuthology.orchestra.run.smithi072.stdout: "type": "client", 2023-10-06T01:40:58.796 INFO:teuthology.orchestra.run.smithi072.stdout: "num": 4598 2023-10-06T01:40:58.796 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-10-06T01:40:58.796 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": { 2023-10-06T01:40:58.796 INFO:teuthology.orchestra.run.smithi072.stdout: "type": "v1", 2023-10-06T01:40:58.796 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": "192.168.0.1:0", 2023-10-06T01:40:58.796 INFO:teuthology.orchestra.run.smithi072.stdout: "nonce": 2714480846 2023-10-06T01:40:58.796 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-10-06T01:40:58.796 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-10-06T01:40:58.797 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": { 2023-10-06T01:40:58.797 INFO:teuthology.orchestra.run.smithi072.stdout: "type": "v1", 2023-10-06T01:40:58.797 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": "192.168.0.1:0", 2023-10-06T01:40:58.797 INFO:teuthology.orchestra.run.smithi072.stdout: "nonce": 2714480846 2023-10-06T01:40:58.797 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-10-06T01:40:58.797 INFO:teuthology.orchestra.run.smithi072.stdout: "inst_str": "client.4598 192.168.0.1:0/2714480846", 2023-10-06T01:40:58.797 INFO:teuthology.orchestra.run.smithi072.stdout: "addr_str": "192.168.0.1:0/2714480846", 2023-10-06T01:40:58.797 INFO:teuthology.orchestra.run.smithi072.stdout: "inode_count": 1, 2023-10-06T01:40:58.797 INFO:teuthology.orchestra.run.smithi072.stdout: "mds_epoch": 9, 2023-10-06T01:40:58.797 INFO:teuthology.orchestra.run.smithi072.stdout: "osd_epoch": 27, 2023-10-06T01:40:58.797 INFO:teuthology.orchestra.run.smithi072.stdout: "osd_epoch_barrier": 0, 2023-10-06T01:40:58.797 INFO:teuthology.orchestra.run.smithi072.stdout: "blocklisted": false, 2023-10-06T01:40:58.798 INFO:teuthology.orchestra.run.smithi072.stdout: "fs_name": "cephfs" 2023-10-06T01:40:58.798 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-10-06T01:40:58.804 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T01:40:58.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:58.930+0000 7f550b59e700 1 Processor -- start 2023-10-06T01:40:58.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:58.930+0000 7f550b59e700 1 -- start start 2023-10-06T01:40:58.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:58.931+0000 7f550b59e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f550c155550 0x7f550c0c7800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:58.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:58.931+0000 7f550b59e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f550c155920 0x7f550c0c7d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:58.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:58.931+0000 7f550b59e700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f550c0c9920 0x7f550c0c9da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:58.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:58.931+0000 7f550b59e700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f550c0c14c0 con 0x7f550c0c9920 2023-10-06T01:40:58.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:58.931+0000 7f550b59e700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f550c0c8570 con 0x7f550c155920 2023-10-06T01:40:58.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:58.931+0000 7f550b59e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f550c0c0b90 con 0x7f550c155550 2023-10-06T01:40:58.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:58.931+0000 7f550ad9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f550c0c9920 0x7f550c0c9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:58.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:58.931+0000 7f550ad9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f550c0c9920 0x7f550c0c9da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52552/0 (socket says 172.21.15.71:52552) 2023-10-06T01:40:58.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:58.931+0000 7f550ad9d700 1 -- 172.21.15.71:0/3084724779 learned_addr learned my addr 172.21.15.71:0/3084724779 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:58.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:58.931+0000 7f550a59c700 1 --2- 172.21.15.71:0/3084724779 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f550c155550 0x7f550c0c7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:58.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:58.931+0000 7f5501d9b700 1 --2- 172.21.15.71:0/3084724779 >> v2:172.21.15.72:3300/0 conn(0x7f550c155920 0x7f550c0c7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:58.935 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:58.931+0000 7f550ad9d700 1 -- 172.21.15.71:0/3084724779 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f550c155550 msgr2=0x7f550c0c7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:58.935 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:58.931+0000 7f550ad9d700 1 --2- 172.21.15.71:0/3084724779 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f550c155550 0x7f550c0c7800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:58.935 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:58.931+0000 7f550ad9d700 1 -- 172.21.15.71:0/3084724779 >> v2:172.21.15.72:3300/0 conn(0x7f550c155920 msgr2=0x7f550c0c7d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:58.935 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:58.931+0000 7f550ad9d700 1 --2- 172.21.15.71:0/3084724779 >> v2:172.21.15.72:3300/0 conn(0x7f550c155920 0x7f550c0c7d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:58.935 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:58.931+0000 7f550ad9d700 1 -- 172.21.15.71:0/3084724779 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f550c0c0e70 con 0x7f550c0c9920 2023-10-06T01:40:58.935 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:58.932+0000 7f550ad9d700 1 --2- 172.21.15.71:0/3084724779 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f550c0c9920 0x7f550c0c9da0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f550c06de80 tx=0x7f5504009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a40631e2956b5e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:58.935 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:58.932+0000 7f5509d9b700 1 -- 172.21.15.71:0/3084724779 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f550400e070 con 0x7f550c0c9920 2023-10-06T01:40:58.935 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:58.932+0000 7f5509d9b700 1 -- 172.21.15.71:0/3084724779 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f550400b970 con 0x7f550c0c9920 2023-10-06T01:40:58.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:58.932+0000 7f5509d9b700 1 -- 172.21.15.71:0/3084724779 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55040092e0 con 0x7f550c0c9920 2023-10-06T01:40:58.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:58.932+0000 7f550b59e700 1 -- 172.21.15.71:0/3084724779 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f550c0c9920 msgr2=0x7f550c0c9da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:58.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:58.932+0000 7f550b59e700 1 --2- 172.21.15.71:0/3084724779 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f550c0c9920 0x7f550c0c9da0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f550c06de80 tx=0x7f5504009840 comp rx=0 tx=0).stop 2023-10-06T01:40:58.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:58.932+0000 7f550b59e700 1 -- 172.21.15.71:0/3084724779 shutdown_connections 2023-10-06T01:40:58.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:58.932+0000 7f550b59e700 1 --2- 172.21.15.71:0/3084724779 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f550c0c9920 0x7f550c0c9da0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:58.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:58.932+0000 7f550b59e700 1 --2- 172.21.15.71:0/3084724779 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f550c155550 0x7f550c0c7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:58.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:58.932+0000 7f550b59e700 1 --2- 172.21.15.71:0/3084724779 >> v2:172.21.15.72:3300/0 conn(0x7f550c155920 0x7f550c0c7d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:58.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:58.932+0000 7f550b59e700 1 -- 172.21.15.71:0/3084724779 >> 172.21.15.71:0/3084724779 conn(0x7f550c0cbd50 msgr2=0x7f550c0cc150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:58.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:58.932+0000 7f550b59e700 1 -- 172.21.15.71:0/3084724779 shutdown_connections 2023-10-06T01:40:58.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:58.932+0000 7f550b59e700 1 -- 172.21.15.71:0/3084724779 wait complete. 2023-10-06T01:40:58.939 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:58.933+0000 7f550b59e700 1 Processor -- start 2023-10-06T01:40:58.939 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:58.933+0000 7f550b59e700 1 -- start start 2023-10-06T01:40:58.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:58.934+0000 7f550b59e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f550c0c9920 0x7f550c0c4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:58.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:58.934+0000 7f550b59e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f550c155550 0x7f550c0c5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:58.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:58.934+0000 7f550b59e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f550c155920 0x7f550c165de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:58.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:58.934+0000 7f550b59e700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f550c0a51a0 con 0x7f550c155920 2023-10-06T01:40:58.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:58.934+0000 7f550b59e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f550c1676b0 con 0x7f550c0c9920 2023-10-06T01:40:58.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:58.934+0000 7f550b59e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f550c1670a0 con 0x7f550c155550 2023-10-06T01:40:58.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:58.934+0000 7f550ad9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f550c155920 0x7f550c165de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:58.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:58.934+0000 7f550ad9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f550c155920 0x7f550c165de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52566/0 (socket says 172.21.15.71:52566) 2023-10-06T01:40:58.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:58.934+0000 7f550ad9d700 1 -- 172.21.15.71:0/542200328 learned_addr learned my addr 172.21.15.71:0/542200328 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:40:58.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:58.935+0000 7f5501d9b700 1 --2- 172.21.15.71:0/542200328 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f550c155550 0x7f550c0c5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:58.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:58.935+0000 7f550a59c700 1 --2- 172.21.15.71:0/542200328 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f550c0c9920 0x7f550c0c4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:58.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:58.935+0000 7f550ad9d700 1 -- 172.21.15.71:0/542200328 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f550c155550 msgr2=0x7f550c0c5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:58.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:58.935+0000 7f550ad9d700 1 --2- 172.21.15.71:0/542200328 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f550c155550 0x7f550c0c5230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:58.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:58.935+0000 7f550ad9d700 1 -- 172.21.15.71:0/542200328 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f550c0c9920 msgr2=0x7f550c0c4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:58.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:58.935+0000 7f550ad9d700 1 --2- 172.21.15.71:0/542200328 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f550c0c9920 0x7f550c0c4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:58.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:58.935+0000 7f550ad9d700 1 -- 172.21.15.71:0/542200328 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5504009ae0 con 0x7f550c155920 2023-10-06T01:40:58.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:58.935+0000 7f5501d9b700 1 --2- 172.21.15.71:0/542200328 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f550c155550 0x7f550c0c5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:40:58.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:58.935+0000 7f550a59c700 1 --2- 172.21.15.71:0/542200328 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f550c0c9920 0x7f550c0c4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:40:58.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:58.935+0000 7f550ad9d700 1 --2- 172.21.15.71:0/542200328 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f550c155920 0x7f550c165de0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f550c069a00 tx=0x7f5504018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:58.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:58.935+0000 7f5502ffd700 1 -- 172.21.15.71:0/542200328 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5504008b80 con 0x7f550c155920 2023-10-06T01:40:58.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:58.935+0000 7f5502ffd700 1 -- 172.21.15.71:0/542200328 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5504008ce0 con 0x7f550c155920 2023-10-06T01:40:58.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:58.935+0000 7f5502ffd700 1 -- 172.21.15.71:0/542200328 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55040266b0 con 0x7f550c155920 2023-10-06T01:40:58.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:58.935+0000 7f550b59e700 1 -- 172.21.15.71:0/542200328 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f550c0c58d0 con 0x7f550c155920 2023-10-06T01:40:58.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:58.935+0000 7f550b59e700 1 -- 172.21.15.71:0/542200328 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f550c0c5bb0 con 0x7f550c155920 2023-10-06T01:40:58.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:58.936+0000 7f550b59e700 1 -- 172.21.15.71:0/542200328 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f550c06d3d0 con 0x7f550c155920 2023-10-06T01:40:58.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:58.936+0000 7f5502ffd700 1 -- 172.21.15.71:0/542200328 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5504003040 con 0x7f550c155920 2023-10-06T01:40:58.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:58.937+0000 7f5502ffd700 1 --2- 172.21.15.71:0/542200328 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f54ec066f30 0x7f54ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:58.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:58.937+0000 7f5502ffd700 1 -- 172.21.15.71:0/542200328 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f5504086260 con 0x7f550c155920 2023-10-06T01:40:58.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:58.937+0000 7f550a59c700 1 --2- 172.21.15.71:0/542200328 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f54ec066f30 0x7f54ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:58.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:58.937+0000 7f550a59c700 1 --2- 172.21.15.71:0/542200328 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f54ec066f30 0x7f54ec0693e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f54fc009d80 tx=0x7f54fc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:58.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:58.941+0000 7f5502ffd700 1 -- 172.21.15.71:0/542200328 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5504053080 con 0x7f550c155920 2023-10-06T01:40:59.168 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:59.167+0000 7f550b59e700 1 -- 172.21.15.71:0/542200328 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f550c0c1150 con 0x7f550c155920 2023-10-06T01:40:59.168 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:59.167+0000 7f5502ffd700 1 -- 172.21.15.71:0/542200328 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f55040566a0 con 0x7f550c155920 2023-10-06T01:40:59.168 INFO:teuthology.orchestra.run.smithi071.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-06T01:40:59.170 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:59.169+0000 7f550b59e700 1 -- 172.21.15.71:0/542200328 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f54ec066f30 msgr2=0x7f54ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:59.170 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:59.169+0000 7f550b59e700 1 --2- 172.21.15.71:0/542200328 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f54ec066f30 0x7f54ec0693e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f54fc009d80 tx=0x7f54fc008040 comp rx=0 tx=0).stop 2023-10-06T01:40:59.170 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:59.169+0000 7f550b59e700 1 -- 172.21.15.71:0/542200328 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f550c155920 msgr2=0x7f550c165de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:59.170 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:59.169+0000 7f550b59e700 1 --2- 172.21.15.71:0/542200328 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f550c155920 0x7f550c165de0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f550c069a00 tx=0x7f5504018000 comp rx=0 tx=0).stop 2023-10-06T01:40:59.170 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:59.169+0000 7f550b59e700 1 -- 172.21.15.71:0/542200328 shutdown_connections 2023-10-06T01:40:59.170 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:59.169+0000 7f550b59e700 1 --2- 172.21.15.71:0/542200328 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f550c155920 0x7f550c165de0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:59.170 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:59.169+0000 7f550b59e700 1 --2- 172.21.15.71:0/542200328 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f54ec066f30 0x7f54ec0693e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:59.170 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:59.169+0000 7f550b59e700 1 --2- 172.21.15.71:0/542200328 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f550c0c9920 0x7f550c0c4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:59.171 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:59.169+0000 7f550b59e700 1 --2- 172.21.15.71:0/542200328 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f550c155550 0x7f550c0c5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:59.171 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:59.169+0000 7f550b59e700 1 -- 172.21.15.71:0/542200328 >> 172.21.15.71:0/542200328 conn(0x7f550c0cbd50 msgr2=0x7f550c0c9cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:59.171 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:59.169+0000 7f550b59e700 1 -- 172.21.15.71:0/542200328 shutdown_connections 2023-10-06T01:40:59.171 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:40:59.169+0000 7f550b59e700 1 -- 172.21.15.71:0/542200328 wait complete. 2023-10-06T01:40:59.181 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T01:40:59.181 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T01:40:59.182 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi072.front.sepia.ceph.com 2023-10-06T01:40:59.182 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-10-06T01:40:59.182 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-10-06T01:40:59.182 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T01:40:59.182 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T01:40:59.182 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T01:40:59.182 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-10-06T01:40:59.182 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:40:59.182 DEBUG:teuthology.orchestra.run.smithi072:> ip addr 2023-10-06T01:40:59.198 INFO:teuthology.orchestra.run.smithi072.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T01:40:59.198 INFO:teuthology.orchestra.run.smithi072.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T01:40:59.198 INFO:teuthology.orchestra.run.smithi072.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T01:40:59.198 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:40:59.198 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 ::1/128 scope host 2023-10-06T01:40:59.198 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:40:59.198 INFO:teuthology.orchestra.run.smithi072.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T01:40:59.199 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f4 brd ff:ff:ff:ff:ff:ff 2023-10-06T01:40:59.199 INFO:teuthology.orchestra.run.smithi072.stdout: altname enp7s0f0 2023-10-06T01:40:59.199 INFO:teuthology.orchestra.run.smithi072.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T01:40:59.199 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f5 brd ff:ff:ff:ff:ff:ff 2023-10-06T01:40:59.199 INFO:teuthology.orchestra.run.smithi072.stdout: altname enp7s0f1 2023-10-06T01:40:59.199 INFO:teuthology.orchestra.run.smithi072.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T01:40:59.199 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:64 brd ff:ff:ff:ff:ff:ff 2023-10-06T01:40:59.199 INFO:teuthology.orchestra.run.smithi072.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T01:40:59.199 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:65 brd ff:ff:ff:ff:ff:ff 2023-10-06T01:40:59.199 INFO:teuthology.orchestra.run.smithi072.stdout: inet 172.21.15.72/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T01:40:59.199 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft 42325sec preferred_lft 42325sec 2023-10-06T01:40:59.199 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::ec4:7aff:fe8f:b765/64 scope link 2023-10-06T01:40:59.200 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:40:59.200 INFO:teuthology.orchestra.run.smithi072.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T01:40:59.200 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 46:a1:d8:60:12:70 brd ff:ff:ff:ff:ff:ff 2023-10-06T01:40:59.200 INFO:teuthology.orchestra.run.smithi072.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T01:40:59.200 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:40:59.200 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::7c79:9cff:fe36:7166/64 scope link 2023-10-06T01:40:59.200 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:40:59.200 INFO:teuthology.orchestra.run.smithi072.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T01:40:59.200 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 46:a1:d8:60:12:70 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T01:40:59.200 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::44a1:d8ff:fe60:1270/64 scope link tentative 2023-10-06T01:40:59.200 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:40:59.201 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:40:59.201 DEBUG:teuthology.orchestra.run.smithi072:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T01:40:59.262 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-06T01:40:59.263 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:40:59.263 DEBUG:teuthology.orchestra.run.smithi072:> route 2023-10-06T01:40:59.320 INFO:teuthology.orchestra.run.smithi072.stdout:Kernel IP routing table 2023-10-06T01:40:59.320 INFO:teuthology.orchestra.run.smithi072.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T01:40:59.320 INFO:teuthology.orchestra.run.smithi072.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T01:40:59.320 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T01:40:59.320 INFO:teuthology.orchestra.run.smithi072.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T01:40:59.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:40:59.321 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-10-06T01:40:59.321 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-10-06T01:40:59.321 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T01:40:59.321 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T01:40:59.321 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T01:40:59.321 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-10-06T01:40:59.420 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:40:59.420 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list 2023-10-06T01:40:59.434 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-06T01:40:59.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:40:59.435 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list-id 2023-10-06T01:40:59.489 INFO:teuthology.orchestra.run.smithi072.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-10-06T01:40:59.489 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:40:59.490 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-10-06T01:40:59.490 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-10-06T01:40:59.490 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-06T01:40:59.490 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-10-06T01:40:59.490 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-10-06T01:40:59.578 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:40:59.578 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-06T01:40:59.612 INFO:teuthology.orchestra.run.smithi072.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T01:40:59.613 INFO:teuthology.orchestra.run.smithi072.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T01:40:59.613 INFO:teuthology.orchestra.run.smithi072.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T01:40:59.613 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:40:59.613 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 ::1/128 scope host 2023-10-06T01:40:59.613 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:40:59.613 INFO:teuthology.orchestra.run.smithi072.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T01:40:59.613 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether a6:ec:dc:fb:03:bb brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-06T01:40:59.613 INFO:teuthology.orchestra.run.smithi072.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-06T01:40:59.613 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:40:59.613 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::a4ec:dcff:fefb:3bb/64 scope link 2023-10-06T01:40:59.613 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:40:59.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:40:59.625 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-06T01:40:59.698 INFO:teuthology.orchestra.run.smithi072.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T01:40:59.698 INFO:teuthology.orchestra.run.smithi072.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T01:40:59.699 INFO:teuthology.orchestra.run.smithi072.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T01:40:59.699 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:40:59.699 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 ::1/128 scope host 2023-10-06T01:40:59.699 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:40:59.699 INFO:teuthology.orchestra.run.smithi072.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T01:40:59.699 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether a6:ec:dc:fb:03:bb brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-06T01:40:59.699 INFO:teuthology.orchestra.run.smithi072.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-06T01:40:59.699 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:40:59.699 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::a4ec:dcff:fefb:3bb/64 scope link 2023-10-06T01:40:59.700 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:40:59.707 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-10-06T01:40:59.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:40:59.708 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-10-06T01:40:59.708 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-10-06T01:40:59.708 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-10-06T01:40:59.708 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-06T01:40:59.708 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-10-06T01:40:59.708 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-10-06T01:40:59.709 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-10-06T01:40:59.709 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-10-06T01:40:59.920 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:40:59.920 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-10-06T01:40:59.921 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-10-06T01:40:59.921 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set brx.1 up 2023-10-06T01:40:59.921 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set dev brx.1 master ceph-brx 2023-10-06T01:40:59.921 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-10-06T01:41:00.012 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2023-10-06T01:41:00.012 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T01:41:00.012 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-10-06T01:41:00.027 INFO:teuthology.orchestra.run.smithi072.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-10-06T01:41:00.027 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T01:41:00.027 DEBUG:teuthology.orchestra.run.smithi072:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-10-06T01:41:00.081 DEBUG:teuthology.orchestra.run.smithi072:> sudo modprobe fuse 2023-10-06T01:41:00.145 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T01:41:00.145 DEBUG:teuthology.orchestra.run.smithi072:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T01:41:00.209 INFO:teuthology.orchestra.run.smithi072.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T01:41:00.209 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T01:41:00.210 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T01:41:00.210 DEBUG:teuthology.orchestra.run.smithi072:> ls /sys/fs/fuse/connections 2023-10-06T01:41:00.265 INFO:teuthology.orchestra.run.smithi072.stdout:46 2023-10-06T01:41:00.265 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [46] 2023-10-06T01:41:00.266 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2023-10-06T01:41:00.308 DEBUG:teuthology.orchestra.run.smithi072:> sudo modprobe fuse 2023-10-06T01:41:00.331 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T01:41:00.332 DEBUG:teuthology.orchestra.run.smithi072:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T01:41:00.387 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi072.stderr:2023-10-06T01:41:00.385+0000 7f2c72611540 -1 init, newargv = 0x558003808a00 newargc=15 2023-10-06T01:41:00.387 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi072.stderr:ceph-fuse[97957]: starting ceph client 2023-10-06T01:41:00.391 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi072.stderr:ceph-fuse[97957]: starting fuse 2023-10-06T01:41:00.396 INFO:teuthology.orchestra.run.smithi072.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T01:41:00.397 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T01:41:00.398 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T01:41:00.398 DEBUG:teuthology.orchestra.run.smithi072:> ls /sys/fs/fuse/connections 2023-10-06T01:41:00.453 INFO:teuthology.orchestra.run.smithi072.stdout:46 2023-10-06T01:41:00.453 INFO:teuthology.orchestra.run.smithi072.stdout:48 2023-10-06T01:41:00.454 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46, 48] 2023-10-06T01:41:00.454 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T01:41:00.454 DEBUG:teuthology.orchestra.run.smithi072:> import glob 2023-10-06T01:41:00.454 DEBUG:teuthology.orchestra.run.smithi072:> import re 2023-10-06T01:41:00.454 DEBUG:teuthology.orchestra.run.smithi072:> import os 2023-10-06T01:41:00.454 DEBUG:teuthology.orchestra.run.smithi072:> import subprocess 2023-10-06T01:41:00.454 DEBUG:teuthology.orchestra.run.smithi072:> 2023-10-06T01:41:00.454 DEBUG:teuthology.orchestra.run.smithi072:> def _find_admin_socket(client_name): 2023-10-06T01:41:00.455 DEBUG:teuthology.orchestra.run.smithi072:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2023-10-06T01:41:00.455 DEBUG:teuthology.orchestra.run.smithi072:> files = glob.glob(asok_path) 2023-10-06T01:41:00.455 DEBUG:teuthology.orchestra.run.smithi072:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2023-10-06T01:41:00.455 DEBUG:teuthology.orchestra.run.smithi072:> 2023-10-06T01:41:00.455 DEBUG:teuthology.orchestra.run.smithi072:> # Given a non-glob path, it better be there 2023-10-06T01:41:00.455 DEBUG:teuthology.orchestra.run.smithi072:> if "*" not in asok_path: 2023-10-06T01:41:00.455 DEBUG:teuthology.orchestra.run.smithi072:> assert(len(files) == 1) 2023-10-06T01:41:00.455 DEBUG:teuthology.orchestra.run.smithi072:> return files[0] 2023-10-06T01:41:00.455 DEBUG:teuthology.orchestra.run.smithi072:> 2023-10-06T01:41:00.455 DEBUG:teuthology.orchestra.run.smithi072:> for f in files: 2023-10-06T01:41:00.455 DEBUG:teuthology.orchestra.run.smithi072:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T01:41:00.456 DEBUG:teuthology.orchestra.run.smithi072:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T01:41:00.456 DEBUG:teuthology.orchestra.run.smithi072:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T01:41:00.456 DEBUG:teuthology.orchestra.run.smithi072:> contents = proc_f.read() 2023-10-06T01:41:00.456 DEBUG:teuthology.orchestra.run.smithi072:> if mountpoint in contents: 2023-10-06T01:41:00.456 DEBUG:teuthology.orchestra.run.smithi072:> return f 2023-10-06T01:41:00.456 DEBUG:teuthology.orchestra.run.smithi072:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T01:41:00.456 DEBUG:teuthology.orchestra.run.smithi072:> 2023-10-06T01:41:00.456 DEBUG:teuthology.orchestra.run.smithi072:> print(_find_admin_socket("client.3")) 2023-10-06T01:41:00.456 DEBUG:teuthology.orchestra.run.smithi072:> ' 2023-10-06T01:41:00.574 INFO:teuthology.orchestra.run.smithi072.stdout:/var/run/ceph/ceph-client.3.97957.asok 2023-10-06T01:41:00.756 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.97957.asok 2023-10-06T01:41:00.757 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T01:41:00.757 DEBUG:teuthology.orchestra.run.smithi072:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.97957.asok status 2023-10-06T01:41:00.909 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-10-06T01:41:00.909 INFO:teuthology.orchestra.run.smithi072.stdout: "metadata": { 2023-10-06T01:41:00.909 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph_sha1": "736ac5ba72cb47af7d6f6666b1e100f7e20a20e2", 2023-10-06T01:41:00.909 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph_version": "ceph version 17.2.6-1296-g736ac5ba (736ac5ba72cb47af7d6f6666b1e100f7e20a20e2) quincy (stable)", 2023-10-06T01:41:00.909 INFO:teuthology.orchestra.run.smithi072.stdout: "entity_id": "3", 2023-10-06T01:41:00.909 INFO:teuthology.orchestra.run.smithi072.stdout: "hostname": "smithi072", 2023-10-06T01:41:00.909 INFO:teuthology.orchestra.run.smithi072.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2023-10-06T01:41:00.909 INFO:teuthology.orchestra.run.smithi072.stdout: "pid": "97957", 2023-10-06T01:41:00.910 INFO:teuthology.orchestra.run.smithi072.stdout: "root": "/" 2023-10-06T01:41:00.910 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-10-06T01:41:00.910 INFO:teuthology.orchestra.run.smithi072.stdout: "dentry_count": 0, 2023-10-06T01:41:00.910 INFO:teuthology.orchestra.run.smithi072.stdout: "dentry_pinned_count": 0, 2023-10-06T01:41:00.910 INFO:teuthology.orchestra.run.smithi072.stdout: "id": 4798, 2023-10-06T01:41:00.910 INFO:teuthology.orchestra.run.smithi072.stdout: "inst": { 2023-10-06T01:41:00.910 INFO:teuthology.orchestra.run.smithi072.stdout: "name": { 2023-10-06T01:41:00.910 INFO:teuthology.orchestra.run.smithi072.stdout: "type": "client", 2023-10-06T01:41:00.910 INFO:teuthology.orchestra.run.smithi072.stdout: "num": 4798 2023-10-06T01:41:00.910 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-10-06T01:41:00.910 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": { 2023-10-06T01:41:00.910 INFO:teuthology.orchestra.run.smithi072.stdout: "type": "v1", 2023-10-06T01:41:00.911 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": "192.168.0.2:0", 2023-10-06T01:41:00.911 INFO:teuthology.orchestra.run.smithi072.stdout: "nonce": 4224893206 2023-10-06T01:41:00.911 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-10-06T01:41:00.911 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-10-06T01:41:00.911 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": { 2023-10-06T01:41:00.911 INFO:teuthology.orchestra.run.smithi072.stdout: "type": "v1", 2023-10-06T01:41:00.911 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": "192.168.0.2:0", 2023-10-06T01:41:00.911 INFO:teuthology.orchestra.run.smithi072.stdout: "nonce": 4224893206 2023-10-06T01:41:00.911 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-10-06T01:41:00.911 INFO:teuthology.orchestra.run.smithi072.stdout: "inst_str": "client.4798 192.168.0.2:0/4224893206", 2023-10-06T01:41:00.911 INFO:teuthology.orchestra.run.smithi072.stdout: "addr_str": "192.168.0.2:0/4224893206", 2023-10-06T01:41:00.911 INFO:teuthology.orchestra.run.smithi072.stdout: "inode_count": 1, 2023-10-06T01:41:00.912 INFO:teuthology.orchestra.run.smithi072.stdout: "mds_epoch": 9, 2023-10-06T01:41:00.912 INFO:teuthology.orchestra.run.smithi072.stdout: "osd_epoch": 27, 2023-10-06T01:41:00.912 INFO:teuthology.orchestra.run.smithi072.stdout: "osd_epoch_barrier": 0, 2023-10-06T01:41:00.912 INFO:teuthology.orchestra.run.smithi072.stdout: "blocklisted": false, 2023-10-06T01:41:00.912 INFO:teuthology.orchestra.run.smithi072.stdout: "fs_name": "cephfs" 2023-10-06T01:41:00.912 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-10-06T01:41:00.918 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T01:41:00.919 DEBUG:teuthology.orchestra.run.smithi071:> stat --file-system '--printf=%T 2023-10-06T01:41:00.919 DEBUG:teuthology.orchestra.run.smithi071:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-06T01:41:00.938 INFO:teuthology.orchestra.run.smithi071.stdout:fuseblk 2023-10-06T01:41:00.938 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-06T01:41:00.938 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T01:41:00.939 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T01:41:01.008 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T01:41:01.009 DEBUG:teuthology.orchestra.run.smithi071:> stat --file-system '--printf=%T 2023-10-06T01:41:01.009 DEBUG:teuthology.orchestra.run.smithi071:> ' -- /home/ubuntu/cephtest/mnt.2 2023-10-06T01:41:01.066 INFO:teuthology.orchestra.run.smithi071.stdout:fuseblk 2023-10-06T01:41:01.066 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2023-10-06T01:41:01.066 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T01:41:01.067 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-10-06T01:41:01.134 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T01:41:01.134 DEBUG:teuthology.orchestra.run.smithi072:> stat --file-system '--printf=%T 2023-10-06T01:41:01.134 DEBUG:teuthology.orchestra.run.smithi072:> ' -- /home/ubuntu/cephtest/mnt.1 2023-10-06T01:41:01.150 INFO:teuthology.orchestra.run.smithi072.stdout:fuseblk 2023-10-06T01:41:01.150 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-10-06T01:41:01.150 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T01:41:01.150 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-06T01:41:01.214 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T01:41:01.215 DEBUG:teuthology.orchestra.run.smithi072:> stat --file-system '--printf=%T 2023-10-06T01:41:01.215 DEBUG:teuthology.orchestra.run.smithi072:> ' -- /home/ubuntu/cephtest/mnt.3 2023-10-06T01:41:01.270 INFO:teuthology.orchestra.run.smithi072.stdout:fuseblk 2023-10-06T01:41:01.270 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2023-10-06T01:41:01.270 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T01:41:01.270 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-10-06T01:41:01.334 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-10-06T01:41:01.351 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:41:01.479 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.479+0000 7fd5b3bf6700 1 Processor -- start 2023-10-06T01:41:01.480 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.479+0000 7fd5b3bf6700 1 -- start start 2023-10-06T01:41:01.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.480+0000 7fd5b3bf6700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd5ac155fb0 0x7fd5ac159d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:01.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.480+0000 7fd5b3bf6700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd5ac156380 0x7fd5ac15a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:01.482 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.480+0000 7fd5b3bf6700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd5ac0aed30 0x7fd5ac0af1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:01.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.480+0000 7fd5b3bf6700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5ac0cb650 con 0x7fd5ac155fb0 2023-10-06T01:41:01.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.480+0000 7fd5b3bf6700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5ac0caa40 con 0x7fd5ac156380 2023-10-06T01:41:01.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.480+0000 7fd5b3bf6700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5ac0cad20 con 0x7fd5ac0aed30 2023-10-06T01:41:01.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.480+0000 7fd5b1992700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd5ac155fb0 0x7fd5ac159d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:01.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.480+0000 7fd5b1992700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd5ac155fb0 0x7fd5ac159d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35902/0 (socket says 172.21.15.71:35902) 2023-10-06T01:41:01.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.480+0000 7fd5b1992700 1 -- 172.21.15.71:0/2247110283 learned_addr learned my addr 172.21.15.71:0/2247110283 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:01.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.480+0000 7fd5b1191700 1 --2- 172.21.15.71:0/2247110283 >> v2:172.21.15.72:3300/0 conn(0x7fd5ac156380 0x7fd5ac15a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:01.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.480+0000 7fd5b2193700 1 --2- 172.21.15.71:0/2247110283 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd5ac0aed30 0x7fd5ac0af1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:01.484 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.480+0000 7fd5b1992700 1 -- 172.21.15.71:0/2247110283 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd5ac0aed30 msgr2=0x7fd5ac0af1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:01.484 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.480+0000 7fd5b1992700 1 --2- 172.21.15.71:0/2247110283 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd5ac0aed30 0x7fd5ac0af1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:01.484 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.480+0000 7fd5b1992700 1 -- 172.21.15.71:0/2247110283 >> v2:172.21.15.72:3300/0 conn(0x7fd5ac156380 msgr2=0x7fd5ac15a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:01.484 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.480+0000 7fd5b1992700 1 --2- 172.21.15.71:0/2247110283 >> v2:172.21.15.72:3300/0 conn(0x7fd5ac156380 0x7fd5ac15a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:01.484 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.480+0000 7fd5b1992700 1 -- 172.21.15.71:0/2247110283 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5ac0cb000 con 0x7fd5ac155fb0 2023-10-06T01:41:01.484 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.480+0000 7fd5b1992700 1 --2- 172.21.15.71:0/2247110283 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5ac155fb0 0x7fd5ac159d10 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd5ac0ae370 tx=0x7fd5a800ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=257036223e23b587 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:01.484 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.480+0000 7fd5b0990700 1 -- 172.21.15.71:0/2247110283 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a8010070 con 0x7fd5ac155fb0 2023-10-06T01:41:01.484 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.480+0000 7fd5b0990700 1 -- 172.21.15.71:0/2247110283 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5a800dde0 con 0x7fd5ac155fb0 2023-10-06T01:41:01.484 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.480+0000 7fd5b0990700 1 -- 172.21.15.71:0/2247110283 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a800b320 con 0x7fd5ac155fb0 2023-10-06T01:41:01.485 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.481+0000 7fd5b3bf6700 1 -- 172.21.15.71:0/2247110283 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5ac155fb0 msgr2=0x7fd5ac159d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:01.485 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.481+0000 7fd5b3bf6700 1 --2- 172.21.15.71:0/2247110283 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5ac155fb0 0x7fd5ac159d10 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd5ac0ae370 tx=0x7fd5a800ba50 comp rx=0 tx=0).stop 2023-10-06T01:41:01.485 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.481+0000 7fd5b3bf6700 1 -- 172.21.15.71:0/2247110283 shutdown_connections 2023-10-06T01:41:01.485 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.481+0000 7fd5b3bf6700 1 --2- 172.21.15.71:0/2247110283 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5ac155fb0 0x7fd5ac159d10 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:01.485 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.481+0000 7fd5b3bf6700 1 --2- 172.21.15.71:0/2247110283 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd5ac0aed30 0x7fd5ac0af1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:01.485 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.481+0000 7fd5b3bf6700 1 --2- 172.21.15.71:0/2247110283 >> v2:172.21.15.72:3300/0 conn(0x7fd5ac156380 0x7fd5ac15a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:01.485 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.481+0000 7fd5b3bf6700 1 -- 172.21.15.71:0/2247110283 >> 172.21.15.71:0/2247110283 conn(0x7fd5ac069100 msgr2=0x7fd5ac0ad9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:01.485 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.481+0000 7fd5b3bf6700 1 -- 172.21.15.71:0/2247110283 shutdown_connections 2023-10-06T01:41:01.485 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.481+0000 7fd5b3bf6700 1 -- 172.21.15.71:0/2247110283 wait complete. 2023-10-06T01:41:01.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.482+0000 7fd5b3bf6700 1 Processor -- start 2023-10-06T01:41:01.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.482+0000 7fd5b3bf6700 1 -- start start 2023-10-06T01:41:01.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.483+0000 7fd5b3bf6700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd5ac0aed30 0x7fd5ac14ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:01.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.483+0000 7fd5b3bf6700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5ac155fb0 0x7fd5ac158ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:01.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.483+0000 7fd5b3bf6700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd5ac156380 0x7fd5ac153060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:01.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.483+0000 7fd5b3bf6700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5ac158640 con 0x7fd5ac155fb0 2023-10-06T01:41:01.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.483+0000 7fd5b3bf6700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5ac157750 con 0x7fd5ac0aed30 2023-10-06T01:41:01.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.483+0000 7fd5b3bf6700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5ac157a30 con 0x7fd5ac156380 2023-10-06T01:41:01.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.483+0000 7fd5b1191700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5ac155fb0 0x7fd5ac158ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:01.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.483+0000 7fd5b1191700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5ac155fb0 0x7fd5ac158ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35904/0 (socket says 172.21.15.71:35904) 2023-10-06T01:41:01.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.483+0000 7fd5b1191700 1 -- 172.21.15.71:0/2324283306 learned_addr learned my addr 172.21.15.71:0/2324283306 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:01.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.483+0000 7fd5b1992700 1 --2- 172.21.15.71:0/2324283306 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd5ac0aed30 0x7fd5ac14ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:01.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.483+0000 7fd5b2193700 1 --2- 172.21.15.71:0/2324283306 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd5ac156380 0x7fd5ac153060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:01.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.483+0000 7fd5b1191700 1 -- 172.21.15.71:0/2324283306 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd5ac156380 msgr2=0x7fd5ac153060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:01.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.483+0000 7fd5b1191700 1 --2- 172.21.15.71:0/2324283306 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd5ac156380 0x7fd5ac153060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:01.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.483+0000 7fd5b1191700 1 -- 172.21.15.71:0/2324283306 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd5ac0aed30 msgr2=0x7fd5ac14ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:01.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.483+0000 7fd5b1191700 1 --2- 172.21.15.71:0/2324283306 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd5ac0aed30 0x7fd5ac14ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:01.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.483+0000 7fd5b1191700 1 -- 172.21.15.71:0/2324283306 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5a800bcf0 con 0x7fd5ac155fb0 2023-10-06T01:41:01.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.483+0000 7fd5b1191700 1 --2- 172.21.15.71:0/2324283306 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5ac155fb0 0x7fd5ac158ad0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd59c00e900 tx=0x7fd59c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:01.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.484+0000 7fd5a1ffb700 1 -- 172.21.15.71:0/2324283306 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd59c013680 con 0x7fd5ac155fb0 2023-10-06T01:41:01.490 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.484+0000 7fd5a1ffb700 1 -- 172.21.15.71:0/2324283306 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd59c0137e0 con 0x7fd5ac155fb0 2023-10-06T01:41:01.490 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.484+0000 7fd5b3bf6700 1 -- 172.21.15.71:0/2324283306 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5ac157d10 con 0x7fd5ac155fb0 2023-10-06T01:41:01.490 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.484+0000 7fd5a1ffb700 1 -- 172.21.15.71:0/2324283306 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd59c013ba0 con 0x7fd5ac155fb0 2023-10-06T01:41:01.490 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.484+0000 7fd5b3bf6700 1 -- 172.21.15.71:0/2324283306 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5ac1582d0 con 0x7fd5ac155fb0 2023-10-06T01:41:01.490 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.485+0000 7fd5b3bf6700 1 -- 172.21.15.71:0/2324283306 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5ac1587b0 con 0x7fd5ac155fb0 2023-10-06T01:41:01.490 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.485+0000 7fd5a1ffb700 1 -- 172.21.15.71:0/2324283306 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd59c0123d0 con 0x7fd5ac155fb0 2023-10-06T01:41:01.490 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.486+0000 7fd5a1ffb700 1 --2- 172.21.15.71:0/2324283306 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fd590066f30 0x7fd5900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:01.490 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.486+0000 7fd5a1ffb700 1 -- 172.21.15.71:0/2324283306 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fd59c084a00 con 0x7fd5ac155fb0 2023-10-06T01:41:01.490 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.486+0000 7fd5b1992700 1 --2- 172.21.15.71:0/2324283306 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fd590066f30 0x7fd5900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:01.490 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.486+0000 7fd5b1992700 1 --2- 172.21.15.71:0/2324283306 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fd590066f30 0x7fd5900693e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd5a800e010 tx=0x7fd5a801a000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:01.491 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.490+0000 7fd5a1ffb700 1 -- 172.21.15.71:0/2324283306 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd59c051820 con 0x7fd5ac155fb0 2023-10-06T01:41:01.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.672+0000 7fd5b3bf6700 1 -- 172.21.15.71:0/2324283306 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd5ac0cb2e0 con 0x7fd5ac155fb0 2023-10-06T01:41:01.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.673+0000 7fd5a1ffb700 1 -- 172.21.15.71:0/2324283306 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18659 (secure 0 0 0) 0x7fd59c054e40 con 0x7fd5ac155fb0 2023-10-06T01:41:01.674 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:41:01.674 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":27,"fsid":"1fbf1bd2-f9b4-4599-bea2-f4aa920e9a56","created":"2023-10-06T01:39:57.016957+0000","modified":"2023-10-06T01:40:26.202441+0000","last_up_change":"2023-10-06T01:40:08.571643+0000","last_in_change":"2023-10-06T01:39:59.462741+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T01:40:08.610349+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T01:40:15.387434+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T01:40:19.640459+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T01:40:20.116883+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T01:40:23.830129+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cf059188-fb20-4dbf-95db-dcf57b213d03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":90670},{"type":"v1","addr":"172.21.15.71:6817","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":90670},{"type":"v1","addr":"172.21.15.71:6819","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":90670},{"type":"v1","addr":"172.21.15.71:6823","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":90670},{"type":"v1","addr":"172.21.15.71:6821","nonce":90670}]},"public_addr":"172.21.15.71:6817/90670","cluster_addr":"172.21.15.71:6819/90670","heartbeat_back_addr":"172.21.15.71:6823/90670","heartbeat_front_addr":"172.21.15.71:6821/90670","state":["exists","up"]},{"osd":1,"uuid":"0cff0aae-1799-4fe0-b610-54cf0813c0e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":90669},{"type":"v1","addr":"172.21.15.71:6809","nonce":90669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":90669},{"type":"v1","addr":"172.21.15.71:6811","nonce":90669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":90669},{"type":"v1","addr":"172.21.15.71:6815","nonce":90669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":90669},{"type":"v1","addr":"172.21.15.71:6813","nonce":90669}]},"public_addr":"172.21.15.71:6809/90669","cluster_addr":"172.21.15.71:6811/90669","heartbeat_back_addr":"172.21.15.71:6815/90669","heartbeat_front_addr":"172.21.15.71:6813/90669","state":["exists","up"]},{"osd":2,"uuid":"88d61ddc-9031-44e1-ba8c-546a41e7c8ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":90679},{"type":"v1","addr":"172.21.15.71:6825","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":90679},{"type":"v1","addr":"172.21.15.71:6827","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":90679},{"type":"v1","addr":"172.21.15.71:6831","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":90679},{"type":"v1","addr":"172.21.15.71:6829","nonce":90679}]},"public_addr":"172.21.15.71:6825/90679","cluster_addr":"172.21.15.71:6827/90679","heartbeat_back_addr":"172.21.15.71:6831/90679","heartbeat_front_addr":"172.21.15.71:6829/90679","state":["exists","up"]},{"osd":3,"uuid":"11ed92b7-960b-4a30-a889-a61d3eeb86f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":90668},{"type":"v1","addr":"172.21.15.71:6801","nonce":90668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":90668},{"type":"v1","addr":"172.21.15.71:6803","nonce":90668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":90668},{"type":"v1","addr":"172.21.15.71:6807","nonce":90668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":90668},{"type":"v1","addr":"172.21.15.71:6805","nonce":90668}]},"public_addr":"172.21.15.71:6801/90668","cluster_addr":"172.21.15.71:6803/90668","heartbeat_back_addr":"172.21.15.71:6807/90668","heartbeat_front_addr":"172.21.15.71:6805/90668","state":["exists","up"]},{"osd":4,"uuid":"ae4df784-abdf-4ddf-aefa-780f3ddafef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":90917},{"type":"v1","addr":"172.21.15.72:6801","nonce":90917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":90917},{"type":"v1","addr":"172.21.15.72:6803","nonce":90917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":90917},{"type":"v1","addr":"172.21.15.72:6807","nonce":90917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":90917},{"type":"v1","addr":"172.21.15.72:6805","nonce":90917}]},"public_addr":"172.21.15.72:6801/90917","cluster_addr":"172.21.15.72:6803/90917","heartbeat_back_addr":"172.21.15.72:6807/90917","heartbeat_front_addr":"172.21.15.72:6805/90917","state":["exists","up"]},{"osd":5,"uuid":"5ef0790f-001e-458f-a05b-efae216cf435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":90941},{"type":"v1","addr":"172.21.15.72:6817","nonce":90941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":90941},{"type":"v1","addr":"172.21.15.72:6819","nonce":90941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":90941},{"type":"v1","addr":"172.21.15.72:6827","nonce":90941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":90941},{"type":"v1","addr":"172.21.15.72:6823","nonce":90941}]},"public_addr":"172.21.15.72:6817/90941","cluster_addr":"172.21.15.72:6819/90941","heartbeat_back_addr":"172.21.15.72:6827/90941","heartbeat_front_addr":"172.21.15.72:6823/90941","state":["exists","up"]},{"osd":6,"uuid":"8705aef1-9ae8-4e54-a3c4-c2909fa0ceb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":90918},{"type":"v1","addr":"172.21.15.72:6809","nonce":90918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":90918},{"type":"v1","addr":"172.21.15.72:6811","nonce":90918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":90918},{"type":"v1","addr":"172.21.15.72:6815","nonce":90918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":90918},{"type":"v1","addr":"172.21.15.72:6813","nonce":90918}]},"public_addr":"172.21.15.72:6809/90918","cluster_addr":"172.21.15.72:6811/90918","heartbeat_back_addr":"172.21.15.72:6815/90918","heartbeat_front_addr":"172.21.15.72:6813/90918","state":["exists","up"]},{"osd":7,"uuid":"364c5119-6b13-4c75-b3f0-15e165eff86a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":90948},{"type":"v1","addr":"172.21.15.72:6822","nonce":90948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":90948},{"type":"v1","addr":"172.21.15.72:6826","nonce":90948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":90948},{"type":"v1","addr":"172.21.15.72:6831","nonce":90948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":90948},{"type":"v1","addr":"172.21.15.72:6829","nonce":90948}]},"public_addr":"172.21.15.72:6822/90948","cluster_addr":"172.21.15.72:6826/90948","heartbeat_back_addr":"172.21.15.72:6831/90948","heartbeat_front_addr":"172.21.15.72:6829/90948","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.642976+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.645372+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.619116+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.663042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.599163+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.646411+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.631545+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.669821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:41:01.676 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.675+0000 7fd5b3bf6700 1 -- 172.21.15.71:0/2324283306 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fd590066f30 msgr2=0x7fd5900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:01.676 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.675+0000 7fd5b3bf6700 1 --2- 172.21.15.71:0/2324283306 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fd590066f30 0x7fd5900693e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd5a800e010 tx=0x7fd5a801a000 comp rx=0 tx=0).stop 2023-10-06T01:41:01.677 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.675+0000 7fd5b3bf6700 1 -- 172.21.15.71:0/2324283306 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5ac155fb0 msgr2=0x7fd5ac158ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:01.677 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.675+0000 7fd5b3bf6700 1 --2- 172.21.15.71:0/2324283306 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5ac155fb0 0x7fd5ac158ad0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd59c00e900 tx=0x7fd59c0091a0 comp rx=0 tx=0).stop 2023-10-06T01:41:01.677 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.675+0000 7fd5b3bf6700 1 -- 172.21.15.71:0/2324283306 shutdown_connections 2023-10-06T01:41:01.677 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.675+0000 7fd5b3bf6700 1 --2- 172.21.15.71:0/2324283306 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd5ac156380 0x7fd5ac153060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:01.677 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.675+0000 7fd5b3bf6700 1 --2- 172.21.15.71:0/2324283306 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fd590066f30 0x7fd5900693e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:01.677 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.675+0000 7fd5b3bf6700 1 --2- 172.21.15.71:0/2324283306 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd5ac0aed30 0x7fd5ac14ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:01.677 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.675+0000 7fd5b3bf6700 1 --2- 172.21.15.71:0/2324283306 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5ac155fb0 0x7fd5ac158ad0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:01.677 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.675+0000 7fd5b3bf6700 1 -- 172.21.15.71:0/2324283306 >> 172.21.15.71:0/2324283306 conn(0x7fd5ac069100 msgr2=0x7fd5ac06e340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:01.677 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.675+0000 7fd5b3bf6700 1 -- 172.21.15.71:0/2324283306 shutdown_connections 2023-10-06T01:41:01.677 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.675+0000 7fd5b3bf6700 1 -- 172.21.15.71:0/2324283306 wait complete. 2023-10-06T01:41:01.688 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T01:40:08.610349+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T01:40:15.387434+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T01:40:19.640459+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T01:40:20.116883+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-06T01:40:23.830129+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T01:41:01.688 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T01:41:01.807 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.806+0000 7f6261872700 1 Processor -- start 2023-10-06T01:41:01.807 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.806+0000 7f6261872700 1 -- start start 2023-10-06T01:41:01.809 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.807+0000 7f6261872700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f625c0cf7d0 0x7f625c0cb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:01.809 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.807+0000 7f6261872700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f625c0cb6e0 0x7f625c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:01.809 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.807+0000 7f6261872700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f625c06a2c0 0x7f625c15d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:01.809 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.807+0000 7f6261872700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f625c159c10 con 0x7f625c06a2c0 2023-10-06T01:41:01.810 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.807+0000 7f6261872700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f625c15abd0 con 0x7f625c0cb6e0 2023-10-06T01:41:01.810 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.807+0000 7f6261872700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f625c06a740 con 0x7f625c0cf7d0 2023-10-06T01:41:01.810 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.807+0000 7f625b7fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f625c06a2c0 0x7f625c15d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:01.810 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.807+0000 7f625b7fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f625c06a2c0 0x7f625c15d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35918/0 (socket says 172.21.15.71:35918) 2023-10-06T01:41:01.810 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.807+0000 7f625b7fe700 1 -- 172.21.15.71:0/3714549800 learned_addr learned my addr 172.21.15.71:0/3714549800 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:01.810 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.807+0000 7f625affd700 1 --2- 172.21.15.71:0/3714549800 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f625c0cf7d0 0x7f625c0cb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:01.810 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.807+0000 7f625a7fc700 1 --2- 172.21.15.71:0/3714549800 >> v2:172.21.15.72:3300/0 conn(0x7f625c0cb6e0 0x7f625c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:01.810 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.807+0000 7f625b7fe700 1 -- 172.21.15.71:0/3714549800 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f625c0cf7d0 msgr2=0x7f625c0cb1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:01.810 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.807+0000 7f625b7fe700 1 --2- 172.21.15.71:0/3714549800 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f625c0cf7d0 0x7f625c0cb1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:01.810 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.807+0000 7f625b7fe700 1 -- 172.21.15.71:0/3714549800 >> v2:172.21.15.72:3300/0 conn(0x7f625c0cb6e0 msgr2=0x7f625c069d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:01.810 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.807+0000 7f625b7fe700 1 --2- 172.21.15.71:0/3714549800 >> v2:172.21.15.72:3300/0 conn(0x7f625c0cb6e0 0x7f625c069d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:01.810 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.807+0000 7f625b7fe700 1 -- 172.21.15.71:0/3714549800 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f625c0cbb80 con 0x7f625c06a2c0 2023-10-06T01:41:01.811 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.807+0000 7f625b7fe700 1 --2- 172.21.15.71:0/3714549800 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f625c06a2c0 0x7f625c15d270 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f625c089030 tx=0x7f6254009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1a8d96ec2156a83 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:01.811 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.807+0000 7f6259ffb700 1 -- 172.21.15.71:0/3714549800 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f625400e070 con 0x7f625c06a2c0 2023-10-06T01:41:01.811 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.808+0000 7f6259ffb700 1 -- 172.21.15.71:0/3714549800 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f625400b8d0 con 0x7f625c06a2c0 2023-10-06T01:41:01.811 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.808+0000 7f6259ffb700 1 -- 172.21.15.71:0/3714549800 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62540092e0 con 0x7f625c06a2c0 2023-10-06T01:41:01.811 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.808+0000 7f6261872700 1 -- 172.21.15.71:0/3714549800 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f625c06a2c0 msgr2=0x7f625c15d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:01.811 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.808+0000 7f6261872700 1 --2- 172.21.15.71:0/3714549800 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f625c06a2c0 0x7f625c15d270 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f625c089030 tx=0x7f6254009840 comp rx=0 tx=0).stop 2023-10-06T01:41:01.811 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.808+0000 7f6261872700 1 -- 172.21.15.71:0/3714549800 shutdown_connections 2023-10-06T01:41:01.811 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.808+0000 7f6261872700 1 --2- 172.21.15.71:0/3714549800 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f625c06a2c0 0x7f625c15d270 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:01.811 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.808+0000 7f6261872700 1 --2- 172.21.15.71:0/3714549800 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f625c0cf7d0 0x7f625c0cb1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:01.811 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.808+0000 7f6261872700 1 --2- 172.21.15.71:0/3714549800 >> v2:172.21.15.72:3300/0 conn(0x7f625c0cb6e0 0x7f625c069d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:01.811 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.808+0000 7f6261872700 1 -- 172.21.15.71:0/3714549800 >> 172.21.15.71:0/3714549800 conn(0x7f625c0d0c60 msgr2=0x7f625c0ccc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:01.812 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.808+0000 7f6261872700 1 -- 172.21.15.71:0/3714549800 shutdown_connections 2023-10-06T01:41:01.812 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.808+0000 7f6261872700 1 -- 172.21.15.71:0/3714549800 wait complete. 2023-10-06T01:41:01.814 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.809+0000 7f6261872700 1 Processor -- start 2023-10-06T01:41:01.814 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.810+0000 7f6261872700 1 -- start start 2023-10-06T01:41:01.814 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.810+0000 7f6261872700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f625c06a2c0 0x7f625c0c6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:01.814 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.810+0000 7f6261872700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f625c0cb6e0 0x7f625c0b4530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:01.814 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.810+0000 7f6261872700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f625c0cf7d0 0x7f625c0b4a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:01.815 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.810+0000 7f6261872700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f625c169cc0 con 0x7f625c0cf7d0 2023-10-06T01:41:01.815 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.810+0000 7f6261872700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f625c15cc40 con 0x7f625c06a2c0 2023-10-06T01:41:01.815 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.810+0000 7f6261872700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f625c16ac50 con 0x7f625c0cb6e0 2023-10-06T01:41:01.815 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.810+0000 7f625b7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f625c0cf7d0 0x7f625c0b4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:01.815 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.810+0000 7f625b7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f625c0cf7d0 0x7f625c0b4a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35934/0 (socket says 172.21.15.71:35934) 2023-10-06T01:41:01.815 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.810+0000 7f625b7fe700 1 -- 172.21.15.71:0/224232526 learned_addr learned my addr 172.21.15.71:0/224232526 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:01.815 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.810+0000 7f625a7fc700 1 --2- 172.21.15.71:0/224232526 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f625c0cb6e0 0x7f625c0b4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:01.815 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.811+0000 7f625affd700 1 --2- 172.21.15.71:0/224232526 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f625c06a2c0 0x7f625c0c6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:01.815 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.811+0000 7f625b7fe700 1 -- 172.21.15.71:0/224232526 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f625c0cb6e0 msgr2=0x7f625c0b4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:01.815 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.811+0000 7f625b7fe700 1 --2- 172.21.15.71:0/224232526 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f625c0cb6e0 0x7f625c0b4530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:01.815 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.811+0000 7f625b7fe700 1 -- 172.21.15.71:0/224232526 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f625c06a2c0 msgr2=0x7f625c0c6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:01.816 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.811+0000 7f625b7fe700 1 --2- 172.21.15.71:0/224232526 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f625c06a2c0 0x7f625c0c6270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:01.816 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.811+0000 7f625b7fe700 1 -- 172.21.15.71:0/224232526 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6254009ae0 con 0x7f625c0cf7d0 2023-10-06T01:41:01.816 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.811+0000 7f625b7fe700 1 --2- 172.21.15.71:0/224232526 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f625c0cf7d0 0x7f625c0b4a70 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f6254009ab0 tx=0x7f6254018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:01.816 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.812+0000 7f6242ffd700 1 -- 172.21.15.71:0/224232526 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f625400bea0 con 0x7f625c0cf7d0 2023-10-06T01:41:01.816 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.812+0000 7f6242ffd700 1 -- 172.21.15.71:0/224232526 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6254008ad0 con 0x7f625c0cf7d0 2023-10-06T01:41:01.816 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.812+0000 7f6261872700 1 -- 172.21.15.71:0/224232526 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f625c169eb0 con 0x7f625c0cf7d0 2023-10-06T01:41:01.816 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.812+0000 7f6242ffd700 1 -- 172.21.15.71:0/224232526 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6254008e90 con 0x7f625c0cf7d0 2023-10-06T01:41:01.816 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.812+0000 7f6261872700 1 -- 172.21.15.71:0/224232526 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f625c16a470 con 0x7f625c0cf7d0 2023-10-06T01:41:01.816 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.813+0000 7f6261872700 1 -- 172.21.15.71:0/224232526 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f625c16aac0 con 0x7f625c0cf7d0 2023-10-06T01:41:01.816 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.813+0000 7f6242ffd700 1 -- 172.21.15.71:0/224232526 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6254003040 con 0x7f625c0cf7d0 2023-10-06T01:41:01.816 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.813+0000 7f6242ffd700 1 --2- 172.21.15.71:0/224232526 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f6248066f30 0x7f62480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:01.817 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.814+0000 7f625affd700 1 --2- 172.21.15.71:0/224232526 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f6248066f30 0x7f62480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:01.817 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.814+0000 7f6242ffd700 1 -- 172.21.15.71:0/224232526 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f6254086110 con 0x7f625c0cf7d0 2023-10-06T01:41:01.817 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.814+0000 7f625affd700 1 --2- 172.21.15.71:0/224232526 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f6248066f30 0x7f62480693e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f624c009db0 tx=0x7f624c0091a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:01.818 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:01.818+0000 7f6242ffd700 1 -- 172.21.15.71:0/224232526 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6254052f30 con 0x7f625c0cf7d0 2023-10-06T01:41:02.001 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.000+0000 7f6261872700 1 -- 172.21.15.71:0/224232526 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f625c064f20 con 0x7f625c0cf7d0 2023-10-06T01:41:02.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.001+0000 7f6242ffd700 1 -- 172.21.15.71:0/224232526 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6254056550 con 0x7f625c0cf7d0 2023-10-06T01:41:02.002 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 1 2023-10-06T01:41:02.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.003+0000 7f6261872700 1 -- 172.21.15.71:0/224232526 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f6248066f30 msgr2=0x7f62480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:02.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.003+0000 7f6261872700 1 --2- 172.21.15.71:0/224232526 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f6248066f30 0x7f62480693e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f624c009db0 tx=0x7f624c0091a0 comp rx=0 tx=0).stop 2023-10-06T01:41:02.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.003+0000 7f6261872700 1 -- 172.21.15.71:0/224232526 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f625c0cf7d0 msgr2=0x7f625c0b4a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:02.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.003+0000 7f6261872700 1 --2- 172.21.15.71:0/224232526 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f625c0cf7d0 0x7f625c0b4a70 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f6254009ab0 tx=0x7f6254018000 comp rx=0 tx=0).stop 2023-10-06T01:41:02.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.003+0000 7f6261872700 1 -- 172.21.15.71:0/224232526 shutdown_connections 2023-10-06T01:41:02.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.003+0000 7f6261872700 1 --2- 172.21.15.71:0/224232526 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f625c0cf7d0 0x7f625c0b4a70 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:02.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.003+0000 7f6261872700 1 --2- 172.21.15.71:0/224232526 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f6248066f30 0x7f62480693e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:02.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.003+0000 7f6261872700 1 --2- 172.21.15.71:0/224232526 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f625c06a2c0 0x7f625c0c6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:02.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.003+0000 7f6261872700 1 --2- 172.21.15.71:0/224232526 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f625c0cb6e0 0x7f625c0b4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:02.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.003+0000 7f6261872700 1 -- 172.21.15.71:0/224232526 >> 172.21.15.71:0/224232526 conn(0x7f625c0d0c60 msgr2=0x7f625c1579a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:02.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.003+0000 7f6261872700 1 -- 172.21.15.71:0/224232526 shutdown_connections 2023-10-06T01:41:02.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.003+0000 7f6261872700 1 -- 172.21.15.71:0/224232526 wait complete. 2023-10-06T01:41:02.015 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T01:41:02.131 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.131+0000 7f54f2359700 1 Processor -- start 2023-10-06T01:41:02.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.131+0000 7f54f2359700 1 -- start start 2023-10-06T01:41:02.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.132+0000 7f54f2359700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f54ec0d0400 0x7f54ec0b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:02.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.132+0000 7f54f2359700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f54ec0d07d0 0x7f54ec0b3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:02.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.132+0000 7f54f2359700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54ec0b6170 con 0x7f54ec0ccd40 2023-10-06T01:41:02.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.132+0000 7f54f2359700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54ec15dd40 con 0x7f54ec0d07d0 2023-10-06T01:41:02.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.132+0000 7f54f2359700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54ec15e020 con 0x7f54ec0d0400 2023-10-06T01:41:02.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.132+0000 7f54f08f6700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f54ec0d07d0 0x7f54ec0b3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:02.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.132+0000 7f54f08f6700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f54ec0d07d0 0x7f54ec0b3aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35946/0 (socket says 172.21.15.71:35946) 2023-10-06T01:41:02.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.132+0000 7f54eb7fe700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f54ec0ccd40 0x7f54ec0cf2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:55842/0 (socket says 172.21.15.71:55842) 2023-10-06T01:41:02.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.132+0000 7f54f08f6700 1 -- 172.21.15.71:0/1506837216 learned_addr learned my addr 172.21.15.71:0/1506837216 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:02.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.132+0000 7f54ebfff700 1 --2- 172.21.15.71:0/1506837216 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f54ec0d0400 0x7f54ec0b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:02.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.132+0000 7f54f08f6700 1 -- 172.21.15.71:0/1506837216 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f54ec0d0400 msgr2=0x7f54ec0b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:02.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.132+0000 7f54f08f6700 1 --2- 172.21.15.71:0/1506837216 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f54ec0d0400 0x7f54ec0b5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:02.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.132+0000 7f54f08f6700 1 -- 172.21.15.71:0/1506837216 >> v1:172.21.15.71:6789/0 conn(0x7f54ec0ccd40 legacy=0x7f54ec0cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:02.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.132+0000 7f54f08f6700 1 -- 172.21.15.71:0/1506837216 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54ec0ceaa0 con 0x7f54ec0d07d0 2023-10-06T01:41:02.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.132+0000 7f54eaffd700 1 -- 172.21.15.71:0/1506837216 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 134576104 0 0) 0x7f54ec0b6170 con 0x7f54ec0ccd40 2023-10-06T01:41:02.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.132+0000 7f54f08f6700 1 --2- 172.21.15.71:0/1506837216 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f54ec0d07d0 0x7f54ec0b3aa0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f54e4009f20 tx=0x7f54e4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c48b70682adec1a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:02.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.132+0000 7f54eaffd700 1 -- 172.21.15.71:0/1506837216 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e400e070 con 0x7f54ec0d07d0 2023-10-06T01:41:02.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.132+0000 7f54eaffd700 1 -- 172.21.15.71:0/1506837216 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54e400b9d0 con 0x7f54ec0d07d0 2023-10-06T01:41:02.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.132+0000 7f54eaffd700 1 -- 172.21.15.71:0/1506837216 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e40092e0 con 0x7f54ec0d07d0 2023-10-06T01:41:02.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.133+0000 7f54f2359700 1 -- 172.21.15.71:0/1506837216 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f54ec0d07d0 msgr2=0x7f54ec0b3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:02.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.133+0000 7f54f2359700 1 --2- 172.21.15.71:0/1506837216 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f54ec0d07d0 0x7f54ec0b3aa0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f54e4009f20 tx=0x7f54e4009840 comp rx=0 tx=0).stop 2023-10-06T01:41:02.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.133+0000 7f54f2359700 1 -- 172.21.15.71:0/1506837216 shutdown_connections 2023-10-06T01:41:02.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.133+0000 7f54f2359700 1 --2- 172.21.15.71:0/1506837216 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f54ec0d07d0 0x7f54ec0b3aa0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:02.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.133+0000 7f54f2359700 1 --2- 172.21.15.71:0/1506837216 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f54ec0d0400 0x7f54ec0b5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:02.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.133+0000 7f54f2359700 1 -- 172.21.15.71:0/1506837216 >> 172.21.15.71:0/1506837216 conn(0x7f54ec06a220 msgr2=0x7f54ec06a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:02.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.133+0000 7f54f2359700 1 -- 172.21.15.71:0/1506837216 shutdown_connections 2023-10-06T01:41:02.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.133+0000 7f54f2359700 1 -- 172.21.15.71:0/1506837216 wait complete. 2023-10-06T01:41:02.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.134+0000 7f54f2359700 1 Processor -- start 2023-10-06T01:41:02.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.134+0000 7f54f2359700 1 -- start start 2023-10-06T01:41:02.143 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.135+0000 7f54f2359700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f54ec0ccd40 0x7f54ec158130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:02.143 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.135+0000 7f54f2359700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54ec0d0400 0x7f54ec15b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:02.143 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.135+0000 7f54f2359700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f54ec0d07d0 0x7f54ec15b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:02.143 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.135+0000 7f54f2359700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54ec0c5dd0 con 0x7f54ec0ccd40 2023-10-06T01:41:02.143 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.135+0000 7f54f2359700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54ec15bcb0 con 0x7f54ec0d0400 2023-10-06T01:41:02.143 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.135+0000 7f54f2359700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54ec15bed0 con 0x7f54ec0d07d0 2023-10-06T01:41:02.143 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.135+0000 7f54ebfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f54ec0ccd40 0x7f54ec158130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:02.143 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.135+0000 7f54ebfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f54ec0ccd40 0x7f54ec158130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35956/0 (socket says 172.21.15.71:35956) 2023-10-06T01:41:02.143 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.135+0000 7f54ebfff700 1 -- 172.21.15.71:0/1625789110 learned_addr learned my addr 172.21.15.71:0/1625789110 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:02.143 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.135+0000 7f54f08f6700 1 --2- 172.21.15.71:0/1625789110 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f54ec0d07d0 0x7f54ec15b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:02.143 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.135+0000 7f54eb7fe700 1 --2- 172.21.15.71:0/1625789110 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54ec0d0400 0x7f54ec15b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:02.144 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.135+0000 7f54ebfff700 1 -- 172.21.15.71:0/1625789110 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f54ec0d07d0 msgr2=0x7f54ec15b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:02.144 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.135+0000 7f54ebfff700 1 --2- 172.21.15.71:0/1625789110 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f54ec0d07d0 0x7f54ec15b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:02.144 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.135+0000 7f54ebfff700 1 -- 172.21.15.71:0/1625789110 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54ec0d0400 msgr2=0x7f54ec15b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:02.144 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.135+0000 7f54ebfff700 1 --2- 172.21.15.71:0/1625789110 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54ec0d0400 0x7f54ec15b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:02.144 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.135+0000 7f54ebfff700 1 -- 172.21.15.71:0/1625789110 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54e4009ae0 con 0x7f54ec0ccd40 2023-10-06T01:41:02.144 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.135+0000 7f54ebfff700 1 --2- 172.21.15.71:0/1625789110 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f54ec0ccd40 0x7f54ec158130 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f54dc00ecb0 tx=0x7f54dc009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:02.144 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.135+0000 7f54d3fff700 1 -- 172.21.15.71:0/1625789110 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54dc00c9d0 con 0x7f54ec0ccd40 2023-10-06T01:41:02.145 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.136+0000 7f54d3fff700 1 -- 172.21.15.71:0/1625789110 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54dc00cb30 con 0x7f54ec0ccd40 2023-10-06T01:41:02.145 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.136+0000 7f54f2359700 1 -- 172.21.15.71:0/1625789110 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54ec15c1b0 con 0x7f54ec0ccd40 2023-10-06T01:41:02.145 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.136+0000 7f54d3fff700 1 -- 172.21.15.71:0/1625789110 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54dc00ceb0 con 0x7f54ec0ccd40 2023-10-06T01:41:02.145 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.136+0000 7f54f2359700 1 -- 172.21.15.71:0/1625789110 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54ec15c7f0 con 0x7f54ec0ccd40 2023-10-06T01:41:02.145 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.136+0000 7f54f2359700 1 -- 172.21.15.71:0/1625789110 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54ec088760 con 0x7f54ec0ccd40 2023-10-06T01:41:02.145 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.137+0000 7f54d3fff700 1 -- 172.21.15.71:0/1625789110 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f54dc013680 con 0x7f54ec0ccd40 2023-10-06T01:41:02.145 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.137+0000 7f54d3fff700 1 --2- 172.21.15.71:0/1625789110 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f54d8066f30 0x7f54d80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:02.146 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.137+0000 7f54d3fff700 1 -- 172.21.15.71:0/1625789110 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f54dc0850d0 con 0x7f54ec0ccd40 2023-10-06T01:41:02.146 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.137+0000 7f54eb7fe700 1 --2- 172.21.15.71:0/1625789110 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f54d8066f30 0x7f54d80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:02.146 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.138+0000 7f54eb7fe700 1 --2- 172.21.15.71:0/1625789110 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f54d8066f30 0x7f54d80693e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f54e0007fd0 tx=0x7f54e0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:02.146 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.142+0000 7f54d3fff700 1 -- 172.21.15.71:0/1625789110 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f54dc051ef0 con 0x7f54ec0ccd40 2023-10-06T01:41:02.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.322+0000 7f54f2359700 1 -- 172.21.15.71:0/1625789110 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f54ec0ced80 con 0x7f54ec0ccd40 2023-10-06T01:41:02.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.322+0000 7f54d3fff700 1 -- 172.21.15.71:0/1625789110 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f54dc017020 con 0x7f54ec0ccd40 2023-10-06T01:41:02.323 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 8 2023-10-06T01:41:02.325 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.324+0000 7f54f2359700 1 -- 172.21.15.71:0/1625789110 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f54d8066f30 msgr2=0x7f54d80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:02.325 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.324+0000 7f54f2359700 1 --2- 172.21.15.71:0/1625789110 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f54d8066f30 0x7f54d80693e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f54e0007fd0 tx=0x7f54e0009040 comp rx=0 tx=0).stop 2023-10-06T01:41:02.325 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.324+0000 7f54f2359700 1 -- 172.21.15.71:0/1625789110 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f54ec0ccd40 msgr2=0x7f54ec158130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:02.325 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.324+0000 7f54f2359700 1 --2- 172.21.15.71:0/1625789110 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f54ec0ccd40 0x7f54ec158130 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f54dc00ecb0 tx=0x7f54dc009120 comp rx=0 tx=0).stop 2023-10-06T01:41:02.325 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.324+0000 7f54f2359700 1 -- 172.21.15.71:0/1625789110 shutdown_connections 2023-10-06T01:41:02.325 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.324+0000 7f54f2359700 1 --2- 172.21.15.71:0/1625789110 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f54ec0d07d0 0x7f54ec15b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:02.325 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.324+0000 7f54f2359700 1 --2- 172.21.15.71:0/1625789110 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f54ec0ccd40 0x7f54ec158130 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:02.326 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.324+0000 7f54f2359700 1 --2- 172.21.15.71:0/1625789110 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f54d8066f30 0x7f54d80693e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:02.326 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.324+0000 7f54f2359700 1 --2- 172.21.15.71:0/1625789110 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f54ec0d0400 0x7f54ec15b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:02.326 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.324+0000 7f54f2359700 1 -- 172.21.15.71:0/1625789110 >> 172.21.15.71:0/1625789110 conn(0x7f54ec06a220 msgr2=0x7f54ec155c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:02.326 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.324+0000 7f54f2359700 1 -- 172.21.15.71:0/1625789110 shutdown_connections 2023-10-06T01:41:02.326 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.324+0000 7f54f2359700 1 -- 172.21.15.71:0/1625789110 wait complete. 2023-10-06T01:41:02.336 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T01:41:02.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.452+0000 7f6bf6cdf700 1 Processor -- start 2023-10-06T01:41:02.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.453+0000 7f6bf6cdf700 1 -- start start 2023-10-06T01:41:02.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.453+0000 7f6bf6cdf700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6bf00c3fd0 0x7f6bf00c4440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:02.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.453+0000 7f6bf6cdf700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bf00c3b40 con 0x7f6bf01574b0 2023-10-06T01:41:02.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.453+0000 7f6bf6cdf700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bf00c2f30 con 0x7f6bf00cbcc0 2023-10-06T01:41:02.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.453+0000 7f6bf6cdf700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf00c4980 con 0x7f6bf00c3fd0 2023-10-06T01:41:02.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.453+0000 7f6bf4a7b700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f6bf01574b0 0x7f6bf00b0eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:55850/0 (socket says 172.21.15.71:55850) 2023-10-06T01:41:02.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.453+0000 7f6bf4a7b700 1 -- 172.21.15.71:0/910427540 learned_addr learned my addr 172.21.15.71:0/910427540 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:41:02.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.454+0000 7f6be7fff700 1 --2- 172.21.15.71:0/910427540 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6bf00c3fd0 0x7f6bf00c4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:02.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.454+0000 7f6be77fe700 1 -- 172.21.15.71:0/910427540 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 561956687 0 0) 0x7f6bf00c3b40 con 0x7f6bf01574b0 2023-10-06T01:41:02.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.454+0000 7f6be77fe700 1 -- 172.21.15.71:0/910427540 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6bd8003570 con 0x7f6bf01574b0 2023-10-06T01:41:02.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.454+0000 7f6be77fe700 1 -- 172.21.15.71:0/910427540 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1975776092 0 0) 0x7f6bf00c2f30 con 0x7f6bf00cbcc0 2023-10-06T01:41:02.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.454+0000 7f6be77fe700 1 -- 172.21.15.71:0/910427540 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6bf00c3b40 con 0x7f6bf00cbcc0 2023-10-06T01:41:02.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.454+0000 7f6be7fff700 1 -- 172.21.15.71:0/910427540 >> v1:172.21.15.72:6789/0 conn(0x7f6bf00cbcc0 legacy=0x7f6bf00c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:02.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.454+0000 7f6be7fff700 1 -- 172.21.15.71:0/910427540 >> v1:172.21.15.71:6789/0 conn(0x7f6bf01574b0 legacy=0x7f6bf00b0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:02.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.454+0000 7f6be7fff700 1 -- 172.21.15.71:0/910427540 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bf00c3210 con 0x7f6bf00c3fd0 2023-10-06T01:41:02.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.454+0000 7f6be7fff700 1 --2- 172.21.15.71:0/910427540 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6bf00c3fd0 0x7f6bf00c4440 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6be0009910 tx=0x7f6be00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e12117d102cb7b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:02.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.454+0000 7f6be77fe700 1 -- 172.21.15.71:0/910427540 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be0011630 con 0x7f6bf00c3fd0 2023-10-06T01:41:02.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.454+0000 7f6be77fe700 1 -- 172.21.15.71:0/910427540 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6be0011790 con 0x7f6bf00c3fd0 2023-10-06T01:41:02.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.454+0000 7f6be77fe700 1 -- 172.21.15.71:0/910427540 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be0011b30 con 0x7f6bf00c3fd0 2023-10-06T01:41:02.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.455+0000 7f6bf6cdf700 1 -- 172.21.15.71:0/910427540 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6bf00c3fd0 msgr2=0x7f6bf00c4440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:02.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.455+0000 7f6bf6cdf700 1 --2- 172.21.15.71:0/910427540 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6bf00c3fd0 0x7f6bf00c4440 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6be0009910 tx=0x7f6be00091a0 comp rx=0 tx=0).stop 2023-10-06T01:41:02.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.455+0000 7f6bf6cdf700 1 -- 172.21.15.71:0/910427540 shutdown_connections 2023-10-06T01:41:02.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.455+0000 7f6bf6cdf700 1 --2- 172.21.15.71:0/910427540 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6bf00c3fd0 0x7f6bf00c4440 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:02.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.455+0000 7f6bf6cdf700 1 -- 172.21.15.71:0/910427540 >> 172.21.15.71:0/910427540 conn(0x7f6bf0067910 msgr2=0x7f6bf00ce0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:02.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.455+0000 7f6bf6cdf700 1 -- 172.21.15.71:0/910427540 shutdown_connections 2023-10-06T01:41:02.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.455+0000 7f6bf6cdf700 1 -- 172.21.15.71:0/910427540 wait complete. 2023-10-06T01:41:02.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.456+0000 7f6bf6cdf700 1 Processor -- start 2023-10-06T01:41:02.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.456+0000 7f6bf6cdf700 1 -- start start 2023-10-06T01:41:02.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.457+0000 7f6bf6cdf700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6bf00c3fd0 0x7f6bf0144b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:02.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.457+0000 7f6bf6cdf700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6bf00cbcc0 0x7f6bf00b3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:02.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.457+0000 7f6bf6cdf700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6bf01574b0 0x7f6bf00b1850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:02.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.457+0000 7f6bf6cdf700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf0158990 con 0x7f6bf00c3fd0 2023-10-06T01:41:02.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.457+0000 7f6bf6cdf700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf01450b0 con 0x7f6bf01574b0 2023-10-06T01:41:02.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.457+0000 7f6bf6cdf700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf00b3dd0 con 0x7f6bf00cbcc0 2023-10-06T01:41:02.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.457+0000 7f6bf4a7b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6bf00c3fd0 0x7f6bf0144b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:02.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.457+0000 7f6bf4a7b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6bf00c3fd0 0x7f6bf0144b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35972/0 (socket says 172.21.15.71:35972) 2023-10-06T01:41:02.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.457+0000 7f6bf4a7b700 1 -- 172.21.15.71:0/2546316161 learned_addr learned my addr 172.21.15.71:0/2546316161 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:02.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.457+0000 7f6bf527c700 1 --2- 172.21.15.71:0/2546316161 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6bf01574b0 0x7f6bf00b1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:02.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.457+0000 7f6be7fff700 1 --2- 172.21.15.71:0/2546316161 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6bf00cbcc0 0x7f6bf00b3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:02.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.457+0000 7f6bf4a7b700 1 -- 172.21.15.71:0/2546316161 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6bf00cbcc0 msgr2=0x7f6bf00b3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:02.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.457+0000 7f6bf4a7b700 1 --2- 172.21.15.71:0/2546316161 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6bf00cbcc0 0x7f6bf00b3890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:02.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.457+0000 7f6bf4a7b700 1 -- 172.21.15.71:0/2546316161 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6bf01574b0 msgr2=0x7f6bf00b1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:02.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.457+0000 7f6bf4a7b700 1 --2- 172.21.15.71:0/2546316161 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6bf01574b0 0x7f6bf00b1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:02.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.457+0000 7f6bf4a7b700 1 -- 172.21.15.71:0/2546316161 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6be0009420 con 0x7f6bf00c3fd0 2023-10-06T01:41:02.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.457+0000 7f6bf4a7b700 1 --2- 172.21.15.71:0/2546316161 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6bf00c3fd0 0x7f6bf0144b70 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f6bec0016e0 tx=0x7f6bec0027d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:02.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.458+0000 7f6be4ff9700 1 -- 172.21.15.71:0/2546316161 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bec005b70 con 0x7f6bf00c3fd0 2023-10-06T01:41:02.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.458+0000 7f6be4ff9700 1 -- 172.21.15.71:0/2546316161 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bec005cd0 con 0x7f6bf00c3fd0 2023-10-06T01:41:02.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.458+0000 7f6bf6cdf700 1 -- 172.21.15.71:0/2546316161 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bf0157d80 con 0x7f6bf00c3fd0 2023-10-06T01:41:02.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.458+0000 7f6be4ff9700 1 -- 172.21.15.71:0/2546316161 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bec00a820 con 0x7f6bf00c3fd0 2023-10-06T01:41:02.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.458+0000 7f6bf6cdf700 1 -- 172.21.15.71:0/2546316161 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bf0158340 con 0x7f6bf00c3fd0 2023-10-06T01:41:02.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.458+0000 7f6bf6cdf700 1 -- 172.21.15.71:0/2546316161 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bf006e590 con 0x7f6bf00c3fd0 2023-10-06T01:41:02.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.459+0000 7f6be4ff9700 1 -- 172.21.15.71:0/2546316161 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6bec00ac10 con 0x7f6bf00c3fd0 2023-10-06T01:41:02.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.459+0000 7f6be4ff9700 1 --2- 172.21.15.71:0/2546316161 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f6bdc066f30 0x7f6bdc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:02.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.459+0000 7f6be7fff700 1 --2- 172.21.15.71:0/2546316161 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f6bdc066f30 0x7f6bdc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:02.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.459+0000 7f6be4ff9700 1 -- 172.21.15.71:0/2546316161 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f6bec084680 con 0x7f6bf00c3fd0 2023-10-06T01:41:02.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.460+0000 7f6be7fff700 1 --2- 172.21.15.71:0/2546316161 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f6bdc066f30 0x7f6bdc0693e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6be00091e0 tx=0x7f6be0017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:02.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.464+0000 7f6be4ff9700 1 -- 172.21.15.71:0/2546316161 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6bec051490 con 0x7f6bf00c3fd0 2023-10-06T01:41:02.646 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.646+0000 7f6bf6cdf700 1 -- 172.21.15.71:0/2546316161 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6bf00c34f0 con 0x7f6bf00c3fd0 2023-10-06T01:41:02.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.646+0000 7f6be4ff9700 1 -- 172.21.15.71:0/2546316161 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6bec054ab0 con 0x7f6bf00c3fd0 2023-10-06T01:41:02.647 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 32 2023-10-06T01:41:02.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.648+0000 7f6bf6cdf700 1 -- 172.21.15.71:0/2546316161 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f6bdc066f30 msgr2=0x7f6bdc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:02.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.648+0000 7f6bf6cdf700 1 --2- 172.21.15.71:0/2546316161 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f6bdc066f30 0x7f6bdc0693e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6be00091e0 tx=0x7f6be0017000 comp rx=0 tx=0).stop 2023-10-06T01:41:02.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.648+0000 7f6bf6cdf700 1 -- 172.21.15.71:0/2546316161 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6bf00c3fd0 msgr2=0x7f6bf0144b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:02.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.648+0000 7f6bf6cdf700 1 --2- 172.21.15.71:0/2546316161 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6bf00c3fd0 0x7f6bf0144b70 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f6bec0016e0 tx=0x7f6bec0027d0 comp rx=0 tx=0).stop 2023-10-06T01:41:02.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.648+0000 7f6bf6cdf700 1 -- 172.21.15.71:0/2546316161 shutdown_connections 2023-10-06T01:41:02.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.648+0000 7f6bf6cdf700 1 --2- 172.21.15.71:0/2546316161 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f6bdc066f30 0x7f6bdc0693e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:02.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.648+0000 7f6bf6cdf700 1 --2- 172.21.15.71:0/2546316161 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6bf01574b0 0x7f6bf00b1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:02.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.648+0000 7f6bf6cdf700 1 --2- 172.21.15.71:0/2546316161 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6bf00c3fd0 0x7f6bf0144b70 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:02.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.648+0000 7f6bf6cdf700 1 --2- 172.21.15.71:0/2546316161 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6bf00cbcc0 0x7f6bf00b3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:02.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.648+0000 7f6bf6cdf700 1 -- 172.21.15.71:0/2546316161 >> 172.21.15.71:0/2546316161 conn(0x7f6bf0067910 msgr2=0x7f6bf00c9200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:02.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.648+0000 7f6bf6cdf700 1 -- 172.21.15.71:0/2546316161 shutdown_connections 2023-10-06T01:41:02.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.648+0000 7f6bf6cdf700 1 -- 172.21.15.71:0/2546316161 wait complete. 2023-10-06T01:41:02.660 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T01:41:02.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.777+0000 7fb0f3baf700 1 Processor -- start 2023-10-06T01:41:02.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.777+0000 7fb0f3baf700 1 -- start start 2023-10-06T01:41:02.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.778+0000 7fb0f3baf700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb0ec0af3f0 0x7fb0ec15a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:02.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.778+0000 7fb0f3baf700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fb0ec159960 0x7fb0ec068680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:02.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.778+0000 7fb0f3baf700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0ec15a170 con 0x7fb0ec0af7c0 2023-10-06T01:41:02.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.778+0000 7fb0f3baf700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0ec0caeb0 con 0x7fb0ec159960 2023-10-06T01:41:02.781 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.778+0000 7fb0f3baf700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0ec15db80 con 0x7fb0ec0af3f0 2023-10-06T01:41:02.781 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.778+0000 7fb0f214c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fb0ec159960 0x7fb0ec068680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:02.781 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.778+0000 7fb0f114a700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fb0ec0af7c0 0x7fb0ec15d030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:55858/0 (socket says 172.21.15.71:55858) 2023-10-06T01:41:02.781 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.778+0000 7fb0f114a700 1 -- 172.21.15.71:0/2460112083 learned_addr learned my addr 172.21.15.71:0/2460112083 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:41:02.781 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.778+0000 7fb0f214c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fb0ec159960 0x7fb0ec068680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35976/0 (socket says 172.21.15.71:35976) 2023-10-06T01:41:02.781 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.778+0000 7fb0f194b700 1 --2- 172.21.15.71:0/2460112083 >> v2:172.21.15.72:3300/0 conn(0x7fb0ec0af3f0 0x7fb0ec15a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:02.781 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.778+0000 7fb0f214c700 1 -- 172.21.15.71:0/2460112083 >> v2:172.21.15.72:3300/0 conn(0x7fb0ec0af3f0 msgr2=0x7fb0ec15a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:02.781 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.778+0000 7fb0f214c700 1 --2- 172.21.15.71:0/2460112083 >> v2:172.21.15.72:3300/0 conn(0x7fb0ec0af3f0 0x7fb0ec15a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:02.781 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.778+0000 7fb0f214c700 1 -- 172.21.15.71:0/2460112083 >> v1:172.21.15.71:6789/0 conn(0x7fb0ec0af7c0 legacy=0x7fb0ec15d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:02.781 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.778+0000 7fb0f0949700 1 -- 172.21.15.71:0/2460112083 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3438092498 0 0) 0x7fb0ec15a170 con 0x7fb0ec0af7c0 2023-10-06T01:41:02.781 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.778+0000 7fb0f214c700 1 -- 172.21.15.71:0/2460112083 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0ec15de60 con 0x7fb0ec159960 2023-10-06T01:41:02.781 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.779+0000 7fb0f214c700 1 --2- 172.21.15.71:0/2460112083 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0ec159960 0x7fb0ec068680 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec0ccf90 tx=0x7fb0e4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d80934a328ac77c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:02.782 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.779+0000 7fb0f0949700 1 -- 172.21.15.71:0/2460112083 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e400e070 con 0x7fb0ec159960 2023-10-06T01:41:02.782 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.779+0000 7fb0f0949700 1 -- 172.21.15.71:0/2460112083 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0e400bb60 con 0x7fb0ec159960 2023-10-06T01:41:02.782 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.779+0000 7fb0f0949700 1 -- 172.21.15.71:0/2460112083 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e4012430 con 0x7fb0ec159960 2023-10-06T01:41:02.782 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.779+0000 7fb0f3baf700 1 -- 172.21.15.71:0/2460112083 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0ec159960 msgr2=0x7fb0ec068680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:02.782 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.779+0000 7fb0f3baf700 1 --2- 172.21.15.71:0/2460112083 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0ec159960 0x7fb0ec068680 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec0ccf90 tx=0x7fb0e4009780 comp rx=0 tx=0).stop 2023-10-06T01:41:02.782 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.779+0000 7fb0f3baf700 1 -- 172.21.15.71:0/2460112083 shutdown_connections 2023-10-06T01:41:02.782 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.779+0000 7fb0f3baf700 1 --2- 172.21.15.71:0/2460112083 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0ec159960 0x7fb0ec068680 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:02.782 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.779+0000 7fb0f3baf700 1 --2- 172.21.15.71:0/2460112083 >> v2:172.21.15.72:3300/0 conn(0x7fb0ec0af3f0 0x7fb0ec15a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:02.782 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.779+0000 7fb0f3baf700 1 -- 172.21.15.71:0/2460112083 >> 172.21.15.71:0/2460112083 conn(0x7fb0ec06a260 msgr2=0x7fb0ec0cd030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:02.782 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.779+0000 7fb0f3baf700 1 -- 172.21.15.71:0/2460112083 shutdown_connections 2023-10-06T01:41:02.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.779+0000 7fb0f3baf700 1 -- 172.21.15.71:0/2460112083 wait complete. 2023-10-06T01:41:02.785 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.780+0000 7fb0f3baf700 1 Processor -- start 2023-10-06T01:41:02.785 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.780+0000 7fb0f3baf700 1 -- start start 2023-10-06T01:41:02.785 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.781+0000 7fb0f3baf700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0ec0af3f0 0x7fb0ec0b13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:02.785 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.781+0000 7fb0f3baf700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb0ec159960 0x7fb0ec155ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:02.785 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.781+0000 7fb0f3baf700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0ec0c9d00 0x7fb0ec0ca180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:02.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.781+0000 7fb0f3baf700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0ec0ca6c0 con 0x7fb0ec0c9d00 2023-10-06T01:41:02.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.781+0000 7fb0f3baf700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0ec0b0f10 con 0x7fb0ec0af3f0 2023-10-06T01:41:02.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.781+0000 7fb0f3baf700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0ec1563e0 con 0x7fb0ec159960 2023-10-06T01:41:02.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.781+0000 7fb0f214c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0ec0c9d00 0x7fb0ec0ca180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:02.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.781+0000 7fb0f214c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0ec0c9d00 0x7fb0ec0ca180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35986/0 (socket says 172.21.15.71:35986) 2023-10-06T01:41:02.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.781+0000 7fb0f214c700 1 -- 172.21.15.71:0/3236445433 learned_addr learned my addr 172.21.15.71:0/3236445433 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:02.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.781+0000 7fb0f214c700 1 -- 172.21.15.71:0/3236445433 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb0ec159960 msgr2=0x7fb0ec155ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:02.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.781+0000 7fb0f114a700 1 --2- 172.21.15.71:0/3236445433 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb0ec159960 0x7fb0ec155ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:02.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.782+0000 7fb0f194b700 1 --2- 172.21.15.71:0/3236445433 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0ec0af3f0 0x7fb0ec0b13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:02.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.782+0000 7fb0f214c700 1 --2- 172.21.15.71:0/3236445433 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb0ec159960 0x7fb0ec155ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:02.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.782+0000 7fb0f214c700 1 -- 172.21.15.71:0/3236445433 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0ec0af3f0 msgr2=0x7fb0ec0b13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:02.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.782+0000 7fb0f214c700 1 --2- 172.21.15.71:0/3236445433 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0ec0af3f0 0x7fb0ec0b13a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:02.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.782+0000 7fb0f214c700 1 -- 172.21.15.71:0/3236445433 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0e4009a20 con 0x7fb0ec0c9d00 2023-10-06T01:41:02.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.782+0000 7fb0f214c700 1 --2- 172.21.15.71:0/3236445433 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0ec0c9d00 0x7fb0ec0ca180 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb0e4013000 tx=0x7fb0e4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:02.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.782+0000 7fb0e1ffb700 1 -- 172.21.15.71:0/3236445433 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e4012e60 con 0x7fb0ec0c9d00 2023-10-06T01:41:02.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.782+0000 7fb0e1ffb700 1 -- 172.21.15.71:0/3236445433 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0e401d630 con 0x7fb0ec0c9d00 2023-10-06T01:41:02.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.782+0000 7fb0f3baf700 1 -- 172.21.15.71:0/3236445433 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0ec0c4fa0 con 0x7fb0ec0c9d00 2023-10-06T01:41:02.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.782+0000 7fb0e1ffb700 1 -- 172.21.15.71:0/3236445433 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e401d9f0 con 0x7fb0ec0c9d00 2023-10-06T01:41:02.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.782+0000 7fb0f3baf700 1 -- 172.21.15.71:0/3236445433 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0ec0b08c0 con 0x7fb0ec0c9d00 2023-10-06T01:41:02.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.783+0000 7fb0f3baf700 1 -- 172.21.15.71:0/3236445433 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0ec0cda80 con 0x7fb0ec0c9d00 2023-10-06T01:41:02.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.783+0000 7fb0e1ffb700 1 -- 172.21.15.71:0/3236445433 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb0e4024070 con 0x7fb0ec0c9d00 2023-10-06T01:41:02.788 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.784+0000 7fb0e1ffb700 1 --2- 172.21.15.71:0/3236445433 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fb0d0066f30 0x7fb0d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:02.788 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.784+0000 7fb0e1ffb700 1 -- 172.21.15.71:0/3236445433 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fb0e4087120 con 0x7fb0ec0c9d00 2023-10-06T01:41:02.788 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.784+0000 7fb0f194b700 1 --2- 172.21.15.71:0/3236445433 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fb0d0066f30 0x7fb0d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:02.788 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.784+0000 7fb0f194b700 1 --2- 172.21.15.71:0/3236445433 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fb0d0066f30 0x7fb0d00693e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb0e8006f00 tx=0x7fb0e8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:02.788 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.788+0000 7fb0e1ffb700 1 -- 172.21.15.71:0/3236445433 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb0e4053f40 con 0x7fb0ec0c9d00 2023-10-06T01:41:02.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.975+0000 7fb0f3baf700 1 -- 172.21.15.71:0/3236445433 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb0ec0b1050 con 0x7fb0ec0c9d00 2023-10-06T01:41:02.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.976+0000 7fb0e1ffb700 1 -- 172.21.15.71:0/3236445433 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb0e4009880 con 0x7fb0ec0c9d00 2023-10-06T01:41:02.976 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 64 2023-10-06T01:41:02.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.978+0000 7fb0f3baf700 1 -- 172.21.15.71:0/3236445433 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fb0d0066f30 msgr2=0x7fb0d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:02.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.978+0000 7fb0f3baf700 1 --2- 172.21.15.71:0/3236445433 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fb0d0066f30 0x7fb0d00693e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb0e8006f00 tx=0x7fb0e8008040 comp rx=0 tx=0).stop 2023-10-06T01:41:02.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.978+0000 7fb0f3baf700 1 -- 172.21.15.71:0/3236445433 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0ec0c9d00 msgr2=0x7fb0ec0ca180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:02.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.978+0000 7fb0f3baf700 1 --2- 172.21.15.71:0/3236445433 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0ec0c9d00 0x7fb0ec0ca180 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb0e4013000 tx=0x7fb0e4019000 comp rx=0 tx=0).stop 2023-10-06T01:41:02.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.978+0000 7fb0f3baf700 1 -- 172.21.15.71:0/3236445433 shutdown_connections 2023-10-06T01:41:02.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.978+0000 7fb0f3baf700 1 --2- 172.21.15.71:0/3236445433 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0ec0c9d00 0x7fb0ec0ca180 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:02.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.978+0000 7fb0f3baf700 1 --2- 172.21.15.71:0/3236445433 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fb0d0066f30 0x7fb0d00693e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:02.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.978+0000 7fb0f3baf700 1 --2- 172.21.15.71:0/3236445433 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0ec0af3f0 0x7fb0ec0b13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:02.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.978+0000 7fb0f3baf700 1 --2- 172.21.15.71:0/3236445433 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb0ec159960 0x7fb0ec155ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:02.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.978+0000 7fb0f3baf700 1 -- 172.21.15.71:0/3236445433 >> 172.21.15.71:0/3236445433 conn(0x7fb0ec06a260 msgr2=0x7fb0ec06d340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:02.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.978+0000 7fb0f3baf700 1 -- 172.21.15.71:0/3236445433 shutdown_connections 2023-10-06T01:41:02.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:02.978+0000 7fb0f3baf700 1 -- 172.21.15.71:0/3236445433 wait complete. 2023-10-06T01:41:02.990 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-06T01:41:03.107 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.106+0000 7f050ea45700 1 Processor -- start 2023-10-06T01:41:03.107 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.106+0000 7f050ea45700 1 -- start start 2023-10-06T01:41:03.109 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.107+0000 7f050ea45700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f05080b0810 0x7f0508164160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:03.109 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.107+0000 7f050ea45700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05080af770 con 0x7f05080cd7d0 2023-10-06T01:41:03.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.107+0000 7f050ea45700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05080afa50 con 0x7f05080cd400 2023-10-06T01:41:03.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.107+0000 7f050ea45700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05080afd30 con 0x7f05080b0810 2023-10-06T01:41:03.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.107+0000 7f050d242700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f05080cd7d0 0x7f05080d01a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:55860/0 (socket says 172.21.15.71:55860) 2023-10-06T01:41:03.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.107+0000 7f050d242700 1 -- 172.21.15.71:0/2577320824 learned_addr learned my addr 172.21.15.71:0/2577320824 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:41:03.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.107+0000 7f050e244700 1 --2- 172.21.15.71:0/2577320824 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f05080b0810 0x7f0508164160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:03.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.107+0000 7f050ca41700 1 -- 172.21.15.71:0/2577320824 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 620889523 0 0) 0x7f05080af770 con 0x7f05080cd7d0 2023-10-06T01:41:03.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.107+0000 7f050ca41700 1 -- 172.21.15.71:0/2577320824 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04f4003570 con 0x7f05080cd7d0 2023-10-06T01:41:03.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.107+0000 7f050ca41700 1 -- 172.21.15.71:0/2577320824 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1276712496 0 0) 0x7f05080afa50 con 0x7f05080cd400 2023-10-06T01:41:03.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.108+0000 7f050ca41700 1 -- 172.21.15.71:0/2577320824 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05080af770 con 0x7f05080cd400 2023-10-06T01:41:03.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.108+0000 7f050e244700 1 -- 172.21.15.71:0/2577320824 >> v1:172.21.15.72:6789/0 conn(0x7f05080cd400 legacy=0x7f05080b1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:03.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.108+0000 7f050ca41700 1 -- 172.21.15.71:0/2577320824 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3268548535 0 0) 0x7f04f4003570 con 0x7f05080cd7d0 2023-10-06T01:41:03.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.108+0000 7f050e244700 1 -- 172.21.15.71:0/2577320824 >> v1:172.21.15.71:6789/0 conn(0x7f05080cd7d0 legacy=0x7f05080d01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:03.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.108+0000 7f050e244700 1 -- 172.21.15.71:0/2577320824 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05080b0010 con 0x7f05080b0810 2023-10-06T01:41:03.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.108+0000 7f050e244700 1 --2- 172.21.15.71:0/2577320824 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f05080b0810 0x7f0508164160 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0500009ec0 tx=0x7f0500009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1c8fb51bcb65f42 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:03.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.108+0000 7f050ca41700 1 -- 172.21.15.71:0/2577320824 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f050000e070 con 0x7f05080b0810 2023-10-06T01:41:03.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.108+0000 7f050ca41700 1 -- 172.21.15.71:0/2577320824 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f050000b870 con 0x7f05080b0810 2023-10-06T01:41:03.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.108+0000 7f050ca41700 1 -- 172.21.15.71:0/2577320824 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f8001470 con 0x7f05080b0810 2023-10-06T01:41:03.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.108+0000 7f050ea45700 1 -- 172.21.15.71:0/2577320824 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f05080b0810 msgr2=0x7f0508164160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:03.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.108+0000 7f050ea45700 1 --2- 172.21.15.71:0/2577320824 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f05080b0810 0x7f0508164160 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0500009ec0 tx=0x7f0500009780 comp rx=0 tx=0).stop 2023-10-06T01:41:03.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.108+0000 7f050ea45700 1 -- 172.21.15.71:0/2577320824 shutdown_connections 2023-10-06T01:41:03.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.108+0000 7f050ea45700 1 --2- 172.21.15.71:0/2577320824 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f05080b0810 0x7f0508164160 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:03.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.108+0000 7f050ea45700 1 -- 172.21.15.71:0/2577320824 >> 172.21.15.71:0/2577320824 conn(0x7f050806a110 msgr2=0x7f050806a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:03.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.109+0000 7f050ea45700 1 -- 172.21.15.71:0/2577320824 shutdown_connections 2023-10-06T01:41:03.112 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.109+0000 7f050ea45700 1 -- 172.21.15.71:0/2577320824 wait complete. 2023-10-06T01:41:03.114 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.110+0000 7f050ea45700 1 Processor -- start 2023-10-06T01:41:03.114 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.110+0000 7f050ea45700 1 -- start start 2023-10-06T01:41:03.114 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.110+0000 7f050ea45700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05080b0810 0x7f0508157f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:03.114 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.110+0000 7f050ea45700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f05080cd400 0x7f05080c49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:03.114 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.110+0000 7f050ea45700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05080c4ef0 0x7f050815dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:03.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.110+0000 7f050ea45700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05080c60a0 con 0x7f05080c4ef0 2023-10-06T01:41:03.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.110+0000 7f050ea45700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0508158480 con 0x7f05080b0810 2023-10-06T01:41:03.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.110+0000 7f050ea45700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05080c5490 con 0x7f05080cd400 2023-10-06T01:41:03.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.110+0000 7f050e244700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05080c4ef0 0x7f050815dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:03.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.110+0000 7f050e244700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05080c4ef0 0x7f050815dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:35996/0 (socket says 172.21.15.71:35996) 2023-10-06T01:41:03.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.110+0000 7f050e244700 1 -- 172.21.15.71:0/2281562455 learned_addr learned my addr 172.21.15.71:0/2281562455 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:03.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.110+0000 7f050da43700 1 --2- 172.21.15.71:0/2281562455 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05080b0810 0x7f0508157f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:03.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.110+0000 7f050d242700 1 --2- 172.21.15.71:0/2281562455 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f05080cd400 0x7f05080c49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:03.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.111+0000 7f050e244700 1 -- 172.21.15.71:0/2281562455 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f05080cd400 msgr2=0x7f05080c49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:03.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.111+0000 7f050e244700 1 --2- 172.21.15.71:0/2281562455 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f05080cd400 0x7f05080c49b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:03.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.111+0000 7f050e244700 1 -- 172.21.15.71:0/2281562455 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05080b0810 msgr2=0x7f0508157f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:03.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.111+0000 7f050e244700 1 --2- 172.21.15.71:0/2281562455 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05080b0810 0x7f0508157f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:03.116 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.111+0000 7f050e244700 1 -- 172.21.15.71:0/2281562455 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0500009a20 con 0x7f05080c4ef0 2023-10-06T01:41:03.116 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.111+0000 7f050e244700 1 --2- 172.21.15.71:0/2281562455 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05080c4ef0 0x7f050815dbc0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f0500003000 tx=0x7f0500017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:03.116 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.111+0000 7f04fdffb700 1 -- 172.21.15.71:0/2281562455 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0500007000 con 0x7f05080c4ef0 2023-10-06T01:41:03.116 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.111+0000 7f04fdffb700 1 -- 172.21.15.71:0/2281562455 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f050000be80 con 0x7f05080c4ef0 2023-10-06T01:41:03.116 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.111+0000 7f04fdffb700 1 -- 172.21.15.71:0/2281562455 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f050001e680 con 0x7f05080c4ef0 2023-10-06T01:41:03.116 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.111+0000 7f050ea45700 1 -- 172.21.15.71:0/2281562455 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05080c5770 con 0x7f05080c4ef0 2023-10-06T01:41:03.116 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.111+0000 7f050ea45700 1 -- 172.21.15.71:0/2281562455 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05080c5d30 con 0x7f05080c4ef0 2023-10-06T01:41:03.116 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.112+0000 7f050ea45700 1 -- 172.21.15.71:0/2281562455 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0508064aa0 con 0x7f05080c4ef0 2023-10-06T01:41:03.116 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.113+0000 7f04fdffb700 1 -- 172.21.15.71:0/2281562455 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f050001ea70 con 0x7f05080c4ef0 2023-10-06T01:41:03.116 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.113+0000 7f04fdffb700 1 --2- 172.21.15.71:0/2281562455 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f04ec066f30 0x7f04ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:03.116 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.113+0000 7f04fdffb700 1 -- 172.21.15.71:0/2281562455 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f0500085fe0 con 0x7f05080c4ef0 2023-10-06T01:41:03.116 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.113+0000 7f050da43700 1 --2- 172.21.15.71:0/2281562455 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f04ec066f30 0x7f04ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:03.117 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.113+0000 7f050da43700 1 --2- 172.21.15.71:0/2281562455 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f04ec066f30 0x7f04ec0693e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0504003ae0 tx=0x7f0504007d40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:03.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.117+0000 7f04fdffb700 1 -- 172.21.15.71:0/2281562455 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0500052dc0 con 0x7f05080c4ef0 2023-10-06T01:41:03.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.299+0000 7f050ea45700 1 -- 172.21.15.71:0/2281562455 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f05080b02f0 con 0x7f05080c4ef0 2023-10-06T01:41:03.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.300+0000 7f04fdffb700 1 -- 172.21.15.71:0/2281562455 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f05000563e0 con 0x7f05080c4ef0 2023-10-06T01:41:03.301 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 32 2023-10-06T01:41:03.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.302+0000 7f050ea45700 1 -- 172.21.15.71:0/2281562455 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f04ec066f30 msgr2=0x7f04ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:03.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.302+0000 7f050ea45700 1 --2- 172.21.15.71:0/2281562455 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f04ec066f30 0x7f04ec0693e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0504003ae0 tx=0x7f0504007d40 comp rx=0 tx=0).stop 2023-10-06T01:41:03.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.302+0000 7f050ea45700 1 -- 172.21.15.71:0/2281562455 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05080c4ef0 msgr2=0x7f050815dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:03.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.302+0000 7f050ea45700 1 --2- 172.21.15.71:0/2281562455 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05080c4ef0 0x7f050815dbc0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f0500003000 tx=0x7f0500017000 comp rx=0 tx=0).stop 2023-10-06T01:41:03.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.302+0000 7f050ea45700 1 -- 172.21.15.71:0/2281562455 shutdown_connections 2023-10-06T01:41:03.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.302+0000 7f050ea45700 1 --2- 172.21.15.71:0/2281562455 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05080c4ef0 0x7f050815dbc0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:03.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.302+0000 7f050ea45700 1 --2- 172.21.15.71:0/2281562455 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f04ec066f30 0x7f04ec0693e0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:03.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.302+0000 7f050ea45700 1 --2- 172.21.15.71:0/2281562455 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05080b0810 0x7f0508157f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:03.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.302+0000 7f050ea45700 1 --2- 172.21.15.71:0/2281562455 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f05080cd400 0x7f05080c49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:03.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.302+0000 7f050ea45700 1 -- 172.21.15.71:0/2281562455 >> 172.21.15.71:0/2281562455 conn(0x7f050806a110 msgr2=0x7f05080cc620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:03.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.302+0000 7f050ea45700 1 -- 172.21.15.71:0/2281562455 shutdown_connections 2023-10-06T01:41:03.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.302+0000 7f050ea45700 1 -- 172.21.15.71:0/2281562455 wait complete. 2023-10-06T01:41:03.314 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:41:03.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.426+0000 7f47ef483700 1 Processor -- start 2023-10-06T01:41:03.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.427+0000 7f47ef483700 1 -- start start 2023-10-06T01:41:03.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.427+0000 7f47ef483700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f47e815cde0 0x7f47e81642c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:03.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.427+0000 7f47ef483700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47e80b1ed0 con 0x7f47e815ca10 2023-10-06T01:41:03.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.427+0000 7f47ef483700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47e80879c0 con 0x7f47e8067d10 2023-10-06T01:41:03.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.427+0000 7f47ef483700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47e80cec50 con 0x7f47e815cde0 2023-10-06T01:41:03.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.427+0000 7f47ed21f700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f47e815ca10 0x7f47e8069f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:55872/0 (socket says 172.21.15.71:55872) 2023-10-06T01:41:03.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.427+0000 7f47ed21f700 1 -- 172.21.15.71:0/2303215997 learned_addr learned my addr 172.21.15.71:0/2303215997 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:41:03.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.428+0000 7f47eda20700 1 --2- 172.21.15.71:0/2303215997 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f47e815cde0 0x7f47e81642c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:03.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.428+0000 7f47dffff700 1 -- 172.21.15.71:0/2303215997 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4268036222 0 0) 0x7f47e80b1ed0 con 0x7f47e815ca10 2023-10-06T01:41:03.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.428+0000 7f47dffff700 1 -- 172.21.15.71:0/2303215997 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47d4003570 con 0x7f47e815ca10 2023-10-06T01:41:03.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.428+0000 7f47dffff700 1 -- 172.21.15.71:0/2303215997 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 579075507 0 0) 0x7f47d4003570 con 0x7f47e815ca10 2023-10-06T01:41:03.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.428+0000 7f47dffff700 1 -- 172.21.15.71:0/2303215997 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f47e815cde0 msgr2=0x7f47e81642c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:03.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.428+0000 7f47dffff700 1 --2- 172.21.15.71:0/2303215997 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f47e815cde0 0x7f47e81642c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:03.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.428+0000 7f47dffff700 1 -- 172.21.15.71:0/2303215997 >> v1:172.21.15.72:6789/0 conn(0x7f47e8067d10 legacy=0x7f47e806a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:03.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.428+0000 7f47dffff700 1 -- 172.21.15.71:0/2303215997 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47e80cef30 con 0x7f47e815ca10 2023-10-06T01:41:03.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.428+0000 7f47dffff700 1 -- 172.21.15.71:0/2303215997 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1184243524 0 0) 0x7f47e4001970 con 0x7f47e815ca10 2023-10-06T01:41:03.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.428+0000 7f47dffff700 1 -- 172.21.15.71:0/2303215997 >> v1:172.21.15.71:6789/0 conn(0x7f47e815ca10 legacy=0x7f47e8069f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:03.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.428+0000 7f47dffff700 1 --2- 172.21.15.71:0/2303215997 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47d4003a90 0x7f47d4003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:03.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.428+0000 7f47dffff700 1 --2- 172.21.15.71:0/2303215997 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f47e815cde0 0x7f47d4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:03.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.428+0000 7f47dffff700 1 --2- 172.21.15.71:0/2303215997 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47d4004d50 0x7f47d40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:03.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.428+0000 7f47dffff700 1 -- 172.21.15.71:0/2303215997 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47e80cec50 con 0x7f47d4003a90 2023-10-06T01:41:03.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.428+0000 7f47dffff700 1 -- 172.21.15.71:0/2303215997 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47d400bb40 con 0x7f47d4004d50 2023-10-06T01:41:03.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.428+0000 7f47dffff700 1 -- 172.21.15.71:0/2303215997 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47d400bd00 con 0x7f47e815cde0 2023-10-06T01:41:03.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.428+0000 7f47ed21f700 1 --2- 172.21.15.71:0/2303215997 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47d4003a90 0x7f47d4003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:03.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.428+0000 7f47eda20700 1 --2- 172.21.15.71:0/2303215997 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47d4004d50 0x7f47d40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:03.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.428+0000 7f47eca1e700 1 --2- 172.21.15.71:0/2303215997 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f47e815cde0 0x7f47d4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:03.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.428+0000 7f47ed21f700 1 -- 172.21.15.71:0/2303215997 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f47e815cde0 msgr2=0x7f47d4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:03.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.428+0000 7f47ed21f700 1 --2- 172.21.15.71:0/2303215997 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f47e815cde0 0x7f47d4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:03.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.428+0000 7f47ed21f700 1 -- 172.21.15.71:0/2303215997 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47d4004d50 msgr2=0x7f47d40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:03.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.428+0000 7f47ed21f700 1 --2- 172.21.15.71:0/2303215997 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47d4004d50 0x7f47d40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:03.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.428+0000 7f47ed21f700 1 -- 172.21.15.71:0/2303215997 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47d4003570 con 0x7f47d4003a90 2023-10-06T01:41:03.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.429+0000 7f47ed21f700 1 --2- 172.21.15.71:0/2303215997 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47d4003a90 0x7f47d4003e60 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f47e400c690 tx=0x7f47e4007ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f135be5fb9f7afa9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:03.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.429+0000 7f47dffff700 1 -- 172.21.15.71:0/2303215997 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e4005b70 con 0x7f47d4003a90 2023-10-06T01:41:03.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.429+0000 7f47dffff700 1 -- 172.21.15.71:0/2303215997 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47e4005cf0 con 0x7f47d4003a90 2023-10-06T01:41:03.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.429+0000 7f47dffff700 1 -- 172.21.15.71:0/2303215997 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e4007360 con 0x7f47d4003a90 2023-10-06T01:41:03.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.429+0000 7f47ef483700 1 -- 172.21.15.71:0/2303215997 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47d4003a90 msgr2=0x7f47d4003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:03.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.429+0000 7f47ef483700 1 --2- 172.21.15.71:0/2303215997 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47d4003a90 0x7f47d4003e60 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f47e400c690 tx=0x7f47e4007ca0 comp rx=0 tx=0).stop 2023-10-06T01:41:03.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.429+0000 7f47eda20700 1 -- 172.21.15.71:0/2303215997 reap_dead start 2023-10-06T01:41:03.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.429+0000 7f47ef483700 1 -- 172.21.15.71:0/2303215997 shutdown_connections 2023-10-06T01:41:03.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.429+0000 7f47ef483700 1 -- 172.21.15.71:0/2303215997 >> 172.21.15.71:0/2303215997 conn(0x7f47e8067910 msgr2=0x7f47e80ce160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:03.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.429+0000 7f47ef483700 1 -- 172.21.15.71:0/2303215997 shutdown_connections 2023-10-06T01:41:03.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.429+0000 7f47ef483700 1 -- 172.21.15.71:0/2303215997 wait complete. 2023-10-06T01:41:03.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.430+0000 7f47ef483700 1 Processor -- start 2023-10-06T01:41:03.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.430+0000 7f47ef483700 1 -- start start 2023-10-06T01:41:03.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.431+0000 7f47ef483700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47d4003a90 0x7f47e8152640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:03.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.431+0000 7f47ef483700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47e8169b00 0x7f47e8169f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:03.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.431+0000 7f47ef483700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f47e815f710 0x7f47e815fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:03.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.431+0000 7f47ef483700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47e81600d0 con 0x7f47e8169b00 2023-10-06T01:41:03.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.431+0000 7f47ef483700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47e815e700 con 0x7f47d4003a90 2023-10-06T01:41:03.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.431+0000 7f47ef483700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47e815e950 con 0x7f47e815f710 2023-10-06T01:41:03.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.431+0000 7f47eca1e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47e8169b00 0x7f47e8169f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:03.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.431+0000 7f47eca1e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47e8169b00 0x7f47e8169f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36026/0 (socket says 172.21.15.71:36026) 2023-10-06T01:41:03.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.431+0000 7f47eca1e700 1 -- 172.21.15.71:0/2595668708 learned_addr learned my addr 172.21.15.71:0/2595668708 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:03.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.432+0000 7f47eda20700 1 --2- 172.21.15.71:0/2595668708 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f47e815f710 0x7f47e815fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:03.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.432+0000 7f47ed21f700 1 --2- 172.21.15.71:0/2595668708 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47d4003a90 0x7f47e8152640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:03.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.432+0000 7f47eca1e700 1 -- 172.21.15.71:0/2595668708 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f47e815f710 msgr2=0x7f47e815fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:03.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.432+0000 7f47eca1e700 1 --2- 172.21.15.71:0/2595668708 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f47e815f710 0x7f47e815fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:03.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.432+0000 7f47eca1e700 1 -- 172.21.15.71:0/2595668708 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47d4003a90 msgr2=0x7f47e8152640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:03.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.432+0000 7f47eca1e700 1 --2- 172.21.15.71:0/2595668708 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47d4003a90 0x7f47e8152640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:03.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.432+0000 7f47eca1e700 1 -- 172.21.15.71:0/2595668708 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47e815ec30 con 0x7f47e8169b00 2023-10-06T01:41:03.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.432+0000 7f47eca1e700 1 --2- 172.21.15.71:0/2595668708 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47e8169b00 0x7f47e8169f70 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f47d8002b30 tx=0x7f47d8007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:03.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.432+0000 7f47dd7fa700 1 -- 172.21.15.71:0/2595668708 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d800f870 con 0x7f47e8169b00 2023-10-06T01:41:03.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.432+0000 7f47dd7fa700 1 -- 172.21.15.71:0/2595668708 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47d800f9d0 con 0x7f47e8169b00 2023-10-06T01:41:03.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.432+0000 7f47ef483700 1 -- 172.21.15.71:0/2595668708 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47e815ef10 con 0x7f47e8169b00 2023-10-06T01:41:03.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.432+0000 7f47dd7fa700 1 -- 172.21.15.71:0/2595668708 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d800fd90 con 0x7f47e8169b00 2023-10-06T01:41:03.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.432+0000 7f47ef483700 1 -- 172.21.15.71:0/2595668708 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47e8152b80 con 0x7f47e8169b00 2023-10-06T01:41:03.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.433+0000 7f47ef483700 1 -- 172.21.15.71:0/2595668708 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47e815f430 con 0x7f47e8169b00 2023-10-06T01:41:03.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.433+0000 7f47dd7fa700 1 -- 172.21.15.71:0/2595668708 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f47d8013600 con 0x7f47e8169b00 2023-10-06T01:41:03.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.434+0000 7f47dd7fa700 1 --2- 172.21.15.71:0/2595668708 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f47cc066f30 0x7f47cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:03.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.434+0000 7f47dd7fa700 1 -- 172.21.15.71:0/2595668708 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f47d8084f40 con 0x7f47e8169b00 2023-10-06T01:41:03.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.434+0000 7f47ed21f700 1 --2- 172.21.15.71:0/2595668708 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f47cc066f30 0x7f47cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:03.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.434+0000 7f47ed21f700 1 --2- 172.21.15.71:0/2595668708 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f47cc066f30 0x7f47cc0693e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f47e400c690 tx=0x7f47e4015000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:03.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.438+0000 7f47dd7fa700 1 -- 172.21.15.71:0/2595668708 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f47e815f430 con 0x7f47e8169b00 2023-10-06T01:41:03.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.624+0000 7f47ef483700 1 -- 172.21.15.71:0/2595668708 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f47e815f430 con 0x7f47e8169b00 2023-10-06T01:41:03.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.625+0000 7f47dd7fa700 1 -- 172.21.15.71:0/2595668708 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18754 (secure 0 0 0) 0x7f47e815f430 con 0x7f47e8169b00 2023-10-06T01:41:03.625 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:41:03.626 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":28,"fsid":"1fbf1bd2-f9b4-4599-bea2-f4aa920e9a56","created":"2023-10-06T01:39:57.016957+0000","modified":"2023-10-06T01:41:02.810517+0000","last_up_change":"2023-10-06T01:40:08.571643+0000","last_in_change":"2023-10-06T01:39:59.462741+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T01:40:08.610349+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T01:40:15.387434+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T01:40:19.640459+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T01:40:20.116883+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T01:40:23.830129+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cf059188-fb20-4dbf-95db-dcf57b213d03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":90670},{"type":"v1","addr":"172.21.15.71:6817","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":90670},{"type":"v1","addr":"172.21.15.71:6819","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":90670},{"type":"v1","addr":"172.21.15.71:6823","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":90670},{"type":"v1","addr":"172.21.15.71:6821","nonce":90670}]},"public_addr":"172.21.15.71:6817/90670","cluster_addr":"172.21.15.71:6819/90670","heartbeat_back_addr":"172.21.15.71:6823/90670","heartbeat_front_addr":"172.21.15.71:6821/90670","state":["exists","up"]},{"osd":1,"uuid":"0cff0aae-1799-4fe0-b610-54cf0813c0e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":90669},{"type":"v1","addr":"172.21.15.71:6809","nonce":90669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":90669},{"type":"v1","addr":"172.21.15.71:6811","nonce":90669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":90669},{"type":"v1","addr":"172.21.15.71:6815","nonce":90669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":90669},{"type":"v1","addr":"172.21.15.71:6813","nonce":90669}]},"public_addr":"172.21.15.71:6809/90669","cluster_addr":"172.21.15.71:6811/90669","heartbeat_back_addr":"172.21.15.71:6815/90669","heartbeat_front_addr":"172.21.15.71:6813/90669","state":["exists","up"]},{"osd":2,"uuid":"88d61ddc-9031-44e1-ba8c-546a41e7c8ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":90679},{"type":"v1","addr":"172.21.15.71:6825","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":90679},{"type":"v1","addr":"172.21.15.71:6827","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":90679},{"type":"v1","addr":"172.21.15.71:6831","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":90679},{"type":"v1","addr":"172.21.15.71:6829","nonce":90679}]},"public_addr":"172.21.15.71:6825/90679","cluster_addr":"172.21.15.71:6827/90679","heartbeat_back_addr":"172.21.15.71:6831/90679","heartbeat_front_addr":"172.21.15.71:6829/90679","state":["exists","up"]},{"osd":3,"uuid":"11ed92b7-960b-4a30-a889-a61d3eeb86f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":90668},{"type":"v1","addr":"172.21.15.71:6801","nonce":90668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":90668},{"type":"v1","addr":"172.21.15.71:6803","nonce":90668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":90668},{"type":"v1","addr":"172.21.15.71:6807","nonce":90668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":90668},{"type":"v1","addr":"172.21.15.71:6805","nonce":90668}]},"public_addr":"172.21.15.71:6801/90668","cluster_addr":"172.21.15.71:6803/90668","heartbeat_back_addr":"172.21.15.71:6807/90668","heartbeat_front_addr":"172.21.15.71:6805/90668","state":["exists","up"]},{"osd":4,"uuid":"ae4df784-abdf-4ddf-aefa-780f3ddafef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":90917},{"type":"v1","addr":"172.21.15.72:6801","nonce":90917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":90917},{"type":"v1","addr":"172.21.15.72:6803","nonce":90917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":90917},{"type":"v1","addr":"172.21.15.72:6807","nonce":90917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":90917},{"type":"v1","addr":"172.21.15.72:6805","nonce":90917}]},"public_addr":"172.21.15.72:6801/90917","cluster_addr":"172.21.15.72:6803/90917","heartbeat_back_addr":"172.21.15.72:6807/90917","heartbeat_front_addr":"172.21.15.72:6805/90917","state":["exists","up"]},{"osd":5,"uuid":"5ef0790f-001e-458f-a05b-efae216cf435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":90941},{"type":"v1","addr":"172.21.15.72:6817","nonce":90941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":90941},{"type":"v1","addr":"172.21.15.72:6819","nonce":90941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":90941},{"type":"v1","addr":"172.21.15.72:6827","nonce":90941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":90941},{"type":"v1","addr":"172.21.15.72:6823","nonce":90941}]},"public_addr":"172.21.15.72:6817/90941","cluster_addr":"172.21.15.72:6819/90941","heartbeat_back_addr":"172.21.15.72:6827/90941","heartbeat_front_addr":"172.21.15.72:6823/90941","state":["exists","up"]},{"osd":6,"uuid":"8705aef1-9ae8-4e54-a3c4-c2909fa0ceb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":90918},{"type":"v1","addr":"172.21.15.72:6809","nonce":90918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":90918},{"type":"v1","addr":"172.21.15.72:6811","nonce":90918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":90918},{"type":"v1","addr":"172.21.15.72:6815","nonce":90918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":90918},{"type":"v1","addr":"172.21.15.72:6813","nonce":90918}]},"public_addr":"172.21.15.72:6809/90918","cluster_addr":"172.21.15.72:6811/90918","heartbeat_back_addr":"172.21.15.72:6815/90918","heartbeat_front_addr":"172.21.15.72:6813/90918","state":["exists","up"]},{"osd":7,"uuid":"364c5119-6b13-4c75-b3f0-15e165eff86a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":90948},{"type":"v1","addr":"172.21.15.72:6822","nonce":90948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":90948},{"type":"v1","addr":"172.21.15.72:6826","nonce":90948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":90948},{"type":"v1","addr":"172.21.15.72:6831","nonce":90948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":90948},{"type":"v1","addr":"172.21.15.72:6829","nonce":90948}]},"public_addr":"172.21.15.72:6822/90948","cluster_addr":"172.21.15.72:6826/90948","heartbeat_back_addr":"172.21.15.72:6831/90948","heartbeat_front_addr":"172.21.15.72:6829/90948","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.642976+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.645372+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.619116+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.663042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.599163+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.646411+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.631545+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.669821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.a","mappings":[{"from":1,"to":5}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:41:03.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.626+0000 7f47ef483700 1 -- 172.21.15.71:0/2595668708 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f47cc066f30 msgr2=0x7f47cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:03.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.626+0000 7f47ef483700 1 --2- 172.21.15.71:0/2595668708 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f47cc066f30 0x7f47cc0693e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f47e400c690 tx=0x7f47e4015000 comp rx=0 tx=0).stop 2023-10-06T01:41:03.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.626+0000 7f47ef483700 1 -- 172.21.15.71:0/2595668708 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47e8169b00 msgr2=0x7f47e8169f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:03.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.626+0000 7f47ef483700 1 --2- 172.21.15.71:0/2595668708 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47e8169b00 0x7f47e8169f70 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f47d8002b30 tx=0x7f47d8007d10 comp rx=0 tx=0).stop 2023-10-06T01:41:03.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.627+0000 7f47ef483700 1 -- 172.21.15.71:0/2595668708 shutdown_connections 2023-10-06T01:41:03.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.627+0000 7f47ef483700 1 --2- 172.21.15.71:0/2595668708 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f47e815f710 0x7f47e815fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:03.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.627+0000 7f47ef483700 1 --2- 172.21.15.71:0/2595668708 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f47cc066f30 0x7f47cc0693e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:03.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.627+0000 7f47ef483700 1 --2- 172.21.15.71:0/2595668708 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47d4003a90 0x7f47e8152640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:03.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.627+0000 7f47ef483700 1 --2- 172.21.15.71:0/2595668708 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f47e8169b00 0x7f47e8169f70 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:03.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.627+0000 7f47ef483700 1 -- 172.21.15.71:0/2595668708 >> 172.21.15.71:0/2595668708 conn(0x7f47e8067910 msgr2=0x7f47e806cae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:03.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.627+0000 7f47ef483700 1 -- 172.21.15.71:0/2595668708 shutdown_connections 2023-10-06T01:41:03.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.627+0000 7f47ef483700 1 -- 172.21.15.71:0/2595668708 wait complete. 2023-10-06T01:41:03.639 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T01:40:08.610349+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T01:40:15.387434+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T01:40:19.640459+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T01:40:20.116883+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-06T01:40:23.830129+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T01:41:03.640 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T01:41:03.758 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.757+0000 7f9a849c5700 1 Processor -- start 2023-10-06T01:41:03.758 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.757+0000 7f9a849c5700 1 -- start start 2023-10-06T01:41:03.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.758+0000 7f9a849c5700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9a800cd7d0 0x7f9a800d01a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:03.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.758+0000 7f9a849c5700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9a800b0810 0x7f9a800d06e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:03.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.758+0000 7f9a849c5700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a800d0c20 con 0x7f9a800cd400 2023-10-06T01:41:03.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.758+0000 7f9a849c5700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a800af770 con 0x7f9a800cd7d0 2023-10-06T01:41:03.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.758+0000 7f9a849c5700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a800afa50 con 0x7f9a800b0810 2023-10-06T01:41:03.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.758+0000 7f9a7f7fe700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f9a800cd400 0x7f9a800b1f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:55884/0 (socket says 172.21.15.71:55884) 2023-10-06T01:41:03.761 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.758+0000 7f9a7effd700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9a800cd7d0 0x7f9a800d01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:03.761 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.758+0000 7f9a7f7fe700 1 -- 172.21.15.71:0/3865420162 learned_addr learned my addr 172.21.15.71:0/3865420162 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:41:03.761 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.758+0000 7f9a7effd700 1 -- 172.21.15.71:0/3865420162 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9a800b0810 msgr2=0x7f9a800d06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:03.761 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.758+0000 7f9a7ffff700 1 --2- 172.21.15.71:0/3865420162 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9a800b0810 0x7f9a800d06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:03.761 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.758+0000 7f9a7effd700 1 --2- 172.21.15.71:0/3865420162 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9a800b0810 0x7f9a800d06e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:03.761 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.758+0000 7f9a7effd700 1 -- 172.21.15.71:0/3865420162 >> v1:172.21.15.71:6789/0 conn(0x7f9a800cd400 legacy=0x7f9a800b1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:03.761 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.758+0000 7f9a7effd700 1 -- 172.21.15.71:0/3865420162 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a800afd30 con 0x7f9a800cd7d0 2023-10-06T01:41:03.761 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.758+0000 7f9a7e7fc700 1 -- 172.21.15.71:0/3865420162 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2286315478 0 0) 0x7f9a800d0c20 con 0x7f9a800cd400 2023-10-06T01:41:03.761 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.758+0000 7f9a7effd700 1 --2- 172.21.15.71:0/3865420162 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9a800cd7d0 0x7f9a800d01a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9a74009910 tx=0x7f9a740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64c33fbc0a0f4ff2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:03.761 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.758+0000 7f9a7e7fc700 1 -- 172.21.15.71:0/3865420162 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a7400b820 con 0x7f9a800cd7d0 2023-10-06T01:41:03.761 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.758+0000 7f9a7e7fc700 1 -- 172.21.15.71:0/3865420162 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a7400b980 con 0x7f9a800cd7d0 2023-10-06T01:41:03.762 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.758+0000 7f9a7e7fc700 1 -- 172.21.15.71:0/3865420162 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a7400bd20 con 0x7f9a800cd7d0 2023-10-06T01:41:03.762 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.759+0000 7f9a849c5700 1 -- 172.21.15.71:0/3865420162 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9a800cd7d0 msgr2=0x7f9a800d01a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:03.762 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.759+0000 7f9a849c5700 1 --2- 172.21.15.71:0/3865420162 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9a800cd7d0 0x7f9a800d01a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9a74009910 tx=0x7f9a740091a0 comp rx=0 tx=0).stop 2023-10-06T01:41:03.762 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.759+0000 7f9a849c5700 1 -- 172.21.15.71:0/3865420162 shutdown_connections 2023-10-06T01:41:03.762 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.759+0000 7f9a849c5700 1 --2- 172.21.15.71:0/3865420162 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9a800b0810 0x7f9a800d06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:03.762 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.759+0000 7f9a849c5700 1 --2- 172.21.15.71:0/3865420162 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9a800cd7d0 0x7f9a800d01a0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:03.762 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.759+0000 7f9a849c5700 1 -- 172.21.15.71:0/3865420162 >> 172.21.15.71:0/3865420162 conn(0x7f9a8006a110 msgr2=0x7f9a8006a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:03.762 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.759+0000 7f9a849c5700 1 -- 172.21.15.71:0/3865420162 shutdown_connections 2023-10-06T01:41:03.762 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.759+0000 7f9a849c5700 1 -- 172.21.15.71:0/3865420162 wait complete. 2023-10-06T01:41:03.764 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.760+0000 7f9a849c5700 1 Processor -- start 2023-10-06T01:41:03.765 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.760+0000 7f9a849c5700 1 -- start start 2023-10-06T01:41:03.765 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.761+0000 7f9a849c5700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9a800b0810 0x7f9a80169840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:03.765 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.761+0000 7f9a849c5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a800cd400 0x7f9a801537e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:03.765 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.761+0000 7f9a849c5700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9a801553b0 0x7f9a800b3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:03.765 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.761+0000 7f9a849c5700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a80154890 con 0x7f9a800b0810 2023-10-06T01:41:03.765 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.761+0000 7f9a849c5700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a80169d80 con 0x7f9a800cd400 2023-10-06T01:41:03.765 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.761+0000 7f9a849c5700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a80153d20 con 0x7f9a801553b0 2023-10-06T01:41:03.765 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.761+0000 7f9a7f7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9a800b0810 0x7f9a80169840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:03.765 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.761+0000 7f9a7f7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9a800b0810 0x7f9a80169840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36046/0 (socket says 172.21.15.71:36046) 2023-10-06T01:41:03.765 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.761+0000 7f9a7f7fe700 1 -- 172.21.15.71:0/1369987803 learned_addr learned my addr 172.21.15.71:0/1369987803 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:03.766 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.761+0000 7f9a7effd700 1 --2- 172.21.15.71:0/1369987803 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a800cd400 0x7f9a801537e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:03.766 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.761+0000 7f9a7ffff700 1 --2- 172.21.15.71:0/1369987803 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9a801553b0 0x7f9a800b3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:03.766 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.761+0000 7f9a7f7fe700 1 -- 172.21.15.71:0/1369987803 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9a801553b0 msgr2=0x7f9a800b3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:03.766 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.761+0000 7f9a7f7fe700 1 --2- 172.21.15.71:0/1369987803 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9a801553b0 0x7f9a800b3eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:03.766 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.761+0000 7f9a7f7fe700 1 -- 172.21.15.71:0/1369987803 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a800cd400 msgr2=0x7f9a801537e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:03.766 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.761+0000 7f9a7f7fe700 1 --2- 172.21.15.71:0/1369987803 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a800cd400 0x7f9a801537e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:03.766 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.761+0000 7f9a7f7fe700 1 -- 172.21.15.71:0/1369987803 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a74009420 con 0x7f9a800b0810 2023-10-06T01:41:03.766 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.761+0000 7f9a7f7fe700 1 --2- 172.21.15.71:0/1369987803 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9a800b0810 0x7f9a80169840 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9a7000cb60 tx=0x7f9a700017b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:03.766 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.762+0000 7f9a677fe700 1 -- 172.21.15.71:0/1369987803 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a70005d80 con 0x7f9a800b0810 2023-10-06T01:41:03.766 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.762+0000 7f9a677fe700 1 -- 172.21.15.71:0/1369987803 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a7000a5a0 con 0x7f9a800b0810 2023-10-06T01:41:03.766 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.762+0000 7f9a849c5700 1 -- 172.21.15.71:0/1369987803 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a80153ff0 con 0x7f9a800b0810 2023-10-06T01:41:03.767 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.762+0000 7f9a677fe700 1 -- 172.21.15.71:0/1369987803 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a7000a960 con 0x7f9a800b0810 2023-10-06T01:41:03.767 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.762+0000 7f9a849c5700 1 -- 172.21.15.71:0/1369987803 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a801545b0 con 0x7f9a800b0810 2023-10-06T01:41:03.767 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.763+0000 7f9a849c5700 1 -- 172.21.15.71:0/1369987803 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a80064aa0 con 0x7f9a800b0810 2023-10-06T01:41:03.767 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.763+0000 7f9a677fe700 1 -- 172.21.15.71:0/1369987803 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9a7000acd0 con 0x7f9a800b0810 2023-10-06T01:41:03.767 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.763+0000 7f9a677fe700 1 --2- 172.21.15.71:0/1369987803 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f9a6c066f30 0x7f9a6c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:03.767 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.763+0000 7f9a677fe700 1 -- 172.21.15.71:0/1369987803 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f9a70084480 con 0x7f9a800b0810 2023-10-06T01:41:03.767 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.763+0000 7f9a7effd700 1 --2- 172.21.15.71:0/1369987803 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f9a6c066f30 0x7f9a6c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:03.767 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.764+0000 7f9a7effd700 1 --2- 172.21.15.71:0/1369987803 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f9a6c066f30 0x7f9a6c0693e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9a74009910 tx=0x7f9a74017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:03.768 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.768+0000 7f9a677fe700 1 -- 172.21.15.71:0/1369987803 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9a700512e0 con 0x7f9a800b0810 2023-10-06T01:41:03.956 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.956+0000 7f9a849c5700 1 -- 172.21.15.71:0/1369987803 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9a800b0010 con 0x7f9a800b0810 2023-10-06T01:41:03.957 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.956+0000 7f9a677fe700 1 -- 172.21.15.71:0/1369987803 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9a70018020 con 0x7f9a800b0810 2023-10-06T01:41:03.957 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 1 2023-10-06T01:41:03.959 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.958+0000 7f9a849c5700 1 -- 172.21.15.71:0/1369987803 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f9a6c066f30 msgr2=0x7f9a6c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:03.959 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.958+0000 7f9a849c5700 1 --2- 172.21.15.71:0/1369987803 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f9a6c066f30 0x7f9a6c0693e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9a74009910 tx=0x7f9a74017000 comp rx=0 tx=0).stop 2023-10-06T01:41:03.959 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.958+0000 7f9a849c5700 1 -- 172.21.15.71:0/1369987803 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9a800b0810 msgr2=0x7f9a80169840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:03.959 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.958+0000 7f9a849c5700 1 --2- 172.21.15.71:0/1369987803 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9a800b0810 0x7f9a80169840 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9a7000cb60 tx=0x7f9a700017b0 comp rx=0 tx=0).stop 2023-10-06T01:41:03.959 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.958+0000 7f9a849c5700 1 -- 172.21.15.71:0/1369987803 shutdown_connections 2023-10-06T01:41:03.959 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.958+0000 7f9a849c5700 1 --2- 172.21.15.71:0/1369987803 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9a801553b0 0x7f9a800b3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:03.959 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.958+0000 7f9a849c5700 1 --2- 172.21.15.71:0/1369987803 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9a800b0810 0x7f9a80169840 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:03.959 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.958+0000 7f9a849c5700 1 --2- 172.21.15.71:0/1369987803 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f9a6c066f30 0x7f9a6c0693e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:03.959 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.958+0000 7f9a849c5700 1 --2- 172.21.15.71:0/1369987803 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a800cd400 0x7f9a801537e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:03.960 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.958+0000 7f9a849c5700 1 -- 172.21.15.71:0/1369987803 >> 172.21.15.71:0/1369987803 conn(0x7f9a8006a110 msgr2=0x7f9a800cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:03.960 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.958+0000 7f9a849c5700 1 -- 172.21.15.71:0/1369987803 shutdown_connections 2023-10-06T01:41:03.960 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:03.958+0000 7f9a849c5700 1 -- 172.21.15.71:0/1369987803 wait complete. 2023-10-06T01:41:03.970 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T01:41:04.088 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.088+0000 7fe1e9fdf700 1 Processor -- start 2023-10-06T01:41:04.089 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.088+0000 7fe1e9fdf700 1 -- start start 2023-10-06T01:41:04.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.089+0000 7fe1e9fdf700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe1e4086ff0 0x7fe1e4087440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:04.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.089+0000 7fe1e9fdf700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1e4087980 con 0x7fe1e40b21b0 2023-10-06T01:41:04.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.089+0000 7fe1e9fdf700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1e40afc50 con 0x7fe1e415a030 2023-10-06T01:41:04.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.089+0000 7fe1e9fdf700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e40b0cf0 con 0x7fe1e4086ff0 2023-10-06T01:41:04.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.089+0000 7fe1e3fff700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fe1e40b21b0 0x7fe1e40b25f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:55896/0 (socket says 172.21.15.71:55896) 2023-10-06T01:41:04.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.089+0000 7fe1e3fff700 1 -- 172.21.15.71:0/1593662053 learned_addr learned my addr 172.21.15.71:0/1593662053 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:41:04.091 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.089+0000 7fe1dbfff700 1 --2- 172.21.15.71:0/1593662053 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe1e4086ff0 0x7fe1e4087440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:04.092 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.089+0000 7fe1e2ffd700 1 -- 172.21.15.71:0/1593662053 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 613158334 0 0) 0x7fe1e4087980 con 0x7fe1e40b21b0 2023-10-06T01:41:04.092 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.089+0000 7fe1e2ffd700 1 -- 172.21.15.71:0/1593662053 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1d0003570 con 0x7fe1e40b21b0 2023-10-06T01:41:04.092 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.089+0000 7fe1e2ffd700 1 -- 172.21.15.71:0/1593662053 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3789286899 0 0) 0x7fe1e40afc50 con 0x7fe1e415a030 2023-10-06T01:41:04.092 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.089+0000 7fe1e2ffd700 1 -- 172.21.15.71:0/1593662053 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1e4087980 con 0x7fe1e415a030 2023-10-06T01:41:04.092 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.089+0000 7fe1e2ffd700 1 -- 172.21.15.71:0/1593662053 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1163243410 0 0) 0x7fe1d0003570 con 0x7fe1e40b21b0 2023-10-06T01:41:04.092 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.089+0000 7fe1dbfff700 1 -- 172.21.15.71:0/1593662053 >> v1:172.21.15.72:6789/0 conn(0x7fe1e415a030 legacy=0x7fe1e415a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:04.092 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.089+0000 7fe1dbfff700 1 -- 172.21.15.71:0/1593662053 >> v1:172.21.15.71:6789/0 conn(0x7fe1e40b21b0 legacy=0x7fe1e40b25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:04.092 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.089+0000 7fe1dbfff700 1 -- 172.21.15.71:0/1593662053 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1e40aff30 con 0x7fe1e4086ff0 2023-10-06T01:41:04.092 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.089+0000 7fe1dbfff700 1 --2- 172.21.15.71:0/1593662053 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe1e4086ff0 0x7fe1e4087440 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc009910 tx=0x7fe1cc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21ec75cbcea1d56b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:04.092 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.090+0000 7fe1e2ffd700 1 -- 172.21.15.71:0/1593662053 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1dc0017f0 con 0x7fe1e4086ff0 2023-10-06T01:41:04.092 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.090+0000 7fe1e2ffd700 1 -- 172.21.15.71:0/1593662053 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1cc011420 con 0x7fe1e4086ff0 2023-10-06T01:41:04.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.090+0000 7fe1e2ffd700 1 -- 172.21.15.71:0/1593662053 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1cc0117a0 con 0x7fe1e4086ff0 2023-10-06T01:41:04.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.090+0000 7fe1e9fdf700 1 -- 172.21.15.71:0/1593662053 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe1e4086ff0 msgr2=0x7fe1e4087440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:04.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.090+0000 7fe1e9fdf700 1 --2- 172.21.15.71:0/1593662053 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe1e4086ff0 0x7fe1e4087440 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc009910 tx=0x7fe1cc0091a0 comp rx=0 tx=0).stop 2023-10-06T01:41:04.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.090+0000 7fe1e9fdf700 1 -- 172.21.15.71:0/1593662053 shutdown_connections 2023-10-06T01:41:04.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.090+0000 7fe1e9fdf700 1 --2- 172.21.15.71:0/1593662053 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe1e4086ff0 0x7fe1e4087440 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:04.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.090+0000 7fe1e9fdf700 1 -- 172.21.15.71:0/1593662053 >> 172.21.15.71:0/1593662053 conn(0x7fe1e4068680 msgr2=0x7fe1e4068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:04.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.090+0000 7fe1e9fdf700 1 -- 172.21.15.71:0/1593662053 shutdown_connections 2023-10-06T01:41:04.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.090+0000 7fe1e9fdf700 1 -- 172.21.15.71:0/1593662053 wait complete. 2023-10-06T01:41:04.096 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.091+0000 7fe1e9fdf700 1 Processor -- start 2023-10-06T01:41:04.096 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.091+0000 7fe1e9fdf700 1 -- start start 2023-10-06T01:41:04.096 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.092+0000 7fe1e9fdf700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1e4086ff0 0x7fe1e415cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:04.096 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.092+0000 7fe1e9fdf700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe1e40b21b0 0x7fe1e416a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:04.096 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.092+0000 7fe1e9fdf700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe1e415a030 0x7fe1e40c4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:04.096 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.092+0000 7fe1e9fdf700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e40c5f20 con 0x7fe1e415a030 2023-10-06T01:41:04.096 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.092+0000 7fe1e9fdf700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e40c5310 con 0x7fe1e4086ff0 2023-10-06T01:41:04.096 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.092+0000 7fe1e9fdf700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e40c55f0 con 0x7fe1e40b21b0 2023-10-06T01:41:04.096 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.092+0000 7fe1e3fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe1e415a030 0x7fe1e40c4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:04.096 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.092+0000 7fe1e3fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe1e415a030 0x7fe1e40c4c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36052/0 (socket says 172.21.15.71:36052) 2023-10-06T01:41:04.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.092+0000 7fe1e3fff700 1 -- 172.21.15.71:0/3683803281 learned_addr learned my addr 172.21.15.71:0/3683803281 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:04.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.092+0000 7fe1dbfff700 1 --2- 172.21.15.71:0/3683803281 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe1e40b21b0 0x7fe1e416a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:04.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.092+0000 7fe1e37fe700 1 --2- 172.21.15.71:0/3683803281 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1e4086ff0 0x7fe1e415cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:04.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.092+0000 7fe1e3fff700 1 -- 172.21.15.71:0/3683803281 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe1e40b21b0 msgr2=0x7fe1e416a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:04.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.092+0000 7fe1e3fff700 1 --2- 172.21.15.71:0/3683803281 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe1e40b21b0 0x7fe1e416a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:04.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.092+0000 7fe1e3fff700 1 -- 172.21.15.71:0/3683803281 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1e4086ff0 msgr2=0x7fe1e415cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:04.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.092+0000 7fe1e3fff700 1 --2- 172.21.15.71:0/3683803281 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1e4086ff0 0x7fe1e415cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:04.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.092+0000 7fe1e3fff700 1 -- 172.21.15.71:0/3683803281 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1cc009420 con 0x7fe1e415a030 2023-10-06T01:41:04.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.093+0000 7fe1e3fff700 1 --2- 172.21.15.71:0/3683803281 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe1e415a030 0x7fe1e40c4c10 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc00cc10 tx=0x7fe1dc007c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:04.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.093+0000 7fe1db7fe700 1 -- 172.21.15.71:0/3683803281 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1dc004dc0 con 0x7fe1e415a030 2023-10-06T01:41:04.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.093+0000 7fe1db7fe700 1 -- 172.21.15.71:0/3683803281 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1dc00a720 con 0x7fe1e415a030 2023-10-06T01:41:04.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.093+0000 7fe1e9fdf700 1 -- 172.21.15.71:0/3683803281 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1e40c58d0 con 0x7fe1e415a030 2023-10-06T01:41:04.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.093+0000 7fe1db7fe700 1 -- 172.21.15.71:0/3683803281 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1dc00aae0 con 0x7fe1e415a030 2023-10-06T01:41:04.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.093+0000 7fe1e9fdf700 1 -- 172.21.15.71:0/3683803281 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1e40c63b0 con 0x7fe1e415a030 2023-10-06T01:41:04.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.094+0000 7fe1e9fdf700 1 -- 172.21.15.71:0/3683803281 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1e40c6090 con 0x7fe1e415a030 2023-10-06T01:41:04.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.094+0000 7fe1db7fe700 1 -- 172.21.15.71:0/3683803281 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe1dc007150 con 0x7fe1e415a030 2023-10-06T01:41:04.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.094+0000 7fe1db7fe700 1 --2- 172.21.15.71:0/3683803281 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fe1c4066f30 0x7fe1c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:04.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.094+0000 7fe1db7fe700 1 -- 172.21.15.71:0/3683803281 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6867+0+0 (secure 0 0 0) 0x7fe1dc0844e0 con 0x7fe1e415a030 2023-10-06T01:41:04.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.095+0000 7fe1e37fe700 1 --2- 172.21.15.71:0/3683803281 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fe1c4066f30 0x7fe1c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:04.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.095+0000 7fe1e37fe700 1 --2- 172.21.15.71:0/3683803281 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fe1c4066f30 0x7fe1c40693e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe1d4002730 tx=0x7fe1d4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:04.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.099+0000 7fe1db7fe700 1 -- 172.21.15.71:0/3683803281 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe1dc051340 con 0x7fe1e415a030 2023-10-06T01:41:04.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.279+0000 7fe1e9fdf700 1 -- 172.21.15.71:0/3683803281 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe1e40b0210 con 0x7fe1e415a030 2023-10-06T01:41:04.280 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.279+0000 7fe1db7fe700 1 -- 172.21.15.71:0/3683803281 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe1dc054960 con 0x7fe1e415a030 2023-10-06T01:41:04.280 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 8 2023-10-06T01:41:04.282 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.281+0000 7fe1e9fdf700 1 -- 172.21.15.71:0/3683803281 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fe1c4066f30 msgr2=0x7fe1c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:04.282 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.281+0000 7fe1e9fdf700 1 --2- 172.21.15.71:0/3683803281 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fe1c4066f30 0x7fe1c40693e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe1d4002730 tx=0x7fe1d4009040 comp rx=0 tx=0).stop 2023-10-06T01:41:04.282 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.281+0000 7fe1e9fdf700 1 -- 172.21.15.71:0/3683803281 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe1e415a030 msgr2=0x7fe1e40c4c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:04.282 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.281+0000 7fe1e9fdf700 1 --2- 172.21.15.71:0/3683803281 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe1e415a030 0x7fe1e40c4c10 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc00cc10 tx=0x7fe1dc007c70 comp rx=0 tx=0).stop 2023-10-06T01:41:04.282 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.281+0000 7fe1e9fdf700 1 -- 172.21.15.71:0/3683803281 shutdown_connections 2023-10-06T01:41:04.282 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.281+0000 7fe1e9fdf700 1 --2- 172.21.15.71:0/3683803281 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe1e415a030 0x7fe1e40c4c10 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:04.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.281+0000 7fe1e9fdf700 1 --2- 172.21.15.71:0/3683803281 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fe1c4066f30 0x7fe1c40693e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:04.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.281+0000 7fe1e9fdf700 1 --2- 172.21.15.71:0/3683803281 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1e4086ff0 0x7fe1e415cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:04.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.281+0000 7fe1e9fdf700 1 --2- 172.21.15.71:0/3683803281 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe1e40b21b0 0x7fe1e416a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:04.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.281+0000 7fe1e9fdf700 1 -- 172.21.15.71:0/3683803281 >> 172.21.15.71:0/3683803281 conn(0x7fe1e4068680 msgr2=0x7fe1e40cb2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:04.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.281+0000 7fe1e9fdf700 1 -- 172.21.15.71:0/3683803281 shutdown_connections 2023-10-06T01:41:04.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.281+0000 7fe1e9fdf700 1 -- 172.21.15.71:0/3683803281 wait complete. 2023-10-06T01:41:04.294 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T01:41:04.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.410+0000 7f4622166700 1 Processor -- start 2023-10-06T01:41:04.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.410+0000 7f4622166700 1 -- start start 2023-10-06T01:41:04.412 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.411+0000 7f4622166700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f461c0cd400 0x7f461c0b1f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:04.412 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.411+0000 7f4622166700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f461c0af770 con 0x7f461c0cd7d0 2023-10-06T01:41:04.412 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.411+0000 7f4622166700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f461c0afa50 con 0x7f461c0b0810 2023-10-06T01:41:04.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.411+0000 7f4622166700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f461c0afd30 con 0x7f461c0cd400 2023-10-06T01:41:04.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.411+0000 7f4621164700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f461c0cd400 0x7f461c0b1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:04.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.411+0000 7f4620963700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f461c0cd7d0 0x7f461c0d01a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:55912/0 (socket says 172.21.15.71:55912) 2023-10-06T01:41:04.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.411+0000 7f4620963700 1 -- 172.21.15.71:0/89434866 learned_addr learned my addr 172.21.15.71:0/89434866 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:41:04.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.411+0000 7f4621164700 1 -- 172.21.15.71:0/89434866 >> v1:172.21.15.72:6789/0 conn(0x7f461c0b0810 legacy=0x7f461c15a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:04.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.411+0000 7f4621164700 1 -- 172.21.15.71:0/89434866 >> v1:172.21.15.71:6789/0 conn(0x7f461c0cd7d0 legacy=0x7f461c0d01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:04.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.411+0000 7f4613fff700 1 -- 172.21.15.71:0/89434866 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2598541517 0 0) 0x7f461c0af770 con 0x7f461c0cd7d0 2023-10-06T01:41:04.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.411+0000 7f4621164700 1 -- 172.21.15.71:0/89434866 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f461c0b0010 con 0x7f461c0cd400 2023-10-06T01:41:04.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.412+0000 7f4621164700 1 --2- 172.21.15.71:0/89434866 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f461c0cd400 0x7f461c0b1f20 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f4618009900 tx=0x7f4618009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a56834aca3163638 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:04.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.412+0000 7f4613fff700 1 -- 172.21.15.71:0/89434866 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4618009ea0 con 0x7f461c0cd400 2023-10-06T01:41:04.414 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.412+0000 7f4613fff700 1 -- 172.21.15.71:0/89434866 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4618005c10 con 0x7f461c0cd400 2023-10-06T01:41:04.414 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.412+0000 7f4613fff700 1 -- 172.21.15.71:0/89434866 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f461800b610 con 0x7f461c0cd400 2023-10-06T01:41:04.416 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.412+0000 7f4622166700 1 -- 172.21.15.71:0/89434866 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f461c0cd400 msgr2=0x7f461c0b1f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:04.416 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.412+0000 7f4622166700 1 --2- 172.21.15.71:0/89434866 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f461c0cd400 0x7f461c0b1f20 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f4618009900 tx=0x7f4618009120 comp rx=0 tx=0).stop 2023-10-06T01:41:04.416 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.412+0000 7f4622166700 1 -- 172.21.15.71:0/89434866 shutdown_connections 2023-10-06T01:41:04.417 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.412+0000 7f4622166700 1 --2- 172.21.15.71:0/89434866 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f461c0cd400 0x7f461c0b1f20 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:04.417 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.412+0000 7f4622166700 1 -- 172.21.15.71:0/89434866 >> 172.21.15.71:0/89434866 conn(0x7f461c06a110 msgr2=0x7f461c06a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:04.417 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.412+0000 7f4622166700 1 -- 172.21.15.71:0/89434866 shutdown_connections 2023-10-06T01:41:04.417 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.412+0000 7f4622166700 1 -- 172.21.15.71:0/89434866 wait complete. 2023-10-06T01:41:04.417 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.413+0000 7f4622166700 1 Processor -- start 2023-10-06T01:41:04.417 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.413+0000 7f4622166700 1 -- start start 2023-10-06T01:41:04.417 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.414+0000 7f4622166700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f461c0b0810 0x7f461c0c6a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:04.417 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.414+0000 7f4622166700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f461c0cd400 0x7f461c1697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:04.417 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.414+0000 7f4622166700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f461c15c470 0x7f461c169d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:04.417 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.414+0000 7f4622166700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f461c15b0f0 con 0x7f461c0b0810 2023-10-06T01:41:04.417 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.414+0000 7f4622166700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f461c15a4e0 con 0x7f461c15c470 2023-10-06T01:41:04.418 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.414+0000 7f4622166700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f461c15a7c0 con 0x7f461c0cd400 2023-10-06T01:41:04.418 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.414+0000 7f4621164700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f461c0b0810 0x7f461c0c6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:04.418 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.414+0000 7f4621164700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f461c0b0810 0x7f461c0c6a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36068/0 (socket says 172.21.15.71:36068) 2023-10-06T01:41:04.418 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.414+0000 7f4621164700 1 -- 172.21.15.71:0/3979447750 learned_addr learned my addr 172.21.15.71:0/3979447750 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:04.418 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.415+0000 7f4621965700 1 --2- 172.21.15.71:0/3979447750 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f461c15c470 0x7f461c169d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:04.418 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.415+0000 7f4620963700 1 --2- 172.21.15.71:0/3979447750 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f461c0cd400 0x7f461c1697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:04.418 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.415+0000 7f4621164700 1 -- 172.21.15.71:0/3979447750 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f461c0cd400 msgr2=0x7f461c1697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:04.418 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.415+0000 7f4621164700 1 --2- 172.21.15.71:0/3979447750 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f461c0cd400 0x7f461c1697e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:04.418 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.415+0000 7f4621164700 1 -- 172.21.15.71:0/3979447750 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f461c15c470 msgr2=0x7f461c169d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:04.418 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.415+0000 7f4621164700 1 --2- 172.21.15.71:0/3979447750 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f461c15c470 0x7f461c169d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:04.419 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.415+0000 7f4621164700 1 -- 172.21.15.71:0/3979447750 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46180093c0 con 0x7f461c0b0810 2023-10-06T01:41:04.419 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.415+0000 7f4621164700 1 --2- 172.21.15.71:0/3979447750 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f461c0b0810 0x7f461c0c6a10 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f461c0b1510 tx=0x7f4618016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:04.419 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.415+0000 7f46117fa700 1 -- 172.21.15.71:0/3979447750 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4618009ea0 con 0x7f461c0b0810 2023-10-06T01:41:04.419 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.415+0000 7f46117fa700 1 -- 172.21.15.71:0/3979447750 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4618009120 con 0x7f461c0b0810 2023-10-06T01:41:04.419 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.415+0000 7f46117fa700 1 -- 172.21.15.71:0/3979447750 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f461801b480 con 0x7f461c0b0810 2023-10-06T01:41:04.419 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.415+0000 7f4622166700 1 -- 172.21.15.71:0/3979447750 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f461c15aaa0 con 0x7f461c0b0810 2023-10-06T01:41:04.419 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.415+0000 7f4622166700 1 -- 172.21.15.71:0/3979447750 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f461c15a1b0 con 0x7f461c0b0810 2023-10-06T01:41:04.419 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.416+0000 7f4622166700 1 -- 172.21.15.71:0/3979447750 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f461c0c6f50 con 0x7f461c0b0810 2023-10-06T01:41:04.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.416+0000 7f46117fa700 1 -- 172.21.15.71:0/3979447750 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f461801b8b0 con 0x7f461c0b0810 2023-10-06T01:41:04.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.417+0000 7f46117fa700 1 --2- 172.21.15.71:0/3979447750 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f4600066f30 0x7f46000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:04.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.417+0000 7f46117fa700 1 -- 172.21.15.71:0/3979447750 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f4618086780 con 0x7f461c0b0810 2023-10-06T01:41:04.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.417+0000 7f4620963700 1 --2- 172.21.15.71:0/3979447750 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f4600066f30 0x7f46000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:04.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.417+0000 7f4620963700 1 --2- 172.21.15.71:0/3979447750 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f4600066f30 0x7f46000693e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f461c0cf7b0 tx=0x7f460c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:04.421 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.421+0000 7f46117fa700 1 -- 172.21.15.71:0/3979447750 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4618053610 con 0x7f461c0b0810 2023-10-06T01:41:04.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.604+0000 7f4622166700 1 -- 172.21.15.71:0/3979447750 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f461c064aa0 con 0x7f461c0b0810 2023-10-06T01:41:04.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.604+0000 7f46117fa700 1 -- 172.21.15.71:0/3979447750 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4618056c30 con 0x7f461c0b0810 2023-10-06T01:41:04.605 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 32 2023-10-06T01:41:04.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.606+0000 7f4622166700 1 -- 172.21.15.71:0/3979447750 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f4600066f30 msgr2=0x7f46000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:04.608 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.606+0000 7f4622166700 1 --2- 172.21.15.71:0/3979447750 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f4600066f30 0x7f46000693e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f461c0cf7b0 tx=0x7f460c009040 comp rx=0 tx=0).stop 2023-10-06T01:41:04.608 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.606+0000 7f4622166700 1 -- 172.21.15.71:0/3979447750 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f461c0b0810 msgr2=0x7f461c0c6a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:04.608 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.606+0000 7f4622166700 1 --2- 172.21.15.71:0/3979447750 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f461c0b0810 0x7f461c0c6a10 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f461c0b1510 tx=0x7f4618016000 comp rx=0 tx=0).stop 2023-10-06T01:41:04.608 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.606+0000 7f4622166700 1 -- 172.21.15.71:0/3979447750 shutdown_connections 2023-10-06T01:41:04.608 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.606+0000 7f4622166700 1 --2- 172.21.15.71:0/3979447750 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f4600066f30 0x7f46000693e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:04.608 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.607+0000 7f4622166700 1 --2- 172.21.15.71:0/3979447750 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f461c15c470 0x7f461c169d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:04.608 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.607+0000 7f4622166700 1 --2- 172.21.15.71:0/3979447750 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f461c0b0810 0x7f461c0c6a10 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:04.608 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.607+0000 7f4622166700 1 --2- 172.21.15.71:0/3979447750 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f461c0cd400 0x7f461c1697e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:04.608 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.607+0000 7f4622166700 1 -- 172.21.15.71:0/3979447750 >> 172.21.15.71:0/3979447750 conn(0x7f461c06a110 msgr2=0x7f461c0cdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:04.608 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.607+0000 7f4622166700 1 -- 172.21.15.71:0/3979447750 shutdown_connections 2023-10-06T01:41:04.609 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.607+0000 7f4622166700 1 -- 172.21.15.71:0/3979447750 wait complete. 2023-10-06T01:41:04.619 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T01:41:04.736 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.735+0000 7f3e4dd7b700 1 Processor -- start 2023-10-06T01:41:04.736 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.735+0000 7f3e4dd7b700 1 -- start start 2023-10-06T01:41:04.739 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.736+0000 7f3e4dd7b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3e480cd400 0x7f3e480b1f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:04.740 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.736+0000 7f3e4dd7b700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e480af770 con 0x7f3e480cd7d0 2023-10-06T01:41:04.740 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.736+0000 7f3e4dd7b700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e480afa50 con 0x7f3e480b0810 2023-10-06T01:41:04.740 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.736+0000 7f3e4dd7b700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e480afd30 con 0x7f3e480cd400 2023-10-06T01:41:04.740 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.736+0000 7f3e47fff700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f3e480cd7d0 0x7f3e480d01a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:55914/0 (socket says 172.21.15.71:55914) 2023-10-06T01:41:04.740 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.736+0000 7f3e47fff700 1 -- 172.21.15.71:0/4243363158 learned_addr learned my addr 172.21.15.71:0/4243363158 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:41:04.740 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.736+0000 7f3e4cd79700 1 --2- 172.21.15.71:0/4243363158 >> v2:172.21.15.72:3300/0 conn(0x7f3e480cd400 0x7f3e480b1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:04.740 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.736+0000 7f3e477fe700 1 -- 172.21.15.71:0/4243363158 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 546958918 0 0) 0x7f3e480af770 con 0x7f3e480cd7d0 2023-10-06T01:41:04.740 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.736+0000 7f3e477fe700 1 -- 172.21.15.71:0/4243363158 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e30003570 con 0x7f3e480cd7d0 2023-10-06T01:41:04.741 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.737+0000 7f3e477fe700 1 -- 172.21.15.71:0/4243363158 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2813143112 0 0) 0x7f3e30003570 con 0x7f3e480cd7d0 2023-10-06T01:41:04.741 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.737+0000 7f3e477fe700 1 -- 172.21.15.71:0/4243363158 >> v2:172.21.15.72:3300/0 conn(0x7f3e480cd400 msgr2=0x7f3e480b1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:04.741 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.737+0000 7f3e477fe700 1 --2- 172.21.15.71:0/4243363158 >> v2:172.21.15.72:3300/0 conn(0x7f3e480cd400 0x7f3e480b1f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:04.741 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.737+0000 7f3e477fe700 1 -- 172.21.15.71:0/4243363158 >> v1:172.21.15.72:6789/0 conn(0x7f3e480b0810 legacy=0x7f3e4815a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:04.741 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.737+0000 7f3e477fe700 1 -- 172.21.15.71:0/4243363158 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e480b0010 con 0x7f3e480cd7d0 2023-10-06T01:41:04.741 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.737+0000 7f3e477fe700 1 -- 172.21.15.71:0/4243363158 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1184243524 0 0) 0x7f3e3c001470 con 0x7f3e480cd7d0 2023-10-06T01:41:04.741 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.737+0000 7f3e477fe700 1 -- 172.21.15.71:0/4243363158 >> v1:172.21.15.71:6789/0 conn(0x7f3e480cd7d0 legacy=0x7f3e480d01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:04.741 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.737+0000 7f3e477fe700 1 --2- 172.21.15.71:0/4243363158 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e30003a60 0x7f3e30003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:04.741 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.737+0000 7f3e477fe700 1 --2- 172.21.15.71:0/4243363158 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3e30004810 0x7f3e30004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:04.742 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.737+0000 7f3e477fe700 1 --2- 172.21.15.71:0/4243363158 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3e300052e0 0x7f3e3000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:04.742 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.737+0000 7f3e477fe700 1 -- 172.21.15.71:0/4243363158 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e480afd30 con 0x7f3e30004810 2023-10-06T01:41:04.742 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.737+0000 7f3e477fe700 1 -- 172.21.15.71:0/4243363158 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3000c2a0 con 0x7f3e30003a60 2023-10-06T01:41:04.742 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.737+0000 7f3e477fe700 1 -- 172.21.15.71:0/4243363158 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3000c460 con 0x7f3e300052e0 2023-10-06T01:41:04.742 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.737+0000 7f3e47fff700 1 --2- 172.21.15.71:0/4243363158 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3e30004810 0x7f3e30004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:04.742 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.737+0000 7f3e4cd79700 1 --2- 172.21.15.71:0/4243363158 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e30003a60 0x7f3e30003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:04.742 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.737+0000 7f3e4d57a700 1 --2- 172.21.15.71:0/4243363158 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3e300052e0 0x7f3e3000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:04.742 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.737+0000 7f3e47fff700 1 -- 172.21.15.71:0/4243363158 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3e300052e0 msgr2=0x7f3e3000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:04.742 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.737+0000 7f3e47fff700 1 --2- 172.21.15.71:0/4243363158 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3e300052e0 0x7f3e3000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:04.743 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.737+0000 7f3e47fff700 1 -- 172.21.15.71:0/4243363158 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e30003a60 msgr2=0x7f3e30003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:04.743 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.737+0000 7f3e47fff700 1 --2- 172.21.15.71:0/4243363158 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e30003a60 0x7f3e30003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:04.743 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.737+0000 7f3e47fff700 1 -- 172.21.15.71:0/4243363158 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e30003570 con 0x7f3e30004810 2023-10-06T01:41:04.743 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.737+0000 7f3e4d57a700 1 --2- 172.21.15.71:0/4243363158 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3e300052e0 0x7f3e3000ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:41:04.743 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.737+0000 7f3e4d57a700 1 -- 172.21.15.71:0/4243363158 reap_dead start 2023-10-06T01:41:04.743 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.737+0000 7f3e47fff700 1 --2- 172.21.15.71:0/4243363158 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3e30004810 0x7f3e30004c80 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c00c390 tx=0x7f3e3c001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86e1e0d7135b590c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:04.743 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.737+0000 7f3e477fe700 1 -- 172.21.15.71:0/4243363158 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e3c00cc60 con 0x7f3e30004810 2023-10-06T01:41:04.743 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.737+0000 7f3e477fe700 1 -- 172.21.15.71:0/4243363158 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e3c00cdc0 con 0x7f3e30004810 2023-10-06T01:41:04.743 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.737+0000 7f3e477fe700 1 -- 172.21.15.71:0/4243363158 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e3c005b50 con 0x7f3e30004810 2023-10-06T01:41:04.744 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.738+0000 7f3e4dd7b700 1 -- 172.21.15.71:0/4243363158 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3e30004810 msgr2=0x7f3e30004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:04.744 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.738+0000 7f3e4dd7b700 1 --2- 172.21.15.71:0/4243363158 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3e30004810 0x7f3e30004c80 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c00c390 tx=0x7f3e3c001e50 comp rx=0 tx=0).stop 2023-10-06T01:41:04.744 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.738+0000 7f3e4dd7b700 1 -- 172.21.15.71:0/4243363158 shutdown_connections 2023-10-06T01:41:04.744 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.738+0000 7f3e4dd7b700 1 --2- 172.21.15.71:0/4243363158 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3e30004810 0x7f3e30004c80 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:04.744 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.738+0000 7f3e4dd7b700 1 -- 172.21.15.71:0/4243363158 >> 172.21.15.71:0/4243363158 conn(0x7f3e4806a110 msgr2=0x7f3e4806a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:04.744 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.738+0000 7f3e4dd7b700 1 -- 172.21.15.71:0/4243363158 shutdown_connections 2023-10-06T01:41:04.744 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.738+0000 7f3e4dd7b700 1 -- 172.21.15.71:0/4243363158 wait complete. 2023-10-06T01:41:04.744 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.739+0000 7f3e4dd7b700 1 Processor -- start 2023-10-06T01:41:04.744 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.739+0000 7f3e4dd7b700 1 -- start start 2023-10-06T01:41:04.747 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.740+0000 7f3e4dd7b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3e30004810 0x7f3e480b3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:04.747 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.740+0000 7f3e4dd7b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e480b53e0 0x7f3e480c9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:04.747 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.740+0000 7f3e4dd7b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3e4815dbc0 0x7f3e4815dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:04.747 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.740+0000 7f3e4dd7b700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e48159b70 con 0x7f3e4815dbc0 2023-10-06T01:41:04.747 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.740+0000 7f3e4dd7b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4815e530 con 0x7f3e480b53e0 2023-10-06T01:41:04.747 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.740+0000 7f3e4dd7b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e480b44e0 con 0x7f3e30004810 2023-10-06T01:41:04.747 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.740+0000 7f3e4cd79700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3e30004810 0x7f3e480b3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:04.748 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.740+0000 7f3e47fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e480b53e0 0x7f3e480c9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:04.748 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.740+0000 7f3e4cd79700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3e30004810 0x7f3e480b3fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.71:35318/0 (socket says 172.21.15.71:35318) 2023-10-06T01:41:04.748 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.740+0000 7f3e4cd79700 1 -- 172.21.15.71:0/217837594 learned_addr learned my addr 172.21.15.71:0/217837594 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:04.748 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.741+0000 7f3e4d57a700 1 --2- 172.21.15.71:0/217837594 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3e4815dbc0 0x7f3e4815dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:04.748 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.741+0000 7f3e4cd79700 1 -- 172.21.15.71:0/217837594 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e480b53e0 msgr2=0x7f3e480c9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:04.748 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.741+0000 7f3e4cd79700 1 --2- 172.21.15.71:0/217837594 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e480b53e0 0x7f3e480c9b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:04.748 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.741+0000 7f3e4cd79700 1 -- 172.21.15.71:0/217837594 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3e4815dbc0 msgr2=0x7f3e4815dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:04.748 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.741+0000 7f3e4cd79700 1 --2- 172.21.15.71:0/217837594 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3e4815dbc0 0x7f3e4815dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:04.748 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.741+0000 7f3e4cd79700 1 -- 172.21.15.71:0/217837594 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e480ca0c0 con 0x7f3e30004810 2023-10-06T01:41:04.748 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.741+0000 7f3e47fff700 1 --2- 172.21.15.71:0/217837594 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e480b53e0 0x7f3e480c9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:41:04.749 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.741+0000 7f3e4d57a700 1 --2- 172.21.15.71:0/217837594 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3e4815dbc0 0x7f3e4815dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:41:04.749 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.741+0000 7f3e4cd79700 1 --2- 172.21.15.71:0/217837594 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3e30004810 0x7f3e480b3fa0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3e38009fd0 tx=0x7f3e3800b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:04.749 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.741+0000 7f3e44ff9700 1 -- 172.21.15.71:0/217837594 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e3800e040 con 0x7f3e30004810 2023-10-06T01:41:04.749 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.741+0000 7f3e44ff9700 1 -- 172.21.15.71:0/217837594 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e3800f040 con 0x7f3e30004810 2023-10-06T01:41:04.749 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.741+0000 7f3e4dd7b700 1 -- 172.21.15.71:0/217837594 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e48159dc0 con 0x7f3e30004810 2023-10-06T01:41:04.749 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.741+0000 7f3e44ff9700 1 -- 172.21.15.71:0/217837594 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e38015430 con 0x7f3e30004810 2023-10-06T01:41:04.749 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.741+0000 7f3e4dd7b700 1 -- 172.21.15.71:0/217837594 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e4815a380 con 0x7f3e30004810 2023-10-06T01:41:04.749 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.742+0000 7f3e4dd7b700 1 -- 172.21.15.71:0/217837594 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e48064aa0 con 0x7f3e30004810 2023-10-06T01:41:04.749 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.743+0000 7f3e44ff9700 1 -- 172.21.15.71:0/217837594 <== mon.2 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3e380157a0 con 0x7f3e30004810 2023-10-06T01:41:04.750 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.743+0000 7f3e44ff9700 1 --2- 172.21.15.71:0/217837594 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f3e34066f30 0x7f3e340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:04.750 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.743+0000 7f3e44ff9700 1 -- 172.21.15.71:0/217837594 <== mon.2 v2:172.21.15.72:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f3e38085750 con 0x7f3e30004810 2023-10-06T01:41:04.750 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.743+0000 7f3e47fff700 1 --2- 172.21.15.71:0/217837594 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f3e34066f30 0x7f3e340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:04.750 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.744+0000 7f3e47fff700 1 --2- 172.21.15.71:0/217837594 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f3e34066f30 0x7f3e340693e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c000c00 tx=0x7f3e3c015000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:04.750 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.748+0000 7f3e44ff9700 1 -- 172.21.15.71:0/217837594 <== mon.2 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3e38055fc0 con 0x7f3e30004810 2023-10-06T01:41:04.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.933+0000 7f3e4dd7b700 1 -- 172.21.15.71:0/217837594 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3e480b02f0 con 0x7f3e30004810 2023-10-06T01:41:04.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.933+0000 7f3e44ff9700 1 -- 172.21.15.71:0/217837594 <== mon.2 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3e38055b50 con 0x7f3e30004810 2023-10-06T01:41:04.934 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 64 2023-10-06T01:41:04.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.935+0000 7f3e4dd7b700 1 -- 172.21.15.71:0/217837594 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f3e34066f30 msgr2=0x7f3e340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:04.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.935+0000 7f3e4dd7b700 1 --2- 172.21.15.71:0/217837594 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f3e34066f30 0x7f3e340693e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c000c00 tx=0x7f3e3c015000 comp rx=0 tx=0).stop 2023-10-06T01:41:04.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.935+0000 7f3e4dd7b700 1 -- 172.21.15.71:0/217837594 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3e30004810 msgr2=0x7f3e480b3fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:04.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.935+0000 7f3e4dd7b700 1 --2- 172.21.15.71:0/217837594 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3e30004810 0x7f3e480b3fa0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3e38009fd0 tx=0x7f3e3800b040 comp rx=0 tx=0).stop 2023-10-06T01:41:04.936 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.935+0000 7f3e4dd7b700 1 -- 172.21.15.71:0/217837594 shutdown_connections 2023-10-06T01:41:04.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.935+0000 7f3e4dd7b700 1 --2- 172.21.15.71:0/217837594 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3e4815dbc0 0x7f3e4815dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:04.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.935+0000 7f3e4dd7b700 1 --2- 172.21.15.71:0/217837594 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3e30004810 0x7f3e480b3fa0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:04.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.935+0000 7f3e4dd7b700 1 --2- 172.21.15.71:0/217837594 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f3e34066f30 0x7f3e340693e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:04.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.935+0000 7f3e4dd7b700 1 --2- 172.21.15.71:0/217837594 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e480b53e0 0x7f3e480c9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:04.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.935+0000 7f3e4dd7b700 1 -- 172.21.15.71:0/217837594 >> 172.21.15.71:0/217837594 conn(0x7f3e4806a110 msgr2=0x7f3e480cc420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:04.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.935+0000 7f3e4dd7b700 1 -- 172.21.15.71:0/217837594 shutdown_connections 2023-10-06T01:41:04.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:04.935+0000 7f3e4dd7b700 1 -- 172.21.15.71:0/217837594 wait complete. 2023-10-06T01:41:04.947 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-06T01:41:05.065 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.064+0000 7f7abc8a8700 1 Processor -- start 2023-10-06T01:41:05.065 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.064+0000 7f7abc8a8700 1 -- start start 2023-10-06T01:41:05.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.065+0000 7f7abc8a8700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7ab8067570 0x7f7ab80cb3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:05.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.065+0000 7f7abc8a8700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ab80caf30 con 0x7f7ab80cb900 2023-10-06T01:41:05.069 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.065+0000 7f7abc8a8700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ab80cd340 con 0x7f7ab8159590 2023-10-06T01:41:05.069 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.065+0000 7f7abc8a8700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ab80ca600 con 0x7f7ab8067570 2023-10-06T01:41:05.069 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.065+0000 7f7ab6d9d700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f7ab80cb900 0x7f7ab8068680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:55922/0 (socket says 172.21.15.71:55922) 2023-10-06T01:41:05.069 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.065+0000 7f7ab6d9d700 1 -- 172.21.15.71:0/2083605544 learned_addr learned my addr 172.21.15.71:0/2083605544 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:41:05.069 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.065+0000 7f7aadd9b700 1 --2- 172.21.15.71:0/2083605544 >> v2:172.21.15.72:3300/0 conn(0x7f7ab8067570 0x7f7ab80cb3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:05.069 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.065+0000 7f7ab5d9b700 1 -- 172.21.15.71:0/2083605544 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3487833329 0 0) 0x7f7ab80caf30 con 0x7f7ab80cb900 2023-10-06T01:41:05.069 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.065+0000 7f7ab5d9b700 1 -- 172.21.15.71:0/2083605544 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7aa4003570 con 0x7f7ab80cb900 2023-10-06T01:41:05.069 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.066+0000 7f7ab5d9b700 1 -- 172.21.15.71:0/2083605544 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1620576598 0 0) 0x7f7aa4003570 con 0x7f7ab80cb900 2023-10-06T01:41:05.069 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.066+0000 7f7ab5d9b700 1 -- 172.21.15.71:0/2083605544 >> v2:172.21.15.72:3300/0 conn(0x7f7ab8067570 msgr2=0x7f7ab80cb3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:05.069 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.066+0000 7f7ab5d9b700 1 --2- 172.21.15.71:0/2083605544 >> v2:172.21.15.72:3300/0 conn(0x7f7ab8067570 0x7f7ab80cb3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:05.069 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.066+0000 7f7ab5d9b700 1 -- 172.21.15.71:0/2083605544 >> v1:172.21.15.72:6789/0 conn(0x7f7ab8159590 legacy=0x7f7ab80cca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:05.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.066+0000 7f7ab5d9b700 1 -- 172.21.15.71:0/2083605544 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ab80ca8e0 con 0x7f7ab80cb900 2023-10-06T01:41:05.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.066+0000 7f7ab5d9b700 1 -- 172.21.15.71:0/2083605544 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1184243524 0 0) 0x7f7ab00017f0 con 0x7f7ab80cb900 2023-10-06T01:41:05.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.066+0000 7f7ab5d9b700 1 -- 172.21.15.71:0/2083605544 >> v1:172.21.15.71:6789/0 conn(0x7f7ab80cb900 legacy=0x7f7ab8068680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:05.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.066+0000 7f7ab5d9b700 1 --2- 172.21.15.71:0/2083605544 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7aa4003a60 0x7f7aa4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:05.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.066+0000 7f7ab5d9b700 1 --2- 172.21.15.71:0/2083605544 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7aa4004810 0x7f7aa4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:05.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.066+0000 7f7ab5d9b700 1 --2- 172.21.15.71:0/2083605544 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7aa40051c0 0x7f7aa400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:05.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.066+0000 7f7ab5d9b700 1 -- 172.21.15.71:0/2083605544 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab80ca600 con 0x7f7aa4003a60 2023-10-06T01:41:05.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.066+0000 7f7ab5d9b700 1 -- 172.21.15.71:0/2083605544 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa400c0d0 con 0x7f7aa4004810 2023-10-06T01:41:05.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.066+0000 7f7ab5d9b700 1 -- 172.21.15.71:0/2083605544 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa400c290 con 0x7f7aa40051c0 2023-10-06T01:41:05.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.066+0000 7f7ab659c700 1 --2- 172.21.15.71:0/2083605544 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7aa4003a60 0x7f7aa4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:05.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.066+0000 7f7aadd9b700 1 --2- 172.21.15.71:0/2083605544 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7aa4004810 0x7f7aa4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:05.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.066+0000 7f7ab6d9d700 1 --2- 172.21.15.71:0/2083605544 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7aa40051c0 0x7f7aa400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:05.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.066+0000 7f7ab659c700 1 -- 172.21.15.71:0/2083605544 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7aa40051c0 msgr2=0x7f7aa400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:05.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.066+0000 7f7ab659c700 1 --2- 172.21.15.71:0/2083605544 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7aa40051c0 0x7f7aa400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:05.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.066+0000 7f7ab659c700 1 -- 172.21.15.71:0/2083605544 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7aa4004810 msgr2=0x7f7aa4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:05.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.066+0000 7f7ab659c700 1 --2- 172.21.15.71:0/2083605544 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7aa4004810 0x7f7aa4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:05.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.066+0000 7f7ab659c700 1 -- 172.21.15.71:0/2083605544 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aa4003570 con 0x7f7aa4003a60 2023-10-06T01:41:05.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.066+0000 7f7ab6d9d700 1 --2- 172.21.15.71:0/2083605544 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7aa40051c0 0x7f7aa400ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:41:05.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.066+0000 7f7ab6d9d700 1 -- 172.21.15.71:0/2083605544 reap_dead start 2023-10-06T01:41:05.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.066+0000 7f7ab659c700 1 --2- 172.21.15.71:0/2083605544 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7aa4003a60 0x7f7aa4003e70 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7aa80018b0 tx=0x7f7aa8007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdf304a943a4e587 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:05.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.066+0000 7f7ab5d9b700 1 -- 172.21.15.71:0/2083605544 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa8012420 con 0x7f7aa4003a60 2023-10-06T01:41:05.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.066+0000 7f7ab5d9b700 1 -- 172.21.15.71:0/2083605544 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aa80125a0 con 0x7f7aa4003a60 2023-10-06T01:41:05.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.066+0000 7f7ab5d9b700 1 -- 172.21.15.71:0/2083605544 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa8012960 con 0x7f7aa4003a60 2023-10-06T01:41:05.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.067+0000 7f7abc8a8700 1 -- 172.21.15.71:0/2083605544 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7aa4003a60 msgr2=0x7f7aa4003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:05.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.067+0000 7f7abc8a8700 1 --2- 172.21.15.71:0/2083605544 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7aa4003a60 0x7f7aa4003e70 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7aa80018b0 tx=0x7f7aa8007d30 comp rx=0 tx=0).stop 2023-10-06T01:41:05.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.067+0000 7f7abc8a8700 1 -- 172.21.15.71:0/2083605544 shutdown_connections 2023-10-06T01:41:05.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.067+0000 7f7abc8a8700 1 --2- 172.21.15.71:0/2083605544 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7aa4003a60 0x7f7aa4003e70 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:05.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.067+0000 7f7abc8a8700 1 -- 172.21.15.71:0/2083605544 >> 172.21.15.71:0/2083605544 conn(0x7f7ab8095d00 msgr2=0x7f7ab80af850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:05.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.067+0000 7f7abc8a8700 1 -- 172.21.15.71:0/2083605544 shutdown_connections 2023-10-06T01:41:05.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.067+0000 7f7abc8a8700 1 -- 172.21.15.71:0/2083605544 wait complete. 2023-10-06T01:41:05.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.068+0000 7f7abc8a8700 1 Processor -- start 2023-10-06T01:41:05.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.068+0000 7f7abc8a8700 1 -- start start 2023-10-06T01:41:05.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.069+0000 7f7abc8a8700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7aa4003a60 0x7f7ab80c67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:05.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.069+0000 7f7abc8a8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ab816ad70 0x7f7ab814c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:05.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.069+0000 7f7abc8a8700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7ab815b9f0 0x7f7ab815be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:05.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.069+0000 7f7abc8a8700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab815c3a0 con 0x7f7ab815b9f0 2023-10-06T01:41:05.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.069+0000 7f7abc8a8700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab80c4d30 con 0x7f7aa4003a60 2023-10-06T01:41:05.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.069+0000 7f7abc8a8700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab80c3e80 con 0x7f7ab816ad70 2023-10-06T01:41:05.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.069+0000 7f7ab6d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7ab815b9f0 0x7f7ab815be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:05.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.069+0000 7f7ab6d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7ab815b9f0 0x7f7ab815be60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36078/0 (socket says 172.21.15.71:36078) 2023-10-06T01:41:05.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.069+0000 7f7ab6d9d700 1 -- 172.21.15.71:0/3874467106 learned_addr learned my addr 172.21.15.71:0/3874467106 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:05.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.069+0000 7f7ab659c700 1 --2- 172.21.15.71:0/3874467106 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7aa4003a60 0x7f7ab80c67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:05.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.069+0000 7f7aadd9b700 1 --2- 172.21.15.71:0/3874467106 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ab816ad70 0x7f7ab814c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:05.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.069+0000 7f7ab6d9d700 1 -- 172.21.15.71:0/3874467106 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ab816ad70 msgr2=0x7f7ab814c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:05.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.069+0000 7f7ab6d9d700 1 --2- 172.21.15.71:0/3874467106 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ab816ad70 0x7f7ab814c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:05.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.069+0000 7f7ab6d9d700 1 -- 172.21.15.71:0/3874467106 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7aa4003a60 msgr2=0x7f7ab80c67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:05.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.069+0000 7f7ab6d9d700 1 --2- 172.21.15.71:0/3874467106 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7aa4003a60 0x7f7ab80c67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:05.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.069+0000 7f7ab6d9d700 1 -- 172.21.15.71:0/3874467106 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ab80c4120 con 0x7f7ab815b9f0 2023-10-06T01:41:05.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.069+0000 7f7ab6d9d700 1 --2- 172.21.15.71:0/3874467106 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7ab815b9f0 0x7f7ab815be60 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7ab0000f80 tx=0x7f7ab00017f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:05.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.069+0000 7f7aaeffd700 1 -- 172.21.15.71:0/3874467106 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab000eab0 con 0x7f7ab815b9f0 2023-10-06T01:41:05.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.069+0000 7f7aaeffd700 1 -- 172.21.15.71:0/3874467106 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ab000ec10 con 0x7f7ab815b9f0 2023-10-06T01:41:05.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.069+0000 7f7abc8a8700 1 -- 172.21.15.71:0/3874467106 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ab80c4400 con 0x7f7ab815b9f0 2023-10-06T01:41:05.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.069+0000 7f7aaeffd700 1 -- 172.21.15.71:0/3874467106 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab0013420 con 0x7f7ab815b9f0 2023-10-06T01:41:05.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.070+0000 7f7abc8a8700 1 -- 172.21.15.71:0/3874467106 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ab80c49c0 con 0x7f7ab815b9f0 2023-10-06T01:41:05.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.070+0000 7f7abc8a8700 1 -- 172.21.15.71:0/3874467106 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ab80c4ec0 con 0x7f7ab815b9f0 2023-10-06T01:41:05.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.071+0000 7f7aaeffd700 1 -- 172.21.15.71:0/3874467106 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7ab0013790 con 0x7f7ab815b9f0 2023-10-06T01:41:05.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.071+0000 7f7aaeffd700 1 --2- 172.21.15.71:0/3874467106 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7a98066f30 0x7f7a980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:05.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.071+0000 7f7aaeffd700 1 -- 172.21.15.71:0/3874467106 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f7ab0084e50 con 0x7f7ab815b9f0 2023-10-06T01:41:05.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.071+0000 7f7ab659c700 1 --2- 172.21.15.71:0/3874467106 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7a98066f30 0x7f7a980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:05.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.072+0000 7f7ab659c700 1 --2- 172.21.15.71:0/3874467106 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7a98066f30 0x7f7a980693e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7aa80018b0 tx=0x7f7aa8015000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:05.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.075+0000 7f7aaeffd700 1 -- 172.21.15.71:0/3874467106 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7ab0051c30 con 0x7f7ab815b9f0 2023-10-06T01:41:05.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.255+0000 7f7abc8a8700 1 -- 172.21.15.71:0/3874467106 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f7ab806d070 con 0x7f7ab815b9f0 2023-10-06T01:41:05.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.255+0000 7f7aaeffd700 1 -- 172.21.15.71:0/3874467106 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f7ab0055250 con 0x7f7ab815b9f0 2023-10-06T01:41:05.256 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 32 2023-10-06T01:41:05.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.257+0000 7f7abc8a8700 1 -- 172.21.15.71:0/3874467106 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7a98066f30 msgr2=0x7f7a980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:05.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.257+0000 7f7abc8a8700 1 --2- 172.21.15.71:0/3874467106 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7a98066f30 0x7f7a980693e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7aa80018b0 tx=0x7f7aa8015000 comp rx=0 tx=0).stop 2023-10-06T01:41:05.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.257+0000 7f7abc8a8700 1 -- 172.21.15.71:0/3874467106 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7ab815b9f0 msgr2=0x7f7ab815be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:05.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.257+0000 7f7abc8a8700 1 --2- 172.21.15.71:0/3874467106 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7ab815b9f0 0x7f7ab815be60 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7ab0000f80 tx=0x7f7ab00017f0 comp rx=0 tx=0).stop 2023-10-06T01:41:05.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.257+0000 7f7abc8a8700 1 -- 172.21.15.71:0/3874467106 shutdown_connections 2023-10-06T01:41:05.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.257+0000 7f7abc8a8700 1 --2- 172.21.15.71:0/3874467106 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7ab815b9f0 0x7f7ab815be60 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:05.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.257+0000 7f7abc8a8700 1 --2- 172.21.15.71:0/3874467106 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7a98066f30 0x7f7a980693e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:05.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.257+0000 7f7abc8a8700 1 --2- 172.21.15.71:0/3874467106 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7aa4003a60 0x7f7ab80c67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:05.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.257+0000 7f7abc8a8700 1 --2- 172.21.15.71:0/3874467106 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7ab816ad70 0x7f7ab814c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:05.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.257+0000 7f7abc8a8700 1 -- 172.21.15.71:0/3874467106 >> 172.21.15.71:0/3874467106 conn(0x7f7ab8095d00 msgr2=0x7f7ab815cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:05.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.257+0000 7f7abc8a8700 1 -- 172.21.15.71:0/3874467106 shutdown_connections 2023-10-06T01:41:05.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.257+0000 7f7abc8a8700 1 -- 172.21.15.71:0/3874467106 wait complete. 2023-10-06T01:41:05.269 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:41:05.383 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.383+0000 7f9a1759e700 1 Processor -- start 2023-10-06T01:41:05.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.383+0000 7f9a1759e700 1 -- start start 2023-10-06T01:41:05.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.384+0000 7f9a1759e700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9a18157040 0x7f9a180cbfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:05.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.384+0000 7f9a1759e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9a180cda40 0x7f9a180cc4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:05.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.384+0000 7f9a1759e700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a180cd5b0 con 0x7f9a18157410 2023-10-06T01:41:05.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.384+0000 7f9a1759e700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a180cca20 con 0x7f9a18157040 2023-10-06T01:41:05.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.384+0000 7f9a1759e700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a180ccc80 con 0x7f9a180cda40 2023-10-06T01:41:05.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.384+0000 7f9a1659c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9a18157040 0x7f9a180cbfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:05.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.384+0000 7f9a15d9b700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f9a18157410 0x7f9a180ad830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:55924/0 (socket says 172.21.15.71:55924) 2023-10-06T01:41:05.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.384+0000 7f9a1659c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9a18157040 0x7f9a180cbfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36088/0 (socket says 172.21.15.71:36088) 2023-10-06T01:41:05.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.384+0000 7f9a15d9b700 1 -- 172.21.15.71:0/3656617391 learned_addr learned my addr 172.21.15.71:0/3656617391 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:41:05.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.384+0000 7f9a16d9d700 1 --2- 172.21.15.71:0/3656617391 >> v2:172.21.15.72:3300/0 conn(0x7f9a180cda40 0x7f9a180cc4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:05.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.384+0000 7f9a1659c700 1 -- 172.21.15.71:0/3656617391 >> v2:172.21.15.72:3300/0 conn(0x7f9a180cda40 msgr2=0x7f9a180cc4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:05.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.384+0000 7f9a1659c700 1 --2- 172.21.15.71:0/3656617391 >> v2:172.21.15.72:3300/0 conn(0x7f9a180cda40 0x7f9a180cc4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:05.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.384+0000 7f9a1659c700 1 -- 172.21.15.71:0/3656617391 >> v1:172.21.15.71:6789/0 conn(0x7f9a18157410 legacy=0x7f9a180ad830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:05.387 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.384+0000 7f9a1659c700 1 -- 172.21.15.71:0/3656617391 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a180ccf60 con 0x7f9a18157040 2023-10-06T01:41:05.387 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.384+0000 7f9a1559a700 1 -- 172.21.15.71:0/3656617391 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4150924164 0 0) 0x7f9a180cd5b0 con 0x7f9a18157410 2023-10-06T01:41:05.387 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.384+0000 7f9a1659c700 1 --2- 172.21.15.71:0/3656617391 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9a18157040 0x7f9a180cbfa0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f9a180cbd60 tx=0x7f9a100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1576df4e08d9f74 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:05.387 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.385+0000 7f9a1559a700 1 -- 172.21.15.71:0/3656617391 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a10011630 con 0x7f9a18157040 2023-10-06T01:41:05.387 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.385+0000 7f9a1559a700 1 -- 172.21.15.71:0/3656617391 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a10011790 con 0x7f9a18157040 2023-10-06T01:41:05.387 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.385+0000 7f9a1559a700 1 -- 172.21.15.71:0/3656617391 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a10011b30 con 0x7f9a18157040 2023-10-06T01:41:05.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.385+0000 7f9a1759e700 1 -- 172.21.15.71:0/3656617391 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9a18157040 msgr2=0x7f9a180cbfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:05.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.385+0000 7f9a1759e700 1 --2- 172.21.15.71:0/3656617391 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9a18157040 0x7f9a180cbfa0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f9a180cbd60 tx=0x7f9a100091a0 comp rx=0 tx=0).stop 2023-10-06T01:41:05.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.385+0000 7f9a1759e700 1 -- 172.21.15.71:0/3656617391 shutdown_connections 2023-10-06T01:41:05.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.385+0000 7f9a1759e700 1 --2- 172.21.15.71:0/3656617391 >> v2:172.21.15.72:3300/0 conn(0x7f9a180cda40 0x7f9a180cc4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:05.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.385+0000 7f9a1759e700 1 --2- 172.21.15.71:0/3656617391 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9a18157040 0x7f9a180cbfa0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:05.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.385+0000 7f9a1759e700 1 -- 172.21.15.71:0/3656617391 >> 172.21.15.71:0/3656617391 conn(0x7f9a18067130 msgr2=0x7f9a18067530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:05.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.385+0000 7f9a1759e700 1 -- 172.21.15.71:0/3656617391 shutdown_connections 2023-10-06T01:41:05.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.385+0000 7f9a1759e700 1 -- 172.21.15.71:0/3656617391 wait complete. 2023-10-06T01:41:05.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.386+0000 7f9a1759e700 1 Processor -- start 2023-10-06T01:41:05.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.386+0000 7f9a1759e700 1 -- start start 2023-10-06T01:41:05.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.387+0000 7f9a1759e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9a180cda40 0x7f9a18168920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:05.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.387+0000 7f9a1759e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a18157040 0x7f9a1815a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:05.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.387+0000 7f9a1759e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9a18157410 0x7f9a1816ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:05.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.387+0000 7f9a1759e700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a180abe70 con 0x7f9a180cda40 2023-10-06T01:41:05.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.387+0000 7f9a1759e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a181536b0 con 0x7f9a18157040 2023-10-06T01:41:05.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.387+0000 7f9a1759e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a1816b8d0 con 0x7f9a18157410 2023-10-06T01:41:05.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.387+0000 7f9a1659c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9a180cda40 0x7f9a18168920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:05.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.387+0000 7f9a1659c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9a180cda40 0x7f9a18168920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36090/0 (socket says 172.21.15.71:36090) 2023-10-06T01:41:05.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.387+0000 7f9a1659c700 1 -- 172.21.15.71:0/3618199100 learned_addr learned my addr 172.21.15.71:0/3618199100 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:05.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.387+0000 7f9a16d9d700 1 --2- 172.21.15.71:0/3618199100 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9a18157410 0x7f9a1816ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:05.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.387+0000 7f9a15d9b700 1 --2- 172.21.15.71:0/3618199100 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a18157040 0x7f9a1815a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:05.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.387+0000 7f9a1659c700 1 -- 172.21.15.71:0/3618199100 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9a18157410 msgr2=0x7f9a1816ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:05.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.387+0000 7f9a1659c700 1 --2- 172.21.15.71:0/3618199100 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9a18157410 0x7f9a1816ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:05.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.387+0000 7f9a1659c700 1 -- 172.21.15.71:0/3618199100 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a18157040 msgr2=0x7f9a1815a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:05.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.387+0000 7f9a1659c700 1 --2- 172.21.15.71:0/3618199100 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a18157040 0x7f9a1815a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:05.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.387+0000 7f9a1659c700 1 -- 172.21.15.71:0/3618199100 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a10009420 con 0x7f9a180cda40 2023-10-06T01:41:05.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.388+0000 7f9a1659c700 1 --2- 172.21.15.71:0/3618199100 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9a180cda40 0x7f9a18168920 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f9a18069100 tx=0x7f9a10017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:05.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.388+0000 7f9a0e7fc700 1 -- 172.21.15.71:0/3618199100 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a10011b10 con 0x7f9a180cda40 2023-10-06T01:41:05.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.388+0000 7f9a0e7fc700 1 -- 172.21.15.71:0/3618199100 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a100253f0 con 0x7f9a180cda40 2023-10-06T01:41:05.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.388+0000 7f9a0e7fc700 1 -- 172.21.15.71:0/3618199100 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a10025790 con 0x7f9a180cda40 2023-10-06T01:41:05.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.388+0000 7f9a1759e700 1 -- 172.21.15.71:0/3618199100 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a1816bbb0 con 0x7f9a180cda40 2023-10-06T01:41:05.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.388+0000 7f9a1759e700 1 -- 172.21.15.71:0/3618199100 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a18168e60 con 0x7f9a180cda40 2023-10-06T01:41:05.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.389+0000 7f9a1759e700 1 -- 172.21.15.71:0/3618199100 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a1806f3c0 con 0x7f9a180cda40 2023-10-06T01:41:05.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.389+0000 7f9a0e7fc700 1 -- 172.21.15.71:0/3618199100 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9a10025b80 con 0x7f9a180cda40 2023-10-06T01:41:05.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.389+0000 7f9a0e7fc700 1 --2- 172.21.15.71:0/3618199100 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f99f8066f30 0x7f99f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:05.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.390+0000 7f9a0e7fc700 1 -- 172.21.15.71:0/3618199100 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f9a10086330 con 0x7f9a180cda40 2023-10-06T01:41:05.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.390+0000 7f9a15d9b700 1 --2- 172.21.15.71:0/3618199100 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f99f8066f30 0x7f99f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:05.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.390+0000 7f9a15d9b700 1 --2- 172.21.15.71:0/3618199100 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f99f8066f30 0x7f99f80693e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9a180a97b0 tx=0x7f9a00009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:05.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.394+0000 7f9a0e7fc700 1 -- 172.21.15.71:0/3618199100 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9a10053110 con 0x7f9a180cda40 2023-10-06T01:41:05.578 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.577+0000 7f9a1759e700 1 -- 172.21.15.71:0/3618199100 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9a180cd240 con 0x7f9a180cda40 2023-10-06T01:41:05.578 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.578+0000 7f9a0e7fc700 1 -- 172.21.15.71:0/3618199100 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18754 (secure 0 0 0) 0x7f9a10056730 con 0x7f9a180cda40 2023-10-06T01:41:05.579 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:41:05.579 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":29,"fsid":"1fbf1bd2-f9b4-4599-bea2-f4aa920e9a56","created":"2023-10-06T01:39:57.016957+0000","modified":"2023-10-06T01:41:03.811605+0000","last_up_change":"2023-10-06T01:40:08.571643+0000","last_in_change":"2023-10-06T01:39:59.462741+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T01:40:08.610349+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T01:40:15.387434+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T01:40:19.640459+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T01:40:20.116883+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T01:40:23.830129+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cf059188-fb20-4dbf-95db-dcf57b213d03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":90670},{"type":"v1","addr":"172.21.15.71:6817","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":90670},{"type":"v1","addr":"172.21.15.71:6819","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":90670},{"type":"v1","addr":"172.21.15.71:6823","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":90670},{"type":"v1","addr":"172.21.15.71:6821","nonce":90670}]},"public_addr":"172.21.15.71:6817/90670","cluster_addr":"172.21.15.71:6819/90670","heartbeat_back_addr":"172.21.15.71:6823/90670","heartbeat_front_addr":"172.21.15.71:6821/90670","state":["exists","up"]},{"osd":1,"uuid":"0cff0aae-1799-4fe0-b610-54cf0813c0e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":90669},{"type":"v1","addr":"172.21.15.71:6809","nonce":90669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":90669},{"type":"v1","addr":"172.21.15.71:6811","nonce":90669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":90669},{"type":"v1","addr":"172.21.15.71:6815","nonce":90669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":90669},{"type":"v1","addr":"172.21.15.71:6813","nonce":90669}]},"public_addr":"172.21.15.71:6809/90669","cluster_addr":"172.21.15.71:6811/90669","heartbeat_back_addr":"172.21.15.71:6815/90669","heartbeat_front_addr":"172.21.15.71:6813/90669","state":["exists","up"]},{"osd":2,"uuid":"88d61ddc-9031-44e1-ba8c-546a41e7c8ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":90679},{"type":"v1","addr":"172.21.15.71:6825","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":90679},{"type":"v1","addr":"172.21.15.71:6827","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":90679},{"type":"v1","addr":"172.21.15.71:6831","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":90679},{"type":"v1","addr":"172.21.15.71:6829","nonce":90679}]},"public_addr":"172.21.15.71:6825/90679","cluster_addr":"172.21.15.71:6827/90679","heartbeat_back_addr":"172.21.15.71:6831/90679","heartbeat_front_addr":"172.21.15.71:6829/90679","state":["exists","up"]},{"osd":3,"uuid":"11ed92b7-960b-4a30-a889-a61d3eeb86f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":90668},{"type":"v1","addr":"172.21.15.71:6801","nonce":90668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":90668},{"type":"v1","addr":"172.21.15.71:6803","nonce":90668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":90668},{"type":"v1","addr":"172.21.15.71:6807","nonce":90668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":90668},{"type":"v1","addr":"172.21.15.71:6805","nonce":90668}]},"public_addr":"172.21.15.71:6801/90668","cluster_addr":"172.21.15.71:6803/90668","heartbeat_back_addr":"172.21.15.71:6807/90668","heartbeat_front_addr":"172.21.15.71:6805/90668","state":["exists","up"]},{"osd":4,"uuid":"ae4df784-abdf-4ddf-aefa-780f3ddafef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":90917},{"type":"v1","addr":"172.21.15.72:6801","nonce":90917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":90917},{"type":"v1","addr":"172.21.15.72:6803","nonce":90917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":90917},{"type":"v1","addr":"172.21.15.72:6807","nonce":90917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":90917},{"type":"v1","addr":"172.21.15.72:6805","nonce":90917}]},"public_addr":"172.21.15.72:6801/90917","cluster_addr":"172.21.15.72:6803/90917","heartbeat_back_addr":"172.21.15.72:6807/90917","heartbeat_front_addr":"172.21.15.72:6805/90917","state":["exists","up"]},{"osd":5,"uuid":"5ef0790f-001e-458f-a05b-efae216cf435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":90941},{"type":"v1","addr":"172.21.15.72:6817","nonce":90941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":90941},{"type":"v1","addr":"172.21.15.72:6819","nonce":90941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":90941},{"type":"v1","addr":"172.21.15.72:6827","nonce":90941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":90941},{"type":"v1","addr":"172.21.15.72:6823","nonce":90941}]},"public_addr":"172.21.15.72:6817/90941","cluster_addr":"172.21.15.72:6819/90941","heartbeat_back_addr":"172.21.15.72:6827/90941","heartbeat_front_addr":"172.21.15.72:6823/90941","state":["exists","up"]},{"osd":6,"uuid":"8705aef1-9ae8-4e54-a3c4-c2909fa0ceb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":90918},{"type":"v1","addr":"172.21.15.72:6809","nonce":90918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":90918},{"type":"v1","addr":"172.21.15.72:6811","nonce":90918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":90918},{"type":"v1","addr":"172.21.15.72:6815","nonce":90918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":90918},{"type":"v1","addr":"172.21.15.72:6813","nonce":90918}]},"public_addr":"172.21.15.72:6809/90918","cluster_addr":"172.21.15.72:6811/90918","heartbeat_back_addr":"172.21.15.72:6815/90918","heartbeat_front_addr":"172.21.15.72:6813/90918","state":["exists","up"]},{"osd":7,"uuid":"364c5119-6b13-4c75-b3f0-15e165eff86a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":90948},{"type":"v1","addr":"172.21.15.72:6822","nonce":90948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":90948},{"type":"v1","addr":"172.21.15.72:6826","nonce":90948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":90948},{"type":"v1","addr":"172.21.15.72:6831","nonce":90948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":90948},{"type":"v1","addr":"172.21.15.72:6829","nonce":90948}]},"public_addr":"172.21.15.72:6822/90948","cluster_addr":"172.21.15.72:6826/90948","heartbeat_back_addr":"172.21.15.72:6831/90948","heartbeat_front_addr":"172.21.15.72:6829/90948","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.642976+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.645372+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.619116+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.663042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.599163+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.646411+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.631545+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.669821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.a","mappings":[{"from":1,"to":5}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:41:05.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.580+0000 7f9a1759e700 1 -- 172.21.15.71:0/3618199100 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f99f8066f30 msgr2=0x7f99f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:05.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.580+0000 7f9a1759e700 1 --2- 172.21.15.71:0/3618199100 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f99f8066f30 0x7f99f80693e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9a180a97b0 tx=0x7f9a00009040 comp rx=0 tx=0).stop 2023-10-06T01:41:05.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.580+0000 7f9a1759e700 1 -- 172.21.15.71:0/3618199100 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9a180cda40 msgr2=0x7f9a18168920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:05.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.580+0000 7f9a1759e700 1 --2- 172.21.15.71:0/3618199100 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9a180cda40 0x7f9a18168920 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f9a18069100 tx=0x7f9a10017000 comp rx=0 tx=0).stop 2023-10-06T01:41:05.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.580+0000 7f9a1759e700 1 -- 172.21.15.71:0/3618199100 shutdown_connections 2023-10-06T01:41:05.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.580+0000 7f9a1759e700 1 --2- 172.21.15.71:0/3618199100 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9a18157410 0x7f9a1816ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:05.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.580+0000 7f9a1759e700 1 --2- 172.21.15.71:0/3618199100 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9a180cda40 0x7f9a18168920 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:05.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.580+0000 7f9a1759e700 1 --2- 172.21.15.71:0/3618199100 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f99f8066f30 0x7f99f80693e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:05.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.580+0000 7f9a1759e700 1 --2- 172.21.15.71:0/3618199100 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a18157040 0x7f9a1815a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:05.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.580+0000 7f9a1759e700 1 -- 172.21.15.71:0/3618199100 >> 172.21.15.71:0/3618199100 conn(0x7f9a18067130 msgr2=0x7f9a181552d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:05.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.580+0000 7f9a1759e700 1 -- 172.21.15.71:0/3618199100 shutdown_connections 2023-10-06T01:41:05.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.580+0000 7f9a1759e700 1 -- 172.21.15.71:0/3618199100 wait complete. 2023-10-06T01:41:05.592 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T01:40:08.610349+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T01:40:15.387434+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T01:40:19.640459+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T01:40:20.116883+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-06T01:40:23.830129+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T01:41:05.593 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T01:41:05.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.709+0000 7f168465c700 1 Processor -- start 2023-10-06T01:41:05.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.709+0000 7f168465c700 1 -- start start 2023-10-06T01:41:05.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.710+0000 7f168465c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f167c153d30 0x7f167c0afe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:05.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.710+0000 7f168465c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f167c154100 0x7f167c06b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:05.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.710+0000 7f168465c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f167c06bba0 0x7f167c0b1150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:05.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.710+0000 7f168465c700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f167c0aeed0 con 0x7f167c153d30 2023-10-06T01:41:05.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.710+0000 7f168465c700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f167c06c020 con 0x7f167c154100 2023-10-06T01:41:05.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.710+0000 7f168465c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f167c0af9e0 con 0x7f167c06bba0 2023-10-06T01:41:05.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.710+0000 7f16823f8700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f167c153d30 0x7f167c0afe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:05.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.710+0000 7f16823f8700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f167c153d30 0x7f167c0afe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36102/0 (socket says 172.21.15.71:36102) 2023-10-06T01:41:05.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.710+0000 7f16823f8700 1 -- 172.21.15.71:0/1161620609 learned_addr learned my addr 172.21.15.71:0/1161620609 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:05.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.710+0000 7f1681bf7700 1 --2- 172.21.15.71:0/1161620609 >> v2:172.21.15.72:3300/0 conn(0x7f167c154100 0x7f167c06b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:05.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.710+0000 7f1682bf9700 1 --2- 172.21.15.71:0/1161620609 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f167c06bba0 0x7f167c0b1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:05.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.710+0000 7f16823f8700 1 -- 172.21.15.71:0/1161620609 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f167c06bba0 msgr2=0x7f167c0b1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:05.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.710+0000 7f16823f8700 1 --2- 172.21.15.71:0/1161620609 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f167c06bba0 0x7f167c0b1150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:05.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.710+0000 7f16823f8700 1 -- 172.21.15.71:0/1161620609 >> v2:172.21.15.72:3300/0 conn(0x7f167c154100 msgr2=0x7f167c06b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:05.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.710+0000 7f16823f8700 1 --2- 172.21.15.71:0/1161620609 >> v2:172.21.15.72:3300/0 conn(0x7f167c154100 0x7f167c06b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:05.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.710+0000 7f16823f8700 1 -- 172.21.15.71:0/1161620609 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f167c0af0b0 con 0x7f167c153d30 2023-10-06T01:41:05.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.711+0000 7f16823f8700 1 --2- 172.21.15.71:0/1161620609 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f167c153d30 0x7f167c0afe70 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f167c0aec50 tx=0x7f1678009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=267cc0bb76b0537a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:05.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.711+0000 7f16813f6700 1 -- 172.21.15.71:0/1161620609 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f167800b640 con 0x7f167c153d30 2023-10-06T01:41:05.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.711+0000 7f16813f6700 1 -- 172.21.15.71:0/1161620609 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f167800b7a0 con 0x7f167c153d30 2023-10-06T01:41:05.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.711+0000 7f16813f6700 1 -- 172.21.15.71:0/1161620609 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f167800bb40 con 0x7f167c153d30 2023-10-06T01:41:05.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.711+0000 7f168465c700 1 -- 172.21.15.71:0/1161620609 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f167c153d30 msgr2=0x7f167c0afe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:05.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.711+0000 7f168465c700 1 --2- 172.21.15.71:0/1161620609 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f167c153d30 0x7f167c0afe70 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f167c0aec50 tx=0x7f1678009250 comp rx=0 tx=0).stop 2023-10-06T01:41:05.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.711+0000 7f168465c700 1 -- 172.21.15.71:0/1161620609 shutdown_connections 2023-10-06T01:41:05.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.711+0000 7f168465c700 1 --2- 172.21.15.71:0/1161620609 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f167c153d30 0x7f167c0afe70 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:05.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.711+0000 7f168465c700 1 --2- 172.21.15.71:0/1161620609 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f167c06bba0 0x7f167c0b1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:05.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.711+0000 7f168465c700 1 --2- 172.21.15.71:0/1161620609 >> v2:172.21.15.72:3300/0 conn(0x7f167c154100 0x7f167c06b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:05.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.711+0000 7f168465c700 1 -- 172.21.15.71:0/1161620609 >> 172.21.15.71:0/1161620609 conn(0x7f167c0cc110 msgr2=0x7f167c0cc510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:05.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.711+0000 7f168465c700 1 -- 172.21.15.71:0/1161620609 shutdown_connections 2023-10-06T01:41:05.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.711+0000 7f168465c700 1 -- 172.21.15.71:0/1161620609 wait complete. 2023-10-06T01:41:05.718 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.712+0000 7f168465c700 1 Processor -- start 2023-10-06T01:41:05.718 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.712+0000 7f168465c700 1 -- start start 2023-10-06T01:41:05.718 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.713+0000 7f168465c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f167c06bba0 0x7f167c148ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:05.718 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.713+0000 7f168465c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f167c153d30 0x7f167c0ac300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:05.718 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.713+0000 7f168465c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f167c154100 0x7f167c166a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:05.718 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.713+0000 7f168465c700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f167c167960 con 0x7f167c154100 2023-10-06T01:41:05.718 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.713+0000 7f168465c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f167c1493e0 con 0x7f167c06bba0 2023-10-06T01:41:05.718 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.713+0000 7f168465c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f167c1673a0 con 0x7f167c153d30 2023-10-06T01:41:05.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.713+0000 7f1682bf9700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f167c154100 0x7f167c166a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:05.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.713+0000 7f1682bf9700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f167c154100 0x7f167c166a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36106/0 (socket says 172.21.15.71:36106) 2023-10-06T01:41:05.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.713+0000 7f1682bf9700 1 -- 172.21.15.71:0/472826878 learned_addr learned my addr 172.21.15.71:0/472826878 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:05.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.713+0000 7f1681bf7700 1 --2- 172.21.15.71:0/472826878 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f167c153d30 0x7f167c0ac300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:05.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.713+0000 7f16823f8700 1 --2- 172.21.15.71:0/472826878 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f167c06bba0 0x7f167c148ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:05.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.714+0000 7f1682bf9700 1 -- 172.21.15.71:0/472826878 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f167c153d30 msgr2=0x7f167c0ac300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:05.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.714+0000 7f1682bf9700 1 --2- 172.21.15.71:0/472826878 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f167c153d30 0x7f167c0ac300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:05.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.714+0000 7f1682bf9700 1 -- 172.21.15.71:0/472826878 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f167c06bba0 msgr2=0x7f167c148ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:05.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.714+0000 7f1682bf9700 1 --2- 172.21.15.71:0/472826878 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f167c06bba0 0x7f167c148ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:05.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.714+0000 7f1682bf9700 1 -- 172.21.15.71:0/472826878 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16780094f0 con 0x7f167c154100 2023-10-06T01:41:05.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.714+0000 7f16823f8700 1 --2- 172.21.15.71:0/472826878 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f167c06bba0 0x7f167c148ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:41:05.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.714+0000 7f1682bf9700 1 --2- 172.21.15.71:0/472826878 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f167c154100 0x7f167c166a50 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f167400e380 tx=0x7f167400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:05.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.714+0000 7f16727fc700 1 -- 172.21.15.71:0/472826878 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1674012430 con 0x7f167c154100 2023-10-06T01:41:05.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.714+0000 7f16727fc700 1 -- 172.21.15.71:0/472826878 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1674012590 con 0x7f167c154100 2023-10-06T01:41:05.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.714+0000 7f168465c700 1 -- 172.21.15.71:0/472826878 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f167c167680 con 0x7f167c154100 2023-10-06T01:41:05.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.714+0000 7f16727fc700 1 -- 172.21.15.71:0/472826878 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1674012950 con 0x7f167c154100 2023-10-06T01:41:05.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.714+0000 7f168465c700 1 -- 172.21.15.71:0/472826878 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f167c0abde0 con 0x7f167c154100 2023-10-06T01:41:05.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.715+0000 7f168465c700 1 -- 172.21.15.71:0/472826878 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f167c0ac000 con 0x7f167c154100 2023-10-06T01:41:05.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.715+0000 7f16727fc700 1 -- 172.21.15.71:0/472826878 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1674012d00 con 0x7f167c154100 2023-10-06T01:41:05.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.715+0000 7f16727fc700 1 --2- 172.21.15.71:0/472826878 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f1660066f30 0x7f16600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:05.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.716+0000 7f16727fc700 1 -- 172.21.15.71:0/472826878 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f1674016070 con 0x7f167c154100 2023-10-06T01:41:05.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.716+0000 7f16823f8700 1 --2- 172.21.15.71:0/472826878 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f1660066f30 0x7f16600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:05.721 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.716+0000 7f16823f8700 1 --2- 172.21.15.71:0/472826878 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f1660066f30 0x7f16600693e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f167c0aec50 tx=0x7f1678017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:05.721 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.720+0000 7f16727fc700 1 -- 172.21.15.71:0/472826878 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1674054930 con 0x7f167c154100 2023-10-06T01:41:05.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.906+0000 7f168465c700 1 -- 172.21.15.71:0/472826878 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f167c0af390 con 0x7f167c154100 2023-10-06T01:41:05.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.907+0000 7f16727fc700 1 -- 172.21.15.71:0/472826878 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1674057f50 con 0x7f167c154100 2023-10-06T01:41:05.907 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 1 2023-10-06T01:41:05.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.909+0000 7f168465c700 1 -- 172.21.15.71:0/472826878 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f1660066f30 msgr2=0x7f16600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:05.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.909+0000 7f168465c700 1 --2- 172.21.15.71:0/472826878 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f1660066f30 0x7f16600693e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f167c0aec50 tx=0x7f1678017000 comp rx=0 tx=0).stop 2023-10-06T01:41:05.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.909+0000 7f168465c700 1 -- 172.21.15.71:0/472826878 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f167c154100 msgr2=0x7f167c166a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:05.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.909+0000 7f168465c700 1 --2- 172.21.15.71:0/472826878 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f167c154100 0x7f167c166a50 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f167400e380 tx=0x7f167400b040 comp rx=0 tx=0).stop 2023-10-06T01:41:05.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.909+0000 7f168465c700 1 -- 172.21.15.71:0/472826878 shutdown_connections 2023-10-06T01:41:05.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.909+0000 7f168465c700 1 --2- 172.21.15.71:0/472826878 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f167c154100 0x7f167c166a50 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:05.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.909+0000 7f168465c700 1 --2- 172.21.15.71:0/472826878 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f1660066f30 0x7f16600693e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:05.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.909+0000 7f168465c700 1 --2- 172.21.15.71:0/472826878 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f167c06bba0 0x7f167c148ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:05.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.909+0000 7f168465c700 1 --2- 172.21.15.71:0/472826878 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f167c153d30 0x7f167c0ac300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:05.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.909+0000 7f168465c700 1 -- 172.21.15.71:0/472826878 >> 172.21.15.71:0/472826878 conn(0x7f167c0cc110 msgr2=0x7f167c0cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:05.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.909+0000 7f168465c700 1 -- 172.21.15.71:0/472826878 shutdown_connections 2023-10-06T01:41:05.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:05.909+0000 7f168465c700 1 -- 172.21.15.71:0/472826878 wait complete. 2023-10-06T01:41:05.921 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T01:41:06.037 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.037+0000 7fdb248b9700 1 Processor -- start 2023-10-06T01:41:06.038 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.037+0000 7fdb248b9700 1 -- start start 2023-10-06T01:41:06.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.038+0000 7fdb248b9700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fdb200cd7d0 0x7fdb200d01a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:06.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.038+0000 7fdb248b9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdb200b0810 0x7fdb200d06e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:06.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.038+0000 7fdb248b9700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb200d0c20 con 0x7fdb200cd400 2023-10-06T01:41:06.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.038+0000 7fdb248b9700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb200af770 con 0x7fdb200cd7d0 2023-10-06T01:41:06.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.038+0000 7fdb248b9700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb200afa50 con 0x7fdb200b0810 2023-10-06T01:41:06.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.038+0000 7fdb1e59c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fdb200cd7d0 0x7fdb200d01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:06.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.038+0000 7fdb1e59c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fdb200cd7d0 0x7fdb200d01a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36120/0 (socket says 172.21.15.71:36120) 2023-10-06T01:41:06.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.038+0000 7fdb1e59c700 1 -- 172.21.15.71:0/319290526 learned_addr learned my addr 172.21.15.71:0/319290526 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:06.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.038+0000 7fdb1e59c700 1 -- 172.21.15.71:0/319290526 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdb200b0810 msgr2=0x7fdb200d06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:06.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.038+0000 7fdb1e59c700 1 --2- 172.21.15.71:0/319290526 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdb200b0810 0x7fdb200d06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:06.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.038+0000 7fdb1e59c700 1 -- 172.21.15.71:0/319290526 >> v1:172.21.15.72:6789/0 conn(0x7fdb200cd400 legacy=0x7fdb200b1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:06.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.038+0000 7fdb1e59c700 1 -- 172.21.15.71:0/319290526 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb200afd30 con 0x7fdb200cd7d0 2023-10-06T01:41:06.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.038+0000 7fdb1e59c700 1 --2- 172.21.15.71:0/319290526 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb200cd7d0 0x7fdb200d01a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fdb080099e0 tx=0x7fdb08009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91323333a8b887dd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:06.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.038+0000 7fdb1dd9b700 1 -- 172.21.15.71:0/319290526 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0800b7e0 con 0x7fdb200cd7d0 2023-10-06T01:41:06.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.038+0000 7fdb1dd9b700 1 -- 172.21.15.71:0/319290526 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb0800b940 con 0x7fdb200cd7d0 2023-10-06T01:41:06.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.038+0000 7fdb1dd9b700 1 -- 172.21.15.71:0/319290526 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0800bd00 con 0x7fdb200cd7d0 2023-10-06T01:41:06.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.039+0000 7fdb248b9700 1 -- 172.21.15.71:0/319290526 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb200cd7d0 msgr2=0x7fdb200d01a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:06.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.039+0000 7fdb248b9700 1 --2- 172.21.15.71:0/319290526 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb200cd7d0 0x7fdb200d01a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fdb080099e0 tx=0x7fdb08009250 comp rx=0 tx=0).stop 2023-10-06T01:41:06.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.039+0000 7fdb248b9700 1 -- 172.21.15.71:0/319290526 shutdown_connections 2023-10-06T01:41:06.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.039+0000 7fdb248b9700 1 --2- 172.21.15.71:0/319290526 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdb200b0810 0x7fdb200d06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:06.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.039+0000 7fdb248b9700 1 --2- 172.21.15.71:0/319290526 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb200cd7d0 0x7fdb200d01a0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:06.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.039+0000 7fdb248b9700 1 -- 172.21.15.71:0/319290526 >> 172.21.15.71:0/319290526 conn(0x7fdb2006a110 msgr2=0x7fdb2006a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:06.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.039+0000 7fdb248b9700 1 -- 172.21.15.71:0/319290526 shutdown_connections 2023-10-06T01:41:06.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.039+0000 7fdb248b9700 1 -- 172.21.15.71:0/319290526 wait complete. 2023-10-06T01:41:06.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.040+0000 7fdb248b9700 1 Processor -- start 2023-10-06T01:41:06.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.040+0000 7fdb248b9700 1 -- start start 2023-10-06T01:41:06.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.041+0000 7fdb248b9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb200b0810 0x7fdb2015c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:06.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.041+0000 7fdb248b9700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb200cd400 0x7fdb200c56c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:06.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.041+0000 7fdb248b9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdb2015a200 0x7fdb20154900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:06.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.041+0000 7fdb248b9700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb2015c720 con 0x7fdb200cd400 2023-10-06T01:41:06.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.041+0000 7fdb248b9700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb2015a770 con 0x7fdb200b0810 2023-10-06T01:41:06.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.041+0000 7fdb248b9700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb2015aa50 con 0x7fdb2015a200 2023-10-06T01:41:06.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.041+0000 7fdb1e59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb200cd400 0x7fdb200c56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:06.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.041+0000 7fdb1e59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb200cd400 0x7fdb200c56c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36122/0 (socket says 172.21.15.71:36122) 2023-10-06T01:41:06.047 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.041+0000 7fdb1e59c700 1 -- 172.21.15.71:0/2659486069 learned_addr learned my addr 172.21.15.71:0/2659486069 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:06.047 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.041+0000 7fdb1ed9d700 1 --2- 172.21.15.71:0/2659486069 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb200b0810 0x7fdb2015c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:06.047 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.041+0000 7fdb1f59e700 1 --2- 172.21.15.71:0/2659486069 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdb2015a200 0x7fdb20154900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:06.047 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.041+0000 7fdb1e59c700 1 -- 172.21.15.71:0/2659486069 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdb2015a200 msgr2=0x7fdb20154900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:06.047 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.041+0000 7fdb1e59c700 1 --2- 172.21.15.71:0/2659486069 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdb2015a200 0x7fdb20154900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:06.047 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.041+0000 7fdb1e59c700 1 -- 172.21.15.71:0/2659486069 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb200b0810 msgr2=0x7fdb2015c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:06.047 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.041+0000 7fdb1e59c700 1 --2- 172.21.15.71:0/2659486069 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb200b0810 0x7fdb2015c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:06.047 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.041+0000 7fdb1e59c700 1 -- 172.21.15.71:0/2659486069 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb080094f0 con 0x7fdb200cd400 2023-10-06T01:41:06.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.041+0000 7fdb1ed9d700 1 --2- 172.21.15.71:0/2659486069 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb200b0810 0x7fdb2015c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:41:06.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.041+0000 7fdb1f59e700 1 --2- 172.21.15.71:0/2659486069 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdb2015a200 0x7fdb20154900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:41:06.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.041+0000 7fdb1e59c700 1 --2- 172.21.15.71:0/2659486069 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb200cd400 0x7fdb200c56c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fdb20089070 tx=0x7fdb08016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:06.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.041+0000 7fdb16ffd700 1 -- 172.21.15.71:0/2659486069 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb08011e50 con 0x7fdb200cd400 2023-10-06T01:41:06.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.041+0000 7fdb16ffd700 1 -- 172.21.15.71:0/2659486069 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb0801f070 con 0x7fdb200cd400 2023-10-06T01:41:06.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.041+0000 7fdb248b9700 1 -- 172.21.15.71:0/2659486069 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb2015ad30 con 0x7fdb200cd400 2023-10-06T01:41:06.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.041+0000 7fdb16ffd700 1 -- 172.21.15.71:0/2659486069 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb080266d0 con 0x7fdb200cd400 2023-10-06T01:41:06.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.042+0000 7fdb248b9700 1 -- 172.21.15.71:0/2659486069 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb200c7970 con 0x7fdb200cd400 2023-10-06T01:41:06.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.042+0000 7fdb248b9700 1 -- 172.21.15.71:0/2659486069 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb200c7bc0 con 0x7fdb200cd400 2023-10-06T01:41:06.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.043+0000 7fdb16ffd700 1 -- 172.21.15.71:0/2659486069 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdb0801a440 con 0x7fdb200cd400 2023-10-06T01:41:06.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.043+0000 7fdb16ffd700 1 --2- 172.21.15.71:0/2659486069 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fdb00066f30 0x7fdb000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:06.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.043+0000 7fdb1ed9d700 1 --2- 172.21.15.71:0/2659486069 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fdb00066f30 0x7fdb000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:06.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.043+0000 7fdb16ffd700 1 -- 172.21.15.71:0/2659486069 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6867+0+0 (secure 0 0 0) 0x7fdb08021070 con 0x7fdb200cd400 2023-10-06T01:41:06.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.044+0000 7fdb1ed9d700 1 --2- 172.21.15.71:0/2659486069 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fdb00066f30 0x7fdb000693e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fdb18007fd0 tx=0x7fdb180074f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:06.050 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.047+0000 7fdb16ffd700 1 -- 172.21.15.71:0/2659486069 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdb08053880 con 0x7fdb200cd400 2023-10-06T01:41:06.228 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.227+0000 7fdb248b9700 1 -- 172.21.15.71:0/2659486069 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fdb20064aa0 con 0x7fdb200cd400 2023-10-06T01:41:06.228 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.228+0000 7fdb16ffd700 1 -- 172.21.15.71:0/2659486069 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7fdb08056ea0 con 0x7fdb200cd400 2023-10-06T01:41:06.228 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 8 2023-10-06T01:41:06.231 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.230+0000 7fdb248b9700 1 -- 172.21.15.71:0/2659486069 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fdb00066f30 msgr2=0x7fdb000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:06.231 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.230+0000 7fdb248b9700 1 --2- 172.21.15.71:0/2659486069 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fdb00066f30 0x7fdb000693e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fdb18007fd0 tx=0x7fdb180074f0 comp rx=0 tx=0).stop 2023-10-06T01:41:06.231 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.230+0000 7fdb248b9700 1 -- 172.21.15.71:0/2659486069 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb200cd400 msgr2=0x7fdb200c56c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:06.231 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.230+0000 7fdb248b9700 1 --2- 172.21.15.71:0/2659486069 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb200cd400 0x7fdb200c56c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fdb20089070 tx=0x7fdb08016000 comp rx=0 tx=0).stop 2023-10-06T01:41:06.231 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.230+0000 7fdb248b9700 1 -- 172.21.15.71:0/2659486069 shutdown_connections 2023-10-06T01:41:06.231 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.230+0000 7fdb248b9700 1 --2- 172.21.15.71:0/2659486069 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdb2015a200 0x7fdb20154900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:06.231 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.230+0000 7fdb248b9700 1 --2- 172.21.15.71:0/2659486069 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fdb00066f30 0x7fdb000693e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:06.231 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.230+0000 7fdb248b9700 1 --2- 172.21.15.71:0/2659486069 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb200b0810 0x7fdb2015c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:06.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.230+0000 7fdb248b9700 1 --2- 172.21.15.71:0/2659486069 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb200cd400 0x7fdb200c56c0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:06.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.230+0000 7fdb248b9700 1 -- 172.21.15.71:0/2659486069 >> 172.21.15.71:0/2659486069 conn(0x7fdb2006a110 msgr2=0x7fdb200b5520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:06.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.230+0000 7fdb248b9700 1 -- 172.21.15.71:0/2659486069 shutdown_connections 2023-10-06T01:41:06.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.230+0000 7fdb248b9700 1 -- 172.21.15.71:0/2659486069 wait complete. 2023-10-06T01:41:06.243 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T01:41:06.360 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.359+0000 7f0352912700 1 Processor -- start 2023-10-06T01:41:06.360 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.359+0000 7f0352912700 1 -- start start 2023-10-06T01:41:06.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.360+0000 7f0352912700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f034c0ccd40 0x7f034c0cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:06.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.360+0000 7f0352912700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f034c0cf7e0 0x7f034c0b3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:06.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.360+0000 7f0352912700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f034c15dd40 con 0x7f034c0d0400 2023-10-06T01:41:06.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.360+0000 7f0352912700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f034c15e020 con 0x7f034c0cf7e0 2023-10-06T01:41:06.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.360+0000 7f0352912700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f034c0ceaa0 con 0x7f034c0ccd40 2023-10-06T01:41:06.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.360+0000 7f0350eaf700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f034c0cf7e0 0x7f034c0b3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:06.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.360+0000 7f034b7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f034c0ccd40 0x7f034c0cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:06.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.360+0000 7f034bfff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f034c0d0400 0x7f034c0b5c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.71:56716/0 (socket says 172.21.15.71:56716) 2023-10-06T01:41:06.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.360+0000 7f034bfff700 1 -- 172.21.15.71:0/431945438 learned_addr learned my addr 172.21.15.71:0/431945438 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:41:06.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.360+0000 7f0350eaf700 1 -- 172.21.15.71:0/431945438 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f034c0ccd40 msgr2=0x7f034c0cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:06.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.360+0000 7f0350eaf700 1 --2- 172.21.15.71:0/431945438 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f034c0ccd40 0x7f034c0cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:06.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.360+0000 7f0350eaf700 1 -- 172.21.15.71:0/431945438 >> v1:172.21.15.72:6789/0 conn(0x7f034c0d0400 legacy=0x7f034c0b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:06.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.360+0000 7f0350eaf700 1 -- 172.21.15.71:0/431945438 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f034c0ced80 con 0x7f034c0cf7e0 2023-10-06T01:41:06.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.360+0000 7f034affd700 1 -- 172.21.15.71:0/431945438 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2887544707 0 0) 0x7f034c15dd40 con 0x7f034c0d0400 2023-10-06T01:41:06.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.361+0000 7f0350eaf700 1 --2- 172.21.15.71:0/431945438 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f034c0cf7e0 0x7f034c0b3aa0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0344009e60 tx=0x7f0344009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f4153e0f6cec3c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:06.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.361+0000 7f034affd700 1 -- 172.21.15.71:0/431945438 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f034400e070 con 0x7f034c0cf7e0 2023-10-06T01:41:06.372 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.361+0000 7f034affd700 1 -- 172.21.15.71:0/431945438 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f034400bb60 con 0x7f034c0cf7e0 2023-10-06T01:41:06.372 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.361+0000 7f034affd700 1 -- 172.21.15.71:0/431945438 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0344012430 con 0x7f034c0cf7e0 2023-10-06T01:41:06.372 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.361+0000 7f0352912700 1 -- 172.21.15.71:0/431945438 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f034c0cf7e0 msgr2=0x7f034c0b3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:06.372 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.361+0000 7f0352912700 1 --2- 172.21.15.71:0/431945438 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f034c0cf7e0 0x7f034c0b3aa0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0344009e60 tx=0x7f0344009780 comp rx=0 tx=0).stop 2023-10-06T01:41:06.372 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.361+0000 7f0352912700 1 -- 172.21.15.71:0/431945438 shutdown_connections 2023-10-06T01:41:06.372 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.361+0000 7f0352912700 1 --2- 172.21.15.71:0/431945438 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f034c0cf7e0 0x7f034c0b3aa0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:06.373 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.361+0000 7f0352912700 1 --2- 172.21.15.71:0/431945438 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f034c0ccd40 0x7f034c0cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:06.373 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.361+0000 7f0352912700 1 -- 172.21.15.71:0/431945438 >> 172.21.15.71:0/431945438 conn(0x7f034c06a220 msgr2=0x7f034c06a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:06.373 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.361+0000 7f0352912700 1 -- 172.21.15.71:0/431945438 shutdown_connections 2023-10-06T01:41:06.373 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.361+0000 7f0352912700 1 -- 172.21.15.71:0/431945438 wait complete. 2023-10-06T01:41:06.373 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.362+0000 7f0352912700 1 Processor -- start 2023-10-06T01:41:06.373 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.363+0000 7f0352912700 1 -- start start 2023-10-06T01:41:06.374 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.363+0000 7f0352912700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f034c0ccd40 0x7f034c152fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:06.374 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.363+0000 7f0352912700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f034c0cf7e0 0x7f034c15c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:06.374 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.363+0000 7f0352912700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f034c0d0400 0x7f034c0c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:06.374 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.363+0000 7f0352912700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f034c153500 con 0x7f034c0cf7e0 2023-10-06T01:41:06.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.363+0000 7f0352912700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f034c15c2f0 con 0x7f034c0ccd40 2023-10-06T01:41:06.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.363+0000 7f0352912700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f034c0c64b0 con 0x7f034c0d0400 2023-10-06T01:41:06.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.363+0000 7f034b7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f034c0cf7e0 0x7f034c15c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:06.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.363+0000 7f034b7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f034c0cf7e0 0x7f034c15c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36134/0 (socket says 172.21.15.71:36134) 2023-10-06T01:41:06.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.363+0000 7f034b7fe700 1 -- 172.21.15.71:0/632673442 learned_addr learned my addr 172.21.15.71:0/632673442 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:06.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.364+0000 7f0350eaf700 1 --2- 172.21.15.71:0/632673442 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f034c0d0400 0x7f034c0c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:06.376 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.364+0000 7f034bfff700 1 --2- 172.21.15.71:0/632673442 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f034c0ccd40 0x7f034c152fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:06.376 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.364+0000 7f034b7fe700 1 -- 172.21.15.71:0/632673442 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f034c0d0400 msgr2=0x7f034c0c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:06.376 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.364+0000 7f034b7fe700 1 --2- 172.21.15.71:0/632673442 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f034c0d0400 0x7f034c0c5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:06.376 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.364+0000 7f034b7fe700 1 -- 172.21.15.71:0/632673442 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f034c0ccd40 msgr2=0x7f034c152fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:06.376 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.364+0000 7f034b7fe700 1 --2- 172.21.15.71:0/632673442 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f034c0ccd40 0x7f034c152fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:06.377 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.364+0000 7f034b7fe700 1 -- 172.21.15.71:0/632673442 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0344009a20 con 0x7f034c0cf7e0 2023-10-06T01:41:06.377 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.364+0000 7f034b7fe700 1 --2- 172.21.15.71:0/632673442 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f034c0cf7e0 0x7f034c15c780 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f034000ec80 tx=0x7f03400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:06.377 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.364+0000 7f0333fff700 1 -- 172.21.15.71:0/632673442 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f034000c850 con 0x7f034c0cf7e0 2023-10-06T01:41:06.377 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.364+0000 7f0333fff700 1 -- 172.21.15.71:0/632673442 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f034000c9b0 con 0x7f034c0cf7e0 2023-10-06T01:41:06.377 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.364+0000 7f0352912700 1 -- 172.21.15.71:0/632673442 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f034c0c6790 con 0x7f034c0cf7e0 2023-10-06T01:41:06.377 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.364+0000 7f0333fff700 1 -- 172.21.15.71:0/632673442 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f034000cd50 con 0x7f034c0cf7e0 2023-10-06T01:41:06.378 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.364+0000 7f0352912700 1 -- 172.21.15.71:0/632673442 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f034c15bf80 con 0x7f034c0cf7e0 2023-10-06T01:41:06.378 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.365+0000 7f0352912700 1 -- 172.21.15.71:0/632673442 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f034c088760 con 0x7f034c0cf7e0 2023-10-06T01:41:06.378 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.365+0000 7f0333fff700 1 -- 172.21.15.71:0/632673442 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0340013680 con 0x7f034c0cf7e0 2023-10-06T01:41:06.378 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.366+0000 7f0333fff700 1 --2- 172.21.15.71:0/632673442 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f0338066f30 0x7f03380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:06.378 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.366+0000 7f0333fff700 1 -- 172.21.15.71:0/632673442 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f0340084bf0 con 0x7f034c0cf7e0 2023-10-06T01:41:06.378 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.366+0000 7f034bfff700 1 --2- 172.21.15.71:0/632673442 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f0338066f30 0x7f03380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:06.379 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.366+0000 7f034bfff700 1 --2- 172.21.15.71:0/632673442 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f0338066f30 0x7f03380693e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f034c0c53a0 tx=0x7f033c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:06.380 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.370+0000 7f0333fff700 1 -- 172.21.15.71:0/632673442 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f03400519d0 con 0x7f034c0cf7e0 2023-10-06T01:41:06.553 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.553+0000 7f0352912700 1 -- 172.21.15.71:0/632673442 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f034c0ce6c0 con 0x7f034c0cf7e0 2023-10-06T01:41:06.554 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.553+0000 7f0333fff700 1 -- 172.21.15.71:0/632673442 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0340054ff0 con 0x7f034c0cf7e0 2023-10-06T01:41:06.554 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 32 2023-10-06T01:41:06.556 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.555+0000 7f0352912700 1 -- 172.21.15.71:0/632673442 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f0338066f30 msgr2=0x7f03380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:06.556 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.555+0000 7f0352912700 1 --2- 172.21.15.71:0/632673442 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f0338066f30 0x7f03380693e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f034c0c53a0 tx=0x7f033c009040 comp rx=0 tx=0).stop 2023-10-06T01:41:06.556 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.555+0000 7f0352912700 1 -- 172.21.15.71:0/632673442 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f034c0cf7e0 msgr2=0x7f034c15c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:06.556 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.555+0000 7f0352912700 1 --2- 172.21.15.71:0/632673442 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f034c0cf7e0 0x7f034c15c780 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f034000ec80 tx=0x7f03400091a0 comp rx=0 tx=0).stop 2023-10-06T01:41:06.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.555+0000 7f0352912700 1 -- 172.21.15.71:0/632673442 shutdown_connections 2023-10-06T01:41:06.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.555+0000 7f0352912700 1 --2- 172.21.15.71:0/632673442 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f034c0d0400 0x7f034c0c5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:06.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.555+0000 7f0352912700 1 --2- 172.21.15.71:0/632673442 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f0338066f30 0x7f03380693e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:06.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.555+0000 7f0352912700 1 --2- 172.21.15.71:0/632673442 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f034c0ccd40 0x7f034c152fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:06.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.555+0000 7f0352912700 1 --2- 172.21.15.71:0/632673442 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f034c0cf7e0 0x7f034c15c780 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:06.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.555+0000 7f0352912700 1 -- 172.21.15.71:0/632673442 >> 172.21.15.71:0/632673442 conn(0x7f034c06a220 msgr2=0x7f034c153cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:06.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.555+0000 7f0352912700 1 -- 172.21.15.71:0/632673442 shutdown_connections 2023-10-06T01:41:06.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.555+0000 7f0352912700 1 -- 172.21.15.71:0/632673442 wait complete. 2023-10-06T01:41:06.568 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T01:41:06.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.682+0000 7fb5609fa700 1 Processor -- start 2023-10-06T01:41:06.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.682+0000 7fb5609fa700 1 -- start start 2023-10-06T01:41:06.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.683+0000 7fb5609fa700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fb55c1570f0 0x7fb55c0c8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:06.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.683+0000 7fb5609fa700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb55c06e8a0 0x7fb55c1584e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:06.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.683+0000 7fb5609fa700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb55c158050 con 0x7fb55c1574c0 2023-10-06T01:41:06.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.683+0000 7fb5609fa700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb55c0c93e0 con 0x7fb55c1570f0 2023-10-06T01:41:06.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.683+0000 7fb5609fa700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb55c0c9940 con 0x7fb55c06e8a0 2023-10-06T01:41:06.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.683+0000 7fb55ad9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fb55c1570f0 0x7fb55c0c8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:06.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.683+0000 7fb55b59e700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fb55c1574c0 0x7fb55c06d9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:55930/0 (socket says 172.21.15.71:55930) 2023-10-06T01:41:06.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.683+0000 7fb55b59e700 1 -- 172.21.15.71:0/221865319 learned_addr learned my addr 172.21.15.71:0/221865319 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:41:06.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.684+0000 7fb55ad9d700 1 -- 172.21.15.71:0/221865319 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb55c06e8a0 msgr2=0x7fb55c1584e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:06.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.684+0000 7fb55ad9d700 1 --2- 172.21.15.71:0/221865319 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb55c06e8a0 0x7fb55c1584e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:06.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.684+0000 7fb55ad9d700 1 -- 172.21.15.71:0/221865319 >> v1:172.21.15.71:6789/0 conn(0x7fb55c1574c0 legacy=0x7fb55c06d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:06.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.684+0000 7fb55ad9d700 1 -- 172.21.15.71:0/221865319 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb55c0c9660 con 0x7fb55c1570f0 2023-10-06T01:41:06.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.684+0000 7fb55a59c700 1 -- 172.21.15.71:0/221865319 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2968106435 0 0) 0x7fb55c158050 con 0x7fb55c1574c0 2023-10-06T01:41:06.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.684+0000 7fb55ad9d700 1 --2- 172.21.15.71:0/221865319 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb55c1570f0 0x7fb55c0c8ea0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb54c0098e0 tx=0x7fb54c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d511bda9ab38e71 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:06.687 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.684+0000 7fb55a59c700 1 -- 172.21.15.71:0/221865319 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54c009e80 con 0x7fb55c1570f0 2023-10-06T01:41:06.687 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.684+0000 7fb55a59c700 1 -- 172.21.15.71:0/221865319 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb54c00b860 con 0x7fb55c1570f0 2023-10-06T01:41:06.687 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.684+0000 7fb55a59c700 1 -- 172.21.15.71:0/221865319 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54c00bbe0 con 0x7fb55c1570f0 2023-10-06T01:41:06.687 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.684+0000 7fb5609fa700 1 -- 172.21.15.71:0/221865319 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb55c1570f0 msgr2=0x7fb55c0c8ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:06.687 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.684+0000 7fb5609fa700 1 --2- 172.21.15.71:0/221865319 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb55c1570f0 0x7fb55c0c8ea0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb54c0098e0 tx=0x7fb54c0091a0 comp rx=0 tx=0).stop 2023-10-06T01:41:06.687 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.684+0000 7fb5609fa700 1 -- 172.21.15.71:0/221865319 shutdown_connections 2023-10-06T01:41:06.687 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.684+0000 7fb5609fa700 1 --2- 172.21.15.71:0/221865319 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb55c1570f0 0x7fb55c0c8ea0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:06.687 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.684+0000 7fb5609fa700 1 --2- 172.21.15.71:0/221865319 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb55c06e8a0 0x7fb55c1584e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:06.687 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.684+0000 7fb5609fa700 1 -- 172.21.15.71:0/221865319 >> 172.21.15.71:0/221865319 conn(0x7fb55c0cea20 msgr2=0x7fb55c06c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:06.687 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.684+0000 7fb5609fa700 1 -- 172.21.15.71:0/221865319 shutdown_connections 2023-10-06T01:41:06.687 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.684+0000 7fb5609fa700 1 -- 172.21.15.71:0/221865319 wait complete. 2023-10-06T01:41:06.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.686+0000 7fb5609fa700 1 Processor -- start 2023-10-06T01:41:06.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.686+0000 7fb5609fa700 1 -- start start 2023-10-06T01:41:06.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.686+0000 7fb5609fa700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb55c06e8a0 0x7fb55c1597c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:06.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.686+0000 7fb5609fa700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb55c1570f0 0x7fb55c151de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:06.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.686+0000 7fb5609fa700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb55c1574c0 0x7fb55c150b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:06.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.686+0000 7fb5609fa700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb55c159df0 con 0x7fb55c1570f0 2023-10-06T01:41:06.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.686+0000 7fb5609fa700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb55c168f10 con 0x7fb55c06e8a0 2023-10-06T01:41:06.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.686+0000 7fb5609fa700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb55c167f00 con 0x7fb55c1574c0 2023-10-06T01:41:06.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.687+0000 7fb55259c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb55c1570f0 0x7fb55c151de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:06.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.687+0000 7fb55259c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb55c1570f0 0x7fb55c151de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36148/0 (socket says 172.21.15.71:36148) 2023-10-06T01:41:06.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.687+0000 7fb55259c700 1 -- 172.21.15.71:0/2772069835 learned_addr learned my addr 172.21.15.71:0/2772069835 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:06.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.687+0000 7fb55ad9d700 1 --2- 172.21.15.71:0/2772069835 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb55c06e8a0 0x7fb55c1597c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:06.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.687+0000 7fb55b59e700 1 --2- 172.21.15.71:0/2772069835 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb55c1574c0 0x7fb55c150b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:06.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.687+0000 7fb55259c700 1 -- 172.21.15.71:0/2772069835 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb55c1574c0 msgr2=0x7fb55c150b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:06.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.687+0000 7fb55259c700 1 --2- 172.21.15.71:0/2772069835 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb55c1574c0 0x7fb55c150b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:06.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.687+0000 7fb55259c700 1 -- 172.21.15.71:0/2772069835 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb55c06e8a0 msgr2=0x7fb55c1597c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:06.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.687+0000 7fb55259c700 1 --2- 172.21.15.71:0/2772069835 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb55c06e8a0 0x7fb55c1597c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:06.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.687+0000 7fb55259c700 1 -- 172.21.15.71:0/2772069835 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb54c009420 con 0x7fb55c1570f0 2023-10-06T01:41:06.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.687+0000 7fb55b59e700 1 --2- 172.21.15.71:0/2772069835 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb55c1574c0 0x7fb55c150b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:41:06.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.687+0000 7fb55259c700 1 --2- 172.21.15.71:0/2772069835 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb55c1570f0 0x7fb55c151de0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb54400b870 tx=0x7fb544009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:06.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.687+0000 7fb5537fe700 1 -- 172.21.15.71:0/2772069835 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54400f510 con 0x7fb55c1570f0 2023-10-06T01:41:06.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.687+0000 7fb5537fe700 1 -- 172.21.15.71:0/2772069835 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb54400f670 con 0x7fb55c1570f0 2023-10-06T01:41:06.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.687+0000 7fb5609fa700 1 -- 172.21.15.71:0/2772069835 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb55c168a80 con 0x7fb55c1570f0 2023-10-06T01:41:06.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.687+0000 7fb5537fe700 1 -- 172.21.15.71:0/2772069835 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54400fa30 con 0x7fb55c1570f0 2023-10-06T01:41:06.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.687+0000 7fb5609fa700 1 -- 172.21.15.71:0/2772069835 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb55c168430 con 0x7fb55c1570f0 2023-10-06T01:41:06.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.688+0000 7fb5609fa700 1 -- 172.21.15.71:0/2772069835 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb55c064ee0 con 0x7fb55c1570f0 2023-10-06T01:41:06.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.689+0000 7fb5537fe700 1 -- 172.21.15.71:0/2772069835 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb54401a400 con 0x7fb55c1570f0 2023-10-06T01:41:06.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.689+0000 7fb5537fe700 1 --2- 172.21.15.71:0/2772069835 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fb53c066f30 0x7fb53c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:06.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.689+0000 7fb5537fe700 1 -- 172.21.15.71:0/2772069835 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6867+0+0 (secure 0 0 0) 0x7fb544084550 con 0x7fb55c1570f0 2023-10-06T01:41:06.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.689+0000 7fb55ad9d700 1 --2- 172.21.15.71:0/2772069835 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fb53c066f30 0x7fb53c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:06.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.689+0000 7fb55ad9d700 1 --2- 172.21.15.71:0/2772069835 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fb53c066f30 0x7fb53c0693e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb54c0091e0 tx=0x7fb54c017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:06.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.693+0000 7fb5537fe700 1 -- 172.21.15.71:0/2772069835 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb5440513b0 con 0x7fb55c1570f0 2023-10-06T01:41:06.877 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.877+0000 7fb5609fa700 1 -- 172.21.15.71:0/2772069835 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb55c168c10 con 0x7fb55c1570f0 2023-10-06T01:41:06.877 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.877+0000 7fb5537fe700 1 -- 172.21.15.71:0/2772069835 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb5440549d0 con 0x7fb55c1570f0 2023-10-06T01:41:06.878 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 64 2023-10-06T01:41:06.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.879+0000 7fb5609fa700 1 -- 172.21.15.71:0/2772069835 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fb53c066f30 msgr2=0x7fb53c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:06.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.879+0000 7fb5609fa700 1 --2- 172.21.15.71:0/2772069835 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fb53c066f30 0x7fb53c0693e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb54c0091e0 tx=0x7fb54c017000 comp rx=0 tx=0).stop 2023-10-06T01:41:06.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.879+0000 7fb5609fa700 1 -- 172.21.15.71:0/2772069835 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb55c1570f0 msgr2=0x7fb55c151de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:06.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.879+0000 7fb5609fa700 1 --2- 172.21.15.71:0/2772069835 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb55c1570f0 0x7fb55c151de0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb54400b870 tx=0x7fb544009220 comp rx=0 tx=0).stop 2023-10-06T01:41:06.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.879+0000 7fb5609fa700 1 -- 172.21.15.71:0/2772069835 shutdown_connections 2023-10-06T01:41:06.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.879+0000 7fb5609fa700 1 --2- 172.21.15.71:0/2772069835 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb55c1574c0 0x7fb55c150b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:06.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.879+0000 7fb5609fa700 1 --2- 172.21.15.71:0/2772069835 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fb53c066f30 0x7fb53c0693e0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:06.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.879+0000 7fb5609fa700 1 --2- 172.21.15.71:0/2772069835 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb55c06e8a0 0x7fb55c1597c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:06.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.879+0000 7fb5609fa700 1 --2- 172.21.15.71:0/2772069835 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb55c1570f0 0x7fb55c151de0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:06.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.879+0000 7fb5609fa700 1 -- 172.21.15.71:0/2772069835 >> 172.21.15.71:0/2772069835 conn(0x7fb55c0cea20 msgr2=0x7fb55c152b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:06.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.879+0000 7fb5609fa700 1 -- 172.21.15.71:0/2772069835 shutdown_connections 2023-10-06T01:41:06.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:06.879+0000 7fb5609fa700 1 -- 172.21.15.71:0/2772069835 wait complete. 2023-10-06T01:41:06.892 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-06T01:41:07.009 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.008+0000 7f751dfe9700 1 Processor -- start 2023-10-06T01:41:07.009 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.008+0000 7f751dfe9700 1 -- start start 2023-10-06T01:41:07.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.009+0000 7f751dfe9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f75180d0400 0x7f75180b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:07.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.009+0000 7f751dfe9700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f75180ccd40 0x7f75180cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:07.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.009+0000 7f751dfe9700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f75180cf7e0 0x7f75180b3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:07.012 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.009+0000 7f751dfe9700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75180b6170 con 0x7f75180ccd40 2023-10-06T01:41:07.012 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.009+0000 7f751dfe9700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f751815dd40 con 0x7f75180cf7e0 2023-10-06T01:41:07.012 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.009+0000 7f751dfe9700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f751815e020 con 0x7f75180d0400 2023-10-06T01:41:07.012 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.009+0000 7f7516ffd700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f75180ccd40 0x7f75180cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:07.012 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.009+0000 7f7516ffd700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f75180ccd40 0x7f75180cf2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36152/0 (socket says 172.21.15.71:36152) 2023-10-06T01:41:07.012 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.009+0000 7f7516ffd700 1 -- 172.21.15.71:0/4083494764 learned_addr learned my addr 172.21.15.71:0/4083494764 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:07.012 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.009+0000 7f7517fff700 1 --2- 172.21.15.71:0/4083494764 >> v2:172.21.15.72:3300/0 conn(0x7f75180cf7e0 0x7f75180b3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:07.012 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.009+0000 7f75177fe700 1 --2- 172.21.15.71:0/4083494764 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f75180d0400 0x7f75180b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:07.012 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.009+0000 7f7516ffd700 1 -- 172.21.15.71:0/4083494764 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f75180d0400 msgr2=0x7f75180b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:07.012 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.009+0000 7f7516ffd700 1 --2- 172.21.15.71:0/4083494764 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f75180d0400 0x7f75180b5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:07.012 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.009+0000 7f7516ffd700 1 -- 172.21.15.71:0/4083494764 >> v2:172.21.15.72:3300/0 conn(0x7f75180cf7e0 msgr2=0x7f75180b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:07.013 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.009+0000 7f7516ffd700 1 --2- 172.21.15.71:0/4083494764 >> v2:172.21.15.72:3300/0 conn(0x7f75180cf7e0 0x7f75180b3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:07.013 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.009+0000 7f7516ffd700 1 -- 172.21.15.71:0/4083494764 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75180ceaa0 con 0x7f75180ccd40 2023-10-06T01:41:07.013 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.010+0000 7f7517fff700 1 --2- 172.21.15.71:0/4083494764 >> v2:172.21.15.72:3300/0 conn(0x7f75180cf7e0 0x7f75180b3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:41:07.013 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.010+0000 7f75177fe700 1 --2- 172.21.15.71:0/4083494764 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f75180d0400 0x7f75180b5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:41:07.013 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.010+0000 7f7516ffd700 1 --2- 172.21.15.71:0/4083494764 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f75180ccd40 0x7f75180cf2a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f75180b3860 tx=0x7f750c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70bd19985ac42b78 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:07.013 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.010+0000 7f75167fc700 1 -- 172.21.15.71:0/4083494764 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750c00b860 con 0x7f75180ccd40 2023-10-06T01:41:07.013 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.010+0000 7f75167fc700 1 -- 172.21.15.71:0/4083494764 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f750c00b9c0 con 0x7f75180ccd40 2023-10-06T01:41:07.013 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.010+0000 7f75167fc700 1 -- 172.21.15.71:0/4083494764 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750c00bd60 con 0x7f75180ccd40 2023-10-06T01:41:07.013 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.010+0000 7f751dfe9700 1 -- 172.21.15.71:0/4083494764 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f75180ccd40 msgr2=0x7f75180cf2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:07.013 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.010+0000 7f751dfe9700 1 --2- 172.21.15.71:0/4083494764 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f75180ccd40 0x7f75180cf2a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f75180b3860 tx=0x7f750c009250 comp rx=0 tx=0).stop 2023-10-06T01:41:07.013 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.010+0000 7f751dfe9700 1 -- 172.21.15.71:0/4083494764 shutdown_connections 2023-10-06T01:41:07.014 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.010+0000 7f751dfe9700 1 --2- 172.21.15.71:0/4083494764 >> v2:172.21.15.72:3300/0 conn(0x7f75180cf7e0 0x7f75180b3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:07.014 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.010+0000 7f751dfe9700 1 --2- 172.21.15.71:0/4083494764 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f75180d0400 0x7f75180b5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:07.014 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.010+0000 7f751dfe9700 1 --2- 172.21.15.71:0/4083494764 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f75180ccd40 0x7f75180cf2a0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:07.014 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.010+0000 7f751dfe9700 1 -- 172.21.15.71:0/4083494764 >> 172.21.15.71:0/4083494764 conn(0x7f751806a220 msgr2=0x7f751806a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:07.014 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.010+0000 7f751dfe9700 1 -- 172.21.15.71:0/4083494764 shutdown_connections 2023-10-06T01:41:07.014 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.010+0000 7f751dfe9700 1 -- 172.21.15.71:0/4083494764 wait complete. 2023-10-06T01:41:07.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.012+0000 7f751dfe9700 1 Processor -- start 2023-10-06T01:41:07.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.012+0000 7f751dfe9700 1 -- start start 2023-10-06T01:41:07.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.012+0000 7f751dfe9700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f75180ccd40 0x7f751816c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:07.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.012+0000 7f751dfe9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75180cf7e0 0x7f75180b1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:07.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.012+0000 7f751dfe9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f75180d0400 0x7f75180b2390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:07.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.012+0000 7f751dfe9700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f751815c7e0 con 0x7f75180ccd40 2023-10-06T01:41:07.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.012+0000 7f751dfe9700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f751815bef0 con 0x7f75180cf7e0 2023-10-06T01:41:07.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.012+0000 7f751dfe9700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75180c6030 con 0x7f75180d0400 2023-10-06T01:41:07.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.012+0000 7f75177fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f75180ccd40 0x7f751816c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:07.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.012+0000 7f75177fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f75180ccd40 0x7f751816c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36160/0 (socket says 172.21.15.71:36160) 2023-10-06T01:41:07.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.012+0000 7f75177fe700 1 -- 172.21.15.71:0/3031880468 learned_addr learned my addr 172.21.15.71:0/3031880468 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:07.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.013+0000 7f7516ffd700 1 --2- 172.21.15.71:0/3031880468 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75180cf7e0 0x7f75180b1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:07.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.013+0000 7f7517fff700 1 --2- 172.21.15.71:0/3031880468 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f75180d0400 0x7f75180b2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:07.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.013+0000 7f75177fe700 1 -- 172.21.15.71:0/3031880468 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f75180d0400 msgr2=0x7f75180b2390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:07.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.013+0000 7f75177fe700 1 --2- 172.21.15.71:0/3031880468 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f75180d0400 0x7f75180b2390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:07.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.013+0000 7f75177fe700 1 -- 172.21.15.71:0/3031880468 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75180cf7e0 msgr2=0x7f75180b1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:07.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.013+0000 7f75177fe700 1 --2- 172.21.15.71:0/3031880468 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75180cf7e0 0x7f75180b1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:07.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.013+0000 7f75177fe700 1 -- 172.21.15.71:0/3031880468 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f750c0094f0 con 0x7f75180ccd40 2023-10-06T01:41:07.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.013+0000 7f7517fff700 1 --2- 172.21.15.71:0/3031880468 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f75180d0400 0x7f75180b2390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:41:07.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.013+0000 7f75177fe700 1 --2- 172.21.15.71:0/3031880468 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f75180ccd40 0x7f751816c840 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f750800a300 tx=0x7f75080078c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:07.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.013+0000 7f74ff7fe700 1 -- 172.21.15.71:0/3031880468 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7508015440 con 0x7f75180ccd40 2023-10-06T01:41:07.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.013+0000 7f74ff7fe700 1 -- 172.21.15.71:0/3031880468 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75080155a0 con 0x7f75180ccd40 2023-10-06T01:41:07.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.013+0000 7f751dfe9700 1 -- 172.21.15.71:0/3031880468 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f751815c190 con 0x7f75180ccd40 2023-10-06T01:41:07.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.013+0000 7f74ff7fe700 1 -- 172.21.15.71:0/3031880468 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7508015920 con 0x7f75180ccd40 2023-10-06T01:41:07.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.013+0000 7f751dfe9700 1 -- 172.21.15.71:0/3031880468 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f751815cc90 con 0x7f75180ccd40 2023-10-06T01:41:07.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.014+0000 7f751dfe9700 1 -- 172.21.15.71:0/3031880468 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7518088760 con 0x7f75180ccd40 2023-10-06T01:41:07.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.014+0000 7f74ff7fe700 1 -- 172.21.15.71:0/3031880468 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7508015cd0 con 0x7f75180ccd40 2023-10-06T01:41:07.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.015+0000 7f74ff7fe700 1 --2- 172.21.15.71:0/3031880468 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7504066f30 0x7f75040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:07.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.015+0000 7f74ff7fe700 1 -- 172.21.15.71:0/3031880468 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f75080850c0 con 0x7f75180ccd40 2023-10-06T01:41:07.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.015+0000 7f7516ffd700 1 --2- 172.21.15.71:0/3031880468 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7504066f30 0x7f75040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:07.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.015+0000 7f7516ffd700 1 --2- 172.21.15.71:0/3031880468 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7504066f30 0x7f75040693e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f75180b3860 tx=0x7f750c017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:07.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.019+0000 7f74ff7fe700 1 -- 172.21.15.71:0/3031880468 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f750804e5a0 con 0x7f75180ccd40 2023-10-06T01:41:07.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.201+0000 7f751dfe9700 1 -- 172.21.15.71:0/3031880468 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f75180ced80 con 0x7f75180ccd40 2023-10-06T01:41:07.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.201+0000 7f74ff7fe700 1 -- 172.21.15.71:0/3031880468 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f7508051f50 con 0x7f75180ccd40 2023-10-06T01:41:07.202 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 32 2023-10-06T01:41:07.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.203+0000 7f751dfe9700 1 -- 172.21.15.71:0/3031880468 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7504066f30 msgr2=0x7f75040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:07.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.203+0000 7f751dfe9700 1 --2- 172.21.15.71:0/3031880468 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7504066f30 0x7f75040693e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f75180b3860 tx=0x7f750c017000 comp rx=0 tx=0).stop 2023-10-06T01:41:07.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.204+0000 7f751dfe9700 1 -- 172.21.15.71:0/3031880468 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f75180ccd40 msgr2=0x7f751816c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:07.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.204+0000 7f751dfe9700 1 --2- 172.21.15.71:0/3031880468 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f75180ccd40 0x7f751816c840 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f750800a300 tx=0x7f75080078c0 comp rx=0 tx=0).stop 2023-10-06T01:41:07.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.204+0000 7f751dfe9700 1 -- 172.21.15.71:0/3031880468 shutdown_connections 2023-10-06T01:41:07.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.204+0000 7f751dfe9700 1 --2- 172.21.15.71:0/3031880468 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f75180d0400 0x7f75180b2390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:07.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.204+0000 7f751dfe9700 1 --2- 172.21.15.71:0/3031880468 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f75180ccd40 0x7f751816c840 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:07.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.204+0000 7f751dfe9700 1 --2- 172.21.15.71:0/3031880468 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7504066f30 0x7f75040693e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:07.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.204+0000 7f751dfe9700 1 --2- 172.21.15.71:0/3031880468 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75180cf7e0 0x7f75180b1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:07.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.204+0000 7f751dfe9700 1 -- 172.21.15.71:0/3031880468 >> 172.21.15.71:0/3031880468 conn(0x7f751806a220 msgr2=0x7f7518154080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:07.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.204+0000 7f751dfe9700 1 -- 172.21.15.71:0/3031880468 shutdown_connections 2023-10-06T01:41:07.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.204+0000 7f751dfe9700 1 -- 172.21.15.71:0/3031880468 wait complete. 2023-10-06T01:41:07.216 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:41:07.330 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.329+0000 7f1dcd0ac700 1 Processor -- start 2023-10-06T01:41:07.330 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.329+0000 7f1dcd0ac700 1 -- start start 2023-10-06T01:41:07.333 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.330+0000 7f1dcd0ac700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1dc80af4e0 0x7f1dc80b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:07.333 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.330+0000 7f1dcd0ac700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1dc815db70 0x7f1dc80b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:07.333 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.330+0000 7f1dcd0ac700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dc815e190 con 0x7f1dc80af8b0 2023-10-06T01:41:07.334 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.330+0000 7f1dcd0ac700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dc80b1910 con 0x7f1dc80af4e0 2023-10-06T01:41:07.334 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.330+0000 7f1dcd0ac700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc815dfa0 con 0x7f1dc815db70 2023-10-06T01:41:07.334 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.330+0000 7f1dbe59c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f1dc80af8b0 0x7f1dc815d460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:55942/0 (socket says 172.21.15.71:55942) 2023-10-06T01:41:07.334 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.330+0000 7f1dbe59c700 1 -- 172.21.15.71:0/2446896960 learned_addr learned my addr 172.21.15.71:0/2446896960 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:41:07.334 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.330+0000 7f1dc659c700 1 -- 172.21.15.71:0/2446896960 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 463669059 0 0) 0x7f1dc815e190 con 0x7f1dc80af8b0 2023-10-06T01:41:07.334 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.330+0000 7f1dc6d9d700 1 --2- 172.21.15.71:0/2446896960 >> v2:172.21.15.72:3300/0 conn(0x7f1dc80af4e0 0x7f1dc80b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:07.334 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.330+0000 7f1dc759e700 1 --2- 172.21.15.71:0/2446896960 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1dc815db70 0x7f1dc80b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:07.334 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.330+0000 7f1dc659c700 1 -- 172.21.15.71:0/2446896960 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1db4003570 con 0x7f1dc80af8b0 2023-10-06T01:41:07.334 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.331+0000 7f1dc659c700 1 -- 172.21.15.71:0/2446896960 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1046783210 0 0) 0x7f1db4003570 con 0x7f1dc80af8b0 2023-10-06T01:41:07.334 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.331+0000 7f1dc659c700 1 -- 172.21.15.71:0/2446896960 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1dc815db70 msgr2=0x7f1dc80b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:07.334 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.331+0000 7f1dc659c700 1 --2- 172.21.15.71:0/2446896960 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1dc815db70 0x7f1dc80b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:07.334 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.331+0000 7f1dc659c700 1 -- 172.21.15.71:0/2446896960 >> v2:172.21.15.72:3300/0 conn(0x7f1dc80af4e0 msgr2=0x7f1dc80b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:07.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.331+0000 7f1dc659c700 1 --2- 172.21.15.71:0/2446896960 >> v2:172.21.15.72:3300/0 conn(0x7f1dc80af4e0 0x7f1dc80b20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:07.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.331+0000 7f1dc659c700 1 -- 172.21.15.71:0/2446896960 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dc80cb650 con 0x7f1dc80af8b0 2023-10-06T01:41:07.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.331+0000 7f1dc659c700 1 -- 172.21.15.71:0/2446896960 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1184243524 0 0) 0x7f1db0001470 con 0x7f1dc80af8b0 2023-10-06T01:41:07.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.331+0000 7f1dc659c700 1 -- 172.21.15.71:0/2446896960 >> v1:172.21.15.71:6789/0 conn(0x7f1dc80af8b0 legacy=0x7f1dc815d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:07.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.331+0000 7f1dc659c700 1 --2- 172.21.15.71:0/2446896960 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1db4003a60 0x7f1db4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:07.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.331+0000 7f1dc659c700 1 --2- 172.21.15.71:0/2446896960 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1dc815db70 0x7f1db4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:07.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.331+0000 7f1dc659c700 1 --2- 172.21.15.71:0/2446896960 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1db4004d50 0x7f1db40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:07.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.331+0000 7f1dc659c700 1 -- 172.21.15.71:0/2446896960 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc80b1910 con 0x7f1db4004d50 2023-10-06T01:41:07.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.331+0000 7f1dc659c700 1 -- 172.21.15.71:0/2446896960 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1db400ba60 con 0x7f1db4003a60 2023-10-06T01:41:07.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.331+0000 7f1dc659c700 1 -- 172.21.15.71:0/2446896960 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1db400bba0 con 0x7f1dc815db70 2023-10-06T01:41:07.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.331+0000 7f1dc759e700 1 --2- 172.21.15.71:0/2446896960 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1db4004d50 0x7f1db40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:07.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.331+0000 7f1dc6d9d700 1 --2- 172.21.15.71:0/2446896960 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1db4003a60 0x7f1db4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:07.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.331+0000 7f1dbe59c700 1 --2- 172.21.15.71:0/2446896960 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1dc815db70 0x7f1db4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:07.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.331+0000 7f1dc759e700 1 -- 172.21.15.71:0/2446896960 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1dc815db70 msgr2=0x7f1db4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:07.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.331+0000 7f1dc759e700 1 --2- 172.21.15.71:0/2446896960 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1dc815db70 0x7f1db4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:07.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.331+0000 7f1dc759e700 1 -- 172.21.15.71:0/2446896960 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1db4003a60 msgr2=0x7f1db4003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:07.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.331+0000 7f1dc759e700 1 --2- 172.21.15.71:0/2446896960 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1db4003a60 0x7f1db4003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:07.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.331+0000 7f1dc759e700 1 -- 172.21.15.71:0/2446896960 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1db4003570 con 0x7f1db4004d50 2023-10-06T01:41:07.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.331+0000 7f1dc759e700 1 --2- 172.21.15.71:0/2446896960 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1db4004d50 0x7f1db40051c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f1dc000e210 tx=0x7f1dc000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99beea01a2f113d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:07.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.331+0000 7f1dc659c700 1 -- 172.21.15.71:0/2446896960 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc000ea60 con 0x7f1db4004d50 2023-10-06T01:41:07.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.331+0000 7f1dc659c700 1 -- 172.21.15.71:0/2446896960 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dc000f040 con 0x7f1db4004d50 2023-10-06T01:41:07.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.331+0000 7f1dc659c700 1 -- 172.21.15.71:0/2446896960 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc000ee10 con 0x7f1db4004d50 2023-10-06T01:41:07.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.332+0000 7f1dcd0ac700 1 -- 172.21.15.71:0/2446896960 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1db4004d50 msgr2=0x7f1db40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:07.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.332+0000 7f1dcd0ac700 1 --2- 172.21.15.71:0/2446896960 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1db4004d50 0x7f1db40051c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f1dc000e210 tx=0x7f1dc000b040 comp rx=0 tx=0).stop 2023-10-06T01:41:07.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.332+0000 7f1dc759e700 1 -- 172.21.15.71:0/2446896960 reap_dead start 2023-10-06T01:41:07.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.332+0000 7f1dcd0ac700 1 -- 172.21.15.71:0/2446896960 shutdown_connections 2023-10-06T01:41:07.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.332+0000 7f1dcd0ac700 1 -- 172.21.15.71:0/2446896960 >> 172.21.15.71:0/2446896960 conn(0x7f1dc8068680 msgr2=0x7f1dc8068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:07.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.332+0000 7f1dcd0ac700 1 -- 172.21.15.71:0/2446896960 shutdown_connections 2023-10-06T01:41:07.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.332+0000 7f1dcd0ac700 1 -- 172.21.15.71:0/2446896960 wait complete. 2023-10-06T01:41:07.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.333+0000 7f1dcd0ac700 1 Processor -- start 2023-10-06T01:41:07.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.333+0000 7f1dcd0ac700 1 -- start start 2023-10-06T01:41:07.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.334+0000 7f1dcd0ac700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1dc8159b80 0x7f1dc8141cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:07.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.334+0000 7f1dcd0ac700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1dc80c9350 0x7f1dc81436c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:07.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.334+0000 7f1dcd0ac700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1dc8143c00 0x7f1dc80c7400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:07.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.334+0000 7f1dcd0ac700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc8144070 con 0x7f1dc80c9350 2023-10-06T01:41:07.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.334+0000 7f1dcd0ac700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc8169ea0 con 0x7f1dc8143c00 2023-10-06T01:41:07.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.334+0000 7f1dcd0ac700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc8142320 con 0x7f1dc8159b80 2023-10-06T01:41:07.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.334+0000 7f1dbe59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1dc80c9350 0x7f1dc81436c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:07.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.334+0000 7f1dbe59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1dc80c9350 0x7f1dc81436c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36180/0 (socket says 172.21.15.71:36180) 2023-10-06T01:41:07.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.334+0000 7f1dbe59c700 1 -- 172.21.15.71:0/1228428005 learned_addr learned my addr 172.21.15.71:0/1228428005 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:07.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.334+0000 7f1dbe59c700 1 -- 172.21.15.71:0/1228428005 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1dc8159b80 msgr2=0x7f1dc8141cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:07.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.334+0000 7f1dc6d9d700 1 --2- 172.21.15.71:0/1228428005 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1dc8159b80 0x7f1dc8141cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:07.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.334+0000 7f1dc759e700 1 --2- 172.21.15.71:0/1228428005 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1dc8143c00 0x7f1dc80c7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:07.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.334+0000 7f1dbe59c700 1 --2- 172.21.15.71:0/1228428005 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1dc8159b80 0x7f1dc8141cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:07.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.334+0000 7f1dbe59c700 1 -- 172.21.15.71:0/1228428005 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1dc8143c00 msgr2=0x7f1dc80c7400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:07.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.334+0000 7f1dbe59c700 1 --2- 172.21.15.71:0/1228428005 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1dc8143c00 0x7f1dc80c7400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:07.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.334+0000 7f1dbe59c700 1 -- 172.21.15.71:0/1228428005 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dc8142600 con 0x7f1dc80c9350 2023-10-06T01:41:07.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.335+0000 7f1dbe59c700 1 --2- 172.21.15.71:0/1228428005 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1dc80c9350 0x7f1dc81436c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f1db0000fd0 tx=0x7f1dc80cb5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:07.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.335+0000 7f1dbf7fe700 1 -- 172.21.15.71:0/1228428005 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db0018030 con 0x7f1dc80c9350 2023-10-06T01:41:07.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.335+0000 7f1dbf7fe700 1 -- 172.21.15.71:0/1228428005 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1db000f8d0 con 0x7f1dc80c9350 2023-10-06T01:41:07.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.335+0000 7f1dbf7fe700 1 -- 172.21.15.71:0/1228428005 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db000fc70 con 0x7f1dc80c9350 2023-10-06T01:41:07.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.335+0000 7f1dcd0ac700 1 -- 172.21.15.71:0/1228428005 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dc81428e0 con 0x7f1dc80c9350 2023-10-06T01:41:07.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.335+0000 7f1dcd0ac700 1 -- 172.21.15.71:0/1228428005 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dc8159f50 con 0x7f1dc80c9350 2023-10-06T01:41:07.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.336+0000 7f1dcd0ac700 1 -- 172.21.15.71:0/1228428005 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dc8088aa0 con 0x7f1dc80c9350 2023-10-06T01:41:07.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.336+0000 7f1dbf7fe700 1 -- 172.21.15.71:0/1228428005 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1db001b070 con 0x7f1dc80c9350 2023-10-06T01:41:07.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.336+0000 7f1dbf7fe700 1 --2- 172.21.15.71:0/1228428005 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f1da8066f30 0x7f1da80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:07.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.336+0000 7f1dbf7fe700 1 -- 172.21.15.71:0/1228428005 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f1db0019070 con 0x7f1dc80c9350 2023-10-06T01:41:07.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.336+0000 7f1dc6d9d700 1 --2- 172.21.15.71:0/1228428005 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f1da8066f30 0x7f1da80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:07.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.337+0000 7f1dc6d9d700 1 --2- 172.21.15.71:0/1228428005 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f1da8066f30 0x7f1da80693e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1dc815a6d0 tx=0x7f1db8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:07.342 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.340+0000 7f1dbf7fe700 1 -- 172.21.15.71:0/1228428005 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1db0051800 con 0x7f1dc80c9350 2023-10-06T01:41:07.524 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.523+0000 7f1dcd0ac700 1 -- 172.21.15.71:0/1228428005 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1dc80cad20 con 0x7f1dc80c9350 2023-10-06T01:41:07.525 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.524+0000 7f1dbf7fe700 1 -- 172.21.15.71:0/1228428005 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18754 (secure 0 0 0) 0x7f1db0054e20 con 0x7f1dc80c9350 2023-10-06T01:41:07.525 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:41:07.525 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":29,"fsid":"1fbf1bd2-f9b4-4599-bea2-f4aa920e9a56","created":"2023-10-06T01:39:57.016957+0000","modified":"2023-10-06T01:41:03.811605+0000","last_up_change":"2023-10-06T01:40:08.571643+0000","last_in_change":"2023-10-06T01:39:59.462741+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T01:40:08.610349+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T01:40:15.387434+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T01:40:19.640459+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T01:40:20.116883+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T01:40:23.830129+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cf059188-fb20-4dbf-95db-dcf57b213d03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":90670},{"type":"v1","addr":"172.21.15.71:6817","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":90670},{"type":"v1","addr":"172.21.15.71:6819","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":90670},{"type":"v1","addr":"172.21.15.71:6823","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":90670},{"type":"v1","addr":"172.21.15.71:6821","nonce":90670}]},"public_addr":"172.21.15.71:6817/90670","cluster_addr":"172.21.15.71:6819/90670","heartbeat_back_addr":"172.21.15.71:6823/90670","heartbeat_front_addr":"172.21.15.71:6821/90670","state":["exists","up"]},{"osd":1,"uuid":"0cff0aae-1799-4fe0-b610-54cf0813c0e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":90669},{"type":"v1","addr":"172.21.15.71:6809","nonce":90669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":90669},{"type":"v1","addr":"172.21.15.71:6811","nonce":90669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":90669},{"type":"v1","addr":"172.21.15.71:6815","nonce":90669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":90669},{"type":"v1","addr":"172.21.15.71:6813","nonce":90669}]},"public_addr":"172.21.15.71:6809/90669","cluster_addr":"172.21.15.71:6811/90669","heartbeat_back_addr":"172.21.15.71:6815/90669","heartbeat_front_addr":"172.21.15.71:6813/90669","state":["exists","up"]},{"osd":2,"uuid":"88d61ddc-9031-44e1-ba8c-546a41e7c8ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":90679},{"type":"v1","addr":"172.21.15.71:6825","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":90679},{"type":"v1","addr":"172.21.15.71:6827","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":90679},{"type":"v1","addr":"172.21.15.71:6831","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":90679},{"type":"v1","addr":"172.21.15.71:6829","nonce":90679}]},"public_addr":"172.21.15.71:6825/90679","cluster_addr":"172.21.15.71:6827/90679","heartbeat_back_addr":"172.21.15.71:6831/90679","heartbeat_front_addr":"172.21.15.71:6829/90679","state":["exists","up"]},{"osd":3,"uuid":"11ed92b7-960b-4a30-a889-a61d3eeb86f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":90668},{"type":"v1","addr":"172.21.15.71:6801","nonce":90668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":90668},{"type":"v1","addr":"172.21.15.71:6803","nonce":90668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":90668},{"type":"v1","addr":"172.21.15.71:6807","nonce":90668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":90668},{"type":"v1","addr":"172.21.15.71:6805","nonce":90668}]},"public_addr":"172.21.15.71:6801/90668","cluster_addr":"172.21.15.71:6803/90668","heartbeat_back_addr":"172.21.15.71:6807/90668","heartbeat_front_addr":"172.21.15.71:6805/90668","state":["exists","up"]},{"osd":4,"uuid":"ae4df784-abdf-4ddf-aefa-780f3ddafef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":90917},{"type":"v1","addr":"172.21.15.72:6801","nonce":90917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":90917},{"type":"v1","addr":"172.21.15.72:6803","nonce":90917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":90917},{"type":"v1","addr":"172.21.15.72:6807","nonce":90917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":90917},{"type":"v1","addr":"172.21.15.72:6805","nonce":90917}]},"public_addr":"172.21.15.72:6801/90917","cluster_addr":"172.21.15.72:6803/90917","heartbeat_back_addr":"172.21.15.72:6807/90917","heartbeat_front_addr":"172.21.15.72:6805/90917","state":["exists","up"]},{"osd":5,"uuid":"5ef0790f-001e-458f-a05b-efae216cf435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":90941},{"type":"v1","addr":"172.21.15.72:6817","nonce":90941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":90941},{"type":"v1","addr":"172.21.15.72:6819","nonce":90941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":90941},{"type":"v1","addr":"172.21.15.72:6827","nonce":90941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":90941},{"type":"v1","addr":"172.21.15.72:6823","nonce":90941}]},"public_addr":"172.21.15.72:6817/90941","cluster_addr":"172.21.15.72:6819/90941","heartbeat_back_addr":"172.21.15.72:6827/90941","heartbeat_front_addr":"172.21.15.72:6823/90941","state":["exists","up"]},{"osd":6,"uuid":"8705aef1-9ae8-4e54-a3c4-c2909fa0ceb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":90918},{"type":"v1","addr":"172.21.15.72:6809","nonce":90918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":90918},{"type":"v1","addr":"172.21.15.72:6811","nonce":90918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":90918},{"type":"v1","addr":"172.21.15.72:6815","nonce":90918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":90918},{"type":"v1","addr":"172.21.15.72:6813","nonce":90918}]},"public_addr":"172.21.15.72:6809/90918","cluster_addr":"172.21.15.72:6811/90918","heartbeat_back_addr":"172.21.15.72:6815/90918","heartbeat_front_addr":"172.21.15.72:6813/90918","state":["exists","up"]},{"osd":7,"uuid":"364c5119-6b13-4c75-b3f0-15e165eff86a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":90948},{"type":"v1","addr":"172.21.15.72:6822","nonce":90948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":90948},{"type":"v1","addr":"172.21.15.72:6826","nonce":90948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":90948},{"type":"v1","addr":"172.21.15.72:6831","nonce":90948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":90948},{"type":"v1","addr":"172.21.15.72:6829","nonce":90948}]},"public_addr":"172.21.15.72:6822/90948","cluster_addr":"172.21.15.72:6826/90948","heartbeat_back_addr":"172.21.15.72:6831/90948","heartbeat_front_addr":"172.21.15.72:6829/90948","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.642976+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.645372+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.619116+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.663042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.599163+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.646411+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.631545+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.669821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.a","mappings":[{"from":1,"to":5}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:41:07.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.526+0000 7f1dcd0ac700 1 -- 172.21.15.71:0/1228428005 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f1da8066f30 msgr2=0x7f1da80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:07.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.526+0000 7f1dcd0ac700 1 --2- 172.21.15.71:0/1228428005 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f1da8066f30 0x7f1da80693e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1dc815a6d0 tx=0x7f1db8008040 comp rx=0 tx=0).stop 2023-10-06T01:41:07.527 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.526+0000 7f1dcd0ac700 1 -- 172.21.15.71:0/1228428005 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1dc80c9350 msgr2=0x7f1dc81436c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:07.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.526+0000 7f1dcd0ac700 1 --2- 172.21.15.71:0/1228428005 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1dc80c9350 0x7f1dc81436c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f1db0000fd0 tx=0x7f1dc80cb5c0 comp rx=0 tx=0).stop 2023-10-06T01:41:07.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.526+0000 7f1dcd0ac700 1 -- 172.21.15.71:0/1228428005 shutdown_connections 2023-10-06T01:41:07.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.526+0000 7f1dcd0ac700 1 --2- 172.21.15.71:0/1228428005 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f1da8066f30 0x7f1da80693e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:07.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.526+0000 7f1dcd0ac700 1 --2- 172.21.15.71:0/1228428005 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1dc8143c00 0x7f1dc80c7400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:07.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.526+0000 7f1dcd0ac700 1 --2- 172.21.15.71:0/1228428005 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1dc8159b80 0x7f1dc8141cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:07.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.526+0000 7f1dcd0ac700 1 --2- 172.21.15.71:0/1228428005 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1dc80c9350 0x7f1dc81436c0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:07.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.526+0000 7f1dcd0ac700 1 -- 172.21.15.71:0/1228428005 >> 172.21.15.71:0/1228428005 conn(0x7f1dc8068680 msgr2=0x7f1dc815c660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:07.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.526+0000 7f1dcd0ac700 1 -- 172.21.15.71:0/1228428005 shutdown_connections 2023-10-06T01:41:07.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.527+0000 7f1dcd0ac700 1 -- 172.21.15.71:0/1228428005 wait complete. 2023-10-06T01:41:07.539 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T01:40:08.610349+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T01:40:15.387434+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T01:40:19.640459+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T01:40:20.116883+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-06T01:40:23.830129+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T01:41:07.539 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T01:41:07.656 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.656+0000 7f9175632700 1 Processor -- start 2023-10-06T01:41:07.656 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.656+0000 7f9175632700 1 -- start start 2023-10-06T01:41:07.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.656+0000 7f9175632700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f91700ccd40 0x7f91700cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:07.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.656+0000 7f9175632700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f91700cf7e0 0x7f91700b3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:07.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.656+0000 7f9175632700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f917015dd40 con 0x7f91700d0400 2023-10-06T01:41:07.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.656+0000 7f9175632700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f917015e020 con 0x7f91700ccd40 2023-10-06T01:41:07.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.656+0000 7f9175632700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91700ceaa0 con 0x7f91700cf7e0 2023-10-06T01:41:07.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.657+0000 7f916effd700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f91700d0400 0x7f91700b5c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:55946/0 (socket says 172.21.15.71:55946) 2023-10-06T01:41:07.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.657+0000 7f916effd700 1 -- 172.21.15.71:0/1611230047 learned_addr learned my addr 172.21.15.71:0/1611230047 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:41:07.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.657+0000 7f916f7fe700 1 --2- 172.21.15.71:0/1611230047 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f91700cf7e0 0x7f91700b3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:07.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.657+0000 7f916e7fc700 1 --2- 172.21.15.71:0/1611230047 >> v2:172.21.15.72:3300/0 conn(0x7f91700ccd40 0x7f91700cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:07.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.657+0000 7f916dffb700 1 -- 172.21.15.71:0/1611230047 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 845165328 0 0) 0x7f917015dd40 con 0x7f91700d0400 2023-10-06T01:41:07.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.657+0000 7f916dffb700 1 -- 172.21.15.71:0/1611230047 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9158003570 con 0x7f91700d0400 2023-10-06T01:41:07.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.657+0000 7f916dffb700 1 -- 172.21.15.71:0/1611230047 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 776055531 0 0) 0x7f9158003570 con 0x7f91700d0400 2023-10-06T01:41:07.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.657+0000 7f916dffb700 1 -- 172.21.15.71:0/1611230047 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f91700cf7e0 msgr2=0x7f91700b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:07.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.657+0000 7f916dffb700 1 --2- 172.21.15.71:0/1611230047 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f91700cf7e0 0x7f91700b3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:07.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.657+0000 7f916dffb700 1 -- 172.21.15.71:0/1611230047 >> v2:172.21.15.72:3300/0 conn(0x7f91700ccd40 msgr2=0x7f91700cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:07.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.657+0000 7f916dffb700 1 --2- 172.21.15.71:0/1611230047 >> v2:172.21.15.72:3300/0 conn(0x7f91700ccd40 0x7f91700cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:07.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.657+0000 7f916dffb700 1 -- 172.21.15.71:0/1611230047 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91700ced80 con 0x7f91700d0400 2023-10-06T01:41:07.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.657+0000 7f916dffb700 1 -- 172.21.15.71:0/1611230047 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1184243524 0 0) 0x7f91600015f0 con 0x7f91700d0400 2023-10-06T01:41:07.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.657+0000 7f916dffb700 1 -- 172.21.15.71:0/1611230047 >> v1:172.21.15.71:6789/0 conn(0x7f91700d0400 legacy=0x7f91700b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:07.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.657+0000 7f916dffb700 1 --2- 172.21.15.71:0/1611230047 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9158003a60 0x7f9158003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:07.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.657+0000 7f916dffb700 1 --2- 172.21.15.71:0/1611230047 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f91700cf7e0 0x7f9158004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:07.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.657+0000 7f916dffb700 1 --2- 172.21.15.71:0/1611230047 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9158004d50 0x7f91580051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:07.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.657+0000 7f916dffb700 1 -- 172.21.15.71:0/1611230047 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f917015e020 con 0x7f9158004d50 2023-10-06T01:41:07.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.657+0000 7f916dffb700 1 -- 172.21.15.71:0/1611230047 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91700ceaa0 con 0x7f9158003a60 2023-10-06T01:41:07.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.657+0000 7f916dffb700 1 -- 172.21.15.71:0/1611230047 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f915800ba60 con 0x7f91700cf7e0 2023-10-06T01:41:07.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.657+0000 7f916e7fc700 1 --2- 172.21.15.71:0/1611230047 >> v2:172.21.15.72:3300/0 conn(0x7f91700ccd40 0x7f91700cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:41:07.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.657+0000 7f916f7fe700 1 --2- 172.21.15.71:0/1611230047 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9158004d50 0x7f91580051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:07.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.657+0000 7f916effd700 1 --2- 172.21.15.71:0/1611230047 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9158003a60 0x7f9158003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:07.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.657+0000 7f916e7fc700 1 --2- 172.21.15.71:0/1611230047 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f91700cf7e0 0x7f9158004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:07.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.658+0000 7f916f7fe700 1 -- 172.21.15.71:0/1611230047 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f91700cf7e0 msgr2=0x7f9158004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:07.662 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.658+0000 7f916f7fe700 1 --2- 172.21.15.71:0/1611230047 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f91700cf7e0 0x7f9158004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:07.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.658+0000 7f916f7fe700 1 -- 172.21.15.71:0/1611230047 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9158003a60 msgr2=0x7f9158003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:07.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.658+0000 7f916f7fe700 1 --2- 172.21.15.71:0/1611230047 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9158003a60 0x7f9158003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:07.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.658+0000 7f916f7fe700 1 -- 172.21.15.71:0/1611230047 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9158003570 con 0x7f9158004d50 2023-10-06T01:41:07.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.658+0000 7f916f7fe700 1 --2- 172.21.15.71:0/1611230047 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9158004d50 0x7f91580051c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f916800e210 tx=0x7f916800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2925bf3c35fd904 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:07.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.658+0000 7f916dffb700 1 -- 172.21.15.71:0/1611230047 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f916800ea60 con 0x7f9158004d50 2023-10-06T01:41:07.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.658+0000 7f916dffb700 1 -- 172.21.15.71:0/1611230047 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f916800f040 con 0x7f9158004d50 2023-10-06T01:41:07.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.658+0000 7f916dffb700 1 -- 172.21.15.71:0/1611230047 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f916800ee10 con 0x7f9158004d50 2023-10-06T01:41:07.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.658+0000 7f9175632700 1 -- 172.21.15.71:0/1611230047 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9158004d50 msgr2=0x7f91580051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:07.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.658+0000 7f9175632700 1 --2- 172.21.15.71:0/1611230047 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9158004d50 0x7f91580051c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f916800e210 tx=0x7f916800b040 comp rx=0 tx=0).stop 2023-10-06T01:41:07.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.658+0000 7f916f7fe700 1 -- 172.21.15.71:0/1611230047 reap_dead start 2023-10-06T01:41:07.663 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.658+0000 7f9175632700 1 -- 172.21.15.71:0/1611230047 shutdown_connections 2023-10-06T01:41:07.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.658+0000 7f9175632700 1 -- 172.21.15.71:0/1611230047 >> 172.21.15.71:0/1611230047 conn(0x7f917006a220 msgr2=0x7f917006a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:07.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.659+0000 7f9175632700 1 -- 172.21.15.71:0/1611230047 shutdown_connections 2023-10-06T01:41:07.664 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.659+0000 7f9175632700 1 -- 172.21.15.71:0/1611230047 wait complete. 2023-10-06T01:41:07.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.660+0000 7f9175632700 1 Processor -- start 2023-10-06T01:41:07.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.660+0000 7f9175632700 1 -- start start 2023-10-06T01:41:07.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.660+0000 7f9175632700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f91700cba90 0x7f917015baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:07.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.660+0000 7f9175632700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91700c5100 0x7f917016b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:07.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.660+0000 7f9175632700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f917016b940 0x7f917016a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:07.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.660+0000 7f9175632700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f917016a1f0 con 0x7f91700cba90 2023-10-06T01:41:07.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.660+0000 7f9175632700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f917016a4d0 con 0x7f91700c5100 2023-10-06T01:41:07.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.661+0000 7f9175632700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91700c5850 con 0x7f917016b940 2023-10-06T01:41:07.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.661+0000 7f916effd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f91700cba90 0x7f917015baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:07.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.661+0000 7f916effd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f91700cba90 0x7f917015baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36202/0 (socket says 172.21.15.71:36202) 2023-10-06T01:41:07.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.661+0000 7f916effd700 1 -- 172.21.15.71:0/1391563386 learned_addr learned my addr 172.21.15.71:0/1391563386 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:07.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.661+0000 7f916e7fc700 1 --2- 172.21.15.71:0/1391563386 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91700c5100 0x7f917016b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:07.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.661+0000 7f916f7fe700 1 --2- 172.21.15.71:0/1391563386 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f917016b940 0x7f917016a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:07.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.661+0000 7f916effd700 1 -- 172.21.15.71:0/1391563386 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f917016b940 msgr2=0x7f917016a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:07.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.661+0000 7f916effd700 1 --2- 172.21.15.71:0/1391563386 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f917016b940 0x7f917016a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:07.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.661+0000 7f916effd700 1 -- 172.21.15.71:0/1391563386 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91700c5100 msgr2=0x7f917016b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:07.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.661+0000 7f916effd700 1 --2- 172.21.15.71:0/1391563386 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91700c5100 0x7f917016b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:07.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.661+0000 7f916effd700 1 -- 172.21.15.71:0/1391563386 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91700c5b30 con 0x7f91700cba90 2023-10-06T01:41:07.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.661+0000 7f916f7fe700 1 --2- 172.21.15.71:0/1391563386 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f917016b940 0x7f917016a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:41:07.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.661+0000 7f916effd700 1 --2- 172.21.15.71:0/1391563386 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f91700cba90 0x7f917015baa0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f916000fc30 tx=0x7f9160009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:07.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.661+0000 7f9156ffd700 1 -- 172.21.15.71:0/1391563386 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91600073b0 con 0x7f91700cba90 2023-10-06T01:41:07.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.661+0000 7f9156ffd700 1 -- 172.21.15.71:0/1391563386 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9160007510 con 0x7f91700cba90 2023-10-06T01:41:07.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.661+0000 7f9175632700 1 -- 172.21.15.71:0/1391563386 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91700c5e10 con 0x7f91700cba90 2023-10-06T01:41:07.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.661+0000 7f9156ffd700 1 -- 172.21.15.71:0/1391563386 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9160005a40 con 0x7f91700cba90 2023-10-06T01:41:07.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.661+0000 7f9175632700 1 -- 172.21.15.71:0/1391563386 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91700cbe60 con 0x7f91700cba90 2023-10-06T01:41:07.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.662+0000 7f9175632700 1 -- 172.21.15.71:0/1391563386 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f917016a7b0 con 0x7f91700cba90 2023-10-06T01:41:07.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.662+0000 7f9156ffd700 1 -- 172.21.15.71:0/1391563386 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f916000d6b0 con 0x7f91700cba90 2023-10-06T01:41:07.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.663+0000 7f9156ffd700 1 --2- 172.21.15.71:0/1391563386 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f915c066f30 0x7f915c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:07.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.663+0000 7f9156ffd700 1 -- 172.21.15.71:0/1391563386 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f9160084cf0 con 0x7f91700cba90 2023-10-06T01:41:07.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.663+0000 7f916e7fc700 1 --2- 172.21.15.71:0/1391563386 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f915c066f30 0x7f915c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:07.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.663+0000 7f916e7fc700 1 --2- 172.21.15.71:0/1391563386 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f915c066f30 0x7f915c0693e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f91640093f0 tx=0x7f9164008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:07.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.667+0000 7f9156ffd700 1 -- 172.21.15.71:0/1391563386 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9160089070 con 0x7f91700cba90 2023-10-06T01:41:07.853 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.852+0000 7f9175632700 1 -- 172.21.15.71:0/1391563386 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f91700c6020 con 0x7f91700cba90 2023-10-06T01:41:07.853 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.853+0000 7f9156ffd700 1 -- 172.21.15.71:0/1391563386 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9160051ad0 con 0x7f91700cba90 2023-10-06T01:41:07.854 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 1 2023-10-06T01:41:07.856 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.855+0000 7f9175632700 1 -- 172.21.15.71:0/1391563386 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f915c066f30 msgr2=0x7f915c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:07.856 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.855+0000 7f9175632700 1 --2- 172.21.15.71:0/1391563386 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f915c066f30 0x7f915c0693e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f91640093f0 tx=0x7f9164008040 comp rx=0 tx=0).stop 2023-10-06T01:41:07.856 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.855+0000 7f9175632700 1 -- 172.21.15.71:0/1391563386 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f91700cba90 msgr2=0x7f917015baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:07.856 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.855+0000 7f9175632700 1 --2- 172.21.15.71:0/1391563386 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f91700cba90 0x7f917015baa0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f916000fc30 tx=0x7f9160009040 comp rx=0 tx=0).stop 2023-10-06T01:41:07.856 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.855+0000 7f9175632700 1 -- 172.21.15.71:0/1391563386 shutdown_connections 2023-10-06T01:41:07.856 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.855+0000 7f9175632700 1 --2- 172.21.15.71:0/1391563386 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f917016b940 0x7f917016a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:07.856 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.855+0000 7f9175632700 1 --2- 172.21.15.71:0/1391563386 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f91700cba90 0x7f917015baa0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:07.857 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.855+0000 7f9175632700 1 --2- 172.21.15.71:0/1391563386 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f915c066f30 0x7f915c0693e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:07.857 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.855+0000 7f9175632700 1 --2- 172.21.15.71:0/1391563386 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91700c5100 0x7f917016b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:07.857 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.855+0000 7f9175632700 1 -- 172.21.15.71:0/1391563386 >> 172.21.15.71:0/1391563386 conn(0x7f917006a220 msgr2=0x7f9170156470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:07.857 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.855+0000 7f9175632700 1 -- 172.21.15.71:0/1391563386 shutdown_connections 2023-10-06T01:41:07.857 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.855+0000 7f9175632700 1 -- 172.21.15.71:0/1391563386 wait complete. 2023-10-06T01:41:07.868 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T01:41:07.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.986+0000 7fb72ee82700 1 Processor -- start 2023-10-06T01:41:07.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.986+0000 7fb72ee82700 1 -- start start 2023-10-06T01:41:07.991 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.987+0000 7fb72ee82700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb7280d0400 0x7fb7280b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:07.991 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.987+0000 7fb72ee82700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7280b6170 con 0x7fb7280d07d0 2023-10-06T01:41:07.991 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.987+0000 7fb72ee82700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb72815dd40 con 0x7fb7280ccd40 2023-10-06T01:41:07.991 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.987+0000 7fb72ee82700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb72815e020 con 0x7fb7280d0400 2023-10-06T01:41:07.991 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.987+0000 7fb72d41f700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fb7280d07d0 0x7fb7280b3aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:55952/0 (socket says 172.21.15.71:55952) 2023-10-06T01:41:07.991 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.987+0000 7fb72d41f700 1 -- 172.21.15.71:0/1487434465 learned_addr learned my addr 172.21.15.71:0/1487434465 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:41:07.991 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.987+0000 7fb72cc1e700 1 --2- 172.21.15.71:0/1487434465 >> v2:172.21.15.72:3300/0 conn(0x7fb7280d0400 0x7fb7280b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:07.991 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.987+0000 7fb7277fe700 1 -- 172.21.15.71:0/1487434465 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 552295677 0 0) 0x7fb7280b6170 con 0x7fb7280d07d0 2023-10-06T01:41:07.992 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.987+0000 7fb7277fe700 1 -- 172.21.15.71:0/1487434465 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb714003570 con 0x7fb7280d07d0 2023-10-06T01:41:07.992 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.988+0000 7fb7277fe700 1 -- 172.21.15.71:0/1487434465 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1467100033 0 0) 0x7fb714003570 con 0x7fb7280d07d0 2023-10-06T01:41:07.992 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.988+0000 7fb7277fe700 1 -- 172.21.15.71:0/1487434465 >> v2:172.21.15.72:3300/0 conn(0x7fb7280d0400 msgr2=0x7fb7280b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:07.992 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.988+0000 7fb7277fe700 1 --2- 172.21.15.71:0/1487434465 >> v2:172.21.15.72:3300/0 conn(0x7fb7280d0400 0x7fb7280b5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:07.992 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.988+0000 7fb7277fe700 1 -- 172.21.15.71:0/1487434465 >> v1:172.21.15.72:6789/0 conn(0x7fb7280ccd40 legacy=0x7fb7280cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:07.992 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.988+0000 7fb7277fe700 1 -- 172.21.15.71:0/1487434465 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7280ceaa0 con 0x7fb7280d07d0 2023-10-06T01:41:07.992 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.988+0000 7fb7277fe700 1 -- 172.21.15.71:0/1487434465 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1184243524 0 0) 0x7fb710001470 con 0x7fb7280d07d0 2023-10-06T01:41:07.992 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.988+0000 7fb7277fe700 1 -- 172.21.15.71:0/1487434465 >> v1:172.21.15.71:6789/0 conn(0x7fb7280d07d0 legacy=0x7fb7280b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:07.992 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.988+0000 7fb7277fe700 1 --2- 172.21.15.71:0/1487434465 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb714003a60 0x7fb714003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:07.992 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.988+0000 7fb7277fe700 1 --2- 172.21.15.71:0/1487434465 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb714004810 0x7fb714004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:07.993 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.988+0000 7fb7277fe700 1 --2- 172.21.15.71:0/1487434465 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb7140051c0 0x7fb71400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:07.993 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.988+0000 7fb7277fe700 1 -- 172.21.15.71:0/1487434465 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb72815e020 con 0x7fb7140051c0 2023-10-06T01:41:07.993 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.988+0000 7fb7277fe700 1 -- 172.21.15.71:0/1487434465 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb71400c0d0 con 0x7fb714004810 2023-10-06T01:41:07.993 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.988+0000 7fb7277fe700 1 -- 172.21.15.71:0/1487434465 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb71400c290 con 0x7fb714003a60 2023-10-06T01:41:07.993 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.988+0000 7fb72d41f700 1 --2- 172.21.15.71:0/1487434465 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb7140051c0 0x7fb71400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:07.993 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.988+0000 7fb72cc1e700 1 --2- 172.21.15.71:0/1487434465 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb714003a60 0x7fb714003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:07.993 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.988+0000 7fb727fff700 1 --2- 172.21.15.71:0/1487434465 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb714004810 0x7fb714004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:07.993 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.988+0000 7fb72d41f700 1 -- 172.21.15.71:0/1487434465 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb714003a60 msgr2=0x7fb714003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:07.993 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.988+0000 7fb72d41f700 1 --2- 172.21.15.71:0/1487434465 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb714003a60 0x7fb714003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:07.994 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.988+0000 7fb72d41f700 1 -- 172.21.15.71:0/1487434465 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb714004810 msgr2=0x7fb714004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:07.994 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.988+0000 7fb72d41f700 1 --2- 172.21.15.71:0/1487434465 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb714004810 0x7fb714004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:07.994 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.988+0000 7fb72d41f700 1 -- 172.21.15.71:0/1487434465 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb714003570 con 0x7fb7140051c0 2023-10-06T01:41:07.994 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.988+0000 7fb72d41f700 1 -- 172.21.15.71:0/1487434465 reap_dead start 2023-10-06T01:41:07.994 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.988+0000 7fb72d41f700 1 --2- 172.21.15.71:0/1487434465 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb7140051c0 0x7fb71400ba60 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fb71000c3c0 tx=0x7fb710001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8aebc7004efee00a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:07.994 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.988+0000 7fb7277fe700 1 -- 172.21.15.71:0/1487434465 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb71000cc90 con 0x7fb7140051c0 2023-10-06T01:41:07.994 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.988+0000 7fb7277fe700 1 -- 172.21.15.71:0/1487434465 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb71000ce10 con 0x7fb7140051c0 2023-10-06T01:41:07.994 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.988+0000 7fb7277fe700 1 -- 172.21.15.71:0/1487434465 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb710005b70 con 0x7fb7140051c0 2023-10-06T01:41:07.994 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.989+0000 7fb72ee82700 1 -- 172.21.15.71:0/1487434465 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb7140051c0 msgr2=0x7fb71400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:07.994 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.989+0000 7fb72ee82700 1 --2- 172.21.15.71:0/1487434465 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb7140051c0 0x7fb71400ba60 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fb71000c3c0 tx=0x7fb710001e50 comp rx=0 tx=0).stop 2023-10-06T01:41:07.994 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.989+0000 7fb72ee82700 1 -- 172.21.15.71:0/1487434465 shutdown_connections 2023-10-06T01:41:07.995 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.989+0000 7fb72ee82700 1 --2- 172.21.15.71:0/1487434465 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb7140051c0 0x7fb71400ba60 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:07.995 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.989+0000 7fb72ee82700 1 -- 172.21.15.71:0/1487434465 >> 172.21.15.71:0/1487434465 conn(0x7fb72806a220 msgr2=0x7fb72806a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:07.995 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.989+0000 7fb72ee82700 1 -- 172.21.15.71:0/1487434465 shutdown_connections 2023-10-06T01:41:07.995 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.989+0000 7fb72ee82700 1 -- 172.21.15.71:0/1487434465 wait complete. 2023-10-06T01:41:07.995 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.990+0000 7fb72ee82700 1 Processor -- start 2023-10-06T01:41:07.995 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.990+0000 7fb72ee82700 1 -- start start 2023-10-06T01:41:07.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.991+0000 7fb72ee82700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb7140051c0 0x7fb728153de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:07.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.991+0000 7fb72ee82700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb72816d4e0 0x7fb72816d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:07.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.991+0000 7fb72ee82700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb72814ecc0 0x7fb72814f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:07.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.991+0000 7fb72ee82700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb72814c940 con 0x7fb7140051c0 2023-10-06T01:41:07.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.991+0000 7fb72ee82700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb72816de90 con 0x7fb72816d4e0 2023-10-06T01:41:07.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.991+0000 7fb72ee82700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb728150310 con 0x7fb72814ecc0 2023-10-06T01:41:07.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.991+0000 7fb72cc1e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb7140051c0 0x7fb728153de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:07.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.991+0000 7fb72cc1e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb7140051c0 0x7fb728153de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36220/0 (socket says 172.21.15.71:36220) 2023-10-06T01:41:07.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.991+0000 7fb72cc1e700 1 -- 172.21.15.71:0/1940264175 learned_addr learned my addr 172.21.15.71:0/1940264175 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:07.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.991+0000 7fb727fff700 1 --2- 172.21.15.71:0/1940264175 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb72816d4e0 0x7fb72816d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:07.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.991+0000 7fb72d41f700 1 --2- 172.21.15.71:0/1940264175 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb72814ecc0 0x7fb72814f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:07.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.991+0000 7fb72cc1e700 1 -- 172.21.15.71:0/1940264175 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb72814ecc0 msgr2=0x7fb72814f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:07.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.991+0000 7fb72cc1e700 1 --2- 172.21.15.71:0/1940264175 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb72814ecc0 0x7fb72814f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:07.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.991+0000 7fb72cc1e700 1 -- 172.21.15.71:0/1940264175 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb72816d4e0 msgr2=0x7fb72816d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:07.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.991+0000 7fb72cc1e700 1 --2- 172.21.15.71:0/1940264175 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb72816d4e0 0x7fb72816d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:07.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.991+0000 7fb72cc1e700 1 -- 172.21.15.71:0/1940264175 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb72816b270 con 0x7fb7140051c0 2023-10-06T01:41:07.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.991+0000 7fb72d41f700 1 --2- 172.21.15.71:0/1940264175 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb72814ecc0 0x7fb72814f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:41:07.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.992+0000 7fb72cc1e700 1 --2- 172.21.15.71:0/1940264175 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb7140051c0 0x7fb728153de0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fb720011f30 tx=0x7fb72000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:07.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.992+0000 7fb724ff9700 1 -- 172.21.15.71:0/1940264175 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72000e040 con 0x7fb7140051c0 2023-10-06T01:41:07.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.992+0000 7fb724ff9700 1 -- 172.21.15.71:0/1940264175 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb72000f040 con 0x7fb7140051c0 2023-10-06T01:41:07.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.992+0000 7fb724ff9700 1 -- 172.21.15.71:0/1940264175 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb720015430 con 0x7fb7140051c0 2023-10-06T01:41:08.000 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.992+0000 7fb72ee82700 1 -- 172.21.15.71:0/1940264175 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb72814fa70 con 0x7fb7140051c0 2023-10-06T01:41:08.000 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.992+0000 7fb72ee82700 1 -- 172.21.15.71:0/1940264175 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb728150030 con 0x7fb7140051c0 2023-10-06T01:41:08.000 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.993+0000 7fb72ee82700 1 -- 172.21.15.71:0/1940264175 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb728088760 con 0x7fb7140051c0 2023-10-06T01:41:08.000 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.993+0000 7fb724ff9700 1 -- 172.21.15.71:0/1940264175 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb720015860 con 0x7fb7140051c0 2023-10-06T01:41:08.000 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.993+0000 7fb724ff9700 1 --2- 172.21.15.71:0/1940264175 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fb708066f30 0x7fb7080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:08.000 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.993+0000 7fb724ff9700 1 -- 172.21.15.71:0/1940264175 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6867+0+0 (secure 0 0 0) 0x7fb7200856d0 con 0x7fb7140051c0 2023-10-06T01:41:08.000 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.993+0000 7fb727fff700 1 --2- 172.21.15.71:0/1940264175 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fb708066f30 0x7fb7080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:08.000 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.994+0000 7fb727fff700 1 --2- 172.21.15.71:0/1940264175 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fb708066f30 0x7fb7080693e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb728150600 tx=0x7fb718009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:08.000 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:07.997+0000 7fb724ff9700 1 -- 172.21.15.71:0/1940264175 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb7200524b0 con 0x7fb7140051c0 2023-10-06T01:41:08.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.178+0000 7fb72ee82700 1 -- 172.21.15.71:0/1940264175 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb72816b550 con 0x7fb7140051c0 2023-10-06T01:41:08.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.178+0000 7fb724ff9700 1 -- 172.21.15.71:0/1940264175 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb720055ad0 con 0x7fb7140051c0 2023-10-06T01:41:08.179 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 8 2023-10-06T01:41:08.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.180+0000 7fb72ee82700 1 -- 172.21.15.71:0/1940264175 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fb708066f30 msgr2=0x7fb7080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:08.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.180+0000 7fb72ee82700 1 --2- 172.21.15.71:0/1940264175 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fb708066f30 0x7fb7080693e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb728150600 tx=0x7fb718009040 comp rx=0 tx=0).stop 2023-10-06T01:41:08.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.180+0000 7fb72ee82700 1 -- 172.21.15.71:0/1940264175 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb7140051c0 msgr2=0x7fb728153de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:08.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.180+0000 7fb72ee82700 1 --2- 172.21.15.71:0/1940264175 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb7140051c0 0x7fb728153de0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fb720011f30 tx=0x7fb72000b040 comp rx=0 tx=0).stop 2023-10-06T01:41:08.181 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.180+0000 7fb72ee82700 1 -- 172.21.15.71:0/1940264175 shutdown_connections 2023-10-06T01:41:08.182 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.180+0000 7fb72ee82700 1 --2- 172.21.15.71:0/1940264175 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb72814ecc0 0x7fb72814f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:08.182 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.180+0000 7fb72ee82700 1 --2- 172.21.15.71:0/1940264175 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb7140051c0 0x7fb728153de0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:08.182 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.180+0000 7fb72ee82700 1 --2- 172.21.15.71:0/1940264175 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fb708066f30 0x7fb7080693e0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:08.182 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.180+0000 7fb72ee82700 1 --2- 172.21.15.71:0/1940264175 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb72816d4e0 0x7fb72816d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:08.182 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.180+0000 7fb72ee82700 1 -- 172.21.15.71:0/1940264175 >> 172.21.15.71:0/1940264175 conn(0x7fb72806a220 msgr2=0x7fb72814d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:08.182 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.180+0000 7fb72ee82700 1 -- 172.21.15.71:0/1940264175 shutdown_connections 2023-10-06T01:41:08.182 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.180+0000 7fb72ee82700 1 -- 172.21.15.71:0/1940264175 wait complete. 2023-10-06T01:41:08.193 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T01:41:08.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.309+0000 7efdf2783700 1 Processor -- start 2023-10-06T01:41:08.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.309+0000 7efdf2783700 1 -- start start 2023-10-06T01:41:08.312 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.310+0000 7efdf2783700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7efdec0ccd40 0x7efdec0cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:08.312 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.310+0000 7efdf2783700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdec15dd40 con 0x7efdec0d0400 2023-10-06T01:41:08.312 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.310+0000 7efdf2783700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdec15e020 con 0x7efdec0cf7e0 2023-10-06T01:41:08.312 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.310+0000 7efdf2783700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdec0ceaa0 con 0x7efdec0ccd40 2023-10-06T01:41:08.312 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.310+0000 7efdebfff700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7efdec0d0400 0x7efdec0b5c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:55964/0 (socket says 172.21.15.71:55964) 2023-10-06T01:41:08.312 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.310+0000 7efdebfff700 1 -- 172.21.15.71:0/1001877371 learned_addr learned my addr 172.21.15.71:0/1001877371 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:41:08.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.310+0000 7efdeb7fe700 1 --2- 172.21.15.71:0/1001877371 >> v2:172.21.15.71:3300/0 conn(0x7efdec0ccd40 0x7efdec0cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:08.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.310+0000 7efdeb7fe700 1 -- 172.21.15.71:0/1001877371 >> v1:172.21.15.72:6789/0 conn(0x7efdec0cf7e0 legacy=0x7efdec0b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:08.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.310+0000 7efdeb7fe700 1 -- 172.21.15.71:0/1001877371 >> v1:172.21.15.71:6789/0 conn(0x7efdec0d0400 legacy=0x7efdec0b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:08.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.310+0000 7efdeb7fe700 1 -- 172.21.15.71:0/1001877371 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdec0ced80 con 0x7efdec0ccd40 2023-10-06T01:41:08.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.310+0000 7efdeaffd700 1 -- 172.21.15.71:0/1001877371 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2465704102 0 0) 0x7efdec15dd40 con 0x7efdec0d0400 2023-10-06T01:41:08.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.311+0000 7efdeb7fe700 1 --2- 172.21.15.71:0/1001877371 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efdec0ccd40 0x7efdec0cf2a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7efde00098e0 tx=0x7efde00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd3c42da89a4f88d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:08.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.311+0000 7efdeaffd700 1 -- 172.21.15.71:0/1001877371 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde0009e80 con 0x7efdec0ccd40 2023-10-06T01:41:08.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.311+0000 7efdeaffd700 1 -- 172.21.15.71:0/1001877371 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efde000b820 con 0x7efdec0ccd40 2023-10-06T01:41:08.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.311+0000 7efdeaffd700 1 -- 172.21.15.71:0/1001877371 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde000bba0 con 0x7efdec0ccd40 2023-10-06T01:41:08.314 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.311+0000 7efdf2783700 1 -- 172.21.15.71:0/1001877371 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efdec0ccd40 msgr2=0x7efdec0cf2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:08.314 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.311+0000 7efdf2783700 1 --2- 172.21.15.71:0/1001877371 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efdec0ccd40 0x7efdec0cf2a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7efde00098e0 tx=0x7efde00091a0 comp rx=0 tx=0).stop 2023-10-06T01:41:08.314 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.311+0000 7efdf2783700 1 -- 172.21.15.71:0/1001877371 shutdown_connections 2023-10-06T01:41:08.314 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.311+0000 7efdf2783700 1 --2- 172.21.15.71:0/1001877371 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efdec0ccd40 0x7efdec0cf2a0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:08.314 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.311+0000 7efdf2783700 1 -- 172.21.15.71:0/1001877371 >> 172.21.15.71:0/1001877371 conn(0x7efdec06a220 msgr2=0x7efdec06a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:08.314 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.311+0000 7efdf2783700 1 -- 172.21.15.71:0/1001877371 shutdown_connections 2023-10-06T01:41:08.314 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.311+0000 7efdf2783700 1 -- 172.21.15.71:0/1001877371 wait complete. 2023-10-06T01:41:08.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.312+0000 7efdf2783700 1 Processor -- start 2023-10-06T01:41:08.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.313+0000 7efdf2783700 1 -- start start 2023-10-06T01:41:08.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.313+0000 7efdf2783700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efdec0ccd40 0x7efdec16d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:08.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.313+0000 7efdf2783700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efdec0cf7e0 0x7efdec16d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:08.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.313+0000 7efdf2783700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efdec0d0400 0x7efdec14d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:08.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.313+0000 7efdf2783700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdec13cae0 con 0x7efdec0cf7e0 2023-10-06T01:41:08.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.313+0000 7efdf2783700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdec0b2680 con 0x7efdec0ccd40 2023-10-06T01:41:08.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.313+0000 7efdf2783700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdec16af30 con 0x7efdec0d0400 2023-10-06T01:41:08.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.313+0000 7efdeb7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efdec0cf7e0 0x7efdec16d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:08.318 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.313+0000 7efdeb7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efdec0cf7e0 0x7efdec16d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36244/0 (socket says 172.21.15.71:36244) 2023-10-06T01:41:08.318 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.313+0000 7efdeb7fe700 1 -- 172.21.15.71:0/2964145937 learned_addr learned my addr 172.21.15.71:0/2964145937 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:08.318 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.314+0000 7efdeb7fe700 1 -- 172.21.15.71:0/2964145937 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efdec0d0400 msgr2=0x7efdec14d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:08.318 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.314+0000 7efdebfff700 1 --2- 172.21.15.71:0/2964145937 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efdec0ccd40 0x7efdec16d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:08.318 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.314+0000 7efdf0d20700 1 --2- 172.21.15.71:0/2964145937 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efdec0d0400 0x7efdec14d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:08.318 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.314+0000 7efdeb7fe700 1 --2- 172.21.15.71:0/2964145937 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efdec0d0400 0x7efdec14d7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:08.318 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.314+0000 7efdeb7fe700 1 -- 172.21.15.71:0/2964145937 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efdec0ccd40 msgr2=0x7efdec16d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:08.318 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.314+0000 7efdeb7fe700 1 --2- 172.21.15.71:0/2964145937 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efdec0ccd40 0x7efdec16d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:08.318 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.314+0000 7efdeb7fe700 1 -- 172.21.15.71:0/2964145937 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efde0009420 con 0x7efdec0cf7e0 2023-10-06T01:41:08.318 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.314+0000 7efdeb7fe700 1 --2- 172.21.15.71:0/2964145937 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efdec0cf7e0 0x7efdec16d770 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7efde00030c0 tx=0x7efde0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:08.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.314+0000 7efdd3fff700 1 -- 172.21.15.71:0/2964145937 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde000bae0 con 0x7efdec0cf7e0 2023-10-06T01:41:08.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.314+0000 7efdd3fff700 1 -- 172.21.15.71:0/2964145937 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efde0020070 con 0x7efdec0cf7e0 2023-10-06T01:41:08.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.314+0000 7efdf2783700 1 -- 172.21.15.71:0/2964145937 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdec0b23a0 con 0x7efdec0cf7e0 2023-10-06T01:41:08.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.314+0000 7efdd3fff700 1 -- 172.21.15.71:0/2964145937 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde001b6a0 con 0x7efdec0cf7e0 2023-10-06T01:41:08.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.314+0000 7efdf2783700 1 -- 172.21.15.71:0/2964145937 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdec16b4b0 con 0x7efdec0cf7e0 2023-10-06T01:41:08.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.315+0000 7efdf2783700 1 -- 172.21.15.71:0/2964145937 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdec16b6a0 con 0x7efdec0cf7e0 2023-10-06T01:41:08.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.315+0000 7efdd3fff700 1 -- 172.21.15.71:0/2964145937 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efde0022030 con 0x7efdec0cf7e0 2023-10-06T01:41:08.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.316+0000 7efdd3fff700 1 --2- 172.21.15.71:0/2964145937 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7efdd8066f60 0x7efdd8069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:08.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.316+0000 7efdd3fff700 1 -- 172.21.15.71:0/2964145937 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6867+0+0 (secure 0 0 0) 0x7efde00869a0 con 0x7efdec0cf7e0 2023-10-06T01:41:08.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.316+0000 7efdebfff700 1 --2- 172.21.15.71:0/2964145937 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7efdd8066f60 0x7efdd8069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:08.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.316+0000 7efdebfff700 1 --2- 172.21.15.71:0/2964145937 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7efdd8066f60 0x7efdd8069410 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7efdec16adb0 tx=0x7efddc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:08.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.320+0000 7efdd3fff700 1 -- 172.21.15.71:0/2964145937 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efde0053780 con 0x7efdec0cf7e0 2023-10-06T01:41:08.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.500+0000 7efdf2783700 1 -- 172.21.15.71:0/2964145937 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7efdec16b6a0 con 0x7efdec0cf7e0 2023-10-06T01:41:08.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.500+0000 7efdd3fff700 1 -- 172.21.15.71:0/2964145937 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7efde0056da0 con 0x7efdec0cf7e0 2023-10-06T01:41:08.501 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 32 2023-10-06T01:41:08.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.502+0000 7efdf2783700 1 -- 172.21.15.71:0/2964145937 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7efdd8066f60 msgr2=0x7efdd8069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:08.504 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.502+0000 7efdf2783700 1 --2- 172.21.15.71:0/2964145937 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7efdd8066f60 0x7efdd8069410 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7efdec16adb0 tx=0x7efddc009040 comp rx=0 tx=0).stop 2023-10-06T01:41:08.504 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.502+0000 7efdf2783700 1 -- 172.21.15.71:0/2964145937 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efdec0cf7e0 msgr2=0x7efdec16d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:08.504 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.502+0000 7efdf2783700 1 --2- 172.21.15.71:0/2964145937 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efdec0cf7e0 0x7efdec16d770 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7efde00030c0 tx=0x7efde0016000 comp rx=0 tx=0).stop 2023-10-06T01:41:08.504 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.502+0000 7efdf2783700 1 -- 172.21.15.71:0/2964145937 shutdown_connections 2023-10-06T01:41:08.504 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.502+0000 7efdf2783700 1 --2- 172.21.15.71:0/2964145937 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efdec0d0400 0x7efdec14d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:08.504 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.502+0000 7efdf2783700 1 --2- 172.21.15.71:0/2964145937 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7efdd8066f60 0x7efdd8069410 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:08.504 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.502+0000 7efdf2783700 1 --2- 172.21.15.71:0/2964145937 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efdec0ccd40 0x7efdec16d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:08.504 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.502+0000 7efdf2783700 1 --2- 172.21.15.71:0/2964145937 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efdec0cf7e0 0x7efdec16d770 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:08.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.502+0000 7efdf2783700 1 -- 172.21.15.71:0/2964145937 >> 172.21.15.71:0/2964145937 conn(0x7efdec06a220 msgr2=0x7efdec0b4910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:08.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.502+0000 7efdf2783700 1 -- 172.21.15.71:0/2964145937 shutdown_connections 2023-10-06T01:41:08.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.502+0000 7efdf2783700 1 -- 172.21.15.71:0/2964145937 wait complete. 2023-10-06T01:41:08.515 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T01:41:08.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.632+0000 7f14ad99e700 1 Processor -- start 2023-10-06T01:41:08.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.632+0000 7f14ad99e700 1 -- start start 2023-10-06T01:41:08.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.633+0000 7f14ad99e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f14a80b0810 0x7f14a8164160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:08.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.633+0000 7f14ad99e700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14a80af770 con 0x7f14a80cd400 2023-10-06T01:41:08.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.633+0000 7f14ad99e700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14a80afa50 con 0x7f14a80cd7d0 2023-10-06T01:41:08.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.633+0000 7f14ad99e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14a80afd30 con 0x7f14a80b0810 2023-10-06T01:41:08.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.633+0000 7f14ac99c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f14a80cd400 0x7f14a80b1f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:55970/0 (socket says 172.21.15.71:55970) 2023-10-06T01:41:08.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.633+0000 7f14ac99c700 1 -- 172.21.15.71:0/3442504086 learned_addr learned my addr 172.21.15.71:0/3442504086 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:41:08.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.633+0000 7f149f7fe700 1 -- 172.21.15.71:0/3442504086 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2275600436 0 0) 0x7f14a80af770 con 0x7f14a80cd400 2023-10-06T01:41:08.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.633+0000 7f149f7fe700 1 -- 172.21.15.71:0/3442504086 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1490003570 con 0x7f14a80cd400 2023-10-06T01:41:08.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.633+0000 7f14ad19d700 1 --2- 172.21.15.71:0/3442504086 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f14a80b0810 0x7f14a8164160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:08.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.634+0000 7f149f7fe700 1 -- 172.21.15.71:0/3442504086 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3891950047 0 0) 0x7f1490003570 con 0x7f14a80cd400 2023-10-06T01:41:08.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.634+0000 7f149f7fe700 1 -- 172.21.15.71:0/3442504086 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f14a80b0810 msgr2=0x7f14a8164160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:08.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.634+0000 7f149f7fe700 1 --2- 172.21.15.71:0/3442504086 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f14a80b0810 0x7f14a8164160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:08.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.634+0000 7f149f7fe700 1 -- 172.21.15.71:0/3442504086 >> v1:172.21.15.72:6789/0 conn(0x7f14a80cd7d0 legacy=0x7f14a80d01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:08.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.634+0000 7f149f7fe700 1 -- 172.21.15.71:0/3442504086 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14a80b0010 con 0x7f14a80cd400 2023-10-06T01:41:08.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.634+0000 7f149f7fe700 1 -- 172.21.15.71:0/3442504086 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1184243524 0 0) 0x7f14a40015f0 con 0x7f14a80cd400 2023-10-06T01:41:08.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.634+0000 7f149f7fe700 1 -- 172.21.15.71:0/3442504086 >> v1:172.21.15.71:6789/0 conn(0x7f14a80cd400 legacy=0x7f14a80b1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:08.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.634+0000 7f149f7fe700 1 --2- 172.21.15.71:0/3442504086 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f14a80b0810 0x7f1490003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:08.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.634+0000 7f149f7fe700 1 --2- 172.21.15.71:0/3442504086 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f14900040c0 0x7f1490004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:08.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.634+0000 7f149f7fe700 1 --2- 172.21.15.71:0/3442504086 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1490004da0 0x7f14900051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:08.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.634+0000 7f149f7fe700 1 -- 172.21.15.71:0/3442504086 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14a80afd30 con 0x7f14900040c0 2023-10-06T01:41:08.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.634+0000 7f149f7fe700 1 -- 172.21.15.71:0/3442504086 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f149000bd10 con 0x7f1490004da0 2023-10-06T01:41:08.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.634+0000 7f149f7fe700 1 -- 172.21.15.71:0/3442504086 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f149000bed0 con 0x7f14a80b0810 2023-10-06T01:41:08.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.634+0000 7f149ffff700 1 --2- 172.21.15.71:0/3442504086 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f14900040c0 0x7f1490004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:08.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.634+0000 7f14ac99c700 1 --2- 172.21.15.71:0/3442504086 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f14a80b0810 0x7f1490003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:08.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.634+0000 7f14ad19d700 1 --2- 172.21.15.71:0/3442504086 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1490004da0 0x7f14900051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:08.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.634+0000 7f149ffff700 1 -- 172.21.15.71:0/3442504086 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f14a80b0810 msgr2=0x7f1490003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:08.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.634+0000 7f149ffff700 1 --2- 172.21.15.71:0/3442504086 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f14a80b0810 0x7f1490003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:08.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.634+0000 7f149ffff700 1 -- 172.21.15.71:0/3442504086 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1490004da0 msgr2=0x7f14900051f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:08.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.634+0000 7f149ffff700 1 --2- 172.21.15.71:0/3442504086 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1490004da0 0x7f14900051f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:08.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.634+0000 7f149ffff700 1 -- 172.21.15.71:0/3442504086 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1490003570 con 0x7f14900040c0 2023-10-06T01:41:08.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.634+0000 7f149ffff700 1 --2- 172.21.15.71:0/3442504086 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f14900040c0 0x7f1490004810 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f1498001880 tx=0x7f1498007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0614f5587bd1573 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:08.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.634+0000 7f149f7fe700 1 -- 172.21.15.71:0/3442504086 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1498012420 con 0x7f14900040c0 2023-10-06T01:41:08.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.634+0000 7f149f7fe700 1 -- 172.21.15.71:0/3442504086 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1498012580 con 0x7f14900040c0 2023-10-06T01:41:08.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.634+0000 7f149f7fe700 1 -- 172.21.15.71:0/3442504086 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1498012920 con 0x7f14900040c0 2023-10-06T01:41:08.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.635+0000 7f14ad99e700 1 -- 172.21.15.71:0/3442504086 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f14900040c0 msgr2=0x7f1490004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:08.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.635+0000 7f14ad99e700 1 --2- 172.21.15.71:0/3442504086 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f14900040c0 0x7f1490004810 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f1498001880 tx=0x7f1498007d30 comp rx=0 tx=0).stop 2023-10-06T01:41:08.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.635+0000 7f14ad19d700 1 -- 172.21.15.71:0/3442504086 reap_dead start 2023-10-06T01:41:08.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.635+0000 7f14ad99e700 1 -- 172.21.15.71:0/3442504086 shutdown_connections 2023-10-06T01:41:08.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.635+0000 7f14ad99e700 1 -- 172.21.15.71:0/3442504086 >> 172.21.15.71:0/3442504086 conn(0x7f14a806a110 msgr2=0x7f14a806a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:08.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.635+0000 7f14ad99e700 1 -- 172.21.15.71:0/3442504086 shutdown_connections 2023-10-06T01:41:08.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.635+0000 7f14ad99e700 1 -- 172.21.15.71:0/3442504086 wait complete. 2023-10-06T01:41:08.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.636+0000 7f14ad99e700 1 Processor -- start 2023-10-06T01:41:08.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.636+0000 7f14ad99e700 1 -- start start 2023-10-06T01:41:08.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.637+0000 7f14ad99e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f14900040c0 0x7f14a8158fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:08.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.637+0000 7f14ad99e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14a80c46d0 0x7f14a815ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:08.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.637+0000 7f14ad99e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f14a80cec30 0x7f14a80cf0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:08.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.637+0000 7f14ad99e700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14a8152990 con 0x7f14a80cec30 2023-10-06T01:41:08.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.637+0000 7f14ad99e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14a815f4d0 con 0x7f14a80c46d0 2023-10-06T01:41:08.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.637+0000 7f14ad99e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14a80cf5e0 con 0x7f14900040c0 2023-10-06T01:41:08.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.637+0000 7f14ad19d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f14a80cec30 0x7f14a80cf0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:08.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.637+0000 7f14ad19d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f14a80cec30 0x7f14a80cf0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36266/0 (socket says 172.21.15.71:36266) 2023-10-06T01:41:08.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.637+0000 7f14ad19d700 1 -- 172.21.15.71:0/3181011400 learned_addr learned my addr 172.21.15.71:0/3181011400 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:08.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.637+0000 7f14ac99c700 1 --2- 172.21.15.71:0/3181011400 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f14900040c0 0x7f14a8158fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:08.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.637+0000 7f149ffff700 1 --2- 172.21.15.71:0/3181011400 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14a80c46d0 0x7f14a815ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:08.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.637+0000 7f14ad19d700 1 -- 172.21.15.71:0/3181011400 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f14900040c0 msgr2=0x7f14a8158fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:08.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.637+0000 7f14ad19d700 1 --2- 172.21.15.71:0/3181011400 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f14900040c0 0x7f14a8158fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:08.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.637+0000 7f14ad19d700 1 -- 172.21.15.71:0/3181011400 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14a80c46d0 msgr2=0x7f14a815ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:08.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.637+0000 7f14ad19d700 1 --2- 172.21.15.71:0/3181011400 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14a80c46d0 0x7f14a815ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:08.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.637+0000 7f14ad19d700 1 -- 172.21.15.71:0/3181011400 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14a815f700 con 0x7f14a80cec30 2023-10-06T01:41:08.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.637+0000 7f14ad19d700 1 --2- 172.21.15.71:0/3181011400 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f14a80cec30 0x7f14a80cf0a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f14a80d0090 tx=0x7f14a0009730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:08.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.638+0000 7f149cff9700 1 -- 172.21.15.71:0/3181011400 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a0010c90 con 0x7f14a80cec30 2023-10-06T01:41:08.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.638+0000 7f149cff9700 1 -- 172.21.15.71:0/3181011400 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14a0010df0 con 0x7f14a80cec30 2023-10-06T01:41:08.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.638+0000 7f14ad99e700 1 -- 172.21.15.71:0/3181011400 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14a80c3bf0 con 0x7f14a80cec30 2023-10-06T01:41:08.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.638+0000 7f149cff9700 1 -- 172.21.15.71:0/3181011400 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a0017680 con 0x7f14a80cec30 2023-10-06T01:41:08.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.638+0000 7f14ad99e700 1 -- 172.21.15.71:0/3181011400 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14a80c41b0 con 0x7f14a80cec30 2023-10-06T01:41:08.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.638+0000 7f14ad99e700 1 -- 172.21.15.71:0/3181011400 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14a80c43d0 con 0x7f14a80cec30 2023-10-06T01:41:08.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.639+0000 7f149cff9700 1 -- 172.21.15.71:0/3181011400 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f14a0017a70 con 0x7f14a80cec30 2023-10-06T01:41:08.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.639+0000 7f149cff9700 1 --2- 172.21.15.71:0/3181011400 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f1494066f30 0x7f14940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:08.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.639+0000 7f14ac99c700 1 --2- 172.21.15.71:0/3181011400 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f1494066f30 0x7f14940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:08.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.639+0000 7f149cff9700 1 -- 172.21.15.71:0/3181011400 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f14a0085900 con 0x7f14a80cec30 2023-10-06T01:41:08.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.640+0000 7f14ac99c700 1 --2- 172.21.15.71:0/3181011400 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f1494066f30 0x7f14940693e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f14a40010e0 tx=0x7f14a4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:08.646 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.644+0000 7f149cff9700 1 -- 172.21.15.71:0/3181011400 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f14a00526e0 con 0x7f14a80cec30 2023-10-06T01:41:08.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.826+0000 7f14ad99e700 1 -- 172.21.15.71:0/3181011400 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f14a8064aa0 con 0x7f14a80cec30 2023-10-06T01:41:08.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.826+0000 7f149cff9700 1 -- 172.21.15.71:0/3181011400 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f14a0055d00 con 0x7f14a80cec30 2023-10-06T01:41:08.827 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 64 2023-10-06T01:41:08.829 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.828+0000 7f14ad99e700 1 -- 172.21.15.71:0/3181011400 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f1494066f30 msgr2=0x7f14940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:08.829 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.828+0000 7f14ad99e700 1 --2- 172.21.15.71:0/3181011400 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f1494066f30 0x7f14940693e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f14a40010e0 tx=0x7f14a4009040 comp rx=0 tx=0).stop 2023-10-06T01:41:08.829 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.828+0000 7f14ad99e700 1 -- 172.21.15.71:0/3181011400 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f14a80cec30 msgr2=0x7f14a80cf0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:08.829 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.828+0000 7f14ad99e700 1 --2- 172.21.15.71:0/3181011400 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f14a80cec30 0x7f14a80cf0a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f14a80d0090 tx=0x7f14a0009730 comp rx=0 tx=0).stop 2023-10-06T01:41:08.829 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.828+0000 7f14ad99e700 1 -- 172.21.15.71:0/3181011400 shutdown_connections 2023-10-06T01:41:08.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.828+0000 7f14ad99e700 1 --2- 172.21.15.71:0/3181011400 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f14a80cec30 0x7f14a80cf0a0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:08.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.828+0000 7f14ad99e700 1 --2- 172.21.15.71:0/3181011400 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f14900040c0 0x7f14a8158fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:08.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.828+0000 7f14ad99e700 1 --2- 172.21.15.71:0/3181011400 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f1494066f30 0x7f14940693e0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:08.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.828+0000 7f14ad99e700 1 --2- 172.21.15.71:0/3181011400 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14a80c46d0 0x7f14a815ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:08.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.828+0000 7f14ad99e700 1 -- 172.21.15.71:0/3181011400 >> 172.21.15.71:0/3181011400 conn(0x7f14a806a110 msgr2=0x7f14a8152ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:08.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.828+0000 7f14ad99e700 1 -- 172.21.15.71:0/3181011400 shutdown_connections 2023-10-06T01:41:08.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.828+0000 7f14ad99e700 1 -- 172.21.15.71:0/3181011400 wait complete. 2023-10-06T01:41:08.842 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-06T01:41:08.958 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.958+0000 7fd482053700 1 Processor -- start 2023-10-06T01:41:08.959 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.958+0000 7fd482053700 1 -- start start 2023-10-06T01:41:08.962 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.959+0000 7fd482053700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd47c0ccd40 0x7fd47c0cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:08.962 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.959+0000 7fd482053700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd47c15dd40 con 0x7fd47c0cf7e0 2023-10-06T01:41:08.962 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.959+0000 7fd482053700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd47c15e020 con 0x7fd47c0d0400 2023-10-06T01:41:08.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.959+0000 7fd482053700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd47c0ceaa0 con 0x7fd47c0ccd40 2023-10-06T01:41:08.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.959+0000 7fd47bfff700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fd47c0cf7e0 0x7fd47c0b3aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:55980/0 (socket says 172.21.15.71:55980) 2023-10-06T01:41:08.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.959+0000 7fd47bfff700 1 -- 172.21.15.71:0/2358661898 learned_addr learned my addr 172.21.15.71:0/2358661898 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:41:08.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.959+0000 7fd47affd700 1 --2- 172.21.15.71:0/2358661898 >> v2:172.21.15.72:3300/0 conn(0x7fd47c0ccd40 0x7fd47c0cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:08.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.959+0000 7fd47a7fc700 1 -- 172.21.15.71:0/2358661898 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 591552416 0 0) 0x7fd47c15dd40 con 0x7fd47c0cf7e0 2023-10-06T01:41:08.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.959+0000 7fd47a7fc700 1 -- 172.21.15.71:0/2358661898 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd468003570 con 0x7fd47c0cf7e0 2023-10-06T01:41:08.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.959+0000 7fd47a7fc700 1 -- 172.21.15.71:0/2358661898 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3008815877 0 0) 0x7fd468003570 con 0x7fd47c0cf7e0 2023-10-06T01:41:08.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.959+0000 7fd47a7fc700 1 -- 172.21.15.71:0/2358661898 >> v2:172.21.15.72:3300/0 conn(0x7fd47c0ccd40 msgr2=0x7fd47c0cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:08.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.959+0000 7fd47a7fc700 1 --2- 172.21.15.71:0/2358661898 >> v2:172.21.15.72:3300/0 conn(0x7fd47c0ccd40 0x7fd47c0cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:08.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.959+0000 7fd47a7fc700 1 -- 172.21.15.71:0/2358661898 >> v1:172.21.15.72:6789/0 conn(0x7fd47c0d0400 legacy=0x7fd47c0b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:08.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.959+0000 7fd47a7fc700 1 -- 172.21.15.71:0/2358661898 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd47c0ced80 con 0x7fd47c0cf7e0 2023-10-06T01:41:08.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.959+0000 7fd47a7fc700 1 -- 172.21.15.71:0/2358661898 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1184243524 0 0) 0x7fd46c001470 con 0x7fd47c0cf7e0 2023-10-06T01:41:08.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.959+0000 7fd47a7fc700 1 -- 172.21.15.71:0/2358661898 >> v1:172.21.15.71:6789/0 conn(0x7fd47c0cf7e0 legacy=0x7fd47c0b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:08.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.959+0000 7fd47a7fc700 1 --2- 172.21.15.71:0/2358661898 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd468003a60 0x7fd468003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:08.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.959+0000 7fd47a7fc700 1 --2- 172.21.15.71:0/2358661898 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd468004810 0x7fd468004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:08.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.959+0000 7fd47a7fc700 1 --2- 172.21.15.71:0/2358661898 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd4680051c0 0x7fd46800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:08.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.959+0000 7fd47a7fc700 1 -- 172.21.15.71:0/2358661898 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd47c0ceaa0 con 0x7fd468003a60 2023-10-06T01:41:08.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.959+0000 7fd47a7fc700 1 -- 172.21.15.71:0/2358661898 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd46800c050 con 0x7fd468004810 2023-10-06T01:41:08.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.959+0000 7fd47a7fc700 1 -- 172.21.15.71:0/2358661898 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd46800c210 con 0x7fd4680051c0 2023-10-06T01:41:08.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.959+0000 7fd47affd700 1 --2- 172.21.15.71:0/2358661898 >> v2:172.21.15.72:3300/0 conn(0x7fd47c0ccd40 0x7fd47c0cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:41:08.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.959+0000 7fd47b7fe700 1 --2- 172.21.15.71:0/2358661898 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd468003a60 0x7fd468003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:08.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.960+0000 7fd47bfff700 1 --2- 172.21.15.71:0/2358661898 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd4680051c0 0x7fd46800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:08.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.960+0000 7fd47affd700 1 --2- 172.21.15.71:0/2358661898 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd468004810 0x7fd468004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:08.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.960+0000 7fd47b7fe700 1 -- 172.21.15.71:0/2358661898 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd4680051c0 msgr2=0x7fd46800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:08.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.960+0000 7fd47b7fe700 1 --2- 172.21.15.71:0/2358661898 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd4680051c0 0x7fd46800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:08.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.960+0000 7fd47b7fe700 1 -- 172.21.15.71:0/2358661898 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd468004810 msgr2=0x7fd468004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:08.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.960+0000 7fd47b7fe700 1 --2- 172.21.15.71:0/2358661898 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd468004810 0x7fd468004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:08.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.960+0000 7fd47b7fe700 1 -- 172.21.15.71:0/2358661898 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd468003570 con 0x7fd468003a60 2023-10-06T01:41:08.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.960+0000 7fd47bfff700 1 -- 172.21.15.71:0/2358661898 reap_dead start 2023-10-06T01:41:08.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.960+0000 7fd47b7fe700 1 --2- 172.21.15.71:0/2358661898 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd468003a60 0x7fd468003e30 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fd47400c320 tx=0x7fd474001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baa18e739e9b5629 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:08.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.960+0000 7fd47a7fc700 1 -- 172.21.15.71:0/2358661898 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd474001e20 con 0x7fd468003a60 2023-10-06T01:41:08.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.960+0000 7fd47a7fc700 1 -- 172.21.15.71:0/2358661898 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd47400cc50 con 0x7fd468003a60 2023-10-06T01:41:08.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.960+0000 7fd47a7fc700 1 -- 172.21.15.71:0/2358661898 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd474012420 con 0x7fd468003a60 2023-10-06T01:41:08.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.961+0000 7fd482053700 1 -- 172.21.15.71:0/2358661898 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd468003a60 msgr2=0x7fd468003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:08.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.961+0000 7fd482053700 1 --2- 172.21.15.71:0/2358661898 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd468003a60 0x7fd468003e30 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fd47400c320 tx=0x7fd474001b10 comp rx=0 tx=0).stop 2023-10-06T01:41:08.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.961+0000 7fd482053700 1 -- 172.21.15.71:0/2358661898 shutdown_connections 2023-10-06T01:41:08.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.961+0000 7fd482053700 1 --2- 172.21.15.71:0/2358661898 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd468003a60 0x7fd468003e30 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:08.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.961+0000 7fd482053700 1 -- 172.21.15.71:0/2358661898 >> 172.21.15.71:0/2358661898 conn(0x7fd47c06a220 msgr2=0x7fd47c06a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:08.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.961+0000 7fd482053700 1 -- 172.21.15.71:0/2358661898 shutdown_connections 2023-10-06T01:41:08.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.961+0000 7fd482053700 1 -- 172.21.15.71:0/2358661898 wait complete. 2023-10-06T01:41:08.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.962+0000 7fd482053700 1 Processor -- start 2023-10-06T01:41:08.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.962+0000 7fd482053700 1 -- start start 2023-10-06T01:41:08.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.963+0000 7fd482053700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd468003a60 0x7fd47c14f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:08.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.963+0000 7fd482053700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd47c14f830 0x7fd47c16d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:08.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.963+0000 7fd482053700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd47c14acb0 0x7fd47c14b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:08.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.963+0000 7fd482053700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd47c14b660 con 0x7fd47c14acb0 2023-10-06T01:41:08.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.963+0000 7fd482053700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd47c14db60 con 0x7fd47c14f830 2023-10-06T01:41:08.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.963+0000 7fd482053700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd47c14d2a0 con 0x7fd468003a60 2023-10-06T01:41:08.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.963+0000 7fd47bfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd47c14acb0 0x7fd47c14b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:08.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.963+0000 7fd47bfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd47c14acb0 0x7fd47c14b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36284/0 (socket says 172.21.15.71:36284) 2023-10-06T01:41:08.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.963+0000 7fd47bfff700 1 -- 172.21.15.71:0/3884720798 learned_addr learned my addr 172.21.15.71:0/3884720798 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:08.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.963+0000 7fd47affd700 1 --2- 172.21.15.71:0/3884720798 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd47c14f830 0x7fd47c16d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:08.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.963+0000 7fd47b7fe700 1 --2- 172.21.15.71:0/3884720798 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd468003a60 0x7fd47c14f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:08.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.963+0000 7fd47bfff700 1 -- 172.21.15.71:0/3884720798 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd468003a60 msgr2=0x7fd47c14f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:08.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.963+0000 7fd47bfff700 1 --2- 172.21.15.71:0/3884720798 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd468003a60 0x7fd47c14f1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:08.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.963+0000 7fd47bfff700 1 -- 172.21.15.71:0/3884720798 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd47c14f830 msgr2=0x7fd47c16d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:08.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.963+0000 7fd47bfff700 1 --2- 172.21.15.71:0/3884720798 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd47c14f830 0x7fd47c16d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:08.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.963+0000 7fd47bfff700 1 -- 172.21.15.71:0/3884720798 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd47c14d510 con 0x7fd47c14acb0 2023-10-06T01:41:08.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.963+0000 7fd47affd700 1 --2- 172.21.15.71:0/3884720798 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd47c14f830 0x7fd47c16d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:41:08.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.963+0000 7fd47bfff700 1 --2- 172.21.15.71:0/3884720798 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd47c14acb0 0x7fd47c14b120 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd47c0ccc10 tx=0x7fd46c0014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:08.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.963+0000 7fd4737fe700 1 -- 172.21.15.71:0/3884720798 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd46c012590 con 0x7fd47c14acb0 2023-10-06T01:41:08.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.963+0000 7fd4737fe700 1 -- 172.21.15.71:0/3884720798 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd46c012710 con 0x7fd47c14acb0 2023-10-06T01:41:08.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.963+0000 7fd482053700 1 -- 172.21.15.71:0/3884720798 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd47c14d7f0 con 0x7fd47c14acb0 2023-10-06T01:41:08.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.963+0000 7fd4737fe700 1 -- 172.21.15.71:0/3884720798 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd46c012ad0 con 0x7fd47c14acb0 2023-10-06T01:41:08.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.963+0000 7fd482053700 1 -- 172.21.15.71:0/3884720798 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd47c14fca0 con 0x7fd47c14acb0 2023-10-06T01:41:08.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.964+0000 7fd482053700 1 -- 172.21.15.71:0/3884720798 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd47c14dcd0 con 0x7fd47c14acb0 2023-10-06T01:41:08.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.965+0000 7fd4737fe700 1 -- 172.21.15.71:0/3884720798 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd46c01d460 con 0x7fd47c14acb0 2023-10-06T01:41:08.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.965+0000 7fd4737fe700 1 --2- 172.21.15.71:0/3884720798 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fd45c066f30 0x7fd45c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:08.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.965+0000 7fd4737fe700 1 -- 172.21.15.71:0/3884720798 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6867+0+0 (secure 0 0 0) 0x7fd46c0847d0 con 0x7fd47c14acb0 2023-10-06T01:41:08.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.965+0000 7fd47b7fe700 1 --2- 172.21.15.71:0/3884720798 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fd45c066f30 0x7fd45c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:08.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.965+0000 7fd47b7fe700 1 --2- 172.21.15.71:0/3884720798 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fd45c066f30 0x7fd45c0693e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd474001860 tx=0x7fd474016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:08.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:08.969+0000 7fd4737fe700 1 -- 172.21.15.71:0/3884720798 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd46c0515b0 con 0x7fd47c14acb0 2023-10-06T01:41:09.152 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.151+0000 7fd482053700 1 -- 172.21.15.71:0/3884720798 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fd47c14dcd0 con 0x7fd47c14acb0 2023-10-06T01:41:09.152 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.151+0000 7fd4737fe700 1 -- 172.21.15.71:0/3884720798 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7fd46c054bd0 con 0x7fd47c14acb0 2023-10-06T01:41:09.152 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 32 2023-10-06T01:41:09.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.153+0000 7fd482053700 1 -- 172.21.15.71:0/3884720798 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fd45c066f30 msgr2=0x7fd45c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:09.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.153+0000 7fd482053700 1 --2- 172.21.15.71:0/3884720798 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fd45c066f30 0x7fd45c0693e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd474001860 tx=0x7fd474016000 comp rx=0 tx=0).stop 2023-10-06T01:41:09.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.153+0000 7fd482053700 1 -- 172.21.15.71:0/3884720798 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd47c14acb0 msgr2=0x7fd47c14b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:09.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.153+0000 7fd482053700 1 --2- 172.21.15.71:0/3884720798 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd47c14acb0 0x7fd47c14b120 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd47c0ccc10 tx=0x7fd46c0014a0 comp rx=0 tx=0).stop 2023-10-06T01:41:09.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.153+0000 7fd482053700 1 -- 172.21.15.71:0/3884720798 shutdown_connections 2023-10-06T01:41:09.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.153+0000 7fd482053700 1 --2- 172.21.15.71:0/3884720798 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd47c14acb0 0x7fd47c14b120 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:09.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.153+0000 7fd482053700 1 --2- 172.21.15.71:0/3884720798 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd468003a60 0x7fd47c14f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:09.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.153+0000 7fd482053700 1 --2- 172.21.15.71:0/3884720798 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fd45c066f30 0x7fd45c0693e0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:09.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.153+0000 7fd482053700 1 --2- 172.21.15.71:0/3884720798 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd47c14f830 0x7fd47c16d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:09.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.153+0000 7fd482053700 1 -- 172.21.15.71:0/3884720798 >> 172.21.15.71:0/3884720798 conn(0x7fd47c06a220 msgr2=0x7fd47c155e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:09.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.153+0000 7fd482053700 1 -- 172.21.15.71:0/3884720798 shutdown_connections 2023-10-06T01:41:09.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.153+0000 7fd482053700 1 -- 172.21.15.71:0/3884720798 wait complete. 2023-10-06T01:41:09.188 INFO:tasks.cephfs_test_runner:Starting test: test_backtrace_repair (tasks.cephfs.test_auto_repair.TestMDSAutoRepair) MDS should verify/fix backtrace on fetch dirfrag 2023-10-06T01:41:09.188 INFO:tasks.cephfs_test_runner:test_backtrace_repair (tasks.cephfs.test_auto_repair.TestMDSAutoRepair) 2023-10-06T01:41:09.189 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_auto_repair.TestMDSAutoRepair.test_backtrace_repair' 2023-10-06T01:41:09.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.302+0000 7f1d699ca700 1 Processor -- start 2023-10-06T01:41:09.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.302+0000 7f1d699ca700 1 -- start start 2023-10-06T01:41:09.306 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.303+0000 7f1d699ca700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1d64159650 0x7f1d64068680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:09.306 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.303+0000 7f1d699ca700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1d640c87d0 0x7f1d64068bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:09.306 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.303+0000 7f1d699ca700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d640c8340 con 0x7f1d64159280 2023-10-06T01:41:09.306 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.303+0000 7f1d699ca700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d640c7a10 con 0x7f1d64159650 2023-10-06T01:41:09.306 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.303+0000 7f1d699ca700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d640c7cf0 con 0x7f1d640c87d0 2023-10-06T01:41:09.306 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.303+0000 7f1d689c8700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f1d64159280 0x7f1d6406f410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:55996/0 (socket says 172.21.15.71:55996) 2023-10-06T01:41:09.306 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.303+0000 7f1d689c8700 1 -- 172.21.15.71:0/324764106 learned_addr learned my addr 172.21.15.71:0/324764106 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:41:09.306 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.303+0000 7f1d5bfff700 1 --2- 172.21.15.71:0/324764106 >> v2:172.21.15.72:3300/0 conn(0x7f1d64159650 0x7f1d64068680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:09.306 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.303+0000 7f1d691c9700 1 --2- 172.21.15.71:0/324764106 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1d640c87d0 0x7f1d64068bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:09.307 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.304+0000 7f1d5b7fe700 1 -- 172.21.15.71:0/324764106 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1651076117 0 0) 0x7f1d640c8340 con 0x7f1d64159280 2023-10-06T01:41:09.307 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.304+0000 7f1d5b7fe700 1 -- 172.21.15.71:0/324764106 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d4c003570 con 0x7f1d64159280 2023-10-06T01:41:09.307 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.304+0000 7f1d5bfff700 1 -- 172.21.15.71:0/324764106 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1d640c87d0 msgr2=0x7f1d64068bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:09.307 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.304+0000 7f1d5bfff700 1 --2- 172.21.15.71:0/324764106 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1d640c87d0 0x7f1d64068bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:09.307 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.304+0000 7f1d5bfff700 1 -- 172.21.15.71:0/324764106 >> v1:172.21.15.71:6789/0 conn(0x7f1d64159280 legacy=0x7f1d6406f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:09.307 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.304+0000 7f1d5b7fe700 1 -- 172.21.15.71:0/324764106 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 557914681 0 0) 0x7f1d4c003570 con 0x7f1d64159280 2023-10-06T01:41:09.307 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.304+0000 7f1d5bfff700 1 -- 172.21.15.71:0/324764106 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d640c7fd0 con 0x7f1d64159650 2023-10-06T01:41:09.307 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.304+0000 7f1d691c9700 1 --2- 172.21.15.71:0/324764106 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1d640c87d0 0x7f1d64068bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:41:09.307 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.304+0000 7f1d5bfff700 1 --2- 172.21.15.71:0/324764106 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d64159650 0x7f1d64068680 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1d540098e0 tx=0x7f1d540091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b74d1029eb8ef35a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:09.307 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.304+0000 7f1d5b7fe700 1 -- 172.21.15.71:0/324764106 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d60001470 con 0x7f1d64159650 2023-10-06T01:41:09.308 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.304+0000 7f1d5b7fe700 1 -- 172.21.15.71:0/324764106 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d54011420 con 0x7f1d64159650 2023-10-06T01:41:09.308 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.304+0000 7f1d5b7fe700 1 -- 172.21.15.71:0/324764106 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d540117c0 con 0x7f1d64159650 2023-10-06T01:41:09.308 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.305+0000 7f1d699ca700 1 -- 172.21.15.71:0/324764106 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d64159650 msgr2=0x7f1d64068680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:09.308 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.305+0000 7f1d699ca700 1 --2- 172.21.15.71:0/324764106 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d64159650 0x7f1d64068680 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1d540098e0 tx=0x7f1d540091a0 comp rx=0 tx=0).stop 2023-10-06T01:41:09.308 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.305+0000 7f1d699ca700 1 -- 172.21.15.71:0/324764106 shutdown_connections 2023-10-06T01:41:09.308 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.305+0000 7f1d699ca700 1 --2- 172.21.15.71:0/324764106 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1d640c87d0 0x7f1d64068bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:09.308 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.305+0000 7f1d699ca700 1 --2- 172.21.15.71:0/324764106 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d64159650 0x7f1d64068680 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:09.308 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.305+0000 7f1d699ca700 1 -- 172.21.15.71:0/324764106 >> 172.21.15.71:0/324764106 conn(0x7f1d640c9070 msgr2=0x7f1d640c9470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:09.308 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.305+0000 7f1d699ca700 1 -- 172.21.15.71:0/324764106 shutdown_connections 2023-10-06T01:41:09.308 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.305+0000 7f1d699ca700 1 -- 172.21.15.71:0/324764106 wait complete. 2023-10-06T01:41:09.311 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.306+0000 7f1d699ca700 1 Processor -- start 2023-10-06T01:41:09.311 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.306+0000 7f1d699ca700 1 -- start start 2023-10-06T01:41:09.311 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.307+0000 7f1d699ca700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d640c87d0 0x7f1d64154540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:09.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.307+0000 7f1d699ca700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1d64159280 0x7f1d64159a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:09.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.307+0000 7f1d699ca700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1d64159f70 0x7f1d6415d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:09.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.307+0000 7f1d699ca700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d640c4700 con 0x7f1d64159f70 2023-10-06T01:41:09.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.307+0000 7f1d699ca700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d6415a480 con 0x7f1d640c87d0 2023-10-06T01:41:09.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.307+0000 7f1d699ca700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d6415a760 con 0x7f1d64159280 2023-10-06T01:41:09.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.307+0000 7f1d691c9700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1d64159f70 0x7f1d6415d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:09.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.307+0000 7f1d691c9700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1d64159f70 0x7f1d6415d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36292/0 (socket says 172.21.15.71:36292) 2023-10-06T01:41:09.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.307+0000 7f1d691c9700 1 -- 172.21.15.71:0/1070989652 learned_addr learned my addr 172.21.15.71:0/1070989652 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:09.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.307+0000 7f1d689c8700 1 --2- 172.21.15.71:0/1070989652 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d640c87d0 0x7f1d64154540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:09.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.307+0000 7f1d5bfff700 1 --2- 172.21.15.71:0/1070989652 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1d64159280 0x7f1d64159a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:09.314 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.307+0000 7f1d691c9700 1 -- 172.21.15.71:0/1070989652 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1d64159280 msgr2=0x7f1d64159a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:09.314 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.307+0000 7f1d691c9700 1 --2- 172.21.15.71:0/1070989652 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1d64159280 0x7f1d64159a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:09.314 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.307+0000 7f1d691c9700 1 -- 172.21.15.71:0/1070989652 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d640c87d0 msgr2=0x7f1d64154540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:09.314 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.307+0000 7f1d691c9700 1 --2- 172.21.15.71:0/1070989652 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d640c87d0 0x7f1d64154540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:09.314 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.308+0000 7f1d691c9700 1 -- 172.21.15.71:0/1070989652 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d5c009a20 con 0x7f1d64159f70 2023-10-06T01:41:09.314 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.308+0000 7f1d691c9700 1 --2- 172.21.15.71:0/1070989652 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1d64159f70 0x7f1d6415d420 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1d5c009f50 tx=0x7f1d5c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:09.314 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.308+0000 7f1d58ff9700 1 -- 172.21.15.71:0/1070989652 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d5c00cc50 con 0x7f1d64159f70 2023-10-06T01:41:09.314 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.308+0000 7f1d58ff9700 1 -- 172.21.15.71:0/1070989652 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d5c00f040 con 0x7f1d64159f70 2023-10-06T01:41:09.314 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.308+0000 7f1d58ff9700 1 -- 172.21.15.71:0/1070989652 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d5c014480 con 0x7f1d64159f70 2023-10-06T01:41:09.314 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.308+0000 7f1d699ca700 1 -- 172.21.15.71:0/1070989652 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d54009420 con 0x7f1d64159f70 2023-10-06T01:41:09.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.308+0000 7f1d699ca700 1 -- 172.21.15.71:0/1070989652 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d64154a80 con 0x7f1d64159f70 2023-10-06T01:41:09.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.309+0000 7f1d699ca700 1 -- 172.21.15.71:0/1070989652 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d640c5c10 con 0x7f1d64159f70 2023-10-06T01:41:09.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.309+0000 7f1d58ff9700 1 -- 172.21.15.71:0/1070989652 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1d5c014870 con 0x7f1d64159f70 2023-10-06T01:41:09.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.310+0000 7f1d58ff9700 1 --2- 172.21.15.71:0/1070989652 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f1d50066f30 0x7f1d500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:09.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.310+0000 7f1d58ff9700 1 -- 172.21.15.71:0/1070989652 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f1d5c085830 con 0x7f1d64159f70 2023-10-06T01:41:09.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.310+0000 7f1d689c8700 1 --2- 172.21.15.71:0/1070989652 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f1d50066f30 0x7f1d500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:09.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.310+0000 7f1d689c8700 1 --2- 172.21.15.71:0/1070989652 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f1d50066f30 0x7f1d500693e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1d600011e0 tx=0x7f1d60001520 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:09.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.314+0000 7f1d58ff9700 1 -- 172.21.15.71:0/1070989652 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1d5c052570 con 0x7f1d64159f70 2023-10-06T01:41:09.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.570+0000 7f1d699ca700 1 -- 172.21.15.71:0/1070989652 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_auto_repair.TestMDSAutoRepair.test_backtrace_repair"]} v 0) v1 -- 0x7f1d640c41f0 con 0x7f1d64159f70 2023-10-06T01:41:09.836 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.836+0000 7f1d58ff9700 1 -- 172.21.15.71:0/1070989652 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_auto_repair.TestMDSAutoRepair.test_backtrace_repair"]}]=0 v63) v1 ==== 151+0+0 (secure 0 0 0) 0x7f1d640c41f0 con 0x7f1d64159f70 2023-10-06T01:41:09.839 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.838+0000 7f1d699ca700 1 -- 172.21.15.71:0/1070989652 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f1d50066f30 msgr2=0x7f1d500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:09.839 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.838+0000 7f1d699ca700 1 --2- 172.21.15.71:0/1070989652 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f1d50066f30 0x7f1d500693e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1d600011e0 tx=0x7f1d60001520 comp rx=0 tx=0).stop 2023-10-06T01:41:09.839 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.838+0000 7f1d699ca700 1 -- 172.21.15.71:0/1070989652 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1d64159f70 msgr2=0x7f1d6415d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:09.839 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.838+0000 7f1d699ca700 1 --2- 172.21.15.71:0/1070989652 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1d64159f70 0x7f1d6415d420 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1d5c009f50 tx=0x7f1d5c00b040 comp rx=0 tx=0).stop 2023-10-06T01:41:09.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.838+0000 7f1d699ca700 1 -- 172.21.15.71:0/1070989652 shutdown_connections 2023-10-06T01:41:09.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.838+0000 7f1d699ca700 1 --2- 172.21.15.71:0/1070989652 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1d64159f70 0x7f1d6415d420 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:09.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.838+0000 7f1d699ca700 1 --2- 172.21.15.71:0/1070989652 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f1d50066f30 0x7f1d500693e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:09.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.838+0000 7f1d699ca700 1 --2- 172.21.15.71:0/1070989652 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d640c87d0 0x7f1d64154540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:09.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.838+0000 7f1d699ca700 1 --2- 172.21.15.71:0/1070989652 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1d64159280 0x7f1d64159a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:09.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.838+0000 7f1d699ca700 1 -- 172.21.15.71:0/1070989652 >> 172.21.15.71:0/1070989652 conn(0x7f1d640c9070 msgr2=0x7f1d640c9440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:09.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.838+0000 7f1d699ca700 1 -- 172.21.15.71:0/1070989652 shutdown_connections 2023-10-06T01:41:09.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.838+0000 7f1d699ca700 1 -- 172.21.15.71:0/1070989652 wait complete. 2023-10-06T01:41:09.851 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-06T01:41:09.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.967+0000 7f088c81e700 1 Processor -- start 2023-10-06T01:41:09.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.967+0000 7f088c81e700 1 -- start start 2023-10-06T01:41:09.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.968+0000 7f088c81e700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f08880d0400 0x7f08880b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:09.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.968+0000 7f088c81e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f08880d07d0 0x7f08880b3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:09.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.968+0000 7f088c81e700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08880b6170 con 0x7f08880ccd40 2023-10-06T01:41:09.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.968+0000 7f088c81e700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f088815dd40 con 0x7f08880d0400 2023-10-06T01:41:09.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.968+0000 7f088c81e700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f088815e020 con 0x7f08880d07d0 2023-10-06T01:41:09.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.968+0000 7f088659c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f08880d0400 0x7f08880b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:09.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.968+0000 7f088659c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f08880d0400 0x7f08880b5c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47340/0 (socket says 172.21.15.71:47340) 2023-10-06T01:41:09.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.968+0000 7f088659c700 1 -- 172.21.15.71:0/2635423434 learned_addr learned my addr 172.21.15.71:0/2635423434 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:09.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.968+0000 7f0886d9d700 1 --2- 172.21.15.71:0/2635423434 >> v2:172.21.15.72:3300/0 conn(0x7f08880d07d0 0x7f08880b3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:09.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.968+0000 7f088659c700 1 -- 172.21.15.71:0/2635423434 >> v2:172.21.15.72:3300/0 conn(0x7f08880d07d0 msgr2=0x7f08880b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:09.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.968+0000 7f088659c700 1 --2- 172.21.15.71:0/2635423434 >> v2:172.21.15.72:3300/0 conn(0x7f08880d07d0 0x7f08880b3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:09.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.968+0000 7f088659c700 1 -- 172.21.15.71:0/2635423434 >> v1:172.21.15.72:6789/0 conn(0x7f08880ccd40 legacy=0x7f08880cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:09.971 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.968+0000 7f088659c700 1 -- 172.21.15.71:0/2635423434 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08880ceaa0 con 0x7f08880d0400 2023-10-06T01:41:09.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.968+0000 7f0886d9d700 1 --2- 172.21.15.71:0/2635423434 >> v2:172.21.15.72:3300/0 conn(0x7f08880d07d0 0x7f08880b3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:41:09.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.969+0000 7f088659c700 1 --2- 172.21.15.71:0/2635423434 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f08880d0400 0x7f08880b5c30 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f08880cdf50 tx=0x7f0878009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d277032abd0953ce server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:09.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.969+0000 7f0885d9b700 1 -- 172.21.15.71:0/2635423434 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0878005c10 con 0x7f08880d0400 2023-10-06T01:41:09.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.969+0000 7f0885d9b700 1 -- 172.21.15.71:0/2635423434 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0878005d70 con 0x7f08880d0400 2023-10-06T01:41:09.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.969+0000 7f0885d9b700 1 -- 172.21.15.71:0/2635423434 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f087800b840 con 0x7f08880d0400 2023-10-06T01:41:09.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.969+0000 7f088c81e700 1 -- 172.21.15.71:0/2635423434 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f08880d0400 msgr2=0x7f08880b5c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:09.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.969+0000 7f088c81e700 1 --2- 172.21.15.71:0/2635423434 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f08880d0400 0x7f08880b5c30 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f08880cdf50 tx=0x7f0878009220 comp rx=0 tx=0).stop 2023-10-06T01:41:09.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.969+0000 7f088c81e700 1 -- 172.21.15.71:0/2635423434 shutdown_connections 2023-10-06T01:41:09.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.969+0000 7f088c81e700 1 --2- 172.21.15.71:0/2635423434 >> v2:172.21.15.72:3300/0 conn(0x7f08880d07d0 0x7f08880b3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:09.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.969+0000 7f088c81e700 1 --2- 172.21.15.71:0/2635423434 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f08880d0400 0x7f08880b5c30 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:09.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.969+0000 7f088c81e700 1 -- 172.21.15.71:0/2635423434 >> 172.21.15.71:0/2635423434 conn(0x7f088806a220 msgr2=0x7f088806a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:09.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.969+0000 7f088c81e700 1 -- 172.21.15.71:0/2635423434 shutdown_connections 2023-10-06T01:41:09.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.969+0000 7f088c81e700 1 -- 172.21.15.71:0/2635423434 wait complete. 2023-10-06T01:41:09.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.970+0000 7f088c81e700 1 Processor -- start 2023-10-06T01:41:09.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.970+0000 7f088c81e700 1 -- start start 2023-10-06T01:41:09.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.971+0000 7f088c81e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f08880ccd40 0x7f0888144760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:09.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.971+0000 7f088c81e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f08880d0400 0x7f08880c8720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:09.975 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.971+0000 7f088c81e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f08880d07d0 0x7f08880c8c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:09.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.971+0000 7f088c81e700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08880ca290 con 0x7f08880d0400 2023-10-06T01:41:09.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.971+0000 7f088c81e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08880cbfe0 con 0x7f08880ccd40 2023-10-06T01:41:09.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.971+0000 7f088c81e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0888144ca0 con 0x7f08880d07d0 2023-10-06T01:41:09.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.971+0000 7f087dd9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f08880d0400 0x7f08880c8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:09.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.971+0000 7f087dd9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f08880d0400 0x7f08880c8720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47354/0 (socket says 172.21.15.71:47354) 2023-10-06T01:41:09.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.971+0000 7f087dd9b700 1 -- 172.21.15.71:0/755836337 learned_addr learned my addr 172.21.15.71:0/755836337 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:09.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.971+0000 7f0886d9d700 1 --2- 172.21.15.71:0/755836337 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f08880d07d0 0x7f08880c8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:09.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.971+0000 7f088659c700 1 --2- 172.21.15.71:0/755836337 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f08880ccd40 0x7f0888144760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:09.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.972+0000 7f087dd9b700 1 -- 172.21.15.71:0/755836337 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f08880d07d0 msgr2=0x7f08880c8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:09.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.972+0000 7f087dd9b700 1 --2- 172.21.15.71:0/755836337 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f08880d07d0 0x7f08880c8c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:09.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.972+0000 7f087dd9b700 1 -- 172.21.15.71:0/755836337 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f08880ccd40 msgr2=0x7f0888144760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:09.976 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.972+0000 7f087dd9b700 1 --2- 172.21.15.71:0/755836337 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f08880ccd40 0x7f0888144760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:09.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.972+0000 7f087dd9b700 1 -- 172.21.15.71:0/755836337 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0878009480 con 0x7f08880d0400 2023-10-06T01:41:09.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.972+0000 7f087dd9b700 1 --2- 172.21.15.71:0/755836337 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f08880d0400 0x7f08880c8720 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f087000c630 tx=0x7f0870007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:09.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.972+0000 7f087effd700 1 -- 172.21.15.71:0/755836337 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0870011590 con 0x7f08880d0400 2023-10-06T01:41:09.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.972+0000 7f087effd700 1 -- 172.21.15.71:0/755836337 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0870011710 con 0x7f08880d0400 2023-10-06T01:41:09.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.972+0000 7f088c81e700 1 -- 172.21.15.71:0/755836337 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f088815c050 con 0x7f08880d0400 2023-10-06T01:41:09.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.972+0000 7f087effd700 1 -- 172.21.15.71:0/755836337 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0870011ad0 con 0x7f08880d0400 2023-10-06T01:41:09.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.972+0000 7f088c81e700 1 -- 172.21.15.71:0/755836337 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08880cba20 con 0x7f08880d0400 2023-10-06T01:41:09.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.973+0000 7f088c81e700 1 -- 172.21.15.71:0/755836337 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f088815c1e0 con 0x7f08880d0400 2023-10-06T01:41:09.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.973+0000 7f087effd700 1 -- 172.21.15.71:0/755836337 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f087001c460 con 0x7f08880d0400 2023-10-06T01:41:09.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.974+0000 7f087effd700 1 --2- 172.21.15.71:0/755836337 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f0868066f30 0x7f08680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:09.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.974+0000 7f087effd700 1 -- 172.21.15.71:0/755836337 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f0870084670 con 0x7f08880d0400 2023-10-06T01:41:09.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.974+0000 7f088659c700 1 --2- 172.21.15.71:0/755836337 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f0868066f30 0x7f08680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:09.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.974+0000 7f088659c700 1 --2- 172.21.15.71:0/755836337 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f0868066f30 0x7f08680693e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f08780030c0 tx=0x7f0878015000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:09.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:09.978+0000 7f087effd700 1 -- 172.21.15.71:0/755836337 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0870051450 con 0x7f08880d0400 2023-10-06T01:41:10.163 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:10.163+0000 7f088c81e700 1 -- 172.21.15.71:0/755836337 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f08880ced80 con 0x7f08880d0400 2023-10-06T01:41:10.167 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:10.166+0000 7f087effd700 1 -- 172.21.15.71:0/755836337 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0870054a70 con 0x7f08880d0400 2023-10-06T01:41:10.169 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:10.168+0000 7f088c81e700 1 -- 172.21.15.71:0/755836337 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f0868066f30 msgr2=0x7f08680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:10.169 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:10.168+0000 7f088c81e700 1 --2- 172.21.15.71:0/755836337 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f0868066f30 0x7f08680693e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f08780030c0 tx=0x7f0878015000 comp rx=0 tx=0).stop 2023-10-06T01:41:10.170 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:10.168+0000 7f088c81e700 1 -- 172.21.15.71:0/755836337 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f08880d0400 msgr2=0x7f08880c8720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:10.170 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:10.168+0000 7f088c81e700 1 --2- 172.21.15.71:0/755836337 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f08880d0400 0x7f08880c8720 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f087000c630 tx=0x7f0870007f60 comp rx=0 tx=0).stop 2023-10-06T01:41:10.170 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:10.168+0000 7f088c81e700 1 -- 172.21.15.71:0/755836337 shutdown_connections 2023-10-06T01:41:10.170 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:10.168+0000 7f088c81e700 1 --2- 172.21.15.71:0/755836337 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f08880d07d0 0x7f08880c8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:10.170 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:10.168+0000 7f088c81e700 1 --2- 172.21.15.71:0/755836337 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f0868066f30 0x7f08680693e0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:10.170 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:10.168+0000 7f088c81e700 1 --2- 172.21.15.71:0/755836337 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f08880ccd40 0x7f0888144760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:10.170 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:10.168+0000 7f088c81e700 1 --2- 172.21.15.71:0/755836337 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f08880d0400 0x7f08880c8720 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:10.170 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:10.168+0000 7f088c81e700 1 -- 172.21.15.71:0/755836337 >> 172.21.15.71:0/755836337 conn(0x7f088806a220 msgr2=0x7f08880b2340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:10.170 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:10.168+0000 7f088c81e700 1 -- 172.21.15.71:0/755836337 shutdown_connections 2023-10-06T01:41:10.170 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:10.168+0000 7f088c81e700 1 -- 172.21.15.71:0/755836337 wait complete. 2023-10-06T01:41:10.181 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T01:41:10.181 DEBUG:teuthology.orchestra.run.smithi071:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T01:41:10.216 DEBUG:teuthology.orchestra.run.smithi072:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T01:41:10.263 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T01:41:10.263 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi071.front.sepia.ceph.com... 2023-10-06T01:41:10.263 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T01:41:10.264 DEBUG:teuthology.orchestra.run.smithi071:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-06T01:41:10.298 INFO:teuthology.orchestra.run:waiting for 900 2023-10-06T01:41:10.299 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi071.front.sepia.ceph.com 2023-10-06T01:41:10.299 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:41:10.299 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T01:41:10.353 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi072.front.sepia.ceph.com... 2023-10-06T01:41:10.353 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T01:41:10.353 DEBUG:teuthology.orchestra.run.smithi072:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-10-06T01:41:10.390 INFO:teuthology.orchestra.run:waiting for 900 2023-10-06T01:41:10.390 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi072.front.sepia.ceph.com 2023-10-06T01:41:10.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:41:10.390 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-06T01:41:10.447 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi071.front.sepia.ceph.com... 2023-10-06T01:41:10.447 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T01:41:10.447 DEBUG:teuthology.orchestra.run.smithi071:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2023-10-06T01:41:10.488 INFO:teuthology.orchestra.run:waiting for 900 2023-10-06T01:41:10.488 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi071.front.sepia.ceph.com 2023-10-06T01:41:10.489 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:41:10.489 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-06T01:41:10.544 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi072.front.sepia.ceph.com... 2023-10-06T01:41:10.544 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T01:41:10.544 DEBUG:teuthology.orchestra.run.smithi072:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2023-10-06T01:41:10.579 INFO:teuthology.orchestra.run:waiting for 900 2023-10-06T01:41:10.579 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi072.front.sepia.ceph.com 2023-10-06T01:41:10.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:41:10.579 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-06T01:41:10.636 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-06T01:41:10.636 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T01:41:10.749 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:10.749+0000 7f1eb04c9700 1 Processor -- start 2023-10-06T01:41:10.750 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:10.749+0000 7f1eb04c9700 1 -- start start 2023-10-06T01:41:10.752 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:10.750+0000 7f1eb04c9700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f1ea80af4e0 0x7f1ea80b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:10.752 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:10.750+0000 7f1eb04c9700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1ea815db70 0x7f1ea80b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:10.752 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:10.750+0000 7f1eb04c9700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ea815e190 con 0x7f1ea80af8b0 2023-10-06T01:41:10.752 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:10.750+0000 7f1eb04c9700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ea80b1910 con 0x7f1ea80af4e0 2023-10-06T01:41:10.752 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:10.750+0000 7f1eb04c9700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ea815dfa0 con 0x7f1ea815db70 2023-10-06T01:41:10.752 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:10.750+0000 7f1eae265700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f1ea80af4e0 0x7f1ea80b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:10.752 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:10.750+0000 7f1eae265700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f1ea80af4e0 0x7f1ea80b20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47358/0 (socket says 172.21.15.71:47358) 2023-10-06T01:41:10.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:10.750+0000 7f1eae265700 1 -- 172.21.15.71:0/2185017140 learned_addr learned my addr 172.21.15.71:0/2185017140 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:10.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:10.750+0000 7f1eae265700 1 -- 172.21.15.71:0/2185017140 >> v2:172.21.15.72:3300/0 conn(0x7f1ea815db70 msgr2=0x7f1ea80b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:10.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:10.750+0000 7f1eae265700 1 --2- 172.21.15.71:0/2185017140 >> v2:172.21.15.72:3300/0 conn(0x7f1ea815db70 0x7f1ea80b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:10.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:10.750+0000 7f1eae265700 1 -- 172.21.15.71:0/2185017140 >> v1:172.21.15.72:6789/0 conn(0x7f1ea80af8b0 legacy=0x7f1ea815d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:10.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:10.750+0000 7f1eae265700 1 -- 172.21.15.71:0/2185017140 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ea80cb650 con 0x7f1ea80af4e0 2023-10-06T01:41:10.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:10.750+0000 7f1eae265700 1 --2- 172.21.15.71:0/2185017140 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1ea80af4e0 0x7f1ea80b20e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f1ea80c7280 tx=0x7f1ea4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f13f0ca57fb621ef server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:10.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:10.750+0000 7f1ead263700 1 -- 172.21.15.71:0/2185017140 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea400b820 con 0x7f1ea80af4e0 2023-10-06T01:41:10.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:10.750+0000 7f1ead263700 1 -- 172.21.15.71:0/2185017140 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ea400b980 con 0x7f1ea80af4e0 2023-10-06T01:41:10.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:10.750+0000 7f1ead263700 1 -- 172.21.15.71:0/2185017140 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea400bd20 con 0x7f1ea80af4e0 2023-10-06T01:41:10.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:10.751+0000 7f1eb04c9700 1 -- 172.21.15.71:0/2185017140 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1ea80af4e0 msgr2=0x7f1ea80b20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:10.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:10.751+0000 7f1eb04c9700 1 --2- 172.21.15.71:0/2185017140 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1ea80af4e0 0x7f1ea80b20e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f1ea80c7280 tx=0x7f1ea4009250 comp rx=0 tx=0).stop 2023-10-06T01:41:10.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:10.751+0000 7f1eb04c9700 1 -- 172.21.15.71:0/2185017140 shutdown_connections 2023-10-06T01:41:10.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:10.751+0000 7f1eb04c9700 1 --2- 172.21.15.71:0/2185017140 >> v2:172.21.15.72:3300/0 conn(0x7f1ea815db70 0x7f1ea80b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:10.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:10.751+0000 7f1eb04c9700 1 --2- 172.21.15.71:0/2185017140 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1ea80af4e0 0x7f1ea80b20e0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:10.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:10.751+0000 7f1eb04c9700 1 -- 172.21.15.71:0/2185017140 >> 172.21.15.71:0/2185017140 conn(0x7f1ea8068680 msgr2=0x7f1ea8068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:10.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:10.751+0000 7f1eb04c9700 1 -- 172.21.15.71:0/2185017140 shutdown_connections 2023-10-06T01:41:10.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:10.751+0000 7f1eb04c9700 1 -- 172.21.15.71:0/2185017140 wait complete. 2023-10-06T01:41:10.759 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:10.752+0000 7f1eb04c9700 1 Processor -- start 2023-10-06T01:41:10.759 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:10.752+0000 7f1eb04c9700 1 -- start start 2023-10-06T01:41:10.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:10.753+0000 7f1eb04c9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ea80af4e0 0x7f1ea816aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:10.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:10.753+0000 7f1eb04c9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1ea80af8b0 0x7f1ea80b4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:10.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:10.753+0000 7f1eb04c9700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1ea815db70 0x7f1ea80b4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:10.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:10.753+0000 7f1eb04c9700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea816af50 con 0x7f1ea815db70 2023-10-06T01:41:10.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:10.753+0000 7f1eb04c9700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea816b1c0 con 0x7f1ea80af4e0 2023-10-06T01:41:10.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:10.753+0000 7f1eb04c9700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea816b4a0 con 0x7f1ea80af8b0 2023-10-06T01:41:10.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:10.753+0000 7f1eaea66700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1ea815db70 0x7f1ea80b4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:10.761 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:10.753+0000 7f1eaea66700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1ea815db70 0x7f1ea80b4770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47370/0 (socket says 172.21.15.71:47370) 2023-10-06T01:41:10.761 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:10.753+0000 7f1eae265700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ea80af4e0 0x7f1ea816aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:10.761 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:10.753+0000 7f1eaea66700 1 -- 172.21.15.71:0/1058485068 learned_addr learned my addr 172.21.15.71:0/1058485068 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:10.761 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:10.753+0000 7f1eada64700 1 --2- 172.21.15.71:0/1058485068 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1ea80af8b0 0x7f1ea80b4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:10.761 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:10.753+0000 7f1eaea66700 1 -- 172.21.15.71:0/1058485068 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1ea80af8b0 msgr2=0x7f1ea80b4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:10.761 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:10.753+0000 7f1eaea66700 1 --2- 172.21.15.71:0/1058485068 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1ea80af8b0 0x7f1ea80b4230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:10.761 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:10.753+0000 7f1eaea66700 1 -- 172.21.15.71:0/1058485068 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ea80af4e0 msgr2=0x7f1ea816aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:10.761 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:10.753+0000 7f1eaea66700 1 --2- 172.21.15.71:0/1058485068 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ea80af4e0 0x7f1ea816aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:10.762 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:10.753+0000 7f1eaea66700 1 -- 172.21.15.71:0/1058485068 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ea40094f0 con 0x7f1ea815db70 2023-10-06T01:41:10.762 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:10.753+0000 7f1eaea66700 1 --2- 172.21.15.71:0/1058485068 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1ea815db70 0x7f1ea80b4770 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1ea000bc30 tx=0x7f1ea0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:10.762 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:10.753+0000 7f1e9e7fc700 1 -- 172.21.15.71:0/1058485068 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea00092e0 con 0x7f1ea815db70 2023-10-06T01:41:10.762 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:10.754+0000 7f1e9e7fc700 1 -- 172.21.15.71:0/1058485068 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ea000c630 con 0x7f1ea815db70 2023-10-06T01:41:10.762 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:10.754+0000 7f1eb04c9700 1 -- 172.21.15.71:0/1058485068 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ea816b780 con 0x7f1ea815db70 2023-10-06T01:41:10.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:10.754+0000 7f1e9e7fc700 1 -- 172.21.15.71:0/1058485068 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea000ca10 con 0x7f1ea815db70 2023-10-06T01:41:10.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:10.754+0000 7f1eb04c9700 1 -- 172.21.15.71:0/1058485068 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ea816bd40 con 0x7f1ea815db70 2023-10-06T01:41:10.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:10.754+0000 7f1eb04c9700 1 -- 172.21.15.71:0/1058485068 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ea816bf60 con 0x7f1ea815db70 2023-10-06T01:41:10.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:10.755+0000 7f1e9e7fc700 1 -- 172.21.15.71:0/1058485068 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1ea0012070 con 0x7f1ea815db70 2023-10-06T01:41:10.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:10.755+0000 7f1e9e7fc700 1 --2- 172.21.15.71:0/1058485068 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f1e8c066f30 0x7f1e8c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:10.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:10.756+0000 7f1eae265700 1 --2- 172.21.15.71:0/1058485068 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f1e8c066f30 0x7f1e8c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:10.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:10.756+0000 7f1e9e7fc700 1 -- 172.21.15.71:0/1058485068 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f1ea00844c0 con 0x7f1ea815db70 2023-10-06T01:41:10.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:10.756+0000 7f1eae265700 1 --2- 172.21.15.71:0/1058485068 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f1e8c066f30 0x7f1e8c0693e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1ea80c7280 tx=0x7f1ea4016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:10.764 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:10.760+0000 7f1e9e7fc700 1 -- 172.21.15.71:0/1058485068 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1ea00512a0 con 0x7f1ea815db70 2023-10-06T01:41:10.986 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:10.985+0000 7f1eb04c9700 1 -- 172.21.15.71:0/1058485068 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1ea80b0910 con 0x7f1ea815db70 2023-10-06T01:41:10.986 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:10.986+0000 7f1e9e7fc700 1 -- 172.21.15.71:0/1058485068 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4590 (secure 0 0 0) 0x7f1ea00548c0 con 0x7f1ea815db70 2023-10-06T01:41:10.987 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:41:10.987 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6836/274053969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":274053969},{"type":"v1","addr":"172.21.15.71:6836","nonce":274053969}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/4158221694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6835","nonce":4158221694},{"type":"v1","addr":"172.21.15.71:6837","nonce":4158221694}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/1094581488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":1094581488},{"type":"v1","addr":"172.21.15.72:6835","nonce":1094581488}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T01:40:21.151426+0000","modified":"2023-10-06T01:40:39.857922+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4315},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4315":{"gid":4315,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6834/2361644634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6833","nonce":2361644634},{"type":"v1","addr":"172.21.15.72:6834","nonce":2361644634}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T01:41:10.989 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:10.988+0000 7f1eb04c9700 1 -- 172.21.15.71:0/1058485068 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f1e8c066f30 msgr2=0x7f1e8c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:10.989 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:10.988+0000 7f1eb04c9700 1 --2- 172.21.15.71:0/1058485068 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f1e8c066f30 0x7f1e8c0693e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1ea80c7280 tx=0x7f1ea4016000 comp rx=0 tx=0).stop 2023-10-06T01:41:10.989 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:10.988+0000 7f1eb04c9700 1 -- 172.21.15.71:0/1058485068 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1ea815db70 msgr2=0x7f1ea80b4770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:10.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:10.988+0000 7f1eb04c9700 1 --2- 172.21.15.71:0/1058485068 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1ea815db70 0x7f1ea80b4770 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1ea000bc30 tx=0x7f1ea0009840 comp rx=0 tx=0).stop 2023-10-06T01:41:10.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:10.988+0000 7f1eb04c9700 1 -- 172.21.15.71:0/1058485068 shutdown_connections 2023-10-06T01:41:10.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:10.988+0000 7f1eb04c9700 1 --2- 172.21.15.71:0/1058485068 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1ea815db70 0x7f1ea80b4770 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:10.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:10.988+0000 7f1eb04c9700 1 --2- 172.21.15.71:0/1058485068 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f1e8c066f30 0x7f1e8c0693e0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:10.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:10.988+0000 7f1eb04c9700 1 --2- 172.21.15.71:0/1058485068 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ea80af4e0 0x7f1ea816aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:10.991 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:10.988+0000 7f1eb04c9700 1 --2- 172.21.15.71:0/1058485068 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1ea80af8b0 0x7f1ea80b4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:10.991 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:10.988+0000 7f1eb04c9700 1 -- 172.21.15.71:0/1058485068 >> 172.21.15.71:0/1058485068 conn(0x7f1ea8068680 msgr2=0x7f1ea80b52e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:10.991 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:10.988+0000 7f1eb04c9700 1 -- 172.21.15.71:0/1058485068 shutdown_connections 2023-10-06T01:41:10.991 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:10.988+0000 7f1eb04c9700 1 -- 172.21.15.71:0/1058485068 wait complete. 2023-10-06T01:41:10.991 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 9 2023-10-06T01:41:11.000 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:41:11.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.114+0000 7f782c5f8700 1 Processor -- start 2023-10-06T01:41:11.115 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.114+0000 7f782c5f8700 1 -- start start 2023-10-06T01:41:11.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.115+0000 7f782c5f8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f78240af4e0 0x7f78240b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:11.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.115+0000 7f782c5f8700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f78240af8b0 0x7f78240b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:11.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.115+0000 7f782c5f8700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f782415e190 con 0x7f782415d460 2023-10-06T01:41:11.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.115+0000 7f782c5f8700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78240b1910 con 0x7f78240af8b0 2023-10-06T01:41:11.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.115+0000 7f782c5f8700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f782415dfb0 con 0x7f78240af4e0 2023-10-06T01:41:11.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.115+0000 7f782a394700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f78240af4e0 0x7f78240b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:11.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.115+0000 7f782a394700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f78240af4e0 0x7f78240b20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.71:45530/0 (socket says 172.21.15.71:45530) 2023-10-06T01:41:11.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.116+0000 7f782a394700 1 -- 172.21.15.71:0/2577982432 learned_addr learned my addr 172.21.15.71:0/2577982432 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:11.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.115+0000 7f7829b93700 1 --2- 172.21.15.71:0/2577982432 >> v2:172.21.15.72:3300/0 conn(0x7f78240af8b0 0x7f78240b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:11.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.116+0000 7f7829b93700 1 -- 172.21.15.71:0/2577982432 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f78240af4e0 msgr2=0x7f78240b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:11.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.116+0000 7f7829b93700 1 --2- 172.21.15.71:0/2577982432 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f78240af4e0 0x7f78240b20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:11.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.116+0000 7f7829b93700 1 -- 172.21.15.71:0/2577982432 >> v1:172.21.15.72:6789/0 conn(0x7f782415d460 legacy=0x7f782415d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:11.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.116+0000 7f7829392700 1 -- 172.21.15.71:0/2577982432 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3055534189 0 0) 0x7f782415e190 con 0x7f782415d460 2023-10-06T01:41:11.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.116+0000 7f7829b93700 1 -- 172.21.15.71:0/2577982432 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78240cb650 con 0x7f78240af8b0 2023-10-06T01:41:11.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.116+0000 7f782a394700 1 --2- 172.21.15.71:0/2577982432 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f78240af4e0 0x7f78240b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:41:11.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.116+0000 7f7829b93700 1 --2- 172.21.15.71:0/2577982432 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78240af8b0 0x7f78240b2620 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f78140098e0 tx=0x7f78140091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eff39135ffba63e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:11.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.116+0000 7f7829392700 1 -- 172.21.15.71:0/2577982432 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f781400b640 con 0x7f78240af8b0 2023-10-06T01:41:11.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.116+0000 7f7829392700 1 -- 172.21.15.71:0/2577982432 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f781400b7a0 con 0x7f78240af8b0 2023-10-06T01:41:11.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.116+0000 7f7829392700 1 -- 172.21.15.71:0/2577982432 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f781400bb40 con 0x7f78240af8b0 2023-10-06T01:41:11.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.117+0000 7f782c5f8700 1 -- 172.21.15.71:0/2577982432 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78240af8b0 msgr2=0x7f78240b2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:11.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.117+0000 7f782c5f8700 1 --2- 172.21.15.71:0/2577982432 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78240af8b0 0x7f78240b2620 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f78140098e0 tx=0x7f78140091a0 comp rx=0 tx=0).stop 2023-10-06T01:41:11.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.117+0000 7f782c5f8700 1 -- 172.21.15.71:0/2577982432 shutdown_connections 2023-10-06T01:41:11.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.117+0000 7f782c5f8700 1 --2- 172.21.15.71:0/2577982432 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f78240af4e0 0x7f78240b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:11.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.117+0000 7f782c5f8700 1 --2- 172.21.15.71:0/2577982432 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78240af8b0 0x7f78240b2620 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:11.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.117+0000 7f782c5f8700 1 -- 172.21.15.71:0/2577982432 >> 172.21.15.71:0/2577982432 conn(0x7f7824068680 msgr2=0x7f7824068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:11.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.117+0000 7f782c5f8700 1 -- 172.21.15.71:0/2577982432 shutdown_connections 2023-10-06T01:41:11.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.117+0000 7f782c5f8700 1 -- 172.21.15.71:0/2577982432 wait complete. 2023-10-06T01:41:11.123 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.118+0000 7f782c5f8700 1 Processor -- start 2023-10-06T01:41:11.123 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.118+0000 7f782c5f8700 1 -- start start 2023-10-06T01:41:11.123 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.118+0000 7f782c5f8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f78240af4e0 0x7f7824155150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:11.123 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.118+0000 7f782c5f8700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78240af8b0 0x7f78240c82d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:11.123 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.118+0000 7f782c5f8700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f782415d460 0x7f7824152310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:11.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.118+0000 7f782c5f8700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7824155690 con 0x7f78240af8b0 2023-10-06T01:41:11.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.118+0000 7f782c5f8700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78240c9850 con 0x7f782415d460 2023-10-06T01:41:11.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.118+0000 7f782c5f8700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78240c8c40 con 0x7f78240af4e0 2023-10-06T01:41:11.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.119+0000 7f7829b93700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78240af8b0 0x7f78240c82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:11.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.119+0000 7f7829b93700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78240af8b0 0x7f78240c82d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47382/0 (socket says 172.21.15.71:47382) 2023-10-06T01:41:11.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.119+0000 7f7829b93700 1 -- 172.21.15.71:0/3887837705 learned_addr learned my addr 172.21.15.71:0/3887837705 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:11.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.119+0000 7f782ab95700 1 --2- 172.21.15.71:0/3887837705 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f782415d460 0x7f7824152310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:11.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.119+0000 7f782a394700 1 --2- 172.21.15.71:0/3887837705 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f78240af4e0 0x7f7824155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:11.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.119+0000 7f7829b93700 1 -- 172.21.15.71:0/3887837705 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f78240af4e0 msgr2=0x7f7824155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:11.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.119+0000 7f7829b93700 1 --2- 172.21.15.71:0/3887837705 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f78240af4e0 0x7f7824155150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:11.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.119+0000 7f7829b93700 1 -- 172.21.15.71:0/3887837705 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f782415d460 msgr2=0x7f7824152310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:11.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.119+0000 7f7829b93700 1 --2- 172.21.15.71:0/3887837705 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f782415d460 0x7f7824152310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:11.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.119+0000 7f7829b93700 1 -- 172.21.15.71:0/3887837705 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78200094f0 con 0x7f78240af8b0 2023-10-06T01:41:11.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.119+0000 7f7829b93700 1 --2- 172.21.15.71:0/3887837705 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78240af8b0 0x7f78240c82d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f781400b6c0 tx=0x7f7814017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:11.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.119+0000 7f781a7fc700 1 -- 172.21.15.71:0/3887837705 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f781400b910 con 0x7f78240af8b0 2023-10-06T01:41:11.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.119+0000 7f781a7fc700 1 -- 172.21.15.71:0/3887837705 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f781400ba70 con 0x7f78240af8b0 2023-10-06T01:41:11.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.119+0000 7f782c5f8700 1 -- 172.21.15.71:0/3887837705 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7814009420 con 0x7f78240af8b0 2023-10-06T01:41:11.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.119+0000 7f781a7fc700 1 -- 172.21.15.71:0/3887837705 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7814024670 con 0x7f78240af8b0 2023-10-06T01:41:11.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.119+0000 7f782c5f8700 1 -- 172.21.15.71:0/3887837705 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78240c9200 con 0x7f78240af8b0 2023-10-06T01:41:11.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.120+0000 7f782c5f8700 1 -- 172.21.15.71:0/3887837705 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78240c99e0 con 0x7f78240af8b0 2023-10-06T01:41:11.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.121+0000 7f781a7fc700 1 -- 172.21.15.71:0/3887837705 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f781402d440 con 0x7f78240af8b0 2023-10-06T01:41:11.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.121+0000 7f781a7fc700 1 --2- 172.21.15.71:0/3887837705 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7808066f30 0x7f78080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:11.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.121+0000 7f781a7fc700 1 -- 172.21.15.71:0/3887837705 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f7814086250 con 0x7f78240af8b0 2023-10-06T01:41:11.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.121+0000 7f782a394700 1 --2- 172.21.15.71:0/3887837705 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7808066f30 0x7f78080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:11.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.121+0000 7f782a394700 1 --2- 172.21.15.71:0/3887837705 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7808066f30 0x7f78080693e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7820006d20 tx=0x7f7820009250 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:11.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.125+0000 7f781a7fc700 1 -- 172.21.15.71:0/3887837705 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f78140530b0 con 0x7f78240af8b0 2023-10-06T01:41:11.314 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.313+0000 7f782c5f8700 1 -- 172.21.15.71:0/3887837705 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f78240c9be0 con 0x7f78240af8b0 2023-10-06T01:41:11.314 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.314+0000 7f781a7fc700 1 -- 172.21.15.71:0/3887837705 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18754 (secure 0 0 0) 0x7f78140566d0 con 0x7f78240af8b0 2023-10-06T01:41:11.315 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:41:11.315 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":29,"fsid":"1fbf1bd2-f9b4-4599-bea2-f4aa920e9a56","created":"2023-10-06T01:39:57.016957+0000","modified":"2023-10-06T01:41:03.811605+0000","last_up_change":"2023-10-06T01:40:08.571643+0000","last_in_change":"2023-10-06T01:39:59.462741+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T01:40:08.610349+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T01:40:15.387434+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T01:40:19.640459+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T01:40:20.116883+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T01:40:23.830129+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cf059188-fb20-4dbf-95db-dcf57b213d03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":90670},{"type":"v1","addr":"172.21.15.71:6817","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":90670},{"type":"v1","addr":"172.21.15.71:6819","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":90670},{"type":"v1","addr":"172.21.15.71:6823","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":90670},{"type":"v1","addr":"172.21.15.71:6821","nonce":90670}]},"public_addr":"172.21.15.71:6817/90670","cluster_addr":"172.21.15.71:6819/90670","heartbeat_back_addr":"172.21.15.71:6823/90670","heartbeat_front_addr":"172.21.15.71:6821/90670","state":["exists","up"]},{"osd":1,"uuid":"0cff0aae-1799-4fe0-b610-54cf0813c0e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":90669},{"type":"v1","addr":"172.21.15.71:6809","nonce":90669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":90669},{"type":"v1","addr":"172.21.15.71:6811","nonce":90669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":90669},{"type":"v1","addr":"172.21.15.71:6815","nonce":90669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":90669},{"type":"v1","addr":"172.21.15.71:6813","nonce":90669}]},"public_addr":"172.21.15.71:6809/90669","cluster_addr":"172.21.15.71:6811/90669","heartbeat_back_addr":"172.21.15.71:6815/90669","heartbeat_front_addr":"172.21.15.71:6813/90669","state":["exists","up"]},{"osd":2,"uuid":"88d61ddc-9031-44e1-ba8c-546a41e7c8ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":90679},{"type":"v1","addr":"172.21.15.71:6825","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":90679},{"type":"v1","addr":"172.21.15.71:6827","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":90679},{"type":"v1","addr":"172.21.15.71:6831","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":90679},{"type":"v1","addr":"172.21.15.71:6829","nonce":90679}]},"public_addr":"172.21.15.71:6825/90679","cluster_addr":"172.21.15.71:6827/90679","heartbeat_back_addr":"172.21.15.71:6831/90679","heartbeat_front_addr":"172.21.15.71:6829/90679","state":["exists","up"]},{"osd":3,"uuid":"11ed92b7-960b-4a30-a889-a61d3eeb86f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":90668},{"type":"v1","addr":"172.21.15.71:6801","nonce":90668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":90668},{"type":"v1","addr":"172.21.15.71:6803","nonce":90668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":90668},{"type":"v1","addr":"172.21.15.71:6807","nonce":90668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":90668},{"type":"v1","addr":"172.21.15.71:6805","nonce":90668}]},"public_addr":"172.21.15.71:6801/90668","cluster_addr":"172.21.15.71:6803/90668","heartbeat_back_addr":"172.21.15.71:6807/90668","heartbeat_front_addr":"172.21.15.71:6805/90668","state":["exists","up"]},{"osd":4,"uuid":"ae4df784-abdf-4ddf-aefa-780f3ddafef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":90917},{"type":"v1","addr":"172.21.15.72:6801","nonce":90917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":90917},{"type":"v1","addr":"172.21.15.72:6803","nonce":90917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":90917},{"type":"v1","addr":"172.21.15.72:6807","nonce":90917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":90917},{"type":"v1","addr":"172.21.15.72:6805","nonce":90917}]},"public_addr":"172.21.15.72:6801/90917","cluster_addr":"172.21.15.72:6803/90917","heartbeat_back_addr":"172.21.15.72:6807/90917","heartbeat_front_addr":"172.21.15.72:6805/90917","state":["exists","up"]},{"osd":5,"uuid":"5ef0790f-001e-458f-a05b-efae216cf435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":90941},{"type":"v1","addr":"172.21.15.72:6817","nonce":90941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":90941},{"type":"v1","addr":"172.21.15.72:6819","nonce":90941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":90941},{"type":"v1","addr":"172.21.15.72:6827","nonce":90941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":90941},{"type":"v1","addr":"172.21.15.72:6823","nonce":90941}]},"public_addr":"172.21.15.72:6817/90941","cluster_addr":"172.21.15.72:6819/90941","heartbeat_back_addr":"172.21.15.72:6827/90941","heartbeat_front_addr":"172.21.15.72:6823/90941","state":["exists","up"]},{"osd":6,"uuid":"8705aef1-9ae8-4e54-a3c4-c2909fa0ceb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":90918},{"type":"v1","addr":"172.21.15.72:6809","nonce":90918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":90918},{"type":"v1","addr":"172.21.15.72:6811","nonce":90918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":90918},{"type":"v1","addr":"172.21.15.72:6815","nonce":90918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":90918},{"type":"v1","addr":"172.21.15.72:6813","nonce":90918}]},"public_addr":"172.21.15.72:6809/90918","cluster_addr":"172.21.15.72:6811/90918","heartbeat_back_addr":"172.21.15.72:6815/90918","heartbeat_front_addr":"172.21.15.72:6813/90918","state":["exists","up"]},{"osd":7,"uuid":"364c5119-6b13-4c75-b3f0-15e165eff86a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":90948},{"type":"v1","addr":"172.21.15.72:6822","nonce":90948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":90948},{"type":"v1","addr":"172.21.15.72:6826","nonce":90948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":90948},{"type":"v1","addr":"172.21.15.72:6831","nonce":90948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":90948},{"type":"v1","addr":"172.21.15.72:6829","nonce":90948}]},"public_addr":"172.21.15.72:6822/90948","cluster_addr":"172.21.15.72:6826/90948","heartbeat_back_addr":"172.21.15.72:6831/90948","heartbeat_front_addr":"172.21.15.72:6829/90948","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.642976+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.645372+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.619116+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.663042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.599163+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.646411+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.631545+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.669821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.a","mappings":[{"from":1,"to":5}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:41:11.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.316+0000 7f782c5f8700 1 -- 172.21.15.71:0/3887837705 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7808066f30 msgr2=0x7f78080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:11.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.316+0000 7f782c5f8700 1 --2- 172.21.15.71:0/3887837705 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7808066f30 0x7f78080693e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7820006d20 tx=0x7f7820009250 comp rx=0 tx=0).stop 2023-10-06T01:41:11.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.316+0000 7f782c5f8700 1 -- 172.21.15.71:0/3887837705 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78240af8b0 msgr2=0x7f78240c82d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:11.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.316+0000 7f782c5f8700 1 --2- 172.21.15.71:0/3887837705 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78240af8b0 0x7f78240c82d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f781400b6c0 tx=0x7f7814017000 comp rx=0 tx=0).stop 2023-10-06T01:41:11.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.316+0000 7f782c5f8700 1 -- 172.21.15.71:0/3887837705 shutdown_connections 2023-10-06T01:41:11.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.316+0000 7f782c5f8700 1 --2- 172.21.15.71:0/3887837705 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7808066f30 0x7f78080693e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:11.318 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.316+0000 7f782c5f8700 1 --2- 172.21.15.71:0/3887837705 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f782415d460 0x7f7824152310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:11.318 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.316+0000 7f782c5f8700 1 --2- 172.21.15.71:0/3887837705 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f78240af4e0 0x7f7824155150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:11.318 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.316+0000 7f782c5f8700 1 --2- 172.21.15.71:0/3887837705 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78240af8b0 0x7f78240c82d0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:11.318 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.316+0000 7f782c5f8700 1 -- 172.21.15.71:0/3887837705 >> 172.21.15.71:0/3887837705 conn(0x7f7824068680 msgr2=0x7f78240d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:11.318 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.316+0000 7f782c5f8700 1 -- 172.21.15.71:0/3887837705 shutdown_connections 2023-10-06T01:41:11.318 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.316+0000 7f782c5f8700 1 -- 172.21.15.71:0/3887837705 wait complete. 2023-10-06T01:41:11.328 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T01:40:08.610349+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T01:40:15.387434+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T01:40:19.640459+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T01:40:20.116883+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-06T01:40:23.830129+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T01:41:11.329 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T01:41:11.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.445+0000 7f60f67c2700 1 Processor -- start 2023-10-06T01:41:11.491 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.445+0000 7f60f67c2700 1 -- start start 2023-10-06T01:41:11.496 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.446+0000 7f60f67c2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f60f00d0400 0x7f60f00b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:11.496 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.446+0000 7f60f67c2700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f60f00ccd40 0x7f60f00cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:11.496 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.446+0000 7f60f67c2700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60f00b6170 con 0x7f60f00cf7e0 2023-10-06T01:41:11.496 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.446+0000 7f60f67c2700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60f015dd40 con 0x7f60f00ccd40 2023-10-06T01:41:11.496 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.446+0000 7f60f67c2700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60f015e020 con 0x7f60f00d0400 2023-10-06T01:41:11.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.446+0000 7f60ef7fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f60f00ccd40 0x7f60f00cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:11.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.446+0000 7f60f4d5f700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f60f00cf7e0 0x7f60f00b3aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:39730/0 (socket says 172.21.15.71:39730) 2023-10-06T01:41:11.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.446+0000 7f60f4d5f700 1 -- 172.21.15.71:0/4265109449 learned_addr learned my addr 172.21.15.71:0/4265109449 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:41:11.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.446+0000 7f60effff700 1 --2- 172.21.15.71:0/4265109449 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f60f00d0400 0x7f60f00b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:11.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.446+0000 7f60ef7fe700 1 -- 172.21.15.71:0/4265109449 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f60f00d0400 msgr2=0x7f60f00b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:11.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.446+0000 7f60ef7fe700 1 --2- 172.21.15.71:0/4265109449 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f60f00d0400 0x7f60f00b5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:11.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.446+0000 7f60ef7fe700 1 -- 172.21.15.71:0/4265109449 >> v1:172.21.15.71:6789/0 conn(0x7f60f00cf7e0 legacy=0x7f60f00b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:11.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.446+0000 7f60ef7fe700 1 -- 172.21.15.71:0/4265109449 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60f00ceaa0 con 0x7f60f00ccd40 2023-10-06T01:41:11.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.446+0000 7f60eeffd700 1 -- 172.21.15.71:0/4265109449 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1488658038 0 0) 0x7f60f00b6170 con 0x7f60f00cf7e0 2023-10-06T01:41:11.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.446+0000 7f60effff700 1 --2- 172.21.15.71:0/4265109449 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f60f00d0400 0x7f60f00b5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:41:11.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.447+0000 7f60ef7fe700 1 --2- 172.21.15.71:0/4265109449 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f60f00ccd40 0x7f60f00cf2a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f60e40098e0 tx=0x7f60e40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c44d4bf04c4f383 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:11.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.447+0000 7f60eeffd700 1 -- 172.21.15.71:0/4265109449 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e4009e80 con 0x7f60f00ccd40 2023-10-06T01:41:11.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.447+0000 7f60eeffd700 1 -- 172.21.15.71:0/4265109449 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60e400b860 con 0x7f60f00ccd40 2023-10-06T01:41:11.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.447+0000 7f60eeffd700 1 -- 172.21.15.71:0/4265109449 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e400bbe0 con 0x7f60f00ccd40 2023-10-06T01:41:11.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.447+0000 7f60f67c2700 1 -- 172.21.15.71:0/4265109449 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f60f00ccd40 msgr2=0x7f60f00cf2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:11.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.447+0000 7f60f67c2700 1 --2- 172.21.15.71:0/4265109449 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f60f00ccd40 0x7f60f00cf2a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f60e40098e0 tx=0x7f60e40091a0 comp rx=0 tx=0).stop 2023-10-06T01:41:11.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.447+0000 7f60f67c2700 1 -- 172.21.15.71:0/4265109449 shutdown_connections 2023-10-06T01:41:11.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.447+0000 7f60f67c2700 1 --2- 172.21.15.71:0/4265109449 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f60f00d0400 0x7f60f00b5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:11.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.447+0000 7f60f67c2700 1 --2- 172.21.15.71:0/4265109449 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f60f00ccd40 0x7f60f00cf2a0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:11.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.447+0000 7f60f67c2700 1 -- 172.21.15.71:0/4265109449 >> 172.21.15.71:0/4265109449 conn(0x7f60f006a220 msgr2=0x7f60f006a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:11.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.447+0000 7f60f67c2700 1 -- 172.21.15.71:0/4265109449 shutdown_connections 2023-10-06T01:41:11.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.447+0000 7f60f67c2700 1 -- 172.21.15.71:0/4265109449 wait complete. 2023-10-06T01:41:11.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.448+0000 7f60f67c2700 1 Processor -- start 2023-10-06T01:41:11.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.449+0000 7f60f67c2700 1 -- start start 2023-10-06T01:41:11.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.449+0000 7f60f67c2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f60f00ccd40 0x7f60f0153270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:11.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.449+0000 7f60f67c2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60f00cf7e0 0x7f60f015b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:11.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.449+0000 7f60f67c2700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f60f00d0400 0x7f60f0169700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:11.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.449+0000 7f60f67c2700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f015b4b0 con 0x7f60f00d0400 2023-10-06T01:41:11.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.449+0000 7f60f67c2700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f015a8a0 con 0x7f60f00cf7e0 2023-10-06T01:41:11.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.449+0000 7f60f67c2700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60f015ab80 con 0x7f60f00ccd40 2023-10-06T01:41:11.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.449+0000 7f60f4d5f700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f60f00d0400 0x7f60f0169700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:11.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.449+0000 7f60f4d5f700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f60f00d0400 0x7f60f0169700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47406/0 (socket says 172.21.15.71:47406) 2023-10-06T01:41:11.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.449+0000 7f60f4d5f700 1 -- 172.21.15.71:0/2981286117 learned_addr learned my addr 172.21.15.71:0/2981286117 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:11.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.450+0000 7f60effff700 1 --2- 172.21.15.71:0/2981286117 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f60f00ccd40 0x7f60f0153270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:11.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.450+0000 7f60f4d5f700 1 -- 172.21.15.71:0/2981286117 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f60f00ccd40 msgr2=0x7f60f0153270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:11.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.450+0000 7f60f4d5f700 1 --2- 172.21.15.71:0/2981286117 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f60f00ccd40 0x7f60f0153270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:11.502 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.450+0000 7f60ef7fe700 1 --2- 172.21.15.71:0/2981286117 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60f00cf7e0 0x7f60f015b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:11.502 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.450+0000 7f60f4d5f700 1 -- 172.21.15.71:0/2981286117 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60f00cf7e0 msgr2=0x7f60f015b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:11.502 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.450+0000 7f60f4d5f700 1 --2- 172.21.15.71:0/2981286117 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60f00cf7e0 0x7f60f015b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:11.502 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.450+0000 7f60f4d5f700 1 -- 172.21.15.71:0/2981286117 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60e4009420 con 0x7f60f00d0400 2023-10-06T01:41:11.502 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.450+0000 7f60effff700 1 --2- 172.21.15.71:0/2981286117 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f60f00ccd40 0x7f60f0153270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:41:11.502 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.450+0000 7f60ef7fe700 1 --2- 172.21.15.71:0/2981286117 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60f00cf7e0 0x7f60f015b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:41:11.502 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.450+0000 7f60f4d5f700 1 --2- 172.21.15.71:0/2981286117 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f60f00d0400 0x7f60f0169700 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f60e800cc90 tx=0x7f60e8001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:11.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.450+0000 7f60d7fff700 1 -- 172.21.15.71:0/2981286117 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e800cea0 con 0x7f60f00d0400 2023-10-06T01:41:11.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.450+0000 7f60d7fff700 1 -- 172.21.15.71:0/2981286117 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60e800ab70 con 0x7f60f00d0400 2023-10-06T01:41:11.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.450+0000 7f60f67c2700 1 -- 172.21.15.71:0/2981286117 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60f015ae60 con 0x7f60f00d0400 2023-10-06T01:41:11.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.450+0000 7f60d7fff700 1 -- 172.21.15.71:0/2981286117 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e80070f0 con 0x7f60f00d0400 2023-10-06T01:41:11.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.450+0000 7f60f67c2700 1 -- 172.21.15.71:0/2981286117 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60f015be80 con 0x7f60f00d0400 2023-10-06T01:41:11.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.451+0000 7f60f67c2700 1 -- 172.21.15.71:0/2981286117 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60f0088760 con 0x7f60f00d0400 2023-10-06T01:41:11.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.451+0000 7f60d7fff700 1 -- 172.21.15.71:0/2981286117 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f60e80074a0 con 0x7f60f00d0400 2023-10-06T01:41:11.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.452+0000 7f60d7fff700 1 --2- 172.21.15.71:0/2981286117 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f60dc066f30 0x7f60dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:11.504 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.452+0000 7f60d7fff700 1 -- 172.21.15.71:0/2981286117 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f60e8084f10 con 0x7f60f00d0400 2023-10-06T01:41:11.504 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.452+0000 7f60effff700 1 --2- 172.21.15.71:0/2981286117 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f60dc066f30 0x7f60dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:11.504 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.452+0000 7f60effff700 1 --2- 172.21.15.71:0/2981286117 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f60dc066f30 0x7f60dc0693e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f60e0008a60 tx=0x7f60e0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:11.504 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.456+0000 7f60d7fff700 1 -- 172.21.15.71:0/2981286117 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f60e8051cd0 con 0x7f60f00d0400 2023-10-06T01:41:11.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.637+0000 7f60f67c2700 1 -- 172.21.15.71:0/2981286117 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f60f00ced80 con 0x7f60f00d0400 2023-10-06T01:41:11.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.638+0000 7f60d7fff700 1 -- 172.21.15.71:0/2981286117 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f60e80552f0 con 0x7f60f00d0400 2023-10-06T01:41:11.639 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 1 2023-10-06T01:41:11.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.640+0000 7f60f67c2700 1 -- 172.21.15.71:0/2981286117 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f60dc066f30 msgr2=0x7f60dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:11.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.640+0000 7f60f67c2700 1 --2- 172.21.15.71:0/2981286117 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f60dc066f30 0x7f60dc0693e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f60e0008a60 tx=0x7f60e0008040 comp rx=0 tx=0).stop 2023-10-06T01:41:11.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.640+0000 7f60f67c2700 1 -- 172.21.15.71:0/2981286117 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f60f00d0400 msgr2=0x7f60f0169700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:11.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.640+0000 7f60f67c2700 1 --2- 172.21.15.71:0/2981286117 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f60f00d0400 0x7f60f0169700 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f60e800cc90 tx=0x7f60e8001a80 comp rx=0 tx=0).stop 2023-10-06T01:41:11.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.640+0000 7f60f67c2700 1 -- 172.21.15.71:0/2981286117 shutdown_connections 2023-10-06T01:41:11.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.640+0000 7f60f67c2700 1 --2- 172.21.15.71:0/2981286117 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f60f00d0400 0x7f60f0169700 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:11.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.640+0000 7f60f67c2700 1 --2- 172.21.15.71:0/2981286117 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f60f00ccd40 0x7f60f0153270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:11.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.640+0000 7f60f67c2700 1 --2- 172.21.15.71:0/2981286117 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f60dc066f30 0x7f60dc0693e0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:11.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.640+0000 7f60f67c2700 1 --2- 172.21.15.71:0/2981286117 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60f00cf7e0 0x7f60f015b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:11.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.640+0000 7f60f67c2700 1 -- 172.21.15.71:0/2981286117 >> 172.21.15.71:0/2981286117 conn(0x7f60f006a220 msgr2=0x7f60f0153f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:11.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.640+0000 7f60f67c2700 1 -- 172.21.15.71:0/2981286117 shutdown_connections 2023-10-06T01:41:11.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.640+0000 7f60f67c2700 1 -- 172.21.15.71:0/2981286117 wait complete. 2023-10-06T01:41:11.653 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T01:41:11.769 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.769+0000 7fa80e975700 1 Processor -- start 2023-10-06T01:41:11.769 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.769+0000 7fa80e975700 1 -- start start 2023-10-06T01:41:11.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.770+0000 7fa80e975700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fa8081574b0 0x7fa8080b0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:11.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.770+0000 7fa80e975700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa8080c46e0 0x7fa8080cbcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:11.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.770+0000 7fa80e975700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8080c3b40 con 0x7fa8080b13f0 2023-10-06T01:41:11.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.770+0000 7fa80e975700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8080c2f30 con 0x7fa8081574b0 2023-10-06T01:41:11.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.770+0000 7fa80e975700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8080c3210 con 0x7fa8080c46e0 2023-10-06T01:41:11.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.770+0000 7fa807fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fa8081574b0 0x7fa8080b0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:11.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.770+0000 7fa8077fe700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fa8080b13f0 0x7fa8080c3fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:39742/0 (socket says 172.21.15.71:39742) 2023-10-06T01:41:11.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.770+0000 7fa8077fe700 1 -- 172.21.15.71:0/3453592226 learned_addr learned my addr 172.21.15.71:0/3453592226 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:41:11.773 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.770+0000 7fa80cf12700 1 --2- 172.21.15.71:0/3453592226 >> v2:172.21.15.72:3300/0 conn(0x7fa8080c46e0 0x7fa8080cbcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:11.773 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.770+0000 7fa807fff700 1 -- 172.21.15.71:0/3453592226 >> v2:172.21.15.72:3300/0 conn(0x7fa8080c46e0 msgr2=0x7fa8080cbcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:11.773 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.770+0000 7fa807fff700 1 --2- 172.21.15.71:0/3453592226 >> v2:172.21.15.72:3300/0 conn(0x7fa8080c46e0 0x7fa8080cbcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:11.773 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.770+0000 7fa807fff700 1 -- 172.21.15.71:0/3453592226 >> v1:172.21.15.71:6789/0 conn(0x7fa8080b13f0 legacy=0x7fa8080c3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:11.773 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.770+0000 7fa807fff700 1 -- 172.21.15.71:0/3453592226 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8080c34f0 con 0x7fa8081574b0 2023-10-06T01:41:11.773 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.770+0000 7fa807fff700 1 --2- 172.21.15.71:0/3453592226 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8081574b0 0x7fa8080b0eb0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fa80806be40 tx=0x7fa7f8009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5179ebacf1007f1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:11.773 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.770+0000 7fa806ffd700 1 -- 172.21.15.71:0/3453592226 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f8005c10 con 0x7fa8081574b0 2023-10-06T01:41:11.773 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.770+0000 7fa806ffd700 1 -- 172.21.15.71:0/3453592226 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7f8005d70 con 0x7fa8081574b0 2023-10-06T01:41:11.773 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.770+0000 7fa806ffd700 1 -- 172.21.15.71:0/3453592226 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f8006260 con 0x7fa8081574b0 2023-10-06T01:41:11.774 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.771+0000 7fa80e975700 1 -- 172.21.15.71:0/3453592226 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8081574b0 msgr2=0x7fa8080b0eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:11.774 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.771+0000 7fa80e975700 1 --2- 172.21.15.71:0/3453592226 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8081574b0 0x7fa8080b0eb0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fa80806be40 tx=0x7fa7f8009120 comp rx=0 tx=0).stop 2023-10-06T01:41:11.774 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.771+0000 7fa80e975700 1 -- 172.21.15.71:0/3453592226 shutdown_connections 2023-10-06T01:41:11.774 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.771+0000 7fa80e975700 1 --2- 172.21.15.71:0/3453592226 >> v2:172.21.15.72:3300/0 conn(0x7fa8080c46e0 0x7fa8080cbcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:11.774 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.771+0000 7fa80e975700 1 --2- 172.21.15.71:0/3453592226 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8081574b0 0x7fa8080b0eb0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:11.774 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.771+0000 7fa80e975700 1 -- 172.21.15.71:0/3453592226 >> 172.21.15.71:0/3453592226 conn(0x7fa808067910 msgr2=0x7fa8080ce0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:11.774 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.771+0000 7fa80e975700 1 -- 172.21.15.71:0/3453592226 shutdown_connections 2023-10-06T01:41:11.774 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.771+0000 7fa80e975700 1 -- 172.21.15.71:0/3453592226 wait complete. 2023-10-06T01:41:11.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.772+0000 7fa80e975700 1 Processor -- start 2023-10-06T01:41:11.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.772+0000 7fa80e975700 1 -- start start 2023-10-06T01:41:11.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.773+0000 7fa80e975700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8080b13f0 0x7fa8081546f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:11.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.773+0000 7fa80e975700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8080c46e0 0x7fa808158c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:11.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.773+0000 7fa80e975700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa8081574b0 0x7fa80815a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:11.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.773+0000 7fa80e975700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa808154260 con 0x7fa8080c46e0 2023-10-06T01:41:11.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.773+0000 7fa80e975700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa808153650 con 0x7fa8080b13f0 2023-10-06T01:41:11.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.773+0000 7fa80e975700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa808153930 con 0x7fa8081574b0 2023-10-06T01:41:11.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.773+0000 7fa8077fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8080c46e0 0x7fa808158c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:11.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.773+0000 7fa8077fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8080c46e0 0x7fa808158c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47420/0 (socket says 172.21.15.71:47420) 2023-10-06T01:41:11.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.773+0000 7fa8077fe700 1 -- 172.21.15.71:0/789747322 learned_addr learned my addr 172.21.15.71:0/789747322 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:11.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.773+0000 7fa807fff700 1 --2- 172.21.15.71:0/789747322 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8080b13f0 0x7fa8081546f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:11.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.773+0000 7fa80cf12700 1 --2- 172.21.15.71:0/789747322 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa8081574b0 0x7fa80815a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:11.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.773+0000 7fa8077fe700 1 -- 172.21.15.71:0/789747322 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa8081574b0 msgr2=0x7fa80815a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:11.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.773+0000 7fa8077fe700 1 --2- 172.21.15.71:0/789747322 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa8081574b0 0x7fa80815a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:11.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.773+0000 7fa8077fe700 1 -- 172.21.15.71:0/789747322 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8080b13f0 msgr2=0x7fa8081546f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:11.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.773+0000 7fa8077fe700 1 --2- 172.21.15.71:0/789747322 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8080b13f0 0x7fa8081546f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:11.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.773+0000 7fa8077fe700 1 -- 172.21.15.71:0/789747322 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7f80093c0 con 0x7fa8080c46e0 2023-10-06T01:41:11.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.773+0000 7fa8077fe700 1 --2- 172.21.15.71:0/789747322 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8080c46e0 0x7fa808158c50 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc00c7c0 tx=0x7fa7fc007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:11.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.773+0000 7fa7effff700 1 -- 172.21.15.71:0/789747322 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7fc005b30 con 0x7fa8080c46e0 2023-10-06T01:41:11.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.774+0000 7fa7effff700 1 -- 172.21.15.71:0/789747322 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7fc005c90 con 0x7fa8080c46e0 2023-10-06T01:41:11.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.774+0000 7fa80e975700 1 -- 172.21.15.71:0/789747322 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa808153c10 con 0x7fa8080c46e0 2023-10-06T01:41:11.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.774+0000 7fa7effff700 1 -- 172.21.15.71:0/789747322 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7fc004a80 con 0x7fa8080c46e0 2023-10-06T01:41:11.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.774+0000 7fa80e975700 1 -- 172.21.15.71:0/789747322 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa808154c30 con 0x7fa8080c46e0 2023-10-06T01:41:11.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.774+0000 7fa80e975700 1 -- 172.21.15.71:0/789747322 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa808154410 con 0x7fa8080c46e0 2023-10-06T01:41:11.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.775+0000 7fa7effff700 1 -- 172.21.15.71:0/789747322 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa7fc0070d0 con 0x7fa8080c46e0 2023-10-06T01:41:11.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.775+0000 7fa7effff700 1 --2- 172.21.15.71:0/789747322 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fa7f4066f60 0x7fa7f4069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:11.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.775+0000 7fa7effff700 1 -- 172.21.15.71:0/789747322 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6867+0+0 (secure 0 0 0) 0x7fa7fc083cc0 con 0x7fa8080c46e0 2023-10-06T01:41:11.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.775+0000 7fa807fff700 1 --2- 172.21.15.71:0/789747322 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fa7f4066f60 0x7fa7f4069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:11.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.776+0000 7fa807fff700 1 --2- 172.21.15.71:0/789747322 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fa7f4066f60 0x7fa7f4069410 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa7f8009160 tx=0x7fa7f8016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:11.781 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.779+0000 7fa7effff700 1 -- 172.21.15.71:0/789747322 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa7fc04b5a0 con 0x7fa8080c46e0 2023-10-06T01:41:11.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.962+0000 7fa80e975700 1 -- 172.21.15.71:0/789747322 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa80806e590 con 0x7fa8080c46e0 2023-10-06T01:41:11.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.963+0000 7fa7effff700 1 -- 172.21.15.71:0/789747322 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa7fc083070 con 0x7fa8080c46e0 2023-10-06T01:41:11.964 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 8 2023-10-06T01:41:11.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.965+0000 7fa80e975700 1 -- 172.21.15.71:0/789747322 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fa7f4066f60 msgr2=0x7fa7f4069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:11.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.965+0000 7fa80e975700 1 --2- 172.21.15.71:0/789747322 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fa7f4066f60 0x7fa7f4069410 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa7f8009160 tx=0x7fa7f8016000 comp rx=0 tx=0).stop 2023-10-06T01:41:11.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.965+0000 7fa80e975700 1 -- 172.21.15.71:0/789747322 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8080c46e0 msgr2=0x7fa808158c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:11.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.965+0000 7fa80e975700 1 --2- 172.21.15.71:0/789747322 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8080c46e0 0x7fa808158c50 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc00c7c0 tx=0x7fa7fc007f70 comp rx=0 tx=0).stop 2023-10-06T01:41:11.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.965+0000 7fa80e975700 1 -- 172.21.15.71:0/789747322 shutdown_connections 2023-10-06T01:41:11.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.965+0000 7fa80e975700 1 --2- 172.21.15.71:0/789747322 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa8081574b0 0x7fa80815a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:11.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.965+0000 7fa80e975700 1 --2- 172.21.15.71:0/789747322 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fa7f4066f60 0x7fa7f4069410 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:11.967 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.965+0000 7fa80e975700 1 --2- 172.21.15.71:0/789747322 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8080b13f0 0x7fa8081546f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:11.967 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.965+0000 7fa80e975700 1 --2- 172.21.15.71:0/789747322 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8080c46e0 0x7fa808158c50 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:11.967 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.965+0000 7fa80e975700 1 -- 172.21.15.71:0/789747322 >> 172.21.15.71:0/789747322 conn(0x7fa808067910 msgr2=0x7fa80806d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:11.967 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.965+0000 7fa80e975700 1 -- 172.21.15.71:0/789747322 shutdown_connections 2023-10-06T01:41:11.967 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:11.965+0000 7fa80e975700 1 -- 172.21.15.71:0/789747322 wait complete. 2023-10-06T01:41:11.978 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T01:41:12.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.094+0000 7fab6f1b3700 1 Processor -- start 2023-10-06T01:41:12.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.094+0000 7fab6f1b3700 1 -- start start 2023-10-06T01:41:12.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.095+0000 7fab6f1b3700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fab680ccd40 0x7fab680cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:12.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.095+0000 7fab6f1b3700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fab680cf7e0 0x7fab680b3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:12.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.095+0000 7fab6f1b3700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab6815dd40 con 0x7fab680d0400 2023-10-06T01:41:12.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.095+0000 7fab6f1b3700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab6815e020 con 0x7fab680cf7e0 2023-10-06T01:41:12.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.095+0000 7fab6f1b3700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab680ceaa0 con 0x7fab680ccd40 2023-10-06T01:41:12.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.095+0000 7fab6d750700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fab680cf7e0 0x7fab680b3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:12.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.095+0000 7fab6cf4f700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fab680d0400 0x7fab680b5c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:39752/0 (socket says 172.21.15.71:39752) 2023-10-06T01:41:12.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.095+0000 7fab6cf4f700 1 -- 172.21.15.71:0/22925047 learned_addr learned my addr 172.21.15.71:0/22925047 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:41:12.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.095+0000 7fab677fe700 1 -- 172.21.15.71:0/22925047 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2128769523 0 0) 0x7fab6815dd40 con 0x7fab680d0400 2023-10-06T01:41:12.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.095+0000 7fab677fe700 1 -- 172.21.15.71:0/22925047 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab58003570 con 0x7fab680d0400 2023-10-06T01:41:12.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.095+0000 7fab67fff700 1 --2- 172.21.15.71:0/22925047 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fab680ccd40 0x7fab680cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:12.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.095+0000 7fab6d750700 1 -- 172.21.15.71:0/22925047 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fab680ccd40 msgr2=0x7fab680cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:12.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.095+0000 7fab6d750700 1 --2- 172.21.15.71:0/22925047 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fab680ccd40 0x7fab680cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:12.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.095+0000 7fab6d750700 1 -- 172.21.15.71:0/22925047 >> v1:172.21.15.71:6789/0 conn(0x7fab680d0400 legacy=0x7fab680b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:12.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.095+0000 7fab6d750700 1 -- 172.21.15.71:0/22925047 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab680ced80 con 0x7fab680cf7e0 2023-10-06T01:41:12.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.095+0000 7fab6d750700 1 --2- 172.21.15.71:0/22925047 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab680cf7e0 0x7fab680b3aa0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fab60009e60 tx=0x7fab60009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=517ba898d5066168 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:12.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.095+0000 7fab677fe700 1 -- 172.21.15.71:0/22925047 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab6000e070 con 0x7fab680cf7e0 2023-10-06T01:41:12.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.095+0000 7fab677fe700 1 -- 172.21.15.71:0/22925047 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab6000bb60 con 0x7fab680cf7e0 2023-10-06T01:41:12.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.095+0000 7fab677fe700 1 -- 172.21.15.71:0/22925047 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab60012430 con 0x7fab680cf7e0 2023-10-06T01:41:12.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.096+0000 7fab6f1b3700 1 -- 172.21.15.71:0/22925047 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab680cf7e0 msgr2=0x7fab680b3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:12.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.096+0000 7fab6f1b3700 1 --2- 172.21.15.71:0/22925047 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab680cf7e0 0x7fab680b3aa0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fab60009e60 tx=0x7fab60009780 comp rx=0 tx=0).stop 2023-10-06T01:41:12.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.096+0000 7fab6f1b3700 1 -- 172.21.15.71:0/22925047 shutdown_connections 2023-10-06T01:41:12.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.096+0000 7fab6f1b3700 1 --2- 172.21.15.71:0/22925047 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab680cf7e0 0x7fab680b3aa0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:12.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.096+0000 7fab6f1b3700 1 --2- 172.21.15.71:0/22925047 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fab680ccd40 0x7fab680cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:12.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.096+0000 7fab6f1b3700 1 -- 172.21.15.71:0/22925047 >> 172.21.15.71:0/22925047 conn(0x7fab6806a220 msgr2=0x7fab6806a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:12.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.096+0000 7fab6f1b3700 1 -- 172.21.15.71:0/22925047 shutdown_connections 2023-10-06T01:41:12.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.096+0000 7fab6f1b3700 1 -- 172.21.15.71:0/22925047 wait complete. 2023-10-06T01:41:12.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.097+0000 7fab6f1b3700 1 Processor -- start 2023-10-06T01:41:12.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.097+0000 7fab6f1b3700 1 -- start start 2023-10-06T01:41:12.102 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.098+0000 7fab6f1b3700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab680ccd40 0x7fab68144eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:12.102 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.098+0000 7fab6f1b3700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab680cf7e0 0x7fab680b44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:12.102 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.098+0000 7fab6f1b3700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fab680d0400 0x7fab680b49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:12.102 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.098+0000 7fab6f1b3700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab6815cf00 con 0x7fab680ccd40 2023-10-06T01:41:12.102 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.098+0000 7fab6f1b3700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab6815c660 con 0x7fab680cf7e0 2023-10-06T01:41:12.102 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.098+0000 7fab6f1b3700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab6815c940 con 0x7fab680d0400 2023-10-06T01:41:12.102 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.098+0000 7fab6cf4f700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab680ccd40 0x7fab68144eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:12.102 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.098+0000 7fab6cf4f700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab680ccd40 0x7fab68144eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47438/0 (socket says 172.21.15.71:47438) 2023-10-06T01:41:12.102 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.098+0000 7fab6cf4f700 1 -- 172.21.15.71:0/3751105618 learned_addr learned my addr 172.21.15.71:0/3751105618 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:12.102 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.098+0000 7fab6cf4f700 1 -- 172.21.15.71:0/3751105618 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fab680d0400 msgr2=0x7fab680b49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:12.102 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.098+0000 7fab6cf4f700 1 --2- 172.21.15.71:0/3751105618 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fab680d0400 0x7fab680b49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:12.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.098+0000 7fab6cf4f700 1 -- 172.21.15.71:0/3751105618 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab680cf7e0 msgr2=0x7fab680b44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:12.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.098+0000 7fab6cf4f700 1 --2- 172.21.15.71:0/3751105618 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab680cf7e0 0x7fab680b44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:12.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.098+0000 7fab6cf4f700 1 -- 172.21.15.71:0/3751105618 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab60009a20 con 0x7fab680ccd40 2023-10-06T01:41:12.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.098+0000 7fab6cf4f700 1 --2- 172.21.15.71:0/3751105618 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab680ccd40 0x7fab68144eb0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fab5c00c790 tx=0x7fab5c007c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:12.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.099+0000 7fab64ff9700 1 -- 172.21.15.71:0/3751105618 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab5c0072e0 con 0x7fab680ccd40 2023-10-06T01:41:12.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.099+0000 7fab64ff9700 1 -- 172.21.15.71:0/3751105618 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab5c007440 con 0x7fab680ccd40 2023-10-06T01:41:12.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.099+0000 7fab6f1b3700 1 -- 172.21.15.71:0/3751105618 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab6815cc20 con 0x7fab680ccd40 2023-10-06T01:41:12.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.099+0000 7fab64ff9700 1 -- 172.21.15.71:0/3751105618 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab5c0057f0 con 0x7fab680ccd40 2023-10-06T01:41:12.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.099+0000 7fab6f1b3700 1 -- 172.21.15.71:0/3751105618 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab681453f0 con 0x7fab680ccd40 2023-10-06T01:41:12.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.100+0000 7fab6f1b3700 1 -- 172.21.15.71:0/3751105618 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab6815a180 con 0x7fab680ccd40 2023-10-06T01:41:12.103 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.100+0000 7fab64ff9700 1 -- 172.21.15.71:0/3751105618 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fab5c005c20 con 0x7fab680ccd40 2023-10-06T01:41:12.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.100+0000 7fab64ff9700 1 --2- 172.21.15.71:0/3751105618 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fab4c066f30 0x7fab4c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:12.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.101+0000 7fab64ff9700 1 -- 172.21.15.71:0/3751105618 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6867+0+0 (secure 0 0 0) 0x7fab5c083dc0 con 0x7fab680ccd40 2023-10-06T01:41:12.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.101+0000 7fab67fff700 1 --2- 172.21.15.71:0/3751105618 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fab4c066f30 0x7fab4c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:12.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.101+0000 7fab67fff700 1 --2- 172.21.15.71:0/3751105618 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fab4c066f30 0x7fab4c0693e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fab680b5350 tx=0x7fab54008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:12.105 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.105+0000 7fab64ff9700 1 -- 172.21.15.71:0/3751105618 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fab5c04b5a0 con 0x7fab680ccd40 2023-10-06T01:41:12.288 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.287+0000 7fab6f1b3700 1 -- 172.21.15.71:0/3751105618 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fab680ce6c0 con 0x7fab680ccd40 2023-10-06T01:41:12.288 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.288+0000 7fab64ff9700 1 -- 172.21.15.71:0/3751105618 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7fab5c0170a0 con 0x7fab680ccd40 2023-10-06T01:41:12.289 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 32 2023-10-06T01:41:12.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.290+0000 7fab6f1b3700 1 -- 172.21.15.71:0/3751105618 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fab4c066f30 msgr2=0x7fab4c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:12.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.290+0000 7fab6f1b3700 1 --2- 172.21.15.71:0/3751105618 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fab4c066f30 0x7fab4c0693e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fab680b5350 tx=0x7fab54008040 comp rx=0 tx=0).stop 2023-10-06T01:41:12.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.290+0000 7fab6f1b3700 1 -- 172.21.15.71:0/3751105618 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab680ccd40 msgr2=0x7fab68144eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:12.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.290+0000 7fab6f1b3700 1 --2- 172.21.15.71:0/3751105618 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab680ccd40 0x7fab68144eb0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fab5c00c790 tx=0x7fab5c007c80 comp rx=0 tx=0).stop 2023-10-06T01:41:12.292 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.290+0000 7fab6f1b3700 1 -- 172.21.15.71:0/3751105618 shutdown_connections 2023-10-06T01:41:12.292 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.290+0000 7fab6f1b3700 1 --2- 172.21.15.71:0/3751105618 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fab680d0400 0x7fab680b49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:12.292 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.290+0000 7fab6f1b3700 1 --2- 172.21.15.71:0/3751105618 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fab680ccd40 0x7fab68144eb0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:12.292 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.290+0000 7fab6f1b3700 1 --2- 172.21.15.71:0/3751105618 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fab4c066f30 0x7fab4c0693e0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:12.292 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.290+0000 7fab6f1b3700 1 --2- 172.21.15.71:0/3751105618 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab680cf7e0 0x7fab680b44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:12.292 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.290+0000 7fab6f1b3700 1 -- 172.21.15.71:0/3751105618 >> 172.21.15.71:0/3751105618 conn(0x7fab6806a220 msgr2=0x7fab680b58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:12.292 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.290+0000 7fab6f1b3700 1 -- 172.21.15.71:0/3751105618 shutdown_connections 2023-10-06T01:41:12.292 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.290+0000 7fab6f1b3700 1 -- 172.21.15.71:0/3751105618 wait complete. 2023-10-06T01:41:12.303 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T01:41:12.418 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.418+0000 7ff6633c5700 1 Processor -- start 2023-10-06T01:41:12.419 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.418+0000 7ff6633c5700 1 -- start start 2023-10-06T01:41:12.421 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.419+0000 7ff6633c5700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff65c0ccd40 0x7ff65c0cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:12.421 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.419+0000 7ff6633c5700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff65c0cf7e0 0x7ff65c0b3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:12.422 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.419+0000 7ff6633c5700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff65c15dd40 con 0x7ff65c0d0400 2023-10-06T01:41:12.422 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.419+0000 7ff6633c5700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff65c15e020 con 0x7ff65c0ccd40 2023-10-06T01:41:12.422 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.419+0000 7ff6633c5700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff65c0ceaa0 con 0x7ff65c0cf7e0 2023-10-06T01:41:12.422 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.419+0000 7ff660960700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff65c0ccd40 0x7ff65c0cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:12.422 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.419+0000 7ff661161700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7ff65c0d0400 0x7ff65c0b5c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:39760/0 (socket says 172.21.15.71:39760) 2023-10-06T01:41:12.422 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.419+0000 7ff661161700 1 -- 172.21.15.71:0/182999202 learned_addr learned my addr 172.21.15.71:0/182999202 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:41:12.422 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.419+0000 7ff660960700 1 -- 172.21.15.71:0/182999202 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff65c0cf7e0 msgr2=0x7ff65c0b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:12.422 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.419+0000 7ff661962700 1 --2- 172.21.15.71:0/182999202 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff65c0cf7e0 0x7ff65c0b3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:12.422 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.419+0000 7ff653fff700 1 -- 172.21.15.71:0/182999202 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 61486406 0 0) 0x7ff65c15dd40 con 0x7ff65c0d0400 2023-10-06T01:41:12.422 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.419+0000 7ff660960700 1 --2- 172.21.15.71:0/182999202 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff65c0cf7e0 0x7ff65c0b3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:12.423 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.419+0000 7ff660960700 1 -- 172.21.15.71:0/182999202 >> v1:172.21.15.71:6789/0 conn(0x7ff65c0d0400 legacy=0x7ff65c0b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:12.423 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.419+0000 7ff660960700 1 -- 172.21.15.71:0/182999202 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff65c0ced80 con 0x7ff65c0ccd40 2023-10-06T01:41:12.423 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.419+0000 7ff661962700 1 --2- 172.21.15.71:0/182999202 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff65c0cf7e0 0x7ff65c0b3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:41:12.423 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.420+0000 7ff660960700 1 --2- 172.21.15.71:0/182999202 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff65c0ccd40 0x7ff65c0cf2a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ff64c0098e0 tx=0x7ff64c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85eb9c644724b5d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:12.423 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.420+0000 7ff653fff700 1 -- 172.21.15.71:0/182999202 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff64c009e80 con 0x7ff65c0ccd40 2023-10-06T01:41:12.423 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.420+0000 7ff653fff700 1 -- 172.21.15.71:0/182999202 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff64c00b860 con 0x7ff65c0ccd40 2023-10-06T01:41:12.423 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.420+0000 7ff653fff700 1 -- 172.21.15.71:0/182999202 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff64c00bbe0 con 0x7ff65c0ccd40 2023-10-06T01:41:12.423 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.420+0000 7ff6633c5700 1 -- 172.21.15.71:0/182999202 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff65c0ccd40 msgr2=0x7ff65c0cf2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:12.423 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.420+0000 7ff6633c5700 1 --2- 172.21.15.71:0/182999202 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff65c0ccd40 0x7ff65c0cf2a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ff64c0098e0 tx=0x7ff64c0091a0 comp rx=0 tx=0).stop 2023-10-06T01:41:12.423 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.420+0000 7ff6633c5700 1 -- 172.21.15.71:0/182999202 shutdown_connections 2023-10-06T01:41:12.424 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.420+0000 7ff6633c5700 1 --2- 172.21.15.71:0/182999202 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff65c0cf7e0 0x7ff65c0b3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:12.424 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.420+0000 7ff6633c5700 1 --2- 172.21.15.71:0/182999202 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff65c0ccd40 0x7ff65c0cf2a0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:12.424 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.420+0000 7ff6633c5700 1 -- 172.21.15.71:0/182999202 >> 172.21.15.71:0/182999202 conn(0x7ff65c06a220 msgr2=0x7ff65c06a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:12.424 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.420+0000 7ff6633c5700 1 -- 172.21.15.71:0/182999202 shutdown_connections 2023-10-06T01:41:12.424 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.420+0000 7ff6633c5700 1 -- 172.21.15.71:0/182999202 wait complete. 2023-10-06T01:41:12.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.421+0000 7ff6633c5700 1 Processor -- start 2023-10-06T01:41:12.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.421+0000 7ff6633c5700 1 -- start start 2023-10-06T01:41:12.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.422+0000 7ff6633c5700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff65c0ccd40 0x7ff65c154930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:12.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.422+0000 7ff6633c5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff65c0cf7e0 0x7ff65c0c6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:12.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.422+0000 7ff6633c5700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff65c0d0400 0x7ff65c152f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:12.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.422+0000 7ff6633c5700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff65c16d760 con 0x7ff65c0d0400 2023-10-06T01:41:12.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.422+0000 7ff6633c5700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff65c0c6e20 con 0x7ff65c0cf7e0 2023-10-06T01:41:12.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.422+0000 7ff6633c5700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff65c16d110 con 0x7ff65c0ccd40 2023-10-06T01:41:12.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.422+0000 7ff661962700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff65c0d0400 0x7ff65c152f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:12.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.422+0000 7ff661962700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff65c0d0400 0x7ff65c152f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47462/0 (socket says 172.21.15.71:47462) 2023-10-06T01:41:12.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.422+0000 7ff661962700 1 -- 172.21.15.71:0/928981566 learned_addr learned my addr 172.21.15.71:0/928981566 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:12.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.423+0000 7ff660960700 1 --2- 172.21.15.71:0/928981566 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff65c0cf7e0 0x7ff65c0c6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:12.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.423+0000 7ff661161700 1 --2- 172.21.15.71:0/928981566 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff65c0ccd40 0x7ff65c154930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:12.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.423+0000 7ff661962700 1 -- 172.21.15.71:0/928981566 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff65c0ccd40 msgr2=0x7ff65c154930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:12.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.423+0000 7ff661962700 1 --2- 172.21.15.71:0/928981566 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff65c0ccd40 0x7ff65c154930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:12.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.423+0000 7ff661962700 1 -- 172.21.15.71:0/928981566 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff65c0cf7e0 msgr2=0x7ff65c0c6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:12.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.423+0000 7ff661962700 1 --2- 172.21.15.71:0/928981566 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff65c0cf7e0 0x7ff65c0c6440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:12.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.423+0000 7ff661962700 1 -- 172.21.15.71:0/928981566 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff64c009420 con 0x7ff65c0d0400 2023-10-06T01:41:12.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.423+0000 7ff661161700 1 --2- 172.21.15.71:0/928981566 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff65c0ccd40 0x7ff65c154930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:41:12.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.423+0000 7ff661962700 1 --2- 172.21.15.71:0/928981566 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff65c0d0400 0x7ff65c152f00 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff65400a380 tx=0x7ff654007900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:12.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.423+0000 7ff6517fa700 1 -- 172.21.15.71:0/928981566 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff65400ae10 con 0x7ff65c0d0400 2023-10-06T01:41:12.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.423+0000 7ff6517fa700 1 -- 172.21.15.71:0/928981566 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff65400d650 con 0x7ff65c0d0400 2023-10-06T01:41:12.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.423+0000 7ff6633c5700 1 -- 172.21.15.71:0/928981566 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff65c16d3f0 con 0x7ff65c0d0400 2023-10-06T01:41:12.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.423+0000 7ff6517fa700 1 -- 172.21.15.71:0/928981566 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff65400da10 con 0x7ff65c0d0400 2023-10-06T01:41:12.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.423+0000 7ff6633c5700 1 -- 172.21.15.71:0/928981566 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff65c0af630 con 0x7ff65c0d0400 2023-10-06T01:41:12.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.424+0000 7ff6633c5700 1 -- 172.21.15.71:0/928981566 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff65c16d8d0 con 0x7ff65c0d0400 2023-10-06T01:41:12.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.424+0000 7ff6517fa700 1 -- 172.21.15.71:0/928981566 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff65401e3b0 con 0x7ff65c0d0400 2023-10-06T01:41:12.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.425+0000 7ff6517fa700 1 --2- 172.21.15.71:0/928981566 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7ff640066f30 0x7ff6400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:12.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.425+0000 7ff6517fa700 1 -- 172.21.15.71:0/928981566 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6867+0+0 (secure 0 0 0) 0x7ff654085490 con 0x7ff65c0d0400 2023-10-06T01:41:12.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.425+0000 7ff661161700 1 --2- 172.21.15.71:0/928981566 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7ff640066f30 0x7ff6400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:12.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.425+0000 7ff661161700 1 --2- 172.21.15.71:0/928981566 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7ff640066f30 0x7ff6400693e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff658001810 tx=0x7ff658009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:12.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.429+0000 7ff6517fa700 1 -- 172.21.15.71:0/928981566 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff654052270 con 0x7ff65c0d0400 2023-10-06T01:41:12.610 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.610+0000 7ff6633c5700 1 -- 172.21.15.71:0/928981566 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff65c0ce6c0 con 0x7ff65c0d0400 2023-10-06T01:41:12.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.610+0000 7ff6517fa700 1 -- 172.21.15.71:0/928981566 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff65401a020 con 0x7ff65c0d0400 2023-10-06T01:41:12.611 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 64 2023-10-06T01:41:12.613 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.612+0000 7ff6633c5700 1 -- 172.21.15.71:0/928981566 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7ff640066f30 msgr2=0x7ff6400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:12.613 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.612+0000 7ff6633c5700 1 --2- 172.21.15.71:0/928981566 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7ff640066f30 0x7ff6400693e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff658001810 tx=0x7ff658009040 comp rx=0 tx=0).stop 2023-10-06T01:41:12.613 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.612+0000 7ff6633c5700 1 -- 172.21.15.71:0/928981566 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff65c0d0400 msgr2=0x7ff65c152f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:12.613 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.612+0000 7ff6633c5700 1 --2- 172.21.15.71:0/928981566 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff65c0d0400 0x7ff65c152f00 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff65400a380 tx=0x7ff654007900 comp rx=0 tx=0).stop 2023-10-06T01:41:12.613 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.612+0000 7ff6633c5700 1 -- 172.21.15.71:0/928981566 shutdown_connections 2023-10-06T01:41:12.614 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.612+0000 7ff6633c5700 1 --2- 172.21.15.71:0/928981566 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff65c0d0400 0x7ff65c152f00 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:12.614 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.612+0000 7ff6633c5700 1 --2- 172.21.15.71:0/928981566 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff65c0ccd40 0x7ff65c154930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:12.614 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.612+0000 7ff6633c5700 1 --2- 172.21.15.71:0/928981566 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7ff640066f30 0x7ff6400693e0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:12.614 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.612+0000 7ff6633c5700 1 --2- 172.21.15.71:0/928981566 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff65c0cf7e0 0x7ff65c0c6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:12.614 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.612+0000 7ff6633c5700 1 -- 172.21.15.71:0/928981566 >> 172.21.15.71:0/928981566 conn(0x7ff65c06a220 msgr2=0x7ff65c0b47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:12.614 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.612+0000 7ff6633c5700 1 -- 172.21.15.71:0/928981566 shutdown_connections 2023-10-06T01:41:12.614 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.612+0000 7ff6633c5700 1 -- 172.21.15.71:0/928981566 wait complete. 2023-10-06T01:41:12.625 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-06T01:41:12.741 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.740+0000 7fb631722700 1 Processor -- start 2023-10-06T01:41:12.741 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.740+0000 7fb631722700 1 -- start start 2023-10-06T01:41:12.745 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.741+0000 7fb631722700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb62c0d0400 0x7fb62c0b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:12.745 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.741+0000 7fb631722700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb62c0ccd40 0x7fb62c0cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:12.745 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.741+0000 7fb631722700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb62c0b6170 con 0x7fb62c0cf7e0 2023-10-06T01:41:12.745 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.741+0000 7fb631722700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb62c15dd40 con 0x7fb62c0ccd40 2023-10-06T01:41:12.745 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.741+0000 7fb631722700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb62c15e020 con 0x7fb62c0d0400 2023-10-06T01:41:12.745 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.741+0000 7fb62b7fe700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fb62c0cf7e0 0x7fb62c0b3aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:39766/0 (socket says 172.21.15.71:39766) 2023-10-06T01:41:12.745 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.741+0000 7fb62b7fe700 1 -- 172.21.15.71:0/1086701203 learned_addr learned my addr 172.21.15.71:0/1086701203 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:41:12.746 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.741+0000 7fb6227fc700 1 --2- 172.21.15.71:0/1086701203 >> v2:172.21.15.72:3300/0 conn(0x7fb62c0ccd40 0x7fb62c0cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:12.746 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.741+0000 7fb62affd700 1 --2- 172.21.15.71:0/1086701203 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb62c0d0400 0x7fb62c0b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:12.746 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.741+0000 7fb62a7fc700 1 -- 172.21.15.71:0/1086701203 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2854356222 0 0) 0x7fb62c0b6170 con 0x7fb62c0cf7e0 2023-10-06T01:41:12.746 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.741+0000 7fb62a7fc700 1 -- 172.21.15.71:0/1086701203 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb618003570 con 0x7fb62c0cf7e0 2023-10-06T01:41:12.746 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.742+0000 7fb62a7fc700 1 -- 172.21.15.71:0/1086701203 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 216029682 0 0) 0x7fb618003570 con 0x7fb62c0cf7e0 2023-10-06T01:41:12.746 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.742+0000 7fb62a7fc700 1 -- 172.21.15.71:0/1086701203 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb62c0d0400 msgr2=0x7fb62c0b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:12.746 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.742+0000 7fb62a7fc700 1 --2- 172.21.15.71:0/1086701203 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb62c0d0400 0x7fb62c0b5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:12.746 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.742+0000 7fb62a7fc700 1 -- 172.21.15.71:0/1086701203 >> v2:172.21.15.72:3300/0 conn(0x7fb62c0ccd40 msgr2=0x7fb62c0cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:12.746 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.742+0000 7fb62a7fc700 1 --2- 172.21.15.71:0/1086701203 >> v2:172.21.15.72:3300/0 conn(0x7fb62c0ccd40 0x7fb62c0cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:12.746 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.742+0000 7fb62a7fc700 1 -- 172.21.15.71:0/1086701203 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb62c0ceaa0 con 0x7fb62c0cf7e0 2023-10-06T01:41:12.746 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.742+0000 7fb62a7fc700 1 -- 172.21.15.71:0/1086701203 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1184243524 0 0) 0x7fb6240017f0 con 0x7fb62c0cf7e0 2023-10-06T01:41:12.747 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.742+0000 7fb62a7fc700 1 -- 172.21.15.71:0/1086701203 >> v1:172.21.15.71:6789/0 conn(0x7fb62c0cf7e0 legacy=0x7fb62c0b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:12.747 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.742+0000 7fb62a7fc700 1 --2- 172.21.15.71:0/1086701203 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb618003a60 0x7fb618003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:12.747 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.742+0000 7fb62a7fc700 1 --2- 172.21.15.71:0/1086701203 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb618004810 0x7fb618004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:12.747 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.742+0000 7fb62a7fc700 1 --2- 172.21.15.71:0/1086701203 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb62c0d0400 0x7fb6180051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:12.747 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.742+0000 7fb62a7fc700 1 -- 172.21.15.71:0/1086701203 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb62c15dd40 con 0x7fb618003a60 2023-10-06T01:41:12.747 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.742+0000 7fb62a7fc700 1 -- 172.21.15.71:0/1086701203 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb62c15e020 con 0x7fb618004810 2023-10-06T01:41:12.747 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.742+0000 7fb62a7fc700 1 -- 172.21.15.71:0/1086701203 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb61800ba60 con 0x7fb62c0d0400 2023-10-06T01:41:12.747 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.742+0000 7fb62affd700 1 --2- 172.21.15.71:0/1086701203 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb618003a60 0x7fb618003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:12.747 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.742+0000 7fb62b7fe700 1 --2- 172.21.15.71:0/1086701203 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb62c0d0400 0x7fb6180051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:12.747 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.742+0000 7fb6227fc700 1 --2- 172.21.15.71:0/1086701203 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb618004810 0x7fb618004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:12.747 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.742+0000 7fb62affd700 1 -- 172.21.15.71:0/1086701203 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb62c0d0400 msgr2=0x7fb6180051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:12.748 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.742+0000 7fb62affd700 1 --2- 172.21.15.71:0/1086701203 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb62c0d0400 0x7fb6180051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:12.748 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.742+0000 7fb62affd700 1 -- 172.21.15.71:0/1086701203 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb618004810 msgr2=0x7fb618004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:12.748 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.742+0000 7fb62affd700 1 --2- 172.21.15.71:0/1086701203 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb618004810 0x7fb618004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:12.748 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.742+0000 7fb62affd700 1 -- 172.21.15.71:0/1086701203 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb618003570 con 0x7fb618003a60 2023-10-06T01:41:12.748 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.742+0000 7fb62affd700 1 --2- 172.21.15.71:0/1086701203 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb618003a60 0x7fb618003e70 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fb61c009c20 tx=0x7fb61c009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=246550e0ddaceb06 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:12.748 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.742+0000 7fb62a7fc700 1 -- 172.21.15.71:0/1086701203 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb61c005a00 con 0x7fb618003a60 2023-10-06T01:41:12.748 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.743+0000 7fb62a7fc700 1 -- 172.21.15.71:0/1086701203 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb61c005b60 con 0x7fb618003a60 2023-10-06T01:41:12.748 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.743+0000 7fb62a7fc700 1 -- 172.21.15.71:0/1086701203 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb61c00e710 con 0x7fb618003a60 2023-10-06T01:41:12.748 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.743+0000 7fb631722700 1 -- 172.21.15.71:0/1086701203 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb618003a60 msgr2=0x7fb618003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:12.748 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.743+0000 7fb631722700 1 --2- 172.21.15.71:0/1086701203 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb618003a60 0x7fb618003e70 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fb61c009c20 tx=0x7fb61c009120 comp rx=0 tx=0).stop 2023-10-06T01:41:12.748 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.743+0000 7fb62b7fe700 1 -- 172.21.15.71:0/1086701203 reap_dead start 2023-10-06T01:41:12.749 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.743+0000 7fb631722700 1 -- 172.21.15.71:0/1086701203 shutdown_connections 2023-10-06T01:41:12.749 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.743+0000 7fb631722700 1 -- 172.21.15.71:0/1086701203 >> 172.21.15.71:0/1086701203 conn(0x7fb62c06a220 msgr2=0x7fb62c06a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:12.749 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.743+0000 7fb631722700 1 -- 172.21.15.71:0/1086701203 shutdown_connections 2023-10-06T01:41:12.749 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.743+0000 7fb631722700 1 -- 172.21.15.71:0/1086701203 wait complete. 2023-10-06T01:41:12.749 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.744+0000 7fb631722700 1 Processor -- start 2023-10-06T01:41:12.749 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.744+0000 7fb631722700 1 -- start start 2023-10-06T01:41:12.751 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.745+0000 7fb631722700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb618003a60 0x7fb62c0ca5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:12.752 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.745+0000 7fb631722700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb62c1545c0 0x7fb62c0c8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:12.752 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.745+0000 7fb631722700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb62c0c8870 0x7fb62c0b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:12.752 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.745+0000 7fb631722700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb62c0c62f0 con 0x7fb62c0c8870 2023-10-06T01:41:12.752 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.745+0000 7fb631722700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb62c0caae0 con 0x7fb618003a60 2023-10-06T01:41:12.752 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.745+0000 7fb631722700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb62c0c8d80 con 0x7fb62c1545c0 2023-10-06T01:41:12.752 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.745+0000 7fb62b7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb62c0c8870 0x7fb62c0b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:12.752 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.745+0000 7fb62b7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb62c0c8870 0x7fb62c0b1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47480/0 (socket says 172.21.15.71:47480) 2023-10-06T01:41:12.752 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.745+0000 7fb62b7fe700 1 -- 172.21.15.71:0/3864774826 learned_addr learned my addr 172.21.15.71:0/3864774826 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:12.752 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.745+0000 7fb62affd700 1 --2- 172.21.15.71:0/3864774826 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb618003a60 0x7fb62c0ca5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:12.752 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.745+0000 7fb6227fc700 1 --2- 172.21.15.71:0/3864774826 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb62c1545c0 0x7fb62c0c8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:12.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.745+0000 7fb62b7fe700 1 -- 172.21.15.71:0/3864774826 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb62c1545c0 msgr2=0x7fb62c0c8330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:12.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.745+0000 7fb62b7fe700 1 --2- 172.21.15.71:0/3864774826 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb62c1545c0 0x7fb62c0c8330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:12.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.745+0000 7fb62b7fe700 1 -- 172.21.15.71:0/3864774826 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb618003a60 msgr2=0x7fb62c0ca5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:12.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.745+0000 7fb62b7fe700 1 --2- 172.21.15.71:0/3864774826 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb618003a60 0x7fb62c0ca5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:12.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.745+0000 7fb62b7fe700 1 -- 172.21.15.71:0/3864774826 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb62c0c5ca0 con 0x7fb62c0c8870 2023-10-06T01:41:12.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.745+0000 7fb62affd700 1 --2- 172.21.15.71:0/3864774826 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb618003a60 0x7fb62c0ca5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:41:12.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.746+0000 7fb62b7fe700 1 --2- 172.21.15.71:0/3864774826 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb62c0c8870 0x7fb62c0b1ef0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb624000f80 tx=0x7fb624002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:12.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.746+0000 7fb6237fe700 1 -- 172.21.15.71:0/3864774826 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb624007b40 con 0x7fb62c0c8870 2023-10-06T01:41:12.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.746+0000 7fb6237fe700 1 -- 172.21.15.71:0/3864774826 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb62400ad80 con 0x7fb62c0c8870 2023-10-06T01:41:12.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.746+0000 7fb631722700 1 -- 172.21.15.71:0/3864774826 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb62c0c5f80 con 0x7fb62c0c8870 2023-10-06T01:41:12.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.746+0000 7fb6237fe700 1 -- 172.21.15.71:0/3864774826 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb624013660 con 0x7fb62c0c8870 2023-10-06T01:41:12.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.746+0000 7fb631722700 1 -- 172.21.15.71:0/3864774826 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb62c154a30 con 0x7fb62c0c8870 2023-10-06T01:41:12.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.747+0000 7fb631722700 1 -- 172.21.15.71:0/3864774826 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb62c088760 con 0x7fb62c0c8870 2023-10-06T01:41:12.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.747+0000 7fb6237fe700 1 -- 172.21.15.71:0/3864774826 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb624013a10 con 0x7fb62c0c8870 2023-10-06T01:41:12.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.748+0000 7fb6237fe700 1 --2- 172.21.15.71:0/3864774826 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fb60c066f30 0x7fb60c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:12.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.748+0000 7fb62affd700 1 --2- 172.21.15.71:0/3864774826 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fb60c066f30 0x7fb60c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:12.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.748+0000 7fb6237fe700 1 -- 172.21.15.71:0/3864774826 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6867+0+0 (secure 0 0 0) 0x7fb624085200 con 0x7fb62c0c8870 2023-10-06T01:41:12.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.748+0000 7fb62affd700 1 --2- 172.21.15.71:0/3864774826 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fb60c066f30 0x7fb60c0693e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb61c009160 tx=0x7fb61c019000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:12.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.752+0000 7fb6237fe700 1 -- 172.21.15.71:0/3864774826 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb624051fe0 con 0x7fb62c0c8870 2023-10-06T01:41:12.935 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.934+0000 7fb631722700 1 -- 172.21.15.71:0/3864774826 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fb62c0c6430 con 0x7fb62c0c8870 2023-10-06T01:41:12.935 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.934+0000 7fb6237fe700 1 -- 172.21.15.71:0/3864774826 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7fb624055600 con 0x7fb62c0c8870 2023-10-06T01:41:12.935 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 32 2023-10-06T01:41:12.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.936+0000 7fb631722700 1 -- 172.21.15.71:0/3864774826 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fb60c066f30 msgr2=0x7fb60c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:12.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.936+0000 7fb631722700 1 --2- 172.21.15.71:0/3864774826 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fb60c066f30 0x7fb60c0693e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb61c009160 tx=0x7fb61c019000 comp rx=0 tx=0).stop 2023-10-06T01:41:12.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.936+0000 7fb631722700 1 -- 172.21.15.71:0/3864774826 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb62c0c8870 msgr2=0x7fb62c0b1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:12.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.936+0000 7fb631722700 1 --2- 172.21.15.71:0/3864774826 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb62c0c8870 0x7fb62c0b1ef0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb624000f80 tx=0x7fb624002210 comp rx=0 tx=0).stop 2023-10-06T01:41:12.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.936+0000 7fb631722700 1 -- 172.21.15.71:0/3864774826 shutdown_connections 2023-10-06T01:41:12.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.936+0000 7fb631722700 1 --2- 172.21.15.71:0/3864774826 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb62c0c8870 0x7fb62c0b1ef0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:12.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.936+0000 7fb631722700 1 --2- 172.21.15.71:0/3864774826 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fb60c066f30 0x7fb60c0693e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:12.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.936+0000 7fb631722700 1 --2- 172.21.15.71:0/3864774826 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb618003a60 0x7fb62c0ca5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:12.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.936+0000 7fb631722700 1 --2- 172.21.15.71:0/3864774826 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb62c1545c0 0x7fb62c0c8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:12.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.936+0000 7fb631722700 1 -- 172.21.15.71:0/3864774826 >> 172.21.15.71:0/3864774826 conn(0x7fb62c06a220 msgr2=0x7fb62c158050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:12.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.937+0000 7fb631722700 1 -- 172.21.15.71:0/3864774826 shutdown_connections 2023-10-06T01:41:12.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:12.937+0000 7fb631722700 1 -- 172.21.15.71:0/3864774826 wait complete. 2023-10-06T01:41:12.949 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T01:41:13.064 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.063+0000 7feb31e7b700 1 Processor -- start 2023-10-06T01:41:13.064 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.063+0000 7feb31e7b700 1 -- start start 2023-10-06T01:41:13.066 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.064+0000 7feb31e7b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7feb2c159400 0x7feb2c0ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:13.066 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.064+0000 7feb31e7b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb2c0cd030 0x7feb2c0cfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:13.066 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.064+0000 7feb31e7b700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb2c0b3560 con 0x7feb2c0cf1a0 2023-10-06T01:41:13.067 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.064+0000 7feb31e7b700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb2c0cf6f0 con 0x7feb2c159400 2023-10-06T01:41:13.067 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.064+0000 7feb31e7b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb2c0cf9d0 con 0x7feb2c0cd030 2023-10-06T01:41:13.067 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.064+0000 7feb30e79700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7feb2c159400 0x7feb2c0ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:13.067 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.064+0000 7feb3167a700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7feb2c0cf1a0 0x7feb2c0b5240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:39772/0 (socket says 172.21.15.71:39772) 2023-10-06T01:41:13.067 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.064+0000 7feb3167a700 1 -- 172.21.15.71:0/1285927948 learned_addr learned my addr 172.21.15.71:0/1285927948 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:41:13.067 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.064+0000 7feb30e79700 1 -- 172.21.15.71:0/1285927948 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb2c0cd030 msgr2=0x7feb2c0cfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:13.067 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.064+0000 7feb2bfff700 1 --2- 172.21.15.71:0/1285927948 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb2c0cd030 0x7feb2c0cfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:13.067 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.064+0000 7feb2b7fe700 1 -- 172.21.15.71:0/1285927948 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1245738988 0 0) 0x7feb2c0b3560 con 0x7feb2c0cf1a0 2023-10-06T01:41:13.067 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.064+0000 7feb30e79700 1 --2- 172.21.15.71:0/1285927948 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb2c0cd030 0x7feb2c0cfec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:13.067 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.064+0000 7feb30e79700 1 -- 172.21.15.71:0/1285927948 >> v1:172.21.15.71:6789/0 conn(0x7feb2c0cf1a0 legacy=0x7feb2c0b5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:13.067 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.064+0000 7feb30e79700 1 -- 172.21.15.71:0/1285927948 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb2c0b2f10 con 0x7feb2c159400 2023-10-06T01:41:13.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.064+0000 7feb2bfff700 1 --2- 172.21.15.71:0/1285927948 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb2c0cd030 0x7feb2c0cfec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:41:13.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.064+0000 7feb30e79700 1 --2- 172.21.15.71:0/1285927948 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feb2c159400 0x7feb2c0ccaf0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7feb200098d0 tx=0x7feb20009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d739d51cced21a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:13.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.065+0000 7feb2b7fe700 1 -- 172.21.15.71:0/1285927948 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb20009e70 con 0x7feb2c159400 2023-10-06T01:41:13.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.065+0000 7feb2b7fe700 1 -- 172.21.15.71:0/1285927948 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb20005c10 con 0x7feb2c159400 2023-10-06T01:41:13.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.065+0000 7feb2b7fe700 1 -- 172.21.15.71:0/1285927948 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb2000b650 con 0x7feb2c159400 2023-10-06T01:41:13.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.065+0000 7feb31e7b700 1 -- 172.21.15.71:0/1285927948 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feb2c159400 msgr2=0x7feb2c0ccaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:13.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.065+0000 7feb31e7b700 1 --2- 172.21.15.71:0/1285927948 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feb2c159400 0x7feb2c0ccaf0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7feb200098d0 tx=0x7feb20009120 comp rx=0 tx=0).stop 2023-10-06T01:41:13.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.065+0000 7feb31e7b700 1 -- 172.21.15.71:0/1285927948 shutdown_connections 2023-10-06T01:41:13.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.065+0000 7feb31e7b700 1 --2- 172.21.15.71:0/1285927948 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feb2c159400 0x7feb2c0ccaf0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:13.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.065+0000 7feb31e7b700 1 --2- 172.21.15.71:0/1285927948 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb2c0cd030 0x7feb2c0cfec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:13.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.065+0000 7feb31e7b700 1 -- 172.21.15.71:0/1285927948 >> 172.21.15.71:0/1285927948 conn(0x7feb2c06ac10 msgr2=0x7feb2c068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:13.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.065+0000 7feb31e7b700 1 -- 172.21.15.71:0/1285927948 shutdown_connections 2023-10-06T01:41:13.069 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.065+0000 7feb31e7b700 1 -- 172.21.15.71:0/1285927948 wait complete. 2023-10-06T01:41:13.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.066+0000 7feb31e7b700 1 Processor -- start 2023-10-06T01:41:13.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.066+0000 7feb31e7b700 1 -- start start 2023-10-06T01:41:13.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.067+0000 7feb31e7b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb2c0cd030 0x7feb2c158680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:13.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.067+0000 7feb31e7b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb2c0cf1a0 0x7feb2c141a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:13.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.067+0000 7feb31e7b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feb2c159400 0x7feb2c0b0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:13.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.067+0000 7feb31e7b700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb2c158bc0 con 0x7feb2c159400 2023-10-06T01:41:13.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.067+0000 7feb31e7b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb2c1512f0 con 0x7feb2c0cf1a0 2023-10-06T01:41:13.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.067+0000 7feb31e7b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb2c1515d0 con 0x7feb2c0cd030 2023-10-06T01:41:13.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.067+0000 7feb3167a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feb2c159400 0x7feb2c0b0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:13.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.067+0000 7feb3167a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feb2c159400 0x7feb2c0b0aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47506/0 (socket says 172.21.15.71:47506) 2023-10-06T01:41:13.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.067+0000 7feb3167a700 1 -- 172.21.15.71:0/384186287 learned_addr learned my addr 172.21.15.71:0/384186287 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:13.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.067+0000 7feb30e79700 1 --2- 172.21.15.71:0/384186287 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb2c0cd030 0x7feb2c158680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:13.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.067+0000 7feb2bfff700 1 --2- 172.21.15.71:0/384186287 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb2c0cf1a0 0x7feb2c141a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:13.073 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.067+0000 7feb3167a700 1 -- 172.21.15.71:0/384186287 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb2c0cd030 msgr2=0x7feb2c158680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:13.073 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.067+0000 7feb3167a700 1 --2- 172.21.15.71:0/384186287 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb2c0cd030 0x7feb2c158680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:13.073 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.067+0000 7feb3167a700 1 -- 172.21.15.71:0/384186287 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb2c0cf1a0 msgr2=0x7feb2c141a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:13.073 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.067+0000 7feb3167a700 1 --2- 172.21.15.71:0/384186287 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb2c0cf1a0 0x7feb2c141a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:13.073 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.067+0000 7feb3167a700 1 -- 172.21.15.71:0/384186287 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb200093c0 con 0x7feb2c159400 2023-10-06T01:41:13.073 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.067+0000 7feb2bfff700 1 --2- 172.21.15.71:0/384186287 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb2c0cf1a0 0x7feb2c141a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:41:13.073 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.068+0000 7feb3167a700 1 --2- 172.21.15.71:0/384186287 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feb2c159400 0x7feb2c0b0aa0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7feb2400cc90 tx=0x7feb24001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:13.073 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.068+0000 7feb28ff9700 1 -- 172.21.15.71:0/384186287 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb2400cea0 con 0x7feb2c159400 2023-10-06T01:41:13.073 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.068+0000 7feb28ff9700 1 -- 172.21.15.71:0/384186287 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb2400ab70 con 0x7feb2c159400 2023-10-06T01:41:13.073 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.068+0000 7feb28ff9700 1 -- 172.21.15.71:0/384186287 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb240070f0 con 0x7feb2c159400 2023-10-06T01:41:13.073 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.068+0000 7feb31e7b700 1 -- 172.21.15.71:0/384186287 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb2c1518b0 con 0x7feb2c159400 2023-10-06T01:41:13.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.068+0000 7feb31e7b700 1 -- 172.21.15.71:0/384186287 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb2c151e70 con 0x7feb2c159400 2023-10-06T01:41:13.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.069+0000 7feb31e7b700 1 -- 172.21.15.71:0/384186287 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb2c159860 con 0x7feb2c159400 2023-10-06T01:41:13.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.069+0000 7feb28ff9700 1 -- 172.21.15.71:0/384186287 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7feb240074a0 con 0x7feb2c159400 2023-10-06T01:41:13.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.069+0000 7feb28ff9700 1 --2- 172.21.15.71:0/384186287 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7feb10066f30 0x7feb100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:13.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.069+0000 7feb28ff9700 1 -- 172.21.15.71:0/384186287 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6867+0+0 (secure 0 0 0) 0x7feb24084e30 con 0x7feb2c159400 2023-10-06T01:41:13.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.069+0000 7feb30e79700 1 --2- 172.21.15.71:0/384186287 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7feb10066f30 0x7feb100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:13.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.070+0000 7feb30e79700 1 --2- 172.21.15.71:0/384186287 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7feb10066f30 0x7feb100693e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7feb20009160 tx=0x7feb20016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:13.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.074+0000 7feb28ff9700 1 -- 172.21.15.71:0/384186287 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feb24051c90 con 0x7feb2c159400 2023-10-06T01:41:13.297 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.296+0000 7feb31e7b700 1 -- 172.21.15.71:0/384186287 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feb2c069ee0 con 0x7feb2c159400 2023-10-06T01:41:13.297 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.296+0000 7feb28ff9700 1 -- 172.21.15.71:0/384186287 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4590 (secure 0 0 0) 0x7feb240552b0 con 0x7feb2c159400 2023-10-06T01:41:13.297 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:41:13.298 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6836/274053969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":274053969},{"type":"v1","addr":"172.21.15.71:6836","nonce":274053969}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/4158221694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6835","nonce":4158221694},{"type":"v1","addr":"172.21.15.71:6837","nonce":4158221694}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/1094581488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":1094581488},{"type":"v1","addr":"172.21.15.72:6835","nonce":1094581488}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T01:40:21.151426+0000","modified":"2023-10-06T01:40:39.857922+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4315},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4315":{"gid":4315,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6834/2361644634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6833","nonce":2361644634},{"type":"v1","addr":"172.21.15.72:6834","nonce":2361644634}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T01:41:13.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.299+0000 7feb31e7b700 1 -- 172.21.15.71:0/384186287 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7feb10066f30 msgr2=0x7feb100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:13.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.299+0000 7feb31e7b700 1 --2- 172.21.15.71:0/384186287 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7feb10066f30 0x7feb100693e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7feb20009160 tx=0x7feb20016000 comp rx=0 tx=0).stop 2023-10-06T01:41:13.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.299+0000 7feb31e7b700 1 -- 172.21.15.71:0/384186287 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feb2c159400 msgr2=0x7feb2c0b0aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:13.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.299+0000 7feb31e7b700 1 --2- 172.21.15.71:0/384186287 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feb2c159400 0x7feb2c0b0aa0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7feb2400cc90 tx=0x7feb24001a80 comp rx=0 tx=0).stop 2023-10-06T01:41:13.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.299+0000 7feb31e7b700 1 -- 172.21.15.71:0/384186287 shutdown_connections 2023-10-06T01:41:13.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.299+0000 7feb31e7b700 1 --2- 172.21.15.71:0/384186287 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feb2c159400 0x7feb2c0b0aa0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:13.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.299+0000 7feb31e7b700 1 --2- 172.21.15.71:0/384186287 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb2c0cd030 0x7feb2c158680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:13.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.299+0000 7feb31e7b700 1 --2- 172.21.15.71:0/384186287 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7feb10066f30 0x7feb100693e0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:13.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.299+0000 7feb31e7b700 1 --2- 172.21.15.71:0/384186287 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb2c0cf1a0 0x7feb2c141a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:13.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.299+0000 7feb31e7b700 1 -- 172.21.15.71:0/384186287 >> 172.21.15.71:0/384186287 conn(0x7feb2c06ac10 msgr2=0x7feb2c15be80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:13.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.299+0000 7feb31e7b700 1 -- 172.21.15.71:0/384186287 shutdown_connections 2023-10-06T01:41:13.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.299+0000 7feb31e7b700 1 -- 172.21.15.71:0/384186287 wait complete. 2023-10-06T01:41:13.301 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 9 2023-10-06T01:41:13.311 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:41:13.426 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.425+0000 7f6539e37700 1 Processor -- start 2023-10-06T01:41:13.426 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.425+0000 7f6539e37700 1 -- start start 2023-10-06T01:41:13.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.426+0000 7f6539e37700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f65340af8b0 0x7f653415d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:13.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.426+0000 7f6539e37700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f653415e190 con 0x7f65340b27f0 2023-10-06T01:41:13.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.426+0000 7f6539e37700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65340cb650 con 0x7f65340af4e0 2023-10-06T01:41:13.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.426+0000 7f6539e37700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65340b1910 con 0x7f65340af8b0 2023-10-06T01:41:13.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.426+0000 7f6533fff700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f65340b27f0 0x7f653415d9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:39788/0 (socket says 172.21.15.71:39788) 2023-10-06T01:41:13.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.426+0000 7f6533fff700 1 -- 172.21.15.71:0/3522398742 learned_addr learned my addr 172.21.15.71:0/3522398742 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:41:13.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.426+0000 7f6532ffd700 1 --2- 172.21.15.71:0/3522398742 >> v2:172.21.15.72:3300/0 conn(0x7f65340af8b0 0x7f653415d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:13.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.426+0000 7f65327fc700 1 -- 172.21.15.71:0/3522398742 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2507922942 0 0) 0x7f653415e190 con 0x7f65340b27f0 2023-10-06T01:41:13.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.427+0000 7f65327fc700 1 -- 172.21.15.71:0/3522398742 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f651c003570 con 0x7f65340b27f0 2023-10-06T01:41:13.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.427+0000 7f65327fc700 1 -- 172.21.15.71:0/3522398742 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3529377951 0 0) 0x7f65340cb650 con 0x7f65340af4e0 2023-10-06T01:41:13.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.427+0000 7f65327fc700 1 -- 172.21.15.71:0/3522398742 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f653415e190 con 0x7f65340af4e0 2023-10-06T01:41:13.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.427+0000 7f6532ffd700 1 -- 172.21.15.71:0/3522398742 >> v1:172.21.15.72:6789/0 conn(0x7f65340af4e0 legacy=0x7f65340b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:13.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.427+0000 7f6532ffd700 1 -- 172.21.15.71:0/3522398742 >> v1:172.21.15.71:6789/0 conn(0x7f65340b27f0 legacy=0x7f653415d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:13.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.427+0000 7f6532ffd700 1 -- 172.21.15.71:0/3522398742 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65340ccaf0 con 0x7f65340af8b0 2023-10-06T01:41:13.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.427+0000 7f6532ffd700 1 --2- 172.21.15.71:0/3522398742 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f65340af8b0 0x7f653415d460 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f65280098e0 tx=0x7f65280091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6630014d1a8c7852 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:13.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.427+0000 7f65327fc700 1 -- 172.21.15.71:0/3522398742 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6528011630 con 0x7f65340af8b0 2023-10-06T01:41:13.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.427+0000 7f65327fc700 1 -- 172.21.15.71:0/3522398742 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6528011790 con 0x7f65340af8b0 2023-10-06T01:41:13.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.427+0000 7f65327fc700 1 -- 172.21.15.71:0/3522398742 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6528011b30 con 0x7f65340af8b0 2023-10-06T01:41:13.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.427+0000 7f6539e37700 1 -- 172.21.15.71:0/3522398742 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f65340af8b0 msgr2=0x7f653415d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:13.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.427+0000 7f6539e37700 1 --2- 172.21.15.71:0/3522398742 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f65340af8b0 0x7f653415d460 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f65280098e0 tx=0x7f65280091a0 comp rx=0 tx=0).stop 2023-10-06T01:41:13.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.428+0000 7f6539e37700 1 -- 172.21.15.71:0/3522398742 shutdown_connections 2023-10-06T01:41:13.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.428+0000 7f6539e37700 1 --2- 172.21.15.71:0/3522398742 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f65340af8b0 0x7f653415d460 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:13.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.428+0000 7f6539e37700 1 -- 172.21.15.71:0/3522398742 >> 172.21.15.71:0/3522398742 conn(0x7f6534068680 msgr2=0x7f6534068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:13.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.428+0000 7f6539e37700 1 -- 172.21.15.71:0/3522398742 shutdown_connections 2023-10-06T01:41:13.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.428+0000 7f6539e37700 1 -- 172.21.15.71:0/3522398742 wait complete. 2023-10-06T01:41:13.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.429+0000 7f6539e37700 1 Processor -- start 2023-10-06T01:41:13.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.429+0000 7f6539e37700 1 -- start start 2023-10-06T01:41:13.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.430+0000 7f6539e37700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65340af4e0 0x7f6534150c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:13.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.430+0000 7f6539e37700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f65340af8b0 0x7f65341511d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:13.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.430+0000 7f6539e37700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f65340b27f0 0x7f65340b7a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:13.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.430+0000 7f6539e37700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65340cf5d0 con 0x7f65340af4e0 2023-10-06T01:41:13.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.430+0000 7f6539e37700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65340cefa0 con 0x7f65340af8b0 2023-10-06T01:41:13.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.430+0000 7f6539e37700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6534144060 con 0x7f65340b27f0 2023-10-06T01:41:13.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.430+0000 7f65337fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65340af4e0 0x7f6534150c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:13.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.430+0000 7f65337fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65340af4e0 0x7f6534150c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47520/0 (socket says 172.21.15.71:47520) 2023-10-06T01:41:13.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.430+0000 7f65337fe700 1 -- 172.21.15.71:0/30515498 learned_addr learned my addr 172.21.15.71:0/30515498 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:13.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.430+0000 7f6532ffd700 1 --2- 172.21.15.71:0/30515498 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f65340af8b0 0x7f65341511d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:13.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.430+0000 7f6533fff700 1 --2- 172.21.15.71:0/30515498 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f65340b27f0 0x7f65340b7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:13.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.430+0000 7f65337fe700 1 -- 172.21.15.71:0/30515498 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f65340b27f0 msgr2=0x7f65340b7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:13.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.430+0000 7f65337fe700 1 --2- 172.21.15.71:0/30515498 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f65340b27f0 0x7f65340b7a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:13.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.430+0000 7f65337fe700 1 -- 172.21.15.71:0/30515498 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f65340af8b0 msgr2=0x7f65341511d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:13.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.430+0000 7f65337fe700 1 --2- 172.21.15.71:0/30515498 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f65340af8b0 0x7f65341511d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:13.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.430+0000 7f65337fe700 1 -- 172.21.15.71:0/30515498 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6528009420 con 0x7f65340af4e0 2023-10-06T01:41:13.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.430+0000 7f6532ffd700 1 --2- 172.21.15.71:0/30515498 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f65340af8b0 0x7f65341511d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:41:13.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.430+0000 7f65337fe700 1 --2- 172.21.15.71:0/30515498 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65340af4e0 0x7f6534150c90 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f652400cb10 tx=0x7f6524002820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:13.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.430+0000 7f651b7fe700 1 -- 172.21.15.71:0/30515498 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f652400a760 con 0x7f65340af4e0 2023-10-06T01:41:13.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.430+0000 7f651b7fe700 1 -- 172.21.15.71:0/30515498 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f652400a8c0 con 0x7f65340af4e0 2023-10-06T01:41:13.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.430+0000 7f651b7fe700 1 -- 172.21.15.71:0/30515498 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f652400ac60 con 0x7f65340af4e0 2023-10-06T01:41:13.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.430+0000 7f6539e37700 1 -- 172.21.15.71:0/30515498 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6534144340 con 0x7f65340af4e0 2023-10-06T01:41:13.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.430+0000 7f6539e37700 1 -- 172.21.15.71:0/30515498 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65340b6630 con 0x7f65340af4e0 2023-10-06T01:41:13.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.431+0000 7f6539e37700 1 -- 172.21.15.71:0/30515498 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65341444d0 con 0x7f65340af4e0 2023-10-06T01:41:13.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.432+0000 7f651b7fe700 1 -- 172.21.15.71:0/30515498 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6524012630 con 0x7f65340af4e0 2023-10-06T01:41:13.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.432+0000 7f651b7fe700 1 --2- 172.21.15.71:0/30515498 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f6520066f30 0x7f65200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:13.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.432+0000 7f651b7fe700 1 -- 172.21.15.71:0/30515498 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f6524084e30 con 0x7f65340af4e0 2023-10-06T01:41:13.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.432+0000 7f6532ffd700 1 --2- 172.21.15.71:0/30515498 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f6520066f30 0x7f65200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:13.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.433+0000 7f6532ffd700 1 --2- 172.21.15.71:0/30515498 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f6520066f30 0x7f65200693e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f65280098e0 tx=0x7f6528017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:13.437 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.436+0000 7f651b7fe700 1 -- 172.21.15.71:0/30515498 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f65341444d0 con 0x7f65340af4e0 2023-10-06T01:41:13.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.620+0000 7f6539e37700 1 -- 172.21.15.71:0/30515498 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f65341444d0 con 0x7f65340af4e0 2023-10-06T01:41:13.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.621+0000 7f651b7fe700 1 -- 172.21.15.71:0/30515498 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18754 (secure 0 0 0) 0x7f65341444d0 con 0x7f65340af4e0 2023-10-06T01:41:13.622 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:41:13.622 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":29,"fsid":"1fbf1bd2-f9b4-4599-bea2-f4aa920e9a56","created":"2023-10-06T01:39:57.016957+0000","modified":"2023-10-06T01:41:03.811605+0000","last_up_change":"2023-10-06T01:40:08.571643+0000","last_in_change":"2023-10-06T01:39:59.462741+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T01:40:08.610349+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T01:40:15.387434+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T01:40:19.640459+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T01:40:20.116883+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T01:40:23.830129+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cf059188-fb20-4dbf-95db-dcf57b213d03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":90670},{"type":"v1","addr":"172.21.15.71:6817","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":90670},{"type":"v1","addr":"172.21.15.71:6819","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":90670},{"type":"v1","addr":"172.21.15.71:6823","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":90670},{"type":"v1","addr":"172.21.15.71:6821","nonce":90670}]},"public_addr":"172.21.15.71:6817/90670","cluster_addr":"172.21.15.71:6819/90670","heartbeat_back_addr":"172.21.15.71:6823/90670","heartbeat_front_addr":"172.21.15.71:6821/90670","state":["exists","up"]},{"osd":1,"uuid":"0cff0aae-1799-4fe0-b610-54cf0813c0e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":90669},{"type":"v1","addr":"172.21.15.71:6809","nonce":90669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":90669},{"type":"v1","addr":"172.21.15.71:6811","nonce":90669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":90669},{"type":"v1","addr":"172.21.15.71:6815","nonce":90669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":90669},{"type":"v1","addr":"172.21.15.71:6813","nonce":90669}]},"public_addr":"172.21.15.71:6809/90669","cluster_addr":"172.21.15.71:6811/90669","heartbeat_back_addr":"172.21.15.71:6815/90669","heartbeat_front_addr":"172.21.15.71:6813/90669","state":["exists","up"]},{"osd":2,"uuid":"88d61ddc-9031-44e1-ba8c-546a41e7c8ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":90679},{"type":"v1","addr":"172.21.15.71:6825","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":90679},{"type":"v1","addr":"172.21.15.71:6827","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":90679},{"type":"v1","addr":"172.21.15.71:6831","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":90679},{"type":"v1","addr":"172.21.15.71:6829","nonce":90679}]},"public_addr":"172.21.15.71:6825/90679","cluster_addr":"172.21.15.71:6827/90679","heartbeat_back_addr":"172.21.15.71:6831/90679","heartbeat_front_addr":"172.21.15.71:6829/90679","state":["exists","up"]},{"osd":3,"uuid":"11ed92b7-960b-4a30-a889-a61d3eeb86f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":90668},{"type":"v1","addr":"172.21.15.71:6801","nonce":90668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":90668},{"type":"v1","addr":"172.21.15.71:6803","nonce":90668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":90668},{"type":"v1","addr":"172.21.15.71:6807","nonce":90668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":90668},{"type":"v1","addr":"172.21.15.71:6805","nonce":90668}]},"public_addr":"172.21.15.71:6801/90668","cluster_addr":"172.21.15.71:6803/90668","heartbeat_back_addr":"172.21.15.71:6807/90668","heartbeat_front_addr":"172.21.15.71:6805/90668","state":["exists","up"]},{"osd":4,"uuid":"ae4df784-abdf-4ddf-aefa-780f3ddafef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":90917},{"type":"v1","addr":"172.21.15.72:6801","nonce":90917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":90917},{"type":"v1","addr":"172.21.15.72:6803","nonce":90917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":90917},{"type":"v1","addr":"172.21.15.72:6807","nonce":90917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":90917},{"type":"v1","addr":"172.21.15.72:6805","nonce":90917}]},"public_addr":"172.21.15.72:6801/90917","cluster_addr":"172.21.15.72:6803/90917","heartbeat_back_addr":"172.21.15.72:6807/90917","heartbeat_front_addr":"172.21.15.72:6805/90917","state":["exists","up"]},{"osd":5,"uuid":"5ef0790f-001e-458f-a05b-efae216cf435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":90941},{"type":"v1","addr":"172.21.15.72:6817","nonce":90941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":90941},{"type":"v1","addr":"172.21.15.72:6819","nonce":90941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":90941},{"type":"v1","addr":"172.21.15.72:6827","nonce":90941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":90941},{"type":"v1","addr":"172.21.15.72:6823","nonce":90941}]},"public_addr":"172.21.15.72:6817/90941","cluster_addr":"172.21.15.72:6819/90941","heartbeat_back_addr":"172.21.15.72:6827/90941","heartbeat_front_addr":"172.21.15.72:6823/90941","state":["exists","up"]},{"osd":6,"uuid":"8705aef1-9ae8-4e54-a3c4-c2909fa0ceb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":90918},{"type":"v1","addr":"172.21.15.72:6809","nonce":90918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":90918},{"type":"v1","addr":"172.21.15.72:6811","nonce":90918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":90918},{"type":"v1","addr":"172.21.15.72:6815","nonce":90918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":90918},{"type":"v1","addr":"172.21.15.72:6813","nonce":90918}]},"public_addr":"172.21.15.72:6809/90918","cluster_addr":"172.21.15.72:6811/90918","heartbeat_back_addr":"172.21.15.72:6815/90918","heartbeat_front_addr":"172.21.15.72:6813/90918","state":["exists","up"]},{"osd":7,"uuid":"364c5119-6b13-4c75-b3f0-15e165eff86a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":90948},{"type":"v1","addr":"172.21.15.72:6822","nonce":90948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":90948},{"type":"v1","addr":"172.21.15.72:6826","nonce":90948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":90948},{"type":"v1","addr":"172.21.15.72:6831","nonce":90948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":90948},{"type":"v1","addr":"172.21.15.72:6829","nonce":90948}]},"public_addr":"172.21.15.72:6822/90948","cluster_addr":"172.21.15.72:6826/90948","heartbeat_back_addr":"172.21.15.72:6831/90948","heartbeat_front_addr":"172.21.15.72:6829/90948","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.642976+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.645372+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.619116+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.663042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.599163+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.646411+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.631545+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.669821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.a","mappings":[{"from":1,"to":5}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:41:13.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.623+0000 7f6539e37700 1 -- 172.21.15.71:0/30515498 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f6520066f30 msgr2=0x7f65200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:13.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.623+0000 7f6539e37700 1 --2- 172.21.15.71:0/30515498 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f6520066f30 0x7f65200693e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f65280098e0 tx=0x7f6528017000 comp rx=0 tx=0).stop 2023-10-06T01:41:13.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.623+0000 7f6539e37700 1 -- 172.21.15.71:0/30515498 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65340af4e0 msgr2=0x7f6534150c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:13.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.623+0000 7f6539e37700 1 --2- 172.21.15.71:0/30515498 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65340af4e0 0x7f6534150c90 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f652400cb10 tx=0x7f6524002820 comp rx=0 tx=0).stop 2023-10-06T01:41:13.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.623+0000 7f6539e37700 1 -- 172.21.15.71:0/30515498 shutdown_connections 2023-10-06T01:41:13.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.623+0000 7f6539e37700 1 --2- 172.21.15.71:0/30515498 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f65340b27f0 0x7f65340b7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:13.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.623+0000 7f6539e37700 1 --2- 172.21.15.71:0/30515498 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65340af4e0 0x7f6534150c90 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:13.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.623+0000 7f6539e37700 1 --2- 172.21.15.71:0/30515498 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f6520066f30 0x7f65200693e0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:13.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.623+0000 7f6539e37700 1 --2- 172.21.15.71:0/30515498 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f65340af8b0 0x7f65341511d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:13.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.623+0000 7f6539e37700 1 -- 172.21.15.71:0/30515498 >> 172.21.15.71:0/30515498 conn(0x7f6534068680 msgr2=0x7f65340afe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:13.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.623+0000 7f6539e37700 1 -- 172.21.15.71:0/30515498 shutdown_connections 2023-10-06T01:41:13.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.623+0000 7f6539e37700 1 -- 172.21.15.71:0/30515498 wait complete. 2023-10-06T01:41:13.636 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T01:41:13.637 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T01:41:13.751 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.750+0000 7fe2e22b1700 1 Processor -- start 2023-10-06T01:41:13.751 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.750+0000 7fe2e22b1700 1 -- start start 2023-10-06T01:41:13.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.751+0000 7fe2e22b1700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fe2dc0af4e0 0x7fe2dc0b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:13.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.751+0000 7fe2e22b1700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe2dc15db70 0x7fe2dc0b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:13.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.751+0000 7fe2e22b1700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2dc15e190 con 0x7fe2dc0af8b0 2023-10-06T01:41:13.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.751+0000 7fe2e22b1700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2dc0b1910 con 0x7fe2dc0af4e0 2023-10-06T01:41:13.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.751+0000 7fe2e22b1700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2dc15dfa0 con 0x7fe2dc15db70 2023-10-06T01:41:13.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.751+0000 7fe2dbfff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fe2dc0af4e0 0x7fe2dc0b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:13.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.751+0000 7fe2db7fe700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fe2dc0af8b0 0x7fe2dc15d460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:39790/0 (socket says 172.21.15.71:39790) 2023-10-06T01:41:13.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.751+0000 7fe2db7fe700 1 -- 172.21.15.71:0/3995090670 learned_addr learned my addr 172.21.15.71:0/3995090670 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:41:13.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.751+0000 7fe2e084e700 1 --2- 172.21.15.71:0/3995090670 >> v2:172.21.15.72:3300/0 conn(0x7fe2dc15db70 0x7fe2dc0b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:13.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.752+0000 7fe2dbfff700 1 -- 172.21.15.71:0/3995090670 >> v2:172.21.15.72:3300/0 conn(0x7fe2dc15db70 msgr2=0x7fe2dc0b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:13.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.752+0000 7fe2dbfff700 1 --2- 172.21.15.71:0/3995090670 >> v2:172.21.15.72:3300/0 conn(0x7fe2dc15db70 0x7fe2dc0b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:13.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.752+0000 7fe2dbfff700 1 -- 172.21.15.71:0/3995090670 >> v1:172.21.15.71:6789/0 conn(0x7fe2dc0af8b0 legacy=0x7fe2dc15d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:13.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.752+0000 7fe2daffd700 1 -- 172.21.15.71:0/3995090670 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4266000320 0 0) 0x7fe2dc15e190 con 0x7fe2dc0af8b0 2023-10-06T01:41:13.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.752+0000 7fe2dbfff700 1 -- 172.21.15.71:0/3995090670 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2dc0cb650 con 0x7fe2dc0af4e0 2023-10-06T01:41:13.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.752+0000 7fe2dbfff700 1 --2- 172.21.15.71:0/3995090670 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2dc0af4e0 0x7fe2dc0b20e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc0c7280 tx=0x7fe2cc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f62fb8c4155b8351 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:13.755 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.752+0000 7fe2daffd700 1 -- 172.21.15.71:0/3995090670 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2cc00b6b0 con 0x7fe2dc0af4e0 2023-10-06T01:41:13.755 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.752+0000 7fe2daffd700 1 -- 172.21.15.71:0/3995090670 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2cc00b810 con 0x7fe2dc0af4e0 2023-10-06T01:41:13.755 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.752+0000 7fe2daffd700 1 -- 172.21.15.71:0/3995090670 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2cc00bbb0 con 0x7fe2dc0af4e0 2023-10-06T01:41:13.755 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.752+0000 7fe2e22b1700 1 -- 172.21.15.71:0/3995090670 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2dc0af4e0 msgr2=0x7fe2dc0b20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:13.755 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.752+0000 7fe2e22b1700 1 --2- 172.21.15.71:0/3995090670 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2dc0af4e0 0x7fe2dc0b20e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc0c7280 tx=0x7fe2cc0091a0 comp rx=0 tx=0).stop 2023-10-06T01:41:13.755 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.752+0000 7fe2e22b1700 1 -- 172.21.15.71:0/3995090670 shutdown_connections 2023-10-06T01:41:13.755 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.752+0000 7fe2e22b1700 1 --2- 172.21.15.71:0/3995090670 >> v2:172.21.15.72:3300/0 conn(0x7fe2dc15db70 0x7fe2dc0b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:13.755 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.752+0000 7fe2e22b1700 1 --2- 172.21.15.71:0/3995090670 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2dc0af4e0 0x7fe2dc0b20e0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:13.755 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.752+0000 7fe2e22b1700 1 -- 172.21.15.71:0/3995090670 >> 172.21.15.71:0/3995090670 conn(0x7fe2dc068680 msgr2=0x7fe2dc068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:13.755 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.752+0000 7fe2e22b1700 1 -- 172.21.15.71:0/3995090670 shutdown_connections 2023-10-06T01:41:13.755 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.752+0000 7fe2e22b1700 1 -- 172.21.15.71:0/3995090670 wait complete. 2023-10-06T01:41:13.758 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.753+0000 7fe2e22b1700 1 Processor -- start 2023-10-06T01:41:13.758 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.754+0000 7fe2e22b1700 1 -- start start 2023-10-06T01:41:13.759 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.754+0000 7fe2e22b1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2dc0af4e0 0x7fe2dc16ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:13.759 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.754+0000 7fe2e22b1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe2dc0af8b0 0x7fe2dc0a8900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:13.759 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.754+0000 7fe2e22b1700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2dc15db70 0x7fe2dc169c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:13.759 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.754+0000 7fe2e22b1700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2dc16b350 con 0x7fe2dc15db70 2023-10-06T01:41:13.759 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.754+0000 7fe2e22b1700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2dc16abe0 con 0x7fe2dc0af4e0 2023-10-06T01:41:13.759 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.754+0000 7fe2e22b1700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2dc16a620 con 0x7fe2dc0af8b0 2023-10-06T01:41:13.759 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.754+0000 7fe2e084e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2dc15db70 0x7fe2dc169c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:13.759 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.754+0000 7fe2e084e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2dc15db70 0x7fe2dc169c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47530/0 (socket says 172.21.15.71:47530) 2023-10-06T01:41:13.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.755+0000 7fe2e084e700 1 -- 172.21.15.71:0/1223295458 learned_addr learned my addr 172.21.15.71:0/1223295458 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:13.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.755+0000 7fe2db7fe700 1 --2- 172.21.15.71:0/1223295458 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe2dc0af8b0 0x7fe2dc0a8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:13.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.755+0000 7fe2e084e700 1 -- 172.21.15.71:0/1223295458 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe2dc0af8b0 msgr2=0x7fe2dc0a8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:13.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.755+0000 7fe2dbfff700 1 --2- 172.21.15.71:0/1223295458 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2dc0af4e0 0x7fe2dc16ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:13.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.755+0000 7fe2e084e700 1 --2- 172.21.15.71:0/1223295458 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe2dc0af8b0 0x7fe2dc0a8900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:13.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.755+0000 7fe2e084e700 1 -- 172.21.15.71:0/1223295458 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2dc0af4e0 msgr2=0x7fe2dc16ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:13.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.755+0000 7fe2e084e700 1 --2- 172.21.15.71:0/1223295458 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2dc0af4e0 0x7fe2dc16ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:13.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.755+0000 7fe2e084e700 1 -- 172.21.15.71:0/1223295458 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2cc009420 con 0x7fe2dc15db70 2023-10-06T01:41:13.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.755+0000 7fe2db7fe700 1 --2- 172.21.15.71:0/1223295458 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe2dc0af8b0 0x7fe2dc0a8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:41:13.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.755+0000 7fe2dbfff700 1 --2- 172.21.15.71:0/1223295458 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2dc0af4e0 0x7fe2dc16ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:41:13.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.755+0000 7fe2e084e700 1 --2- 172.21.15.71:0/1223295458 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2dc15db70 0x7fe2dc169c60 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fe2d4009fa0 tx=0x7fe2d4009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:13.761 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.755+0000 7fe2c3fff700 1 -- 172.21.15.71:0/1223295458 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d400ed20 con 0x7fe2dc15db70 2023-10-06T01:41:13.761 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.755+0000 7fe2c3fff700 1 -- 172.21.15.71:0/1223295458 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2d400ee80 con 0x7fe2dc15db70 2023-10-06T01:41:13.761 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.755+0000 7fe2c3fff700 1 -- 172.21.15.71:0/1223295458 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d4014670 con 0x7fe2dc15db70 2023-10-06T01:41:13.761 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.755+0000 7fe2e22b1700 1 -- 172.21.15.71:0/1223295458 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2dc16a900 con 0x7fe2dc15db70 2023-10-06T01:41:13.761 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.755+0000 7fe2e22b1700 1 -- 172.21.15.71:0/1223295458 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2dc0a7130 con 0x7fe2dc15db70 2023-10-06T01:41:13.761 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.756+0000 7fe2e22b1700 1 -- 172.21.15.71:0/1223295458 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2dc0a7350 con 0x7fe2dc15db70 2023-10-06T01:41:13.761 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.757+0000 7fe2c3fff700 1 -- 172.21.15.71:0/1223295458 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe2d40149e0 con 0x7fe2dc15db70 2023-10-06T01:41:13.761 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.757+0000 7fe2c3fff700 1 --2- 172.21.15.71:0/1223295458 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fe2c8066f30 0x7fe2c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:13.761 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.757+0000 7fe2c3fff700 1 -- 172.21.15.71:0/1223295458 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6867+0+0 (secure 0 0 0) 0x7fe2d40851b0 con 0x7fe2dc15db70 2023-10-06T01:41:13.761 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.757+0000 7fe2dbfff700 1 --2- 172.21.15.71:0/1223295458 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fe2c8066f30 0x7fe2c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:13.761 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.757+0000 7fe2dbfff700 1 --2- 172.21.15.71:0/1223295458 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fe2c8066f30 0x7fe2c80693e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc003080 tx=0x7fe2cc017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:13.762 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.761+0000 7fe2c3fff700 1 -- 172.21.15.71:0/1223295458 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe2d4051f90 con 0x7fe2dc15db70 2023-10-06T01:41:13.991 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.991+0000 7fe2e22b1700 1 -- 172.21.15.71:0/1223295458 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe2dc0b0910 con 0x7fe2dc15db70 2023-10-06T01:41:13.992 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.991+0000 7fe2c3fff700 1 -- 172.21.15.71:0/1223295458 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4590 (secure 0 0 0) 0x7fe2d40555b0 con 0x7fe2dc15db70 2023-10-06T01:41:13.992 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:41:13.994 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6836/274053969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":274053969},{"type":"v1","addr":"172.21.15.71:6836","nonce":274053969}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/4158221694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6835","nonce":4158221694},{"type":"v1","addr":"172.21.15.71:6837","nonce":4158221694}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/1094581488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":1094581488},{"type":"v1","addr":"172.21.15.72:6835","nonce":1094581488}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T01:40:21.151426+0000","modified":"2023-10-06T01:40:39.857922+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4315},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4315":{"gid":4315,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6834/2361644634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6833","nonce":2361644634},{"type":"v1","addr":"172.21.15.72:6834","nonce":2361644634}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T01:41:13.995 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.993+0000 7fe2e22b1700 1 -- 172.21.15.71:0/1223295458 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fe2c8066f30 msgr2=0x7fe2c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:13.996 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.993+0000 7fe2e22b1700 1 --2- 172.21.15.71:0/1223295458 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fe2c8066f30 0x7fe2c80693e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc003080 tx=0x7fe2cc017000 comp rx=0 tx=0).stop 2023-10-06T01:41:13.996 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.993+0000 7fe2e22b1700 1 -- 172.21.15.71:0/1223295458 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2dc15db70 msgr2=0x7fe2dc169c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:13.996 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.993+0000 7fe2e22b1700 1 --2- 172.21.15.71:0/1223295458 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2dc15db70 0x7fe2dc169c60 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fe2d4009fa0 tx=0x7fe2d4009900 comp rx=0 tx=0).stop 2023-10-06T01:41:13.996 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.993+0000 7fe2e22b1700 1 -- 172.21.15.71:0/1223295458 shutdown_connections 2023-10-06T01:41:13.996 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.993+0000 7fe2e22b1700 1 --2- 172.21.15.71:0/1223295458 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2dc15db70 0x7fe2dc169c60 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:13.996 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.993+0000 7fe2e22b1700 1 --2- 172.21.15.71:0/1223295458 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fe2c8066f30 0x7fe2c80693e0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:13.996 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.993+0000 7fe2e22b1700 1 --2- 172.21.15.71:0/1223295458 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2dc0af4e0 0x7fe2dc16ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:13.996 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.994+0000 7fe2e22b1700 1 --2- 172.21.15.71:0/1223295458 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe2dc0af8b0 0x7fe2dc0a8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:13.996 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.994+0000 7fe2e22b1700 1 -- 172.21.15.71:0/1223295458 >> 172.21.15.71:0/1223295458 conn(0x7fe2dc068680 msgr2=0x7fe2dc0b2450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:13.996 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.994+0000 7fe2e22b1700 1 -- 172.21.15.71:0/1223295458 shutdown_connections 2023-10-06T01:41:13.996 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:13.994+0000 7fe2e22b1700 1 -- 172.21.15.71:0/1223295458 wait complete. 2023-10-06T01:41:13.997 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 9 2023-10-06T01:41:14.006 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T01:41:14.121 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.120+0000 7fb17f86b700 1 Processor -- start 2023-10-06T01:41:14.121 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.120+0000 7fb17f86b700 1 -- start start 2023-10-06T01:41:14.123 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.121+0000 7fb17f86b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb1780c78d0 0x7fb1780ccfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:14.123 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.121+0000 7fb17f86b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fb1780c7ca0 0x7fb1780cd510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:14.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.121+0000 7fb17f86b700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1780ca3e0 con 0x7fb17813f930 2023-10-06T01:41:14.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.121+0000 7fb17f86b700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1780c95c0 con 0x7fb1780c7ca0 2023-10-06T01:41:14.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.121+0000 7fb17f86b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1780c3140 con 0x7fb1780c78d0 2023-10-06T01:41:14.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.121+0000 7fb17ce06700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fb1780c7ca0 0x7fb1780cd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:14.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.121+0000 7fb17ce06700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fb1780c7ca0 0x7fb1780cd510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47546/0 (socket says 172.21.15.71:47546) 2023-10-06T01:41:14.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.121+0000 7fb17ce06700 1 -- 172.21.15.71:0/2925089440 learned_addr learned my addr 172.21.15.71:0/2925089440 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:14.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.122+0000 7fb17d607700 1 --2- 172.21.15.71:0/2925089440 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb1780c78d0 0x7fb1780ccfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:14.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.122+0000 7fb17ce06700 1 -- 172.21.15.71:0/2925089440 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb1780c78d0 msgr2=0x7fb1780ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:14.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.122+0000 7fb17ce06700 1 --2- 172.21.15.71:0/2925089440 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb1780c78d0 0x7fb1780ccfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:14.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.122+0000 7fb17ce06700 1 -- 172.21.15.71:0/2925089440 >> v1:172.21.15.72:6789/0 conn(0x7fb17813f930 legacy=0x7fb17813fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:14.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.122+0000 7fb17ce06700 1 -- 172.21.15.71:0/2925089440 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1780c97d0 con 0x7fb1780c7ca0 2023-10-06T01:41:14.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.122+0000 7fb17ce06700 1 --2- 172.21.15.71:0/2925089440 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb1780c7ca0 0x7fb1780cd510 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fb1680099b0 tx=0x7fb168009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17d0056cd4e8b296 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:14.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.122+0000 7fb16ffff700 1 -- 172.21.15.71:0/2925089440 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb16800b860 con 0x7fb1780c7ca0 2023-10-06T01:41:14.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.122+0000 7fb16ffff700 1 -- 172.21.15.71:0/2925089440 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb16800b9c0 con 0x7fb1780c7ca0 2023-10-06T01:41:14.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.122+0000 7fb16ffff700 1 -- 172.21.15.71:0/2925089440 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb16800bd60 con 0x7fb1780c7ca0 2023-10-06T01:41:14.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.122+0000 7fb17f86b700 1 -- 172.21.15.71:0/2925089440 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb1780c7ca0 msgr2=0x7fb1780cd510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:14.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.122+0000 7fb17f86b700 1 --2- 172.21.15.71:0/2925089440 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb1780c7ca0 0x7fb1780cd510 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fb1680099b0 tx=0x7fb168009250 comp rx=0 tx=0).stop 2023-10-06T01:41:14.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.123+0000 7fb17f86b700 1 -- 172.21.15.71:0/2925089440 shutdown_connections 2023-10-06T01:41:14.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.123+0000 7fb17f86b700 1 --2- 172.21.15.71:0/2925089440 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb1780c78d0 0x7fb1780ccfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:14.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.123+0000 7fb17f86b700 1 --2- 172.21.15.71:0/2925089440 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb1780c7ca0 0x7fb1780cd510 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:14.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.123+0000 7fb17f86b700 1 -- 172.21.15.71:0/2925089440 >> 172.21.15.71:0/2925089440 conn(0x7fb178069790 msgr2=0x7fb178069b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:14.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.123+0000 7fb17f86b700 1 -- 172.21.15.71:0/2925089440 shutdown_connections 2023-10-06T01:41:14.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.123+0000 7fb17f86b700 1 -- 172.21.15.71:0/2925089440 wait complete. 2023-10-06T01:41:14.128 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.124+0000 7fb17f86b700 1 Processor -- start 2023-10-06T01:41:14.128 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.124+0000 7fb17f86b700 1 -- start start 2023-10-06T01:41:14.128 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.125+0000 7fb17f86b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb1780c78d0 0x7fb17816b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:14.128 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.125+0000 7fb17f86b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb1780c7ca0 0x7fb17816a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:14.128 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.125+0000 7fb17f86b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb17813f930 0x7fb1780c5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:14.128 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.125+0000 7fb17f86b700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb17813bd40 con 0x7fb1780c7ca0 2023-10-06T01:41:14.128 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.125+0000 7fb17f86b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb17813c8c0 con 0x7fb17813f930 2023-10-06T01:41:14.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.125+0000 7fb17f86b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb17816b700 con 0x7fb1780c78d0 2023-10-06T01:41:14.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.125+0000 7fb17ce06700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb1780c7ca0 0x7fb17816a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:14.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.125+0000 7fb17ce06700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb1780c7ca0 0x7fb17816a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47550/0 (socket says 172.21.15.71:47550) 2023-10-06T01:41:14.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.125+0000 7fb17ce06700 1 -- 172.21.15.71:0/3732472664 learned_addr learned my addr 172.21.15.71:0/3732472664 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:14.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.125+0000 7fb17de08700 1 --2- 172.21.15.71:0/3732472664 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb17813f930 0x7fb1780c5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:14.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.125+0000 7fb17d607700 1 --2- 172.21.15.71:0/3732472664 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb1780c78d0 0x7fb17816b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:14.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.125+0000 7fb17ce06700 1 -- 172.21.15.71:0/3732472664 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb1780c78d0 msgr2=0x7fb17816b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:14.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.125+0000 7fb17ce06700 1 --2- 172.21.15.71:0/3732472664 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb1780c78d0 0x7fb17816b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:14.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.125+0000 7fb17ce06700 1 -- 172.21.15.71:0/3732472664 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb17813f930 msgr2=0x7fb1780c5bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:14.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.125+0000 7fb17ce06700 1 --2- 172.21.15.71:0/3732472664 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb17813f930 0x7fb1780c5bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:14.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.125+0000 7fb17ce06700 1 -- 172.21.15.71:0/3732472664 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1680094f0 con 0x7fb1780c7ca0 2023-10-06T01:41:14.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.125+0000 7fb17de08700 1 --2- 172.21.15.71:0/3732472664 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb17813f930 0x7fb1780c5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:41:14.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.125+0000 7fb17ce06700 1 --2- 172.21.15.71:0/3732472664 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb1780c7ca0 0x7fb17816a830 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fb168006fd0 tx=0x7fb168017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:14.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.125+0000 7fb16d7fa700 1 -- 172.21.15.71:0/3732472664 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb16801a420 con 0x7fb1780c7ca0 2023-10-06T01:41:14.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.125+0000 7fb16d7fa700 1 -- 172.21.15.71:0/3732472664 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb16801a580 con 0x7fb1780c7ca0 2023-10-06T01:41:14.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.125+0000 7fb17f86b700 1 -- 172.21.15.71:0/3732472664 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb17813bf90 con 0x7fb1780c7ca0 2023-10-06T01:41:14.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.125+0000 7fb16d7fa700 1 -- 172.21.15.71:0/3732472664 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb16801a940 con 0x7fb1780c7ca0 2023-10-06T01:41:14.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.125+0000 7fb17f86b700 1 -- 172.21.15.71:0/3732472664 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb17813c550 con 0x7fb1780c7ca0 2023-10-06T01:41:14.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.126+0000 7fb17f86b700 1 -- 172.21.15.71:0/3732472664 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb17813c710 con 0x7fb1780c7ca0 2023-10-06T01:41:14.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.126+0000 7fb16d7fa700 1 -- 172.21.15.71:0/3732472664 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb16801acf0 con 0x7fb1780c7ca0 2023-10-06T01:41:14.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.127+0000 7fb16d7fa700 1 --2- 172.21.15.71:0/3732472664 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fb15c066f30 0x7fb15c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:14.131 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.127+0000 7fb16d7fa700 1 -- 172.21.15.71:0/3732472664 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6867+0+0 (secure 0 0 0) 0x7fb1680863c0 con 0x7fb1780c7ca0 2023-10-06T01:41:14.131 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.127+0000 7fb17d607700 1 --2- 172.21.15.71:0/3732472664 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fb15c066f30 0x7fb15c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:14.131 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.127+0000 7fb17d607700 1 --2- 172.21.15.71:0/3732472664 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fb15c066f30 0x7fb15c0693e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb174006fd0 tx=0x7fb174008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:14.131 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.131+0000 7fb16d7fa700 1 -- 172.21.15.71:0/3732472664 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb1680531a0 con 0x7fb1780c7ca0 2023-10-06T01:41:14.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.355+0000 7fb17f86b700 1 -- 172.21.15.71:0/3732472664 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb17813ca00 con 0x7fb1780c7ca0 2023-10-06T01:41:14.356 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.355+0000 7fb16d7fa700 1 -- 172.21.15.71:0/3732472664 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4590 (secure 0 0 0) 0x7fb1680567c0 con 0x7fb1780c7ca0 2023-10-06T01:41:14.356 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:41:14.356 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6836/274053969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":274053969},{"type":"v1","addr":"172.21.15.71:6836","nonce":274053969}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/4158221694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6835","nonce":4158221694},{"type":"v1","addr":"172.21.15.71:6837","nonce":4158221694}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/1094581488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":1094581488},{"type":"v1","addr":"172.21.15.72:6835","nonce":1094581488}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T01:40:21.151426+0000","modified":"2023-10-06T01:40:39.857922+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4315},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4315":{"gid":4315,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6834/2361644634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6833","nonce":2361644634},{"type":"v1","addr":"172.21.15.72:6834","nonce":2361644634}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T01:41:14.358 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.357+0000 7fb17f86b700 1 -- 172.21.15.71:0/3732472664 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fb15c066f30 msgr2=0x7fb15c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:14.359 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.357+0000 7fb17f86b700 1 --2- 172.21.15.71:0/3732472664 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fb15c066f30 0x7fb15c0693e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb174006fd0 tx=0x7fb174008040 comp rx=0 tx=0).stop 2023-10-06T01:41:14.359 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.357+0000 7fb17f86b700 1 -- 172.21.15.71:0/3732472664 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb1780c7ca0 msgr2=0x7fb17816a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:14.359 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.357+0000 7fb17f86b700 1 --2- 172.21.15.71:0/3732472664 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb1780c7ca0 0x7fb17816a830 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fb168006fd0 tx=0x7fb168017000 comp rx=0 tx=0).stop 2023-10-06T01:41:14.359 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.357+0000 7fb17f86b700 1 -- 172.21.15.71:0/3732472664 shutdown_connections 2023-10-06T01:41:14.359 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.357+0000 7fb17f86b700 1 --2- 172.21.15.71:0/3732472664 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fb15c066f30 0x7fb15c0693e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:14.359 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.357+0000 7fb17f86b700 1 --2- 172.21.15.71:0/3732472664 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb17813f930 0x7fb1780c5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:14.359 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.357+0000 7fb17f86b700 1 --2- 172.21.15.71:0/3732472664 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb1780c78d0 0x7fb17816b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:14.359 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.357+0000 7fb17f86b700 1 --2- 172.21.15.71:0/3732472664 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb1780c7ca0 0x7fb17816a830 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:14.359 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.357+0000 7fb17f86b700 1 -- 172.21.15.71:0/3732472664 >> 172.21.15.71:0/3732472664 conn(0x7fb178069790 msgr2=0x7fb178068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:14.359 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.357+0000 7fb17f86b700 1 -- 172.21.15.71:0/3732472664 shutdown_connections 2023-10-06T01:41:14.359 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.357+0000 7fb17f86b700 1 -- 172.21.15.71:0/3732472664 wait complete. 2023-10-06T01:41:14.360 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 9 2023-10-06T01:41:14.370 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:41:14.483 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.483+0000 7fa3a2efa700 1 Processor -- start 2023-10-06T01:41:14.484 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.483+0000 7fa3a2efa700 1 -- start start 2023-10-06T01:41:14.484 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.484+0000 7fa3a2efa700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa39c0af8b0 0x7fa39c15d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:14.485 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.484+0000 7fa3a2efa700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa39c0b27f0 0x7fa39c15d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:14.485 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.484+0000 7fa3a2efa700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa39c15e190 con 0x7fa39c0af4e0 2023-10-06T01:41:14.485 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.484+0000 7fa3a2efa700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa39c0b1910 con 0x7fa39c0af8b0 2023-10-06T01:41:14.485 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.484+0000 7fa3a2efa700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa39c0cb650 con 0x7fa39c0b27f0 2023-10-06T01:41:14.485 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.484+0000 7fa3a1497700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa39c0b27f0 0x7fa39c15d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:14.485 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.484+0000 7fa39bfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa39c0af8b0 0x7fa39c15d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:14.486 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.484+0000 7fa3a1497700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa39c0b27f0 0x7fa39c15d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.71:45684/0 (socket says 172.21.15.71:45684) 2023-10-06T01:41:14.486 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.484+0000 7fa3a1497700 1 -- 172.21.15.71:0/141654869 learned_addr learned my addr 172.21.15.71:0/141654869 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:14.487 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.484+0000 7fa39bfff700 1 -- 172.21.15.71:0/141654869 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa39c0b27f0 msgr2=0x7fa39c15d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:14.487 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.484+0000 7fa39bfff700 1 --2- 172.21.15.71:0/141654869 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa39c0b27f0 0x7fa39c15d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:14.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.484+0000 7fa39bfff700 1 -- 172.21.15.71:0/141654869 >> v1:172.21.15.72:6789/0 conn(0x7fa39c0af4e0 legacy=0x7fa39c0b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:14.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.484+0000 7fa39bfff700 1 -- 172.21.15.71:0/141654869 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa39c0ccaf0 con 0x7fa39c0af8b0 2023-10-06T01:41:14.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.484+0000 7fa39b7fe700 1 -- 172.21.15.71:0/141654869 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1971705915 0 0) 0x7fa39c15e190 con 0x7fa39c0af4e0 2023-10-06T01:41:14.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.484+0000 7fa3a1497700 1 --2- 172.21.15.71:0/141654869 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa39c0b27f0 0x7fa39c15d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:41:14.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.485+0000 7fa39bfff700 1 --2- 172.21.15.71:0/141654869 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa39c0af8b0 0x7fa39c15d460 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa38c0098e0 tx=0x7fa38c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a885a86f1bd63723 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:14.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.485+0000 7fa39b7fe700 1 -- 172.21.15.71:0/141654869 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa38c00b640 con 0x7fa39c0af8b0 2023-10-06T01:41:14.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.485+0000 7fa39b7fe700 1 -- 172.21.15.71:0/141654869 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa38c00b7a0 con 0x7fa39c0af8b0 2023-10-06T01:41:14.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.485+0000 7fa39b7fe700 1 -- 172.21.15.71:0/141654869 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa38c00bb40 con 0x7fa39c0af8b0 2023-10-06T01:41:14.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.485+0000 7fa3a2efa700 1 -- 172.21.15.71:0/141654869 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa39c0af8b0 msgr2=0x7fa39c15d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:14.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.485+0000 7fa3a2efa700 1 --2- 172.21.15.71:0/141654869 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa39c0af8b0 0x7fa39c15d460 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa38c0098e0 tx=0x7fa38c0091a0 comp rx=0 tx=0).stop 2023-10-06T01:41:14.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.485+0000 7fa3a2efa700 1 -- 172.21.15.71:0/141654869 shutdown_connections 2023-10-06T01:41:14.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.485+0000 7fa3a2efa700 1 --2- 172.21.15.71:0/141654869 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa39c0b27f0 0x7fa39c15d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:14.490 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.485+0000 7fa3a2efa700 1 --2- 172.21.15.71:0/141654869 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa39c0af8b0 0x7fa39c15d460 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:14.490 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.485+0000 7fa3a2efa700 1 -- 172.21.15.71:0/141654869 >> 172.21.15.71:0/141654869 conn(0x7fa39c068680 msgr2=0x7fa39c068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:14.490 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.485+0000 7fa3a2efa700 1 -- 172.21.15.71:0/141654869 shutdown_connections 2023-10-06T01:41:14.490 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.485+0000 7fa3a2efa700 1 -- 172.21.15.71:0/141654869 wait complete. 2023-10-06T01:41:14.490 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.486+0000 7fa3a2efa700 1 Processor -- start 2023-10-06T01:41:14.490 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.487+0000 7fa3a2efa700 1 -- start start 2023-10-06T01:41:14.493 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.487+0000 7fa3a2efa700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa39c0af4e0 0x7fa39c0c65f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:14.493 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.487+0000 7fa3a2efa700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa39c0af8b0 0x7fa39c154430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:14.493 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.487+0000 7fa3a2efa700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa39c0b27f0 0x7fa39c0c7470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:14.493 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.487+0000 7fa3a2efa700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa39c0ce820 con 0x7fa39c0af8b0 2023-10-06T01:41:14.494 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.487+0000 7fa3a2efa700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa39c0ceb00 con 0x7fa39c0af4e0 2023-10-06T01:41:14.494 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.487+0000 7fa3a2efa700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa39c0cede0 con 0x7fa39c0b27f0 2023-10-06T01:41:14.494 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.488+0000 7fa39bfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa39c0af8b0 0x7fa39c154430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:14.494 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.488+0000 7fa39bfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa39c0af8b0 0x7fa39c154430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47562/0 (socket says 172.21.15.71:47562) 2023-10-06T01:41:14.494 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.488+0000 7fa39bfff700 1 -- 172.21.15.71:0/377173089 learned_addr learned my addr 172.21.15.71:0/377173089 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:14.494 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.488+0000 7fa3a1497700 1 --2- 172.21.15.71:0/377173089 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa39c0b27f0 0x7fa39c0c7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:14.494 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.488+0000 7fa3a0c96700 1 --2- 172.21.15.71:0/377173089 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa39c0af4e0 0x7fa39c0c65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:14.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.488+0000 7fa39bfff700 1 -- 172.21.15.71:0/377173089 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa39c0b27f0 msgr2=0x7fa39c0c7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:14.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.488+0000 7fa39bfff700 1 --2- 172.21.15.71:0/377173089 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa39c0b27f0 0x7fa39c0c7470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:14.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.488+0000 7fa39bfff700 1 -- 172.21.15.71:0/377173089 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa39c0af4e0 msgr2=0x7fa39c0c65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:14.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.488+0000 7fa39bfff700 1 --2- 172.21.15.71:0/377173089 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa39c0af4e0 0x7fa39c0c65f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:14.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.488+0000 7fa39bfff700 1 -- 172.21.15.71:0/377173089 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3840094f0 con 0x7fa39c0af8b0 2023-10-06T01:41:14.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.488+0000 7fa39bfff700 1 --2- 172.21.15.71:0/377173089 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa39c0af8b0 0x7fa39c154430 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fa39c089520 tx=0x7fa38c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:14.495 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.488+0000 7fa398ff9700 1 -- 172.21.15.71:0/377173089 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa38c00b910 con 0x7fa39c0af8b0 2023-10-06T01:41:14.496 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.488+0000 7fa398ff9700 1 -- 172.21.15.71:0/377173089 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa38c00ba70 con 0x7fa39c0af8b0 2023-10-06T01:41:14.496 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.488+0000 7fa3a2efa700 1 -- 172.21.15.71:0/377173089 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa38c009420 con 0x7fa39c0af8b0 2023-10-06T01:41:14.496 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.488+0000 7fa398ff9700 1 -- 172.21.15.71:0/377173089 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa38c024670 con 0x7fa39c0af8b0 2023-10-06T01:41:14.496 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.488+0000 7fa3a2efa700 1 -- 172.21.15.71:0/377173089 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa39c0cf3a0 con 0x7fa39c0af8b0 2023-10-06T01:41:14.496 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.489+0000 7fa3a2efa700 1 -- 172.21.15.71:0/377173089 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa39c0cf590 con 0x7fa39c0af8b0 2023-10-06T01:41:14.496 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.489+0000 7fa398ff9700 1 -- 172.21.15.71:0/377173089 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa38c02d440 con 0x7fa39c0af8b0 2023-10-06T01:41:14.496 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.490+0000 7fa398ff9700 1 --2- 172.21.15.71:0/377173089 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fa37c066f30 0x7fa37c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:14.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.490+0000 7fa398ff9700 1 -- 172.21.15.71:0/377173089 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6867+0+0 (secure 0 0 0) 0x7fa38c086110 con 0x7fa39c0af8b0 2023-10-06T01:41:14.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.490+0000 7fa3a0c96700 1 --2- 172.21.15.71:0/377173089 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fa37c066f30 0x7fa37c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:14.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.490+0000 7fa3a0c96700 1 --2- 172.21.15.71:0/377173089 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fa37c066f30 0x7fa37c0693e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa394007fd0 tx=0x7fa394001640 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:14.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.494+0000 7fa398ff9700 1 -- 172.21.15.71:0/377173089 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa38c052ef0 con 0x7fa39c0af8b0 2023-10-06T01:41:14.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.678+0000 7fa3a2efa700 1 -- 172.21.15.71:0/377173089 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa39c0b0910 con 0x7fa39c0af8b0 2023-10-06T01:41:14.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.679+0000 7fa398ff9700 1 -- 172.21.15.71:0/377173089 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18754 (secure 0 0 0) 0x7fa38c056510 con 0x7fa39c0af8b0 2023-10-06T01:41:14.681 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:41:14.681 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":29,"fsid":"1fbf1bd2-f9b4-4599-bea2-f4aa920e9a56","created":"2023-10-06T01:39:57.016957+0000","modified":"2023-10-06T01:41:03.811605+0000","last_up_change":"2023-10-06T01:40:08.571643+0000","last_in_change":"2023-10-06T01:39:59.462741+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T01:40:08.610349+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T01:40:15.387434+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T01:40:19.640459+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T01:40:20.116883+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T01:40:23.830129+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cf059188-fb20-4dbf-95db-dcf57b213d03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":90670},{"type":"v1","addr":"172.21.15.71:6817","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":90670},{"type":"v1","addr":"172.21.15.71:6819","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":90670},{"type":"v1","addr":"172.21.15.71:6823","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":90670},{"type":"v1","addr":"172.21.15.71:6821","nonce":90670}]},"public_addr":"172.21.15.71:6817/90670","cluster_addr":"172.21.15.71:6819/90670","heartbeat_back_addr":"172.21.15.71:6823/90670","heartbeat_front_addr":"172.21.15.71:6821/90670","state":["exists","up"]},{"osd":1,"uuid":"0cff0aae-1799-4fe0-b610-54cf0813c0e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":90669},{"type":"v1","addr":"172.21.15.71:6809","nonce":90669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":90669},{"type":"v1","addr":"172.21.15.71:6811","nonce":90669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":90669},{"type":"v1","addr":"172.21.15.71:6815","nonce":90669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":90669},{"type":"v1","addr":"172.21.15.71:6813","nonce":90669}]},"public_addr":"172.21.15.71:6809/90669","cluster_addr":"172.21.15.71:6811/90669","heartbeat_back_addr":"172.21.15.71:6815/90669","heartbeat_front_addr":"172.21.15.71:6813/90669","state":["exists","up"]},{"osd":2,"uuid":"88d61ddc-9031-44e1-ba8c-546a41e7c8ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":90679},{"type":"v1","addr":"172.21.15.71:6825","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":90679},{"type":"v1","addr":"172.21.15.71:6827","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":90679},{"type":"v1","addr":"172.21.15.71:6831","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":90679},{"type":"v1","addr":"172.21.15.71:6829","nonce":90679}]},"public_addr":"172.21.15.71:6825/90679","cluster_addr":"172.21.15.71:6827/90679","heartbeat_back_addr":"172.21.15.71:6831/90679","heartbeat_front_addr":"172.21.15.71:6829/90679","state":["exists","up"]},{"osd":3,"uuid":"11ed92b7-960b-4a30-a889-a61d3eeb86f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":90668},{"type":"v1","addr":"172.21.15.71:6801","nonce":90668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":90668},{"type":"v1","addr":"172.21.15.71:6803","nonce":90668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":90668},{"type":"v1","addr":"172.21.15.71:6807","nonce":90668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":90668},{"type":"v1","addr":"172.21.15.71:6805","nonce":90668}]},"public_addr":"172.21.15.71:6801/90668","cluster_addr":"172.21.15.71:6803/90668","heartbeat_back_addr":"172.21.15.71:6807/90668","heartbeat_front_addr":"172.21.15.71:6805/90668","state":["exists","up"]},{"osd":4,"uuid":"ae4df784-abdf-4ddf-aefa-780f3ddafef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":90917},{"type":"v1","addr":"172.21.15.72:6801","nonce":90917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":90917},{"type":"v1","addr":"172.21.15.72:6803","nonce":90917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":90917},{"type":"v1","addr":"172.21.15.72:6807","nonce":90917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":90917},{"type":"v1","addr":"172.21.15.72:6805","nonce":90917}]},"public_addr":"172.21.15.72:6801/90917","cluster_addr":"172.21.15.72:6803/90917","heartbeat_back_addr":"172.21.15.72:6807/90917","heartbeat_front_addr":"172.21.15.72:6805/90917","state":["exists","up"]},{"osd":5,"uuid":"5ef0790f-001e-458f-a05b-efae216cf435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":90941},{"type":"v1","addr":"172.21.15.72:6817","nonce":90941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":90941},{"type":"v1","addr":"172.21.15.72:6819","nonce":90941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":90941},{"type":"v1","addr":"172.21.15.72:6827","nonce":90941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":90941},{"type":"v1","addr":"172.21.15.72:6823","nonce":90941}]},"public_addr":"172.21.15.72:6817/90941","cluster_addr":"172.21.15.72:6819/90941","heartbeat_back_addr":"172.21.15.72:6827/90941","heartbeat_front_addr":"172.21.15.72:6823/90941","state":["exists","up"]},{"osd":6,"uuid":"8705aef1-9ae8-4e54-a3c4-c2909fa0ceb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":90918},{"type":"v1","addr":"172.21.15.72:6809","nonce":90918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":90918},{"type":"v1","addr":"172.21.15.72:6811","nonce":90918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":90918},{"type":"v1","addr":"172.21.15.72:6815","nonce":90918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":90918},{"type":"v1","addr":"172.21.15.72:6813","nonce":90918}]},"public_addr":"172.21.15.72:6809/90918","cluster_addr":"172.21.15.72:6811/90918","heartbeat_back_addr":"172.21.15.72:6815/90918","heartbeat_front_addr":"172.21.15.72:6813/90918","state":["exists","up"]},{"osd":7,"uuid":"364c5119-6b13-4c75-b3f0-15e165eff86a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":90948},{"type":"v1","addr":"172.21.15.72:6822","nonce":90948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":90948},{"type":"v1","addr":"172.21.15.72:6826","nonce":90948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":90948},{"type":"v1","addr":"172.21.15.72:6831","nonce":90948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":90948},{"type":"v1","addr":"172.21.15.72:6829","nonce":90948}]},"public_addr":"172.21.15.72:6822/90948","cluster_addr":"172.21.15.72:6826/90948","heartbeat_back_addr":"172.21.15.72:6831/90948","heartbeat_front_addr":"172.21.15.72:6829/90948","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.642976+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.645372+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.619116+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.663042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.599163+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.646411+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.631545+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.669821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.a","mappings":[{"from":1,"to":5}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:41:14.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.682+0000 7fa3a2efa700 1 -- 172.21.15.71:0/377173089 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fa37c066f30 msgr2=0x7fa37c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:14.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.682+0000 7fa3a2efa700 1 --2- 172.21.15.71:0/377173089 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fa37c066f30 0x7fa37c0693e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa394007fd0 tx=0x7fa394001640 comp rx=0 tx=0).stop 2023-10-06T01:41:14.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.682+0000 7fa3a2efa700 1 -- 172.21.15.71:0/377173089 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa39c0af8b0 msgr2=0x7fa39c154430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:14.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.682+0000 7fa3a2efa700 1 --2- 172.21.15.71:0/377173089 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa39c0af8b0 0x7fa39c154430 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fa39c089520 tx=0x7fa38c017000 comp rx=0 tx=0).stop 2023-10-06T01:41:14.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.682+0000 7fa3a2efa700 1 -- 172.21.15.71:0/377173089 shutdown_connections 2023-10-06T01:41:14.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.682+0000 7fa3a2efa700 1 --2- 172.21.15.71:0/377173089 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa39c0b27f0 0x7fa39c0c7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:14.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.682+0000 7fa3a2efa700 1 --2- 172.21.15.71:0/377173089 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fa37c066f30 0x7fa37c0693e0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:14.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.682+0000 7fa3a2efa700 1 --2- 172.21.15.71:0/377173089 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa39c0af4e0 0x7fa39c0c65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:14.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.682+0000 7fa3a2efa700 1 --2- 172.21.15.71:0/377173089 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa39c0af8b0 0x7fa39c154430 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:14.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.682+0000 7fa3a2efa700 1 -- 172.21.15.71:0/377173089 >> 172.21.15.71:0/377173089 conn(0x7fa39c068680 msgr2=0x7fa39c15d230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:14.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.682+0000 7fa3a2efa700 1 -- 172.21.15.71:0/377173089 shutdown_connections 2023-10-06T01:41:14.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.682+0000 7fa3a2efa700 1 -- 172.21.15.71:0/377173089 wait complete. 2023-10-06T01:41:14.695 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T01:41:14.808 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.808+0000 7f6a59081700 1 Processor -- start 2023-10-06T01:41:14.808 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.808+0000 7f6a59081700 1 -- start start 2023-10-06T01:41:14.810 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.809+0000 7f6a59081700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f6a540b28c0 0x7f6a54087470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:14.810 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.809+0000 7f6a59081700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a540afc50 con 0x7f6a54086ff0 2023-10-06T01:41:14.810 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.809+0000 7f6a59081700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a540aff30 con 0x7f6a5415a030 2023-10-06T01:41:14.810 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.809+0000 7f6a59081700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a540b0cf0 con 0x7f6a540b28c0 2023-10-06T01:41:14.810 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.809+0000 7f6a5359e700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f6a540b28c0 0x7f6a54087470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:14.810 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.809+0000 7f6a5259c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f6a54086ff0 0x7f6a540b21b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:39798/0 (socket says 172.21.15.71:39798) 2023-10-06T01:41:14.810 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.809+0000 7f6a5259c700 1 -- 172.21.15.71:0/657430261 learned_addr learned my addr 172.21.15.71:0/657430261 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:41:14.811 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.809+0000 7f6a5359e700 1 -- 172.21.15.71:0/657430261 >> v1:172.21.15.72:6789/0 conn(0x7f6a5415a030 legacy=0x7f6a5415a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:14.811 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.809+0000 7f6a51d9b700 1 -- 172.21.15.71:0/657430261 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4156900707 0 0) 0x7f6a540aff30 con 0x7f6a5415a030 2023-10-06T01:41:14.811 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.809+0000 7f6a5359e700 1 -- 172.21.15.71:0/657430261 >> v1:172.21.15.71:6789/0 conn(0x7f6a54086ff0 legacy=0x7f6a540b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:14.811 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.809+0000 7f6a5359e700 1 -- 172.21.15.71:0/657430261 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a540b0210 con 0x7f6a540b28c0 2023-10-06T01:41:14.811 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.809+0000 7f6a5359e700 1 --2- 172.21.15.71:0/657430261 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6a540b28c0 0x7f6a54087470 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c009e60 tx=0x7f6a4c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff38837c31a28f6b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:14.811 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.809+0000 7f6a51d9b700 1 -- 172.21.15.71:0/657430261 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4c00e070 con 0x7f6a540b28c0 2023-10-06T01:41:14.811 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.809+0000 7f6a51d9b700 1 -- 172.21.15.71:0/657430261 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a4c00bb30 con 0x7f6a540b28c0 2023-10-06T01:41:14.811 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.809+0000 7f6a51d9b700 1 -- 172.21.15.71:0/657430261 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4c012430 con 0x7f6a540b28c0 2023-10-06T01:41:14.814 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.810+0000 7f6a59081700 1 -- 172.21.15.71:0/657430261 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6a540b28c0 msgr2=0x7f6a54087470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:14.814 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.810+0000 7f6a59081700 1 --2- 172.21.15.71:0/657430261 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6a540b28c0 0x7f6a54087470 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c009e60 tx=0x7f6a4c009780 comp rx=0 tx=0).stop 2023-10-06T01:41:14.814 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.810+0000 7f6a59081700 1 -- 172.21.15.71:0/657430261 shutdown_connections 2023-10-06T01:41:14.814 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.810+0000 7f6a59081700 1 --2- 172.21.15.71:0/657430261 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6a540b28c0 0x7f6a54087470 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:14.814 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.810+0000 7f6a59081700 1 -- 172.21.15.71:0/657430261 >> 172.21.15.71:0/657430261 conn(0x7f6a54068680 msgr2=0x7f6a54068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:14.814 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.810+0000 7f6a59081700 1 -- 172.21.15.71:0/657430261 shutdown_connections 2023-10-06T01:41:14.814 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.810+0000 7f6a59081700 1 -- 172.21.15.71:0/657430261 wait complete. 2023-10-06T01:41:14.814 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.811+0000 7f6a59081700 1 Processor -- start 2023-10-06T01:41:14.814 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.811+0000 7f6a59081700 1 -- start start 2023-10-06T01:41:14.814 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.812+0000 7f6a59081700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6a54086ff0 0x7f6a54149a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:14.814 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.812+0000 7f6a59081700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6a540b28c0 0x7f6a540c47f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:14.815 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.812+0000 7f6a59081700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a5415a030 0x7f6a540c9780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:14.815 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.812+0000 7f6a59081700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a540c6130 con 0x7f6a540b28c0 2023-10-06T01:41:14.815 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.812+0000 7f6a59081700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a540c6aa0 con 0x7f6a5415a030 2023-10-06T01:41:14.815 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.812+0000 7f6a59081700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a540c4d30 con 0x7f6a54086ff0 2023-10-06T01:41:14.815 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.812+0000 7f6a5259c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6a540b28c0 0x7f6a540c47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:14.815 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.812+0000 7f6a5259c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6a540b28c0 0x7f6a540c47f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47580/0 (socket says 172.21.15.71:47580) 2023-10-06T01:41:14.815 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.812+0000 7f6a5259c700 1 -- 172.21.15.71:0/822962744 learned_addr learned my addr 172.21.15.71:0/822962744 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:14.815 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.812+0000 7f6a5359e700 1 --2- 172.21.15.71:0/822962744 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a5415a030 0x7f6a540c9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:14.815 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.812+0000 7f6a52d9d700 1 --2- 172.21.15.71:0/822962744 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6a54086ff0 0x7f6a54149a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:14.815 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.812+0000 7f6a5259c700 1 -- 172.21.15.71:0/822962744 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6a54086ff0 msgr2=0x7f6a54149a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:14.815 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.812+0000 7f6a5259c700 1 --2- 172.21.15.71:0/822962744 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6a54086ff0 0x7f6a54149a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:14.815 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.812+0000 7f6a5259c700 1 -- 172.21.15.71:0/822962744 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a5415a030 msgr2=0x7f6a540c9780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:14.815 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.812+0000 7f6a5259c700 1 --2- 172.21.15.71:0/822962744 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a5415a030 0x7f6a540c9780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:14.816 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.812+0000 7f6a5259c700 1 -- 172.21.15.71:0/822962744 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a4c009a20 con 0x7f6a540b28c0 2023-10-06T01:41:14.816 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.813+0000 7f6a5259c700 1 --2- 172.21.15.71:0/822962744 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6a540b28c0 0x7f6a540c47f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f6a4800c810 tx=0x7f6a48007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:14.816 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.813+0000 7f6a3affd700 1 -- 172.21.15.71:0/822962744 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a48005b30 con 0x7f6a540b28c0 2023-10-06T01:41:14.816 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.813+0000 7f6a3affd700 1 -- 172.21.15.71:0/822962744 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a48005cb0 con 0x7f6a540b28c0 2023-10-06T01:41:14.816 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.813+0000 7f6a59081700 1 -- 172.21.15.71:0/822962744 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a540c8070 con 0x7f6a540b28c0 2023-10-06T01:41:14.816 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.813+0000 7f6a3affd700 1 -- 172.21.15.71:0/822962744 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a48007320 con 0x7f6a540b28c0 2023-10-06T01:41:14.816 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.813+0000 7f6a59081700 1 -- 172.21.15.71:0/822962744 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a540c5dc0 con 0x7f6a540b28c0 2023-10-06T01:41:14.817 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.814+0000 7f6a59081700 1 -- 172.21.15.71:0/822962744 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a540c64c0 con 0x7f6a540b28c0 2023-10-06T01:41:14.817 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.814+0000 7f6a3affd700 1 -- 172.21.15.71:0/822962744 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6a4801b3b0 con 0x7f6a540b28c0 2023-10-06T01:41:14.817 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.814+0000 7f6a3affd700 1 --2- 172.21.15.71:0/822962744 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f6a40066f30 0x7f6a400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:14.817 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.815+0000 7f6a52d9d700 1 --2- 172.21.15.71:0/822962744 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f6a40066f30 0x7f6a400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:14.817 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.815+0000 7f6a3affd700 1 -- 172.21.15.71:0/822962744 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f6a48083df0 con 0x7f6a540b28c0 2023-10-06T01:41:14.817 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.815+0000 7f6a52d9d700 1 --2- 172.21.15.71:0/822962744 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f6a40066f30 0x7f6a400693e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f6a44007fd0 tx=0x7f6a44007d30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:14.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:14.819+0000 7f6a3affd700 1 -- 172.21.15.71:0/822962744 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6a540c64c0 con 0x7f6a540b28c0 2023-10-06T01:41:15.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:15.044+0000 7f6a59081700 1 -- 172.21.15.71:0/822962744 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f6a540c64c0 con 0x7f6a540b28c0 2023-10-06T01:41:15.045 INFO:tasks.ceph.mon.a.smithi071.stderr:2023-10-06T01:41:15.045+0000 7fec89f1c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T01:41:15.052 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:15.051+0000 7f6a3affd700 1 -- 172.21.15.71:0/822962744 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) v1 ==== 161+0+0 (secure 0 0 0) 0x7f6a540c64c0 con 0x7f6a540b28c0 2023-10-06T01:41:15.054 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:15.053+0000 7f6a59081700 1 -- 172.21.15.71:0/822962744 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f6a40066f30 msgr2=0x7f6a400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:15.054 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:15.053+0000 7f6a59081700 1 --2- 172.21.15.71:0/822962744 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f6a40066f30 0x7f6a400693e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f6a44007fd0 tx=0x7f6a44007d30 comp rx=0 tx=0).stop 2023-10-06T01:41:15.054 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:15.053+0000 7f6a59081700 1 -- 172.21.15.71:0/822962744 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6a540b28c0 msgr2=0x7f6a540c47f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:15.055 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:15.053+0000 7f6a59081700 1 --2- 172.21.15.71:0/822962744 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6a540b28c0 0x7f6a540c47f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f6a4800c810 tx=0x7f6a48007ef0 comp rx=0 tx=0).stop 2023-10-06T01:41:15.055 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:15.053+0000 7f6a59081700 1 -- 172.21.15.71:0/822962744 shutdown_connections 2023-10-06T01:41:15.055 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:15.053+0000 7f6a59081700 1 --2- 172.21.15.71:0/822962744 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f6a40066f30 0x7f6a400693e0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:15.055 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:15.053+0000 7f6a59081700 1 --2- 172.21.15.71:0/822962744 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a5415a030 0x7f6a540c9780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:15.055 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:15.053+0000 7f6a59081700 1 --2- 172.21.15.71:0/822962744 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6a54086ff0 0x7f6a54149a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:15.055 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:15.053+0000 7f6a59081700 1 --2- 172.21.15.71:0/822962744 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6a540b28c0 0x7f6a540c47f0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:15.055 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:15.053+0000 7f6a59081700 1 -- 172.21.15.71:0/822962744 >> 172.21.15.71:0/822962744 conn(0x7f6a54068680 msgr2=0x7f6a540cb450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:15.055 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:15.053+0000 7f6a59081700 1 -- 172.21.15.71:0/822962744 shutdown_connections 2023-10-06T01:41:15.055 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:15.053+0000 7f6a59081700 1 -- 172.21.15.71:0/822962744 wait complete. 2023-10-06T01:41:15.056 INFO:teuthology.orchestra.run.smithi071.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T01:41:15.056 INFO:tasks.ceph.mds.b.smithi072.stderr: -3988> 2023-10-06T01:40:27.761+0000 7f03db0a6700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T01:41:15.066 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T01:41:15.083 INFO:tasks.ceph.mds.b.smithi072.stdout:starting mds.b at 2023-10-06T01:41:15.182 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:15.181+0000 7ff3f7256700 1 Processor -- start 2023-10-06T01:41:15.182 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:15.181+0000 7ff3f7256700 1 -- start start 2023-10-06T01:41:15.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:15.182+0000 7ff3f7256700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff3f00d0400 0x7ff3f00b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:15.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:15.182+0000 7ff3f7256700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3f00b6170 con 0x7ff3f00d07d0 2023-10-06T01:41:15.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:15.182+0000 7ff3f7256700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3f015dd40 con 0x7ff3f00ccd40 2023-10-06T01:41:15.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:15.182+0000 7ff3f7256700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f015e020 con 0x7ff3f00d0400 2023-10-06T01:41:15.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:15.182+0000 7ff3f57f3700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7ff3f00d07d0 0x7ff3f00b3aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:39804/0 (socket says 172.21.15.71:39804) 2023-10-06T01:41:15.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:15.182+0000 7ff3f57f3700 1 -- 172.21.15.71:0/2614942433 learned_addr learned my addr 172.21.15.71:0/2614942433 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:41:15.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:15.182+0000 7ff3f4ff2700 1 --2- 172.21.15.71:0/2614942433 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff3f00d0400 0x7ff3f00b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:15.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:15.182+0000 7ff3ef7fe700 1 -- 172.21.15.71:0/2614942433 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3476955077 0 0) 0x7ff3f00b6170 con 0x7ff3f00d07d0 2023-10-06T01:41:15.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:15.182+0000 7ff3ef7fe700 1 -- 172.21.15.71:0/2614942433 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3d8003570 con 0x7ff3f00d07d0 2023-10-06T01:41:15.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:15.182+0000 7ff3ef7fe700 1 -- 172.21.15.71:0/2614942433 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 982821165 0 0) 0x7ff3f015dd40 con 0x7ff3f00ccd40 2023-10-06T01:41:15.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:15.182+0000 7ff3ef7fe700 1 -- 172.21.15.71:0/2614942433 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3f00b6170 con 0x7ff3f00ccd40 2023-10-06T01:41:15.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:15.182+0000 7ff3ef7fe700 1 -- 172.21.15.71:0/2614942433 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2172474987 0 0) 0x7ff3d8003570 con 0x7ff3f00d07d0 2023-10-06T01:41:15.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:15.182+0000 7ff3ef7fe700 1 -- 172.21.15.71:0/2614942433 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff3f00d0400 msgr2=0x7ff3f00b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:15.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:15.182+0000 7ff3ef7fe700 1 --2- 172.21.15.71:0/2614942433 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff3f00d0400 0x7ff3f00b5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:15.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:15.182+0000 7ff3ef7fe700 1 -- 172.21.15.71:0/2614942433 >> v1:172.21.15.72:6789/0 conn(0x7ff3f00ccd40 legacy=0x7ff3f00cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:15.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:15.182+0000 7ff3ef7fe700 1 -- 172.21.15.71:0/2614942433 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3f00ceaa0 con 0x7ff3f00d07d0 2023-10-06T01:41:15.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:15.182+0000 7ff3ef7fe700 1 -- 172.21.15.71:0/2614942433 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1184243524 0 0) 0x7ff3e00013f0 con 0x7ff3f00d07d0 2023-10-06T01:41:15.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:15.183+0000 7ff3ef7fe700 1 -- 172.21.15.71:0/2614942433 >> v1:172.21.15.71:6789/0 conn(0x7ff3f00d07d0 legacy=0x7ff3f00b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:15.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:15.183+0000 7ff3ef7fe700 1 --2- 172.21.15.71:0/2614942433 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3d8003c20 0x7ff3d8004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:15.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:15.183+0000 7ff3ef7fe700 1 --2- 172.21.15.71:0/2614942433 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3d8004810 0x7ff3d8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:15.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:15.183+0000 7ff3ef7fe700 1 --2- 172.21.15.71:0/2614942433 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff3f00d0400 0x7ff3d8005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:15.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:15.183+0000 7ff3ef7fe700 1 -- 172.21.15.71:0/2614942433 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f015e020 con 0x7ff3d8004810 2023-10-06T01:41:15.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:15.183+0000 7ff3ef7fe700 1 -- 172.21.15.71:0/2614942433 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d800bbf0 con 0x7ff3d8003c20 2023-10-06T01:41:15.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:15.183+0000 7ff3ef7fe700 1 -- 172.21.15.71:0/2614942433 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d800bdb0 con 0x7ff3f00d0400 2023-10-06T01:41:15.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:15.183+0000 7ff3effff700 1 --2- 172.21.15.71:0/2614942433 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3d8004810 0x7ff3d8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:15.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:15.183+0000 7ff3f4ff2700 1 --2- 172.21.15.71:0/2614942433 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3d8003c20 0x7ff3d8004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:15.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:15.183+0000 7ff3f57f3700 1 --2- 172.21.15.71:0/2614942433 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff3f00d0400 0x7ff3d8005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:15.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:15.183+0000 7ff3effff700 1 -- 172.21.15.71:0/2614942433 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff3f00d0400 msgr2=0x7ff3d8005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:15.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:15.183+0000 7ff3effff700 1 --2- 172.21.15.71:0/2614942433 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff3f00d0400 0x7ff3d8005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:15.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:15.183+0000 7ff3effff700 1 -- 172.21.15.71:0/2614942433 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3d8003c20 msgr2=0x7ff3d8004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:15.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:15.183+0000 7ff3effff700 1 --2- 172.21.15.71:0/2614942433 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3d8003c20 0x7ff3d8004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:15.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:15.183+0000 7ff3effff700 1 -- 172.21.15.71:0/2614942433 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3d8003570 con 0x7ff3d8004810 2023-10-06T01:41:15.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:15.183+0000 7ff3effff700 1 --2- 172.21.15.71:0/2614942433 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3d8004810 0x7ff3d8004c80 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7ff3e4001a10 tx=0x7ff3e4007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ade4e57c65a6d1f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:15.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:15.183+0000 7ff3ef7fe700 1 -- 172.21.15.71:0/2614942433 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e400c5d0 con 0x7ff3d8004810 2023-10-06T01:41:15.189 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:15.183+0000 7ff3ef7fe700 1 -- 172.21.15.71:0/2614942433 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3e400c730 con 0x7ff3d8004810 2023-10-06T01:41:15.189 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:15.183+0000 7ff3ef7fe700 1 -- 172.21.15.71:0/2614942433 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e400cad0 con 0x7ff3d8004810 2023-10-06T01:41:15.189 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:15.184+0000 7ff3f7256700 1 -- 172.21.15.71:0/2614942433 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3d8004810 msgr2=0x7ff3d8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:15.189 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:15.184+0000 7ff3f7256700 1 --2- 172.21.15.71:0/2614942433 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3d8004810 0x7ff3d8004c80 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7ff3e4001a10 tx=0x7ff3e4007d30 comp rx=0 tx=0).stop 2023-10-06T01:41:15.189 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:15.184+0000 7ff3f57f3700 1 -- 172.21.15.71:0/2614942433 reap_dead start 2023-10-06T01:41:15.189 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:15.184+0000 7ff3f7256700 1 -- 172.21.15.71:0/2614942433 shutdown_connections 2023-10-06T01:41:15.189 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:15.184+0000 7ff3f7256700 1 -- 172.21.15.71:0/2614942433 >> 172.21.15.71:0/2614942433 conn(0x7ff3f006a220 msgr2=0x7ff3f006a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:15.189 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:15.184+0000 7ff3f7256700 1 -- 172.21.15.71:0/2614942433 shutdown_connections 2023-10-06T01:41:15.189 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:15.184+0000 7ff3f7256700 1 -- 172.21.15.71:0/2614942433 wait complete. 2023-10-06T01:41:15.189 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:15.185+0000 7ff3f7256700 1 Processor -- start 2023-10-06T01:41:15.189 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:15.185+0000 7ff3f7256700 1 -- start start 2023-10-06T01:41:15.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:15.186+0000 7ff3f7256700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3d8004810 0x7ff3f00ca780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:15.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:15.186+0000 7ff3f7256700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3f00cacc0 0x7ff3f0169b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:15.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:15.186+0000 7ff3f7256700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff3f016a0a0 0x7ff3f016a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:15.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:15.186+0000 7ff3f7256700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f016aa60 con 0x7ff3d8004810 2023-10-06T01:41:15.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:15.186+0000 7ff3f7256700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f00cb2d0 con 0x7ff3f00cacc0 2023-10-06T01:41:15.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:15.186+0000 7ff3f7256700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f00cb5b0 con 0x7ff3f016a0a0 2023-10-06T01:41:15.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:15.186+0000 7ff3f4ff2700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3d8004810 0x7ff3f00ca780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:15.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:15.186+0000 7ff3f4ff2700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3d8004810 0x7ff3f00ca780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47586/0 (socket says 172.21.15.71:47586) 2023-10-06T01:41:15.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:15.186+0000 7ff3effff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3f00cacc0 0x7ff3f0169b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:15.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:15.186+0000 7ff3f4ff2700 1 -- 172.21.15.71:0/589160551 learned_addr learned my addr 172.21.15.71:0/589160551 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:15.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:15.186+0000 7ff3f57f3700 1 --2- 172.21.15.71:0/589160551 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff3f016a0a0 0x7ff3f016a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:15.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:15.186+0000 7ff3f4ff2700 1 -- 172.21.15.71:0/589160551 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff3f016a0a0 msgr2=0x7ff3f016a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:15.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:15.186+0000 7ff3f4ff2700 1 --2- 172.21.15.71:0/589160551 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff3f016a0a0 0x7ff3f016a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:15.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:15.186+0000 7ff3f4ff2700 1 -- 172.21.15.71:0/589160551 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3f00cacc0 msgr2=0x7ff3f0169b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:15.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:15.186+0000 7ff3f4ff2700 1 --2- 172.21.15.71:0/589160551 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3f00cacc0 0x7ff3f0169b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:15.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:15.186+0000 7ff3f4ff2700 1 -- 172.21.15.71:0/589160551 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3f00cb890 con 0x7ff3d8004810 2023-10-06T01:41:15.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:15.186+0000 7ff3f4ff2700 1 --2- 172.21.15.71:0/589160551 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3d8004810 0x7ff3f00ca780 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8009fd0 tx=0x7ff3e800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:15.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:15.186+0000 7ff3ecff9700 1 -- 172.21.15.71:0/589160551 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e800e040 con 0x7ff3d8004810 2023-10-06T01:41:15.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:15.186+0000 7ff3ecff9700 1 -- 172.21.15.71:0/589160551 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3e800f040 con 0x7ff3d8004810 2023-10-06T01:41:15.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:15.186+0000 7ff3f7256700 1 -- 172.21.15.71:0/589160551 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3f00cbb70 con 0x7ff3d8004810 2023-10-06T01:41:15.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:15.186+0000 7ff3ecff9700 1 -- 172.21.15.71:0/589160551 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e8015430 con 0x7ff3d8004810 2023-10-06T01:41:15.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:15.187+0000 7ff3f7256700 1 -- 172.21.15.71:0/589160551 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3f0155900 con 0x7ff3d8004810 2023-10-06T01:41:15.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:15.187+0000 7ff3f7256700 1 -- 172.21.15.71:0/589160551 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3f00cb090 con 0x7ff3d8004810 2023-10-06T01:41:15.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:15.188+0000 7ff3ecff9700 1 -- 172.21.15.71:0/589160551 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff3e80157e0 con 0x7ff3d8004810 2023-10-06T01:41:15.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:15.188+0000 7ff3ecff9700 1 --2- 172.21.15.71:0/589160551 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7ff3dc066f30 0x7ff3dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:15.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:15.188+0000 7ff3effff700 1 --2- 172.21.15.71:0/589160551 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7ff3dc066f30 0x7ff3dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:15.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:15.188+0000 7ff3ecff9700 1 -- 172.21.15.71:0/589160551 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6953+0+0 (secure 0 0 0) 0x7ff3e80855f0 con 0x7ff3d8004810 2023-10-06T01:41:15.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:15.189+0000 7ff3effff700 1 --2- 172.21.15.71:0/589160551 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7ff3dc066f30 0x7ff3dc0693e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff3e4008fd0 tx=0x7ff3e4015000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:15.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:15.193+0000 7ff3ecff9700 1 -- 172.21.15.71:0/589160551 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff3f00cb090 con 0x7ff3d8004810 2023-10-06T01:41:15.415 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:15.415+0000 7ff3f7256700 1 -- 172.21.15.71:0/589160551 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ff3f00cb090 con 0x7ff3d8004810 2023-10-06T01:41:16.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:16.049+0000 7ff3ecff9700 1 -- 172.21.15.71:0/589160551 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff3f00cb090 con 0x7ff3d8004810 2023-10-06T01:41:16.052 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:16.051+0000 7ff3f7256700 1 -- 172.21.15.71:0/589160551 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7ff3dc066f30 msgr2=0x7ff3dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:16.052 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:16.051+0000 7ff3f7256700 1 --2- 172.21.15.71:0/589160551 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7ff3dc066f30 0x7ff3dc0693e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff3e4008fd0 tx=0x7ff3e4015000 comp rx=0 tx=0).stop 2023-10-06T01:41:16.052 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:16.051+0000 7ff3f7256700 1 -- 172.21.15.71:0/589160551 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3d8004810 msgr2=0x7ff3f00ca780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:16.052 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:16.051+0000 7ff3f7256700 1 --2- 172.21.15.71:0/589160551 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3d8004810 0x7ff3f00ca780 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8009fd0 tx=0x7ff3e800b040 comp rx=0 tx=0).stop 2023-10-06T01:41:16.052 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:16.051+0000 7ff3f7256700 1 -- 172.21.15.71:0/589160551 shutdown_connections 2023-10-06T01:41:16.052 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:16.051+0000 7ff3f7256700 1 --2- 172.21.15.71:0/589160551 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff3f016a0a0 0x7ff3f016a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:16.053 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:16.051+0000 7ff3f7256700 1 --2- 172.21.15.71:0/589160551 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3d8004810 0x7ff3f00ca780 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:16.053 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:16.051+0000 7ff3f7256700 1 --2- 172.21.15.71:0/589160551 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7ff3dc066f30 0x7ff3dc0693e0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:16.053 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:16.051+0000 7ff3f7256700 1 --2- 172.21.15.71:0/589160551 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3f00cacc0 0x7ff3f0169b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:16.053 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:16.051+0000 7ff3f7256700 1 -- 172.21.15.71:0/589160551 >> 172.21.15.71:0/589160551 conn(0x7ff3f006a220 msgr2=0x7ff3f00aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:16.053 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:16.051+0000 7ff3f7256700 1 -- 172.21.15.71:0/589160551 shutdown_connections 2023-10-06T01:41:16.053 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:16.051+0000 7ff3f7256700 1 -- 172.21.15.71:0/589160551 wait complete. 2023-10-06T01:41:16.064 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T01:41:16.182 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:16.181+0000 7f3c44141700 1 Processor -- start 2023-10-06T01:41:16.182 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:16.181+0000 7f3c44141700 1 -- start start 2023-10-06T01:41:16.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:16.182+0000 7f3c44141700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3c3c13cc10 0x7f3c3c068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:16.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:16.182+0000 7f3c44141700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f3c3c0c3180 0x7f3c3c0c35d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:16.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:16.182+0000 7f3c44141700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c3c0c2cf0 con 0x7f3c3c13c840 2023-10-06T01:41:16.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:16.182+0000 7f3c44141700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c3c0c3b10 con 0x7f3c3c0c3180 2023-10-06T01:41:16.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:16.182+0000 7f3c44141700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c3c0691f0 con 0x7f3c3c13cc10 2023-10-06T01:41:16.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:16.182+0000 7f3c426de700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f3c3c0c3180 0x7f3c3c0c35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:16.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:16.182+0000 7f3c41edd700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f3c3c13c840 0x7f3c3c140580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:39816/0 (socket says 172.21.15.71:39816) 2023-10-06T01:41:16.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:16.182+0000 7f3c41edd700 1 -- 172.21.15.71:0/512278397 learned_addr learned my addr 172.21.15.71:0/512278397 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:41:16.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:16.182+0000 7f3c426de700 1 -- 172.21.15.71:0/512278397 >> v2:172.21.15.72:3300/0 conn(0x7f3c3c13cc10 msgr2=0x7f3c3c068cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:16.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:16.182+0000 7f3c416dc700 1 --2- 172.21.15.71:0/512278397 >> v2:172.21.15.72:3300/0 conn(0x7f3c3c13cc10 0x7f3c3c068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:16.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:16.183+0000 7f3c426de700 1 --2- 172.21.15.71:0/512278397 >> v2:172.21.15.72:3300/0 conn(0x7f3c3c13cc10 0x7f3c3c068cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:16.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:16.183+0000 7f3c426de700 1 -- 172.21.15.71:0/512278397 >> v1:172.21.15.71:6789/0 conn(0x7f3c3c13c840 legacy=0x7f3c3c140580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:16.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:16.182+0000 7f3c40edb700 1 -- 172.21.15.71:0/512278397 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1681977098 0 0) 0x7f3c3c0c2cf0 con 0x7f3c3c13c840 2023-10-06T01:41:16.185 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:16.183+0000 7f3c426de700 1 -- 172.21.15.71:0/512278397 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c3c0c1e00 con 0x7f3c3c0c3180 2023-10-06T01:41:16.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:16.183+0000 7f3c416dc700 1 --2- 172.21.15.71:0/512278397 >> v2:172.21.15.72:3300/0 conn(0x7f3c3c13cc10 0x7f3c3c068cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:41:16.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:16.183+0000 7f3c426de700 1 --2- 172.21.15.71:0/512278397 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3c3c0c3180 0x7f3c3c0c35d0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c063c30 tx=0x7f3c340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37d8b5370960437b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:16.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:16.183+0000 7f3c40edb700 1 -- 172.21.15.71:0/512278397 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3400b6b0 con 0x7f3c3c0c3180 2023-10-06T01:41:16.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:16.183+0000 7f3c40edb700 1 -- 172.21.15.71:0/512278397 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c3400b810 con 0x7f3c3c0c3180 2023-10-06T01:41:16.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:16.183+0000 7f3c40edb700 1 -- 172.21.15.71:0/512278397 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3400bbb0 con 0x7f3c3c0c3180 2023-10-06T01:41:16.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:16.183+0000 7f3c44141700 1 -- 172.21.15.71:0/512278397 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3c3c0c3180 msgr2=0x7f3c3c0c35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:16.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:16.183+0000 7f3c44141700 1 --2- 172.21.15.71:0/512278397 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3c3c0c3180 0x7f3c3c0c35d0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c063c30 tx=0x7f3c340091a0 comp rx=0 tx=0).stop 2023-10-06T01:41:16.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:16.183+0000 7f3c44141700 1 -- 172.21.15.71:0/512278397 shutdown_connections 2023-10-06T01:41:16.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:16.183+0000 7f3c44141700 1 --2- 172.21.15.71:0/512278397 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3c3c0c3180 0x7f3c3c0c35d0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:16.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:16.183+0000 7f3c44141700 1 --2- 172.21.15.71:0/512278397 >> v2:172.21.15.72:3300/0 conn(0x7f3c3c13cc10 0x7f3c3c068cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:16.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:16.183+0000 7f3c44141700 1 -- 172.21.15.71:0/512278397 >> 172.21.15.71:0/512278397 conn(0x7f3c3c069790 msgr2=0x7f3c3c069b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:16.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:16.183+0000 7f3c44141700 1 -- 172.21.15.71:0/512278397 shutdown_connections 2023-10-06T01:41:16.187 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:16.183+0000 7f3c44141700 1 -- 172.21.15.71:0/512278397 wait complete. 2023-10-06T01:41:16.189 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:16.184+0000 7f3c44141700 1 Processor -- start 2023-10-06T01:41:16.189 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:16.185+0000 7f3c44141700 1 -- start start 2023-10-06T01:41:16.189 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:16.185+0000 7f3c44141700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3c3c0c3180 0x7f3c3c16a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:16.189 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:16.185+0000 7f3c44141700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c3c13c840 0x7f3c3c155a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:16.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:16.185+0000 7f3c44141700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3c3c13cc10 0x7f3c3c0b0f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:16.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:16.185+0000 7f3c44141700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3c155f80 con 0x7f3c3c0c3180 2023-10-06T01:41:16.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:16.185+0000 7f3c44141700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3c0b22d0 con 0x7f3c3c13c840 2023-10-06T01:41:16.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:16.185+0000 7f3c44141700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3c0b1440 con 0x7f3c3c13cc10 2023-10-06T01:41:16.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:16.185+0000 7f3c41edd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3c3c0c3180 0x7f3c3c16a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:16.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:16.185+0000 7f3c41edd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3c3c0c3180 0x7f3c3c16a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47606/0 (socket says 172.21.15.71:47606) 2023-10-06T01:41:16.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:16.185+0000 7f3c41edd700 1 -- 172.21.15.71:0/1204135615 learned_addr learned my addr 172.21.15.71:0/1204135615 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:16.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:16.185+0000 7f3c416dc700 1 --2- 172.21.15.71:0/1204135615 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c3c13c840 0x7f3c3c155a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:16.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:16.185+0000 7f3c426de700 1 --2- 172.21.15.71:0/1204135615 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3c3c13cc10 0x7f3c3c0b0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:16.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:16.186+0000 7f3c41edd700 1 -- 172.21.15.71:0/1204135615 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3c3c13cc10 msgr2=0x7f3c3c0b0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:16.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:16.186+0000 7f3c41edd700 1 --2- 172.21.15.71:0/1204135615 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3c3c13cc10 0x7f3c3c0b0f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:16.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:16.186+0000 7f3c41edd700 1 -- 172.21.15.71:0/1204135615 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c3c13c840 msgr2=0x7f3c3c155a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:16.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:16.186+0000 7f3c41edd700 1 --2- 172.21.15.71:0/1204135615 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c3c13c840 0x7f3c3c155a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:16.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:16.186+0000 7f3c41edd700 1 -- 172.21.15.71:0/1204135615 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c34009420 con 0x7f3c3c0c3180 2023-10-06T01:41:16.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:16.186+0000 7f3c41edd700 1 --2- 172.21.15.71:0/1204135615 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3c3c0c3180 0x7f3c3c16a200 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f3c3800cdb0 tx=0x7f3c38001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:16.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:16.186+0000 7f3c31ffb700 1 -- 172.21.15.71:0/1204135615 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3800aad0 con 0x7f3c3c0c3180 2023-10-06T01:41:16.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:16.186+0000 7f3c31ffb700 1 -- 172.21.15.71:0/1204135615 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c3800ac30 con 0x7f3c3c0c3180 2023-10-06T01:41:16.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:16.186+0000 7f3c31ffb700 1 -- 172.21.15.71:0/1204135615 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c380070f0 con 0x7f3c3c0c3180 2023-10-06T01:41:16.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:16.186+0000 7f3c44141700 1 -- 172.21.15.71:0/1204135615 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c3c0b16c0 con 0x7f3c3c0c3180 2023-10-06T01:41:16.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:16.186+0000 7f3c44141700 1 -- 172.21.15.71:0/1204135615 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c3c0b1c80 con 0x7f3c3c0c3180 2023-10-06T01:41:16.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:16.187+0000 7f3c44141700 1 -- 172.21.15.71:0/1204135615 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c3c0b25b0 con 0x7f3c3c0c3180 2023-10-06T01:41:16.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:16.187+0000 7f3c31ffb700 1 -- 172.21.15.71:0/1204135615 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3c380074a0 con 0x7f3c3c0c3180 2023-10-06T01:41:16.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:16.188+0000 7f3c31ffb700 1 --2- 172.21.15.71:0/1204135615 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f3c20066f30 0x7f3c200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:16.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:16.188+0000 7f3c31ffb700 1 -- 172.21.15.71:0/1204135615 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6953+0+0 (secure 0 0 0) 0x7f3c38084f20 con 0x7f3c3c0c3180 2023-10-06T01:41:16.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:16.188+0000 7f3c416dc700 1 --2- 172.21.15.71:0/1204135615 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f3c20066f30 0x7f3c200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:16.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:16.188+0000 7f3c416dc700 1 --2- 172.21.15.71:0/1204135615 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f3c20066f30 0x7f3c200693e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c15d620 tx=0x7f3c2c006f90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:16.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:16.192+0000 7f3c31ffb700 1 -- 172.21.15.71:0/1204135615 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3c38051d30 con 0x7f3c3c0c3180 2023-10-06T01:41:16.374 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:16.373+0000 7f3c44141700 1 -- 172.21.15.71:0/1204135615 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3c3c0b2e50 con 0x7f3c3c0c3180 2023-10-06T01:41:17.052 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:17.051+0000 7f3c31ffb700 1 -- 172.21.15.71:0/1204135615 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v31) v1 ==== 181+0+0 (secure 0 0 0) 0x7f3c38055350 con 0x7f3c3c0c3180 2023-10-06T01:41:17.055 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:17.054+0000 7f3c44141700 1 -- 172.21.15.71:0/1204135615 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f3c20066f30 msgr2=0x7f3c200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:17.055 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:17.054+0000 7f3c44141700 1 --2- 172.21.15.71:0/1204135615 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f3c20066f30 0x7f3c200693e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c15d620 tx=0x7f3c2c006f90 comp rx=0 tx=0).stop 2023-10-06T01:41:17.055 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:17.054+0000 7f3c44141700 1 -- 172.21.15.71:0/1204135615 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3c3c0c3180 msgr2=0x7f3c3c16a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:17.055 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:17.054+0000 7f3c44141700 1 --2- 172.21.15.71:0/1204135615 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3c3c0c3180 0x7f3c3c16a200 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f3c3800cdb0 tx=0x7f3c38001ae0 comp rx=0 tx=0).stop 2023-10-06T01:41:17.056 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:17.054+0000 7f3c44141700 1 -- 172.21.15.71:0/1204135615 shutdown_connections 2023-10-06T01:41:17.056 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:17.054+0000 7f3c44141700 1 --2- 172.21.15.71:0/1204135615 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3c3c13cc10 0x7f3c3c0b0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:17.056 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:17.054+0000 7f3c44141700 1 --2- 172.21.15.71:0/1204135615 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3c3c0c3180 0x7f3c3c16a200 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:17.056 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:17.054+0000 7f3c44141700 1 --2- 172.21.15.71:0/1204135615 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f3c20066f30 0x7f3c200693e0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:17.056 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:17.054+0000 7f3c44141700 1 --2- 172.21.15.71:0/1204135615 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c3c13c840 0x7f3c3c155a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:17.056 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:17.054+0000 7f3c44141700 1 -- 172.21.15.71:0/1204135615 >> 172.21.15.71:0/1204135615 conn(0x7f3c3c069790 msgr2=0x7f3c3c15beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:17.056 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:17.054+0000 7f3c44141700 1 -- 172.21.15.71:0/1204135615 shutdown_connections 2023-10-06T01:41:17.056 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:17.054+0000 7f3c44141700 1 -- 172.21.15.71:0/1204135615 wait complete. 2023-10-06T01:41:17.056 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'cephfs_metadata' removed 2023-10-06T01:41:17.070 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T01:41:17.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:17.187+0000 7fed57100700 1 Processor -- start 2023-10-06T01:41:17.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:17.187+0000 7fed57100700 1 -- start start 2023-10-06T01:41:17.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:17.188+0000 7fed57100700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fed500b59a0 0x7fed50158c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:17.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:17.188+0000 7fed57100700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fed500ce5d0 0x7fed500ce9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:17.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:17.188+0000 7fed57100700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed500cf400 con 0x7fed500b5d70 2023-10-06T01:41:17.190 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:17.188+0000 7fed57100700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed500cf6e0 con 0x7fed500b59a0 2023-10-06T01:41:17.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:17.188+0000 7fed57100700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed500cf9c0 con 0x7fed500ce5d0 2023-10-06T01:41:17.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:17.188+0000 7fed560fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fed500b59a0 0x7fed50158c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:17.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:17.188+0000 7fed558fd700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fed500b5d70 0x7fed501591d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:39828/0 (socket says 172.21.15.71:39828) 2023-10-06T01:41:17.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:17.188+0000 7fed558fd700 1 -- 172.21.15.71:0/1987885604 learned_addr learned my addr 172.21.15.71:0/1987885604 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:41:17.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:17.188+0000 7fed560fe700 1 -- 172.21.15.71:0/1987885604 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fed500ce5d0 msgr2=0x7fed500ce9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:17.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:17.188+0000 7fed568ff700 1 --2- 172.21.15.71:0/1987885604 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fed500ce5d0 0x7fed500ce9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:17.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:17.188+0000 7fed560fe700 1 --2- 172.21.15.71:0/1987885604 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fed500ce5d0 0x7fed500ce9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:17.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:17.188+0000 7fed550fc700 1 -- 172.21.15.71:0/1987885604 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3818340485 0 0) 0x7fed500cf400 con 0x7fed500b5d70 2023-10-06T01:41:17.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:17.188+0000 7fed560fe700 1 -- 172.21.15.71:0/1987885604 >> v1:172.21.15.71:6789/0 conn(0x7fed500b5d70 legacy=0x7fed501591d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:17.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:17.188+0000 7fed560fe700 1 -- 172.21.15.71:0/1987885604 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed500cfca0 con 0x7fed500b59a0 2023-10-06T01:41:17.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:17.189+0000 7fed560fe700 1 --2- 172.21.15.71:0/1987885604 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fed500b59a0 0x7fed50158c90 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fed4c009e60 tx=0x7fed4c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a308c9729fbefe0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:17.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:17.189+0000 7fed550fc700 1 -- 172.21.15.71:0/1987885604 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed4c00e070 con 0x7fed500b59a0 2023-10-06T01:41:17.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:17.189+0000 7fed550fc700 1 -- 172.21.15.71:0/1987885604 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed4c00bc30 con 0x7fed500b59a0 2023-10-06T01:41:17.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:17.189+0000 7fed550fc700 1 -- 172.21.15.71:0/1987885604 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed4c012430 con 0x7fed500b59a0 2023-10-06T01:41:17.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:17.189+0000 7fed57100700 1 -- 172.21.15.71:0/1987885604 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fed500b59a0 msgr2=0x7fed50158c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:17.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:17.189+0000 7fed57100700 1 --2- 172.21.15.71:0/1987885604 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fed500b59a0 0x7fed50158c90 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fed4c009e60 tx=0x7fed4c009780 comp rx=0 tx=0).stop 2023-10-06T01:41:17.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:17.189+0000 7fed57100700 1 -- 172.21.15.71:0/1987885604 shutdown_connections 2023-10-06T01:41:17.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:17.189+0000 7fed57100700 1 --2- 172.21.15.71:0/1987885604 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fed500ce5d0 0x7fed500ce9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:17.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:17.189+0000 7fed57100700 1 --2- 172.21.15.71:0/1987885604 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fed500b59a0 0x7fed50158c90 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:17.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:17.189+0000 7fed57100700 1 -- 172.21.15.71:0/1987885604 >> 172.21.15.71:0/1987885604 conn(0x7fed50069150 msgr2=0x7fed500b1b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:17.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:17.189+0000 7fed57100700 1 -- 172.21.15.71:0/1987885604 shutdown_connections 2023-10-06T01:41:17.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:17.189+0000 7fed57100700 1 -- 172.21.15.71:0/1987885604 wait complete. 2023-10-06T01:41:17.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:17.190+0000 7fed57100700 1 Processor -- start 2023-10-06T01:41:17.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:17.190+0000 7fed57100700 1 -- start start 2023-10-06T01:41:17.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:17.191+0000 7fed57100700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fed500b59a0 0x7fed500cca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:17.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:17.191+0000 7fed57100700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fed500b5d70 0x7fed500ca830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:17.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:17.191+0000 7fed57100700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fed500ce5d0 0x7fed500b4290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:17.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:17.191+0000 7fed57100700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed500c6550 con 0x7fed500ce5d0 2023-10-06T01:41:17.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:17.191+0000 7fed57100700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed500c8bd0 con 0x7fed500b59a0 2023-10-06T01:41:17.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:17.191+0000 7fed57100700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed500c7280 con 0x7fed500b5d70 2023-10-06T01:41:17.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:17.191+0000 7fed568ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fed500ce5d0 0x7fed500b4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:17.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:17.191+0000 7fed568ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fed500ce5d0 0x7fed500b4290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47622/0 (socket says 172.21.15.71:47622) 2023-10-06T01:41:17.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:17.191+0000 7fed568ff700 1 -- 172.21.15.71:0/3787423076 learned_addr learned my addr 172.21.15.71:0/3787423076 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:17.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:17.192+0000 7fed558fd700 1 --2- 172.21.15.71:0/3787423076 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fed500b5d70 0x7fed500ca830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:17.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:17.192+0000 7fed560fe700 1 --2- 172.21.15.71:0/3787423076 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fed500b59a0 0x7fed500cca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:17.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:17.192+0000 7fed568ff700 1 -- 172.21.15.71:0/3787423076 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fed500b5d70 msgr2=0x7fed500ca830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:17.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:17.192+0000 7fed568ff700 1 --2- 172.21.15.71:0/3787423076 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fed500b5d70 0x7fed500ca830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:17.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:17.192+0000 7fed568ff700 1 -- 172.21.15.71:0/3787423076 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fed500b59a0 msgr2=0x7fed500cca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:17.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:17.192+0000 7fed568ff700 1 --2- 172.21.15.71:0/3787423076 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fed500b59a0 0x7fed500cca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:17.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:17.192+0000 7fed568ff700 1 -- 172.21.15.71:0/3787423076 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed4c009a20 con 0x7fed500ce5d0 2023-10-06T01:41:17.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:17.192+0000 7fed560fe700 1 --2- 172.21.15.71:0/3787423076 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fed500b59a0 0x7fed500cca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:41:17.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:17.192+0000 7fed558fd700 1 --2- 172.21.15.71:0/3787423076 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fed500b5d70 0x7fed500ca830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:41:17.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:17.192+0000 7fed568ff700 1 --2- 172.21.15.71:0/3787423076 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fed500ce5d0 0x7fed500b4290 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fed4800c880 tx=0x7fed48008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:17.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:17.192+0000 7fed467fc700 1 -- 172.21.15.71:0/3787423076 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed48011600 con 0x7fed500ce5d0 2023-10-06T01:41:17.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:17.192+0000 7fed467fc700 1 -- 172.21.15.71:0/3787423076 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed48011760 con 0x7fed500ce5d0 2023-10-06T01:41:17.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:17.192+0000 7fed57100700 1 -- 172.21.15.71:0/3787423076 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed500c6950 con 0x7fed500ce5d0 2023-10-06T01:41:17.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:17.192+0000 7fed467fc700 1 -- 172.21.15.71:0/3787423076 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed48011b00 con 0x7fed500ce5d0 2023-10-06T01:41:17.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:17.192+0000 7fed57100700 1 -- 172.21.15.71:0/3787423076 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed500c6f10 con 0x7fed500ce5d0 2023-10-06T01:41:17.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:17.193+0000 7fed57100700 1 -- 172.21.15.71:0/3787423076 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed500c7430 con 0x7fed500ce5d0 2023-10-06T01:41:17.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:17.193+0000 7fed467fc700 1 -- 172.21.15.71:0/3787423076 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fed48018360 con 0x7fed500ce5d0 2023-10-06T01:41:17.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:17.193+0000 7fed467fc700 1 --2- 172.21.15.71:0/3787423076 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fed34066f30 0x7fed340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:17.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:17.194+0000 7fed467fc700 1 -- 172.21.15.71:0/3787423076 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6515+0+0 (secure 0 0 0) 0x7fed48084500 con 0x7fed500ce5d0 2023-10-06T01:41:17.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:17.194+0000 7fed560fe700 1 --2- 172.21.15.71:0/3787423076 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fed34066f30 0x7fed340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:17.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:17.194+0000 7fed560fe700 1 --2- 172.21.15.71:0/3787423076 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fed34066f30 0x7fed340693e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fed4c009e60 tx=0x7fed4c019000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:17.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:17.198+0000 7fed467fc700 1 -- 172.21.15.71:0/3787423076 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fed500c7430 con 0x7fed500ce5d0 2023-10-06T01:41:17.379 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:17.378+0000 7fed57100700 1 -- 172.21.15.71:0/3787423076 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fed500c73f0 con 0x7fed500ce5d0 2023-10-06T01:41:18.063 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:18.062+0000 7fed467fc700 1 -- 172.21.15.71:0/3787423076 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v32) v1 ==== 169+0+0 (secure 0 0 0) 0x7fed48054c40 con 0x7fed500ce5d0 2023-10-06T01:41:18.067 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:18.066+0000 7fed57100700 1 -- 172.21.15.71:0/3787423076 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fed34066f30 msgr2=0x7fed340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:18.067 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:18.066+0000 7fed57100700 1 --2- 172.21.15.71:0/3787423076 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fed34066f30 0x7fed340693e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fed4c009e60 tx=0x7fed4c019000 comp rx=0 tx=0).stop 2023-10-06T01:41:18.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:18.066+0000 7fed57100700 1 -- 172.21.15.71:0/3787423076 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fed500ce5d0 msgr2=0x7fed500b4290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:18.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:18.066+0000 7fed57100700 1 --2- 172.21.15.71:0/3787423076 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fed500ce5d0 0x7fed500b4290 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fed4800c880 tx=0x7fed48008040 comp rx=0 tx=0).stop 2023-10-06T01:41:18.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:18.066+0000 7fed57100700 1 -- 172.21.15.71:0/3787423076 shutdown_connections 2023-10-06T01:41:18.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:18.066+0000 7fed57100700 1 --2- 172.21.15.71:0/3787423076 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fed500ce5d0 0x7fed500b4290 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:18.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:18.066+0000 7fed57100700 1 --2- 172.21.15.71:0/3787423076 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fed34066f30 0x7fed340693e0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:18.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:18.066+0000 7fed57100700 1 --2- 172.21.15.71:0/3787423076 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fed500b59a0 0x7fed500cca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:18.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:18.066+0000 7fed57100700 1 --2- 172.21.15.71:0/3787423076 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fed500b5d70 0x7fed500ca830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:18.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:18.066+0000 7fed57100700 1 -- 172.21.15.71:0/3787423076 >> 172.21.15.71:0/3787423076 conn(0x7fed50069150 msgr2=0x7fed50156650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:18.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:18.067+0000 7fed57100700 1 -- 172.21.15.71:0/3787423076 shutdown_connections 2023-10-06T01:41:18.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:18.067+0000 7fed57100700 1 -- 172.21.15.71:0/3787423076 wait complete. 2023-10-06T01:41:18.069 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'cephfs_data' removed 2023-10-06T01:41:18.080 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-10-06T01:41:18.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:18.197+0000 7fc9a8b0a700 1 Processor -- start 2023-10-06T01:41:18.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:18.197+0000 7fc9a8b0a700 1 -- start start 2023-10-06T01:41:18.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:18.198+0000 7fc9a8b0a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc9a4142df0 0x7fc9a40cc350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:18.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:18.198+0000 7fc9a8b0a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc9a40cc890 0x7fc9a40d0260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:18.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:18.198+0000 7fc9a8b0a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc9a40d07a0 0x7fc9a40cea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:18.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:18.198+0000 7fc9a8b0a700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9a40d0c40 con 0x7fc9a40cc890 2023-10-06T01:41:18.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:18.198+0000 7fc9a8b0a700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9a415a710 con 0x7fc9a40d07a0 2023-10-06T01:41:18.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:18.198+0000 7fc9a8b0a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a4159b40 con 0x7fc9a4142df0 2023-10-06T01:41:18.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:18.198+0000 7fc99bfff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc9a40cc890 0x7fc9a40d0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:18.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:18.198+0000 7fc99bfff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc9a40cc890 0x7fc9a40d0260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47632/0 (socket says 172.21.15.71:47632) 2023-10-06T01:41:18.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:18.198+0000 7fc99bfff700 1 -- 172.21.15.71:0/1934659220 learned_addr learned my addr 172.21.15.71:0/1934659220 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:18.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:18.198+0000 7fc9a2d9d700 1 --2- 172.21.15.71:0/1934659220 >> v2:172.21.15.72:3300/0 conn(0x7fc9a40d07a0 0x7fc9a40cea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:18.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:18.198+0000 7fc9a259c700 1 --2- 172.21.15.71:0/1934659220 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc9a4142df0 0x7fc9a40cc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:18.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:18.198+0000 7fc99bfff700 1 -- 172.21.15.71:0/1934659220 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc9a4142df0 msgr2=0x7fc9a40cc350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:18.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:18.198+0000 7fc99bfff700 1 --2- 172.21.15.71:0/1934659220 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc9a4142df0 0x7fc9a40cc350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:18.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:18.198+0000 7fc99bfff700 1 -- 172.21.15.71:0/1934659220 >> v2:172.21.15.72:3300/0 conn(0x7fc9a40d07a0 msgr2=0x7fc9a40cea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:18.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:18.199+0000 7fc99bfff700 1 --2- 172.21.15.71:0/1934659220 >> v2:172.21.15.72:3300/0 conn(0x7fc9a40d07a0 0x7fc9a40cea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:18.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:18.199+0000 7fc99bfff700 1 -- 172.21.15.71:0/1934659220 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9a4159de0 con 0x7fc9a40cc890 2023-10-06T01:41:18.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:18.199+0000 7fc99bfff700 1 --2- 172.21.15.71:0/1934659220 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9a40cc890 0x7fc9a40d0260 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fc9a4088430 tx=0x7fc98c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=397f1571a6b6473b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:18.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:18.199+0000 7fc9a1d9b700 1 -- 172.21.15.71:0/1934659220 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc98c00b860 con 0x7fc9a40cc890 2023-10-06T01:41:18.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:18.199+0000 7fc9a1d9b700 1 -- 172.21.15.71:0/1934659220 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc98c00b9c0 con 0x7fc9a40cc890 2023-10-06T01:41:18.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:18.199+0000 7fc9a1d9b700 1 -- 172.21.15.71:0/1934659220 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc98c00bd60 con 0x7fc9a40cc890 2023-10-06T01:41:18.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:18.199+0000 7fc9a8b0a700 1 -- 172.21.15.71:0/1934659220 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9a40cc890 msgr2=0x7fc9a40d0260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:18.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:18.199+0000 7fc9a8b0a700 1 --2- 172.21.15.71:0/1934659220 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9a40cc890 0x7fc9a40d0260 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fc9a4088430 tx=0x7fc98c009250 comp rx=0 tx=0).stop 2023-10-06T01:41:18.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:18.199+0000 7fc9a8b0a700 1 -- 172.21.15.71:0/1934659220 shutdown_connections 2023-10-06T01:41:18.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:18.199+0000 7fc9a8b0a700 1 --2- 172.21.15.71:0/1934659220 >> v2:172.21.15.72:3300/0 conn(0x7fc9a40d07a0 0x7fc9a40cea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:18.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:18.199+0000 7fc9a8b0a700 1 --2- 172.21.15.71:0/1934659220 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc9a4142df0 0x7fc9a40cc350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:18.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:18.199+0000 7fc9a8b0a700 1 --2- 172.21.15.71:0/1934659220 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9a40cc890 0x7fc9a40d0260 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:18.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:18.199+0000 7fc9a8b0a700 1 -- 172.21.15.71:0/1934659220 >> 172.21.15.71:0/1934659220 conn(0x7fc9a40690f0 msgr2=0x7fc9a406a340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:18.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:18.199+0000 7fc9a8b0a700 1 -- 172.21.15.71:0/1934659220 shutdown_connections 2023-10-06T01:41:18.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:18.199+0000 7fc9a8b0a700 1 -- 172.21.15.71:0/1934659220 wait complete. 2023-10-06T01:41:18.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:18.200+0000 7fc9a8b0a700 1 Processor -- start 2023-10-06T01:41:18.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:18.201+0000 7fc9a8b0a700 1 -- start start 2023-10-06T01:41:18.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:18.201+0000 7fc9a8b0a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9a40cc890 0x7fc9a40cb5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:18.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:18.201+0000 7fc9a8b0a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9a40d07a0 0x7fc9a40c6f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:18.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:18.201+0000 7fc9a8b0a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc9a4142df0 0x7fc9a40c74d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:18.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:18.201+0000 7fc9a8b0a700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a40c6b70 con 0x7fc9a40d07a0 2023-10-06T01:41:18.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:18.201+0000 7fc9a8b0a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a40ca9a0 con 0x7fc9a40cc890 2023-10-06T01:41:18.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:18.201+0000 7fc9a8b0a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a40c7a10 con 0x7fc9a4142df0 2023-10-06T01:41:18.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:18.201+0000 7fc99bfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9a40d07a0 0x7fc9a40c6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:18.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:18.201+0000 7fc99bfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9a40d07a0 0x7fc9a40c6f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47636/0 (socket says 172.21.15.71:47636) 2023-10-06T01:41:18.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:18.201+0000 7fc99bfff700 1 -- 172.21.15.71:0/2000621191 learned_addr learned my addr 172.21.15.71:0/2000621191 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:18.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:18.202+0000 7fc9a2d9d700 1 --2- 172.21.15.71:0/2000621191 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc9a4142df0 0x7fc9a40c74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:18.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:18.202+0000 7fc9a259c700 1 --2- 172.21.15.71:0/2000621191 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9a40cc890 0x7fc9a40cb5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:18.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:18.202+0000 7fc99bfff700 1 -- 172.21.15.71:0/2000621191 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc9a4142df0 msgr2=0x7fc9a40c74d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:18.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:18.202+0000 7fc99bfff700 1 --2- 172.21.15.71:0/2000621191 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc9a4142df0 0x7fc9a40c74d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:18.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:18.202+0000 7fc99bfff700 1 -- 172.21.15.71:0/2000621191 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9a40cc890 msgr2=0x7fc9a40cb5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:18.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:18.202+0000 7fc99bfff700 1 --2- 172.21.15.71:0/2000621191 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9a40cc890 0x7fc9a40cb5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:18.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:18.202+0000 7fc99bfff700 1 -- 172.21.15.71:0/2000621191 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc98c0094f0 con 0x7fc9a40d07a0 2023-10-06T01:41:18.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:18.202+0000 7fc99bfff700 1 --2- 172.21.15.71:0/2000621191 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9a40d07a0 0x7fc9a40c6f90 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fc9a4067c10 tx=0x7fc98c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:18.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:18.202+0000 7fc99a7fc700 1 -- 172.21.15.71:0/2000621191 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc98c024440 con 0x7fc9a40d07a0 2023-10-06T01:41:18.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:18.202+0000 7fc99a7fc700 1 -- 172.21.15.71:0/2000621191 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc98c0245a0 con 0x7fc9a40d07a0 2023-10-06T01:41:18.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:18.202+0000 7fc9a8b0a700 1 -- 172.21.15.71:0/2000621191 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9a40c61d0 con 0x7fc9a40d07a0 2023-10-06T01:41:18.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:18.202+0000 7fc99a7fc700 1 -- 172.21.15.71:0/2000621191 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc98c024960 con 0x7fc9a40d07a0 2023-10-06T01:41:18.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:18.202+0000 7fc9a8b0a700 1 -- 172.21.15.71:0/2000621191 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9a40c6790 con 0x7fc9a40d07a0 2023-10-06T01:41:18.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:18.203+0000 7fc9a8b0a700 1 -- 172.21.15.71:0/2000621191 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9a4088ad0 con 0x7fc9a40d07a0 2023-10-06T01:41:18.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:18.203+0000 7fc99a7fc700 1 -- 172.21.15.71:0/2000621191 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc98c01a420 con 0x7fc9a40d07a0 2023-10-06T01:41:18.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:18.203+0000 7fc99a7fc700 1 --2- 172.21.15.71:0/2000621191 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fc984066f30 0x7fc9840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:18.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:18.204+0000 7fc99a7fc700 1 -- 172.21.15.71:0/2000621191 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6043+0+0 (secure 0 0 0) 0x7fc98c0864c0 con 0x7fc9a40d07a0 2023-10-06T01:41:18.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:18.204+0000 7fc9a259c700 1 --2- 172.21.15.71:0/2000621191 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fc984066f30 0x7fc9840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:18.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:18.204+0000 7fc9a259c700 1 --2- 172.21.15.71:0/2000621191 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fc984066f30 0x7fc9840693e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc994006fd0 tx=0x7fc994008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:18.209 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:18.208+0000 7fc99a7fc700 1 -- 172.21.15.71:0/2000621191 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc98c053660 con 0x7fc9a40d07a0 2023-10-06T01:41:18.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:18.388+0000 7fc9a8b0a700 1 -- 172.21.15.71:0/2000621191 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc9a415a0c0 con 0x7fc9a40d07a0 2023-10-06T01:41:19.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:19.068+0000 7fc99a7fc700 1 -- 172.21.15.71:0/2000621191 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v33) v1 ==== 178+0+0 (secure 0 0 0) 0x7fc98c056c80 con 0x7fc9a40d07a0 2023-10-06T01:41:19.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:19.074+0000 7fc9a8b0a700 1 -- 172.21.15.71:0/2000621191 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fc984066f30 msgr2=0x7fc9840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:19.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:19.074+0000 7fc9a8b0a700 1 --2- 172.21.15.71:0/2000621191 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fc984066f30 0x7fc9840693e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc994006fd0 tx=0x7fc994008040 comp rx=0 tx=0).stop 2023-10-06T01:41:19.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:19.074+0000 7fc9a8b0a700 1 -- 172.21.15.71:0/2000621191 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9a40d07a0 msgr2=0x7fc9a40c6f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:19.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:19.074+0000 7fc9a8b0a700 1 --2- 172.21.15.71:0/2000621191 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9a40d07a0 0x7fc9a40c6f90 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fc9a4067c10 tx=0x7fc98c017000 comp rx=0 tx=0).stop 2023-10-06T01:41:19.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:19.074+0000 7fc9a8b0a700 1 -- 172.21.15.71:0/2000621191 shutdown_connections 2023-10-06T01:41:19.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:19.074+0000 7fc9a8b0a700 1 --2- 172.21.15.71:0/2000621191 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc9a4142df0 0x7fc9a40c74d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:19.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:19.074+0000 7fc9a8b0a700 1 --2- 172.21.15.71:0/2000621191 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fc984066f30 0x7fc9840693e0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:19.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:19.074+0000 7fc9a8b0a700 1 --2- 172.21.15.71:0/2000621191 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9a40cc890 0x7fc9a40cb5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:19.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:19.074+0000 7fc9a8b0a700 1 --2- 172.21.15.71:0/2000621191 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9a40d07a0 0x7fc9a40c6f90 secure :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fc9a4067c10 tx=0x7fc98c017000 comp rx=0 tx=0).stop 2023-10-06T01:41:19.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:19.074+0000 7fc9a8b0a700 1 -- 172.21.15.71:0/2000621191 >> 172.21.15.71:0/2000621191 conn(0x7fc9a40690f0 msgr2=0x7fc9a4159330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:19.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:19.078+0000 7fc9a8b0a700 1 -- 172.21.15.71:0/2000621191 shutdown_connections 2023-10-06T01:41:19.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:19.079+0000 7fc9a8b0a700 1 -- 172.21.15.71:0/2000621191 wait complete. 2023-10-06T01:41:19.081 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'cephfs_data_ec' removed 2023-10-06T01:41:19.094 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T01:41:19.094 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-06T01:41:19.094 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T01:41:19.095 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T01:41:19.095 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T01:41:19.095 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-06T01:41:19.095 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T01:41:19.095 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T01:41:19.095 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T01:41:19.095 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-06T01:41:19.096 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T01:41:19.096 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T01:41:19.096 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T01:41:19.096 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-06T01:41:19.096 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T01:41:19.096 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T01:41:19.104 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T01:41:19.104 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T01:41:19.105 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T01:41:19.106 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T01:41:19.107 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T01:41:19.107 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T01:41:19.108 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T01:41:19.108 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T01:41:19.148 INFO:tasks.ceph.mds.a:Started 2023-10-06T01:41:19.149 DEBUG:teuthology.parallel:result is None 2023-10-06T01:41:19.150 INFO:tasks.ceph.mds.c:Started 2023-10-06T01:41:19.150 DEBUG:teuthology.parallel:result is None 2023-10-06T01:41:19.151 INFO:tasks.ceph.mds.b:Started 2023-10-06T01:41:19.151 DEBUG:teuthology.parallel:result is None 2023-10-06T01:41:19.152 INFO:tasks.ceph.mds.d:Started 2023-10-06T01:41:19.152 DEBUG:teuthology.parallel:result is None 2023-10-06T01:41:19.152 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-06T01:41:19.220 INFO:tasks.ceph.mds.a.smithi071.stdout:starting mds.a at 2023-10-06T01:41:19.220 INFO:tasks.ceph.mds.c.smithi071.stdout:starting mds.c at 2023-10-06T01:41:19.232 INFO:tasks.ceph.mds.b.smithi072.stdout:starting mds.b at 2023-10-06T01:41:19.233 INFO:tasks.ceph.mds.d.smithi072.stdout:starting mds.d at 2023-10-06T01:41:19.271 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:19.271+0000 7f494eae7700 1 Processor -- start 2023-10-06T01:41:19.272 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:19.271+0000 7f494eae7700 1 -- start start 2023-10-06T01:41:19.274 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:19.271+0000 7f494eae7700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4948086ff0 0x7f4948087470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:19.274 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:19.271+0000 7f494eae7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f49480b21b0 0x7f49480b2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:19.274 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:19.271+0000 7f494eae7700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49480b2b70 con 0x7f494815a030 2023-10-06T01:41:19.274 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:19.272+0000 7f494eae7700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49480b0cf0 con 0x7f4948086ff0 2023-10-06T01:41:19.274 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:19.272+0000 7f494eae7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49480879b0 con 0x7f49480b21b0 2023-10-06T01:41:19.274 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:19.272+0000 7f493ffff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4948086ff0 0x7f4948087470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:19.274 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:19.272+0000 7f493ffff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4948086ff0 0x7f4948087470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47674/0 (socket says 172.21.15.71:47674) 2023-10-06T01:41:19.274 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:19.272+0000 7f494d084700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f49480b21b0 0x7f49480b2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:19.275 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:19.272+0000 7f493ffff700 1 -- 172.21.15.71:0/4055532455 learned_addr learned my addr 172.21.15.71:0/4055532455 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:19.275 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:19.272+0000 7f494c883700 1 --1- 172.21.15.71:0/4055532455 >> v1:172.21.15.72:6789/0 conn(0x7f494815a030 0x7f494815a400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.71:45028/0 (socket says 172.21.15.71:45028) 2023-10-06T01:41:19.275 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:19.272+0000 7f494d084700 1 -- 172.21.15.71:0/4055532455 >> v2:172.21.15.71:3300/0 conn(0x7f4948086ff0 msgr2=0x7f4948087470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:19.275 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:19.272+0000 7f494d084700 1 --2- 172.21.15.71:0/4055532455 >> v2:172.21.15.71:3300/0 conn(0x7f4948086ff0 0x7f4948087470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:19.275 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:19.272+0000 7f494d084700 1 -- 172.21.15.71:0/4055532455 >> v1:172.21.15.72:6789/0 conn(0x7f494815a030 legacy=0x7f494815a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:19.275 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:19.272+0000 7f494d084700 1 -- 172.21.15.71:0/4055532455 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49480afc50 con 0x7f49480b21b0 2023-10-06T01:41:19.275 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:19.272+0000 7f493f7fe700 1 -- 172.21.15.71:0/4055532455 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 319549677 0 0) 0x7f49480b2b70 con 0x7f494815a030 2023-10-06T01:41:19.275 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:19.272+0000 7f493ffff700 1 --2- 172.21.15.71:0/4055532455 >> v2:172.21.15.71:3300/0 conn(0x7f4948086ff0 0x7f4948087470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:41:19.275 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:19.272+0000 7f494d084700 1 --2- 172.21.15.71:0/4055532455 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f49480b21b0 0x7f49480b2630 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f49400098e0 tx=0x7f49400091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=14080cbde8d93f1f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:19.275 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:19.272+0000 7f493f7fe700 1 -- 172.21.15.71:0/4055532455 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f494000b640 con 0x7f49480b21b0 2023-10-06T01:41:19.275 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:19.272+0000 7f493f7fe700 1 -- 172.21.15.71:0/4055532455 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f494000b7a0 con 0x7f49480b21b0 2023-10-06T01:41:19.276 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:19.272+0000 7f493f7fe700 1 -- 172.21.15.71:0/4055532455 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f494000bb40 con 0x7f49480b21b0 2023-10-06T01:41:19.276 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:19.273+0000 7f494eae7700 1 -- 172.21.15.71:0/4055532455 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f49480b21b0 msgr2=0x7f49480b2630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:19.276 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:19.273+0000 7f494eae7700 1 --2- 172.21.15.71:0/4055532455 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f49480b21b0 0x7f49480b2630 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f49400098e0 tx=0x7f49400091a0 comp rx=0 tx=0).stop 2023-10-06T01:41:19.276 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:19.273+0000 7f494eae7700 1 -- 172.21.15.71:0/4055532455 shutdown_connections 2023-10-06T01:41:19.276 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:19.273+0000 7f494eae7700 1 --2- 172.21.15.71:0/4055532455 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f49480b21b0 0x7f49480b2630 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:19.276 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:19.273+0000 7f494eae7700 1 --2- 172.21.15.71:0/4055532455 >> v2:172.21.15.71:3300/0 conn(0x7f4948086ff0 0x7f4948087470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:19.276 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:19.273+0000 7f494eae7700 1 -- 172.21.15.71:0/4055532455 >> 172.21.15.71:0/4055532455 conn(0x7f4948068680 msgr2=0x7f4948068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:19.276 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:19.273+0000 7f494eae7700 1 -- 172.21.15.71:0/4055532455 shutdown_connections 2023-10-06T01:41:19.276 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:19.273+0000 7f494eae7700 1 -- 172.21.15.71:0/4055532455 wait complete. 2023-10-06T01:41:19.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:19.274+0000 7f494eae7700 1 Processor -- start 2023-10-06T01:41:19.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:19.274+0000 7f494eae7700 1 -- start start 2023-10-06T01:41:19.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:19.275+0000 7f494eae7700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4948086ff0 0x7f49480b3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:19.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:19.275+0000 7f494eae7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49480b21b0 0x7f49480b5620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:19.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:19.275+0000 7f494eae7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f494815a030 0x7f494815ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:19.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:19.275+0000 7f494eae7700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49480b5e50 con 0x7f4948086ff0 2023-10-06T01:41:19.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:19.275+0000 7f494eae7700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49480c3c40 con 0x7f49480b21b0 2023-10-06T01:41:19.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:19.275+0000 7f494eae7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49480c3f20 con 0x7f494815a030 2023-10-06T01:41:19.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:19.275+0000 7f494c883700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4948086ff0 0x7f49480b3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:19.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:19.275+0000 7f494c883700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4948086ff0 0x7f49480b3bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:47682/0 (socket says 172.21.15.71:47682) 2023-10-06T01:41:19.280 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:19.275+0000 7f494c883700 1 -- 172.21.15.71:0/2240795763 learned_addr learned my addr 172.21.15.71:0/2240795763 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:19.280 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:19.275+0000 7f494d084700 1 --2- 172.21.15.71:0/2240795763 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f494815a030 0x7f494815ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:19.280 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:19.275+0000 7f493ffff700 1 --2- 172.21.15.71:0/2240795763 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49480b21b0 0x7f49480b5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:19.280 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:19.275+0000 7f494c883700 1 -- 172.21.15.71:0/2240795763 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f494815a030 msgr2=0x7f494815ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:19.280 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:19.275+0000 7f494c883700 1 --2- 172.21.15.71:0/2240795763 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f494815a030 0x7f494815ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:19.280 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:19.275+0000 7f494c883700 1 -- 172.21.15.71:0/2240795763 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49480b21b0 msgr2=0x7f49480b5620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:19.280 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:19.275+0000 7f494c883700 1 --2- 172.21.15.71:0/2240795763 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49480b21b0 0x7f49480b5620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:19.280 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:19.275+0000 7f494c883700 1 -- 172.21.15.71:0/2240795763 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49380094f0 con 0x7f4948086ff0 2023-10-06T01:41:19.280 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:19.275+0000 7f494c883700 1 --2- 172.21.15.71:0/2240795763 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4948086ff0 0x7f49480b3bc0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f494400cd30 tx=0x7f4944001af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:19.280 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:19.275+0000 7f493cff9700 1 -- 172.21.15.71:0/2240795763 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f494400ce90 con 0x7f4948086ff0 2023-10-06T01:41:19.280 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:19.276+0000 7f493cff9700 1 -- 172.21.15.71:0/2240795763 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4944005df0 con 0x7f4948086ff0 2023-10-06T01:41:19.280 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:19.276+0000 7f494eae7700 1 -- 172.21.15.71:0/2240795763 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4940009420 con 0x7f4948086ff0 2023-10-06T01:41:19.281 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:19.276+0000 7f493cff9700 1 -- 172.21.15.71:0/2240795763 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f494400ab00 con 0x7f4948086ff0 2023-10-06T01:41:19.281 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:19.276+0000 7f494eae7700 1 -- 172.21.15.71:0/2240795763 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49480c44e0 con 0x7f4948086ff0 2023-10-06T01:41:19.281 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:19.276+0000 7f494eae7700 1 -- 172.21.15.71:0/2240795763 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49480c4700 con 0x7f4948086ff0 2023-10-06T01:41:19.281 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:19.277+0000 7f493cff9700 1 -- 172.21.15.71:0/2240795763 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f49440070f0 con 0x7f4948086ff0 2023-10-06T01:41:19.281 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:19.277+0000 7f493cff9700 1 --2- 172.21.15.71:0/2240795763 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f4934066f30 0x7f49340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:19.281 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:19.277+0000 7f493ffff700 1 --2- 172.21.15.71:0/2240795763 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f4934066f30 0x7f49340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:19.281 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:19.277+0000 7f493cff9700 1 -- 172.21.15.71:0/2240795763 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f4944084530 con 0x7f4948086ff0 2023-10-06T01:41:19.281 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:19.278+0000 7f493ffff700 1 --2- 172.21.15.71:0/2240795763 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f4934066f30 0x7f49340693e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4948069fd0 tx=0x7f4938009250 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:19.282 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:19.282+0000 7f493cff9700 1 -- 172.21.15.71:0/2240795763 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4944051880 con 0x7f4948086ff0 2023-10-06T01:41:19.478 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:19.478+0000 7f494eae7700 1 -- 172.21.15.71:0/2240795763 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f49480aff30 con 0x7f4948086ff0 2023-10-06T01:41:20.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.076+0000 7f493cff9700 1 -- 172.21.15.71:0/2240795763 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v35) v1 ==== 97+0+0 (secure 0 0 0) 0x7f4944054ea0 con 0x7f4948086ff0 2023-10-06T01:41:20.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.078+0000 7f494eae7700 1 -- 172.21.15.71:0/2240795763 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f4934066f30 msgr2=0x7f49340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:20.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.078+0000 7f494eae7700 1 --2- 172.21.15.71:0/2240795763 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f4934066f30 0x7f49340693e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4948069fd0 tx=0x7f4938009250 comp rx=0 tx=0).stop 2023-10-06T01:41:20.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.078+0000 7f494eae7700 1 -- 172.21.15.71:0/2240795763 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4948086ff0 msgr2=0x7f49480b3bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:20.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.078+0000 7f494eae7700 1 --2- 172.21.15.71:0/2240795763 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4948086ff0 0x7f49480b3bc0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f494400cd30 tx=0x7f4944001af0 comp rx=0 tx=0).stop 2023-10-06T01:41:20.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.078+0000 7f494eae7700 1 -- 172.21.15.71:0/2240795763 shutdown_connections 2023-10-06T01:41:20.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.078+0000 7f494eae7700 1 --2- 172.21.15.71:0/2240795763 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f494815a030 0x7f494815ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:20.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.078+0000 7f494eae7700 1 --2- 172.21.15.71:0/2240795763 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4948086ff0 0x7f49480b3bc0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:20.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.078+0000 7f494eae7700 1 --2- 172.21.15.71:0/2240795763 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f4934066f30 0x7f49340693e0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:20.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.078+0000 7f494eae7700 1 --2- 172.21.15.71:0/2240795763 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49480b21b0 0x7f49480b5620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:20.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.078+0000 7f494eae7700 1 -- 172.21.15.71:0/2240795763 >> 172.21.15.71:0/2240795763 conn(0x7f4948068680 msgr2=0x7f494815da90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:20.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.079+0000 7f494eae7700 1 -- 172.21.15.71:0/2240795763 shutdown_connections 2023-10-06T01:41:20.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.079+0000 7f494eae7700 1 -- 172.21.15.71:0/2240795763 wait complete. 2023-10-06T01:41:20.081 INFO:teuthology.orchestra.run.smithi071.stderr: removed all blocklist entries 2023-10-06T01:41:20.092 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-06T01:41:20.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.207+0000 7f27964c2700 1 Processor -- start 2023-10-06T01:41:20.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.207+0000 7f27964c2700 1 -- start start 2023-10-06T01:41:20.211 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.208+0000 7f27964c2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f27900af8b0 0x7f279015d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:20.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.208+0000 7f27964c2700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f279015e190 con 0x7f27900b27f0 2023-10-06T01:41:20.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.208+0000 7f27964c2700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27900cb650 con 0x7f27900af4e0 2023-10-06T01:41:20.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.208+0000 7f27964c2700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27900b1910 con 0x7f27900af8b0 2023-10-06T01:41:20.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.208+0000 7f2794a5f700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f27900b27f0 0x7f279015d9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:44804/0 (socket says 172.21.15.71:44804) 2023-10-06T01:41:20.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.208+0000 7f2794a5f700 1 -- 172.21.15.71:0/2477188373 learned_addr learned my addr 172.21.15.71:0/2477188373 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:41:20.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.208+0000 7f278f7fe700 1 --2- 172.21.15.71:0/2477188373 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f27900af8b0 0x7f279015d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:20.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.208+0000 7f278effd700 1 -- 172.21.15.71:0/2477188373 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4034261056 0 0) 0x7f279015e190 con 0x7f27900b27f0 2023-10-06T01:41:20.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.208+0000 7f278effd700 1 -- 172.21.15.71:0/2477188373 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2778003570 con 0x7f27900b27f0 2023-10-06T01:41:20.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.208+0000 7f278effd700 1 -- 172.21.15.71:0/2477188373 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4103926338 0 0) 0x7f2778003570 con 0x7f27900b27f0 2023-10-06T01:41:20.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.208+0000 7f278effd700 1 -- 172.21.15.71:0/2477188373 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f27900af8b0 msgr2=0x7f279015d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:20.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.208+0000 7f278effd700 1 --2- 172.21.15.71:0/2477188373 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f27900af8b0 0x7f279015d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:20.212 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.208+0000 7f278effd700 1 -- 172.21.15.71:0/2477188373 >> v1:172.21.15.72:6789/0 conn(0x7f27900af4e0 legacy=0x7f27900b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:20.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.208+0000 7f278effd700 1 -- 172.21.15.71:0/2477188373 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27900ccaf0 con 0x7f27900b27f0 2023-10-06T01:41:20.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.208+0000 7f278effd700 1 -- 172.21.15.71:0/2477188373 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1184243524 0 0) 0x7f27880017f0 con 0x7f27900b27f0 2023-10-06T01:41:20.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.208+0000 7f278effd700 1 -- 172.21.15.71:0/2477188373 >> v1:172.21.15.71:6789/0 conn(0x7f27900b27f0 legacy=0x7f279015d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:20.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.208+0000 7f278effd700 1 --2- 172.21.15.71:0/2477188373 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2778003a90 0x7f2778003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:20.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.208+0000 7f278effd700 1 --2- 172.21.15.71:0/2477188373 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2778004810 0x7f2778004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:20.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.208+0000 7f278effd700 1 --2- 172.21.15.71:0/2477188373 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f27900af8b0 0x7f27780051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:20.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.208+0000 7f278effd700 1 -- 172.21.15.71:0/2477188373 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27900b1910 con 0x7f2778004810 2023-10-06T01:41:20.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.208+0000 7f278effd700 1 -- 172.21.15.71:0/2477188373 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f277800bbc0 con 0x7f2778003a90 2023-10-06T01:41:20.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.208+0000 7f278effd700 1 -- 172.21.15.71:0/2477188373 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f277800bd80 con 0x7f27900af8b0 2023-10-06T01:41:20.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.208+0000 7f278f7fe700 1 --2- 172.21.15.71:0/2477188373 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2778004810 0x7f2778004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:20.213 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.209+0000 7f2794a5f700 1 --2- 172.21.15.71:0/2477188373 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f27900af8b0 0x7f27780051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:20.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.209+0000 7f278ffff700 1 --2- 172.21.15.71:0/2477188373 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2778003a90 0x7f2778003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:20.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.209+0000 7f278f7fe700 1 -- 172.21.15.71:0/2477188373 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f27900af8b0 msgr2=0x7f27780051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:20.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.209+0000 7f278f7fe700 1 --2- 172.21.15.71:0/2477188373 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f27900af8b0 0x7f27780051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:20.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.209+0000 7f278f7fe700 1 -- 172.21.15.71:0/2477188373 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2778003a90 msgr2=0x7f2778003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:20.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.209+0000 7f278f7fe700 1 --2- 172.21.15.71:0/2477188373 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2778003a90 0x7f2778003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:20.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.209+0000 7f278f7fe700 1 -- 172.21.15.71:0/2477188373 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2778003570 con 0x7f2778004810 2023-10-06T01:41:20.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.209+0000 7f278ffff700 1 --2- 172.21.15.71:0/2477188373 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2778003a90 0x7f2778003ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:41:20.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.209+0000 7f278f7fe700 1 --2- 172.21.15.71:0/2477188373 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2778004810 0x7f2778004c80 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f2780009c00 tx=0x7f27800091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23d6230b6fd56a3c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:20.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.209+0000 7f278effd700 1 -- 172.21.15.71:0/2477188373 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f278000e710 con 0x7f2778004810 2023-10-06T01:41:20.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.209+0000 7f278effd700 1 -- 172.21.15.71:0/2477188373 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f278000e870 con 0x7f2778004810 2023-10-06T01:41:20.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.209+0000 7f278effd700 1 -- 172.21.15.71:0/2477188373 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f278000ec30 con 0x7f2778004810 2023-10-06T01:41:20.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.209+0000 7f27964c2700 1 -- 172.21.15.71:0/2477188373 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2778004810 msgr2=0x7f2778004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:20.215 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.209+0000 7f27964c2700 1 --2- 172.21.15.71:0/2477188373 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2778004810 0x7f2778004c80 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f2780009c00 tx=0x7f27800091a0 comp rx=0 tx=0).stop 2023-10-06T01:41:20.215 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.209+0000 7f2794a5f700 1 -- 172.21.15.71:0/2477188373 reap_dead start 2023-10-06T01:41:20.215 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.210+0000 7f27964c2700 1 -- 172.21.15.71:0/2477188373 shutdown_connections 2023-10-06T01:41:20.215 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.210+0000 7f27964c2700 1 -- 172.21.15.71:0/2477188373 >> 172.21.15.71:0/2477188373 conn(0x7f2790068680 msgr2=0x7f2790068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:20.215 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.210+0000 7f27964c2700 1 -- 172.21.15.71:0/2477188373 shutdown_connections 2023-10-06T01:41:20.215 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.210+0000 7f27964c2700 1 -- 172.21.15.71:0/2477188373 wait complete. 2023-10-06T01:41:20.215 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.211+0000 7f27964c2700 1 Processor -- start 2023-10-06T01:41:20.215 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.211+0000 7f27964c2700 1 -- start start 2023-10-06T01:41:20.218 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.211+0000 7f27964c2700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2778004810 0x7f2790169870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:20.218 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.211+0000 7f27964c2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2790150b80 0x7f2790150ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:20.218 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.211+0000 7f27964c2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f27900c9090 0x7f27900c94e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:20.218 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.211+0000 7f27964c2700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2790152900 con 0x7f2778004810 2023-10-06T01:41:20.218 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.211+0000 7f27964c2700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27901508f0 con 0x7f2790150b80 2023-10-06T01:41:20.218 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.211+0000 7f27964c2700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2790151530 con 0x7f27900c9090 2023-10-06T01:41:20.218 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.212+0000 7f278ffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2778004810 0x7f2790169870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:20.218 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.212+0000 7f278ffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2778004810 0x7f2790169870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52894/0 (socket says 172.21.15.71:52894) 2023-10-06T01:41:20.218 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.212+0000 7f278ffff700 1 -- 172.21.15.71:0/969887759 learned_addr learned my addr 172.21.15.71:0/969887759 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:20.219 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.212+0000 7f2794a5f700 1 --2- 172.21.15.71:0/969887759 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f27900c9090 0x7f27900c94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:20.219 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.212+0000 7f278f7fe700 1 --2- 172.21.15.71:0/969887759 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2790150b80 0x7f2790150ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:20.219 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.212+0000 7f278ffff700 1 -- 172.21.15.71:0/969887759 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f27900c9090 msgr2=0x7f27900c94e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:20.219 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.212+0000 7f278ffff700 1 --2- 172.21.15.71:0/969887759 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f27900c9090 0x7f27900c94e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:20.219 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.212+0000 7f278ffff700 1 -- 172.21.15.71:0/969887759 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2790150b80 msgr2=0x7f2790150ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:20.219 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.212+0000 7f278ffff700 1 --2- 172.21.15.71:0/969887759 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2790150b80 0x7f2790150ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:20.219 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.212+0000 7f278ffff700 1 -- 172.21.15.71:0/969887759 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2790152ba0 con 0x7f2778004810 2023-10-06T01:41:20.219 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.212+0000 7f2794a5f700 1 --2- 172.21.15.71:0/969887759 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f27900c9090 0x7f27900c94e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:41:20.219 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.212+0000 7f278ffff700 1 --2- 172.21.15.71:0/969887759 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2778004810 0x7f2790169870 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f278400e8a0 tx=0x7f2784009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:20.219 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.212+0000 7f2777fff700 1 -- 172.21.15.71:0/969887759 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2784017070 con 0x7f2778004810 2023-10-06T01:41:20.219 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.212+0000 7f2777fff700 1 -- 172.21.15.71:0/969887759 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2784006820 con 0x7f2778004810 2023-10-06T01:41:20.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.212+0000 7f27964c2700 1 -- 172.21.15.71:0/969887759 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27900c9ea0 con 0x7f2778004810 2023-10-06T01:41:20.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.212+0000 7f2777fff700 1 -- 172.21.15.71:0/969887759 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2784006bc0 con 0x7f2778004810 2023-10-06T01:41:20.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.212+0000 7f27964c2700 1 -- 172.21.15.71:0/969887759 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27900ca460 con 0x7f2778004810 2023-10-06T01:41:20.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.213+0000 7f27964c2700 1 -- 172.21.15.71:0/969887759 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2790088aa0 con 0x7f2778004810 2023-10-06T01:41:20.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.213+0000 7f2777fff700 1 -- 172.21.15.71:0/969887759 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2784007020 con 0x7f2778004810 2023-10-06T01:41:20.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.214+0000 7f2777fff700 1 --2- 172.21.15.71:0/969887759 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f277c066f30 0x7f277c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:20.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.214+0000 7f2777fff700 1 -- 172.21.15.71:0/969887759 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f2784084040 con 0x7f2778004810 2023-10-06T01:41:20.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.214+0000 7f278f7fe700 1 --2- 172.21.15.71:0/969887759 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f277c066f30 0x7f277c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:20.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.214+0000 7f278f7fe700 1 --2- 172.21.15.71:0/969887759 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f277c066f30 0x7f277c0693e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f27800091e0 tx=0x7f278001a000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:20.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.218+0000 7f2777fff700 1 -- 172.21.15.71:0/969887759 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2784051360 con 0x7f2778004810 2023-10-06T01:41:20.475 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.475+0000 7f27964c2700 1 -- 172.21.15.71:0/969887759 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f27900cad20 con 0x7f2778004810 2023-10-06T01:41:20.476 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.475+0000 7f2777fff700 1 -- 172.21.15.71:0/969887759 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v8) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f2784054980 con 0x7f2778004810 2023-10-06T01:41:20.476 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:41:20.476 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2023-10-06T01:41:20.476 INFO:teuthology.orchestra.run.smithi071.stdout: "auth_dump": [ 2023-10-06T01:41:20.477 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-06T01:41:20.477 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "mds.a", 2023-10-06T01:41:20.477 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQBLZR9lcoBDKBAAuqBFOnzb876BazeC2Cbhzw==", 2023-10-06T01:41:20.477 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-06T01:41:20.477 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-06T01:41:20.477 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow *", 2023-10-06T01:41:20.477 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow *", 2023-10-06T01:41:20.477 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-06T01:41:20.477 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-06T01:41:20.477 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-06T01:41:20.477 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-06T01:41:20.478 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "mds.b", 2023-10-06T01:41:20.478 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQBLZR9lE79sMxAAm8IQLgkFMY+nP5YQcCZeZg==", 2023-10-06T01:41:20.478 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-06T01:41:20.478 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-06T01:41:20.478 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow *", 2023-10-06T01:41:20.478 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow *", 2023-10-06T01:41:20.478 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-06T01:41:20.478 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-06T01:41:20.478 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-06T01:41:20.478 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-06T01:41:20.478 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "mds.c", 2023-10-06T01:41:20.479 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQBLZR9lC30MLxAAVjECkWzmVuCjwmfytprvTw==", 2023-10-06T01:41:20.479 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-06T01:41:20.479 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-06T01:41:20.479 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow *", 2023-10-06T01:41:20.479 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow *", 2023-10-06T01:41:20.479 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-06T01:41:20.479 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-06T01:41:20.479 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-06T01:41:20.479 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-06T01:41:20.479 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "mds.d", 2023-10-06T01:41:20.479 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQBLZR9loz09OhAAy7MxAbp7ihZerFQfSqBglw==", 2023-10-06T01:41:20.480 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-06T01:41:20.480 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-06T01:41:20.480 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow *", 2023-10-06T01:41:20.480 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow *", 2023-10-06T01:41:20.480 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-06T01:41:20.480 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-06T01:41:20.480 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-06T01:41:20.480 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-06T01:41:20.480 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.0", 2023-10-06T01:41:20.480 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQBPZR9lT45fFxAAviTkT2FYL+NLj6FNrCE5Ng==", 2023-10-06T01:41:20.480 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-06T01:41:20.480 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-06T01:41:20.481 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-06T01:41:20.481 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-06T01:41:20.481 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-06T01:41:20.481 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-06T01:41:20.481 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-06T01:41:20.481 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.1", 2023-10-06T01:41:20.481 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQBSZR9lWpR+FBAA0WaTKl/H0wwNPPPqS1ju3w==", 2023-10-06T01:41:20.481 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-06T01:41:20.481 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-06T01:41:20.481 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-06T01:41:20.481 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-06T01:41:20.481 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-06T01:41:20.482 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-06T01:41:20.482 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-06T01:41:20.482 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.2", 2023-10-06T01:41:20.482 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQBVZR9lFrqxExAABQRNP/VF7HBY7D8WBia/CA==", 2023-10-06T01:41:20.482 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-06T01:41:20.482 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-06T01:41:20.482 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-06T01:41:20.482 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-06T01:41:20.482 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-06T01:41:20.482 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-06T01:41:20.482 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-06T01:41:20.482 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.3", 2023-10-06T01:41:20.483 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQBYZR9lmNBKExAAi3WvWiyerLluzlqwcVv6CA==", 2023-10-06T01:41:20.483 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-06T01:41:20.483 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-06T01:41:20.483 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-06T01:41:20.483 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-06T01:41:20.483 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-06T01:41:20.483 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-06T01:41:20.483 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-06T01:41:20.483 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.4", 2023-10-06T01:41:20.483 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQBeZR9lwv27EBAAX3IDzrKCSWlivcjt4tn+9A==", 2023-10-06T01:41:20.483 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-06T01:41:20.483 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-06T01:41:20.484 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-06T01:41:20.484 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-06T01:41:20.484 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-06T01:41:20.484 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-06T01:41:20.484 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-06T01:41:20.484 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.5", 2023-10-06T01:41:20.484 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQBhZR9lhqzQDhAASmhyOln1kgXSDwK+7YZJyQ==", 2023-10-06T01:41:20.484 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-06T01:41:20.484 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-06T01:41:20.484 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-06T01:41:20.484 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-06T01:41:20.484 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-06T01:41:20.485 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-06T01:41:20.485 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-06T01:41:20.485 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.6", 2023-10-06T01:41:20.485 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQBkZR9lLimVDhAAV8pqtb5zp49hl4HAJM0tfA==", 2023-10-06T01:41:20.485 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-06T01:41:20.485 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-06T01:41:20.485 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-06T01:41:20.485 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-06T01:41:20.485 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-06T01:41:20.485 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-06T01:41:20.485 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-06T01:41:20.485 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.7", 2023-10-06T01:41:20.486 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQBnZR9lDwURDxAABbfmEhouaGSV3tByZdRKKw==", 2023-10-06T01:41:20.486 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-06T01:41:20.486 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-06T01:41:20.486 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-06T01:41:20.486 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-06T01:41:20.486 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-06T01:41:20.486 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-06T01:41:20.486 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-06T01:41:20.486 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.0", 2023-10-06T01:41:20.486 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQBMZR9lFadqAhAAjrNmQYFfd+qw3Vup+6+B+Q==", 2023-10-06T01:41:20.486 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-06T01:41:20.487 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-06T01:41:20.487 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow r", 2023-10-06T01:41:20.487 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow rw", 2023-10-06T01:41:20.487 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow rwx" 2023-10-06T01:41:20.487 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-06T01:41:20.487 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-06T01:41:20.487 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-06T01:41:20.487 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.1", 2023-10-06T01:41:20.487 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQBMZR9l8Jy+ChAAtqx+Fz4onmRzILbFxuZ5lg==", 2023-10-06T01:41:20.487 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-06T01:41:20.487 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-06T01:41:20.488 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow r", 2023-10-06T01:41:20.488 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow rw", 2023-10-06T01:41:20.488 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow rwx" 2023-10-06T01:41:20.488 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-06T01:41:20.488 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-06T01:41:20.488 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-06T01:41:20.488 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.2", 2023-10-06T01:41:20.488 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQBMZR9lfIDHBxAAPZRU1OPQtHEJ2+ozcMF5pA==", 2023-10-06T01:41:20.488 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-06T01:41:20.488 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-06T01:41:20.489 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow r", 2023-10-06T01:41:20.489 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow rw", 2023-10-06T01:41:20.489 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow rwx" 2023-10-06T01:41:20.489 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-06T01:41:20.489 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-06T01:41:20.489 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-06T01:41:20.489 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.3", 2023-10-06T01:41:20.489 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQBMZR9lC2QVEBAAJiILvy19TnhA32dUBUiWJw==", 2023-10-06T01:41:20.489 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-06T01:41:20.489 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-06T01:41:20.489 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow r", 2023-10-06T01:41:20.489 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow rw", 2023-10-06T01:41:20.490 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow rwx" 2023-10-06T01:41:20.490 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-06T01:41:20.490 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-06T01:41:20.490 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-06T01:41:20.490 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.admin", 2023-10-06T01:41:20.490 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQBLZR9lATqVDRAAh9Fc8DmrYAKrr2ZMnCdIRQ==", 2023-10-06T01:41:20.490 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-06T01:41:20.490 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow *", 2023-10-06T01:41:20.491 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow *", 2023-10-06T01:41:20.491 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow *", 2023-10-06T01:41:20.491 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-06T01:41:20.491 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-06T01:41:20.491 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-06T01:41:20.491 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-06T01:41:20.491 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.bootstrap-mds", 2023-10-06T01:41:20.491 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQBtZR9lvzcJARAATp9FuLj3mZg2Tr2wZdxQHA==", 2023-10-06T01:41:20.491 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-06T01:41:20.491 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile bootstrap-mds" 2023-10-06T01:41:20.491 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-06T01:41:20.491 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-06T01:41:20.492 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-06T01:41:20.492 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.bootstrap-mgr", 2023-10-06T01:41:20.492 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQBtZR9lDkEJARAA3I/DD+Bwtzh0pB2HncPKbw==", 2023-10-06T01:41:20.492 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-06T01:41:20.492 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile bootstrap-mgr" 2023-10-06T01:41:20.492 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-06T01:41:20.492 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-06T01:41:20.492 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-06T01:41:20.492 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.bootstrap-osd", 2023-10-06T01:41:20.492 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQBtZR9ls0kJARAAgtSW/sZzMX4WKskfZ5yyDA==", 2023-10-06T01:41:20.492 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-06T01:41:20.492 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile bootstrap-osd" 2023-10-06T01:41:20.493 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-06T01:41:20.493 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-06T01:41:20.493 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-06T01:41:20.493 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.bootstrap-rbd", 2023-10-06T01:41:20.493 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQBtZR9l5lAJARAAq4pNZN8/tuqBT8uMWjfo9g==", 2023-10-06T01:41:20.493 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-06T01:41:20.493 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile bootstrap-rbd" 2023-10-06T01:41:20.493 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-06T01:41:20.493 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-06T01:41:20.493 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-06T01:41:20.493 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-10-06T01:41:20.493 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQBtZR9lR1gJARAAVqu8nyv0ReoqMm5d0QT68w==", 2023-10-06T01:41:20.494 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-06T01:41:20.494 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-10-06T01:41:20.494 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-06T01:41:20.494 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-06T01:41:20.494 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-06T01:41:20.494 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.bootstrap-rgw", 2023-10-06T01:41:20.494 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQBtZR9ls18JARAArrQu7wnvt8GHRC8MOzfg0A==", 2023-10-06T01:41:20.494 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-06T01:41:20.494 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile bootstrap-rgw" 2023-10-06T01:41:20.494 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-06T01:41:20.494 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-06T01:41:20.495 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-06T01:41:20.495 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "mgr.x", 2023-10-06T01:41:20.495 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQBLZR9lcCNIJRAAreWP16OjllwbkDLHYn36tA==", 2023-10-06T01:41:20.495 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-06T01:41:20.495 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow *", 2023-10-06T01:41:20.495 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile mgr", 2023-10-06T01:41:20.495 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-06T01:41:20.495 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-06T01:41:20.495 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-06T01:41:20.495 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-06T01:41:20.495 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "mgr.y", 2023-10-06T01:41:20.495 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQBLZR9lp02wIRAAyzu2xX+9mB6LzZ5qLF8c7w==", 2023-10-06T01:41:20.496 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-06T01:41:20.496 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow *", 2023-10-06T01:41:20.496 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile mgr", 2023-10-06T01:41:20.496 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-06T01:41:20.496 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-06T01:41:20.496 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-06T01:41:20.496 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2023-10-06T01:41:20.496 INFO:teuthology.orchestra.run.smithi071.stdout:} 2023-10-06T01:41:20.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.477+0000 7f27964c2700 1 -- 172.21.15.71:0/969887759 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f277c066f30 msgr2=0x7f277c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:20.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.477+0000 7f27964c2700 1 --2- 172.21.15.71:0/969887759 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f277c066f30 0x7f277c0693e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f27800091e0 tx=0x7f278001a000 comp rx=0 tx=0).stop 2023-10-06T01:41:20.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.477+0000 7f27964c2700 1 -- 172.21.15.71:0/969887759 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2778004810 msgr2=0x7f2790169870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:20.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.477+0000 7f27964c2700 1 --2- 172.21.15.71:0/969887759 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2778004810 0x7f2790169870 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f278400e8a0 tx=0x7f2784009040 comp rx=0 tx=0).stop 2023-10-06T01:41:20.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.477+0000 7f27964c2700 1 -- 172.21.15.71:0/969887759 shutdown_connections 2023-10-06T01:41:20.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.477+0000 7f27964c2700 1 --2- 172.21.15.71:0/969887759 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f27900c9090 0x7f27900c94e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:20.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.477+0000 7f27964c2700 1 --2- 172.21.15.71:0/969887759 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2778004810 0x7f2790169870 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:20.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.477+0000 7f27964c2700 1 --2- 172.21.15.71:0/969887759 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f277c066f30 0x7f277c0693e0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:20.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.477+0000 7f27964c2700 1 --2- 172.21.15.71:0/969887759 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2790150b80 0x7f2790150ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:20.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.477+0000 7f27964c2700 1 -- 172.21.15.71:0/969887759 >> 172.21.15.71:0/969887759 conn(0x7f2790068680 msgr2=0x7f27900b54b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:20.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.477+0000 7f27964c2700 1 -- 172.21.15.71:0/969887759 shutdown_connections 2023-10-06T01:41:20.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.477+0000 7f27964c2700 1 -- 172.21.15.71:0/969887759 wait complete. 2023-10-06T01:41:20.499 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-10-06T01:41:20.614 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.613+0000 7f106ebe6700 1 Processor -- start 2023-10-06T01:41:20.614 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.613+0000 7f106ebe6700 1 -- start start 2023-10-06T01:41:20.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.614+0000 7f106ebe6700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f10680a8d90 0x7f10680af200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:20.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.614+0000 7f106ebe6700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f10680b3820 0x7f1068069790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:20.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.614+0000 7f106ebe6700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f106806b030 con 0x7f10680a89c0 2023-10-06T01:41:20.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.614+0000 7f106ebe6700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10680b1ab0 con 0x7f10680b3820 2023-10-06T01:41:20.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.614+0000 7f106ebe6700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f106806ad50 con 0x7f10680a8d90 2023-10-06T01:41:20.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.615+0000 7f105ffff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f10680a8d90 0x7f10680af200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:20.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.615+0000 7f106d183700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f10680b3820 0x7f1068069790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:20.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.615+0000 7f106d183700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f10680b3820 0x7f1068069790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:39512/0 (socket says 172.21.15.71:39512) 2023-10-06T01:41:20.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.615+0000 7f105ffff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f10680a8d90 0x7f10680af200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.71:40318/0 (socket says 172.21.15.71:40318) 2023-10-06T01:41:20.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.615+0000 7f106d183700 1 -- 172.21.15.71:0/1580872138 learned_addr learned my addr 172.21.15.71:0/1580872138 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:20.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.615+0000 7f105ffff700 1 -- 172.21.15.71:0/1580872138 >> v2:172.21.15.72:3300/0 conn(0x7f10680b3820 msgr2=0x7f1068069790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:20.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.615+0000 7f105ffff700 1 --2- 172.21.15.71:0/1580872138 >> v2:172.21.15.72:3300/0 conn(0x7f10680b3820 0x7f1068069790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:20.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.615+0000 7f105ffff700 1 -- 172.21.15.71:0/1580872138 >> v1:172.21.15.72:6789/0 conn(0x7f10680a89c0 legacy=0x7f10680aeaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:20.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.615+0000 7f105ffff700 1 -- 172.21.15.71:0/1580872138 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10680b1d30 con 0x7f10680a8d90 2023-10-06T01:41:20.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.615+0000 7f105ffff700 1 --2- 172.21.15.71:0/1580872138 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f10680a8d90 0x7f10680af200 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f10580098e0 tx=0x7f10580091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc225a20760f7d10 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:20.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.615+0000 7f105f7fe700 1 -- 172.21.15.71:0/1580872138 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f105800b640 con 0x7f10680a8d90 2023-10-06T01:41:20.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.615+0000 7f105f7fe700 1 -- 172.21.15.71:0/1580872138 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f105800b7a0 con 0x7f10680a8d90 2023-10-06T01:41:20.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.615+0000 7f105f7fe700 1 -- 172.21.15.71:0/1580872138 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f105800bb40 con 0x7f10680a8d90 2023-10-06T01:41:20.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.616+0000 7f106ebe6700 1 -- 172.21.15.71:0/1580872138 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f10680a8d90 msgr2=0x7f10680af200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:20.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.616+0000 7f106ebe6700 1 --2- 172.21.15.71:0/1580872138 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f10680a8d90 0x7f10680af200 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f10580098e0 tx=0x7f10580091a0 comp rx=0 tx=0).stop 2023-10-06T01:41:20.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.616+0000 7f106ebe6700 1 -- 172.21.15.71:0/1580872138 shutdown_connections 2023-10-06T01:41:20.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.616+0000 7f106ebe6700 1 --2- 172.21.15.71:0/1580872138 >> v2:172.21.15.72:3300/0 conn(0x7f10680b3820 0x7f1068069790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:20.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.616+0000 7f106ebe6700 1 --2- 172.21.15.71:0/1580872138 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f10680a8d90 0x7f10680af200 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:20.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.616+0000 7f106ebe6700 1 -- 172.21.15.71:0/1580872138 >> 172.21.15.71:0/1580872138 conn(0x7f1068067910 msgr2=0x7f10680ce120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:20.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.616+0000 7f106ebe6700 1 -- 172.21.15.71:0/1580872138 shutdown_connections 2023-10-06T01:41:20.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.616+0000 7f106ebe6700 1 -- 172.21.15.71:0/1580872138 wait complete. 2023-10-06T01:41:20.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.617+0000 7f106ebe6700 1 Processor -- start 2023-10-06T01:41:20.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.617+0000 7f106ebe6700 1 -- start start 2023-10-06T01:41:20.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.618+0000 7f106ebe6700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f10680a89c0 0x7f1068169ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:20.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.618+0000 7f106ebe6700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f10680a8d90 0x7f106816cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:20.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.618+0000 7f106ebe6700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10680b3820 0x7f106806c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:20.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.618+0000 7f106ebe6700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1068098c30 con 0x7f10680a8d90 2023-10-06T01:41:20.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.618+0000 7f106ebe6700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1068098020 con 0x7f10680b3820 2023-10-06T01:41:20.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.618+0000 7f106ebe6700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1068098300 con 0x7f10680a89c0 2023-10-06T01:41:20.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.618+0000 7f105ffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f10680a8d90 0x7f106816cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:20.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.618+0000 7f105ffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f10680a8d90 0x7f106816cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52896/0 (socket says 172.21.15.71:52896) 2023-10-06T01:41:20.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.618+0000 7f105ffff700 1 -- 172.21.15.71:0/2968237154 learned_addr learned my addr 172.21.15.71:0/2968237154 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:20.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.618+0000 7f106c982700 1 --2- 172.21.15.71:0/2968237154 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f10680a89c0 0x7f1068169ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:20.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.618+0000 7f106d183700 1 --2- 172.21.15.71:0/2968237154 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10680b3820 0x7f106806c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:20.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.618+0000 7f105ffff700 1 -- 172.21.15.71:0/2968237154 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f10680a89c0 msgr2=0x7f1068169ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:20.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.618+0000 7f105ffff700 1 --2- 172.21.15.71:0/2968237154 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f10680a89c0 0x7f1068169ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:20.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.618+0000 7f105ffff700 1 -- 172.21.15.71:0/2968237154 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10680b3820 msgr2=0x7f106806c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:20.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.618+0000 7f105ffff700 1 --2- 172.21.15.71:0/2968237154 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10680b3820 0x7f106806c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:20.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.618+0000 7f105ffff700 1 -- 172.21.15.71:0/2968237154 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1058009420 con 0x7f10680a8d90 2023-10-06T01:41:20.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.618+0000 7f105ffff700 1 --2- 172.21.15.71:0/2968237154 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f10680a8d90 0x7f106816cc40 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f1058013000 tx=0x7f1058017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:20.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.619+0000 7f105cff9700 1 -- 172.21.15.71:0/2968237154 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f105801bc40 con 0x7f10680a8d90 2023-10-06T01:41:20.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.619+0000 7f106ebe6700 1 -- 172.21.15.71:0/2968237154 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10680985e0 con 0x7f10680a8d90 2023-10-06T01:41:20.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.619+0000 7f105cff9700 1 -- 172.21.15.71:0/2968237154 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f105801bdc0 con 0x7f10680a8d90 2023-10-06T01:41:20.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.619+0000 7f105cff9700 1 -- 172.21.15.71:0/2968237154 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1058011670 con 0x7f10680a8d90 2023-10-06T01:41:20.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.619+0000 7f106ebe6700 1 -- 172.21.15.71:0/2968237154 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1068097cb0 con 0x7f10680a8d90 2023-10-06T01:41:20.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.620+0000 7f106ebe6700 1 -- 172.21.15.71:0/2968237154 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1068087170 con 0x7f10680a8d90 2023-10-06T01:41:20.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.620+0000 7f105cff9700 1 -- 172.21.15.71:0/2968237154 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1058011a20 con 0x7f10680a8d90 2023-10-06T01:41:20.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.620+0000 7f105cff9700 1 --2- 172.21.15.71:0/2968237154 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f1054066f30 0x7f10540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:20.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.620+0000 7f105cff9700 1 -- 172.21.15.71:0/2968237154 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f1058085a80 con 0x7f10680a8d90 2023-10-06T01:41:20.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.620+0000 7f106c982700 1 --2- 172.21.15.71:0/2968237154 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f1054066f30 0x7f10540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:20.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.621+0000 7f106c982700 1 --2- 172.21.15.71:0/2968237154 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f1054066f30 0x7f10540693e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f106400c580 tx=0x7f1064001a80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:20.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.624+0000 7f105cff9700 1 -- 172.21.15.71:0/2968237154 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1058052da0 con 0x7f10680a8d90 2023-10-06T01:41:20.883 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.882+0000 7f106ebe6700 1 -- 172.21.15.71:0/2968237154 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f106806e5d0 con 0x7f10680a8d90 2023-10-06T01:41:20.886 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.885+0000 7f105cff9700 1 -- 172.21.15.71:0/2968237154 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f10580563c0 con 0x7f10680a8d90 2023-10-06T01:41:20.889 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.887+0000 7f106ebe6700 1 -- 172.21.15.71:0/2968237154 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f1054066f30 msgr2=0x7f10540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:20.889 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.887+0000 7f106ebe6700 1 --2- 172.21.15.71:0/2968237154 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f1054066f30 0x7f10540693e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f106400c580 tx=0x7f1064001a80 comp rx=0 tx=0).stop 2023-10-06T01:41:20.889 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.888+0000 7f106ebe6700 1 -- 172.21.15.71:0/2968237154 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f10680a8d90 msgr2=0x7f106816cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:20.889 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.888+0000 7f106ebe6700 1 --2- 172.21.15.71:0/2968237154 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f10680a8d90 0x7f106816cc40 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f1058013000 tx=0x7f1058017000 comp rx=0 tx=0).stop 2023-10-06T01:41:20.889 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.888+0000 7f106ebe6700 1 -- 172.21.15.71:0/2968237154 shutdown_connections 2023-10-06T01:41:20.889 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.888+0000 7f106ebe6700 1 --2- 172.21.15.71:0/2968237154 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f1054066f30 0x7f10540693e0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:20.889 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.888+0000 7f106ebe6700 1 --2- 172.21.15.71:0/2968237154 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10680b3820 0x7f106806c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:20.889 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.888+0000 7f106ebe6700 1 --2- 172.21.15.71:0/2968237154 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f10680a89c0 0x7f1068169ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:20.889 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.888+0000 7f106ebe6700 1 --2- 172.21.15.71:0/2968237154 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f10680a8d90 0x7f106816cc40 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:20.889 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.888+0000 7f106ebe6700 1 -- 172.21.15.71:0/2968237154 >> 172.21.15.71:0/2968237154 conn(0x7f1068067910 msgr2=0x7f10681585f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:20.889 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.888+0000 7f106ebe6700 1 -- 172.21.15.71:0/2968237154 shutdown_connections 2023-10-06T01:41:20.890 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:20.888+0000 7f106ebe6700 1 -- 172.21.15.71:0/2968237154 wait complete. 2023-10-06T01:41:20.900 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-10-06T01:41:21.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.014+0000 7fad0472c700 1 Processor -- start 2023-10-06T01:41:21.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.014+0000 7fad0472c700 1 -- start start 2023-10-06T01:41:21.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.015+0000 7fad0472c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7facfc15a030 0x7facfc15a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:21.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.015+0000 7fad0472c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7facfc087700 0x7facfc0b21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:21.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.015+0000 7fad0472c700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facfc0afc50 con 0x7facfc15a940 2023-10-06T01:41:21.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.015+0000 7fad0472c700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facfc0b0cf0 con 0x7facfc087700 2023-10-06T01:41:21.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.015+0000 7fad0472c700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facfc0aff30 con 0x7facfc15a030 2023-10-06T01:41:21.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.015+0000 7fad02cc9700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7facfc087700 0x7facfc0b21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:21.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.015+0000 7fad02cc9700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7facfc087700 0x7facfc0b21b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52908/0 (socket says 172.21.15.71:52908) 2023-10-06T01:41:21.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.015+0000 7fad02cc9700 1 -- 172.21.15.71:0/3519412115 learned_addr learned my addr 172.21.15.71:0/3519412115 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:21.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.016+0000 7fad024c8700 1 --2- 172.21.15.71:0/3519412115 >> v2:172.21.15.72:3300/0 conn(0x7facfc15a030 0x7facfc15a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:21.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.016+0000 7fad02cc9700 1 -- 172.21.15.71:0/3519412115 >> v2:172.21.15.72:3300/0 conn(0x7facfc15a030 msgr2=0x7facfc15a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:21.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.016+0000 7fad02cc9700 1 --2- 172.21.15.71:0/3519412115 >> v2:172.21.15.72:3300/0 conn(0x7facfc15a030 0x7facfc15a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:21.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.016+0000 7fad02cc9700 1 -- 172.21.15.71:0/3519412115 >> v1:172.21.15.72:6789/0 conn(0x7facfc15a940 legacy=0x7facfc086ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:21.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.016+0000 7fad02cc9700 1 -- 172.21.15.71:0/3519412115 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facfc0b0210 con 0x7facfc087700 2023-10-06T01:41:21.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.016+0000 7fad02cc9700 1 --2- 172.21.15.71:0/3519412115 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7facfc087700 0x7facfc0b21b0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7facfc0cddc0 tx=0x7facf4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d122403efad3719 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:21.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.016+0000 7fad014c6700 1 -- 172.21.15.71:0/3519412115 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf400b820 con 0x7facfc087700 2023-10-06T01:41:21.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.016+0000 7fad014c6700 1 -- 172.21.15.71:0/3519412115 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facf400b980 con 0x7facfc087700 2023-10-06T01:41:21.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.016+0000 7fad014c6700 1 -- 172.21.15.71:0/3519412115 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf400bd20 con 0x7facfc087700 2023-10-06T01:41:21.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.016+0000 7fad0472c700 1 -- 172.21.15.71:0/3519412115 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7facfc087700 msgr2=0x7facfc0b21b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:21.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.016+0000 7fad0472c700 1 --2- 172.21.15.71:0/3519412115 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7facfc087700 0x7facfc0b21b0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7facfc0cddc0 tx=0x7facf4009250 comp rx=0 tx=0).stop 2023-10-06T01:41:21.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.017+0000 7fad0472c700 1 -- 172.21.15.71:0/3519412115 shutdown_connections 2023-10-06T01:41:21.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.017+0000 7fad0472c700 1 --2- 172.21.15.71:0/3519412115 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7facfc087700 0x7facfc0b21b0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:21.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.017+0000 7fad0472c700 1 --2- 172.21.15.71:0/3519412115 >> v2:172.21.15.72:3300/0 conn(0x7facfc15a030 0x7facfc15a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:21.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.017+0000 7fad0472c700 1 -- 172.21.15.71:0/3519412115 >> 172.21.15.71:0/3519412115 conn(0x7facfc068680 msgr2=0x7facfc068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:21.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.017+0000 7fad0472c700 1 -- 172.21.15.71:0/3519412115 shutdown_connections 2023-10-06T01:41:21.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.017+0000 7fad0472c700 1 -- 172.21.15.71:0/3519412115 wait complete. 2023-10-06T01:41:21.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.018+0000 7fad0472c700 1 Processor -- start 2023-10-06T01:41:21.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.018+0000 7fad0472c700 1 -- start start 2023-10-06T01:41:21.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.018+0000 7fad0472c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7facfc087700 0x7facfc16deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:21.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.018+0000 7fad0472c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7facfc15a030 0x7facfc15d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:21.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.018+0000 7fad0472c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7facfc15a940 0x7facfc169e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:21.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.018+0000 7fad0472c700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facfc16e3f0 con 0x7facfc15a030 2023-10-06T01:41:21.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.018+0000 7fad0472c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facfc16d460 con 0x7facfc087700 2023-10-06T01:41:21.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.018+0000 7fad0472c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facfc16da20 con 0x7facfc15a940 2023-10-06T01:41:21.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.019+0000 7fad01cc7700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7facfc15a030 0x7facfc15d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:21.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.019+0000 7fad01cc7700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7facfc15a030 0x7facfc15d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52910/0 (socket says 172.21.15.71:52910) 2023-10-06T01:41:21.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.019+0000 7fad01cc7700 1 -- 172.21.15.71:0/3822563402 learned_addr learned my addr 172.21.15.71:0/3822563402 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:21.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.019+0000 7fad024c8700 1 --2- 172.21.15.71:0/3822563402 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7facfc087700 0x7facfc16deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:21.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.019+0000 7fad02cc9700 1 --2- 172.21.15.71:0/3822563402 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7facfc15a940 0x7facfc169e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:21.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.019+0000 7fad024c8700 1 -- 172.21.15.71:0/3822563402 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7facfc15a940 msgr2=0x7facfc169e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:21.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.019+0000 7fad024c8700 1 --2- 172.21.15.71:0/3822563402 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7facfc15a940 0x7facfc169e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:21.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.019+0000 7fad024c8700 1 -- 172.21.15.71:0/3822563402 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7facfc15a030 msgr2=0x7facfc15d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:21.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.019+0000 7fad024c8700 1 --2- 172.21.15.71:0/3822563402 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7facfc15a030 0x7facfc15d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:21.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.019+0000 7fad024c8700 1 -- 172.21.15.71:0/3822563402 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facf40094f0 con 0x7facfc087700 2023-10-06T01:41:21.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.019+0000 7fad01cc7700 1 --2- 172.21.15.71:0/3822563402 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7facfc15a030 0x7facfc15d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:41:21.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.019+0000 7fad024c8700 1 --2- 172.21.15.71:0/3822563402 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7facfc087700 0x7facfc16deb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7facf8007fc0 tx=0x7facf8009880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:21.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.019+0000 7facf27fc700 1 -- 172.21.15.71:0/3822563402 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf800eca0 con 0x7facfc087700 2023-10-06T01:41:21.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.019+0000 7facf27fc700 1 -- 172.21.15.71:0/3822563402 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facf800ee00 con 0x7facfc087700 2023-10-06T01:41:21.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.019+0000 7fad0472c700 1 -- 172.21.15.71:0/3822563402 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facfc16a990 con 0x7facfc087700 2023-10-06T01:41:21.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.019+0000 7facf27fc700 1 -- 172.21.15.71:0/3822563402 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf8014650 con 0x7facfc087700 2023-10-06T01:41:21.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.019+0000 7fad0472c700 1 -- 172.21.15.71:0/3822563402 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facfc16d6b0 con 0x7facfc087700 2023-10-06T01:41:21.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.020+0000 7fad0472c700 1 -- 172.21.15.71:0/3822563402 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facfc16dd00 con 0x7facfc087700 2023-10-06T01:41:21.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.021+0000 7facf27fc700 1 -- 172.21.15.71:0/3822563402 <== mon.1 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7facf8014a80 con 0x7facfc087700 2023-10-06T01:41:21.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.021+0000 7facf27fc700 1 --2- 172.21.15.71:0/3822563402 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7face0066f30 0x7face00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:21.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.021+0000 7fad01cc7700 1 --2- 172.21.15.71:0/3822563402 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7face0066f30 0x7face00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:21.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.021+0000 7facf27fc700 1 -- 172.21.15.71:0/3822563402 <== mon.1 v2:172.21.15.72:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5526+0+0 (secure 0 0 0) 0x7facf8084be0 con 0x7facfc087700 2023-10-06T01:41:21.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.022+0000 7fad01cc7700 1 --2- 172.21.15.71:0/3822563402 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7face0066f30 0x7face00693e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7facfc0aeee0 tx=0x7facec008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:21.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.026+0000 7facf27fc700 1 -- 172.21.15.71:0/3822563402 <== mon.1 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7facf8051f00 con 0x7facfc087700 2023-10-06T01:41:21.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.289+0000 7fad0472c700 1 -- 172.21.15.71:0/3822563402 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7facfc0b04f0 con 0x7facfc087700 2023-10-06T01:41:21.296 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.296+0000 7facf27fc700 1 -- 172.21.15.71:0/3822563402 <== mon.1 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7facf8055520 con 0x7facfc087700 2023-10-06T01:41:21.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.298+0000 7fad0472c700 1 -- 172.21.15.71:0/3822563402 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7face0066f30 msgr2=0x7face00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:21.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.298+0000 7fad0472c700 1 --2- 172.21.15.71:0/3822563402 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7face0066f30 0x7face00693e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7facfc0aeee0 tx=0x7facec008040 comp rx=0 tx=0).stop 2023-10-06T01:41:21.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.298+0000 7fad0472c700 1 -- 172.21.15.71:0/3822563402 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7facfc087700 msgr2=0x7facfc16deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:21.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.298+0000 7fad0472c700 1 --2- 172.21.15.71:0/3822563402 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7facfc087700 0x7facfc16deb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7facf8007fc0 tx=0x7facf8009880 comp rx=0 tx=0).stop 2023-10-06T01:41:21.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.298+0000 7fad0472c700 1 -- 172.21.15.71:0/3822563402 shutdown_connections 2023-10-06T01:41:21.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.298+0000 7fad0472c700 1 --2- 172.21.15.71:0/3822563402 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7facfc15a940 0x7facfc169e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:21.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.298+0000 7fad0472c700 1 --2- 172.21.15.71:0/3822563402 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7face0066f30 0x7face00693e0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:21.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.298+0000 7fad0472c700 1 --2- 172.21.15.71:0/3822563402 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7facfc087700 0x7facfc16deb0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:21.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.298+0000 7fad0472c700 1 --2- 172.21.15.71:0/3822563402 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7facfc15a030 0x7facfc15d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:21.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.298+0000 7fad0472c700 1 -- 172.21.15.71:0/3822563402 >> 172.21.15.71:0/3822563402 conn(0x7facfc068680 msgr2=0x7facfc156910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:21.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.298+0000 7fad0472c700 1 -- 172.21.15.71:0/3822563402 shutdown_connections 2023-10-06T01:41:21.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.298+0000 7fad0472c700 1 -- 172.21.15.71:0/3822563402 wait complete. 2023-10-06T01:41:21.310 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-10-06T01:41:21.425 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.424+0000 7f7f714aa700 1 Processor -- start 2023-10-06T01:41:21.425 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.424+0000 7f7f714aa700 1 -- start start 2023-10-06T01:41:21.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.425+0000 7f7f714aa700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7f6c15a030 0x7f7f6c15a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:21.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.425+0000 7f7f714aa700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f6c15a940 0x7f7f6c086ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:21.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.425+0000 7f7f714aa700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f7f6c087530 0x7f7f6c0b21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:21.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.425+0000 7f7f714aa700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f6c0b0cf0 con 0x7f7f6c087530 2023-10-06T01:41:21.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.425+0000 7f7f714aa700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f6c0879b0 con 0x7f7f6c15a030 2023-10-06T01:41:21.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.425+0000 7f7f714aa700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f6c0afc50 con 0x7f7f6c15a940 2023-10-06T01:41:21.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.425+0000 7f7f6b7fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f7f6c087530 0x7f7f6c0b21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:21.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.425+0000 7f7f6b7fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f7f6c087530 0x7f7f6c0b21b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52914/0 (socket says 172.21.15.71:52914) 2023-10-06T01:41:21.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.425+0000 7f7f6b7fe700 1 -- 172.21.15.71:0/601037762 learned_addr learned my addr 172.21.15.71:0/601037762 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:21.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.425+0000 7f7f6affd700 1 --2- 172.21.15.71:0/601037762 >> v2:172.21.15.72:3300/0 conn(0x7f7f6c15a030 0x7f7f6c15a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:21.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.425+0000 7f7f627fc700 1 --2- 172.21.15.71:0/601037762 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f6c15a940 0x7f7f6c086ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:21.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.426+0000 7f7f6b7fe700 1 -- 172.21.15.71:0/601037762 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f6c15a940 msgr2=0x7f7f6c086ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:21.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.426+0000 7f7f6b7fe700 1 --2- 172.21.15.71:0/601037762 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f6c15a940 0x7f7f6c086ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:21.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.426+0000 7f7f6b7fe700 1 -- 172.21.15.71:0/601037762 >> v2:172.21.15.72:3300/0 conn(0x7f7f6c15a030 msgr2=0x7f7f6c15a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:21.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.426+0000 7f7f6b7fe700 1 --2- 172.21.15.71:0/601037762 >> v2:172.21.15.72:3300/0 conn(0x7f7f6c15a030 0x7f7f6c15a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:21.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.426+0000 7f7f6b7fe700 1 -- 172.21.15.71:0/601037762 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f6c0aff30 con 0x7f7f6c087530 2023-10-06T01:41:21.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.426+0000 7f7f6affd700 1 --2- 172.21.15.71:0/601037762 >> v2:172.21.15.72:3300/0 conn(0x7f7f6c15a030 0x7f7f6c15a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:41:21.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.426+0000 7f7f6b7fe700 1 --2- 172.21.15.71:0/601037762 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7f6c087530 0x7f7f6c0b21b0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c0cddc0 tx=0x7f7f64009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c350f122e0de5f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:21.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.426+0000 7f7f6a7fc700 1 -- 172.21.15.71:0/601037762 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f6400e070 con 0x7f7f6c087530 2023-10-06T01:41:21.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.426+0000 7f7f6a7fc700 1 -- 172.21.15.71:0/601037762 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f6400ba40 con 0x7f7f6c087530 2023-10-06T01:41:21.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.426+0000 7f7f6a7fc700 1 -- 172.21.15.71:0/601037762 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f640092e0 con 0x7f7f6c087530 2023-10-06T01:41:21.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.426+0000 7f7f714aa700 1 -- 172.21.15.71:0/601037762 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7f6c087530 msgr2=0x7f7f6c0b21b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:21.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.426+0000 7f7f714aa700 1 --2- 172.21.15.71:0/601037762 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7f6c087530 0x7f7f6c0b21b0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c0cddc0 tx=0x7f7f64009840 comp rx=0 tx=0).stop 2023-10-06T01:41:21.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.426+0000 7f7f714aa700 1 -- 172.21.15.71:0/601037762 shutdown_connections 2023-10-06T01:41:21.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.426+0000 7f7f714aa700 1 --2- 172.21.15.71:0/601037762 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7f6c087530 0x7f7f6c0b21b0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:21.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.426+0000 7f7f714aa700 1 --2- 172.21.15.71:0/601037762 >> v2:172.21.15.72:3300/0 conn(0x7f7f6c15a030 0x7f7f6c15a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:21.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.426+0000 7f7f714aa700 1 --2- 172.21.15.71:0/601037762 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f6c15a940 0x7f7f6c086ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:21.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.426+0000 7f7f714aa700 1 -- 172.21.15.71:0/601037762 >> 172.21.15.71:0/601037762 conn(0x7f7f6c068680 msgr2=0x7f7f6c068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:21.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.427+0000 7f7f714aa700 1 -- 172.21.15.71:0/601037762 shutdown_connections 2023-10-06T01:41:21.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.427+0000 7f7f714aa700 1 -- 172.21.15.71:0/601037762 wait complete. 2023-10-06T01:41:21.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.428+0000 7f7f714aa700 1 Processor -- start 2023-10-06T01:41:21.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.428+0000 7f7f714aa700 1 -- start start 2023-10-06T01:41:21.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.428+0000 7f7f714aa700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f6c087530 0x7f7f6c15bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:21.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.428+0000 7f7f714aa700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f6c15a030 0x7f7f6c155a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:21.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.428+0000 7f7f714aa700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7f6c15a940 0x7f7f6c0b50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:21.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.428+0000 7f7f714aa700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f6c0b5b00 con 0x7f7f6c15a940 2023-10-06T01:41:21.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.428+0000 7f7f714aa700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f6c0c7390 con 0x7f7f6c087530 2023-10-06T01:41:21.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.428+0000 7f7f714aa700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f6c0c7670 con 0x7f7f6c15a030 2023-10-06T01:41:21.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.429+0000 7f7f6b7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7f6c15a940 0x7f7f6c0b50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:21.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.429+0000 7f7f6b7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7f6c15a940 0x7f7f6c0b50d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52924/0 (socket says 172.21.15.71:52924) 2023-10-06T01:41:21.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.429+0000 7f7f6b7fe700 1 -- 172.21.15.71:0/1016429502 learned_addr learned my addr 172.21.15.71:0/1016429502 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:21.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.429+0000 7f7f627fc700 1 --2- 172.21.15.71:0/1016429502 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f6c15a030 0x7f7f6c155a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:21.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.429+0000 7f7f6affd700 1 --2- 172.21.15.71:0/1016429502 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f6c087530 0x7f7f6c15bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:21.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.429+0000 7f7f6b7fe700 1 -- 172.21.15.71:0/1016429502 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f6c15a030 msgr2=0x7f7f6c155a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:21.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.429+0000 7f7f6b7fe700 1 --2- 172.21.15.71:0/1016429502 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f6c15a030 0x7f7f6c155a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:21.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.429+0000 7f7f6b7fe700 1 -- 172.21.15.71:0/1016429502 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f6c087530 msgr2=0x7f7f6c15bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:21.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.429+0000 7f7f6b7fe700 1 --2- 172.21.15.71:0/1016429502 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f6c087530 0x7f7f6c15bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:21.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.429+0000 7f7f6b7fe700 1 -- 172.21.15.71:0/1016429502 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f64009ae0 con 0x7f7f6c15a940 2023-10-06T01:41:21.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.429+0000 7f7f6b7fe700 1 --2- 172.21.15.71:0/1016429502 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7f6c15a940 0x7f7f6c0b50d0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f7f64009880 tx=0x7f7f64018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:21.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.429+0000 7f7f637fe700 1 -- 172.21.15.71:0/1016429502 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f640032f0 con 0x7f7f6c15a940 2023-10-06T01:41:21.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.429+0000 7f7f637fe700 1 -- 172.21.15.71:0/1016429502 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f64008ce0 con 0x7f7f6c15a940 2023-10-06T01:41:21.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.429+0000 7f7f714aa700 1 -- 172.21.15.71:0/1016429502 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f6c0c7950 con 0x7f7f6c15a940 2023-10-06T01:41:21.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.429+0000 7f7f637fe700 1 -- 172.21.15.71:0/1016429502 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f64026690 con 0x7f7f6c15a940 2023-10-06T01:41:21.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.429+0000 7f7f714aa700 1 -- 172.21.15.71:0/1016429502 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f6c0c9b90 con 0x7f7f6c15a940 2023-10-06T01:41:21.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.430+0000 7f7f714aa700 1 -- 172.21.15.71:0/1016429502 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f6c0c9d80 con 0x7f7f6c15a940 2023-10-06T01:41:21.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.430+0000 7f7f637fe700 1 -- 172.21.15.71:0/1016429502 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7f64003040 con 0x7f7f6c15a940 2023-10-06T01:41:21.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.431+0000 7f7f637fe700 1 --2- 172.21.15.71:0/1016429502 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7f4c066f30 0x7f7f4c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:21.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.431+0000 7f7f637fe700 1 -- 172.21.15.71:0/1016429502 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f7f64086390 con 0x7f7f6c15a940 2023-10-06T01:41:21.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.431+0000 7f7f6affd700 1 --2- 172.21.15.71:0/1016429502 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7f4c066f30 0x7f7f4c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:21.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.431+0000 7f7f6affd700 1 --2- 172.21.15.71:0/1016429502 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7f4c066f30 0x7f7f4c0693e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c006f00 tx=0x7f7f5c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:21.435 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T01:41:21.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.435+0000 7f7f637fe700 1 -- 172.21.15.71:0/1016429502 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7f6c0c9d80 con 0x7f7f6c15a940 2023-10-06T01:41:21.437 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T01:41:21.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.696+0000 7f7f714aa700 1 -- 172.21.15.71:0/1016429502 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f7f6c0c9d80 con 0x7f7f6c15a940 2023-10-06T01:41:21.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.701+0000 7f7f637fe700 1 -- 172.21.15.71:0/1016429502 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v11) v1 ==== 90+0+0 (secure 0 0 0) 0x7f7f6c0c9d80 con 0x7f7f6c15a940 2023-10-06T01:41:21.704 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.704+0000 7f7f714aa700 1 -- 172.21.15.71:0/1016429502 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7f4c066f30 msgr2=0x7f7f4c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:21.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.704+0000 7f7f714aa700 1 --2- 172.21.15.71:0/1016429502 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7f4c066f30 0x7f7f4c0693e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c006f00 tx=0x7f7f5c008040 comp rx=0 tx=0).stop 2023-10-06T01:41:21.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.704+0000 7f7f714aa700 1 -- 172.21.15.71:0/1016429502 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7f6c15a940 msgr2=0x7f7f6c0b50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:21.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.704+0000 7f7f714aa700 1 --2- 172.21.15.71:0/1016429502 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7f6c15a940 0x7f7f6c0b50d0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f7f64009880 tx=0x7f7f64018000 comp rx=0 tx=0).stop 2023-10-06T01:41:21.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.704+0000 7f7f714aa700 1 -- 172.21.15.71:0/1016429502 shutdown_connections 2023-10-06T01:41:21.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.704+0000 7f7f714aa700 1 --2- 172.21.15.71:0/1016429502 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7f6c15a940 0x7f7f6c0b50d0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:21.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.704+0000 7f7f714aa700 1 --2- 172.21.15.71:0/1016429502 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7f4c066f30 0x7f7f4c0693e0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:21.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.704+0000 7f7f714aa700 1 --2- 172.21.15.71:0/1016429502 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f6c087530 0x7f7f6c15bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:21.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.704+0000 7f7f714aa700 1 --2- 172.21.15.71:0/1016429502 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f6c15a030 0x7f7f6c155a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:21.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.704+0000 7f7f714aa700 1 -- 172.21.15.71:0/1016429502 >> 172.21.15.71:0/1016429502 conn(0x7f7f6c068680 msgr2=0x7f7f6c1577f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:21.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.704+0000 7f7f714aa700 1 -- 172.21.15.71:0/1016429502 shutdown_connections 2023-10-06T01:41:21.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.704+0000 7f7f714aa700 1 -- 172.21.15.71:0/1016429502 wait complete. 2023-10-06T01:41:21.716 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-10-06T01:41:21.832 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.831+0000 7f71e4b6a700 1 Processor -- start 2023-10-06T01:41:21.832 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.831+0000 7f71e4b6a700 1 -- start start 2023-10-06T01:41:21.834 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.832+0000 7f71e4b6a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f71e015a030 0x7f71e015a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:21.834 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.832+0000 7f71e4b6a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f71e0087700 0x7f71e00b21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:21.834 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.832+0000 7f71e4b6a700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71e00afc50 con 0x7f71e015a940 2023-10-06T01:41:21.834 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.832+0000 7f71e4b6a700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71e00b0cf0 con 0x7f71e015a030 2023-10-06T01:41:21.834 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.832+0000 7f71e4b6a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71e00aff30 con 0x7f71e0087700 2023-10-06T01:41:21.835 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.832+0000 7f71de59c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f71e015a030 0x7f71e015a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:21.835 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.832+0000 7f71de59c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f71e015a030 0x7f71e015a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52926/0 (socket says 172.21.15.71:52926) 2023-10-06T01:41:21.835 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.832+0000 7f71de59c700 1 -- 172.21.15.71:0/1770034048 learned_addr learned my addr 172.21.15.71:0/1770034048 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:21.835 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.832+0000 7f71de59c700 1 -- 172.21.15.71:0/1770034048 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f71e0087700 msgr2=0x7f71e00b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:21.835 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.832+0000 7f71de59c700 1 --2- 172.21.15.71:0/1770034048 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f71e0087700 0x7f71e00b21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:21.835 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.832+0000 7f71de59c700 1 -- 172.21.15.71:0/1770034048 >> v1:172.21.15.72:6789/0 conn(0x7f71e015a940 legacy=0x7f71e0086ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:21.835 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.832+0000 7f71de59c700 1 -- 172.21.15.71:0/1770034048 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71e00b0210 con 0x7f71e015a030 2023-10-06T01:41:21.835 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.832+0000 7f71de59c700 1 --2- 172.21.15.71:0/1770034048 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f71e015a030 0x7f71e015a400 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f71d00099b0 tx=0x7f71d0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18c0d6dbd5b10aa3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:21.835 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.833+0000 7f71ddd9b700 1 -- 172.21.15.71:0/1770034048 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d000b820 con 0x7f71e015a030 2023-10-06T01:41:21.835 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.833+0000 7f71ddd9b700 1 -- 172.21.15.71:0/1770034048 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71d000b980 con 0x7f71e015a030 2023-10-06T01:41:21.835 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.833+0000 7f71ddd9b700 1 -- 172.21.15.71:0/1770034048 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d000bd20 con 0x7f71e015a030 2023-10-06T01:41:21.835 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.833+0000 7f71e4b6a700 1 -- 172.21.15.71:0/1770034048 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f71e015a030 msgr2=0x7f71e015a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:21.836 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.833+0000 7f71e4b6a700 1 --2- 172.21.15.71:0/1770034048 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f71e015a030 0x7f71e015a400 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f71d00099b0 tx=0x7f71d0009250 comp rx=0 tx=0).stop 2023-10-06T01:41:21.836 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.833+0000 7f71e4b6a700 1 -- 172.21.15.71:0/1770034048 shutdown_connections 2023-10-06T01:41:21.836 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.833+0000 7f71e4b6a700 1 --2- 172.21.15.71:0/1770034048 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f71e0087700 0x7f71e00b21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:21.836 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.833+0000 7f71e4b6a700 1 --2- 172.21.15.71:0/1770034048 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f71e015a030 0x7f71e015a400 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:21.836 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.833+0000 7f71e4b6a700 1 -- 172.21.15.71:0/1770034048 >> 172.21.15.71:0/1770034048 conn(0x7f71e0068680 msgr2=0x7f71e0068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:21.836 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.833+0000 7f71e4b6a700 1 -- 172.21.15.71:0/1770034048 shutdown_connections 2023-10-06T01:41:21.836 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.833+0000 7f71e4b6a700 1 -- 172.21.15.71:0/1770034048 wait complete. 2023-10-06T01:41:21.838 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.834+0000 7f71e4b6a700 1 Processor -- start 2023-10-06T01:41:21.839 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.834+0000 7f71e4b6a700 1 -- start start 2023-10-06T01:41:21.839 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.835+0000 7f71e4b6a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f71e0087700 0x7f71e014b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:21.839 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.835+0000 7f71e4b6a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f71e015a030 0x7f71e00c4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:21.839 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.835+0000 7f71e4b6a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71e015a940 0x7f71e00b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:21.839 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.835+0000 7f71e4b6a700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71e00c8a00 con 0x7f71e015a030 2023-10-06T01:41:21.839 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.835+0000 7f71e4b6a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71e014bf10 con 0x7f71e015a940 2023-10-06T01:41:21.839 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.835+0000 7f71e4b6a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71e00c8410 con 0x7f71e0087700 2023-10-06T01:41:21.839 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.835+0000 7f71d5d9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f71e015a030 0x7f71e00c4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:21.839 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.835+0000 7f71d5d9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f71e015a030 0x7f71e00c4c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52932/0 (socket says 172.21.15.71:52932) 2023-10-06T01:41:21.839 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.835+0000 7f71d5d9b700 1 -- 172.21.15.71:0/1291898203 learned_addr learned my addr 172.21.15.71:0/1291898203 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:21.839 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.835+0000 7f71d5d9b700 1 -- 172.21.15.71:0/1291898203 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f71e0087700 msgr2=0x7f71e014b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:21.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.835+0000 7f71d5d9b700 1 --2- 172.21.15.71:0/1291898203 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f71e0087700 0x7f71e014b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:21.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.835+0000 7f71d5d9b700 1 -- 172.21.15.71:0/1291898203 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71e015a940 msgr2=0x7f71e00b2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:21.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.835+0000 7f71d5d9b700 1 --2- 172.21.15.71:0/1291898203 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71e015a940 0x7f71e00b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:21.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.835+0000 7f71d5d9b700 1 -- 172.21.15.71:0/1291898203 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71d00094f0 con 0x7f71e015a030 2023-10-06T01:41:21.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.836+0000 7f71d5d9b700 1 --2- 172.21.15.71:0/1291898203 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f71e015a030 0x7f71e00c4c10 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f71c800b5e0 tx=0x7f71c80090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:21.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.836+0000 7f71d6ffd700 1 -- 172.21.15.71:0/1291898203 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c800f510 con 0x7f71e015a030 2023-10-06T01:41:21.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.836+0000 7f71d6ffd700 1 -- 172.21.15.71:0/1291898203 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71c800f670 con 0x7f71e015a030 2023-10-06T01:41:21.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.836+0000 7f71e4b6a700 1 -- 172.21.15.71:0/1291898203 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71e00c55f0 con 0x7f71e015a030 2023-10-06T01:41:21.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.836+0000 7f71d6ffd700 1 -- 172.21.15.71:0/1291898203 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c800f9f0 con 0x7f71e015a030 2023-10-06T01:41:21.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.836+0000 7f71e4b6a700 1 -- 172.21.15.71:0/1291898203 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71e00c8690 con 0x7f71e015a030 2023-10-06T01:41:21.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.837+0000 7f71e4b6a700 1 -- 172.21.15.71:0/1291898203 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71e0088700 con 0x7f71e015a030 2023-10-06T01:41:21.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.837+0000 7f71d6ffd700 1 -- 172.21.15.71:0/1291898203 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f71c801a400 con 0x7f71e015a030 2023-10-06T01:41:21.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.837+0000 7f71d6ffd700 1 --2- 172.21.15.71:0/1291898203 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f71c0066f30 0x7f71c00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:21.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.837+0000 7f71d6ffd700 1 -- 172.21.15.71:0/1291898203 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f71c8083f30 con 0x7f71e015a030 2023-10-06T01:41:21.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.837+0000 7f71de59c700 1 --2- 172.21.15.71:0/1291898203 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f71c0066f30 0x7f71c00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:21.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.838+0000 7f71de59c700 1 --2- 172.21.15.71:0/1291898203 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f71c0066f30 0x7f71c00693e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f71d00099b0 tx=0x7f71d0016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:21.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:21.841+0000 7f71d6ffd700 1 -- 172.21.15.71:0/1291898203 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f71c80512d0 con 0x7f71e015a030 2023-10-06T01:41:22.102 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.101+0000 7f71e4b6a700 1 -- 172.21.15.71:0/1291898203 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f71e00c8b90 con 0x7f71e015a030 2023-10-06T01:41:22.105 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.104+0000 7f71d6ffd700 1 -- 172.21.15.71:0/1291898203 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f71c80548f0 con 0x7f71e015a030 2023-10-06T01:41:22.107 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.106+0000 7f71e4b6a700 1 -- 172.21.15.71:0/1291898203 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f71c0066f30 msgr2=0x7f71c00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:22.107 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.106+0000 7f71e4b6a700 1 --2- 172.21.15.71:0/1291898203 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f71c0066f30 0x7f71c00693e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f71d00099b0 tx=0x7f71d0016000 comp rx=0 tx=0).stop 2023-10-06T01:41:22.107 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.106+0000 7f71e4b6a700 1 -- 172.21.15.71:0/1291898203 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f71e015a030 msgr2=0x7f71e00c4c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:22.107 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.106+0000 7f71e4b6a700 1 --2- 172.21.15.71:0/1291898203 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f71e015a030 0x7f71e00c4c10 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f71c800b5e0 tx=0x7f71c80090f0 comp rx=0 tx=0).stop 2023-10-06T01:41:22.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.106+0000 7f71e4b6a700 1 -- 172.21.15.71:0/1291898203 shutdown_connections 2023-10-06T01:41:22.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.106+0000 7f71e4b6a700 1 --2- 172.21.15.71:0/1291898203 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f71c0066f30 0x7f71c00693e0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:22.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.106+0000 7f71e4b6a700 1 --2- 172.21.15.71:0/1291898203 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71e015a940 0x7f71e00b2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:22.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.106+0000 7f71e4b6a700 1 --2- 172.21.15.71:0/1291898203 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f71e0087700 0x7f71e014b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:22.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.106+0000 7f71e4b6a700 1 --2- 172.21.15.71:0/1291898203 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f71e015a030 0x7f71e00c4c10 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:22.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.106+0000 7f71e4b6a700 1 -- 172.21.15.71:0/1291898203 >> 172.21.15.71:0/1291898203 conn(0x7f71e0068680 msgr2=0x7f71e0158d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:22.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.106+0000 7f71e4b6a700 1 -- 172.21.15.71:0/1291898203 shutdown_connections 2023-10-06T01:41:22.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.106+0000 7f71e4b6a700 1 -- 172.21.15.71:0/1291898203 wait complete. 2023-10-06T01:41:22.119 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-10-06T01:41:22.234 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.233+0000 7f43ca283700 1 Processor -- start 2023-10-06T01:41:22.234 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.233+0000 7f43ca283700 1 -- start start 2023-10-06T01:41:22.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.234+0000 7f43ca283700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f43c4086ff0 0x7f43c4087470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:22.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.234+0000 7f43ca283700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43c40afc50 con 0x7f43c415a030 2023-10-06T01:41:22.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.234+0000 7f43ca283700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43c40aff30 con 0x7f43c40b21b0 2023-10-06T01:41:22.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.234+0000 7f43ca283700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43c40b0cf0 con 0x7f43c4086ff0 2023-10-06T01:41:22.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.234+0000 7f43c3fff700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f43c415a030 0x7f43c415a400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:44812/0 (socket says 172.21.15.71:44812) 2023-10-06T01:41:22.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.234+0000 7f43c3fff700 1 -- 172.21.15.71:0/728589494 learned_addr learned my addr 172.21.15.71:0/728589494 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:41:22.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.235+0000 7f43c37fe700 1 --2- 172.21.15.71:0/728589494 >> v2:172.21.15.72:3300/0 conn(0x7f43c4086ff0 0x7f43c4087470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:22.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.235+0000 7f43c2ffd700 1 -- 172.21.15.71:0/728589494 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 936798370 0 0) 0x7f43c40afc50 con 0x7f43c415a030 2023-10-06T01:41:22.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.235+0000 7f43c2ffd700 1 -- 172.21.15.71:0/728589494 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43ac003570 con 0x7f43c415a030 2023-10-06T01:41:22.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.235+0000 7f43c2ffd700 1 -- 172.21.15.71:0/728589494 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3665359584 0 0) 0x7f43ac003570 con 0x7f43c415a030 2023-10-06T01:41:22.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.235+0000 7f43c2ffd700 1 -- 172.21.15.71:0/728589494 >> v2:172.21.15.72:3300/0 conn(0x7f43c4086ff0 msgr2=0x7f43c4087470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:22.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.235+0000 7f43c2ffd700 1 --2- 172.21.15.71:0/728589494 >> v2:172.21.15.72:3300/0 conn(0x7f43c4086ff0 0x7f43c4087470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:22.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.235+0000 7f43c2ffd700 1 -- 172.21.15.71:0/728589494 >> v1:172.21.15.72:6789/0 conn(0x7f43c40b21b0 legacy=0x7f43c40b2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:22.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.235+0000 7f43c2ffd700 1 -- 172.21.15.71:0/728589494 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43c40b0210 con 0x7f43c415a030 2023-10-06T01:41:22.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.235+0000 7f43c2ffd700 1 -- 172.21.15.71:0/728589494 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1184243524 0 0) 0x7f43b4001470 con 0x7f43c415a030 2023-10-06T01:41:22.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.235+0000 7f43c2ffd700 1 -- 172.21.15.71:0/728589494 >> v1:172.21.15.71:6789/0 conn(0x7f43c415a030 legacy=0x7f43c415a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:22.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.235+0000 7f43c2ffd700 1 --2- 172.21.15.71:0/728589494 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f43ac003a60 0x7f43ac003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:22.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.235+0000 7f43c2ffd700 1 --2- 172.21.15.71:0/728589494 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f43ac004810 0x7f43ac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:22.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.235+0000 7f43c2ffd700 1 --2- 172.21.15.71:0/728589494 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43ac0051c0 0x7f43ac00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:22.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.235+0000 7f43c2ffd700 1 -- 172.21.15.71:0/728589494 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43c40b0cf0 con 0x7f43ac004810 2023-10-06T01:41:22.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.235+0000 7f43c2ffd700 1 -- 172.21.15.71:0/728589494 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43ac00c0d0 con 0x7f43ac0051c0 2023-10-06T01:41:22.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.235+0000 7f43c2ffd700 1 -- 172.21.15.71:0/728589494 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43ac00c290 con 0x7f43ac003a60 2023-10-06T01:41:22.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.235+0000 7f43c37fe700 1 --2- 172.21.15.71:0/728589494 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f43ac004810 0x7f43ac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:22.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.235+0000 7f43c8820700 1 --2- 172.21.15.71:0/728589494 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43ac0051c0 0x7f43ac00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:22.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.235+0000 7f43c3fff700 1 --2- 172.21.15.71:0/728589494 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f43ac003a60 0x7f43ac003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:22.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.235+0000 7f43c37fe700 1 -- 172.21.15.71:0/728589494 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f43ac003a60 msgr2=0x7f43ac003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:22.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.235+0000 7f43c37fe700 1 --2- 172.21.15.71:0/728589494 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f43ac003a60 0x7f43ac003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:22.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.235+0000 7f43c37fe700 1 -- 172.21.15.71:0/728589494 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43ac0051c0 msgr2=0x7f43ac00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:22.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.235+0000 7f43c37fe700 1 --2- 172.21.15.71:0/728589494 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43ac0051c0 0x7f43ac00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:22.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.235+0000 7f43c8820700 1 -- 172.21.15.71:0/728589494 reap_dead start 2023-10-06T01:41:22.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.235+0000 7f43c37fe700 1 -- 172.21.15.71:0/728589494 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43ac003570 con 0x7f43ac004810 2023-10-06T01:41:22.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.235+0000 7f43c37fe700 1 --2- 172.21.15.71:0/728589494 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f43ac004810 0x7f43ac004c80 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f43b8009be0 tx=0x7f43b80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c45ac962b74ef7df server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:22.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.236+0000 7f43c2ffd700 1 -- 172.21.15.71:0/728589494 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b800e710 con 0x7f43ac004810 2023-10-06T01:41:22.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.236+0000 7f43c2ffd700 1 -- 172.21.15.71:0/728589494 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43b800e870 con 0x7f43ac004810 2023-10-06T01:41:22.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.236+0000 7f43c2ffd700 1 -- 172.21.15.71:0/728589494 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b800ec30 con 0x7f43ac004810 2023-10-06T01:41:22.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.236+0000 7f43ca283700 1 -- 172.21.15.71:0/728589494 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f43ac004810 msgr2=0x7f43ac004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:22.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.236+0000 7f43ca283700 1 --2- 172.21.15.71:0/728589494 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f43ac004810 0x7f43ac004c80 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f43b8009be0 tx=0x7f43b80091a0 comp rx=0 tx=0).stop 2023-10-06T01:41:22.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.236+0000 7f43ca283700 1 -- 172.21.15.71:0/728589494 shutdown_connections 2023-10-06T01:41:22.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.236+0000 7f43ca283700 1 --2- 172.21.15.71:0/728589494 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f43ac004810 0x7f43ac004c80 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:22.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.236+0000 7f43ca283700 1 -- 172.21.15.71:0/728589494 >> 172.21.15.71:0/728589494 conn(0x7f43c4068680 msgr2=0x7f43c4068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:22.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.236+0000 7f43ca283700 1 -- 172.21.15.71:0/728589494 shutdown_connections 2023-10-06T01:41:22.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.236+0000 7f43ca283700 1 -- 172.21.15.71:0/728589494 wait complete. 2023-10-06T01:41:22.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.237+0000 7f43ca283700 1 Processor -- start 2023-10-06T01:41:22.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.237+0000 7f43ca283700 1 -- start start 2023-10-06T01:41:22.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.238+0000 7f43ca283700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f43ac004810 0x7f43c40c82c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:22.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.238+0000 7f43ca283700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43c40c8800 0x7f43c416d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:22.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.238+0000 7f43ca283700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f43c416d620 0x7f43c4156550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:22.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.238+0000 7f43ca283700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43c40c98b0 con 0x7f43ac004810 2023-10-06T01:41:22.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.238+0000 7f43ca283700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43c40c8ca0 con 0x7f43c40c8800 2023-10-06T01:41:22.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.238+0000 7f43ca283700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43c40c8f80 con 0x7f43c416d620 2023-10-06T01:41:22.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.238+0000 7f43c3fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f43ac004810 0x7f43c40c82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:22.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.238+0000 7f43c3fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f43ac004810 0x7f43c40c82c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52956/0 (socket says 172.21.15.71:52956) 2023-10-06T01:41:22.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.238+0000 7f43c3fff700 1 -- 172.21.15.71:0/562799761 learned_addr learned my addr 172.21.15.71:0/562799761 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:22.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.238+0000 7f43c37fe700 1 --2- 172.21.15.71:0/562799761 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43c40c8800 0x7f43c416d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:22.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.238+0000 7f43c8820700 1 --2- 172.21.15.71:0/562799761 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f43c416d620 0x7f43c4156550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:22.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.238+0000 7f43c3fff700 1 -- 172.21.15.71:0/562799761 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f43c416d620 msgr2=0x7f43c4156550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:22.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.238+0000 7f43c3fff700 1 --2- 172.21.15.71:0/562799761 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f43c416d620 0x7f43c4156550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:22.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.238+0000 7f43c3fff700 1 -- 172.21.15.71:0/562799761 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43c40c8800 msgr2=0x7f43c416d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:22.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.238+0000 7f43c3fff700 1 --2- 172.21.15.71:0/562799761 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43c40c8800 0x7f43c416d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:22.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.238+0000 7f43c3fff700 1 -- 172.21.15.71:0/562799761 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43c40c9260 con 0x7f43ac004810 2023-10-06T01:41:22.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.239+0000 7f43c3fff700 1 --2- 172.21.15.71:0/562799761 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f43ac004810 0x7f43c40c82c0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f43b40073c0 tx=0x7f43b4001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:22.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.239+0000 7f43abfff700 1 -- 172.21.15.71:0/562799761 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b4018030 con 0x7f43ac004810 2023-10-06T01:41:22.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.239+0000 7f43abfff700 1 -- 172.21.15.71:0/562799761 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43b400f8d0 con 0x7f43ac004810 2023-10-06T01:41:22.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.239+0000 7f43abfff700 1 -- 172.21.15.71:0/562799761 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b400fc90 con 0x7f43ac004810 2023-10-06T01:41:22.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.239+0000 7f43ca283700 1 -- 172.21.15.71:0/562799761 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43c40c9540 con 0x7f43ac004810 2023-10-06T01:41:22.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.239+0000 7f43ca283700 1 -- 172.21.15.71:0/562799761 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43c416dbb0 con 0x7f43ac004810 2023-10-06T01:41:22.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.240+0000 7f43ca283700 1 -- 172.21.15.71:0/562799761 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43c40c9b90 con 0x7f43ac004810 2023-10-06T01:41:22.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.240+0000 7f43abfff700 1 -- 172.21.15.71:0/562799761 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f43b401b070 con 0x7f43ac004810 2023-10-06T01:41:22.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.240+0000 7f43abfff700 1 --2- 172.21.15.71:0/562799761 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f43b0066f30 0x7f43b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:22.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.240+0000 7f43abfff700 1 -- 172.21.15.71:0/562799761 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f43b4019070 con 0x7f43ac004810 2023-10-06T01:41:22.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.240+0000 7f43c37fe700 1 --2- 172.21.15.71:0/562799761 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f43b0066f30 0x7f43b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:22.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.241+0000 7f43c37fe700 1 --2- 172.21.15.71:0/562799761 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f43b0066f30 0x7f43b00693e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f43b80091e0 tx=0x7f43b8019000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:22.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.245+0000 7f43abfff700 1 -- 172.21.15.71:0/562799761 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f43b4051850 con 0x7f43ac004810 2023-10-06T01:41:22.508 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.507+0000 7f43ca283700 1 -- 172.21.15.71:0/562799761 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f43c416dd40 con 0x7f43ac004810 2023-10-06T01:41:22.512 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.511+0000 7f43abfff700 1 -- 172.21.15.71:0/562799761 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v13) v1 ==== 97+0+0 (secure 0 0 0) 0x7f43b4054e70 con 0x7f43ac004810 2023-10-06T01:41:22.514 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.513+0000 7f43ca283700 1 -- 172.21.15.71:0/562799761 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f43b0066f30 msgr2=0x7f43b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:22.514 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.513+0000 7f43ca283700 1 --2- 172.21.15.71:0/562799761 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f43b0066f30 0x7f43b00693e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f43b80091e0 tx=0x7f43b8019000 comp rx=0 tx=0).stop 2023-10-06T01:41:22.514 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.513+0000 7f43ca283700 1 -- 172.21.15.71:0/562799761 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f43ac004810 msgr2=0x7f43c40c82c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:22.514 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.513+0000 7f43ca283700 1 --2- 172.21.15.71:0/562799761 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f43ac004810 0x7f43c40c82c0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f43b40073c0 tx=0x7f43b4001e50 comp rx=0 tx=0).stop 2023-10-06T01:41:22.514 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.513+0000 7f43ca283700 1 -- 172.21.15.71:0/562799761 shutdown_connections 2023-10-06T01:41:22.515 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.513+0000 7f43ca283700 1 --2- 172.21.15.71:0/562799761 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f43c416d620 0x7f43c4156550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:22.515 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.513+0000 7f43ca283700 1 --2- 172.21.15.71:0/562799761 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f43ac004810 0x7f43c40c82c0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:22.515 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.513+0000 7f43ca283700 1 --2- 172.21.15.71:0/562799761 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f43b0066f30 0x7f43b00693e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:22.515 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.513+0000 7f43ca283700 1 --2- 172.21.15.71:0/562799761 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43c40c8800 0x7f43c416d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:22.515 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.513+0000 7f43ca283700 1 -- 172.21.15.71:0/562799761 >> 172.21.15.71:0/562799761 conn(0x7f43c4068680 msgr2=0x7f43c40ccf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:22.515 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.513+0000 7f43ca283700 1 -- 172.21.15.71:0/562799761 shutdown_connections 2023-10-06T01:41:22.516 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.513+0000 7f43ca283700 1 -- 172.21.15.71:0/562799761 wait complete. 2023-10-06T01:41:22.525 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-10-06T01:41:22.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.640+0000 7fc502921700 1 Processor -- start 2023-10-06T01:41:22.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.640+0000 7fc502921700 1 -- start start 2023-10-06T01:41:22.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.641+0000 7fc502921700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc4fc15a030 0x7fc4fc15a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:22.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.641+0000 7fc502921700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4fc0afc50 con 0x7fc4fc15a940 2023-10-06T01:41:22.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.641+0000 7fc502921700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4fc0aff30 con 0x7fc4fc087700 2023-10-06T01:41:22.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.641+0000 7fc502921700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4fc0b0cf0 con 0x7fc4fc15a030 2023-10-06T01:41:22.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.641+0000 7fc4fbfff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc4fc15a030 0x7fc4fc15a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:22.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.641+0000 7fc4fb7fe700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fc4fc15a940 0x7fc4fc086ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:44824/0 (socket says 172.21.15.71:44824) 2023-10-06T01:41:22.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.641+0000 7fc4fb7fe700 1 -- 172.21.15.71:0/1428558039 learned_addr learned my addr 172.21.15.71:0/1428558039 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:41:22.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.641+0000 7fc4fbfff700 1 -- 172.21.15.71:0/1428558039 >> v1:172.21.15.72:6789/0 conn(0x7fc4fc087700 legacy=0x7fc4fc0b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:22.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.642+0000 7fc4fbfff700 1 -- 172.21.15.71:0/1428558039 >> v1:172.21.15.71:6789/0 conn(0x7fc4fc15a940 legacy=0x7fc4fc086ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:22.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.641+0000 7fc4faffd700 1 -- 172.21.15.71:0/1428558039 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3116421596 0 0) 0x7fc4fc0afc50 con 0x7fc4fc15a940 2023-10-06T01:41:22.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.642+0000 7fc4fbfff700 1 -- 172.21.15.71:0/1428558039 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4fc0b0210 con 0x7fc4fc15a030 2023-10-06T01:41:22.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.642+0000 7fc4fbfff700 1 --2- 172.21.15.71:0/1428558039 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc4fc15a030 0x7fc4fc15a400 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec0098e0 tx=0x7fc4ec0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27b718032c3725e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:22.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.642+0000 7fc4faffd700 1 -- 172.21.15.71:0/1428558039 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ec009e80 con 0x7fc4fc15a030 2023-10-06T01:41:22.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.642+0000 7fc4faffd700 1 -- 172.21.15.71:0/1428558039 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4ec00b820 con 0x7fc4fc15a030 2023-10-06T01:41:22.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.642+0000 7fc4faffd700 1 -- 172.21.15.71:0/1428558039 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ec00bba0 con 0x7fc4fc15a030 2023-10-06T01:41:22.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.642+0000 7fc502921700 1 -- 172.21.15.71:0/1428558039 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc4fc15a030 msgr2=0x7fc4fc15a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:22.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.642+0000 7fc502921700 1 --2- 172.21.15.71:0/1428558039 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc4fc15a030 0x7fc4fc15a400 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec0098e0 tx=0x7fc4ec0091a0 comp rx=0 tx=0).stop 2023-10-06T01:41:22.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.642+0000 7fc502921700 1 -- 172.21.15.71:0/1428558039 shutdown_connections 2023-10-06T01:41:22.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.642+0000 7fc502921700 1 --2- 172.21.15.71:0/1428558039 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc4fc15a030 0x7fc4fc15a400 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:22.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.642+0000 7fc502921700 1 -- 172.21.15.71:0/1428558039 >> 172.21.15.71:0/1428558039 conn(0x7fc4fc068680 msgr2=0x7fc4fc068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:22.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.642+0000 7fc502921700 1 -- 172.21.15.71:0/1428558039 shutdown_connections 2023-10-06T01:41:22.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.642+0000 7fc502921700 1 -- 172.21.15.71:0/1428558039 wait complete. 2023-10-06T01:41:22.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.643+0000 7fc502921700 1 Processor -- start 2023-10-06T01:41:22.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.644+0000 7fc502921700 1 -- start start 2023-10-06T01:41:22.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.644+0000 7fc502921700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc4fc087700 0x7fc4fc0c96b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:22.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.644+0000 7fc502921700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc4fc15a030 0x7fc4fc16a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:22.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.644+0000 7fc502921700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc4fc15a940 0x7fc4fc155c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:22.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.644+0000 7fc502921700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4fc16ae20 con 0x7fc4fc15a030 2023-10-06T01:41:22.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.644+0000 7fc502921700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4fc0c9220 con 0x7fc4fc15a940 2023-10-06T01:41:22.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.644+0000 7fc502921700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4fc1561c0 con 0x7fc4fc087700 2023-10-06T01:41:22.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.644+0000 7fc4fb7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc4fc15a030 0x7fc4fc16a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:22.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.644+0000 7fc4fb7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc4fc15a030 0x7fc4fc16a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52972/0 (socket says 172.21.15.71:52972) 2023-10-06T01:41:22.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.644+0000 7fc4fb7fe700 1 -- 172.21.15.71:0/1668265429 learned_addr learned my addr 172.21.15.71:0/1668265429 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:22.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.645+0000 7fc4fbfff700 1 --2- 172.21.15.71:0/1668265429 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc4fc087700 0x7fc4fc0c96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:22.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.645+0000 7fc500ebe700 1 --2- 172.21.15.71:0/1668265429 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc4fc15a940 0x7fc4fc155c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:22.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.645+0000 7fc4fb7fe700 1 -- 172.21.15.71:0/1668265429 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc4fc087700 msgr2=0x7fc4fc0c96b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:22.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.645+0000 7fc4fb7fe700 1 --2- 172.21.15.71:0/1668265429 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc4fc087700 0x7fc4fc0c96b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:22.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.645+0000 7fc4fb7fe700 1 -- 172.21.15.71:0/1668265429 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc4fc15a940 msgr2=0x7fc4fc155c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:22.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.645+0000 7fc4fb7fe700 1 --2- 172.21.15.71:0/1668265429 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc4fc15a940 0x7fc4fc155c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:22.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.645+0000 7fc4fb7fe700 1 -- 172.21.15.71:0/1668265429 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4ec009420 con 0x7fc4fc15a030 2023-10-06T01:41:22.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.645+0000 7fc4fb7fe700 1 --2- 172.21.15.71:0/1668265429 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc4fc15a030 0x7fc4fc16a8e0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fc4f000c5e0 tx=0x7fc4f0000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:22.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.645+0000 7fc4e3fff700 1 -- 172.21.15.71:0/1668265429 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f0005b30 con 0x7fc4fc15a030 2023-10-06T01:41:22.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.645+0000 7fc4e3fff700 1 -- 172.21.15.71:0/1668265429 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4f0005c90 con 0x7fc4fc15a030 2023-10-06T01:41:22.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.645+0000 7fc4e3fff700 1 -- 172.21.15.71:0/1668265429 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f00072e0 con 0x7fc4fc15a030 2023-10-06T01:41:22.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.645+0000 7fc502921700 1 -- 172.21.15.71:0/1668265429 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4fc0c6a50 con 0x7fc4fc15a030 2023-10-06T01:41:22.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.645+0000 7fc502921700 1 -- 172.21.15.71:0/1668265429 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4fc0c8bd0 con 0x7fc4fc15a030 2023-10-06T01:41:22.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.646+0000 7fc502921700 1 -- 172.21.15.71:0/1668265429 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4fc0c93d0 con 0x7fc4fc15a030 2023-10-06T01:41:22.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.646+0000 7fc4e3fff700 1 -- 172.21.15.71:0/1668265429 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc4f0007690 con 0x7fc4fc15a030 2023-10-06T01:41:22.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.647+0000 7fc4e3fff700 1 --2- 172.21.15.71:0/1668265429 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fc4e8066f30 0x7fc4e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:22.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.647+0000 7fc4e3fff700 1 -- 172.21.15.71:0/1668265429 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5526+0+0 (secure 0 0 0) 0x7fc4f0083820 con 0x7fc4fc15a030 2023-10-06T01:41:22.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.647+0000 7fc4fbfff700 1 --2- 172.21.15.71:0/1668265429 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fc4e8066f30 0x7fc4e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:22.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.647+0000 7fc4fbfff700 1 --2- 172.21.15.71:0/1668265429 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fc4e8066f30 0x7fc4e80693e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec0030c0 tx=0x7fc4ec016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:22.651 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.651+0000 7fc4e3fff700 1 -- 172.21.15.71:0/1668265429 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc4f004b5a0 con 0x7fc4fc15a030 2023-10-06T01:41:22.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.905+0000 7fc502921700 1 -- 172.21.15.71:0/1668265429 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fc4fc0b04f0 con 0x7fc4fc15a030 2023-10-06T01:41:22.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.909+0000 7fc4e3fff700 1 -- 172.21.15.71:0/1668265429 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v14) v1 ==== 90+0+0 (secure 0 0 0) 0x7fc4f00170a0 con 0x7fc4fc15a030 2023-10-06T01:41:22.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.911+0000 7fc502921700 1 -- 172.21.15.71:0/1668265429 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fc4e8066f30 msgr2=0x7fc4e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:22.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.911+0000 7fc502921700 1 --2- 172.21.15.71:0/1668265429 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fc4e8066f30 0x7fc4e80693e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec0030c0 tx=0x7fc4ec016000 comp rx=0 tx=0).stop 2023-10-06T01:41:22.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.911+0000 7fc502921700 1 -- 172.21.15.71:0/1668265429 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc4fc15a030 msgr2=0x7fc4fc16a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:22.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.911+0000 7fc502921700 1 --2- 172.21.15.71:0/1668265429 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc4fc15a030 0x7fc4fc16a8e0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fc4f000c5e0 tx=0x7fc4f0000fe0 comp rx=0 tx=0).stop 2023-10-06T01:41:22.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.911+0000 7fc502921700 1 -- 172.21.15.71:0/1668265429 shutdown_connections 2023-10-06T01:41:22.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.911+0000 7fc502921700 1 --2- 172.21.15.71:0/1668265429 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fc4e8066f30 0x7fc4e80693e0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:22.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.911+0000 7fc502921700 1 --2- 172.21.15.71:0/1668265429 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc4fc15a940 0x7fc4fc155c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:22.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.911+0000 7fc502921700 1 --2- 172.21.15.71:0/1668265429 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc4fc087700 0x7fc4fc0c96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:22.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.911+0000 7fc502921700 1 --2- 172.21.15.71:0/1668265429 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc4fc15a030 0x7fc4fc16a8e0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:22.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.912+0000 7fc502921700 1 -- 172.21.15.71:0/1668265429 >> 172.21.15.71:0/1668265429 conn(0x7fc4fc068680 msgr2=0x7fc4fc0cb730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:22.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.912+0000 7fc502921700 1 -- 172.21.15.71:0/1668265429 shutdown_connections 2023-10-06T01:41:22.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:22.912+0000 7fc502921700 1 -- 172.21.15.71:0/1668265429 wait complete. 2023-10-06T01:41:22.924 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:41:23.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.039+0000 7f48e799f700 1 Processor -- start 2023-10-06T01:41:23.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.039+0000 7f48e799f700 1 -- start start 2023-10-06T01:41:23.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.040+0000 7f48e799f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f48e00b27f0 0x7f48e015db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:23.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.040+0000 7f48e799f700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48e015e190 con 0x7f48e00af8b0 2023-10-06T01:41:23.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.040+0000 7f48e799f700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48e00cb650 con 0x7f48e00af4e0 2023-10-06T01:41:23.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.040+0000 7f48e799f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48e00b1910 con 0x7f48e00b27f0 2023-10-06T01:41:23.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.040+0000 7f48e4f3a700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f48e00af8b0 0x7f48e015d460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:44826/0 (socket says 172.21.15.71:44826) 2023-10-06T01:41:23.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.040+0000 7f48e4f3a700 1 -- 172.21.15.71:0/3220026603 learned_addr learned my addr 172.21.15.71:0/3220026603 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:41:23.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.040+0000 7f48e5f3c700 1 --2- 172.21.15.71:0/3220026603 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f48e00b27f0 0x7f48e015db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:23.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.040+0000 7f48dffff700 1 -- 172.21.15.71:0/3220026603 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1934179572 0 0) 0x7f48e015e190 con 0x7f48e00af8b0 2023-10-06T01:41:23.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.040+0000 7f48dffff700 1 -- 172.21.15.71:0/3220026603 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48c8003570 con 0x7f48e00af8b0 2023-10-06T01:41:23.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.040+0000 7f48dffff700 1 -- 172.21.15.71:0/3220026603 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1219421268 0 0) 0x7f48c8003570 con 0x7f48e00af8b0 2023-10-06T01:41:23.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.040+0000 7f48dffff700 1 -- 172.21.15.71:0/3220026603 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f48e00b27f0 msgr2=0x7f48e015db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:23.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.040+0000 7f48dffff700 1 --2- 172.21.15.71:0/3220026603 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f48e00b27f0 0x7f48e015db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:23.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.040+0000 7f48dffff700 1 -- 172.21.15.71:0/3220026603 >> v1:172.21.15.72:6789/0 conn(0x7f48e00af4e0 legacy=0x7f48e00b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:23.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.040+0000 7f48dffff700 1 -- 172.21.15.71:0/3220026603 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48e00ccaf0 con 0x7f48e00af8b0 2023-10-06T01:41:23.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.040+0000 7f48dffff700 1 -- 172.21.15.71:0/3220026603 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1184243524 0 0) 0x7f48d4001470 con 0x7f48e00af8b0 2023-10-06T01:41:23.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.040+0000 7f48dffff700 1 -- 172.21.15.71:0/3220026603 >> v1:172.21.15.71:6789/0 conn(0x7f48e00af8b0 legacy=0x7f48e015d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:23.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.040+0000 7f48dffff700 1 --2- 172.21.15.71:0/3220026603 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f48c8003a90 0x7f48c8003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:23.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.040+0000 7f48dffff700 1 --2- 172.21.15.71:0/3220026603 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f48c8004810 0x7f48c8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:23.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.040+0000 7f48dffff700 1 --2- 172.21.15.71:0/3220026603 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f48e00b27f0 0x7f48c80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:23.049 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.040+0000 7f48dffff700 1 -- 172.21.15.71:0/3220026603 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48e00b1910 con 0x7f48c8004810 2023-10-06T01:41:23.050 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.040+0000 7f48dffff700 1 -- 172.21.15.71:0/3220026603 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48c800bb10 con 0x7f48c8003a90 2023-10-06T01:41:23.050 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.040+0000 7f48dffff700 1 -- 172.21.15.71:0/3220026603 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48c800bcd0 con 0x7f48e00b27f0 2023-10-06T01:41:23.050 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.040+0000 7f48e4f3a700 1 --2- 172.21.15.71:0/3220026603 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f48c8004810 0x7f48c8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:23.050 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.041+0000 7f48e573b700 1 --2- 172.21.15.71:0/3220026603 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f48c8003a90 0x7f48c8003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:23.050 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.041+0000 7f48e5f3c700 1 --2- 172.21.15.71:0/3220026603 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f48e00b27f0 0x7f48c80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:23.050 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.041+0000 7f48e4f3a700 1 -- 172.21.15.71:0/3220026603 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f48e00b27f0 msgr2=0x7f48c80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:23.050 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.041+0000 7f48e4f3a700 1 --2- 172.21.15.71:0/3220026603 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f48e00b27f0 0x7f48c80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:23.050 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.041+0000 7f48e4f3a700 1 -- 172.21.15.71:0/3220026603 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f48c8003a90 msgr2=0x7f48c8003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:23.050 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.041+0000 7f48e4f3a700 1 --2- 172.21.15.71:0/3220026603 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f48c8003a90 0x7f48c8003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:23.050 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.041+0000 7f48e4f3a700 1 -- 172.21.15.71:0/3220026603 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48c8003570 con 0x7f48c8004810 2023-10-06T01:41:23.050 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.041+0000 7f48e573b700 1 --2- 172.21.15.71:0/3220026603 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f48c8003a90 0x7f48c8003e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:41:23.050 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.041+0000 7f48e5f3c700 1 --2- 172.21.15.71:0/3220026603 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f48e00b27f0 0x7f48c80051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:41:23.051 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.041+0000 7f48e4f3a700 1 --2- 172.21.15.71:0/3220026603 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f48c8004810 0x7f48c8004c80 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f48d400c2a0 tx=0x7f48e00cb5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e9011818e9bfd2d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:23.051 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.041+0000 7f48dffff700 1 -- 172.21.15.71:0/3220026603 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d400cbd0 con 0x7f48c8004810 2023-10-06T01:41:23.051 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.041+0000 7f48dffff700 1 -- 172.21.15.71:0/3220026603 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48d400cd30 con 0x7f48c8004810 2023-10-06T01:41:23.051 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.041+0000 7f48dffff700 1 -- 172.21.15.71:0/3220026603 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d400cea0 con 0x7f48c8004810 2023-10-06T01:41:23.051 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.041+0000 7f48e799f700 1 -- 172.21.15.71:0/3220026603 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f48c8004810 msgr2=0x7f48c8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:23.051 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.041+0000 7f48e799f700 1 --2- 172.21.15.71:0/3220026603 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f48c8004810 0x7f48c8004c80 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f48d400c2a0 tx=0x7f48e00cb5c0 comp rx=0 tx=0).stop 2023-10-06T01:41:23.051 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.041+0000 7f48e5f3c700 1 -- 172.21.15.71:0/3220026603 reap_dead start 2023-10-06T01:41:23.051 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.041+0000 7f48e799f700 1 -- 172.21.15.71:0/3220026603 shutdown_connections 2023-10-06T01:41:23.051 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.041+0000 7f48e799f700 1 -- 172.21.15.71:0/3220026603 >> 172.21.15.71:0/3220026603 conn(0x7f48e0068680 msgr2=0x7f48e0068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:23.051 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.042+0000 7f48e799f700 1 -- 172.21.15.71:0/3220026603 shutdown_connections 2023-10-06T01:41:23.051 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.042+0000 7f48e799f700 1 -- 172.21.15.71:0/3220026603 wait complete. 2023-10-06T01:41:23.051 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.043+0000 7f48e799f700 1 Processor -- start 2023-10-06T01:41:23.052 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.043+0000 7f48e799f700 1 -- start start 2023-10-06T01:41:23.052 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.043+0000 7f48e799f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f48c8004810 0x7f48e00cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:23.052 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.043+0000 7f48e799f700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f48e0150e60 0x7f48e00c7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:23.052 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.043+0000 7f48e799f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f48e016cf00 0x7f48e016d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:23.052 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.044+0000 7f48e799f700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48e016d8e0 con 0x7f48e0150e60 2023-10-06T01:41:23.052 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.044+0000 7f48e799f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48e00c91a0 con 0x7f48c8004810 2023-10-06T01:41:23.052 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.044+0000 7f48e799f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48e00c8ec0 con 0x7f48e016cf00 2023-10-06T01:41:23.052 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.044+0000 7f48e4f3a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f48e0150e60 0x7f48e00c7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:23.052 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.044+0000 7f48e4f3a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f48e0150e60 0x7f48e00c7950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52976/0 (socket says 172.21.15.71:52976) 2023-10-06T01:41:23.052 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.044+0000 7f48e4f3a700 1 -- 172.21.15.71:0/650175197 learned_addr learned my addr 172.21.15.71:0/650175197 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:23.052 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.044+0000 7f48e5f3c700 1 --2- 172.21.15.71:0/650175197 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f48e016cf00 0x7f48e016d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:23.052 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.044+0000 7f48e573b700 1 --2- 172.21.15.71:0/650175197 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f48c8004810 0x7f48e00cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:23.053 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.044+0000 7f48e4f3a700 1 -- 172.21.15.71:0/650175197 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f48e016cf00 msgr2=0x7f48e016d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:23.053 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.044+0000 7f48e4f3a700 1 --2- 172.21.15.71:0/650175197 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f48e016cf00 0x7f48e016d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:23.053 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.044+0000 7f48e4f3a700 1 -- 172.21.15.71:0/650175197 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f48c8004810 msgr2=0x7f48e00cefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:23.053 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.044+0000 7f48e4f3a700 1 --2- 172.21.15.71:0/650175197 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f48c8004810 0x7f48e00cefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:23.053 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.044+0000 7f48e4f3a700 1 -- 172.21.15.71:0/650175197 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48e0153aa0 con 0x7f48e0150e60 2023-10-06T01:41:23.053 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.044+0000 7f48e4f3a700 1 --2- 172.21.15.71:0/650175197 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f48e0150e60 0x7f48e00c7950 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f48c8004770 tx=0x7f48d4015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:23.053 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.044+0000 7f48dd7fa700 1 -- 172.21.15.71:0/650175197 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d4004b10 con 0x7f48e0150e60 2023-10-06T01:41:23.053 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.044+0000 7f48dd7fa700 1 -- 172.21.15.71:0/650175197 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48d4004c70 con 0x7f48e0150e60 2023-10-06T01:41:23.053 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.044+0000 7f48e799f700 1 -- 172.21.15.71:0/650175197 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48e0153d80 con 0x7f48e0150e60 2023-10-06T01:41:23.053 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.044+0000 7f48dd7fa700 1 -- 172.21.15.71:0/650175197 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d40070d0 con 0x7f48e0150e60 2023-10-06T01:41:23.053 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.044+0000 7f48e799f700 1 -- 172.21.15.71:0/650175197 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48e00c8bd0 con 0x7f48e0150e60 2023-10-06T01:41:23.054 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.045+0000 7f48e799f700 1 -- 172.21.15.71:0/650175197 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48e0153900 con 0x7f48e0150e60 2023-10-06T01:41:23.054 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.046+0000 7f48dd7fa700 1 -- 172.21.15.71:0/650175197 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f48d4019070 con 0x7f48e0150e60 2023-10-06T01:41:23.054 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.046+0000 7f48dd7fa700 1 --2- 172.21.15.71:0/650175197 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f48cc066f30 0x7f48cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:23.054 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.046+0000 7f48dd7fa700 1 -- 172.21.15.71:0/650175197 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f48d4085cc0 con 0x7f48e0150e60 2023-10-06T01:41:23.054 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.046+0000 7f48e573b700 1 --2- 172.21.15.71:0/650175197 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f48cc066f30 0x7f48cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:23.054 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.046+0000 7f48e573b700 1 --2- 172.21.15.71:0/650175197 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f48cc066f30 0x7f48cc0693e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f48d8007f40 tx=0x7f48d8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:23.054 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.050+0000 7f48dd7fa700 1 -- 172.21.15.71:0/650175197 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f48e0153900 con 0x7f48e0150e60 2023-10-06T01:41:23.234 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.233+0000 7f48e799f700 1 -- 172.21.15.71:0/650175197 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f48e0153900 con 0x7f48e0150e60 2023-10-06T01:41:23.235 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.234+0000 7f48dd7fa700 1 -- 172.21.15.71:0/650175197 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+13807 (secure 0 0 0) 0x7f48e0153900 con 0x7f48e0150e60 2023-10-06T01:41:23.235 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:41:23.235 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":37,"fsid":"1fbf1bd2-f9b4-4599-bea2-f4aa920e9a56","created":"2023-10-06T01:39:57.016957+0000","modified":"2023-10-06T01:41:20.081006+0000","last_up_change":"2023-10-06T01:40:08.571643+0000","last_in_change":"2023-10-06T01:39:59.462741+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T01:40:08.610349+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T01:40:15.387434+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"cf059188-fb20-4dbf-95db-dcf57b213d03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":90670},{"type":"v1","addr":"172.21.15.71:6817","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":90670},{"type":"v1","addr":"172.21.15.71:6819","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":90670},{"type":"v1","addr":"172.21.15.71:6823","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":90670},{"type":"v1","addr":"172.21.15.71:6821","nonce":90670}]},"public_addr":"172.21.15.71:6817/90670","cluster_addr":"172.21.15.71:6819/90670","heartbeat_back_addr":"172.21.15.71:6823/90670","heartbeat_front_addr":"172.21.15.71:6821/90670","state":["exists","up"]},{"osd":1,"uuid":"0cff0aae-1799-4fe0-b610-54cf0813c0e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":90669},{"type":"v1","addr":"172.21.15.71:6809","nonce":90669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":90669},{"type":"v1","addr":"172.21.15.71:6811","nonce":90669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":90669},{"type":"v1","addr":"172.21.15.71:6815","nonce":90669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":90669},{"type":"v1","addr":"172.21.15.71:6813","nonce":90669}]},"public_addr":"172.21.15.71:6809/90669","cluster_addr":"172.21.15.71:6811/90669","heartbeat_back_addr":"172.21.15.71:6815/90669","heartbeat_front_addr":"172.21.15.71:6813/90669","state":["exists","up"]},{"osd":2,"uuid":"88d61ddc-9031-44e1-ba8c-546a41e7c8ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":90679},{"type":"v1","addr":"172.21.15.71:6825","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":90679},{"type":"v1","addr":"172.21.15.71:6827","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":90679},{"type":"v1","addr":"172.21.15.71:6831","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":90679},{"type":"v1","addr":"172.21.15.71:6829","nonce":90679}]},"public_addr":"172.21.15.71:6825/90679","cluster_addr":"172.21.15.71:6827/90679","heartbeat_back_addr":"172.21.15.71:6831/90679","heartbeat_front_addr":"172.21.15.71:6829/90679","state":["exists","up"]},{"osd":3,"uuid":"11ed92b7-960b-4a30-a889-a61d3eeb86f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":90668},{"type":"v1","addr":"172.21.15.71:6801","nonce":90668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":90668},{"type":"v1","addr":"172.21.15.71:6803","nonce":90668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":90668},{"type":"v1","addr":"172.21.15.71:6807","nonce":90668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":90668},{"type":"v1","addr":"172.21.15.71:6805","nonce":90668}]},"public_addr":"172.21.15.71:6801/90668","cluster_addr":"172.21.15.71:6803/90668","heartbeat_back_addr":"172.21.15.71:6807/90668","heartbeat_front_addr":"172.21.15.71:6805/90668","state":["exists","up"]},{"osd":4,"uuid":"ae4df784-abdf-4ddf-aefa-780f3ddafef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":90917},{"type":"v1","addr":"172.21.15.72:6801","nonce":90917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":90917},{"type":"v1","addr":"172.21.15.72:6803","nonce":90917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":90917},{"type":"v1","addr":"172.21.15.72:6807","nonce":90917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":90917},{"type":"v1","addr":"172.21.15.72:6805","nonce":90917}]},"public_addr":"172.21.15.72:6801/90917","cluster_addr":"172.21.15.72:6803/90917","heartbeat_back_addr":"172.21.15.72:6807/90917","heartbeat_front_addr":"172.21.15.72:6805/90917","state":["exists","up"]},{"osd":5,"uuid":"5ef0790f-001e-458f-a05b-efae216cf435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":90941},{"type":"v1","addr":"172.21.15.72:6817","nonce":90941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":90941},{"type":"v1","addr":"172.21.15.72:6819","nonce":90941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":90941},{"type":"v1","addr":"172.21.15.72:6827","nonce":90941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":90941},{"type":"v1","addr":"172.21.15.72:6823","nonce":90941}]},"public_addr":"172.21.15.72:6817/90941","cluster_addr":"172.21.15.72:6819/90941","heartbeat_back_addr":"172.21.15.72:6827/90941","heartbeat_front_addr":"172.21.15.72:6823/90941","state":["exists","up"]},{"osd":6,"uuid":"8705aef1-9ae8-4e54-a3c4-c2909fa0ceb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":90918},{"type":"v1","addr":"172.21.15.72:6809","nonce":90918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":90918},{"type":"v1","addr":"172.21.15.72:6811","nonce":90918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":90918},{"type":"v1","addr":"172.21.15.72:6815","nonce":90918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":90918},{"type":"v1","addr":"172.21.15.72:6813","nonce":90918}]},"public_addr":"172.21.15.72:6809/90918","cluster_addr":"172.21.15.72:6811/90918","heartbeat_back_addr":"172.21.15.72:6815/90918","heartbeat_front_addr":"172.21.15.72:6813/90918","state":["exists","up"]},{"osd":7,"uuid":"364c5119-6b13-4c75-b3f0-15e165eff86a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":90948},{"type":"v1","addr":"172.21.15.72:6822","nonce":90948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":90948},{"type":"v1","addr":"172.21.15.72:6826","nonce":90948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":90948},{"type":"v1","addr":"172.21.15.72:6831","nonce":90948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":90948},{"type":"v1","addr":"172.21.15.72:6829","nonce":90948}]},"public_addr":"172.21.15.72:6822/90948","cluster_addr":"172.21.15.72:6826/90948","heartbeat_back_addr":"172.21.15.72:6831/90948","heartbeat_front_addr":"172.21.15.72:6829/90948","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.642976+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.645372+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.619116+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.663042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.599163+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.646411+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.631545+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.669821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:41:23.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.236+0000 7f48e799f700 1 -- 172.21.15.71:0/650175197 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f48cc066f30 msgr2=0x7f48cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:23.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.236+0000 7f48e799f700 1 --2- 172.21.15.71:0/650175197 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f48cc066f30 0x7f48cc0693e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f48d8007f40 tx=0x7f48d8009040 comp rx=0 tx=0).stop 2023-10-06T01:41:23.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.236+0000 7f48e799f700 1 -- 172.21.15.71:0/650175197 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f48e0150e60 msgr2=0x7f48e00c7950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:23.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.236+0000 7f48e799f700 1 --2- 172.21.15.71:0/650175197 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f48e0150e60 0x7f48e00c7950 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f48c8004770 tx=0x7f48d4015000 comp rx=0 tx=0).stop 2023-10-06T01:41:23.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.237+0000 7f48e799f700 1 -- 172.21.15.71:0/650175197 shutdown_connections 2023-10-06T01:41:23.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.237+0000 7f48e799f700 1 --2- 172.21.15.71:0/650175197 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f48e016cf00 0x7f48e016d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:23.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.237+0000 7f48e799f700 1 --2- 172.21.15.71:0/650175197 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f48cc066f30 0x7f48cc0693e0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:23.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.237+0000 7f48e799f700 1 --2- 172.21.15.71:0/650175197 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f48c8004810 0x7f48e00cefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:23.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.237+0000 7f48e799f700 1 --2- 172.21.15.71:0/650175197 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f48e0150e60 0x7f48e00c7950 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:23.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.237+0000 7f48e799f700 1 -- 172.21.15.71:0/650175197 >> 172.21.15.71:0/650175197 conn(0x7f48e0068680 msgr2=0x7f48e006a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:23.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.237+0000 7f48e799f700 1 -- 172.21.15.71:0/650175197 shutdown_connections 2023-10-06T01:41:23.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.237+0000 7f48e799f700 1 -- 172.21.15.71:0/650175197 wait complete. 2023-10-06T01:41:23.249 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T01:40:08.610349+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T01:40:15.387434+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-10-06T01:41:23.249 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T01:41:23.366 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.365+0000 7fc397fff700 1 Processor -- start 2023-10-06T01:41:23.366 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.365+0000 7fc397fff700 1 -- start start 2023-10-06T01:41:23.368 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.366+0000 7fc397fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc3980cd400 0x7fc3980b1f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:23.368 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.366+0000 7fc397fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc3980b0810 0x7fc3980b2460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:23.368 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.366+0000 7fc397fff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3980b29a0 con 0x7fc3980cd7d0 2023-10-06T01:41:23.368 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.366+0000 7fc397fff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3980af770 con 0x7fc3980cd400 2023-10-06T01:41:23.368 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.366+0000 7fc397fff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3980afa50 con 0x7fc3980b0810 2023-10-06T01:41:23.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.366+0000 7fc396ffd700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc3980cd400 0x7fc3980b1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:23.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.366+0000 7fc396ffd700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc3980cd400 0x7fc3980b1f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:52986/0 (socket says 172.21.15.71:52986) 2023-10-06T01:41:23.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.366+0000 7fc396ffd700 1 -- 172.21.15.71:0/1556064649 learned_addr learned my addr 172.21.15.71:0/1556064649 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:23.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.366+0000 7fc3977fe700 1 --2- 172.21.15.71:0/1556064649 >> v2:172.21.15.72:3300/0 conn(0x7fc3980b0810 0x7fc3980b2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:23.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.366+0000 7fc396ffd700 1 -- 172.21.15.71:0/1556064649 >> v2:172.21.15.72:3300/0 conn(0x7fc3980b0810 msgr2=0x7fc3980b2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:23.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.366+0000 7fc396ffd700 1 --2- 172.21.15.71:0/1556064649 >> v2:172.21.15.72:3300/0 conn(0x7fc3980b0810 0x7fc3980b2460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:23.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.366+0000 7fc396ffd700 1 -- 172.21.15.71:0/1556064649 >> v1:172.21.15.72:6789/0 conn(0x7fc3980cd7d0 legacy=0x7fc3980d01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:23.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.366+0000 7fc396ffd700 1 -- 172.21.15.71:0/1556064649 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3980afd30 con 0x7fc3980cd400 2023-10-06T01:41:23.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.366+0000 7fc396ffd700 1 --2- 172.21.15.71:0/1556064649 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3980cd400 0x7fc3980b1f20 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fc388009990 tx=0x7fc388009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bcf6ca54e8f8d86 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:23.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.367+0000 7fc3967fc700 1 -- 172.21.15.71:0/1556064649 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc388009e80 con 0x7fc3980cd400 2023-10-06T01:41:23.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.367+0000 7fc3967fc700 1 -- 172.21.15.71:0/1556064649 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc388005c10 con 0x7fc3980cd400 2023-10-06T01:41:23.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.367+0000 7fc3967fc700 1 -- 172.21.15.71:0/1556064649 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38800b610 con 0x7fc3980cd400 2023-10-06T01:41:23.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.367+0000 7fc397fff700 1 -- 172.21.15.71:0/1556064649 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3980cd400 msgr2=0x7fc3980b1f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:23.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.367+0000 7fc397fff700 1 --2- 172.21.15.71:0/1556064649 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3980cd400 0x7fc3980b1f20 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fc388009990 tx=0x7fc388009220 comp rx=0 tx=0).stop 2023-10-06T01:41:23.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.367+0000 7fc397fff700 1 -- 172.21.15.71:0/1556064649 shutdown_connections 2023-10-06T01:41:23.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.367+0000 7fc397fff700 1 --2- 172.21.15.71:0/1556064649 >> v2:172.21.15.72:3300/0 conn(0x7fc3980b0810 0x7fc3980b2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:23.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.367+0000 7fc397fff700 1 --2- 172.21.15.71:0/1556064649 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3980cd400 0x7fc3980b1f20 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:23.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.367+0000 7fc397fff700 1 -- 172.21.15.71:0/1556064649 >> 172.21.15.71:0/1556064649 conn(0x7fc39806a110 msgr2=0x7fc39806a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:23.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.367+0000 7fc397fff700 1 -- 172.21.15.71:0/1556064649 shutdown_connections 2023-10-06T01:41:23.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.367+0000 7fc397fff700 1 -- 172.21.15.71:0/1556064649 wait complete. 2023-10-06T01:41:23.373 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.368+0000 7fc397fff700 1 Processor -- start 2023-10-06T01:41:23.373 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.368+0000 7fc397fff700 1 -- start start 2023-10-06T01:41:23.373 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.369+0000 7fc397fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3980b0810 0x7fc3980c7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:23.373 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.369+0000 7fc397fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc3980cd400 0x7fc398148450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:23.373 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.369+0000 7fc397fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3980c5ec0 0x7fc3980c6310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:23.373 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.369+0000 7fc397fff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3980c47a0 con 0x7fc3980b0810 2023-10-06T01:41:23.373 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.369+0000 7fc397fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3980c6850 con 0x7fc3980c5ec0 2023-10-06T01:41:23.374 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.369+0000 7fc397fff700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3980c8520 con 0x7fc3980cd400 2023-10-06T01:41:23.374 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.369+0000 7fc396ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3980b0810 0x7fc3980c7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:23.374 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.369+0000 7fc396ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3980b0810 0x7fc3980c7fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:53002/0 (socket says 172.21.15.71:53002) 2023-10-06T01:41:23.374 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.369+0000 7fc396ffd700 1 -- 172.21.15.71:0/2474519101 learned_addr learned my addr 172.21.15.71:0/2474519101 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:23.374 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.369+0000 7fc3977fe700 1 --2- 172.21.15.71:0/2474519101 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3980c5ec0 0x7fc3980c6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:23.374 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.369+0000 7fc396ffd700 1 -- 172.21.15.71:0/2474519101 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc3980cd400 msgr2=0x7fc398148450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:23.374 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.369+0000 7fc396ffd700 1 --2- 172.21.15.71:0/2474519101 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc3980cd400 0x7fc398148450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:23.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.369+0000 7fc396ffd700 1 -- 172.21.15.71:0/2474519101 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3980c5ec0 msgr2=0x7fc3980c6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:23.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.369+0000 7fc396ffd700 1 --2- 172.21.15.71:0/2474519101 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3980c5ec0 0x7fc3980c6310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:23.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.369+0000 7fc396ffd700 1 -- 172.21.15.71:0/2474519101 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc388009480 con 0x7fc3980b0810 2023-10-06T01:41:23.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.370+0000 7fc396ffd700 1 --2- 172.21.15.71:0/2474519101 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3980b0810 0x7fc3980c7fe0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fc398089070 tx=0x7fc388016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:23.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.370+0000 7fc38f7fe700 1 -- 172.21.15.71:0/2474519101 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38800be40 con 0x7fc3980b0810 2023-10-06T01:41:23.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.370+0000 7fc38f7fe700 1 -- 172.21.15.71:0/2474519101 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc38801a630 con 0x7fc3980b0810 2023-10-06T01:41:23.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.370+0000 7fc397fff700 1 -- 172.21.15.71:0/2474519101 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3980c3b90 con 0x7fc3980b0810 2023-10-06T01:41:23.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.370+0000 7fc38f7fe700 1 -- 172.21.15.71:0/2474519101 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38801a9f0 con 0x7fc3980b0810 2023-10-06T01:41:23.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.370+0000 7fc397fff700 1 -- 172.21.15.71:0/2474519101 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3980c4150 con 0x7fc3980b0810 2023-10-06T01:41:23.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.371+0000 7fc397fff700 1 -- 172.21.15.71:0/2474519101 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc398064aa0 con 0x7fc3980b0810 2023-10-06T01:41:23.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.371+0000 7fc38f7fe700 1 -- 172.21.15.71:0/2474519101 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc388011420 con 0x7fc3980b0810 2023-10-06T01:41:23.375 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.371+0000 7fc38f7fe700 1 --2- 172.21.15.71:0/2474519101 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fc378066f30 0x7fc3780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:23.376 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.371+0000 7fc38f7fe700 1 -- 172.21.15.71:0/2474519101 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5526+0+0 (secure 0 0 0) 0x7fc388085840 con 0x7fc3980b0810 2023-10-06T01:41:23.376 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.371+0000 7fc38e7fc700 1 --2- 172.21.15.71:0/2474519101 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fc378066f30 0x7fc3780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:23.376 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.372+0000 7fc38e7fc700 1 --2- 172.21.15.71:0/2474519101 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fc378066f30 0x7fc3780693e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc39815be30 tx=0x7fc380007a70 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:23.376 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.375+0000 7fc38f7fe700 1 -- 172.21.15.71:0/2474519101 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc388052c10 con 0x7fc3980b0810 2023-10-06T01:41:23.558 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.557+0000 7fc397fff700 1 -- 172.21.15.71:0/2474519101 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc3980b0010 con 0x7fc3980b0810 2023-10-06T01:41:23.558 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.558+0000 7fc38f7fe700 1 -- 172.21.15.71:0/2474519101 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc388029070 con 0x7fc3980b0810 2023-10-06T01:41:23.559 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 1 2023-10-06T01:41:23.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.560+0000 7fc397fff700 1 -- 172.21.15.71:0/2474519101 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fc378066f30 msgr2=0x7fc3780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:23.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.560+0000 7fc397fff700 1 --2- 172.21.15.71:0/2474519101 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fc378066f30 0x7fc3780693e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc39815be30 tx=0x7fc380007a70 comp rx=0 tx=0).stop 2023-10-06T01:41:23.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.560+0000 7fc397fff700 1 -- 172.21.15.71:0/2474519101 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3980b0810 msgr2=0x7fc3980c7fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:23.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.560+0000 7fc397fff700 1 --2- 172.21.15.71:0/2474519101 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3980b0810 0x7fc3980c7fe0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fc398089070 tx=0x7fc388016000 comp rx=0 tx=0).stop 2023-10-06T01:41:23.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.560+0000 7fc397fff700 1 -- 172.21.15.71:0/2474519101 shutdown_connections 2023-10-06T01:41:23.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.560+0000 7fc397fff700 1 --2- 172.21.15.71:0/2474519101 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fc378066f30 0x7fc3780693e0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:23.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.560+0000 7fc397fff700 1 --2- 172.21.15.71:0/2474519101 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3980c5ec0 0x7fc3980c6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:23.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.560+0000 7fc397fff700 1 --2- 172.21.15.71:0/2474519101 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3980b0810 0x7fc3980c7fe0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:23.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.560+0000 7fc397fff700 1 --2- 172.21.15.71:0/2474519101 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc3980cd400 0x7fc398148450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:23.562 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.560+0000 7fc397fff700 1 -- 172.21.15.71:0/2474519101 >> 172.21.15.71:0/2474519101 conn(0x7fc39806a110 msgr2=0x7fc3980cf720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:23.563 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.560+0000 7fc397fff700 1 -- 172.21.15.71:0/2474519101 shutdown_connections 2023-10-06T01:41:23.563 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.560+0000 7fc397fff700 1 -- 172.21.15.71:0/2474519101 wait complete. 2023-10-06T01:41:23.573 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T01:41:23.689 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.689+0000 7fecf7027700 1 Processor -- start 2023-10-06T01:41:23.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.689+0000 7fecf7027700 1 -- start start 2023-10-06T01:41:23.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.690+0000 7fecf7027700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fecf00b0810 0x7fecf0164160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:23.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.690+0000 7fecf7027700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecf00af770 con 0x7fecf00cd400 2023-10-06T01:41:23.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.690+0000 7fecf7027700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecf00afa50 con 0x7fecf00cd7d0 2023-10-06T01:41:23.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.690+0000 7fecf7027700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecf00afd30 con 0x7fecf00b0810 2023-10-06T01:41:23.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.690+0000 7fecf6025700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fecf00cd400 0x7fecf00b1f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:44840/0 (socket says 172.21.15.71:44840) 2023-10-06T01:41:23.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.690+0000 7fecf6025700 1 -- 172.21.15.71:0/1275686885 learned_addr learned my addr 172.21.15.71:0/1275686885 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:41:23.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.690+0000 7fecf6826700 1 --2- 172.21.15.71:0/1275686885 >> v2:172.21.15.72:3300/0 conn(0x7fecf00b0810 0x7fecf0164160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:23.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.690+0000 7fecf5023700 1 -- 172.21.15.71:0/1275686885 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2826013138 0 0) 0x7fecf00af770 con 0x7fecf00cd400 2023-10-06T01:41:23.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.690+0000 7fecf5023700 1 -- 172.21.15.71:0/1275686885 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fecd8003570 con 0x7fecf00cd400 2023-10-06T01:41:23.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.690+0000 7fecf5023700 1 -- 172.21.15.71:0/1275686885 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3876904558 0 0) 0x7fecd8003570 con 0x7fecf00cd400 2023-10-06T01:41:23.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.690+0000 7fecf5023700 1 -- 172.21.15.71:0/1275686885 >> v2:172.21.15.72:3300/0 conn(0x7fecf00b0810 msgr2=0x7fecf0164160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:23.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.690+0000 7fecf5023700 1 --2- 172.21.15.71:0/1275686885 >> v2:172.21.15.72:3300/0 conn(0x7fecf00b0810 0x7fecf0164160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:23.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.690+0000 7fecf5023700 1 -- 172.21.15.71:0/1275686885 >> v1:172.21.15.72:6789/0 conn(0x7fecf00cd7d0 legacy=0x7fecf00d01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:23.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.690+0000 7fecf5023700 1 -- 172.21.15.71:0/1275686885 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecf00b0010 con 0x7fecf00cd400 2023-10-06T01:41:23.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.690+0000 7fecf5023700 1 -- 172.21.15.71:0/1275686885 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1184243524 0 0) 0x7fece80015f0 con 0x7fecf00cd400 2023-10-06T01:41:23.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.690+0000 7fecf5023700 1 -- 172.21.15.71:0/1275686885 >> v1:172.21.15.71:6789/0 conn(0x7fecf00cd400 legacy=0x7fecf00b1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:23.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.691+0000 7fecf5023700 1 --2- 172.21.15.71:0/1275686885 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fecd8003a60 0x7fecd8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:23.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.691+0000 7fecf5023700 1 --2- 172.21.15.71:0/1275686885 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecd8004810 0x7fecd8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:23.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.691+0000 7fecf5023700 1 --2- 172.21.15.71:0/1275686885 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fecd80052e0 0x7fecd800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:23.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.691+0000 7fecf5023700 1 -- 172.21.15.71:0/1275686885 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecf00afd30 con 0x7fecd8003a60 2023-10-06T01:41:23.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.691+0000 7fecf5023700 1 -- 172.21.15.71:0/1275686885 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd800c2a0 con 0x7fecd8004810 2023-10-06T01:41:23.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.691+0000 7fecf5023700 1 -- 172.21.15.71:0/1275686885 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecd800c460 con 0x7fecd80052e0 2023-10-06T01:41:23.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.691+0000 7fecf6025700 1 --2- 172.21.15.71:0/1275686885 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fecd8003a60 0x7fecd8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:23.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.691+0000 7fecf6826700 1 --2- 172.21.15.71:0/1275686885 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fecd80052e0 0x7fecd800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:23.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.691+0000 7fecf5824700 1 --2- 172.21.15.71:0/1275686885 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecd8004810 0x7fecd8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:23.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.691+0000 7fecf6025700 1 -- 172.21.15.71:0/1275686885 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fecd80052e0 msgr2=0x7fecd800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:23.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.691+0000 7fecf6025700 1 --2- 172.21.15.71:0/1275686885 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fecd80052e0 0x7fecd800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:23.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.691+0000 7fecf6025700 1 -- 172.21.15.71:0/1275686885 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecd8004810 msgr2=0x7fecd8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:23.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.691+0000 7fecf6025700 1 --2- 172.21.15.71:0/1275686885 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecd8004810 0x7fecd8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:23.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.691+0000 7fecf6025700 1 -- 172.21.15.71:0/1275686885 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecd8003570 con 0x7fecd8003a60 2023-10-06T01:41:23.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.691+0000 7fecf5824700 1 --2- 172.21.15.71:0/1275686885 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecd8004810 0x7fecd8004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:41:23.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.691+0000 7fecf6826700 1 --2- 172.21.15.71:0/1275686885 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fecd80052e0 0x7fecd800ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:41:23.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.691+0000 7fecf6826700 1 -- 172.21.15.71:0/1275686885 reap_dead start 2023-10-06T01:41:23.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.691+0000 7fecf6025700 1 --2- 172.21.15.71:0/1275686885 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fecd8003a60 0x7fecd8003e70 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fece800c3c0 tx=0x7fece8007920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2db20f2bd33c98e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:23.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.691+0000 7fecf5023700 1 -- 172.21.15.71:0/1275686885 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece800cc90 con 0x7fecd8003a60 2023-10-06T01:41:23.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.691+0000 7fecf5023700 1 -- 172.21.15.71:0/1275686885 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fece800ce10 con 0x7fecd8003a60 2023-10-06T01:41:23.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.691+0000 7fecf5023700 1 -- 172.21.15.71:0/1275686885 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece8007320 con 0x7fecd8003a60 2023-10-06T01:41:23.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.692+0000 7fecf7027700 1 -- 172.21.15.71:0/1275686885 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fecd8003a60 msgr2=0x7fecd8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:23.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.692+0000 7fecf7027700 1 --2- 172.21.15.71:0/1275686885 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fecd8003a60 0x7fecd8003e70 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fece800c3c0 tx=0x7fece8007920 comp rx=0 tx=0).stop 2023-10-06T01:41:23.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.692+0000 7fecf7027700 1 -- 172.21.15.71:0/1275686885 shutdown_connections 2023-10-06T01:41:23.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.692+0000 7fecf7027700 1 --2- 172.21.15.71:0/1275686885 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fecd8003a60 0x7fecd8003e70 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:23.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.692+0000 7fecf7027700 1 -- 172.21.15.71:0/1275686885 >> 172.21.15.71:0/1275686885 conn(0x7fecf006a110 msgr2=0x7fecf006a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:23.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.692+0000 7fecf7027700 1 -- 172.21.15.71:0/1275686885 shutdown_connections 2023-10-06T01:41:23.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.692+0000 7fecf7027700 1 -- 172.21.15.71:0/1275686885 wait complete. 2023-10-06T01:41:23.700 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.693+0000 7fecf7027700 1 Processor -- start 2023-10-06T01:41:23.700 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.693+0000 7fecf7027700 1 -- start start 2023-10-06T01:41:23.700 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.693+0000 7fecf7027700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecd8003a60 0x7fecf00b5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:23.700 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.694+0000 7fecf7027700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fecf0169eb0 0x7fecf016a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:23.701 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.694+0000 7fecf7027700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fecf0159d00 0x7fecf015a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:23.701 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.694+0000 7fecf7027700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecf016a860 con 0x7fecf0169eb0 2023-10-06T01:41:23.701 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.694+0000 7fecf7027700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecf015a6b0 con 0x7fecd8003a60 2023-10-06T01:41:23.701 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.694+0000 7fecf7027700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecf015b350 con 0x7fecf0159d00 2023-10-06T01:41:23.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.694+0000 7fecf5824700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fecf0169eb0 0x7fecf016a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:23.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.694+0000 7fecf5824700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fecf0169eb0 0x7fecf016a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:53014/0 (socket says 172.21.15.71:53014) 2023-10-06T01:41:23.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.694+0000 7fecf5824700 1 -- 172.21.15.71:0/370545593 learned_addr learned my addr 172.21.15.71:0/370545593 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:23.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.694+0000 7fecf6826700 1 --2- 172.21.15.71:0/370545593 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fecf0159d00 0x7fecf015a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:23.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.694+0000 7fecf6025700 1 --2- 172.21.15.71:0/370545593 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecd8003a60 0x7fecf00b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:23.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.694+0000 7fecf5824700 1 -- 172.21.15.71:0/370545593 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fecf0159d00 msgr2=0x7fecf015a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:23.703 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.694+0000 7fecf5824700 1 --2- 172.21.15.71:0/370545593 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fecf0159d00 0x7fecf015a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:23.703 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.694+0000 7fecf5824700 1 -- 172.21.15.71:0/370545593 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecd8003a60 msgr2=0x7fecf00b5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:23.703 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.694+0000 7fecf5824700 1 --2- 172.21.15.71:0/370545593 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecd8003a60 0x7fecf00b5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:23.703 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.694+0000 7fecf5824700 1 -- 172.21.15.71:0/370545593 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecf015bed0 con 0x7fecf0169eb0 2023-10-06T01:41:23.703 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.694+0000 7fecf6826700 1 --2- 172.21.15.71:0/370545593 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fecf0159d00 0x7fecf015a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:41:23.704 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.694+0000 7fecf5824700 1 --2- 172.21.15.71:0/370545593 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fecf0169eb0 0x7fecf016a320 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fece400e840 tx=0x7fece4009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:23.704 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.694+0000 7fecee7fc700 1 -- 172.21.15.71:0/370545593 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece4017070 con 0x7fecf0169eb0 2023-10-06T01:41:23.704 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.694+0000 7fecee7fc700 1 -- 172.21.15.71:0/370545593 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fece4006820 con 0x7fecf0169eb0 2023-10-06T01:41:23.704 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.694+0000 7fecf7027700 1 -- 172.21.15.71:0/370545593 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecf015b5a0 con 0x7fecf0169eb0 2023-10-06T01:41:23.704 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.694+0000 7fecee7fc700 1 -- 172.21.15.71:0/370545593 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece4006ba0 con 0x7fecf0169eb0 2023-10-06T01:41:23.704 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.694+0000 7fecf7027700 1 -- 172.21.15.71:0/370545593 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecf015bb60 con 0x7fecf0169eb0 2023-10-06T01:41:23.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.695+0000 7fecf7027700 1 -- 172.21.15.71:0/370545593 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecf0064aa0 con 0x7fecf0169eb0 2023-10-06T01:41:23.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.696+0000 7fecee7fc700 1 -- 172.21.15.71:0/370545593 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fece4007020 con 0x7fecf0169eb0 2023-10-06T01:41:23.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.696+0000 7fecee7fc700 1 --2- 172.21.15.71:0/370545593 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fecdc066f30 0x7fecdc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:23.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.696+0000 7fecee7fc700 1 -- 172.21.15.71:0/370545593 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5526+0+0 (secure 0 0 0) 0x7fece4084080 con 0x7fecf0169eb0 2023-10-06T01:41:23.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.696+0000 7fecf6025700 1 --2- 172.21.15.71:0/370545593 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fecdc066f30 0x7fecdc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:23.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.696+0000 7fecf6025700 1 --2- 172.21.15.71:0/370545593 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fecdc066f30 0x7fecdc0693e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fece8000ef0 tx=0x7fece8015000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:23.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.700+0000 7fecee7fc700 1 -- 172.21.15.71:0/370545593 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fece4054e30 con 0x7fecf0169eb0 2023-10-06T01:41:23.882 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.881+0000 7fecf7027700 1 -- 172.21.15.71:0/370545593 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fecf00b02f0 con 0x7fecf0169eb0 2023-10-06T01:41:23.882 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.881+0000 7fecee7fc700 1 -- 172.21.15.71:0/370545593 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v37) v1 ==== 92+0+10 (secure 0 0 0) 0x7fece40549c0 con 0x7fecf0169eb0 2023-10-06T01:41:23.882 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 8 2023-10-06T01:41:23.884 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.883+0000 7fecf7027700 1 -- 172.21.15.71:0/370545593 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fecdc066f30 msgr2=0x7fecdc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:23.884 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.883+0000 7fecf7027700 1 --2- 172.21.15.71:0/370545593 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fecdc066f30 0x7fecdc0693e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fece8000ef0 tx=0x7fece8015000 comp rx=0 tx=0).stop 2023-10-06T01:41:23.885 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.883+0000 7fecf7027700 1 -- 172.21.15.71:0/370545593 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fecf0169eb0 msgr2=0x7fecf016a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:23.885 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.883+0000 7fecf7027700 1 --2- 172.21.15.71:0/370545593 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fecf0169eb0 0x7fecf016a320 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fece400e840 tx=0x7fece4009040 comp rx=0 tx=0).stop 2023-10-06T01:41:23.885 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.883+0000 7fecf7027700 1 -- 172.21.15.71:0/370545593 shutdown_connections 2023-10-06T01:41:23.885 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.883+0000 7fecf7027700 1 --2- 172.21.15.71:0/370545593 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fecf0159d00 0x7fecf015a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:23.885 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.883+0000 7fecf7027700 1 --2- 172.21.15.71:0/370545593 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fecdc066f30 0x7fecdc0693e0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:23.885 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.883+0000 7fecf7027700 1 --2- 172.21.15.71:0/370545593 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecd8003a60 0x7fecf00b5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:23.885 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.883+0000 7fecf7027700 1 --2- 172.21.15.71:0/370545593 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fecf0169eb0 0x7fecf016a320 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:23.885 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.883+0000 7fecf7027700 1 -- 172.21.15.71:0/370545593 >> 172.21.15.71:0/370545593 conn(0x7fecf006a110 msgr2=0x7fecf0158fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:23.885 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.884+0000 7fecf7027700 1 -- 172.21.15.71:0/370545593 shutdown_connections 2023-10-06T01:41:23.885 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:23.884+0000 7fecf7027700 1 -- 172.21.15.71:0/370545593 wait complete. 2023-10-06T01:41:23.896 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T01:41:24.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.009+0000 7f6658511700 1 Processor -- start 2023-10-06T01:41:24.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.009+0000 7f6658511700 1 -- start start 2023-10-06T01:41:24.012 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.010+0000 7f6658511700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f66500af4e0 0x7f66500b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:24.012 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.010+0000 7f6658511700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f665015db70 0x7f66500b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:24.013 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.010+0000 7f6658511700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f665015e190 con 0x7f66500af8b0 2023-10-06T01:41:24.013 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.010+0000 7f6658511700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66500b1910 con 0x7f665015db70 2023-10-06T01:41:24.013 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.010+0000 7f6658511700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f665015dfa0 con 0x7f66500af4e0 2023-10-06T01:41:24.013 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.010+0000 7f6656aae700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f665015db70 0x7f66500b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:24.013 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.010+0000 7f6655aac700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f66500af8b0 0x7f665015d460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:44846/0 (socket says 172.21.15.71:44846) 2023-10-06T01:41:24.013 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.010+0000 7f6656aae700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f665015db70 0x7f66500b2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:53018/0 (socket says 172.21.15.71:53018) 2023-10-06T01:41:24.013 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.010+0000 7f6655aac700 1 -- 172.21.15.71:0/256119512 learned_addr learned my addr 172.21.15.71:0/256119512 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:41:24.013 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.011+0000 7f6656aae700 1 -- 172.21.15.71:0/256119512 >> v2:172.21.15.72:3300/0 conn(0x7f66500af4e0 msgr2=0x7f66500b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:24.013 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.011+0000 7f66562ad700 1 --2- 172.21.15.71:0/256119512 >> v2:172.21.15.72:3300/0 conn(0x7f66500af4e0 0x7f66500b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:24.013 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.011+0000 7f6656aae700 1 --2- 172.21.15.71:0/256119512 >> v2:172.21.15.72:3300/0 conn(0x7f66500af4e0 0x7f66500b20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:24.014 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.011+0000 7f66552ab700 1 -- 172.21.15.71:0/256119512 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1201752354 0 0) 0x7f665015e190 con 0x7f66500af8b0 2023-10-06T01:41:24.014 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.011+0000 7f6656aae700 1 -- 172.21.15.71:0/256119512 >> v1:172.21.15.71:6789/0 conn(0x7f66500af8b0 legacy=0x7f665015d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:24.014 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.011+0000 7f6656aae700 1 -- 172.21.15.71:0/256119512 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66500cb650 con 0x7f665015db70 2023-10-06T01:41:24.014 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.011+0000 7f66562ad700 1 --2- 172.21.15.71:0/256119512 >> v2:172.21.15.72:3300/0 conn(0x7f66500af4e0 0x7f66500b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:41:24.014 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.011+0000 7f6656aae700 1 --2- 172.21.15.71:0/256119512 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f665015db70 0x7f66500b2620 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f66500d1360 tx=0x7f66480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=742d4c14c308be3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:24.014 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.011+0000 7f66552ab700 1 -- 172.21.15.71:0/256119512 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f664800b6b0 con 0x7f665015db70 2023-10-06T01:41:24.014 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.011+0000 7f66552ab700 1 -- 172.21.15.71:0/256119512 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f664800b810 con 0x7f665015db70 2023-10-06T01:41:24.014 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.011+0000 7f66552ab700 1 -- 172.21.15.71:0/256119512 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f664800bbb0 con 0x7f665015db70 2023-10-06T01:41:24.014 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.011+0000 7f6658511700 1 -- 172.21.15.71:0/256119512 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f665015db70 msgr2=0x7f66500b2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:24.014 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.011+0000 7f6658511700 1 --2- 172.21.15.71:0/256119512 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f665015db70 0x7f66500b2620 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f66500d1360 tx=0x7f66480091a0 comp rx=0 tx=0).stop 2023-10-06T01:41:24.014 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.012+0000 7f6658511700 1 -- 172.21.15.71:0/256119512 shutdown_connections 2023-10-06T01:41:24.014 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.012+0000 7f6658511700 1 --2- 172.21.15.71:0/256119512 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f665015db70 0x7f66500b2620 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:24.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.012+0000 7f6658511700 1 --2- 172.21.15.71:0/256119512 >> v2:172.21.15.72:3300/0 conn(0x7f66500af4e0 0x7f66500b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:24.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.012+0000 7f6658511700 1 -- 172.21.15.71:0/256119512 >> 172.21.15.71:0/256119512 conn(0x7f6650068680 msgr2=0x7f6650068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:24.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.012+0000 7f6658511700 1 -- 172.21.15.71:0/256119512 shutdown_connections 2023-10-06T01:41:24.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.012+0000 7f6658511700 1 -- 172.21.15.71:0/256119512 wait complete. 2023-10-06T01:41:24.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.013+0000 7f6658511700 1 Processor -- start 2023-10-06T01:41:24.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.013+0000 7f6658511700 1 -- start start 2023-10-06T01:41:24.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.013+0000 7f6658511700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66500af4e0 0x7f6650159770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:24.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.013+0000 7f6658511700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f66500af8b0 0x7f6650169830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:24.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.013+0000 7f6658511700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f665015db70 0x7f66500ce7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:24.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.013+0000 7f6658511700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66500a7cb0 con 0x7f665015db70 2023-10-06T01:41:24.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.013+0000 7f6658511700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6650159cb0 con 0x7f66500af4e0 2023-10-06T01:41:24.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.013+0000 7f6658511700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66500a70a0 con 0x7f66500af8b0 2023-10-06T01:41:24.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.013+0000 7f6656aae700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f665015db70 0x7f66500ce7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:24.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.013+0000 7f6656aae700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f665015db70 0x7f66500ce7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:53024/0 (socket says 172.21.15.71:53024) 2023-10-06T01:41:24.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.013+0000 7f6656aae700 1 -- 172.21.15.71:0/693262892 learned_addr learned my addr 172.21.15.71:0/693262892 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:24.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.014+0000 7f6656aae700 1 -- 172.21.15.71:0/693262892 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f66500af8b0 msgr2=0x7f6650169830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:24.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.014+0000 7f6656aae700 1 --2- 172.21.15.71:0/693262892 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f66500af8b0 0x7f6650169830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:24.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.014+0000 7f6656aae700 1 -- 172.21.15.71:0/693262892 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66500af4e0 msgr2=0x7f6650159770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:24.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.014+0000 7f66562ad700 1 --2- 172.21.15.71:0/693262892 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66500af4e0 0x7f6650159770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:24.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.014+0000 7f6656aae700 1 --2- 172.21.15.71:0/693262892 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66500af4e0 0x7f6650159770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:24.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.014+0000 7f6656aae700 1 -- 172.21.15.71:0/693262892 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6648009420 con 0x7f665015db70 2023-10-06T01:41:24.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.014+0000 7f6656aae700 1 --2- 172.21.15.71:0/693262892 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f665015db70 0x7f66500ce7d0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f6650089520 tx=0x7f6648017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:24.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.014+0000 7f66467fc700 1 -- 172.21.15.71:0/693262892 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6648025420 con 0x7f665015db70 2023-10-06T01:41:24.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.014+0000 7f66467fc700 1 -- 172.21.15.71:0/693262892 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6648025580 con 0x7f665015db70 2023-10-06T01:41:24.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.014+0000 7f6658511700 1 -- 172.21.15.71:0/693262892 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66500a7380 con 0x7f665015db70 2023-10-06T01:41:24.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.014+0000 7f66467fc700 1 -- 172.21.15.71:0/693262892 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6648025920 con 0x7f665015db70 2023-10-06T01:41:24.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.014+0000 7f6658511700 1 -- 172.21.15.71:0/693262892 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66500a7940 con 0x7f665015db70 2023-10-06T01:41:24.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.015+0000 7f6658511700 1 -- 172.21.15.71:0/693262892 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66500a7e60 con 0x7f665015db70 2023-10-06T01:41:24.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.015+0000 7f66467fc700 1 -- 172.21.15.71:0/693262892 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6648023070 con 0x7f665015db70 2023-10-06T01:41:24.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.016+0000 7f66467fc700 1 --2- 172.21.15.71:0/693262892 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f6634066f30 0x7f66340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:24.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.016+0000 7f66467fc700 1 -- 172.21.15.71:0/693262892 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f6648085bf0 con 0x7f665015db70 2023-10-06T01:41:24.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.016+0000 7f66562ad700 1 --2- 172.21.15.71:0/693262892 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f6634066f30 0x7f66340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:24.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.016+0000 7f66562ad700 1 --2- 172.21.15.71:0/693262892 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f6634066f30 0x7f66340693e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f664c00d380 tx=0x7f664c007500 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:24.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.020+0000 7f66467fc700 1 -- 172.21.15.71:0/693262892 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f66500a7e60 con 0x7f665015db70 2023-10-06T01:41:24.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.205+0000 7f6658511700 1 -- 172.21.15.71:0/693262892 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f66500a7df0 con 0x7f665015db70 2023-10-06T01:41:24.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.205+0000 7f66467fc700 1 -- 172.21.15.71:0/693262892 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v37) v1 ==== 84+0+126 (secure 0 0 0) 0x7f6648015090 con 0x7f665015db70 2023-10-06T01:41:24.206 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:41:24.206 INFO:teuthology.orchestra.run.smithi071.stdout:[ 2023-10-06T01:41:24.206 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-06T01:41:24.207 INFO:teuthology.orchestra.run.smithi071.stdout: "poolnum": 1, 2023-10-06T01:41:24.207 INFO:teuthology.orchestra.run.smithi071.stdout: "poolname": ".mgr" 2023-10-06T01:41:24.207 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-06T01:41:24.207 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-06T01:41:24.207 INFO:teuthology.orchestra.run.smithi071.stdout: "poolnum": 2, 2023-10-06T01:41:24.207 INFO:teuthology.orchestra.run.smithi071.stdout: "poolname": "rbd" 2023-10-06T01:41:24.207 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-06T01:41:24.207 INFO:teuthology.orchestra.run.smithi071.stdout:] 2023-10-06T01:41:24.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.207+0000 7f6658511700 1 -- 172.21.15.71:0/693262892 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f6634066f30 msgr2=0x7f66340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:24.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.207+0000 7f6658511700 1 --2- 172.21.15.71:0/693262892 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f6634066f30 0x7f66340693e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f664c00d380 tx=0x7f664c007500 comp rx=0 tx=0).stop 2023-10-06T01:41:24.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.207+0000 7f6658511700 1 -- 172.21.15.71:0/693262892 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f665015db70 msgr2=0x7f66500ce7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:24.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.207+0000 7f6658511700 1 --2- 172.21.15.71:0/693262892 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f665015db70 0x7f66500ce7d0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f6650089520 tx=0x7f6648017000 comp rx=0 tx=0).stop 2023-10-06T01:41:24.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.207+0000 7f6658511700 1 -- 172.21.15.71:0/693262892 shutdown_connections 2023-10-06T01:41:24.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.207+0000 7f6658511700 1 --2- 172.21.15.71:0/693262892 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f665015db70 0x7f66500ce7d0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:24.209 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.207+0000 7f6658511700 1 --2- 172.21.15.71:0/693262892 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f6634066f30 0x7f66340693e0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:24.209 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.207+0000 7f6658511700 1 --2- 172.21.15.71:0/693262892 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f66500af4e0 0x7f6650159770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:24.209 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.207+0000 7f6658511700 1 --2- 172.21.15.71:0/693262892 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f66500af8b0 0x7f6650169830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:24.209 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.207+0000 7f6658511700 1 -- 172.21.15.71:0/693262892 >> 172.21.15.71:0/693262892 conn(0x7f6650068680 msgr2=0x7f665015a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:24.209 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.207+0000 7f6658511700 1 -- 172.21.15.71:0/693262892 shutdown_connections 2023-10-06T01:41:24.209 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.207+0000 7f6658511700 1 -- 172.21.15.71:0/693262892 wait complete. 2023-10-06T01:41:24.219 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T01:41:24.219 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T01:41:24.338 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.337+0000 7fd9177f4700 1 Processor -- start 2023-10-06T01:41:24.338 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.337+0000 7fd9177f4700 1 -- start start 2023-10-06T01:41:24.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.338+0000 7fd9177f4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd910142df0 0x7fd9100cc350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:24.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.338+0000 7fd9177f4700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd91015a710 con 0x7fd9100d0970 2023-10-06T01:41:24.342 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.338+0000 7fd9177f4700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd910159b40 con 0x7fd9100cc890 2023-10-06T01:41:24.342 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.338+0000 7fd9177f4700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd910159de0 con 0x7fd910142df0 2023-10-06T01:41:24.342 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.338+0000 7fd915d91700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fd9100d0970 0x7fd910163060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:44854/0 (socket says 172.21.15.71:44854) 2023-10-06T01:41:24.342 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.338+0000 7fd915d91700 1 -- 172.21.15.71:0/286001077 learned_addr learned my addr 172.21.15.71:0/286001077 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:41:24.342 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.338+0000 7fd907fff700 1 -- 172.21.15.71:0/286001077 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2277745264 0 0) 0x7fd91015a710 con 0x7fd9100d0970 2023-10-06T01:41:24.342 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.338+0000 7fd915590700 1 --2- 172.21.15.71:0/286001077 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd910142df0 0x7fd9100cc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:24.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.338+0000 7fd907fff700 1 -- 172.21.15.71:0/286001077 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8fc003570 con 0x7fd9100d0970 2023-10-06T01:41:24.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.338+0000 7fd907fff700 1 -- 172.21.15.71:0/286001077 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2949663990 0 0) 0x7fd8fc003570 con 0x7fd9100d0970 2023-10-06T01:41:24.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.338+0000 7fd907fff700 1 -- 172.21.15.71:0/286001077 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd910142df0 msgr2=0x7fd9100cc350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:24.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.338+0000 7fd907fff700 1 --2- 172.21.15.71:0/286001077 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd910142df0 0x7fd9100cc350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:24.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.338+0000 7fd907fff700 1 -- 172.21.15.71:0/286001077 >> v1:172.21.15.72:6789/0 conn(0x7fd9100cc890 legacy=0x7fd9100d0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:24.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.338+0000 7fd907fff700 1 -- 172.21.15.71:0/286001077 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd91015a0c0 con 0x7fd9100d0970 2023-10-06T01:41:24.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.338+0000 7fd907fff700 1 -- 172.21.15.71:0/286001077 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1184243524 0 0) 0x7fd9080017f0 con 0x7fd9100d0970 2023-10-06T01:41:24.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.338+0000 7fd907fff700 1 -- 172.21.15.71:0/286001077 >> v1:172.21.15.71:6789/0 conn(0x7fd9100d0970 legacy=0x7fd910163060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:24.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.338+0000 7fd907fff700 1 --2- 172.21.15.71:0/286001077 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd8fc003a90 0x7fd8fc003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:24.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.338+0000 7fd907fff700 1 --2- 172.21.15.71:0/286001077 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd8fc004810 0x7fd8fc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:24.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.338+0000 7fd907fff700 1 --2- 172.21.15.71:0/286001077 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd910142df0 0x7fd8fc0051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:24.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.338+0000 7fd907fff700 1 -- 172.21.15.71:0/286001077 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd910159de0 con 0x7fd8fc004810 2023-10-06T01:41:24.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.338+0000 7fd907fff700 1 -- 172.21.15.71:0/286001077 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8fc00bb60 con 0x7fd8fc003a90 2023-10-06T01:41:24.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.338+0000 7fd907fff700 1 -- 172.21.15.71:0/286001077 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8fc00bd20 con 0x7fd910142df0 2023-10-06T01:41:24.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.339+0000 7fd915590700 1 --2- 172.21.15.71:0/286001077 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd8fc003a90 0x7fd8fc003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:24.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.339+0000 7fd914d8f700 1 --2- 172.21.15.71:0/286001077 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd8fc004810 0x7fd8fc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:24.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.339+0000 7fd915d91700 1 --2- 172.21.15.71:0/286001077 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd910142df0 0x7fd8fc0051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:24.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.339+0000 7fd914d8f700 1 -- 172.21.15.71:0/286001077 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd910142df0 msgr2=0x7fd8fc0051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:24.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.339+0000 7fd914d8f700 1 --2- 172.21.15.71:0/286001077 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd910142df0 0x7fd8fc0051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:24.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.339+0000 7fd914d8f700 1 -- 172.21.15.71:0/286001077 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd8fc003a90 msgr2=0x7fd8fc003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:24.346 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.339+0000 7fd914d8f700 1 --2- 172.21.15.71:0/286001077 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd8fc003a90 0x7fd8fc003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:24.346 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.339+0000 7fd914d8f700 1 -- 172.21.15.71:0/286001077 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8fc003570 con 0x7fd8fc004810 2023-10-06T01:41:24.346 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.339+0000 7fd915590700 1 --2- 172.21.15.71:0/286001077 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd8fc003a90 0x7fd8fc003ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:41:24.346 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.339+0000 7fd914d8f700 1 --2- 172.21.15.71:0/286001077 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd8fc004810 0x7fd8fc004c80 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fd900001880 tx=0x7fd900007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19a1002d4ba1b198 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:24.346 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.339+0000 7fd907fff700 1 -- 172.21.15.71:0/286001077 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd900012420 con 0x7fd8fc004810 2023-10-06T01:41:24.346 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.339+0000 7fd907fff700 1 -- 172.21.15.71:0/286001077 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd900012580 con 0x7fd8fc004810 2023-10-06T01:41:24.347 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.339+0000 7fd907fff700 1 -- 172.21.15.71:0/286001077 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd900012920 con 0x7fd8fc004810 2023-10-06T01:41:24.347 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.340+0000 7fd9177f4700 1 -- 172.21.15.71:0/286001077 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd8fc004810 msgr2=0x7fd8fc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:24.347 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.340+0000 7fd9177f4700 1 --2- 172.21.15.71:0/286001077 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd8fc004810 0x7fd8fc004c80 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fd900001880 tx=0x7fd900007d30 comp rx=0 tx=0).stop 2023-10-06T01:41:24.347 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.340+0000 7fd915d91700 1 -- 172.21.15.71:0/286001077 reap_dead start 2023-10-06T01:41:24.347 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.340+0000 7fd9177f4700 1 -- 172.21.15.71:0/286001077 shutdown_connections 2023-10-06T01:41:24.347 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.340+0000 7fd9177f4700 1 -- 172.21.15.71:0/286001077 >> 172.21.15.71:0/286001077 conn(0x7fd9100690f0 msgr2=0x7fd91006a340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:24.347 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.340+0000 7fd9177f4700 1 -- 172.21.15.71:0/286001077 shutdown_connections 2023-10-06T01:41:24.348 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.340+0000 7fd9177f4700 1 -- 172.21.15.71:0/286001077 wait complete. 2023-10-06T01:41:24.348 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.341+0000 7fd9177f4700 1 Processor -- start 2023-10-06T01:41:24.348 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.341+0000 7fd9177f4700 1 -- start start 2023-10-06T01:41:24.350 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.342+0000 7fd9177f4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd8fc004810 0x7fd9100afd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:24.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.342+0000 7fd9177f4700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd9100cb510 0x7fd910141d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:24.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.342+0000 7fd9177f4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd910169a90 0x7fd9100b22e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:24.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.342+0000 7fd9177f4700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd910154450 con 0x7fd9100cb510 2023-10-06T01:41:24.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.342+0000 7fd9177f4700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd910142290 con 0x7fd910169a90 2023-10-06T01:41:24.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.342+0000 7fd9177f4700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd91016a350 con 0x7fd8fc004810 2023-10-06T01:41:24.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.342+0000 7fd914d8f700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd9100cb510 0x7fd910141d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:24.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.342+0000 7fd914d8f700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd9100cb510 0x7fd910141d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:53046/0 (socket says 172.21.15.71:53046) 2023-10-06T01:41:24.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.342+0000 7fd914d8f700 1 -- 172.21.15.71:0/2483961914 learned_addr learned my addr 172.21.15.71:0/2483961914 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:24.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.342+0000 7fd915590700 1 --2- 172.21.15.71:0/2483961914 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd8fc004810 0x7fd9100afd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:24.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.342+0000 7fd915d91700 1 --2- 172.21.15.71:0/2483961914 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd910169a90 0x7fd9100b22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:24.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.342+0000 7fd914d8f700 1 -- 172.21.15.71:0/2483961914 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd8fc004810 msgr2=0x7fd9100afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:24.353 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.342+0000 7fd914d8f700 1 --2- 172.21.15.71:0/2483961914 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd8fc004810 0x7fd9100afd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:24.353 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.342+0000 7fd914d8f700 1 -- 172.21.15.71:0/2483961914 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd910169a90 msgr2=0x7fd9100b22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:24.353 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.342+0000 7fd914d8f700 1 --2- 172.21.15.71:0/2483961914 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd910169a90 0x7fd9100b22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:24.353 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.342+0000 7fd914d8f700 1 -- 172.21.15.71:0/2483961914 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd91016a630 con 0x7fd9100cb510 2023-10-06T01:41:24.353 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.342+0000 7fd915d91700 1 --2- 172.21.15.71:0/2483961914 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd910169a90 0x7fd9100b22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:41:24.353 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.342+0000 7fd914d8f700 1 --2- 172.21.15.71:0/2483961914 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd9100cb510 0x7fd910141d50 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc00bb30 tx=0x7fd900015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:24.353 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.342+0000 7fd9057fa700 1 -- 172.21.15.71:0/2483961914 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd900001200 con 0x7fd9100cb510 2023-10-06T01:41:24.354 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.342+0000 7fd9057fa700 1 -- 172.21.15.71:0/2483961914 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd900000c30 con 0x7fd9100cb510 2023-10-06T01:41:24.354 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.342+0000 7fd9177f4700 1 -- 172.21.15.71:0/2483961914 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd91016a910 con 0x7fd9100cb510 2023-10-06T01:41:24.354 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.342+0000 7fd9057fa700 1 -- 172.21.15.71:0/2483961914 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9000126f0 con 0x7fd9100cb510 2023-10-06T01:41:24.354 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.342+0000 7fd9177f4700 1 -- 172.21.15.71:0/2483961914 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd910169f00 con 0x7fd9100cb510 2023-10-06T01:41:24.354 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.343+0000 7fd9177f4700 1 -- 172.21.15.71:0/2483961914 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd91016a120 con 0x7fd9100cb510 2023-10-06T01:41:24.354 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.344+0000 7fd9057fa700 1 -- 172.21.15.71:0/2483961914 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd900019030 con 0x7fd9100cb510 2023-10-06T01:41:24.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.344+0000 7fd9057fa700 1 --2- 172.21.15.71:0/2483961914 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fd8f4066f30 0x7fd8f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:24.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.344+0000 7fd9057fa700 1 -- 172.21.15.71:0/2483961914 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5526+0+0 (secure 0 0 0) 0x7fd900085890 con 0x7fd9100cb510 2023-10-06T01:41:24.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.344+0000 7fd915590700 1 --2- 172.21.15.71:0/2483961914 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fd8f4066f30 0x7fd8f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:24.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.344+0000 7fd915590700 1 --2- 172.21.15.71:0/2483961914 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fd8f4066f30 0x7fd8f40693e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd9100ce6d0 tx=0x7fd90c0091a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:24.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.348+0000 7fd9057fa700 1 -- 172.21.15.71:0/2483961914 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd900052bb0 con 0x7fd9100cb510 2023-10-06T01:41:24.544 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:24.543+0000 7fd9177f4700 1 -- 172.21.15.71:0/2483961914 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fd9101542a0 con 0x7fd9100cb510 2023-10-06T01:41:25.096 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:25.096+0000 7fd9057fa700 1 -- 172.21.15.71:0/2483961914 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v38) v1 ==== 138+0+0 (secure 0 0 0) 0x7fd90002b020 con 0x7fd9100cb510 2023-10-06T01:41:25.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:25.099+0000 7fd9177f4700 1 -- 172.21.15.71:0/2483961914 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fd8f4066f30 msgr2=0x7fd8f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:25.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:25.099+0000 7fd9177f4700 1 --2- 172.21.15.71:0/2483961914 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fd8f4066f30 0x7fd8f40693e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd9100ce6d0 tx=0x7fd90c0091a0 comp rx=0 tx=0).stop 2023-10-06T01:41:25.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:25.099+0000 7fd9177f4700 1 -- 172.21.15.71:0/2483961914 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd9100cb510 msgr2=0x7fd910141d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:25.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:25.099+0000 7fd9177f4700 1 --2- 172.21.15.71:0/2483961914 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd9100cb510 0x7fd910141d50 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc00bb30 tx=0x7fd900015000 comp rx=0 tx=0).stop 2023-10-06T01:41:25.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:25.099+0000 7fd9177f4700 1 -- 172.21.15.71:0/2483961914 shutdown_connections 2023-10-06T01:41:25.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:25.099+0000 7fd9177f4700 1 --2- 172.21.15.71:0/2483961914 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fd8f4066f30 0x7fd8f40693e0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:25.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:25.099+0000 7fd9177f4700 1 --2- 172.21.15.71:0/2483961914 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd910169a90 0x7fd9100b22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:25.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:25.099+0000 7fd9177f4700 1 --2- 172.21.15.71:0/2483961914 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd8fc004810 0x7fd9100afd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:25.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:25.099+0000 7fd9177f4700 1 --2- 172.21.15.71:0/2483961914 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd9100cb510 0x7fd910141d50 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:25.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:25.099+0000 7fd9177f4700 1 -- 172.21.15.71:0/2483961914 >> 172.21.15.71:0/2483961914 conn(0x7fd9100690f0 msgr2=0x7fd9100af210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:25.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:25.099+0000 7fd9177f4700 1 -- 172.21.15.71:0/2483961914 shutdown_connections 2023-10-06T01:41:25.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:25.099+0000 7fd9177f4700 1 -- 172.21.15.71:0/2483961914 wait complete. 2023-10-06T01:41:25.101 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'cephfs_metadata' created 2023-10-06T01:41:25.113 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T01:41:25.234 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:25.233+0000 7f772f0d2700 1 Processor -- start 2023-10-06T01:41:25.234 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:25.233+0000 7f772f0d2700 1 -- start start 2023-10-06T01:41:25.236 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:25.234+0000 7f772f0d2700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7728087240 0x7f77280cde70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:25.236 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:25.234+0000 7f772f0d2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7728087610 0x7f77280ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:25.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:25.234+0000 7f772f0d2700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f7728158e20 0x7f7728159270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:25.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:25.234+0000 7f772f0d2700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77280ce8f0 con 0x7f7728158e20 2023-10-06T01:41:25.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:25.234+0000 7f772f0d2700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77280cf740 con 0x7f7728087240 2023-10-06T01:41:25.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:25.234+0000 7f772f0d2700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77280ceb30 con 0x7f7728087610 2023-10-06T01:41:25.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:25.234+0000 7f772d66f700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f7728158e20 0x7f7728159270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:25.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:25.234+0000 7f772d66f700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f7728158e20 0x7f7728159270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:53054/0 (socket says 172.21.15.71:53054) 2023-10-06T01:41:25.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:25.234+0000 7f772d66f700 1 -- 172.21.15.71:0/336914626 learned_addr learned my addr 172.21.15.71:0/336914626 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:25.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:25.234+0000 7f772ce6e700 1 --2- 172.21.15.71:0/336914626 >> v2:172.21.15.72:3300/0 conn(0x7f7728087240 0x7f77280cde70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:25.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:25.234+0000 7f771ffff700 1 --2- 172.21.15.71:0/336914626 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7728087610 0x7f77280ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:25.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:25.234+0000 7f772d66f700 1 -- 172.21.15.71:0/336914626 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7728087610 msgr2=0x7f77280ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:25.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:25.234+0000 7f772d66f700 1 --2- 172.21.15.71:0/336914626 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7728087610 0x7f77280ce3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:25.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:25.234+0000 7f772d66f700 1 -- 172.21.15.71:0/336914626 >> v2:172.21.15.72:3300/0 conn(0x7f7728087240 msgr2=0x7f77280cde70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:25.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:25.234+0000 7f772d66f700 1 --2- 172.21.15.71:0/336914626 >> v2:172.21.15.72:3300/0 conn(0x7f7728087240 0x7f77280cde70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:25.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:25.234+0000 7f772d66f700 1 -- 172.21.15.71:0/336914626 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77280cee10 con 0x7f7728158e20 2023-10-06T01:41:25.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:25.234+0000 7f771ffff700 1 --2- 172.21.15.71:0/336914626 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7728087610 0x7f77280ce3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:41:25.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:25.235+0000 7f772d66f700 1 --2- 172.21.15.71:0/336914626 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7728158e20 0x7f7728159270 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f77280895a0 tx=0x7f7720009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5178a7f2cad33f69 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:25.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:25.235+0000 7f771f7fe700 1 -- 172.21.15.71:0/336914626 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7720009e70 con 0x7f7728158e20 2023-10-06T01:41:25.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:25.235+0000 7f771f7fe700 1 -- 172.21.15.71:0/336914626 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f772000b860 con 0x7f7728158e20 2023-10-06T01:41:25.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:25.235+0000 7f771f7fe700 1 -- 172.21.15.71:0/336914626 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f772000bc00 con 0x7f7728158e20 2023-10-06T01:41:25.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:25.235+0000 7f772f0d2700 1 -- 172.21.15.71:0/336914626 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7728158e20 msgr2=0x7f7728159270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:25.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:25.235+0000 7f772f0d2700 1 --2- 172.21.15.71:0/336914626 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7728158e20 0x7f7728159270 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f77280895a0 tx=0x7f7720009250 comp rx=0 tx=0).stop 2023-10-06T01:41:25.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:25.235+0000 7f772f0d2700 1 -- 172.21.15.71:0/336914626 shutdown_connections 2023-10-06T01:41:25.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:25.235+0000 7f772f0d2700 1 --2- 172.21.15.71:0/336914626 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7728158e20 0x7f7728159270 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:25.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:25.235+0000 7f772f0d2700 1 --2- 172.21.15.71:0/336914626 >> v2:172.21.15.72:3300/0 conn(0x7f7728087240 0x7f77280cde70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:25.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:25.235+0000 7f772f0d2700 1 --2- 172.21.15.71:0/336914626 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7728087610 0x7f77280ce3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:25.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:25.235+0000 7f772f0d2700 1 -- 172.21.15.71:0/336914626 >> 172.21.15.71:0/336914626 conn(0x7f7728069150 msgr2=0x7f77280d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:25.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:25.235+0000 7f772f0d2700 1 -- 172.21.15.71:0/336914626 shutdown_connections 2023-10-06T01:41:25.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:25.235+0000 7f772f0d2700 1 -- 172.21.15.71:0/336914626 wait complete. 2023-10-06T01:41:25.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:25.236+0000 7f772f0d2700 1 Processor -- start 2023-10-06T01:41:25.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:25.237+0000 7f772f0d2700 1 -- start start 2023-10-06T01:41:25.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:25.237+0000 7f772f0d2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7728087240 0x7f7728147c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:25.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:25.237+0000 7f772f0d2700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7728087610 0x7f7728154990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:25.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:25.237+0000 7f772f0d2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7728158e20 0x7f7728151400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:25.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:25.237+0000 7f772f0d2700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7728155ff0 con 0x7f7728087610 2023-10-06T01:41:25.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:25.237+0000 7f772f0d2700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77281553e0 con 0x7f7728087240 2023-10-06T01:41:25.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:25.237+0000 7f772f0d2700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77281556c0 con 0x7f7728158e20 2023-10-06T01:41:25.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:25.237+0000 7f771ffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7728087610 0x7f7728154990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:25.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:25.237+0000 7f771ffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7728087610 0x7f7728154990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:53060/0 (socket says 172.21.15.71:53060) 2023-10-06T01:41:25.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:25.237+0000 7f771ffff700 1 -- 172.21.15.71:0/2141722349 learned_addr learned my addr 172.21.15.71:0/2141722349 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:25.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:25.238+0000 7f772d66f700 1 --2- 172.21.15.71:0/2141722349 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7728158e20 0x7f7728151400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:25.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:25.238+0000 7f772ce6e700 1 --2- 172.21.15.71:0/2141722349 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7728087240 0x7f7728147c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:25.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:25.238+0000 7f771ffff700 1 -- 172.21.15.71:0/2141722349 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7728158e20 msgr2=0x7f7728151400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:25.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:25.238+0000 7f771ffff700 1 --2- 172.21.15.71:0/2141722349 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7728158e20 0x7f7728151400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:25.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:25.238+0000 7f771ffff700 1 -- 172.21.15.71:0/2141722349 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7728087240 msgr2=0x7f7728147c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:25.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:25.238+0000 7f771ffff700 1 --2- 172.21.15.71:0/2141722349 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7728087240 0x7f7728147c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:25.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:25.238+0000 7f771ffff700 1 -- 172.21.15.71:0/2141722349 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77200094f0 con 0x7f7728087610 2023-10-06T01:41:25.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:25.238+0000 7f771ffff700 1 --2- 172.21.15.71:0/2141722349 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7728087610 0x7f7728154990 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f771800e8d0 tx=0x7f7718008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:25.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:25.238+0000 7f771cff9700 1 -- 172.21.15.71:0/2141722349 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f771800ee70 con 0x7f7728087610 2023-10-06T01:41:25.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:25.238+0000 7f771cff9700 1 -- 172.21.15.71:0/2141722349 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f771800c5e0 con 0x7f7728087610 2023-10-06T01:41:25.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:25.238+0000 7f772f0d2700 1 -- 172.21.15.71:0/2141722349 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77281559a0 con 0x7f7728087610 2023-10-06T01:41:25.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:25.238+0000 7f771cff9700 1 -- 172.21.15.71:0/2141722349 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f771800c980 con 0x7f7728087610 2023-10-06T01:41:25.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:25.238+0000 7f772f0d2700 1 -- 172.21.15.71:0/2141722349 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77281481c0 con 0x7f7728087610 2023-10-06T01:41:25.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:25.239+0000 7f772f0d2700 1 -- 172.21.15.71:0/2141722349 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77280889e0 con 0x7f7728087610 2023-10-06T01:41:25.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:25.239+0000 7f771cff9700 1 -- 172.21.15.71:0/2141722349 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7718013410 con 0x7f7728087610 2023-10-06T01:41:25.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:25.240+0000 7f771cff9700 1 --2- 172.21.15.71:0/2141722349 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7714066f30 0x7f77140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:25.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:25.240+0000 7f771cff9700 1 -- 172.21.15.71:0/2141722349 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5896+0+0 (secure 0 0 0) 0x7f7718084400 con 0x7f7728087610 2023-10-06T01:41:25.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:25.240+0000 7f772ce6e700 1 --2- 172.21.15.71:0/2141722349 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7714066f30 0x7f77140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:25.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:25.240+0000 7f772ce6e700 1 --2- 172.21.15.71:0/2141722349 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7714066f30 0x7f77140693e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f77240076a0 tx=0x7f772400b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:25.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:25.244+0000 7f771cff9700 1 -- 172.21.15.71:0/2141722349 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f77180515b0 con 0x7f7728087610 2023-10-06T01:41:25.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:25.427+0000 7f772f0d2700 1 -- 172.21.15.71:0/2141722349 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f77280cf0f0 con 0x7f7728087610 2023-10-06T01:41:26.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:26.096+0000 7f771cff9700 1 -- 172.21.15.71:0/2141722349 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v39) v1 ==== 170+0+0 (secure 0 0 0) 0x7f7718054bd0 con 0x7f7728087610 2023-10-06T01:41:26.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:26.099+0000 7f772f0d2700 1 -- 172.21.15.71:0/2141722349 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7714066f30 msgr2=0x7f77140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:26.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:26.099+0000 7f772f0d2700 1 --2- 172.21.15.71:0/2141722349 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7714066f30 0x7f77140693e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f77240076a0 tx=0x7f772400b040 comp rx=0 tx=0).stop 2023-10-06T01:41:26.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:26.099+0000 7f772f0d2700 1 -- 172.21.15.71:0/2141722349 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7728087610 msgr2=0x7f7728154990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:26.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:26.099+0000 7f772f0d2700 1 --2- 172.21.15.71:0/2141722349 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7728087610 0x7f7728154990 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f771800e8d0 tx=0x7f7718008040 comp rx=0 tx=0).stop 2023-10-06T01:41:26.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:26.099+0000 7f772f0d2700 1 -- 172.21.15.71:0/2141722349 shutdown_connections 2023-10-06T01:41:26.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:26.099+0000 7f772f0d2700 1 --2- 172.21.15.71:0/2141722349 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7728158e20 0x7f7728151400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:26.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:26.099+0000 7f772f0d2700 1 --2- 172.21.15.71:0/2141722349 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7714066f30 0x7f77140693e0 secure :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f77240076a0 tx=0x7f772400b040 comp rx=0 tx=0).stop 2023-10-06T01:41:26.102 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:26.099+0000 7f772f0d2700 1 --2- 172.21.15.71:0/2141722349 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7728087240 0x7f7728147c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:26.102 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:26.099+0000 7f772f0d2700 1 --2- 172.21.15.71:0/2141722349 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7728087610 0x7f7728154990 secure :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f771800e8d0 tx=0x7f7718008040 comp rx=0 tx=0).stop 2023-10-06T01:41:26.102 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:26.099+0000 7f772f0d2700 1 -- 172.21.15.71:0/2141722349 >> 172.21.15.71:0/2141722349 conn(0x7f7728069150 msgr2=0x7f77280c5160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:26.102 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:26.100+0000 7f772f0d2700 1 -- 172.21.15.71:0/2141722349 shutdown_connections 2023-10-06T01:41:26.102 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:26.101+0000 7f772f0d2700 1 -- 172.21.15.71:0/2141722349 wait complete. 2023-10-06T01:41:26.103 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'cephfs_data' created 2023-10-06T01:41:26.121 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T01:41:26.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:26.236+0000 7fefbffbd700 1 Processor -- start 2023-10-06T01:41:26.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:26.236+0000 7fefbffbd700 1 -- start start 2023-10-06T01:41:26.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:26.237+0000 7fefbffbd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fefb80d0400 0x7fefb80b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:26.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:26.237+0000 7fefbffbd700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefb80b6170 con 0x7fefb80d07d0 2023-10-06T01:41:26.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:26.237+0000 7fefbffbd700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefb815dd40 con 0x7fefb80ccd40 2023-10-06T01:41:26.239 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:26.237+0000 7fefbffbd700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefb815e020 con 0x7fefb80d0400 2023-10-06T01:41:26.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:26.237+0000 7fefbe55a700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fefb80d07d0 0x7fefb80b3aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:44866/0 (socket says 172.21.15.71:44866) 2023-10-06T01:41:26.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:26.237+0000 7fefbe55a700 1 -- 172.21.15.71:0/3214415384 learned_addr learned my addr 172.21.15.71:0/3214415384 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:41:26.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:26.237+0000 7fefbdd59700 1 --2- 172.21.15.71:0/3214415384 >> v2:172.21.15.72:3300/0 conn(0x7fefb80d0400 0x7fefb80b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:26.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:26.237+0000 7fefbcd57700 1 -- 172.21.15.71:0/3214415384 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3641303796 0 0) 0x7fefb80b6170 con 0x7fefb80d07d0 2023-10-06T01:41:26.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:26.237+0000 7fefbcd57700 1 -- 172.21.15.71:0/3214415384 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fefa4003570 con 0x7fefb80d07d0 2023-10-06T01:41:26.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:26.238+0000 7fefbdd59700 1 -- 172.21.15.71:0/3214415384 >> v1:172.21.15.72:6789/0 conn(0x7fefb80ccd40 legacy=0x7fefb80cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:26.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:26.238+0000 7fefbdd59700 1 -- 172.21.15.71:0/3214415384 >> v1:172.21.15.71:6789/0 conn(0x7fefb80d07d0 legacy=0x7fefb80b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:26.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:26.238+0000 7fefbcd57700 1 -- 172.21.15.71:0/3214415384 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3050930369 0 0) 0x7fefa4003570 con 0x7fefb80d07d0 2023-10-06T01:41:26.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:26.238+0000 7fefbdd59700 1 -- 172.21.15.71:0/3214415384 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefb80ceaa0 con 0x7fefb80d0400 2023-10-06T01:41:26.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:26.238+0000 7fefbdd59700 1 --2- 172.21.15.71:0/3214415384 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fefb80d0400 0x7fefb80b5c30 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fefb40098d0 tx=0x7fefb4009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2ed2ed0b7879234 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:26.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:26.238+0000 7fefbcd57700 1 -- 172.21.15.71:0/3214415384 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb00017f0 con 0x7fefb80d0400 2023-10-06T01:41:26.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:26.238+0000 7fefbcd57700 1 -- 172.21.15.71:0/3214415384 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefb4011420 con 0x7fefb80d0400 2023-10-06T01:41:26.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:26.238+0000 7fefbcd57700 1 -- 172.21.15.71:0/3214415384 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb40117c0 con 0x7fefb80d0400 2023-10-06T01:41:26.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:26.238+0000 7fefbffbd700 1 -- 172.21.15.71:0/3214415384 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fefb80d0400 msgr2=0x7fefb80b5c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:26.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:26.238+0000 7fefbffbd700 1 --2- 172.21.15.71:0/3214415384 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fefb80d0400 0x7fefb80b5c30 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fefb40098d0 tx=0x7fefb4009120 comp rx=0 tx=0).stop 2023-10-06T01:41:26.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:26.238+0000 7fefbffbd700 1 -- 172.21.15.71:0/3214415384 shutdown_connections 2023-10-06T01:41:26.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:26.238+0000 7fefbffbd700 1 --2- 172.21.15.71:0/3214415384 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fefb80d0400 0x7fefb80b5c30 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:26.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:26.239+0000 7fefbffbd700 1 -- 172.21.15.71:0/3214415384 >> 172.21.15.71:0/3214415384 conn(0x7fefb806a220 msgr2=0x7fefb806a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:26.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:26.239+0000 7fefbffbd700 1 -- 172.21.15.71:0/3214415384 shutdown_connections 2023-10-06T01:41:26.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:26.239+0000 7fefbffbd700 1 -- 172.21.15.71:0/3214415384 wait complete. 2023-10-06T01:41:26.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:26.240+0000 7fefbffbd700 1 Processor -- start 2023-10-06T01:41:26.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:26.240+0000 7fefbffbd700 1 -- start start 2023-10-06T01:41:26.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:26.240+0000 7fefbffbd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fefb80ccd40 0x7fefb81699c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:26.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:26.240+0000 7fefbffbd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fefb80d0400 0x7fefb80c8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:26.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:26.240+0000 7fefbffbd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fefb80d07d0 0x7fefb80c8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:26.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:26.240+0000 7fefbffbd700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefb815bf50 con 0x7fefb80d07d0 2023-10-06T01:41:26.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:26.240+0000 7fefbffbd700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefb80cb5b0 con 0x7fefb80ccd40 2023-10-06T01:41:26.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:26.240+0000 7fefbffbd700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefb80cb890 con 0x7fefb80d0400 2023-10-06T01:41:26.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:26.240+0000 7fefbe55a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fefb80d07d0 0x7fefb80c8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:26.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:26.241+0000 7fefbe55a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fefb80d07d0 0x7fefb80c8ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:53068/0 (socket says 172.21.15.71:53068) 2023-10-06T01:41:26.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:26.241+0000 7fefbe55a700 1 -- 172.21.15.71:0/3402329018 learned_addr learned my addr 172.21.15.71:0/3402329018 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:26.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:26.241+0000 7fefbdd59700 1 --2- 172.21.15.71:0/3402329018 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fefb80ccd40 0x7fefb81699c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:26.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:26.241+0000 7fefbd558700 1 --2- 172.21.15.71:0/3402329018 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fefb80d0400 0x7fefb80c8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:26.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:26.241+0000 7fefbe55a700 1 -- 172.21.15.71:0/3402329018 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fefb80d0400 msgr2=0x7fefb80c8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:26.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:26.241+0000 7fefbe55a700 1 --2- 172.21.15.71:0/3402329018 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fefb80d0400 0x7fefb80c8580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:26.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:26.241+0000 7fefbe55a700 1 -- 172.21.15.71:0/3402329018 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fefb80ccd40 msgr2=0x7fefb81699c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:26.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:26.241+0000 7fefbe55a700 1 --2- 172.21.15.71:0/3402329018 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fefb80ccd40 0x7fefb81699c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:26.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:26.241+0000 7fefbe55a700 1 -- 172.21.15.71:0/3402329018 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefb40093c0 con 0x7fefb80d07d0 2023-10-06T01:41:26.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:26.241+0000 7fefbdd59700 1 --2- 172.21.15.71:0/3402329018 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fefb80ccd40 0x7fefb81699c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:41:26.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:26.241+0000 7fefbe55a700 1 --2- 172.21.15.71:0/3402329018 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fefb80d07d0 0x7fefb80c8ac0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fefb000cae0 tx=0x7fefb0007ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:26.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:26.241+0000 7fefadffb700 1 -- 172.21.15.71:0/3402329018 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb0004dc0 con 0x7fefb80d07d0 2023-10-06T01:41:26.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:26.241+0000 7fefadffb700 1 -- 172.21.15.71:0/3402329018 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefb000a6a0 con 0x7fefb80d07d0 2023-10-06T01:41:26.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:26.241+0000 7fefbffbd700 1 -- 172.21.15.71:0/3402329018 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefb80cbb70 con 0x7fefb80d07d0 2023-10-06T01:41:26.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:26.241+0000 7fefadffb700 1 -- 172.21.15.71:0/3402329018 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb000aa60 con 0x7fefb80d07d0 2023-10-06T01:41:26.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:26.241+0000 7fefbffbd700 1 -- 172.21.15.71:0/3402329018 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefb80ca880 con 0x7fefb80d07d0 2023-10-06T01:41:26.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:26.242+0000 7fefbffbd700 1 -- 172.21.15.71:0/3402329018 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefb8088760 con 0x7fefb80d07d0 2023-10-06T01:41:26.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:26.243+0000 7fefadffb700 1 -- 172.21.15.71:0/3402329018 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fefb0007150 con 0x7fefb80d07d0 2023-10-06T01:41:26.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:26.243+0000 7fefadffb700 1 --2- 172.21.15.71:0/3402329018 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fef9c066f30 0x7fef9c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:26.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:26.243+0000 7fefadffb700 1 -- 172.21.15.71:0/3402329018 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6278+0+0 (secure 0 0 0) 0x7fefb0084310 con 0x7fefb80d07d0 2023-10-06T01:41:26.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:26.243+0000 7fefbdd59700 1 --2- 172.21.15.71:0/3402329018 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fef9c066f30 0x7fef9c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:26.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:26.243+0000 7fefbdd59700 1 --2- 172.21.15.71:0/3402329018 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fef9c066f30 0x7fef9c0693e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fefb4003080 tx=0x7fefb4016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:26.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:26.247+0000 7fefadffb700 1 -- 172.21.15.71:0/3402329018 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fefb0051340 con 0x7fefb80d07d0 2023-10-06T01:41:26.473 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:26.472+0000 7fefbffbd700 1 -- 172.21.15.71:0/3402329018 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fefb815c090 con 0x7fefb80d07d0 2023-10-06T01:41:27.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.119+0000 7fefadffb700 1 -- 172.21.15.71:0/3402329018 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v14) v1 ==== 172+0+0 (secure 0 0 0) 0x7fefb0054960 con 0x7fefb80d07d0 2023-10-06T01:41:27.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.123+0000 7fefbffbd700 1 -- 172.21.15.71:0/3402329018 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fef9c066f30 msgr2=0x7fef9c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:27.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.123+0000 7fefbffbd700 1 --2- 172.21.15.71:0/3402329018 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fef9c066f30 0x7fef9c0693e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fefb4003080 tx=0x7fefb4016000 comp rx=0 tx=0).stop 2023-10-06T01:41:27.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.123+0000 7fefbffbd700 1 -- 172.21.15.71:0/3402329018 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fefb80d07d0 msgr2=0x7fefb80c8ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:27.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.123+0000 7fefbffbd700 1 --2- 172.21.15.71:0/3402329018 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fefb80d07d0 0x7fefb80c8ac0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fefb000cae0 tx=0x7fefb0007ca0 comp rx=0 tx=0).stop 2023-10-06T01:41:27.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.123+0000 7fefbffbd700 1 -- 172.21.15.71:0/3402329018 shutdown_connections 2023-10-06T01:41:27.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.123+0000 7fefbffbd700 1 --2- 172.21.15.71:0/3402329018 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fefb80d07d0 0x7fefb80c8ac0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:27.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.123+0000 7fefbffbd700 1 --2- 172.21.15.71:0/3402329018 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fef9c066f30 0x7fef9c0693e0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:27.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.123+0000 7fefbffbd700 1 --2- 172.21.15.71:0/3402329018 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fefb80ccd40 0x7fefb81699c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:27.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.123+0000 7fefbffbd700 1 --2- 172.21.15.71:0/3402329018 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fefb80d0400 0x7fefb80c8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:27.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.123+0000 7fefbffbd700 1 -- 172.21.15.71:0/3402329018 >> 172.21.15.71:0/3402329018 conn(0x7fefb806a220 msgr2=0x7fefb80b2340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:27.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.123+0000 7fefbffbd700 1 -- 172.21.15.71:0/3402329018 shutdown_connections 2023-10-06T01:41:27.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.123+0000 7fefbffbd700 1 -- 172.21.15.71:0/3402329018 wait complete. 2023-10-06T01:41:27.125 INFO:teuthology.orchestra.run.smithi071.stderr:new fs with metadata pool 6 and data pool 7 2023-10-06T01:41:27.139 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:41:27.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.253+0000 7f13bd34e700 1 Processor -- start 2023-10-06T01:41:27.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.254+0000 7f13bd34e700 1 -- start start 2023-10-06T01:41:27.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.254+0000 7f13bd34e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f13b80cd6e0 0x7f13b813f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:27.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.254+0000 7f13bd34e700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13b80ca3e0 con 0x7f13b80c78d0 2023-10-06T01:41:27.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.254+0000 7f13bd34e700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13b80c97d0 con 0x7f13b80c7ca0 2023-10-06T01:41:27.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.254+0000 7f13bd34e700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13b80c95c0 con 0x7f13b80cd6e0 2023-10-06T01:41:27.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.254+0000 7f13b6ffd700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f13b80c78d0 0x7f13b80ccfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:44872/0 (socket says 172.21.15.71:44872) 2023-10-06T01:41:27.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.254+0000 7f13b6ffd700 1 -- 172.21.15.71:0/349915460 learned_addr learned my addr 172.21.15.71:0/349915460 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:41:27.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.255+0000 7f13ae7fc700 1 --2- 172.21.15.71:0/349915460 >> v2:172.21.15.72:3300/0 conn(0x7f13b80cd6e0 0x7f13b813f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:27.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.255+0000 7f13b67fc700 1 -- 172.21.15.71:0/349915460 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1719250387 0 0) 0x7f13b80ca3e0 con 0x7f13b80c78d0 2023-10-06T01:41:27.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.255+0000 7f13b67fc700 1 -- 172.21.15.71:0/349915460 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13a4003570 con 0x7f13b80c78d0 2023-10-06T01:41:27.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.255+0000 7f13b67fc700 1 -- 172.21.15.71:0/349915460 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 412477730 0 0) 0x7f13a4003570 con 0x7f13b80c78d0 2023-10-06T01:41:27.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.255+0000 7f13b67fc700 1 -- 172.21.15.71:0/349915460 >> v2:172.21.15.72:3300/0 conn(0x7f13b80cd6e0 msgr2=0x7f13b813f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:27.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.255+0000 7f13b67fc700 1 --2- 172.21.15.71:0/349915460 >> v2:172.21.15.72:3300/0 conn(0x7f13b80cd6e0 0x7f13b813f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:27.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.255+0000 7f13b67fc700 1 -- 172.21.15.71:0/349915460 >> v1:172.21.15.72:6789/0 conn(0x7f13b80c7ca0 legacy=0x7f13b80c2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:27.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.255+0000 7f13b67fc700 1 -- 172.21.15.71:0/349915460 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13b80c9ab0 con 0x7f13b80c78d0 2023-10-06T01:41:27.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.255+0000 7f13b67fc700 1 -- 172.21.15.71:0/349915460 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1184243524 0 0) 0x7f13a8001470 con 0x7f13b80c78d0 2023-10-06T01:41:27.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.255+0000 7f13b67fc700 1 -- 172.21.15.71:0/349915460 >> v1:172.21.15.71:6789/0 conn(0x7f13b80c78d0 legacy=0x7f13b80ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:27.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.255+0000 7f13b67fc700 1 --2- 172.21.15.71:0/349915460 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f13a4003a60 0x7f13a4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:27.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.255+0000 7f13b67fc700 1 --2- 172.21.15.71:0/349915460 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13a4004810 0x7f13a4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:27.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.255+0000 7f13b67fc700 1 --2- 172.21.15.71:0/349915460 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f13a40051c0 0x7f13a400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:27.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.255+0000 7f13b67fc700 1 -- 172.21.15.71:0/349915460 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13b80c95c0 con 0x7f13a4004810 2023-10-06T01:41:27.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.255+0000 7f13b67fc700 1 -- 172.21.15.71:0/349915460 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13a400c0d0 con 0x7f13a40051c0 2023-10-06T01:41:27.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.255+0000 7f13b67fc700 1 -- 172.21.15.71:0/349915460 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13a400c290 con 0x7f13a4003a60 2023-10-06T01:41:27.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.255+0000 7f13ae7fc700 1 --2- 172.21.15.71:0/349915460 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13a4004810 0x7f13a4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:27.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.255+0000 7f13b6ffd700 1 --2- 172.21.15.71:0/349915460 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f13a4003a60 0x7f13a4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:27.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.255+0000 7f13b77fe700 1 --2- 172.21.15.71:0/349915460 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f13a40051c0 0x7f13a400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:27.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.255+0000 7f13ae7fc700 1 -- 172.21.15.71:0/349915460 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f13a4003a60 msgr2=0x7f13a4003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:27.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.255+0000 7f13ae7fc700 1 --2- 172.21.15.71:0/349915460 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f13a4003a60 0x7f13a4003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:27.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.255+0000 7f13ae7fc700 1 -- 172.21.15.71:0/349915460 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f13a40051c0 msgr2=0x7f13a400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:27.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.255+0000 7f13ae7fc700 1 --2- 172.21.15.71:0/349915460 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f13a40051c0 0x7f13a400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:27.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.255+0000 7f13b77fe700 1 -- 172.21.15.71:0/349915460 reap_dead start 2023-10-06T01:41:27.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.255+0000 7f13ae7fc700 1 -- 172.21.15.71:0/349915460 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13a4003570 con 0x7f13a4004810 2023-10-06T01:41:27.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.256+0000 7f13ae7fc700 1 --2- 172.21.15.71:0/349915460 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13a4004810 0x7f13a4004c80 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f13a0009c00 tx=0x7f13a00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec0211024750b4cc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:27.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.256+0000 7f13b67fc700 1 -- 172.21.15.71:0/349915460 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a000e710 con 0x7f13a4004810 2023-10-06T01:41:27.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.256+0000 7f13b67fc700 1 -- 172.21.15.71:0/349915460 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13a000e870 con 0x7f13a4004810 2023-10-06T01:41:27.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.256+0000 7f13b67fc700 1 -- 172.21.15.71:0/349915460 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a000ec30 con 0x7f13a4004810 2023-10-06T01:41:27.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.256+0000 7f13bd34e700 1 -- 172.21.15.71:0/349915460 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13a4004810 msgr2=0x7f13a4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:27.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.256+0000 7f13bd34e700 1 --2- 172.21.15.71:0/349915460 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13a4004810 0x7f13a4004c80 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f13a0009c00 tx=0x7f13a00091a0 comp rx=0 tx=0).stop 2023-10-06T01:41:27.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.256+0000 7f13bd34e700 1 -- 172.21.15.71:0/349915460 shutdown_connections 2023-10-06T01:41:27.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.256+0000 7f13bd34e700 1 --2- 172.21.15.71:0/349915460 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13a4004810 0x7f13a4004c80 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:27.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.256+0000 7f13bd34e700 1 -- 172.21.15.71:0/349915460 >> 172.21.15.71:0/349915460 conn(0x7f13b8069790 msgr2=0x7f13b8069b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:27.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.256+0000 7f13bd34e700 1 -- 172.21.15.71:0/349915460 shutdown_connections 2023-10-06T01:41:27.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.256+0000 7f13bd34e700 1 -- 172.21.15.71:0/349915460 wait complete. 2023-10-06T01:41:27.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.258+0000 7f13bd34e700 1 Processor -- start 2023-10-06T01:41:27.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.258+0000 7f13bd34e700 1 -- start start 2023-10-06T01:41:27.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.258+0000 7f13bd34e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f13a4004810 0x7f13b8153df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:27.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.258+0000 7f13bd34e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13b80c5410 0x7f13b8165ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:27.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.258+0000 7f13bd34e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f13b80c5880 0x7f13b80b22b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:27.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.258+0000 7f13bd34e700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13b8158620 con 0x7f13b80c5410 2023-10-06T01:41:27.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.258+0000 7f13bd34e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13b8166c90 con 0x7f13a4004810 2023-10-06T01:41:27.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.258+0000 7f13bd34e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13b81666d0 con 0x7f13b80c5880 2023-10-06T01:41:27.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.258+0000 7f13ae7fc700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13b80c5410 0x7f13b8165ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:27.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.258+0000 7f13ae7fc700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13b80c5410 0x7f13b8165ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:53094/0 (socket says 172.21.15.71:53094) 2023-10-06T01:41:27.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.258+0000 7f13ae7fc700 1 -- 172.21.15.71:0/297894511 learned_addr learned my addr 172.21.15.71:0/297894511 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:27.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.258+0000 7f13b77fe700 1 --2- 172.21.15.71:0/297894511 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f13b80c5880 0x7f13b80b22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:27.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.258+0000 7f13b6ffd700 1 --2- 172.21.15.71:0/297894511 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f13a4004810 0x7f13b8153df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:27.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.259+0000 7f13ae7fc700 1 -- 172.21.15.71:0/297894511 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f13b80c5880 msgr2=0x7f13b80b22b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:27.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.259+0000 7f13ae7fc700 1 --2- 172.21.15.71:0/297894511 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f13b80c5880 0x7f13b80b22b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:27.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.259+0000 7f13ae7fc700 1 -- 172.21.15.71:0/297894511 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f13a4004810 msgr2=0x7f13b8153df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:27.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.259+0000 7f13ae7fc700 1 --2- 172.21.15.71:0/297894511 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f13a4004810 0x7f13b8153df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:27.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.259+0000 7f13ae7fc700 1 -- 172.21.15.71:0/297894511 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13b81669b0 con 0x7f13b80c5410 2023-10-06T01:41:27.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.259+0000 7f13ae7fc700 1 --2- 172.21.15.71:0/297894511 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13b80c5410 0x7f13b8165ca0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f13a400c0a0 tx=0x7f13a001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:27.266 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.259+0000 7f13af7fe700 1 -- 172.21.15.71:0/297894511 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a0022070 con 0x7f13b80c5410 2023-10-06T01:41:27.266 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.259+0000 7f13af7fe700 1 -- 172.21.15.71:0/297894511 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13a000e9e0 con 0x7f13b80c5410 2023-10-06T01:41:27.266 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.259+0000 7f13bd34e700 1 -- 172.21.15.71:0/297894511 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13b8158240 con 0x7f13b80c5410 2023-10-06T01:41:27.266 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.259+0000 7f13af7fe700 1 -- 172.21.15.71:0/297894511 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a000e710 con 0x7f13b80c5410 2023-10-06T01:41:27.266 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.259+0000 7f13bd34e700 1 -- 172.21.15.71:0/297894511 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13b81693f0 con 0x7f13b80c5410 2023-10-06T01:41:27.266 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.260+0000 7f13bd34e700 1 -- 172.21.15.71:0/297894511 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13b81580a0 con 0x7f13b80c5410 2023-10-06T01:41:27.266 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.260+0000 7f13af7fe700 1 -- 172.21.15.71:0/297894511 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f13a001c660 con 0x7f13b80c5410 2023-10-06T01:41:27.266 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.261+0000 7f13af7fe700 1 --2- 172.21.15.71:0/297894511 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f1398066f30 0x7f13980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:27.266 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.261+0000 7f13af7fe700 1 -- 172.21.15.71:0/297894511 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f13a0085ec0 con 0x7f13b80c5410 2023-10-06T01:41:27.266 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.261+0000 7f13b6ffd700 1 --2- 172.21.15.71:0/297894511 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f1398066f30 0x7f13980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:27.266 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.261+0000 7f13b6ffd700 1 --2- 172.21.15.71:0/297894511 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f1398066f30 0x7f13980693e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f13a8000c00 tx=0x7f13a8001e50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:27.267 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.265+0000 7f13af7fe700 1 -- 172.21.15.71:0/297894511 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f13b81580a0 con 0x7f13b80c5410 2023-10-06T01:41:27.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.447+0000 7f13bd34e700 1 -- 172.21.15.71:0/297894511 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f13b81580a0 con 0x7f13b80c5410 2023-10-06T01:41:27.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.448+0000 7f13af7fe700 1 -- 172.21.15.71:0/297894511 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+17036 (secure 0 0 0) 0x7f13a00722a0 con 0x7f13b80c5410 2023-10-06T01:41:27.449 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:41:27.449 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":40,"fsid":"1fbf1bd2-f9b4-4599-bea2-f4aa920e9a56","created":"2023-10-06T01:39:57.016957+0000","modified":"2023-10-06T01:41:26.474154+0000","last_up_change":"2023-10-06T01:40:08.571643+0000","last_in_change":"2023-10-06T01:39:59.462741+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T01:40:08.610349+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T01:40:15.387434+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-06T01:41:24.561219+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-06T01:41:25.445423+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cf059188-fb20-4dbf-95db-dcf57b213d03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":90670},{"type":"v1","addr":"172.21.15.71:6817","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":90670},{"type":"v1","addr":"172.21.15.71:6819","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":90670},{"type":"v1","addr":"172.21.15.71:6823","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":90670},{"type":"v1","addr":"172.21.15.71:6821","nonce":90670}]},"public_addr":"172.21.15.71:6817/90670","cluster_addr":"172.21.15.71:6819/90670","heartbeat_back_addr":"172.21.15.71:6823/90670","heartbeat_front_addr":"172.21.15.71:6821/90670","state":["exists","up"]},{"osd":1,"uuid":"0cff0aae-1799-4fe0-b610-54cf0813c0e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":90669},{"type":"v1","addr":"172.21.15.71:6809","nonce":90669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":90669},{"type":"v1","addr":"172.21.15.71:6811","nonce":90669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":90669},{"type":"v1","addr":"172.21.15.71:6815","nonce":90669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":90669},{"type":"v1","addr":"172.21.15.71:6813","nonce":90669}]},"public_addr":"172.21.15.71:6809/90669","cluster_addr":"172.21.15.71:6811/90669","heartbeat_back_addr":"172.21.15.71:6815/90669","heartbeat_front_addr":"172.21.15.71:6813/90669","state":["exists","up"]},{"osd":2,"uuid":"88d61ddc-9031-44e1-ba8c-546a41e7c8ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":90679},{"type":"v1","addr":"172.21.15.71:6825","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":90679},{"type":"v1","addr":"172.21.15.71:6827","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":90679},{"type":"v1","addr":"172.21.15.71:6831","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":90679},{"type":"v1","addr":"172.21.15.71:6829","nonce":90679}]},"public_addr":"172.21.15.71:6825/90679","cluster_addr":"172.21.15.71:6827/90679","heartbeat_back_addr":"172.21.15.71:6831/90679","heartbeat_front_addr":"172.21.15.71:6829/90679","state":["exists","up"]},{"osd":3,"uuid":"11ed92b7-960b-4a30-a889-a61d3eeb86f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":90668},{"type":"v1","addr":"172.21.15.71:6801","nonce":90668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":90668},{"type":"v1","addr":"172.21.15.71:6803","nonce":90668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":90668},{"type":"v1","addr":"172.21.15.71:6807","nonce":90668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":90668},{"type":"v1","addr":"172.21.15.71:6805","nonce":90668}]},"public_addr":"172.21.15.71:6801/90668","cluster_addr":"172.21.15.71:6803/90668","heartbeat_back_addr":"172.21.15.71:6807/90668","heartbeat_front_addr":"172.21.15.71:6805/90668","state":["exists","up"]},{"osd":4,"uuid":"ae4df784-abdf-4ddf-aefa-780f3ddafef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":90917},{"type":"v1","addr":"172.21.15.72:6801","nonce":90917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":90917},{"type":"v1","addr":"172.21.15.72:6803","nonce":90917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":90917},{"type":"v1","addr":"172.21.15.72:6807","nonce":90917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":90917},{"type":"v1","addr":"172.21.15.72:6805","nonce":90917}]},"public_addr":"172.21.15.72:6801/90917","cluster_addr":"172.21.15.72:6803/90917","heartbeat_back_addr":"172.21.15.72:6807/90917","heartbeat_front_addr":"172.21.15.72:6805/90917","state":["exists","up"]},{"osd":5,"uuid":"5ef0790f-001e-458f-a05b-efae216cf435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":90941},{"type":"v1","addr":"172.21.15.72:6817","nonce":90941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":90941},{"type":"v1","addr":"172.21.15.72:6819","nonce":90941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":90941},{"type":"v1","addr":"172.21.15.72:6827","nonce":90941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":90941},{"type":"v1","addr":"172.21.15.72:6823","nonce":90941}]},"public_addr":"172.21.15.72:6817/90941","cluster_addr":"172.21.15.72:6819/90941","heartbeat_back_addr":"172.21.15.72:6827/90941","heartbeat_front_addr":"172.21.15.72:6823/90941","state":["exists","up"]},{"osd":6,"uuid":"8705aef1-9ae8-4e54-a3c4-c2909fa0ceb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":90918},{"type":"v1","addr":"172.21.15.72:6809","nonce":90918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":90918},{"type":"v1","addr":"172.21.15.72:6811","nonce":90918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":90918},{"type":"v1","addr":"172.21.15.72:6815","nonce":90918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":90918},{"type":"v1","addr":"172.21.15.72:6813","nonce":90918}]},"public_addr":"172.21.15.72:6809/90918","cluster_addr":"172.21.15.72:6811/90918","heartbeat_back_addr":"172.21.15.72:6815/90918","heartbeat_front_addr":"172.21.15.72:6813/90918","state":["exists","up"]},{"osd":7,"uuid":"364c5119-6b13-4c75-b3f0-15e165eff86a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":90948},{"type":"v1","addr":"172.21.15.72:6822","nonce":90948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":90948},{"type":"v1","addr":"172.21.15.72:6826","nonce":90948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":90948},{"type":"v1","addr":"172.21.15.72:6831","nonce":90948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":90948},{"type":"v1","addr":"172.21.15.72:6829","nonce":90948}]},"public_addr":"172.21.15.72:6822/90948","cluster_addr":"172.21.15.72:6826/90948","heartbeat_back_addr":"172.21.15.72:6831/90948","heartbeat_front_addr":"172.21.15.72:6829/90948","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.642976+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.645372+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.619116+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.663042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.599163+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.646411+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.631545+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.669821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:41:27.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.450+0000 7f13bd34e700 1 -- 172.21.15.71:0/297894511 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f1398066f30 msgr2=0x7f13980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:27.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.450+0000 7f13bd34e700 1 --2- 172.21.15.71:0/297894511 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f1398066f30 0x7f13980693e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f13a8000c00 tx=0x7f13a8001e50 comp rx=0 tx=0).stop 2023-10-06T01:41:27.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.450+0000 7f13bd34e700 1 -- 172.21.15.71:0/297894511 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13b80c5410 msgr2=0x7f13b8165ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:27.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.450+0000 7f13bd34e700 1 --2- 172.21.15.71:0/297894511 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13b80c5410 0x7f13b8165ca0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f13a400c0a0 tx=0x7f13a001a000 comp rx=0 tx=0).stop 2023-10-06T01:41:27.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.450+0000 7f13bd34e700 1 -- 172.21.15.71:0/297894511 shutdown_connections 2023-10-06T01:41:27.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.450+0000 7f13bd34e700 1 --2- 172.21.15.71:0/297894511 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f13b80c5880 0x7f13b80b22b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:27.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.450+0000 7f13bd34e700 1 --2- 172.21.15.71:0/297894511 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f1398066f30 0x7f13980693e0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:27.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.450+0000 7f13bd34e700 1 --2- 172.21.15.71:0/297894511 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f13a4004810 0x7f13b8153df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:27.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.450+0000 7f13bd34e700 1 --2- 172.21.15.71:0/297894511 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f13b80c5410 0x7f13b8165ca0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:27.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.450+0000 7f13bd34e700 1 -- 172.21.15.71:0/297894511 >> 172.21.15.71:0/297894511 conn(0x7f13b8069790 msgr2=0x7f13b8063230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:27.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.450+0000 7f13bd34e700 1 -- 172.21.15.71:0/297894511 shutdown_connections 2023-10-06T01:41:27.452 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.450+0000 7f13bd34e700 1 -- 172.21.15.71:0/297894511 wait complete. 2023-10-06T01:41:27.463 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:41:27.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.576+0000 7f4a183a3700 1 Processor -- start 2023-10-06T01:41:27.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.576+0000 7f4a183a3700 1 -- start start 2023-10-06T01:41:27.579 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.577+0000 7f4a183a3700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4a100af4e0 0x7f4a100b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:27.579 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.577+0000 7f4a183a3700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4a1015db70 0x7f4a100b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:27.579 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.577+0000 7f4a183a3700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a1015e190 con 0x7f4a100af8b0 2023-10-06T01:41:27.579 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.577+0000 7f4a183a3700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a100b1910 con 0x7f4a1015db70 2023-10-06T01:41:27.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.577+0000 7f4a183a3700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a1015dfa0 con 0x7f4a100af4e0 2023-10-06T01:41:27.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.577+0000 7f4a16940700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4a1015db70 0x7f4a100b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:27.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.577+0000 7f4a16940700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4a1015db70 0x7f4a100b2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:53096/0 (socket says 172.21.15.71:53096) 2023-10-06T01:41:27.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.577+0000 7f4a16940700 1 -- 172.21.15.71:0/2282431262 learned_addr learned my addr 172.21.15.71:0/2282431262 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:27.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.577+0000 7f4a1613f700 1 --2- 172.21.15.71:0/2282431262 >> v2:172.21.15.72:3300/0 conn(0x7f4a100af4e0 0x7f4a100b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:27.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.578+0000 7f4a16940700 1 -- 172.21.15.71:0/2282431262 >> v2:172.21.15.72:3300/0 conn(0x7f4a100af4e0 msgr2=0x7f4a100b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:27.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.578+0000 7f4a16940700 1 --2- 172.21.15.71:0/2282431262 >> v2:172.21.15.72:3300/0 conn(0x7f4a100af4e0 0x7f4a100b20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:27.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.578+0000 7f4a16940700 1 -- 172.21.15.71:0/2282431262 >> v1:172.21.15.72:6789/0 conn(0x7f4a100af8b0 legacy=0x7f4a1015d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:27.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.578+0000 7f4a16940700 1 -- 172.21.15.71:0/2282431262 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a100cb650 con 0x7f4a1015db70 2023-10-06T01:41:27.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.578+0000 7f4a16940700 1 --2- 172.21.15.71:0/2282431262 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4a1015db70 0x7f4a100b2620 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f4a100d1360 tx=0x7f4a08009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4aea9578b24d31c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:27.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.578+0000 7f4a1513d700 1 -- 172.21.15.71:0/2282431262 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a0800e070 con 0x7f4a1015db70 2023-10-06T01:41:27.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.578+0000 7f4a1513d700 1 -- 172.21.15.71:0/2282431262 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a0800ba10 con 0x7f4a1015db70 2023-10-06T01:41:27.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.578+0000 7f4a1513d700 1 -- 172.21.15.71:0/2282431262 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a080092e0 con 0x7f4a1015db70 2023-10-06T01:41:27.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.578+0000 7f4a183a3700 1 -- 172.21.15.71:0/2282431262 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4a1015db70 msgr2=0x7f4a100b2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:27.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.578+0000 7f4a183a3700 1 --2- 172.21.15.71:0/2282431262 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4a1015db70 0x7f4a100b2620 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f4a100d1360 tx=0x7f4a08009840 comp rx=0 tx=0).stop 2023-10-06T01:41:27.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.578+0000 7f4a183a3700 1 -- 172.21.15.71:0/2282431262 shutdown_connections 2023-10-06T01:41:27.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.578+0000 7f4a183a3700 1 --2- 172.21.15.71:0/2282431262 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4a1015db70 0x7f4a100b2620 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:27.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.578+0000 7f4a183a3700 1 --2- 172.21.15.71:0/2282431262 >> v2:172.21.15.72:3300/0 conn(0x7f4a100af4e0 0x7f4a100b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:27.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.578+0000 7f4a183a3700 1 -- 172.21.15.71:0/2282431262 >> 172.21.15.71:0/2282431262 conn(0x7f4a10068680 msgr2=0x7f4a10068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:27.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.578+0000 7f4a183a3700 1 -- 172.21.15.71:0/2282431262 shutdown_connections 2023-10-06T01:41:27.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.579+0000 7f4a183a3700 1 -- 172.21.15.71:0/2282431262 wait complete. 2023-10-06T01:41:27.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.579+0000 7f4a183a3700 1 Processor -- start 2023-10-06T01:41:27.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.580+0000 7f4a183a3700 1 -- start start 2023-10-06T01:41:27.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.580+0000 7f4a183a3700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a100af4e0 0x7f4a10169bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:27.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.580+0000 7f4a183a3700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4a100af8b0 0x7f4a1014e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:27.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.580+0000 7f4a183a3700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4a1015db70 0x7f4a100a85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:27.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.580+0000 7f4a183a3700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a100c9f50 con 0x7f4a100af8b0 2023-10-06T01:41:27.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.580+0000 7f4a183a3700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a100c73a0 con 0x7f4a100af4e0 2023-10-06T01:41:27.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.580+0000 7f4a183a3700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a100c7680 con 0x7f4a1015db70 2023-10-06T01:41:27.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.580+0000 7f4a1593e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4a100af8b0 0x7f4a1014e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:27.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.580+0000 7f4a1593e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4a100af8b0 0x7f4a1014e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:53110/0 (socket says 172.21.15.71:53110) 2023-10-06T01:41:27.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.580+0000 7f4a1593e700 1 -- 172.21.15.71:0/3913335933 learned_addr learned my addr 172.21.15.71:0/3913335933 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:27.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.580+0000 7f4a1613f700 1 --2- 172.21.15.71:0/3913335933 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a100af4e0 0x7f4a10169bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:27.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.580+0000 7f4a16940700 1 --2- 172.21.15.71:0/3913335933 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4a1015db70 0x7f4a100a85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:27.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.581+0000 7f4a1593e700 1 -- 172.21.15.71:0/3913335933 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4a1015db70 msgr2=0x7f4a100a85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:27.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.581+0000 7f4a1593e700 1 --2- 172.21.15.71:0/3913335933 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4a1015db70 0x7f4a100a85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:27.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.581+0000 7f4a1593e700 1 -- 172.21.15.71:0/3913335933 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a100af4e0 msgr2=0x7f4a10169bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:27.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.581+0000 7f4a1593e700 1 --2- 172.21.15.71:0/3913335933 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a100af4e0 0x7f4a10169bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:27.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.581+0000 7f4a1593e700 1 -- 172.21.15.71:0/3913335933 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a08009ae0 con 0x7f4a100af8b0 2023-10-06T01:41:27.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.581+0000 7f4a1593e700 1 --2- 172.21.15.71:0/3913335933 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4a100af8b0 0x7f4a1014e830 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f4a0000c590 tx=0x7f4a00007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:27.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.581+0000 7f4a067fc700 1 -- 172.21.15.71:0/3913335933 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a00011590 con 0x7f4a100af8b0 2023-10-06T01:41:27.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.581+0000 7f4a067fc700 1 -- 172.21.15.71:0/3913335933 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a000116f0 con 0x7f4a100af8b0 2023-10-06T01:41:27.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.581+0000 7f4a183a3700 1 -- 172.21.15.71:0/3913335933 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a100c7960 con 0x7f4a100af8b0 2023-10-06T01:41:27.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.581+0000 7f4a067fc700 1 -- 172.21.15.71:0/3913335933 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a00011ab0 con 0x7f4a100af8b0 2023-10-06T01:41:27.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.581+0000 7f4a183a3700 1 -- 172.21.15.71:0/3913335933 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a1014ed70 con 0x7f4a100af8b0 2023-10-06T01:41:27.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.582+0000 7f4a183a3700 1 -- 172.21.15.71:0/3913335933 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a10088aa0 con 0x7f4a100af8b0 2023-10-06T01:41:27.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.582+0000 7f4a067fc700 1 -- 172.21.15.71:0/3913335933 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4a0001c460 con 0x7f4a100af8b0 2023-10-06T01:41:27.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.583+0000 7f4a067fc700 1 --2- 172.21.15.71:0/3913335933 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f49f4066f30 0x7f49f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:27.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.583+0000 7f4a067fc700 1 -- 172.21.15.71:0/3913335933 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f4a00084420 con 0x7f4a100af8b0 2023-10-06T01:41:27.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.583+0000 7f4a1613f700 1 --2- 172.21.15.71:0/3913335933 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f49f4066f30 0x7f49f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:27.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.583+0000 7f4a1613f700 1 --2- 172.21.15.71:0/3913335933 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f49f4066f30 0x7f49f40693e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c006fd0 tx=0x7f4a0c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:27.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.587+0000 7f4a067fc700 1 -- 172.21.15.71:0/3913335933 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4a000513f0 con 0x7f4a100af8b0 2023-10-06T01:41:27.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.772+0000 7f4a183a3700 1 -- 172.21.15.71:0/3913335933 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4a100b0910 con 0x7f4a100af8b0 2023-10-06T01:41:27.773 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.772+0000 7f4a067fc700 1 -- 172.21.15.71:0/3913335933 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+17036 (secure 0 0 0) 0x7f4a00054a10 con 0x7f4a100af8b0 2023-10-06T01:41:27.773 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:41:27.774 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":40,"fsid":"1fbf1bd2-f9b4-4599-bea2-f4aa920e9a56","created":"2023-10-06T01:39:57.016957+0000","modified":"2023-10-06T01:41:26.474154+0000","last_up_change":"2023-10-06T01:40:08.571643+0000","last_in_change":"2023-10-06T01:39:59.462741+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T01:40:08.610349+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T01:40:15.387434+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-06T01:41:24.561219+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-06T01:41:25.445423+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cf059188-fb20-4dbf-95db-dcf57b213d03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":90670},{"type":"v1","addr":"172.21.15.71:6817","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":90670},{"type":"v1","addr":"172.21.15.71:6819","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":90670},{"type":"v1","addr":"172.21.15.71:6823","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":90670},{"type":"v1","addr":"172.21.15.71:6821","nonce":90670}]},"public_addr":"172.21.15.71:6817/90670","cluster_addr":"172.21.15.71:6819/90670","heartbeat_back_addr":"172.21.15.71:6823/90670","heartbeat_front_addr":"172.21.15.71:6821/90670","state":["exists","up"]},{"osd":1,"uuid":"0cff0aae-1799-4fe0-b610-54cf0813c0e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":90669},{"type":"v1","addr":"172.21.15.71:6809","nonce":90669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":90669},{"type":"v1","addr":"172.21.15.71:6811","nonce":90669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":90669},{"type":"v1","addr":"172.21.15.71:6815","nonce":90669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":90669},{"type":"v1","addr":"172.21.15.71:6813","nonce":90669}]},"public_addr":"172.21.15.71:6809/90669","cluster_addr":"172.21.15.71:6811/90669","heartbeat_back_addr":"172.21.15.71:6815/90669","heartbeat_front_addr":"172.21.15.71:6813/90669","state":["exists","up"]},{"osd":2,"uuid":"88d61ddc-9031-44e1-ba8c-546a41e7c8ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":90679},{"type":"v1","addr":"172.21.15.71:6825","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":90679},{"type":"v1","addr":"172.21.15.71:6827","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":90679},{"type":"v1","addr":"172.21.15.71:6831","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":90679},{"type":"v1","addr":"172.21.15.71:6829","nonce":90679}]},"public_addr":"172.21.15.71:6825/90679","cluster_addr":"172.21.15.71:6827/90679","heartbeat_back_addr":"172.21.15.71:6831/90679","heartbeat_front_addr":"172.21.15.71:6829/90679","state":["exists","up"]},{"osd":3,"uuid":"11ed92b7-960b-4a30-a889-a61d3eeb86f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":90668},{"type":"v1","addr":"172.21.15.71:6801","nonce":90668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":90668},{"type":"v1","addr":"172.21.15.71:6803","nonce":90668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":90668},{"type":"v1","addr":"172.21.15.71:6807","nonce":90668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":90668},{"type":"v1","addr":"172.21.15.71:6805","nonce":90668}]},"public_addr":"172.21.15.71:6801/90668","cluster_addr":"172.21.15.71:6803/90668","heartbeat_back_addr":"172.21.15.71:6807/90668","heartbeat_front_addr":"172.21.15.71:6805/90668","state":["exists","up"]},{"osd":4,"uuid":"ae4df784-abdf-4ddf-aefa-780f3ddafef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":90917},{"type":"v1","addr":"172.21.15.72:6801","nonce":90917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":90917},{"type":"v1","addr":"172.21.15.72:6803","nonce":90917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":90917},{"type":"v1","addr":"172.21.15.72:6807","nonce":90917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":90917},{"type":"v1","addr":"172.21.15.72:6805","nonce":90917}]},"public_addr":"172.21.15.72:6801/90917","cluster_addr":"172.21.15.72:6803/90917","heartbeat_back_addr":"172.21.15.72:6807/90917","heartbeat_front_addr":"172.21.15.72:6805/90917","state":["exists","up"]},{"osd":5,"uuid":"5ef0790f-001e-458f-a05b-efae216cf435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":90941},{"type":"v1","addr":"172.21.15.72:6817","nonce":90941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":90941},{"type":"v1","addr":"172.21.15.72:6819","nonce":90941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":90941},{"type":"v1","addr":"172.21.15.72:6827","nonce":90941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":90941},{"type":"v1","addr":"172.21.15.72:6823","nonce":90941}]},"public_addr":"172.21.15.72:6817/90941","cluster_addr":"172.21.15.72:6819/90941","heartbeat_back_addr":"172.21.15.72:6827/90941","heartbeat_front_addr":"172.21.15.72:6823/90941","state":["exists","up"]},{"osd":6,"uuid":"8705aef1-9ae8-4e54-a3c4-c2909fa0ceb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":90918},{"type":"v1","addr":"172.21.15.72:6809","nonce":90918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":90918},{"type":"v1","addr":"172.21.15.72:6811","nonce":90918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":90918},{"type":"v1","addr":"172.21.15.72:6815","nonce":90918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":90918},{"type":"v1","addr":"172.21.15.72:6813","nonce":90918}]},"public_addr":"172.21.15.72:6809/90918","cluster_addr":"172.21.15.72:6811/90918","heartbeat_back_addr":"172.21.15.72:6815/90918","heartbeat_front_addr":"172.21.15.72:6813/90918","state":["exists","up"]},{"osd":7,"uuid":"364c5119-6b13-4c75-b3f0-15e165eff86a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":90948},{"type":"v1","addr":"172.21.15.72:6822","nonce":90948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":90948},{"type":"v1","addr":"172.21.15.72:6826","nonce":90948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":90948},{"type":"v1","addr":"172.21.15.72:6831","nonce":90948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":90948},{"type":"v1","addr":"172.21.15.72:6829","nonce":90948}]},"public_addr":"172.21.15.72:6822/90948","cluster_addr":"172.21.15.72:6826/90948","heartbeat_back_addr":"172.21.15.72:6831/90948","heartbeat_front_addr":"172.21.15.72:6829/90948","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.642976+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.645372+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.619116+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.663042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.599163+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.646411+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.631545+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.669821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:41:27.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.775+0000 7f4a183a3700 1 -- 172.21.15.71:0/3913335933 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f49f4066f30 msgr2=0x7f49f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:27.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.775+0000 7f4a183a3700 1 --2- 172.21.15.71:0/3913335933 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f49f4066f30 0x7f49f40693e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c006fd0 tx=0x7f4a0c008040 comp rx=0 tx=0).stop 2023-10-06T01:41:27.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.775+0000 7f4a183a3700 1 -- 172.21.15.71:0/3913335933 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4a100af8b0 msgr2=0x7f4a1014e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:27.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.775+0000 7f4a183a3700 1 --2- 172.21.15.71:0/3913335933 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4a100af8b0 0x7f4a1014e830 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f4a0000c590 tx=0x7f4a00007f30 comp rx=0 tx=0).stop 2023-10-06T01:41:27.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.775+0000 7f4a183a3700 1 -- 172.21.15.71:0/3913335933 shutdown_connections 2023-10-06T01:41:27.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.775+0000 7f4a183a3700 1 --2- 172.21.15.71:0/3913335933 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4a1015db70 0x7f4a100a85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:27.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.775+0000 7f4a183a3700 1 --2- 172.21.15.71:0/3913335933 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f49f4066f30 0x7f49f40693e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:27.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.775+0000 7f4a183a3700 1 --2- 172.21.15.71:0/3913335933 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4a100af4e0 0x7f4a10169bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:27.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.775+0000 7f4a183a3700 1 --2- 172.21.15.71:0/3913335933 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4a100af8b0 0x7f4a1014e830 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:27.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.775+0000 7f4a183a3700 1 -- 172.21.15.71:0/3913335933 >> 172.21.15.71:0/3913335933 conn(0x7f4a10068680 msgr2=0x7f4a100b5070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:27.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.775+0000 7f4a183a3700 1 -- 172.21.15.71:0/3913335933 shutdown_connections 2023-10-06T01:41:27.777 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.775+0000 7f4a183a3700 1 -- 172.21.15.71:0/3913335933 wait complete. 2023-10-06T01:41:27.788 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T01:41:27.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.907+0000 7ff1432b5700 1 Processor -- start 2023-10-06T01:41:27.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.907+0000 7ff1432b5700 1 -- start start 2023-10-06T01:41:27.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.908+0000 7ff1432b5700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff13c0d0400 0x7ff13c0b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:27.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.908+0000 7ff1432b5700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff13c0d07d0 0x7ff13c0b3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:27.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.908+0000 7ff1432b5700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff13c0b6170 con 0x7ff13c0ccd40 2023-10-06T01:41:27.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.908+0000 7ff1432b5700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff13c15dd40 con 0x7ff13c0d07d0 2023-10-06T01:41:27.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.908+0000 7ff1432b5700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff13c15e020 con 0x7ff13c0d0400 2023-10-06T01:41:27.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.908+0000 7ff140850700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7ff13c0ccd40 0x7ff13c0cf2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:44880/0 (socket says 172.21.15.71:44880) 2023-10-06T01:41:27.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.908+0000 7ff140850700 1 -- 172.21.15.71:0/4033948351 learned_addr learned my addr 172.21.15.71:0/4033948351 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:41:27.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.908+0000 7ff141852700 1 --2- 172.21.15.71:0/4033948351 >> v2:172.21.15.72:3300/0 conn(0x7ff13c0d07d0 0x7ff13c0b3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:27.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.908+0000 7ff141051700 1 --2- 172.21.15.71:0/4033948351 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff13c0d0400 0x7ff13c0b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:27.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.908+0000 7ff13bfff700 1 -- 172.21.15.71:0/4033948351 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 861602779 0 0) 0x7ff13c0b6170 con 0x7ff13c0ccd40 2023-10-06T01:41:27.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.908+0000 7ff13bfff700 1 -- 172.21.15.71:0/4033948351 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff124003570 con 0x7ff13c0ccd40 2023-10-06T01:41:27.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.908+0000 7ff13bfff700 1 -- 172.21.15.71:0/4033948351 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3949373858 0 0) 0x7ff124003570 con 0x7ff13c0ccd40 2023-10-06T01:41:27.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.908+0000 7ff13bfff700 1 -- 172.21.15.71:0/4033948351 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff13c0d0400 msgr2=0x7ff13c0b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:27.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.908+0000 7ff13bfff700 1 --2- 172.21.15.71:0/4033948351 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff13c0d0400 0x7ff13c0b5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:27.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.908+0000 7ff13bfff700 1 -- 172.21.15.71:0/4033948351 >> v2:172.21.15.72:3300/0 conn(0x7ff13c0d07d0 msgr2=0x7ff13c0b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:27.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.908+0000 7ff13bfff700 1 --2- 172.21.15.71:0/4033948351 >> v2:172.21.15.72:3300/0 conn(0x7ff13c0d07d0 0x7ff13c0b3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:27.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.908+0000 7ff13bfff700 1 -- 172.21.15.71:0/4033948351 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff13c0ceaa0 con 0x7ff13c0ccd40 2023-10-06T01:41:27.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.908+0000 7ff13bfff700 1 -- 172.21.15.71:0/4033948351 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1184243524 0 0) 0x7ff130001470 con 0x7ff13c0ccd40 2023-10-06T01:41:27.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.908+0000 7ff13bfff700 1 -- 172.21.15.71:0/4033948351 >> v1:172.21.15.71:6789/0 conn(0x7ff13c0ccd40 legacy=0x7ff13c0cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:27.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.908+0000 7ff13bfff700 1 --2- 172.21.15.71:0/4033948351 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff124003a60 0x7ff124003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:27.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.908+0000 7ff13bfff700 1 --2- 172.21.15.71:0/4033948351 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff124004810 0x7ff124004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:27.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.908+0000 7ff13bfff700 1 --2- 172.21.15.71:0/4033948351 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff13c0d0400 0x7ff1240051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:27.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.908+0000 7ff13bfff700 1 -- 172.21.15.71:0/4033948351 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff13c15dd40 con 0x7ff124004810 2023-10-06T01:41:27.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.908+0000 7ff13bfff700 1 -- 172.21.15.71:0/4033948351 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff13c15e020 con 0x7ff124003a60 2023-10-06T01:41:27.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.908+0000 7ff13bfff700 1 -- 172.21.15.71:0/4033948351 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff12400ba60 con 0x7ff13c0d0400 2023-10-06T01:41:27.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.908+0000 7ff140850700 1 --2- 172.21.15.71:0/4033948351 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff124004810 0x7ff124004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:27.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.909+0000 7ff141852700 1 --2- 172.21.15.71:0/4033948351 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff13c0d0400 0x7ff1240051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:27.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.909+0000 7ff141051700 1 --2- 172.21.15.71:0/4033948351 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff124003a60 0x7ff124003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:27.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.909+0000 7ff140850700 1 -- 172.21.15.71:0/4033948351 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff13c0d0400 msgr2=0x7ff1240051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:27.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.909+0000 7ff140850700 1 --2- 172.21.15.71:0/4033948351 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff13c0d0400 0x7ff1240051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:27.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.909+0000 7ff140850700 1 -- 172.21.15.71:0/4033948351 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff124003a60 msgr2=0x7ff124003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:27.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.909+0000 7ff140850700 1 --2- 172.21.15.71:0/4033948351 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff124003a60 0x7ff124003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:27.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.909+0000 7ff140850700 1 -- 172.21.15.71:0/4033948351 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff124003570 con 0x7ff124004810 2023-10-06T01:41:27.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.909+0000 7ff141852700 1 --2- 172.21.15.71:0/4033948351 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff13c0d0400 0x7ff1240051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:41:27.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.909+0000 7ff141051700 1 --2- 172.21.15.71:0/4033948351 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff124003a60 0x7ff124003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:41:27.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.909+0000 7ff140850700 1 --2- 172.21.15.71:0/4033948351 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff124004810 0x7ff124004c80 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7ff13000c3f0 tx=0x7ff130001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd10789a947cfcee server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:27.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.909+0000 7ff13bfff700 1 -- 172.21.15.71:0/4033948351 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff13000cc80 con 0x7ff124004810 2023-10-06T01:41:27.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.909+0000 7ff13bfff700 1 -- 172.21.15.71:0/4033948351 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff13000ce00 con 0x7ff124004810 2023-10-06T01:41:27.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.909+0000 7ff13bfff700 1 -- 172.21.15.71:0/4033948351 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff130005b70 con 0x7ff124004810 2023-10-06T01:41:27.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.909+0000 7ff1432b5700 1 -- 172.21.15.71:0/4033948351 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff124004810 msgr2=0x7ff124004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:27.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.909+0000 7ff1432b5700 1 --2- 172.21.15.71:0/4033948351 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff124004810 0x7ff124004c80 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7ff13000c3f0 tx=0x7ff130001e90 comp rx=0 tx=0).stop 2023-10-06T01:41:27.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.909+0000 7ff141852700 1 -- 172.21.15.71:0/4033948351 reap_dead start 2023-10-06T01:41:27.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.909+0000 7ff1432b5700 1 -- 172.21.15.71:0/4033948351 shutdown_connections 2023-10-06T01:41:27.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.909+0000 7ff1432b5700 1 -- 172.21.15.71:0/4033948351 >> 172.21.15.71:0/4033948351 conn(0x7ff13c06a220 msgr2=0x7ff13c06a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:27.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.910+0000 7ff1432b5700 1 -- 172.21.15.71:0/4033948351 shutdown_connections 2023-10-06T01:41:27.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.910+0000 7ff1432b5700 1 -- 172.21.15.71:0/4033948351 wait complete. 2023-10-06T01:41:27.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.911+0000 7ff1432b5700 1 Processor -- start 2023-10-06T01:41:27.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.911+0000 7ff1432b5700 1 -- start start 2023-10-06T01:41:27.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.911+0000 7ff1432b5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff124004810 0x7ff13c0c6f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:27.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.912+0000 7ff1432b5700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff13c0cbf80 0x7ff13c148950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:27.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.912+0000 7ff1432b5700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff13c087450 0x7ff13c0c9b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:27.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.912+0000 7ff1432b5700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff13c148e90 con 0x7ff13c0cbf80 2023-10-06T01:41:27.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.912+0000 7ff1432b5700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff13c0c8280 con 0x7ff124004810 2023-10-06T01:41:27.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.912+0000 7ff1432b5700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff13c0cc3f0 con 0x7ff13c087450 2023-10-06T01:41:27.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.912+0000 7ff140850700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff13c0cbf80 0x7ff13c148950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:27.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.912+0000 7ff140850700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff13c0cbf80 0x7ff13c148950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:53132/0 (socket says 172.21.15.71:53132) 2023-10-06T01:41:27.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.912+0000 7ff140850700 1 -- 172.21.15.71:0/535024744 learned_addr learned my addr 172.21.15.71:0/535024744 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:27.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.912+0000 7ff141852700 1 --2- 172.21.15.71:0/535024744 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff13c087450 0x7ff13c0c9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:27.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.912+0000 7ff141051700 1 --2- 172.21.15.71:0/535024744 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff124004810 0x7ff13c0c6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:27.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.912+0000 7ff140850700 1 -- 172.21.15.71:0/535024744 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff13c087450 msgr2=0x7ff13c0c9b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:27.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.912+0000 7ff140850700 1 --2- 172.21.15.71:0/535024744 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff13c087450 0x7ff13c0c9b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:27.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.912+0000 7ff140850700 1 -- 172.21.15.71:0/535024744 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff124004810 msgr2=0x7ff13c0c6f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:27.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.912+0000 7ff140850700 1 --2- 172.21.15.71:0/535024744 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff124004810 0x7ff13c0c6f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:27.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.912+0000 7ff140850700 1 -- 172.21.15.71:0/535024744 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff13c0c7670 con 0x7ff13c0cbf80 2023-10-06T01:41:27.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.912+0000 7ff141852700 1 --2- 172.21.15.71:0/535024744 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff13c087450 0x7ff13c0c9b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:41:27.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.912+0000 7ff141051700 1 --2- 172.21.15.71:0/535024744 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff124004810 0x7ff13c0c6f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:41:27.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.912+0000 7ff140850700 1 --2- 172.21.15.71:0/535024744 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff13c0cbf80 0x7ff13c148950 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7ff130001ed0 tx=0x7ff130015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:27.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.912+0000 7ff1397fa700 1 -- 172.21.15.71:0/535024744 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1300072e0 con 0x7ff13c0cbf80 2023-10-06T01:41:27.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.912+0000 7ff1397fa700 1 -- 172.21.15.71:0/535024744 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff130007480 con 0x7ff13c0cbf80 2023-10-06T01:41:27.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.912+0000 7ff1432b5700 1 -- 172.21.15.71:0/535024744 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff13c0c7950 con 0x7ff13c0cbf80 2023-10-06T01:41:27.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.912+0000 7ff1397fa700 1 -- 172.21.15.71:0/535024744 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff130007840 con 0x7ff13c0cbf80 2023-10-06T01:41:27.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.912+0000 7ff1432b5700 1 -- 172.21.15.71:0/535024744 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff13c0c7f10 con 0x7ff13c0cbf80 2023-10-06T01:41:27.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.913+0000 7ff1432b5700 1 -- 172.21.15.71:0/535024744 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff13c088760 con 0x7ff13c0cbf80 2023-10-06T01:41:27.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.914+0000 7ff1397fa700 1 -- 172.21.15.71:0/535024744 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff130019030 con 0x7ff13c0cbf80 2023-10-06T01:41:27.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.914+0000 7ff1397fa700 1 --2- 172.21.15.71:0/535024744 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7ff128066f60 0x7ff128069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:27.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.914+0000 7ff1397fa700 1 -- 172.21.15.71:0/535024744 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6378+0+0 (secure 0 0 0) 0x7ff130085f40 con 0x7ff13c0cbf80 2023-10-06T01:41:27.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.914+0000 7ff141051700 1 --2- 172.21.15.71:0/535024744 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7ff128066f60 0x7ff128069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:27.920 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.914+0000 7ff141051700 1 --2- 172.21.15.71:0/535024744 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7ff128066f60 0x7ff128069410 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff1340094d0 tx=0x7ff13400b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:27.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:27.918+0000 7ff1397fa700 1 -- 172.21.15.71:0/535024744 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff130052f10 con 0x7ff13c0cbf80 2023-10-06T01:41:28.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:28.142+0000 7ff1432b5700 1 -- 172.21.15.71:0/535024744 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7ff13c0ced80 con 0x7ff13c0cbf80 2023-10-06T01:41:29.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:29.132+0000 7ff1397fa700 1 -- 172.21.15.71:0/535024744 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) v1 ==== 118+0+0 (secure 0 0 0) 0x7ff1300170b0 con 0x7ff13c0cbf80 2023-10-06T01:41:29.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:29.134+0000 7ff1432b5700 1 -- 172.21.15.71:0/535024744 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7ff128066f60 msgr2=0x7ff128069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:29.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:29.134+0000 7ff1432b5700 1 --2- 172.21.15.71:0/535024744 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7ff128066f60 0x7ff128069410 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff1340094d0 tx=0x7ff13400b040 comp rx=0 tx=0).stop 2023-10-06T01:41:29.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:29.135+0000 7ff1432b5700 1 -- 172.21.15.71:0/535024744 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff13c0cbf80 msgr2=0x7ff13c148950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:29.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:29.135+0000 7ff1432b5700 1 --2- 172.21.15.71:0/535024744 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff13c0cbf80 0x7ff13c148950 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7ff130001ed0 tx=0x7ff130015000 comp rx=0 tx=0).stop 2023-10-06T01:41:29.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:29.135+0000 7ff1432b5700 1 -- 172.21.15.71:0/535024744 shutdown_connections 2023-10-06T01:41:29.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:29.135+0000 7ff1432b5700 1 --2- 172.21.15.71:0/535024744 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff13c087450 0x7ff13c0c9b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:29.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:29.135+0000 7ff1432b5700 1 --2- 172.21.15.71:0/535024744 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7ff128066f60 0x7ff128069410 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:29.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:29.135+0000 7ff1432b5700 1 --2- 172.21.15.71:0/535024744 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff124004810 0x7ff13c0c6f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:29.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:29.135+0000 7ff1432b5700 1 --2- 172.21.15.71:0/535024744 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff13c0cbf80 0x7ff13c148950 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:29.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:29.135+0000 7ff1432b5700 1 -- 172.21.15.71:0/535024744 >> 172.21.15.71:0/535024744 conn(0x7ff13c06a220 msgr2=0x7ff13c156d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:29.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:29.135+0000 7ff1432b5700 1 -- 172.21.15.71:0/535024744 shutdown_connections 2023-10-06T01:41:29.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:29.135+0000 7ff1432b5700 1 -- 172.21.15.71:0/535024744 wait complete. 2023-10-06T01:41:29.149 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T01:41:29.270 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:29.269+0000 7fe1885a7700 1 Processor -- start 2023-10-06T01:41:29.270 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:29.269+0000 7fe1885a7700 1 -- start start 2023-10-06T01:41:29.272 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:29.270+0000 7fe1885a7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe180086ff0 0x7fe180087440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:29.272 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:29.270+0000 7fe1885a7700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fe1800b21b0 0x7fe1800b25f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:29.272 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:29.270+0000 7fe1885a7700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe180087980 con 0x7fe18015a030 2023-10-06T01:41:29.272 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:29.270+0000 7fe1885a7700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1800b0cf0 con 0x7fe1800b21b0 2023-10-06T01:41:29.273 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:29.270+0000 7fe1885a7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1800b2b30 con 0x7fe180086ff0 2023-10-06T01:41:29.273 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:29.270+0000 7fe186b44700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fe1800b21b0 0x7fe1800b25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:29.273 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:29.270+0000 7fe186b44700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fe1800b21b0 0x7fe1800b25f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:53138/0 (socket says 172.21.15.71:53138) 2023-10-06T01:41:29.273 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:29.270+0000 7fe186b44700 1 -- 172.21.15.71:0/3420089274 learned_addr learned my addr 172.21.15.71:0/3420089274 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:29.273 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:29.271+0000 7fe185b42700 1 --2- 172.21.15.71:0/3420089274 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe180086ff0 0x7fe180087440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:29.273 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:29.271+0000 7fe186b44700 1 -- 172.21.15.71:0/3420089274 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe180086ff0 msgr2=0x7fe180087440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:29.273 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:29.271+0000 7fe186b44700 1 --2- 172.21.15.71:0/3420089274 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe180086ff0 0x7fe180087440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:29.273 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:29.271+0000 7fe186b44700 1 -- 172.21.15.71:0/3420089274 >> v1:172.21.15.72:6789/0 conn(0x7fe18015a030 legacy=0x7fe18015a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:29.273 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:29.271+0000 7fe186b44700 1 -- 172.21.15.71:0/3420089274 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1800afc50 con 0x7fe1800b21b0 2023-10-06T01:41:29.273 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:29.271+0000 7fe186b44700 1 --2- 172.21.15.71:0/3420089274 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe1800b21b0 0x7fe1800b25f0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fe178009f20 tx=0x7fe178009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=191a0767935075e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:29.273 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:29.271+0000 7fe185341700 1 -- 172.21.15.71:0/3420089274 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe17800e070 con 0x7fe1800b21b0 2023-10-06T01:41:29.273 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:29.271+0000 7fe185341700 1 -- 172.21.15.71:0/3420089274 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe17800ba80 con 0x7fe1800b21b0 2023-10-06T01:41:29.274 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:29.271+0000 7fe185341700 1 -- 172.21.15.71:0/3420089274 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1780092e0 con 0x7fe1800b21b0 2023-10-06T01:41:29.274 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:29.271+0000 7fe1885a7700 1 -- 172.21.15.71:0/3420089274 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe1800b21b0 msgr2=0x7fe1800b25f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:29.274 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:29.271+0000 7fe1885a7700 1 --2- 172.21.15.71:0/3420089274 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe1800b21b0 0x7fe1800b25f0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fe178009f20 tx=0x7fe178009840 comp rx=0 tx=0).stop 2023-10-06T01:41:29.274 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:29.272+0000 7fe1885a7700 1 -- 172.21.15.71:0/3420089274 shutdown_connections 2023-10-06T01:41:29.274 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:29.272+0000 7fe1885a7700 1 --2- 172.21.15.71:0/3420089274 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe1800b21b0 0x7fe1800b25f0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:29.274 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:29.272+0000 7fe1885a7700 1 --2- 172.21.15.71:0/3420089274 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe180086ff0 0x7fe180087440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:29.274 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:29.272+0000 7fe1885a7700 1 -- 172.21.15.71:0/3420089274 >> 172.21.15.71:0/3420089274 conn(0x7fe180068680 msgr2=0x7fe180068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:29.274 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:29.272+0000 7fe1885a7700 1 -- 172.21.15.71:0/3420089274 shutdown_connections 2023-10-06T01:41:29.274 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:29.272+0000 7fe1885a7700 1 -- 172.21.15.71:0/3420089274 wait complete. 2023-10-06T01:41:29.277 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:29.273+0000 7fe1885a7700 1 Processor -- start 2023-10-06T01:41:29.277 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:29.273+0000 7fe1885a7700 1 -- start start 2023-10-06T01:41:29.277 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:29.273+0000 7fe1885a7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe180086ff0 0x7fe1800b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:29.277 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:29.273+0000 7fe1885a7700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe1800b21b0 0x7fe180158a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:29.277 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:29.273+0000 7fe1885a7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe18015a030 0x7fe180155c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:29.277 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:29.273+0000 7fe1885a7700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1800b3860 con 0x7fe1800b21b0 2023-10-06T01:41:29.277 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:29.273+0000 7fe1885a7700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1800b4d20 con 0x7fe18015a030 2023-10-06T01:41:29.278 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:29.273+0000 7fe1885a7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1800b3210 con 0x7fe180086ff0 2023-10-06T01:41:29.278 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:29.274+0000 7fe185b42700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe1800b21b0 0x7fe180158a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:29.278 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:29.274+0000 7fe185b42700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe1800b21b0 0x7fe180158a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:53152/0 (socket says 172.21.15.71:53152) 2023-10-06T01:41:29.278 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:29.274+0000 7fe185b42700 1 -- 172.21.15.71:0/2755039726 learned_addr learned my addr 172.21.15.71:0/2755039726 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:29.278 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:29.274+0000 7fe186343700 1 --2- 172.21.15.71:0/2755039726 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe180086ff0 0x7fe1800b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:29.278 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:29.274+0000 7fe186b44700 1 --2- 172.21.15.71:0/2755039726 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe18015a030 0x7fe180155c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:29.278 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:29.274+0000 7fe185b42700 1 -- 172.21.15.71:0/2755039726 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe180086ff0 msgr2=0x7fe1800b51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:29.278 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:29.274+0000 7fe185b42700 1 --2- 172.21.15.71:0/2755039726 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe180086ff0 0x7fe1800b51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:29.278 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:29.274+0000 7fe185b42700 1 -- 172.21.15.71:0/2755039726 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe18015a030 msgr2=0x7fe180155c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:29.278 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:29.274+0000 7fe185b42700 1 --2- 172.21.15.71:0/2755039726 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe18015a030 0x7fe180155c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:29.278 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:29.274+0000 7fe185b42700 1 -- 172.21.15.71:0/2755039726 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe178009ae0 con 0x7fe1800b21b0 2023-10-06T01:41:29.278 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:29.274+0000 7fe185b42700 1 --2- 172.21.15.71:0/2755039726 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe1800b21b0 0x7fe180158a10 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fe17000d890 tx=0x7fe170008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:29.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:29.274+0000 7fe1767fc700 1 -- 172.21.15.71:0/2755039726 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1700125f0 con 0x7fe1800b21b0 2023-10-06T01:41:29.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:29.274+0000 7fe1767fc700 1 -- 172.21.15.71:0/2755039726 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe170012770 con 0x7fe1800b21b0 2023-10-06T01:41:29.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:29.274+0000 7fe1885a7700 1 -- 172.21.15.71:0/2755039726 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1800b34f0 con 0x7fe1800b21b0 2023-10-06T01:41:29.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:29.274+0000 7fe1767fc700 1 -- 172.21.15.71:0/2755039726 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe170012b30 con 0x7fe1800b21b0 2023-10-06T01:41:29.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:29.274+0000 7fe1885a7700 1 -- 172.21.15.71:0/2755039726 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe180158f50 con 0x7fe1800b21b0 2023-10-06T01:41:29.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:29.275+0000 7fe1885a7700 1 -- 172.21.15.71:0/2755039726 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1800b3a10 con 0x7fe1800b21b0 2023-10-06T01:41:29.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:29.275+0000 7fe1767fc700 1 -- 172.21.15.71:0/2755039726 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe17001e460 con 0x7fe1800b21b0 2023-10-06T01:41:29.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:29.276+0000 7fe1767fc700 1 --2- 172.21.15.71:0/2755039726 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fe164066f30 0x7fe1640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:29.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:29.276+0000 7fe1767fc700 1 -- 172.21.15.71:0/2755039726 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fe170084d50 con 0x7fe1800b21b0 2023-10-06T01:41:29.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:29.276+0000 7fe186343700 1 --2- 172.21.15.71:0/2755039726 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fe164066f30 0x7fe1640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:29.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:29.276+0000 7fe186343700 1 --2- 172.21.15.71:0/2755039726 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fe164066f30 0x7fe1640693e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe17c0039e0 tx=0x7fe17c007ec0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:29.280 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:29.280+0000 7fe1767fc700 1 -- 172.21.15.71:0/2755039726 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe1800b3a10 con 0x7fe1800b21b0 2023-10-06T01:41:29.506 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:29.506+0000 7fe1885a7700 1 -- 172.21.15.71:0/2755039726 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fe180159170 con 0x7fe1800b21b0 2023-10-06T01:41:30.134 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.133+0000 7fe1767fc700 1 -- 172.21.15.71:0/2755039726 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe170088030 con 0x7fe1800b21b0 2023-10-06T01:41:30.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.136+0000 7fe1885a7700 1 -- 172.21.15.71:0/2755039726 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fe164066f30 msgr2=0x7fe1640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:30.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.136+0000 7fe1885a7700 1 --2- 172.21.15.71:0/2755039726 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fe164066f30 0x7fe1640693e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe17c0039e0 tx=0x7fe17c007ec0 comp rx=0 tx=0).stop 2023-10-06T01:41:30.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.136+0000 7fe1885a7700 1 -- 172.21.15.71:0/2755039726 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe1800b21b0 msgr2=0x7fe180158a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:30.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.136+0000 7fe1885a7700 1 --2- 172.21.15.71:0/2755039726 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe1800b21b0 0x7fe180158a10 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fe17000d890 tx=0x7fe170008040 comp rx=0 tx=0).stop 2023-10-06T01:41:30.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.136+0000 7fe1885a7700 1 -- 172.21.15.71:0/2755039726 shutdown_connections 2023-10-06T01:41:30.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.136+0000 7fe1885a7700 1 --2- 172.21.15.71:0/2755039726 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fe164066f30 0x7fe1640693e0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:30.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.136+0000 7fe1885a7700 1 --2- 172.21.15.71:0/2755039726 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe18015a030 0x7fe180155c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:30.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.136+0000 7fe1885a7700 1 --2- 172.21.15.71:0/2755039726 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe180086ff0 0x7fe1800b51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:30.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.136+0000 7fe1885a7700 1 --2- 172.21.15.71:0/2755039726 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe1800b21b0 0x7fe180158a10 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:30.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.136+0000 7fe1885a7700 1 -- 172.21.15.71:0/2755039726 >> 172.21.15.71:0/2755039726 conn(0x7fe180068680 msgr2=0x7fe180160760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:30.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.136+0000 7fe1885a7700 1 -- 172.21.15.71:0/2755039726 shutdown_connections 2023-10-06T01:41:30.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.136+0000 7fe1885a7700 1 -- 172.21.15.71:0/2755039726 wait complete. 2023-10-06T01:41:30.150 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T01:41:30.266 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.265+0000 7f7442d78700 1 Processor -- start 2023-10-06T01:41:30.266 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.265+0000 7f7442d78700 1 -- start start 2023-10-06T01:41:30.268 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.266+0000 7f7442d78700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f743c159400 0x7f743c0ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:30.268 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.266+0000 7f7442d78700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f743c0cd030 0x7f743c0cfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:30.268 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.266+0000 7f7442d78700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f743c0b3560 con 0x7f743c0cf1a0 2023-10-06T01:41:30.268 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.266+0000 7f7442d78700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f743c0cf6f0 con 0x7f743c159400 2023-10-06T01:41:30.268 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.266+0000 7f7442d78700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f743c0cf9d0 con 0x7f743c0cd030 2023-10-06T01:41:30.268 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.266+0000 7f7441d76700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f743c159400 0x7f743c0ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:30.269 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.266+0000 7f7441d76700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f743c159400 0x7f743c0ccaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37718/0 (socket says 172.21.15.71:37718) 2023-10-06T01:41:30.269 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.266+0000 7f7441d76700 1 -- 172.21.15.71:0/3844480633 learned_addr learned my addr 172.21.15.71:0/3844480633 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:30.269 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.266+0000 7f7441575700 1 --2- 172.21.15.71:0/3844480633 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f743c0cd030 0x7f743c0cfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:30.269 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.266+0000 7f7441d76700 1 -- 172.21.15.71:0/3844480633 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f743c0cd030 msgr2=0x7f743c0cfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:30.269 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.266+0000 7f7441d76700 1 --2- 172.21.15.71:0/3844480633 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f743c0cd030 0x7f743c0cfec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:30.269 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.267+0000 7f7441d76700 1 -- 172.21.15.71:0/3844480633 >> v1:172.21.15.72:6789/0 conn(0x7f743c0cf1a0 legacy=0x7f743c0b5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:30.269 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.267+0000 7f7441d76700 1 -- 172.21.15.71:0/3844480633 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f743c0b2f10 con 0x7f743c159400 2023-10-06T01:41:30.269 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.267+0000 7f7441d76700 1 --2- 172.21.15.71:0/3844480633 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f743c159400 0x7f743c0ccaf0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f7438009990 tx=0x7f7438009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a5d5165ffa26ed5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:30.269 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.267+0000 7f7440d74700 1 -- 172.21.15.71:0/3844480633 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7438005c10 con 0x7f743c159400 2023-10-06T01:41:30.269 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.267+0000 7f7440d74700 1 -- 172.21.15.71:0/3844480633 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7438005d70 con 0x7f743c159400 2023-10-06T01:41:30.269 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.267+0000 7f7440d74700 1 -- 172.21.15.71:0/3844480633 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f743800b840 con 0x7f743c159400 2023-10-06T01:41:30.270 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.267+0000 7f7442d78700 1 -- 172.21.15.71:0/3844480633 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f743c159400 msgr2=0x7f743c0ccaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:30.270 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.267+0000 7f7442d78700 1 --2- 172.21.15.71:0/3844480633 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f743c159400 0x7f743c0ccaf0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f7438009990 tx=0x7f7438009220 comp rx=0 tx=0).stop 2023-10-06T01:41:30.270 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.267+0000 7f7442d78700 1 -- 172.21.15.71:0/3844480633 shutdown_connections 2023-10-06T01:41:30.270 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.267+0000 7f7442d78700 1 --2- 172.21.15.71:0/3844480633 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f743c159400 0x7f743c0ccaf0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:30.270 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.267+0000 7f7442d78700 1 --2- 172.21.15.71:0/3844480633 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f743c0cd030 0x7f743c0cfec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:30.270 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.267+0000 7f7442d78700 1 -- 172.21.15.71:0/3844480633 >> 172.21.15.71:0/3844480633 conn(0x7f743c06ac10 msgr2=0x7f743c068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:30.270 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.267+0000 7f7442d78700 1 -- 172.21.15.71:0/3844480633 shutdown_connections 2023-10-06T01:41:30.270 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.267+0000 7f7442d78700 1 -- 172.21.15.71:0/3844480633 wait complete. 2023-10-06T01:41:30.273 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.268+0000 7f7442d78700 1 Processor -- start 2023-10-06T01:41:30.273 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.269+0000 7f7442d78700 1 -- start start 2023-10-06T01:41:30.273 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.269+0000 7f7442d78700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f743c0cd030 0x7f743c0cb980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:30.273 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.269+0000 7f7442d78700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f743c0cf1a0 0x7f743c1698d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:30.273 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.269+0000 7f7442d78700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f743c159400 0x7f743c16d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:30.273 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.269+0000 7f7442d78700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f743c16d280 con 0x7f743c159400 2023-10-06T01:41:30.273 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.269+0000 7f7442d78700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f743c16cf30 con 0x7f743c0cd030 2023-10-06T01:41:30.273 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.269+0000 7f7442d78700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f743c16a180 con 0x7f743c0cf1a0 2023-10-06T01:41:30.273 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.269+0000 7f7442577700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f743c159400 0x7f743c16d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:30.274 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.269+0000 7f7442577700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f743c159400 0x7f743c16d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37734/0 (socket says 172.21.15.71:37734) 2023-10-06T01:41:30.274 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.269+0000 7f7442577700 1 -- 172.21.15.71:0/222724817 learned_addr learned my addr 172.21.15.71:0/222724817 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:30.274 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.270+0000 7f7441575700 1 --2- 172.21.15.71:0/222724817 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f743c0cf1a0 0x7f743c1698d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:30.274 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.270+0000 7f7442577700 1 -- 172.21.15.71:0/222724817 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f743c0cf1a0 msgr2=0x7f743c1698d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:30.274 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.270+0000 7f7441d76700 1 --2- 172.21.15.71:0/222724817 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f743c0cd030 0x7f743c0cb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:30.274 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.270+0000 7f7442577700 1 --2- 172.21.15.71:0/222724817 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f743c0cf1a0 0x7f743c1698d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:30.274 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.270+0000 7f7442577700 1 -- 172.21.15.71:0/222724817 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f743c0cd030 msgr2=0x7f743c0cb980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:30.274 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.270+0000 7f7442577700 1 --2- 172.21.15.71:0/222724817 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f743c0cd030 0x7f743c0cb980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:30.274 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.270+0000 7f7442577700 1 -- 172.21.15.71:0/222724817 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7438009480 con 0x7f743c159400 2023-10-06T01:41:30.274 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.270+0000 7f7442577700 1 --2- 172.21.15.71:0/222724817 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f743c159400 0x7f743c16d710 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f743400c930 tx=0x7f74340026e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:30.274 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.270+0000 7f7431ffb700 1 -- 172.21.15.71:0/222724817 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f743400ce70 con 0x7f743c159400 2023-10-06T01:41:30.275 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.270+0000 7f7431ffb700 1 -- 172.21.15.71:0/222724817 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f743400a7e0 con 0x7f743c159400 2023-10-06T01:41:30.275 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.270+0000 7f7442d78700 1 -- 172.21.15.71:0/222724817 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f743c16a460 con 0x7f743c159400 2023-10-06T01:41:30.275 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.270+0000 7f7431ffb700 1 -- 172.21.15.71:0/222724817 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f743400aba0 con 0x7f743c159400 2023-10-06T01:41:30.275 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.270+0000 7f7442d78700 1 -- 172.21.15.71:0/222724817 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f743c169e10 con 0x7f743c159400 2023-10-06T01:41:30.275 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.271+0000 7f7442d78700 1 -- 172.21.15.71:0/222724817 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f743c16d430 con 0x7f743c159400 2023-10-06T01:41:30.275 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.271+0000 7f7431ffb700 1 -- 172.21.15.71:0/222724817 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7434012420 con 0x7f743c159400 2023-10-06T01:41:30.275 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.272+0000 7f7431ffb700 1 --2- 172.21.15.71:0/222724817 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7420066f30 0x7f74200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:30.275 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.272+0000 7f7431ffb700 1 -- 172.21.15.71:0/222724817 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f7434084bc0 con 0x7f743c159400 2023-10-06T01:41:30.275 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.272+0000 7f7441d76700 1 --2- 172.21.15.71:0/222724817 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7420066f30 0x7f74200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:30.275 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.272+0000 7f7441d76700 1 --2- 172.21.15.71:0/222724817 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7420066f30 0x7f74200693e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7438007fd0 tx=0x7f7438015000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:30.276 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.276+0000 7f7431ffb700 1 -- 172.21.15.71:0/222724817 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f743c16d430 con 0x7f743c159400 2023-10-06T01:41:30.502 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.501+0000 7f7442d78700 1 -- 172.21.15.71:0/222724817 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f743c159860 con 0x7f743c159400 2023-10-06T01:41:30.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.502+0000 7f7431ffb700 1 -- 172.21.15.71:0/222724817 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4597 (secure 0 0 0) 0x7f7434051c40 con 0x7f743c159400 2023-10-06T01:41:30.503 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:41:30.503 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5020,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/2765166441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6833","nonce":2765166441},{"type":"v1","addr":"172.21.15.72:6835","nonce":2765166441}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5145,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6836/1993673980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":1993673980},{"type":"v1","addr":"172.21.15.71:6836","nonce":1993673980}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5148,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/3598886363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6835","nonce":3598886363},{"type":"v1","addr":"172.21.15.71:6837","nonce":3598886363}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T01:41:26.474510+0000","modified":"2023-10-06T01:41:30.131784+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5157},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5157":{"gid":5157,"name":"d","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6834/2476889061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":2476889061},{"type":"v1","addr":"172.21.15.72:6834","nonce":2476889061}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T01:41:30.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.504+0000 7f7442d78700 1 -- 172.21.15.71:0/222724817 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7420066f30 msgr2=0x7f74200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:30.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.504+0000 7f7442d78700 1 --2- 172.21.15.71:0/222724817 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7420066f30 0x7f74200693e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7438007fd0 tx=0x7f7438015000 comp rx=0 tx=0).stop 2023-10-06T01:41:30.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.504+0000 7f7442d78700 1 -- 172.21.15.71:0/222724817 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f743c159400 msgr2=0x7f743c16d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:30.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.504+0000 7f7442d78700 1 --2- 172.21.15.71:0/222724817 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f743c159400 0x7f743c16d710 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f743400c930 tx=0x7f74340026e0 comp rx=0 tx=0).stop 2023-10-06T01:41:30.506 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.504+0000 7f7442d78700 1 -- 172.21.15.71:0/222724817 shutdown_connections 2023-10-06T01:41:30.506 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.504+0000 7f7442d78700 1 --2- 172.21.15.71:0/222724817 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f743c159400 0x7f743c16d710 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:30.506 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.504+0000 7f7442d78700 1 --2- 172.21.15.71:0/222724817 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7420066f30 0x7f74200693e0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:30.506 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.504+0000 7f7442d78700 1 --2- 172.21.15.71:0/222724817 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f743c0cd030 0x7f743c0cb980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:30.506 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.504+0000 7f7442d78700 1 --2- 172.21.15.71:0/222724817 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f743c0cf1a0 0x7f743c1698d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:30.506 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.504+0000 7f7442d78700 1 -- 172.21.15.71:0/222724817 >> 172.21.15.71:0/222724817 conn(0x7f743c06ac10 msgr2=0x7f743c157c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:30.506 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.504+0000 7f7442d78700 1 -- 172.21.15.71:0/222724817 shutdown_connections 2023-10-06T01:41:30.506 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.504+0000 7f7442d78700 1 -- 172.21.15.71:0/222724817 wait complete. 2023-10-06T01:41:30.507 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 18 2023-10-06T01:41:30.517 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:41:30.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.630+0000 7fc798163700 1 Processor -- start 2023-10-06T01:41:30.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.630+0000 7fc798163700 1 -- start start 2023-10-06T01:41:30.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.631+0000 7fc798163700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc7900af8b0 0x7fc79015d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:30.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.631+0000 7fc798163700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc7900b27f0 0x7fc79015d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:30.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.631+0000 7fc798163700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc79015e190 con 0x7fc7900af4e0 2023-10-06T01:41:30.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.631+0000 7fc798163700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7900b1910 con 0x7fc7900b27f0 2023-10-06T01:41:30.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.631+0000 7fc798163700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7900cb650 con 0x7fc7900af8b0 2023-10-06T01:41:30.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.631+0000 7fc796700700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fc7900b27f0 0x7fc79015d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:30.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.631+0000 7fc795eff700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fc7900af4e0 0x7fc7900b20e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:58102/0 (socket says 172.21.15.71:58102) 2023-10-06T01:41:30.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.631+0000 7fc795eff700 1 -- 172.21.15.71:0/617816347 learned_addr learned my addr 172.21.15.71:0/617816347 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:41:30.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.631+0000 7fc7956fe700 1 --2- 172.21.15.71:0/617816347 >> v2:172.21.15.72:3300/0 conn(0x7fc7900af8b0 0x7fc79015d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:30.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.632+0000 7fc796700700 1 -- 172.21.15.71:0/617816347 >> v2:172.21.15.72:3300/0 conn(0x7fc7900af8b0 msgr2=0x7fc79015d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:30.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.632+0000 7fc796700700 1 --2- 172.21.15.71:0/617816347 >> v2:172.21.15.72:3300/0 conn(0x7fc7900af8b0 0x7fc79015d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:30.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.632+0000 7fc796700700 1 -- 172.21.15.71:0/617816347 >> v1:172.21.15.71:6789/0 conn(0x7fc7900af4e0 legacy=0x7fc7900b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:30.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.632+0000 7fc794efd700 1 -- 172.21.15.71:0/617816347 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1601124327 0 0) 0x7fc79015e190 con 0x7fc7900af4e0 2023-10-06T01:41:30.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.632+0000 7fc796700700 1 -- 172.21.15.71:0/617816347 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7900ccaf0 con 0x7fc7900b27f0 2023-10-06T01:41:30.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.632+0000 7fc796700700 1 --2- 172.21.15.71:0/617816347 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc7900b27f0 0x7fc79015d9a0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fc7900cdd50 tx=0x7fc7880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ada4f57d9b75169 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:30.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.632+0000 7fc794efd700 1 -- 172.21.15.71:0/617816347 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc78800b6b0 con 0x7fc7900b27f0 2023-10-06T01:41:30.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.632+0000 7fc794efd700 1 -- 172.21.15.71:0/617816347 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc78800b810 con 0x7fc7900b27f0 2023-10-06T01:41:30.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.632+0000 7fc794efd700 1 -- 172.21.15.71:0/617816347 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc78800bbb0 con 0x7fc7900b27f0 2023-10-06T01:41:30.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.632+0000 7fc798163700 1 -- 172.21.15.71:0/617816347 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc7900b27f0 msgr2=0x7fc79015d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:30.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.632+0000 7fc798163700 1 --2- 172.21.15.71:0/617816347 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc7900b27f0 0x7fc79015d9a0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fc7900cdd50 tx=0x7fc7880091a0 comp rx=0 tx=0).stop 2023-10-06T01:41:30.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.632+0000 7fc798163700 1 -- 172.21.15.71:0/617816347 shutdown_connections 2023-10-06T01:41:30.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.632+0000 7fc798163700 1 --2- 172.21.15.71:0/617816347 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc7900b27f0 0x7fc79015d9a0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:30.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.632+0000 7fc798163700 1 --2- 172.21.15.71:0/617816347 >> v2:172.21.15.72:3300/0 conn(0x7fc7900af8b0 0x7fc79015d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:30.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.632+0000 7fc798163700 1 -- 172.21.15.71:0/617816347 >> 172.21.15.71:0/617816347 conn(0x7fc790068680 msgr2=0x7fc790068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:30.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.633+0000 7fc798163700 1 -- 172.21.15.71:0/617816347 shutdown_connections 2023-10-06T01:41:30.635 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.633+0000 7fc798163700 1 -- 172.21.15.71:0/617816347 wait complete. 2023-10-06T01:41:30.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.634+0000 7fc798163700 1 Processor -- start 2023-10-06T01:41:30.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.634+0000 7fc798163700 1 -- start start 2023-10-06T01:41:30.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.634+0000 7fc798163700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc7900af4e0 0x7fc7900cedf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:30.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.634+0000 7fc798163700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc7900af8b0 0x7fc790150b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:30.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.634+0000 7fc798163700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc7900b27f0 0x7fc7900c8360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:30.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.634+0000 7fc798163700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7900c9150 con 0x7fc7900b27f0 2023-10-06T01:41:30.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.634+0000 7fc798163700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc790156c80 con 0x7fc7900af4e0 2023-10-06T01:41:30.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.634+0000 7fc798163700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7901563b0 con 0x7fc7900af8b0 2023-10-06T01:41:30.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.634+0000 7fc796700700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc7900b27f0 0x7fc7900c8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:30.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.634+0000 7fc796700700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc7900b27f0 0x7fc7900c8360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37740/0 (socket says 172.21.15.71:37740) 2023-10-06T01:41:30.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.634+0000 7fc796700700 1 -- 172.21.15.71:0/3206824530 learned_addr learned my addr 172.21.15.71:0/3206824530 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:30.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.634+0000 7fc795eff700 1 --2- 172.21.15.71:0/3206824530 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc7900af4e0 0x7fc7900cedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:30.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.635+0000 7fc7956fe700 1 --2- 172.21.15.71:0/3206824530 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc7900af8b0 0x7fc790150b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:30.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.635+0000 7fc796700700 1 -- 172.21.15.71:0/3206824530 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc7900af8b0 msgr2=0x7fc790150b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:30.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.635+0000 7fc796700700 1 --2- 172.21.15.71:0/3206824530 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc7900af8b0 0x7fc790150b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:30.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.635+0000 7fc796700700 1 -- 172.21.15.71:0/3206824530 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc7900af4e0 msgr2=0x7fc7900cedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:30.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.635+0000 7fc796700700 1 --2- 172.21.15.71:0/3206824530 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc7900af4e0 0x7fc7900cedf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:30.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.635+0000 7fc796700700 1 -- 172.21.15.71:0/3206824530 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc788009420 con 0x7fc7900b27f0 2023-10-06T01:41:30.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.635+0000 7fc796700700 1 --2- 172.21.15.71:0/3206824530 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc7900b27f0 0x7fc7900c8360 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fc790089520 tx=0x7fc788017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:30.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.635+0000 7fc785ffb700 1 -- 172.21.15.71:0/3206824530 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc788011420 con 0x7fc7900b27f0 2023-10-06T01:41:30.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.635+0000 7fc785ffb700 1 -- 172.21.15.71:0/3206824530 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc788011580 con 0x7fc7900b27f0 2023-10-06T01:41:30.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.635+0000 7fc785ffb700 1 -- 172.21.15.71:0/3206824530 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc788011940 con 0x7fc7900b27f0 2023-10-06T01:41:30.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.635+0000 7fc798163700 1 -- 172.21.15.71:0/3206824530 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7900c8e70 con 0x7fc7900b27f0 2023-10-06T01:41:30.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.635+0000 7fc798163700 1 -- 172.21.15.71:0/3206824530 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc790156910 con 0x7fc7900b27f0 2023-10-06T01:41:30.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.636+0000 7fc798163700 1 -- 172.21.15.71:0/3206824530 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc790156e10 con 0x7fc7900b27f0 2023-10-06T01:41:30.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.637+0000 7fc785ffb700 1 -- 172.21.15.71:0/3206824530 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc788011cb0 con 0x7fc7900b27f0 2023-10-06T01:41:30.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.637+0000 7fc785ffb700 1 --2- 172.21.15.71:0/3206824530 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fc774066f30 0x7fc7740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:30.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.637+0000 7fc785ffb700 1 -- 172.21.15.71:0/3206824530 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fc7880861a0 con 0x7fc7900b27f0 2023-10-06T01:41:30.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.637+0000 7fc795eff700 1 --2- 172.21.15.71:0/3206824530 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fc774066f30 0x7fc7740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:30.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.637+0000 7fc795eff700 1 --2- 172.21.15.71:0/3206824530 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fc774066f30 0x7fc7740693e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc78c007240 tx=0x7fc78c001970 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:30.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.641+0000 7fc785ffb700 1 -- 172.21.15.71:0/3206824530 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc788053170 con 0x7fc7900b27f0 2023-10-06T01:41:30.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.824+0000 7fc798163700 1 -- 172.21.15.71:0/3206824530 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc7900b13e0 con 0x7fc7900b27f0 2023-10-06T01:41:30.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.825+0000 7fc785ffb700 1 -- 172.21.15.71:0/3206824530 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+17023 (secure 0 0 0) 0x7fc788056790 con 0x7fc7900b27f0 2023-10-06T01:41:30.826 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:41:30.827 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":41,"fsid":"1fbf1bd2-f9b4-4599-bea2-f4aa920e9a56","created":"2023-10-06T01:39:57.016957+0000","modified":"2023-10-06T01:41:27.809737+0000","last_up_change":"2023-10-06T01:40:08.571643+0000","last_in_change":"2023-10-06T01:39:59.462741+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T01:40:08.610349+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T01:40:15.387434+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-06T01:41:24.561219+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-06T01:41:25.445423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cf059188-fb20-4dbf-95db-dcf57b213d03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":90670},{"type":"v1","addr":"172.21.15.71:6817","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":90670},{"type":"v1","addr":"172.21.15.71:6819","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":90670},{"type":"v1","addr":"172.21.15.71:6823","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":90670},{"type":"v1","addr":"172.21.15.71:6821","nonce":90670}]},"public_addr":"172.21.15.71:6817/90670","cluster_addr":"172.21.15.71:6819/90670","heartbeat_back_addr":"172.21.15.71:6823/90670","heartbeat_front_addr":"172.21.15.71:6821/90670","state":["exists","up"]},{"osd":1,"uuid":"0cff0aae-1799-4fe0-b610-54cf0813c0e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":90669},{"type":"v1","addr":"172.21.15.71:6809","nonce":90669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":90669},{"type":"v1","addr":"172.21.15.71:6811","nonce":90669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":90669},{"type":"v1","addr":"172.21.15.71:6815","nonce":90669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":90669},{"type":"v1","addr":"172.21.15.71:6813","nonce":90669}]},"public_addr":"172.21.15.71:6809/90669","cluster_addr":"172.21.15.71:6811/90669","heartbeat_back_addr":"172.21.15.71:6815/90669","heartbeat_front_addr":"172.21.15.71:6813/90669","state":["exists","up"]},{"osd":2,"uuid":"88d61ddc-9031-44e1-ba8c-546a41e7c8ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":90679},{"type":"v1","addr":"172.21.15.71:6825","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":90679},{"type":"v1","addr":"172.21.15.71:6827","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":90679},{"type":"v1","addr":"172.21.15.71:6831","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":90679},{"type":"v1","addr":"172.21.15.71:6829","nonce":90679}]},"public_addr":"172.21.15.71:6825/90679","cluster_addr":"172.21.15.71:6827/90679","heartbeat_back_addr":"172.21.15.71:6831/90679","heartbeat_front_addr":"172.21.15.71:6829/90679","state":["exists","up"]},{"osd":3,"uuid":"11ed92b7-960b-4a30-a889-a61d3eeb86f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":90668},{"type":"v1","addr":"172.21.15.71:6801","nonce":90668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":90668},{"type":"v1","addr":"172.21.15.71:6803","nonce":90668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":90668},{"type":"v1","addr":"172.21.15.71:6807","nonce":90668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":90668},{"type":"v1","addr":"172.21.15.71:6805","nonce":90668}]},"public_addr":"172.21.15.71:6801/90668","cluster_addr":"172.21.15.71:6803/90668","heartbeat_back_addr":"172.21.15.71:6807/90668","heartbeat_front_addr":"172.21.15.71:6805/90668","state":["exists","up"]},{"osd":4,"uuid":"ae4df784-abdf-4ddf-aefa-780f3ddafef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":90917},{"type":"v1","addr":"172.21.15.72:6801","nonce":90917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":90917},{"type":"v1","addr":"172.21.15.72:6803","nonce":90917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":90917},{"type":"v1","addr":"172.21.15.72:6807","nonce":90917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":90917},{"type":"v1","addr":"172.21.15.72:6805","nonce":90917}]},"public_addr":"172.21.15.72:6801/90917","cluster_addr":"172.21.15.72:6803/90917","heartbeat_back_addr":"172.21.15.72:6807/90917","heartbeat_front_addr":"172.21.15.72:6805/90917","state":["exists","up"]},{"osd":5,"uuid":"5ef0790f-001e-458f-a05b-efae216cf435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":90941},{"type":"v1","addr":"172.21.15.72:6817","nonce":90941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":90941},{"type":"v1","addr":"172.21.15.72:6819","nonce":90941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":90941},{"type":"v1","addr":"172.21.15.72:6827","nonce":90941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":90941},{"type":"v1","addr":"172.21.15.72:6823","nonce":90941}]},"public_addr":"172.21.15.72:6817/90941","cluster_addr":"172.21.15.72:6819/90941","heartbeat_back_addr":"172.21.15.72:6827/90941","heartbeat_front_addr":"172.21.15.72:6823/90941","state":["exists","up"]},{"osd":6,"uuid":"8705aef1-9ae8-4e54-a3c4-c2909fa0ceb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":90918},{"type":"v1","addr":"172.21.15.72:6809","nonce":90918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":90918},{"type":"v1","addr":"172.21.15.72:6811","nonce":90918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":90918},{"type":"v1","addr":"172.21.15.72:6815","nonce":90918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":90918},{"type":"v1","addr":"172.21.15.72:6813","nonce":90918}]},"public_addr":"172.21.15.72:6809/90918","cluster_addr":"172.21.15.72:6811/90918","heartbeat_back_addr":"172.21.15.72:6815/90918","heartbeat_front_addr":"172.21.15.72:6813/90918","state":["exists","up"]},{"osd":7,"uuid":"364c5119-6b13-4c75-b3f0-15e165eff86a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":90948},{"type":"v1","addr":"172.21.15.72:6822","nonce":90948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":90948},{"type":"v1","addr":"172.21.15.72:6826","nonce":90948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":90948},{"type":"v1","addr":"172.21.15.72:6831","nonce":90948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":90948},{"type":"v1","addr":"172.21.15.72:6829","nonce":90948}]},"public_addr":"172.21.15.72:6822/90948","cluster_addr":"172.21.15.72:6826/90948","heartbeat_back_addr":"172.21.15.72:6831/90948","heartbeat_front_addr":"172.21.15.72:6829/90948","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.642976+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.645372+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.619116+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.663042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.599163+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.646411+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.631545+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.669821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:41:30.828 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.827+0000 7fc798163700 1 -- 172.21.15.71:0/3206824530 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fc774066f30 msgr2=0x7fc7740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:30.828 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.827+0000 7fc798163700 1 --2- 172.21.15.71:0/3206824530 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fc774066f30 0x7fc7740693e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc78c007240 tx=0x7fc78c001970 comp rx=0 tx=0).stop 2023-10-06T01:41:30.828 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.827+0000 7fc798163700 1 -- 172.21.15.71:0/3206824530 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc7900b27f0 msgr2=0x7fc7900c8360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:30.828 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.827+0000 7fc798163700 1 --2- 172.21.15.71:0/3206824530 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc7900b27f0 0x7fc7900c8360 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fc790089520 tx=0x7fc788017000 comp rx=0 tx=0).stop 2023-10-06T01:41:30.829 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.827+0000 7fc798163700 1 -- 172.21.15.71:0/3206824530 shutdown_connections 2023-10-06T01:41:30.829 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.827+0000 7fc798163700 1 --2- 172.21.15.71:0/3206824530 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc7900b27f0 0x7fc7900c8360 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:30.829 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.827+0000 7fc798163700 1 --2- 172.21.15.71:0/3206824530 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fc774066f30 0x7fc7740693e0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:30.829 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.827+0000 7fc798163700 1 --2- 172.21.15.71:0/3206824530 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc7900af4e0 0x7fc7900cedf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:30.829 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.827+0000 7fc798163700 1 --2- 172.21.15.71:0/3206824530 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc7900af8b0 0x7fc790150b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:30.829 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.827+0000 7fc798163700 1 -- 172.21.15.71:0/3206824530 >> 172.21.15.71:0/3206824530 conn(0x7fc790068680 msgr2=0x7fc7900b4910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:30.829 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.827+0000 7fc798163700 1 -- 172.21.15.71:0/3206824530 shutdown_connections 2023-10-06T01:41:30.829 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.827+0000 7fc798163700 1 -- 172.21.15.71:0/3206824530 wait complete. 2023-10-06T01:41:30.840 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T01:41:30.840 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T01:41:30.954 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.953+0000 7f3c18ea9700 1 Processor -- start 2023-10-06T01:41:30.954 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.953+0000 7f3c18ea9700 1 -- start start 2023-10-06T01:41:30.956 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.954+0000 7f3c18ea9700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f3c141593f0 0x7f3c1406de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:30.957 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.954+0000 7f3c18ea9700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3c1406adf0 0x7f3c1406e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:30.957 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.954+0000 7f3c18ea9700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c14069950 con 0x7f3c141597c0 2023-10-06T01:41:30.957 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.954+0000 7f3c18ea9700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c140b2850 con 0x7f3c141593f0 2023-10-06T01:41:30.957 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.954+0000 7f3c18ea9700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c140b1fb0 con 0x7f3c1406adf0 2023-10-06T01:41:30.957 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.954+0000 7f3c1259c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f3c141593f0 0x7f3c1406de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:30.957 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.954+0000 7f3c1259c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f3c141593f0 0x7f3c1406de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37744/0 (socket says 172.21.15.71:37744) 2023-10-06T01:41:30.957 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.954+0000 7f3c1259c700 1 -- 172.21.15.71:0/1544821796 learned_addr learned my addr 172.21.15.71:0/1544821796 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:30.957 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.954+0000 7f3c12d9d700 1 --2- 172.21.15.71:0/1544821796 >> v2:172.21.15.72:3300/0 conn(0x7f3c1406adf0 0x7f3c1406e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:30.957 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.955+0000 7f3c1259c700 1 -- 172.21.15.71:0/1544821796 >> v2:172.21.15.72:3300/0 conn(0x7f3c1406adf0 msgr2=0x7f3c1406e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:30.957 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.955+0000 7f3c1259c700 1 --2- 172.21.15.71:0/1544821796 >> v2:172.21.15.72:3300/0 conn(0x7f3c1406adf0 0x7f3c1406e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:30.958 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.955+0000 7f3c1259c700 1 -- 172.21.15.71:0/1544821796 >> v1:172.21.15.72:6789/0 conn(0x7f3c141597c0 legacy=0x7f3c1415d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:30.958 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.955+0000 7f3c1259c700 1 -- 172.21.15.71:0/1544821796 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c140b2290 con 0x7f3c141593f0 2023-10-06T01:41:30.958 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.955+0000 7f3c1259c700 1 --2- 172.21.15.71:0/1544821796 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3c141593f0 0x7f3c1406de10 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f3c140ada90 tx=0x7f3c04009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bcfcf34811a72ea server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:30.958 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.955+0000 7f3c11d9b700 1 -- 172.21.15.71:0/1544821796 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c04009e70 con 0x7f3c141593f0 2023-10-06T01:41:30.958 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.955+0000 7f3c11d9b700 1 -- 172.21.15.71:0/1544821796 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c0400b860 con 0x7f3c141593f0 2023-10-06T01:41:30.958 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.955+0000 7f3c11d9b700 1 -- 172.21.15.71:0/1544821796 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c0400bc00 con 0x7f3c141593f0 2023-10-06T01:41:30.958 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.956+0000 7f3c18ea9700 1 -- 172.21.15.71:0/1544821796 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3c141593f0 msgr2=0x7f3c1406de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:30.958 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.956+0000 7f3c18ea9700 1 --2- 172.21.15.71:0/1544821796 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3c141593f0 0x7f3c1406de10 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f3c140ada90 tx=0x7f3c04009250 comp rx=0 tx=0).stop 2023-10-06T01:41:30.958 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.956+0000 7f3c18ea9700 1 -- 172.21.15.71:0/1544821796 shutdown_connections 2023-10-06T01:41:30.958 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.956+0000 7f3c18ea9700 1 --2- 172.21.15.71:0/1544821796 >> v2:172.21.15.72:3300/0 conn(0x7f3c1406adf0 0x7f3c1406e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:30.958 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.956+0000 7f3c18ea9700 1 --2- 172.21.15.71:0/1544821796 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3c141593f0 0x7f3c1406de10 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:30.958 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.956+0000 7f3c18ea9700 1 -- 172.21.15.71:0/1544821796 >> 172.21.15.71:0/1544821796 conn(0x7f3c1406cff0 msgr2=0x7f3c140afaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:30.959 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.956+0000 7f3c18ea9700 1 -- 172.21.15.71:0/1544821796 shutdown_connections 2023-10-06T01:41:30.959 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.956+0000 7f3c18ea9700 1 -- 172.21.15.71:0/1544821796 wait complete. 2023-10-06T01:41:30.961 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.957+0000 7f3c18ea9700 1 Processor -- start 2023-10-06T01:41:30.961 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.957+0000 7f3c18ea9700 1 -- start start 2023-10-06T01:41:30.961 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.957+0000 7f3c18ea9700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3c1406adf0 0x7f3c140c8970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:30.961 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.957+0000 7f3c18ea9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c141593f0 0x7f3c1416ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:30.961 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.957+0000 7f3c18ea9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3c141597c0 0x7f3c141677d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:30.961 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.957+0000 7f3c18ea9700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c1416b2a0 con 0x7f3c1406adf0 2023-10-06T01:41:30.962 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.957+0000 7f3c18ea9700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c1416b4d0 con 0x7f3c141593f0 2023-10-06T01:41:30.962 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.957+0000 7f3c18ea9700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c1416b7b0 con 0x7f3c141597c0 2023-10-06T01:41:30.962 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.957+0000 7f3c1259c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3c1406adf0 0x7f3c140c8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:30.962 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.957+0000 7f3c1259c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3c1406adf0 0x7f3c140c8970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37758/0 (socket says 172.21.15.71:37758) 2023-10-06T01:41:30.962 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.958+0000 7f3c1259c700 1 -- 172.21.15.71:0/1216356354 learned_addr learned my addr 172.21.15.71:0/1216356354 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:30.962 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.958+0000 7f3c0bfff700 1 --2- 172.21.15.71:0/1216356354 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c141593f0 0x7f3c1416ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:30.962 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.958+0000 7f3c12d9d700 1 --2- 172.21.15.71:0/1216356354 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3c141597c0 0x7f3c141677d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:30.962 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.958+0000 7f3c1259c700 1 -- 172.21.15.71:0/1216356354 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3c141597c0 msgr2=0x7f3c141677d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:30.962 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.958+0000 7f3c1259c700 1 --2- 172.21.15.71:0/1216356354 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3c141597c0 0x7f3c141677d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:30.962 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.958+0000 7f3c1259c700 1 -- 172.21.15.71:0/1216356354 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c141593f0 msgr2=0x7f3c1416ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:30.962 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.958+0000 7f3c1259c700 1 --2- 172.21.15.71:0/1216356354 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c141593f0 0x7f3c1416ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:30.962 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.958+0000 7f3c1259c700 1 -- 172.21.15.71:0/1216356354 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c040094f0 con 0x7f3c1406adf0 2023-10-06T01:41:30.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.958+0000 7f3c1259c700 1 --2- 172.21.15.71:0/1216356354 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3c1406adf0 0x7f3c140c8970 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f3c1406fe40 tx=0x7f3c04017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:30.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.958+0000 7f3c0a7fc700 1 -- 172.21.15.71:0/1216356354 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c04011420 con 0x7f3c1406adf0 2023-10-06T01:41:30.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.958+0000 7f3c0a7fc700 1 -- 172.21.15.71:0/1216356354 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c04011580 con 0x7f3c1406adf0 2023-10-06T01:41:30.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.958+0000 7f3c18ea9700 1 -- 172.21.15.71:0/1216356354 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c1416ba90 con 0x7f3c1406adf0 2023-10-06T01:41:30.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.958+0000 7f3c0a7fc700 1 -- 172.21.15.71:0/1216356354 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c04011940 con 0x7f3c1406adf0 2023-10-06T01:41:30.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.958+0000 7f3c18ea9700 1 -- 172.21.15.71:0/1216356354 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c1416c050 con 0x7f3c1406adf0 2023-10-06T01:41:30.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.959+0000 7f3c18ea9700 1 -- 172.21.15.71:0/1216356354 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c1406d3f0 con 0x7f3c1406adf0 2023-10-06T01:41:30.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.959+0000 7f3c0a7fc700 1 -- 172.21.15.71:0/1216356354 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3c0402c3b0 con 0x7f3c1406adf0 2023-10-06T01:41:30.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.960+0000 7f3c0a7fc700 1 --2- 172.21.15.71:0/1216356354 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f3bf4066fb0 0x7f3bf4069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:30.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.960+0000 7f3c0a7fc700 1 -- 172.21.15.71:0/1216356354 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f3c04085e00 con 0x7f3c1406adf0 2023-10-06T01:41:30.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.960+0000 7f3c0bfff700 1 --2- 172.21.15.71:0/1216356354 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f3bf4066fb0 0x7f3bf4069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:30.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.960+0000 7f3c0bfff700 1 --2- 172.21.15.71:0/1216356354 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f3bf4066fb0 0x7f3bf4069460 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3c141550a0 tx=0x7f3bfc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:30.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:30.964+0000 7f3c0a7fc700 1 -- 172.21.15.71:0/1216356354 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3c04052d30 con 0x7f3c1406adf0 2023-10-06T01:41:31.089 INFO:tasks.ceph.mds.d.smithi072.stderr:2023-10-06T01:41:31.089+0000 7f55b032d700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T01:41:31.146 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.145+0000 7f3c18ea9700 1 -- 172.21.15.71:0/1216356354 --> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3c1406dbd0 con 0x7f3bf4066fb0 2023-10-06T01:41:31.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.154+0000 7f3c0a7fc700 1 -- 172.21.15.71:0/1216356354 <== mgr.4107 v2:172.21.15.71:6832/90436 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310770 (secure 0 0 0) 0x7f3c1406dbd0 con 0x7f3bf4066fb0 2023-10-06T01:41:31.158 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:41:31.160 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.157+0000 7f3c18ea9700 1 -- 172.21.15.71:0/1216356354 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f3bf4066fb0 msgr2=0x7f3bf4069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:31.161 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.157+0000 7f3c18ea9700 1 --2- 172.21.15.71:0/1216356354 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f3bf4066fb0 0x7f3bf4069460 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3c141550a0 tx=0x7f3bfc009040 comp rx=0 tx=0).stop 2023-10-06T01:41:31.161 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.157+0000 7f3c18ea9700 1 -- 172.21.15.71:0/1216356354 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3c1406adf0 msgr2=0x7f3c140c8970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:31.161 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.157+0000 7f3c18ea9700 1 --2- 172.21.15.71:0/1216356354 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3c1406adf0 0x7f3c140c8970 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f3c1406fe40 tx=0x7f3c04017000 comp rx=0 tx=0).stop 2023-10-06T01:41:31.161 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.157+0000 7f3c18ea9700 1 -- 172.21.15.71:0/1216356354 shutdown_connections 2023-10-06T01:41:31.161 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.157+0000 7f3c18ea9700 1 --2- 172.21.15.71:0/1216356354 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3c141597c0 0x7f3c141677d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:31.161 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.157+0000 7f3c18ea9700 1 --2- 172.21.15.71:0/1216356354 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3c1406adf0 0x7f3c140c8970 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:31.161 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.157+0000 7f3c18ea9700 1 --2- 172.21.15.71:0/1216356354 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f3bf4066fb0 0x7f3bf4069460 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:31.161 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.157+0000 7f3c18ea9700 1 --2- 172.21.15.71:0/1216356354 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3c141593f0 0x7f3c1416ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:31.161 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.157+0000 7f3c18ea9700 1 -- 172.21.15.71:0/1216356354 >> 172.21.15.71:0/1216356354 conn(0x7f3c1406cff0 msgr2=0x7f3c1415a640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:31.161 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.157+0000 7f3c18ea9700 1 -- 172.21.15.71:0/1216356354 shutdown_connections 2023-10-06T01:41:31.161 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.157+0000 7f3c18ea9700 1 -- 172.21.15.71:0/1216356354 wait complete. 2023-10-06T01:41:31.162 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2023-10-06T01:41:31.170 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":75,"stamp":"2023-10-06T01:41:30.578633+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":156,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2383236,"kb_used_data":4932,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752591484,"statfs":{"total":773094113280,"available":770653679616,"internally_reserved":0,"allocated":5050368,"data_stored":2881331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.485959"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.828660+0000","last_change":"2023-10-06T01:41:26.827558+0000","last_active":"2023-10-06T01:41:26.828660+0000","last_peered":"2023-10-06T01:41:26.828660+0000","last_clean":"2023-10-06T01:41:26.828660+0000","last_became_active":"2023-10-06T01:41:26.827254+0000","last_became_peered":"2023-10-06T01:41:26.827254+0000","last_unstale":"2023-10-06T01:41:26.828660+0000","last_undegraded":"2023-10-06T01:41:26.828660+0000","last_fullsized":"2023-10-06T01:41:26.828660+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:14:16.658005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.835682+0000","last_change":"2023-10-06T01:41:26.834572+0000","last_active":"2023-10-06T01:41:26.835682+0000","last_peered":"2023-10-06T01:41:26.835682+0000","last_clean":"2023-10-06T01:41:26.835682+0000","last_became_active":"2023-10-06T01:41:26.834299+0000","last_became_peered":"2023-10-06T01:41:26.834299+0000","last_unstale":"2023-10-06T01:41:26.835682+0000","last_undegraded":"2023-10-06T01:41:26.835682+0000","last_fullsized":"2023-10-06T01:41:26.835682+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:08:44.723266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.825626+0000","last_change":"2023-10-06T01:41:26.821688+0000","last_active":"2023-10-06T01:41:26.825626+0000","last_peered":"2023-10-06T01:41:26.825626+0000","last_clean":"2023-10-06T01:41:26.825626+0000","last_became_active":"2023-10-06T01:41:26.821424+0000","last_became_peered":"2023-10-06T01:41:26.821424+0000","last_unstale":"2023-10-06T01:41:26.825626+0000","last_undegraded":"2023-10-06T01:41:26.825626+0000","last_fullsized":"2023-10-06T01:41:26.825626+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:52:02.886097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.833219+0000","last_change":"2023-10-06T01:41:26.832578+0000","last_active":"2023-10-06T01:41:26.833219+0000","last_peered":"2023-10-06T01:41:26.833219+0000","last_clean":"2023-10-06T01:41:26.833219+0000","last_became_active":"2023-10-06T01:41:26.832401+0000","last_became_peered":"2023-10-06T01:41:26.832401+0000","last_unstale":"2023-10-06T01:41:26.833219+0000","last_undegraded":"2023-10-06T01:41:26.833219+0000","last_fullsized":"2023-10-06T01:41:26.833219+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:01:51.254365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.833668+0000","last_change":"2023-10-06T01:41:26.832196+0000","last_active":"2023-10-06T01:41:26.833668+0000","last_peered":"2023-10-06T01:41:26.833668+0000","last_clean":"2023-10-06T01:41:26.833668+0000","last_became_active":"2023-10-06T01:41:26.831826+0000","last_became_peered":"2023-10-06T01:41:26.831826+0000","last_unstale":"2023-10-06T01:41:26.833668+0000","last_undegraded":"2023-10-06T01:41:26.833668+0000","last_fullsized":"2023-10-06T01:41:26.833668+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:03:47.822189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.828804+0000","last_change":"2023-10-06T01:41:26.823100+0000","last_active":"2023-10-06T01:41:26.828804+0000","last_peered":"2023-10-06T01:41:26.828804+0000","last_clean":"2023-10-06T01:41:26.828804+0000","last_became_active":"2023-10-06T01:41:26.821627+0000","last_became_peered":"2023-10-06T01:41:26.821627+0000","last_unstale":"2023-10-06T01:41:26.828804+0000","last_undegraded":"2023-10-06T01:41:26.828804+0000","last_fullsized":"2023-10-06T01:41:26.828804+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:18:34.124375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.828287+0000","last_change":"2023-10-06T01:41:26.827224+0000","last_active":"2023-10-06T01:41:26.828287+0000","last_peered":"2023-10-06T01:41:26.828287+0000","last_clean":"2023-10-06T01:41:26.828287+0000","last_became_active":"2023-10-06T01:41:26.826393+0000","last_became_peered":"2023-10-06T01:41:26.826393+0000","last_unstale":"2023-10-06T01:41:26.828287+0000","last_undegraded":"2023-10-06T01:41:26.828287+0000","last_fullsized":"2023-10-06T01:41:26.828287+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:18:29.375501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.832594+0000","last_change":"2023-10-06T01:41:26.831677+0000","last_active":"2023-10-06T01:41:26.832594+0000","last_peered":"2023-10-06T01:41:26.832594+0000","last_clean":"2023-10-06T01:41:26.832594+0000","last_became_active":"2023-10-06T01:41:26.831441+0000","last_became_peered":"2023-10-06T01:41:26.831441+0000","last_unstale":"2023-10-06T01:41:26.832594+0000","last_undegraded":"2023-10-06T01:41:26.832594+0000","last_fullsized":"2023-10-06T01:41:26.832594+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:43:40.038663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.831498+0000","last_change":"2023-10-06T01:41:26.824289+0000","last_active":"2023-10-06T01:41:26.831498+0000","last_peered":"2023-10-06T01:41:26.831498+0000","last_clean":"2023-10-06T01:41:26.831498+0000","last_became_active":"2023-10-06T01:41:26.823622+0000","last_became_peered":"2023-10-06T01:41:26.823622+0000","last_unstale":"2023-10-06T01:41:26.831498+0000","last_undegraded":"2023-10-06T01:41:26.831498+0000","last_fullsized":"2023-10-06T01:41:26.831498+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:18:34.124375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.833848+0000","last_change":"2023-10-06T01:41:26.833145+0000","last_active":"2023-10-06T01:41:26.833848+0000","last_peered":"2023-10-06T01:41:26.833848+0000","last_clean":"2023-10-06T01:41:26.833848+0000","last_became_active":"2023-10-06T01:41:26.832828+0000","last_became_peered":"2023-10-06T01:41:26.832828+0000","last_unstale":"2023-10-06T01:41:26.833848+0000","last_undegraded":"2023-10-06T01:41:26.833848+0000","last_fullsized":"2023-10-06T01:41:26.833848+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:06:06.225550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.832397+0000","last_change":"2023-10-06T01:41:26.826901+0000","last_active":"2023-10-06T01:41:26.832397+0000","last_peered":"2023-10-06T01:41:26.832397+0000","last_clean":"2023-10-06T01:41:26.832397+0000","last_became_active":"2023-10-06T01:41:26.826646+0000","last_became_peered":"2023-10-06T01:41:26.826646+0000","last_unstale":"2023-10-06T01:41:26.832397+0000","last_undegraded":"2023-10-06T01:41:26.832397+0000","last_fullsized":"2023-10-06T01:41:26.832397+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:12:28.103885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.830082+0000","last_change":"2023-10-06T01:41:26.826137+0000","last_active":"2023-10-06T01:41:26.830082+0000","last_peered":"2023-10-06T01:41:26.830082+0000","last_clean":"2023-10-06T01:41:26.830082+0000","last_became_active":"2023-10-06T01:41:26.825488+0000","last_became_peered":"2023-10-06T01:41:26.825488+0000","last_unstale":"2023-10-06T01:41:26.830082+0000","last_undegraded":"2023-10-06T01:41:26.830082+0000","last_fullsized":"2023-10-06T01:41:26.830082+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:27:59.329803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.828348+0000","last_change":"2023-10-06T01:41:26.823986+0000","last_active":"2023-10-06T01:41:26.828348+0000","last_peered":"2023-10-06T01:41:26.828348+0000","last_clean":"2023-10-06T01:41:26.828348+0000","last_became_active":"2023-10-06T01:41:26.823610+0000","last_became_peered":"2023-10-06T01:41:26.823610+0000","last_unstale":"2023-10-06T01:41:26.828348+0000","last_undegraded":"2023-10-06T01:41:26.828348+0000","last_fullsized":"2023-10-06T01:41:26.828348+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:49:42.258001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.832101+0000","last_change":"2023-10-06T01:41:26.823787+0000","last_active":"2023-10-06T01:41:26.832101+0000","last_peered":"2023-10-06T01:41:26.832101+0000","last_clean":"2023-10-06T01:41:26.832101+0000","last_became_active":"2023-10-06T01:41:26.823527+0000","last_became_peered":"2023-10-06T01:41:26.823527+0000","last_unstale":"2023-10-06T01:41:26.832101+0000","last_undegraded":"2023-10-06T01:41:26.832101+0000","last_fullsized":"2023-10-06T01:41:26.832101+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:52:02.886097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.824178+0000","last_change":"2023-10-06T01:41:26.819931+0000","last_active":"2023-10-06T01:41:26.824178+0000","last_peered":"2023-10-06T01:41:26.824178+0000","last_clean":"2023-10-06T01:41:26.824178+0000","last_became_active":"2023-10-06T01:41:26.819675+0000","last_became_peered":"2023-10-06T01:41:26.819675+0000","last_unstale":"2023-10-06T01:41:26.824178+0000","last_undegraded":"2023-10-06T01:41:26.824178+0000","last_fullsized":"2023-10-06T01:41:26.824178+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:01:33.092370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.834565+0000","last_change":"2023-10-06T01:41:26.833492+0000","last_active":"2023-10-06T01:41:26.834565+0000","last_peered":"2023-10-06T01:41:26.834565+0000","last_clean":"2023-10-06T01:41:26.834565+0000","last_became_active":"2023-10-06T01:41:26.833121+0000","last_became_peered":"2023-10-06T01:41:26.833121+0000","last_unstale":"2023-10-06T01:41:26.834565+0000","last_undegraded":"2023-10-06T01:41:26.834565+0000","last_fullsized":"2023-10-06T01:41:26.834565+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:01:59.421328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.826704+0000","last_change":"2023-10-06T01:41:26.825219+0000","last_active":"2023-10-06T01:41:26.826704+0000","last_peered":"2023-10-06T01:41:26.826704+0000","last_clean":"2023-10-06T01:41:26.826704+0000","last_became_active":"2023-10-06T01:41:26.824341+0000","last_became_peered":"2023-10-06T01:41:26.824341+0000","last_unstale":"2023-10-06T01:41:26.826704+0000","last_undegraded":"2023-10-06T01:41:26.826704+0000","last_fullsized":"2023-10-06T01:41:26.826704+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:39:56.013958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.835710+0000","last_change":"2023-10-06T01:41:26.833788+0000","last_active":"2023-10-06T01:41:26.835710+0000","last_peered":"2023-10-06T01:41:26.835710+0000","last_clean":"2023-10-06T01:41:26.835710+0000","last_became_active":"2023-10-06T01:41:26.833160+0000","last_became_peered":"2023-10-06T01:41:26.833160+0000","last_unstale":"2023-10-06T01:41:26.835710+0000","last_undegraded":"2023-10-06T01:41:26.835710+0000","last_fullsized":"2023-10-06T01:41:26.835710+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:01.369719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.831361+0000","last_change":"2023-10-06T01:41:26.829947+0000","last_active":"2023-10-06T01:41:26.831361+0000","last_peered":"2023-10-06T01:41:26.831361+0000","last_clean":"2023-10-06T01:41:26.831361+0000","last_became_active":"2023-10-06T01:41:26.829659+0000","last_became_peered":"2023-10-06T01:41:26.829659+0000","last_unstale":"2023-10-06T01:41:26.831361+0000","last_undegraded":"2023-10-06T01:41:26.831361+0000","last_fullsized":"2023-10-06T01:41:26.831361+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:24:52.262682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.830148+0000","last_change":"2023-10-06T01:41:26.827260+0000","last_active":"2023-10-06T01:41:26.830148+0000","last_peered":"2023-10-06T01:41:26.830148+0000","last_clean":"2023-10-06T01:41:26.830148+0000","last_became_active":"2023-10-06T01:41:26.826780+0000","last_became_peered":"2023-10-06T01:41:26.826780+0000","last_unstale":"2023-10-06T01:41:26.830148+0000","last_undegraded":"2023-10-06T01:41:26.830148+0000","last_fullsized":"2023-10-06T01:41:26.830148+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:49:31.447635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.825956+0000","last_change":"2023-10-06T01:41:26.820610+0000","last_active":"2023-10-06T01:41:26.825956+0000","last_peered":"2023-10-06T01:41:26.825956+0000","last_clean":"2023-10-06T01:41:26.825956+0000","last_became_active":"2023-10-06T01:41:26.820352+0000","last_became_peered":"2023-10-06T01:41:26.820352+0000","last_unstale":"2023-10-06T01:41:26.825956+0000","last_undegraded":"2023-10-06T01:41:26.825956+0000","last_fullsized":"2023-10-06T01:41:26.825956+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:06:06.225550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.832332+0000","last_change":"2023-10-06T01:41:26.826878+0000","last_active":"2023-10-06T01:41:26.832332+0000","last_peered":"2023-10-06T01:41:26.832332+0000","last_clean":"2023-10-06T01:41:26.832332+0000","last_became_active":"2023-10-06T01:41:26.826618+0000","last_became_peered":"2023-10-06T01:41:26.826618+0000","last_unstale":"2023-10-06T01:41:26.832332+0000","last_undegraded":"2023-10-06T01:41:26.832332+0000","last_fullsized":"2023-10-06T01:41:26.832332+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:23:49.561289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.829399+0000","last_change":"2023-10-06T01:41:26.823743+0000","last_active":"2023-10-06T01:41:26.829399+0000","last_peered":"2023-10-06T01:41:26.829399+0000","last_clean":"2023-10-06T01:41:26.829399+0000","last_became_active":"2023-10-06T01:41:26.821147+0000","last_became_peered":"2023-10-06T01:41:26.821147+0000","last_unstale":"2023-10-06T01:41:26.829399+0000","last_undegraded":"2023-10-06T01:41:26.829399+0000","last_fullsized":"2023-10-06T01:41:26.829399+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:35:09.682504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.823577+0000","last_change":"2023-10-06T01:41:26.822044+0000","last_active":"2023-10-06T01:41:26.823577+0000","last_peered":"2023-10-06T01:41:26.823577+0000","last_clean":"2023-10-06T01:41:26.823577+0000","last_became_active":"2023-10-06T01:41:26.821848+0000","last_became_peered":"2023-10-06T01:41:26.821848+0000","last_unstale":"2023-10-06T01:41:26.823577+0000","last_undegraded":"2023-10-06T01:41:26.823577+0000","last_fullsized":"2023-10-06T01:41:26.823577+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:52:39.363663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.829300+0000","last_change":"2023-10-06T01:41:26.824652+0000","last_active":"2023-10-06T01:41:26.829300+0000","last_peered":"2023-10-06T01:41:26.829300+0000","last_clean":"2023-10-06T01:41:26.829300+0000","last_became_active":"2023-10-06T01:41:26.824400+0000","last_became_peered":"2023-10-06T01:41:26.824400+0000","last_unstale":"2023-10-06T01:41:26.829300+0000","last_undegraded":"2023-10-06T01:41:26.829300+0000","last_fullsized":"2023-10-06T01:41:26.829300+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:41:44.253849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.827151+0000","last_change":"2023-10-06T01:41:26.823376+0000","last_active":"2023-10-06T01:41:26.827151+0000","last_peered":"2023-10-06T01:41:26.827151+0000","last_clean":"2023-10-06T01:41:26.827151+0000","last_became_active":"2023-10-06T01:41:26.823125+0000","last_became_peered":"2023-10-06T01:41:26.823125+0000","last_unstale":"2023-10-06T01:41:26.827151+0000","last_undegraded":"2023-10-06T01:41:26.827151+0000","last_fullsized":"2023-10-06T01:41:26.827151+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:02:47.981436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.826669+0000","last_change":"2023-10-06T01:41:26.825096+0000","last_active":"2023-10-06T01:41:26.826669+0000","last_peered":"2023-10-06T01:41:26.826669+0000","last_clean":"2023-10-06T01:41:26.826669+0000","last_became_active":"2023-10-06T01:41:26.823940+0000","last_became_peered":"2023-10-06T01:41:26.823940+0000","last_unstale":"2023-10-06T01:41:26.826669+0000","last_undegraded":"2023-10-06T01:41:26.826669+0000","last_fullsized":"2023-10-06T01:41:26.826669+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:51:56.204830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.830104+0000","last_change":"2023-10-06T01:41:26.826290+0000","last_active":"2023-10-06T01:41:26.830104+0000","last_peered":"2023-10-06T01:41:26.830104+0000","last_clean":"2023-10-06T01:41:26.830104+0000","last_became_active":"2023-10-06T01:41:26.825851+0000","last_became_peered":"2023-10-06T01:41:26.825851+0000","last_unstale":"2023-10-06T01:41:26.830104+0000","last_undegraded":"2023-10-06T01:41:26.830104+0000","last_fullsized":"2023-10-06T01:41:26.830104+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:18:29.375501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.829345+0000","last_change":"2023-10-06T01:41:26.824866+0000","last_active":"2023-10-06T01:41:26.829345+0000","last_peered":"2023-10-06T01:41:26.829345+0000","last_clean":"2023-10-06T01:41:26.829345+0000","last_became_active":"2023-10-06T01:41:26.824586+0000","last_became_peered":"2023-10-06T01:41:26.824586+0000","last_unstale":"2023-10-06T01:41:26.829345+0000","last_undegraded":"2023-10-06T01:41:26.829345+0000","last_fullsized":"2023-10-06T01:41:26.829345+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:49:31.447635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.823592+0000","last_change":"2023-10-06T01:41:26.820900+0000","last_active":"2023-10-06T01:41:26.823592+0000","last_peered":"2023-10-06T01:41:26.823592+0000","last_clean":"2023-10-06T01:41:26.823592+0000","last_became_active":"2023-10-06T01:41:26.820629+0000","last_became_peered":"2023-10-06T01:41:26.820629+0000","last_unstale":"2023-10-06T01:41:26.823592+0000","last_undegraded":"2023-10-06T01:41:26.823592+0000","last_fullsized":"2023-10-06T01:41:26.823592+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:43:40.038663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.828389+0000","last_change":"2023-10-06T01:41:26.822928+0000","last_active":"2023-10-06T01:41:26.828389+0000","last_peered":"2023-10-06T01:41:26.828389+0000","last_clean":"2023-10-06T01:41:26.828389+0000","last_became_active":"2023-10-06T01:41:26.822683+0000","last_became_peered":"2023-10-06T01:41:26.822683+0000","last_unstale":"2023-10-06T01:41:26.828389+0000","last_undegraded":"2023-10-06T01:41:26.828389+0000","last_fullsized":"2023-10-06T01:41:26.828389+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:43:40.038663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.825090+0000","last_change":"2023-10-06T01:41:26.821793+0000","last_active":"2023-10-06T01:41:26.825090+0000","last_peered":"2023-10-06T01:41:26.825090+0000","last_clean":"2023-10-06T01:41:26.825090+0000","last_became_active":"2023-10-06T01:41:26.821541+0000","last_became_peered":"2023-10-06T01:41:26.821541+0000","last_unstale":"2023-10-06T01:41:26.825090+0000","last_undegraded":"2023-10-06T01:41:26.825090+0000","last_fullsized":"2023-10-06T01:41:26.825090+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:23:14.876172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.824247+0000","last_change":"2023-10-06T01:41:26.823092+0000","last_active":"2023-10-06T01:41:26.824247+0000","last_peered":"2023-10-06T01:41:26.824247+0000","last_clean":"2023-10-06T01:41:26.824247+0000","last_became_active":"2023-10-06T01:41:26.822856+0000","last_became_peered":"2023-10-06T01:41:26.822856+0000","last_unstale":"2023-10-06T01:41:26.824247+0000","last_undegraded":"2023-10-06T01:41:26.824247+0000","last_fullsized":"2023-10-06T01:41:26.824247+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:02:47.981436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"40'4","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:27.131134+0000","last_change":"2023-10-06T01:41:26.111498+0000","last_active":"2023-10-06T01:41:27.131134+0000","last_peered":"2023-10-06T01:41:27.131134+0000","last_clean":"2023-10-06T01:41:27.131134+0000","last_became_active":"2023-10-06T01:41:26.111208+0000","last_became_peered":"2023-10-06T01:41:26.111208+0000","last_unstale":"2023-10-06T01:41:27.131134+0000","last_undegraded":"2023-10-06T01:41:27.131134+0000","last_fullsized":"2023-10-06T01:41:27.131134+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_clean_scrub_stamp":"2023-10-06T01:41:25.085467+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:20.212462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.829347+0000","last_change":"2023-10-06T01:41:26.825201+0000","last_active":"2023-10-06T01:41:26.829347+0000","last_peered":"2023-10-06T01:41:26.829347+0000","last_clean":"2023-10-06T01:41:26.829347+0000","last_became_active":"2023-10-06T01:41:26.824955+0000","last_became_peered":"2023-10-06T01:41:26.824955+0000","last_unstale":"2023-10-06T01:41:26.829347+0000","last_undegraded":"2023-10-06T01:41:26.829347+0000","last_fullsized":"2023-10-06T01:41:26.829347+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:02:47.981436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"40'1","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:27.126970+0000","last_change":"2023-10-06T01:41:26.120756+0000","last_active":"2023-10-06T01:41:27.126970+0000","last_peered":"2023-10-06T01:41:27.126970+0000","last_clean":"2023-10-06T01:41:27.126970+0000","last_became_active":"2023-10-06T01:41:26.120489+0000","last_became_peered":"2023-10-06T01:41:26.120489+0000","last_unstale":"2023-10-06T01:41:27.126970+0000","last_undegraded":"2023-10-06T01:41:27.126970+0000","last_fullsized":"2023-10-06T01:41:27.126970+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_clean_scrub_stamp":"2023-10-06T01:41:25.085467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:14:15.651618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.830224+0000","last_change":"2023-10-06T01:41:26.827507+0000","last_active":"2023-10-06T01:41:26.830224+0000","last_peered":"2023-10-06T01:41:26.830224+0000","last_clean":"2023-10-06T01:41:26.830224+0000","last_became_active":"2023-10-06T01:41:26.827218+0000","last_became_peered":"2023-10-06T01:41:26.827218+0000","last_unstale":"2023-10-06T01:41:26.830224+0000","last_undegraded":"2023-10-06T01:41:26.830224+0000","last_fullsized":"2023-10-06T01:41:26.830224+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:18:27.983245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"40'2","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:27.126231+0000","last_change":"2023-10-06T01:41:26.112124+0000","last_active":"2023-10-06T01:41:27.126231+0000","last_peered":"2023-10-06T01:41:27.126231+0000","last_clean":"2023-10-06T01:41:27.126231+0000","last_became_active":"2023-10-06T01:41:26.111199+0000","last_became_peered":"2023-10-06T01:41:26.111199+0000","last_unstale":"2023-10-06T01:41:27.126231+0000","last_undegraded":"2023-10-06T01:41:27.126231+0000","last_fullsized":"2023-10-06T01:41:27.126231+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_clean_scrub_stamp":"2023-10-06T01:41:25.085467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:41:43.247462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.827597+0000","last_change":"2023-10-06T01:41:26.825431+0000","last_active":"2023-10-06T01:41:26.827597+0000","last_peered":"2023-10-06T01:41:26.827597+0000","last_clean":"2023-10-06T01:41:26.827597+0000","last_became_active":"2023-10-06T01:41:26.824877+0000","last_became_peered":"2023-10-06T01:41:26.824877+0000","last_unstale":"2023-10-06T01:41:26.827597+0000","last_undegraded":"2023-10-06T01:41:26.827597+0000","last_fullsized":"2023-10-06T01:41:26.827597+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:57:16.248663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"40'2","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:27.131024+0000","last_change":"2023-10-06T01:41:26.115205+0000","last_active":"2023-10-06T01:41:27.131024+0000","last_peered":"2023-10-06T01:41:27.131024+0000","last_clean":"2023-10-06T01:41:27.131024+0000","last_became_active":"2023-10-06T01:41:26.114921+0000","last_became_peered":"2023-10-06T01:41:26.114921+0000","last_unstale":"2023-10-06T01:41:27.131024+0000","last_undegraded":"2023-10-06T01:41:27.131024+0000","last_fullsized":"2023-10-06T01:41:27.131024+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_clean_scrub_stamp":"2023-10-06T01:41:25.085467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:49:41.251613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.825126+0000","last_change":"2023-10-06T01:41:26.824093+0000","last_active":"2023-10-06T01:41:26.825126+0000","last_peered":"2023-10-06T01:41:26.825126+0000","last_clean":"2023-10-06T01:41:26.825126+0000","last_became_active":"2023-10-06T01:41:26.823806+0000","last_became_peered":"2023-10-06T01:41:26.823806+0000","last_unstale":"2023-10-06T01:41:26.825126+0000","last_undegraded":"2023-10-06T01:41:26.825126+0000","last_fullsized":"2023-10-06T01:41:26.825126+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:06:06.225550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"40'1","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:27.127782+0000","last_change":"2023-10-06T01:41:26.115009+0000","last_active":"2023-10-06T01:41:27.127782+0000","last_peered":"2023-10-06T01:41:27.127782+0000","last_clean":"2023-10-06T01:41:27.127782+0000","last_became_active":"2023-10-06T01:41:26.114791+0000","last_became_peered":"2023-10-06T01:41:26.114791+0000","last_unstale":"2023-10-06T01:41:27.127782+0000","last_undegraded":"2023-10-06T01:41:27.127782+0000","last_fullsized":"2023-10-06T01:41:27.127782+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_clean_scrub_stamp":"2023-10-06T01:41:25.085467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:01:58.414941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.832519+0000","last_change":"2023-10-06T01:41:26.827259+0000","last_active":"2023-10-06T01:41:26.832519+0000","last_peered":"2023-10-06T01:41:26.832519+0000","last_clean":"2023-10-06T01:41:26.832519+0000","last_became_active":"2023-10-06T01:41:26.824329+0000","last_became_peered":"2023-10-06T01:41:26.824329+0000","last_unstale":"2023-10-06T01:41:26.832519+0000","last_undegraded":"2023-10-06T01:41:26.832519+0000","last_fullsized":"2023-10-06T01:41:26.832519+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:39:56.013958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"40'1","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:27.126688+0000","last_change":"2023-10-06T01:41:26.112833+0000","last_active":"2023-10-06T01:41:27.126688+0000","last_peered":"2023-10-06T01:41:27.126688+0000","last_clean":"2023-10-06T01:41:27.126688+0000","last_became_active":"2023-10-06T01:41:26.112476+0000","last_became_peered":"2023-10-06T01:41:26.112476+0000","last_unstale":"2023-10-06T01:41:27.126688+0000","last_undegraded":"2023-10-06T01:41:27.126688+0000","last_fullsized":"2023-10-06T01:41:27.126688+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_clean_scrub_stamp":"2023-10-06T01:41:25.085467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:18:28.369114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.832554+0000","last_change":"2023-10-06T01:41:26.829731+0000","last_active":"2023-10-06T01:41:26.832554+0000","last_peered":"2023-10-06T01:41:26.832554+0000","last_clean":"2023-10-06T01:41:26.832554+0000","last_became_active":"2023-10-06T01:41:26.829595+0000","last_became_peered":"2023-10-06T01:41:26.829595+0000","last_unstale":"2023-10-06T01:41:26.832554+0000","last_undegraded":"2023-10-06T01:41:26.832554+0000","last_fullsized":"2023-10-06T01:41:26.832554+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:49:52.344585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.818298+0000","last_change":"2023-10-06T01:41:26.110569+0000","last_active":"2023-10-06T01:41:26.818298+0000","last_peered":"2023-10-06T01:41:26.818298+0000","last_clean":"2023-10-06T01:41:26.818298+0000","last_became_active":"2023-10-06T01:41:26.110282+0000","last_became_peered":"2023-10-06T01:41:26.110282+0000","last_unstale":"2023-10-06T01:41:26.818298+0000","last_undegraded":"2023-10-06T01:41:26.818298+0000","last_fullsized":"2023-10-06T01:41:26.818298+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_clean_scrub_stamp":"2023-10-06T01:41:25.085467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:36:16.367983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.825581+0000","last_change":"2023-10-06T01:41:26.821335+0000","last_active":"2023-10-06T01:41:26.825581+0000","last_peered":"2023-10-06T01:41:26.825581+0000","last_clean":"2023-10-06T01:41:26.825581+0000","last_became_active":"2023-10-06T01:41:26.820993+0000","last_became_peered":"2023-10-06T01:41:26.820993+0000","last_unstale":"2023-10-06T01:41:26.825581+0000","last_undegraded":"2023-10-06T01:41:26.825581+0000","last_fullsized":"2023-10-06T01:41:26.825581+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:21.218850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.820907+0000","last_change":"2023-10-06T01:41:26.113998+0000","last_active":"2023-10-06T01:41:26.820907+0000","last_peered":"2023-10-06T01:41:26.820907+0000","last_clean":"2023-10-06T01:41:26.820907+0000","last_became_active":"2023-10-06T01:41:26.113113+0000","last_became_peered":"2023-10-06T01:41:26.113113+0000","last_unstale":"2023-10-06T01:41:26.820907+0000","last_undegraded":"2023-10-06T01:41:26.820907+0000","last_fullsized":"2023-10-06T01:41:26.820907+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_clean_scrub_stamp":"2023-10-06T01:41:25.085467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:57:15.242276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.835722+0000","last_change":"2023-10-06T01:41:26.833973+0000","last_active":"2023-10-06T01:41:26.835722+0000","last_peered":"2023-10-06T01:41:26.835722+0000","last_clean":"2023-10-06T01:41:26.835722+0000","last_became_active":"2023-10-06T01:41:26.833525+0000","last_became_peered":"2023-10-06T01:41:26.833525+0000","last_unstale":"2023-10-06T01:41:26.835722+0000","last_undegraded":"2023-10-06T01:41:26.835722+0000","last_fullsized":"2023-10-06T01:41:26.835722+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:21:56.382339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.813541+0000","last_change":"2023-10-06T01:41:26.102557+0000","last_active":"2023-10-06T01:41:26.813541+0000","last_peered":"2023-10-06T01:41:26.813541+0000","last_clean":"2023-10-06T01:41:26.813541+0000","last_became_active":"2023-10-06T01:41:26.102247+0000","last_became_peered":"2023-10-06T01:41:26.102247+0000","last_unstale":"2023-10-06T01:41:26.813541+0000","last_undegraded":"2023-10-06T01:41:26.813541+0000","last_fullsized":"2023-10-06T01:41:26.813541+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_clean_scrub_stamp":"2023-10-06T01:41:25.085467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:50:00.275736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.830775+0000","last_change":"2023-10-06T01:41:26.828572+0000","last_active":"2023-10-06T01:41:26.830775+0000","last_peered":"2023-10-06T01:41:26.830775+0000","last_clean":"2023-10-06T01:41:26.830775+0000","last_became_active":"2023-10-06T01:41:26.828292+0000","last_became_peered":"2023-10-06T01:41:26.828292+0000","last_unstale":"2023-10-06T01:41:26.830775+0000","last_undegraded":"2023-10-06T01:41:26.830775+0000","last_fullsized":"2023-10-06T01:41:26.830775+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:27:59.329803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.821172+0000","last_change":"2023-10-06T01:41:26.114744+0000","last_active":"2023-10-06T01:41:26.821172+0000","last_peered":"2023-10-06T01:41:26.821172+0000","last_clean":"2023-10-06T01:41:26.821172+0000","last_became_active":"2023-10-06T01:41:26.113390+0000","last_became_peered":"2023-10-06T01:41:26.113390+0000","last_unstale":"2023-10-06T01:41:26.821172+0000","last_undegraded":"2023-10-06T01:41:26.821172+0000","last_fullsized":"2023-10-06T01:41:26.821172+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_clean_scrub_stamp":"2023-10-06T01:41:25.085467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:06.865277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.823919+0000","last_change":"2023-10-06T01:41:26.819193+0000","last_active":"2023-10-06T01:41:26.823919+0000","last_peered":"2023-10-06T01:41:26.823919+0000","last_clean":"2023-10-06T01:41:26.823919+0000","last_became_active":"2023-10-06T01:41:26.818921+0000","last_became_peered":"2023-10-06T01:41:26.818921+0000","last_unstale":"2023-10-06T01:41:26.823919+0000","last_undegraded":"2023-10-06T01:41:26.823919+0000","last_fullsized":"2023-10-06T01:41:26.823919+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:52:02.886097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"40'3","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:27.127498+0000","last_change":"2023-10-06T01:41:26.122005+0000","last_active":"2023-10-06T01:41:27.127498+0000","last_peered":"2023-10-06T01:41:27.127498+0000","last_clean":"2023-10-06T01:41:27.127498+0000","last_became_active":"2023-10-06T01:41:26.121719+0000","last_became_peered":"2023-10-06T01:41:26.121719+0000","last_unstale":"2023-10-06T01:41:27.127498+0000","last_undegraded":"2023-10-06T01:41:27.127498+0000","last_fullsized":"2023-10-06T01:41:27.127498+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_clean_scrub_stamp":"2023-10-06T01:41:25.085467+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:36:16.367983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.830792+0000","last_change":"2023-10-06T01:41:26.828842+0000","last_active":"2023-10-06T01:41:26.830792+0000","last_peered":"2023-10-06T01:41:26.830792+0000","last_clean":"2023-10-06T01:41:26.830792+0000","last_became_active":"2023-10-06T01:41:26.828434+0000","last_became_peered":"2023-10-06T01:41:26.828434+0000","last_unstale":"2023-10-06T01:41:26.830792+0000","last_undegraded":"2023-10-06T01:41:26.830792+0000","last_fullsized":"2023-10-06T01:41:26.830792+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:09:10.516132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"40'6","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:27.131909+0000","last_change":"2023-10-06T01:41:26.102865+0000","last_active":"2023-10-06T01:41:27.131909+0000","last_peered":"2023-10-06T01:41:27.131909+0000","last_clean":"2023-10-06T01:41:27.131909+0000","last_became_active":"2023-10-06T01:41:26.102602+0000","last_became_peered":"2023-10-06T01:41:26.102602+0000","last_unstale":"2023-10-06T01:41:27.131909+0000","last_undegraded":"2023-10-06T01:41:27.131909+0000","last_fullsized":"2023-10-06T01:41:27.131909+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_clean_scrub_stamp":"2023-10-06T01:41:25.085467+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:30:56.249670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.834995+0000","last_change":"2023-10-06T01:41:26.833904+0000","last_active":"2023-10-06T01:41:26.834995+0000","last_peered":"2023-10-06T01:41:26.834995+0000","last_clean":"2023-10-06T01:41:26.834995+0000","last_became_active":"2023-10-06T01:41:26.833625+0000","last_became_peered":"2023-10-06T01:41:26.833625+0000","last_unstale":"2023-10-06T01:41:26.834995+0000","last_undegraded":"2023-10-06T01:41:26.834995+0000","last_fullsized":"2023-10-06T01:41:26.834995+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:16:32.023169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"40'2","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:27.130858+0000","last_change":"2023-10-06T01:41:26.113405+0000","last_active":"2023-10-06T01:41:27.130858+0000","last_peered":"2023-10-06T01:41:27.130858+0000","last_clean":"2023-10-06T01:41:27.130858+0000","last_became_active":"2023-10-06T01:41:26.113166+0000","last_became_peered":"2023-10-06T01:41:26.113166+0000","last_unstale":"2023-10-06T01:41:27.130858+0000","last_undegraded":"2023-10-06T01:41:27.130858+0000","last_fullsized":"2023-10-06T01:41:27.130858+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_clean_scrub_stamp":"2023-10-06T01:41:25.085467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:52:38.357276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.831503+0000","last_change":"2023-10-06T01:41:26.823968+0000","last_active":"2023-10-06T01:41:26.831503+0000","last_peered":"2023-10-06T01:41:26.831503+0000","last_clean":"2023-10-06T01:41:26.831503+0000","last_became_active":"2023-10-06T01:41:26.823694+0000","last_became_peered":"2023-10-06T01:41:26.823694+0000","last_unstale":"2023-10-06T01:41:26.831503+0000","last_undegraded":"2023-10-06T01:41:26.831503+0000","last_fullsized":"2023-10-06T01:41:26.831503+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:14:19.138080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.822208+0000","last_change":"2023-10-06T01:41:26.114851+0000","last_active":"2023-10-06T01:41:26.822208+0000","last_peered":"2023-10-06T01:41:26.822208+0000","last_clean":"2023-10-06T01:41:26.822208+0000","last_became_active":"2023-10-06T01:41:26.114589+0000","last_became_peered":"2023-10-06T01:41:26.114589+0000","last_unstale":"2023-10-06T01:41:26.822208+0000","last_undegraded":"2023-10-06T01:41:26.822208+0000","last_fullsized":"2023-10-06T01:41:26.822208+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_clean_scrub_stamp":"2023-10-06T01:41:25.085467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:57:15.242276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.824277+0000","last_change":"2023-10-06T01:41:26.821348+0000","last_active":"2023-10-06T01:41:26.824277+0000","last_peered":"2023-10-06T01:41:26.824277+0000","last_clean":"2023-10-06T01:41:26.824277+0000","last_became_active":"2023-10-06T01:41:26.821104+0000","last_became_peered":"2023-10-06T01:41:26.821104+0000","last_unstale":"2023-10-06T01:41:26.824277+0000","last_undegraded":"2023-10-06T01:41:26.824277+0000","last_fullsized":"2023-10-06T01:41:26.824277+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:01:51.254365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.811514+0000","last_change":"2023-10-06T01:41:26.110222+0000","last_active":"2023-10-06T01:41:26.811514+0000","last_peered":"2023-10-06T01:41:26.811514+0000","last_clean":"2023-10-06T01:41:26.811514+0000","last_became_active":"2023-10-06T01:41:26.109982+0000","last_became_peered":"2023-10-06T01:41:26.109982+0000","last_unstale":"2023-10-06T01:41:26.811514+0000","last_undegraded":"2023-10-06T01:41:26.811514+0000","last_fullsized":"2023-10-06T01:41:26.811514+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_clean_scrub_stamp":"2023-10-06T01:41:25.085467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:35:08.676117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.831081+0000","last_change":"2023-10-06T01:41:26.829159+0000","last_active":"2023-10-06T01:41:26.831081+0000","last_peered":"2023-10-06T01:41:26.831081+0000","last_clean":"2023-10-06T01:41:26.831081+0000","last_became_active":"2023-10-06T01:41:26.828473+0000","last_became_peered":"2023-10-06T01:41:26.828473+0000","last_unstale":"2023-10-06T01:41:26.831081+0000","last_undegraded":"2023-10-06T01:41:26.831081+0000","last_fullsized":"2023-10-06T01:41:26.831081+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:18:27.983245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"40'8","reported_seq":18,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:27.131862+0000","last_change":"2023-10-06T01:41:26.118344+0000","last_active":"2023-10-06T01:41:27.131862+0000","last_peered":"2023-10-06T01:41:27.131862+0000","last_clean":"2023-10-06T01:41:27.131862+0000","last_became_active":"2023-10-06T01:41:26.118109+0000","last_became_peered":"2023-10-06T01:41:26.118109+0000","last_unstale":"2023-10-06T01:41:27.131862+0000","last_undegraded":"2023-10-06T01:41:27.131862+0000","last_fullsized":"2023-10-06T01:41:27.131862+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_clean_scrub_stamp":"2023-10-06T01:41:25.085467+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:02:46.975049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.827173+0000","last_change":"2023-10-06T01:41:26.824838+0000","last_active":"2023-10-06T01:41:26.827173+0000","last_peered":"2023-10-06T01:41:26.827173+0000","last_clean":"2023-10-06T01:41:26.827173+0000","last_became_active":"2023-10-06T01:41:26.824590+0000","last_became_peered":"2023-10-06T01:41:26.824590+0000","last_unstale":"2023-10-06T01:41:26.827173+0000","last_undegraded":"2023-10-06T01:41:26.827173+0000","last_fullsized":"2023-10-06T01:41:26.827173+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:23:42.756115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"40'1","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:27.130088+0000","last_change":"2023-10-06T01:41:26.104337+0000","last_active":"2023-10-06T01:41:27.130088+0000","last_peered":"2023-10-06T01:41:27.130088+0000","last_clean":"2023-10-06T01:41:27.130088+0000","last_became_active":"2023-10-06T01:41:26.104069+0000","last_became_peered":"2023-10-06T01:41:26.104069+0000","last_unstale":"2023-10-06T01:41:27.130088+0000","last_undegraded":"2023-10-06T01:41:27.130088+0000","last_fullsized":"2023-10-06T01:41:27.130088+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_clean_scrub_stamp":"2023-10-06T01:41:25.085467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:31:40.433231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.832404+0000","last_change":"2023-10-06T01:41:26.829421+0000","last_active":"2023-10-06T01:41:26.832404+0000","last_peered":"2023-10-06T01:41:26.832404+0000","last_clean":"2023-10-06T01:41:26.832404+0000","last_became_active":"2023-10-06T01:41:26.827337+0000","last_became_peered":"2023-10-06T01:41:26.827337+0000","last_unstale":"2023-10-06T01:41:26.832404+0000","last_undegraded":"2023-10-06T01:41:26.832404+0000","last_fullsized":"2023-10-06T01:41:26.832404+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:18:27.983245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"40'2","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:27.126533+0000","last_change":"2023-10-06T01:41:26.107747+0000","last_active":"2023-10-06T01:41:27.126533+0000","last_peered":"2023-10-06T01:41:27.126533+0000","last_clean":"2023-10-06T01:41:27.126533+0000","last_became_active":"2023-10-06T01:41:26.107474+0000","last_became_peered":"2023-10-06T01:41:26.107474+0000","last_unstale":"2023-10-06T01:41:27.126533+0000","last_undegraded":"2023-10-06T01:41:27.126533+0000","last_fullsized":"2023-10-06T01:41:27.126533+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_clean_scrub_stamp":"2023-10-06T01:41:25.085467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:09:09.509744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.829732+0000","last_change":"2023-10-06T01:41:26.823654+0000","last_active":"2023-10-06T01:41:26.829732+0000","last_peered":"2023-10-06T01:41:26.829732+0000","last_clean":"2023-10-06T01:41:26.829732+0000","last_became_active":"2023-10-06T01:41:26.823304+0000","last_became_peered":"2023-10-06T01:41:26.823304+0000","last_unstale":"2023-10-06T01:41:26.829732+0000","last_undegraded":"2023-10-06T01:41:26.829732+0000","last_fullsized":"2023-10-06T01:41:26.829732+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:58:55.761307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"40'1","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:27.137536+0000","last_change":"2023-10-06T01:41:26.109890+0000","last_active":"2023-10-06T01:41:27.137536+0000","last_peered":"2023-10-06T01:41:27.137536+0000","last_clean":"2023-10-06T01:41:27.137536+0000","last_became_active":"2023-10-06T01:41:26.109479+0000","last_became_peered":"2023-10-06T01:41:26.109479+0000","last_unstale":"2023-10-06T01:41:27.137536+0000","last_undegraded":"2023-10-06T01:41:27.137536+0000","last_fullsized":"2023-10-06T01:41:27.137536+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_clean_scrub_stamp":"2023-10-06T01:41:25.085467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:20.212462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.829832+0000","last_change":"2023-10-06T01:41:26.823377+0000","last_active":"2023-10-06T01:41:26.829832+0000","last_peered":"2023-10-06T01:41:26.829832+0000","last_clean":"2023-10-06T01:41:26.829832+0000","last_became_active":"2023-10-06T01:41:26.822712+0000","last_became_peered":"2023-10-06T01:41:26.822712+0000","last_unstale":"2023-10-06T01:41:26.829832+0000","last_undegraded":"2023-10-06T01:41:26.829832+0000","last_fullsized":"2023-10-06T01:41:26.829832+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:36:17.374371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.811914+0000","last_change":"2023-10-06T01:41:26.120015+0000","last_active":"2023-10-06T01:41:26.811914+0000","last_peered":"2023-10-06T01:41:26.811914+0000","last_clean":"2023-10-06T01:41:26.811914+0000","last_became_active":"2023-10-06T01:41:26.119751+0000","last_became_peered":"2023-10-06T01:41:26.119751+0000","last_unstale":"2023-10-06T01:41:26.811914+0000","last_undegraded":"2023-10-06T01:41:26.811914+0000","last_fullsized":"2023-10-06T01:41:26.811914+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_clean_scrub_stamp":"2023-10-06T01:41:25.085467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:57:15.242276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.825879+0000","last_change":"2023-10-06T01:41:26.818911+0000","last_active":"2023-10-06T01:41:26.825879+0000","last_peered":"2023-10-06T01:41:26.825879+0000","last_clean":"2023-10-06T01:41:26.825879+0000","last_became_active":"2023-10-06T01:41:26.818659+0000","last_became_peered":"2023-10-06T01:41:26.818659+0000","last_unstale":"2023-10-06T01:41:26.825879+0000","last_undegraded":"2023-10-06T01:41:26.825879+0000","last_fullsized":"2023-10-06T01:41:26.825879+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:23:49.561289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"40'2","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:27.128089+0000","last_change":"2023-10-06T01:41:26.106658+0000","last_active":"2023-10-06T01:41:27.128089+0000","last_peered":"2023-10-06T01:41:27.128089+0000","last_clean":"2023-10-06T01:41:27.128089+0000","last_became_active":"2023-10-06T01:41:26.106433+0000","last_became_peered":"2023-10-06T01:41:26.106433+0000","last_unstale":"2023-10-06T01:41:27.128089+0000","last_undegraded":"2023-10-06T01:41:27.128089+0000","last_fullsized":"2023-10-06T01:41:27.128089+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_clean_scrub_stamp":"2023-10-06T01:41:25.085467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:24:51.256295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.826774+0000","last_change":"2023-10-06T01:41:26.824678+0000","last_active":"2023-10-06T01:41:26.826774+0000","last_peered":"2023-10-06T01:41:26.826774+0000","last_clean":"2023-10-06T01:41:26.826774+0000","last_became_active":"2023-10-06T01:41:26.824450+0000","last_became_peered":"2023-10-06T01:41:26.824450+0000","last_unstale":"2023-10-06T01:41:26.826774+0000","last_undegraded":"2023-10-06T01:41:26.826774+0000","last_fullsized":"2023-10-06T01:41:26.826774+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:49:42.258001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.817718+0000","last_change":"2023-10-06T01:41:26.120648+0000","last_active":"2023-10-06T01:41:26.817718+0000","last_peered":"2023-10-06T01:41:26.817718+0000","last_clean":"2023-10-06T01:41:26.817718+0000","last_became_active":"2023-10-06T01:41:26.120306+0000","last_became_peered":"2023-10-06T01:41:26.120306+0000","last_unstale":"2023-10-06T01:41:26.817718+0000","last_undegraded":"2023-10-06T01:41:26.817718+0000","last_fullsized":"2023-10-06T01:41:26.817718+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_clean_scrub_stamp":"2023-10-06T01:41:25.085467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:50:23.625160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.825072+0000","last_change":"2023-10-06T01:41:26.821644+0000","last_active":"2023-10-06T01:41:26.825072+0000","last_peered":"2023-10-06T01:41:26.825072+0000","last_clean":"2023-10-06T01:41:26.825072+0000","last_became_active":"2023-10-06T01:41:26.821402+0000","last_became_peered":"2023-10-06T01:41:26.821402+0000","last_unstale":"2023-10-06T01:41:26.825072+0000","last_undegraded":"2023-10-06T01:41:26.825072+0000","last_fullsized":"2023-10-06T01:41:26.825072+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:57:16.248663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.820754+0000","last_change":"2023-10-06T01:41:26.113690+0000","last_active":"2023-10-06T01:41:26.820754+0000","last_peered":"2023-10-06T01:41:26.820754+0000","last_clean":"2023-10-06T01:41:26.820754+0000","last_became_active":"2023-10-06T01:41:26.113402+0000","last_became_peered":"2023-10-06T01:41:26.113402+0000","last_unstale":"2023-10-06T01:41:26.820754+0000","last_undegraded":"2023-10-06T01:41:26.820754+0000","last_fullsized":"2023-10-06T01:41:26.820754+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_clean_scrub_stamp":"2023-10-06T01:41:25.085467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:49:41.251613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.831650+0000","last_change":"2023-10-06T01:41:26.824296+0000","last_active":"2023-10-06T01:41:26.831650+0000","last_peered":"2023-10-06T01:41:26.831650+0000","last_clean":"2023-10-06T01:41:26.831650+0000","last_became_active":"2023-10-06T01:41:26.824039+0000","last_became_peered":"2023-10-06T01:41:26.824039+0000","last_unstale":"2023-10-06T01:41:26.831650+0000","last_undegraded":"2023-10-06T01:41:26.831650+0000","last_fullsized":"2023-10-06T01:41:26.831650+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:01:33.092370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.818765+0000","last_change":"2023-10-06T01:41:26.114423+0000","last_active":"2023-10-06T01:41:26.818765+0000","last_peered":"2023-10-06T01:41:26.818765+0000","last_clean":"2023-10-06T01:41:26.818765+0000","last_became_active":"2023-10-06T01:41:26.114134+0000","last_became_peered":"2023-10-06T01:41:26.114134+0000","last_unstale":"2023-10-06T01:41:26.818765+0000","last_undegraded":"2023-10-06T01:41:26.818765+0000","last_fullsized":"2023-10-06T01:41:26.818765+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_clean_scrub_stamp":"2023-10-06T01:41:25.085467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:49:30.441248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.828030+0000","last_change":"2023-10-06T01:41:26.825830+0000","last_active":"2023-10-06T01:41:26.828030+0000","last_peered":"2023-10-06T01:41:26.828030+0000","last_clean":"2023-10-06T01:41:26.828030+0000","last_became_active":"2023-10-06T01:41:26.825556+0000","last_became_peered":"2023-10-06T01:41:26.825556+0000","last_unstale":"2023-10-06T01:41:26.828030+0000","last_undegraded":"2023-10-06T01:41:26.828030+0000","last_fullsized":"2023-10-06T01:41:26.828030+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:18:34.124375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.821104+0000","last_change":"2023-10-06T01:41:26.115006+0000","last_active":"2023-10-06T01:41:26.821104+0000","last_peered":"2023-10-06T01:41:26.821104+0000","last_clean":"2023-10-06T01:41:26.821104+0000","last_became_active":"2023-10-06T01:41:26.114767+0000","last_became_peered":"2023-10-06T01:41:26.114767+0000","last_unstale":"2023-10-06T01:41:26.821104+0000","last_undegraded":"2023-10-06T01:41:26.821104+0000","last_fullsized":"2023-10-06T01:41:26.821104+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_clean_scrub_stamp":"2023-10-06T01:41:25.085467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:23:41.749728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":28,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.814101+0000","last_change":"2023-10-06T01:40:16.930992+0000","last_active":"2023-10-06T01:41:26.814101+0000","last_peered":"2023-10-06T01:41:26.814101+0000","last_clean":"2023-10-06T01:41:26.814101+0000","last_became_active":"2023-10-06T01:40:16.930707+0000","last_became_peered":"2023-10-06T01:40:16.930707+0000","last_unstale":"2023-10-06T01:41:26.814101+0000","last_undegraded":"2023-10-06T01:41:26.814101+0000","last_fullsized":"2023-10-06T01:41:26.814101+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:52:43.316071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.831420+0000","last_change":"2023-10-06T01:41:26.830847+0000","last_active":"2023-10-06T01:41:26.831420+0000","last_peered":"2023-10-06T01:41:26.831420+0000","last_clean":"2023-10-06T01:41:26.831420+0000","last_became_active":"2023-10-06T01:41:26.830535+0000","last_became_peered":"2023-10-06T01:41:26.830535+0000","last_unstale":"2023-10-06T01:41:26.831420+0000","last_undegraded":"2023-10-06T01:41:26.831420+0000","last_fullsized":"2023-10-06T01:41:26.831420+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:50:24.631547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"41'1","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T01:41:27.812820+0000","last_change":"2023-10-06T01:41:26.107258+0000","last_active":"2023-10-06T01:41:27.812820+0000","last_peered":"2023-10-06T01:41:27.812820+0000","last_clean":"2023-10-06T01:41:27.812820+0000","last_became_active":"2023-10-06T01:41:26.107002+0000","last_became_peered":"2023-10-06T01:41:26.107002+0000","last_unstale":"2023-10-06T01:41:27.812820+0000","last_undegraded":"2023-10-06T01:41:27.812820+0000","last_fullsized":"2023-10-06T01:41:27.812820+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_clean_scrub_stamp":"2023-10-06T01:41:25.085467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:49:30.441248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":29,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.817802+0000","last_change":"2023-10-06T01:40:16.651019+0000","last_active":"2023-10-06T01:41:26.817802+0000","last_peered":"2023-10-06T01:41:26.817802+0000","last_clean":"2023-10-06T01:41:26.817802+0000","last_became_active":"2023-10-06T01:40:16.650628+0000","last_became_peered":"2023-10-06T01:40:16.650628+0000","last_unstale":"2023-10-06T01:41:26.817802+0000","last_undegraded":"2023-10-06T01:41:26.817802+0000","last_fullsized":"2023-10-06T01:41:26.817802+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:11:57.218984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.832274+0000","last_change":"2023-10-06T01:41:26.826075+0000","last_active":"2023-10-06T01:41:26.832274+0000","last_peered":"2023-10-06T01:41:26.832274+0000","last_clean":"2023-10-06T01:41:26.832274+0000","last_became_active":"2023-10-06T01:41:26.825861+0000","last_became_peered":"2023-10-06T01:41:26.825861+0000","last_unstale":"2023-10-06T01:41:26.832274+0000","last_undegraded":"2023-10-06T01:41:26.832274+0000","last_fullsized":"2023-10-06T01:41:26.832274+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:14:16.658005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.823557+0000","last_change":"2023-10-06T01:41:26.122062+0000","last_active":"2023-10-06T01:41:26.823557+0000","last_peered":"2023-10-06T01:41:26.823557+0000","last_clean":"2023-10-06T01:41:26.823557+0000","last_became_active":"2023-10-06T01:41:26.121730+0000","last_became_peered":"2023-10-06T01:41:26.121730+0000","last_unstale":"2023-10-06T01:41:26.823557+0000","last_undegraded":"2023-10-06T01:41:26.823557+0000","last_fullsized":"2023-10-06T01:41:26.823557+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_clean_scrub_stamp":"2023-10-06T01:41:25.085467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:50:23.625160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":29,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.814734+0000","last_change":"2023-10-06T01:40:16.781596+0000","last_active":"2023-10-06T01:41:26.814734+0000","last_peered":"2023-10-06T01:41:26.814734+0000","last_clean":"2023-10-06T01:41:26.814734+0000","last_became_active":"2023-10-06T01:40:16.781352+0000","last_became_peered":"2023-10-06T01:40:16.781352+0000","last_unstale":"2023-10-06T01:41:26.814734+0000","last_undegraded":"2023-10-06T01:41:26.814734+0000","last_fullsized":"2023-10-06T01:41:26.814734+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:52:43.316071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.832740+0000","last_change":"2023-10-06T01:41:26.826305+0000","last_active":"2023-10-06T01:41:26.832740+0000","last_peered":"2023-10-06T01:41:26.832740+0000","last_clean":"2023-10-06T01:41:26.832740+0000","last_became_active":"2023-10-06T01:41:26.826061+0000","last_became_peered":"2023-10-06T01:41:26.826061+0000","last_unstale":"2023-10-06T01:41:26.832740+0000","last_undegraded":"2023-10-06T01:41:26.832740+0000","last_fullsized":"2023-10-06T01:41:26.832740+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:08:44.723266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"40'2","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:27.130758+0000","last_change":"2023-10-06T01:41:26.115059+0000","last_active":"2023-10-06T01:41:27.130758+0000","last_peered":"2023-10-06T01:41:27.130758+0000","last_clean":"2023-10-06T01:41:27.130758+0000","last_became_active":"2023-10-06T01:41:26.114788+0000","last_became_peered":"2023-10-06T01:41:26.114788+0000","last_unstale":"2023-10-06T01:41:27.130758+0000","last_undegraded":"2023-10-06T01:41:27.130758+0000","last_fullsized":"2023-10-06T01:41:27.130758+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_clean_scrub_stamp":"2023-10-06T01:41:25.085467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:58:54.754920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":29,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.818993+0000","last_change":"2023-10-06T01:40:16.650826+0000","last_active":"2023-10-06T01:41:26.818993+0000","last_peered":"2023-10-06T01:41:26.818993+0000","last_clean":"2023-10-06T01:41:26.818993+0000","last_became_active":"2023-10-06T01:40:16.650469+0000","last_became_peered":"2023-10-06T01:40:16.650469+0000","last_unstale":"2023-10-06T01:41:26.818993+0000","last_undegraded":"2023-10-06T01:41:26.818993+0000","last_fullsized":"2023-10-06T01:41:26.818993+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:50:23.628212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":181,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.819771+0000","last_change":"2023-10-06T01:40:10.645512+0000","last_active":"2023-10-06T01:41:26.819771+0000","last_peered":"2023-10-06T01:41:26.819771+0000","last_clean":"2023-10-06T01:41:26.819771+0000","last_became_active":"2023-10-06T01:40:10.644601+0000","last_became_peered":"2023-10-06T01:40:10.644601+0000","last_unstale":"2023-10-06T01:41:26.819771+0000","last_undegraded":"2023-10-06T01:41:26.819771+0000","last_fullsized":"2023-10-06T01:41:26.819771+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:09.580865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:09.580865+0000","last_clean_scrub_stamp":"2023-10-06T01:40:09.580865+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:05:28.268591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.832660+0000","last_change":"2023-10-06T01:41:26.831564+0000","last_active":"2023-10-06T01:41:26.832660+0000","last_peered":"2023-10-06T01:41:26.832660+0000","last_clean":"2023-10-06T01:41:26.832660+0000","last_became_active":"2023-10-06T01:41:26.831293+0000","last_became_peered":"2023-10-06T01:41:26.831293+0000","last_unstale":"2023-10-06T01:41:26.832660+0000","last_undegraded":"2023-10-06T01:41:26.832660+0000","last_fullsized":"2023-10-06T01:41:26.832660+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:03:47.822189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.814028+0000","last_change":"2023-10-06T01:41:26.111969+0000","last_active":"2023-10-06T01:41:26.814028+0000","last_peered":"2023-10-06T01:41:26.814028+0000","last_clean":"2023-10-06T01:41:26.814028+0000","last_became_active":"2023-10-06T01:41:26.111442+0000","last_became_peered":"2023-10-06T01:41:26.111442+0000","last_unstale":"2023-10-06T01:41:26.814028+0000","last_undegraded":"2023-10-06T01:41:26.814028+0000","last_fullsized":"2023-10-06T01:41:26.814028+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_clean_scrub_stamp":"2023-10-06T01:41:25.085467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:18:49.326166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":28,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.819853+0000","last_change":"2023-10-06T01:40:16.651332+0000","last_active":"2023-10-06T01:41:26.819853+0000","last_peered":"2023-10-06T01:41:26.819853+0000","last_clean":"2023-10-06T01:41:26.819853+0000","last_became_active":"2023-10-06T01:40:16.651049+0000","last_became_peered":"2023-10-06T01:40:16.651049+0000","last_unstale":"2023-10-06T01:41:26.819853+0000","last_undegraded":"2023-10-06T01:41:26.819853+0000","last_fullsized":"2023-10-06T01:41:26.819853+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:11:57.218984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.829569+0000","last_change":"2023-10-06T01:41:26.824653+0000","last_active":"2023-10-06T01:41:26.829569+0000","last_peered":"2023-10-06T01:41:26.829569+0000","last_clean":"2023-10-06T01:41:26.829569+0000","last_became_active":"2023-10-06T01:41:26.824391+0000","last_became_peered":"2023-10-06T01:41:26.824391+0000","last_unstale":"2023-10-06T01:41:26.829569+0000","last_undegraded":"2023-10-06T01:41:26.829569+0000","last_fullsized":"2023-10-06T01:41:26.829569+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:14:16.658005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.813971+0000","last_change":"2023-10-06T01:41:26.120248+0000","last_active":"2023-10-06T01:41:26.813971+0000","last_peered":"2023-10-06T01:41:26.813971+0000","last_clean":"2023-10-06T01:41:26.813971+0000","last_became_active":"2023-10-06T01:41:26.119964+0000","last_became_peered":"2023-10-06T01:41:26.119964+0000","last_unstale":"2023-10-06T01:41:26.813971+0000","last_undegraded":"2023-10-06T01:41:26.813971+0000","last_fullsized":"2023-10-06T01:41:26.813971+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_clean_scrub_stamp":"2023-10-06T01:41:25.085467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:19:08.833484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":28,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.823631+0000","last_change":"2023-10-06T01:40:16.931106+0000","last_active":"2023-10-06T01:41:26.823631+0000","last_peered":"2023-10-06T01:41:26.823631+0000","last_clean":"2023-10-06T01:41:26.823631+0000","last_became_active":"2023-10-06T01:40:16.930830+0000","last_became_peered":"2023-10-06T01:40:16.930830+0000","last_unstale":"2023-10-06T01:41:26.823631+0000","last_undegraded":"2023-10-06T01:41:26.823631+0000","last_fullsized":"2023-10-06T01:41:26.823631+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:50:23.628212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.826924+0000","last_change":"2023-10-06T01:41:26.821751+0000","last_active":"2023-10-06T01:41:26.826924+0000","last_peered":"2023-10-06T01:41:26.826924+0000","last_clean":"2023-10-06T01:41:26.826924+0000","last_became_active":"2023-10-06T01:41:26.821480+0000","last_became_peered":"2023-10-06T01:41:26.821480+0000","last_unstale":"2023-10-06T01:41:26.826924+0000","last_undegraded":"2023-10-06T01:41:26.826924+0000","last_fullsized":"2023-10-06T01:41:26.826924+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:49:52.344585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.813525+0000","last_change":"2023-10-06T01:41:26.106585+0000","last_active":"2023-10-06T01:41:26.813525+0000","last_peered":"2023-10-06T01:41:26.813525+0000","last_clean":"2023-10-06T01:41:26.813525+0000","last_became_active":"2023-10-06T01:41:26.106249+0000","last_became_peered":"2023-10-06T01:41:26.106249+0000","last_unstale":"2023-10-06T01:41:26.813525+0000","last_undegraded":"2023-10-06T01:41:26.813525+0000","last_fullsized":"2023-10-06T01:41:26.813525+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_clean_scrub_stamp":"2023-10-06T01:41:25.085467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:27:58.323415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":28,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.815340+0000","last_change":"2023-10-06T01:40:16.649379+0000","last_active":"2023-10-06T01:41:26.815340+0000","last_peered":"2023-10-06T01:41:26.815340+0000","last_clean":"2023-10-06T01:41:26.815340+0000","last_became_active":"2023-10-06T01:40:16.649147+0000","last_became_peered":"2023-10-06T01:40:16.649147+0000","last_unstale":"2023-10-06T01:41:26.815340+0000","last_undegraded":"2023-10-06T01:41:26.815340+0000","last_fullsized":"2023-10-06T01:41:26.815340+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:11:57.218984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.825899+0000","last_change":"2023-10-06T01:41:26.819529+0000","last_active":"2023-10-06T01:41:26.825899+0000","last_peered":"2023-10-06T01:41:26.825899+0000","last_clean":"2023-10-06T01:41:26.825899+0000","last_became_active":"2023-10-06T01:41:26.819272+0000","last_became_peered":"2023-10-06T01:41:26.819272+0000","last_unstale":"2023-10-06T01:41:26.825899+0000","last_undegraded":"2023-10-06T01:41:26.825899+0000","last_fullsized":"2023-10-06T01:41:26.825899+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:12:28.103885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.823069+0000","last_change":"2023-10-06T01:41:26.120256+0000","last_active":"2023-10-06T01:41:26.823069+0000","last_peered":"2023-10-06T01:41:26.823069+0000","last_clean":"2023-10-06T01:41:26.823069+0000","last_became_active":"2023-10-06T01:41:26.119859+0000","last_became_peered":"2023-10-06T01:41:26.119859+0000","last_unstale":"2023-10-06T01:41:26.823069+0000","last_undegraded":"2023-10-06T01:41:26.823069+0000","last_fullsized":"2023-10-06T01:41:26.823069+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_clean_scrub_stamp":"2023-10-06T01:41:25.085467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:02:46.975049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":29,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.816113+0000","last_change":"2023-10-06T01:40:16.651477+0000","last_active":"2023-10-06T01:41:26.816113+0000","last_peered":"2023-10-06T01:41:26.816113+0000","last_clean":"2023-10-06T01:41:26.816113+0000","last_became_active":"2023-10-06T01:40:16.651190+0000","last_became_peered":"2023-10-06T01:40:16.651190+0000","last_unstale":"2023-10-06T01:41:26.816113+0000","last_undegraded":"2023-10-06T01:41:26.816113+0000","last_fullsized":"2023-10-06T01:41:26.816113+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:45:47.422876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298336,"kb_used_data":1048,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073504,"statfs":{"total":96636764160,"available":96331268096,"internally_reserved":0,"allocated":1073152,"data_stored":802576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:41:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":3.6920000000000002,"5min":3.6920000000000002,"15min":3.6920000000000002},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":3.629,"5min":3.629,"15min":3.629},"last":0.622}]},{"osd":1,"last update":"Fri Oct 6 01:41:11 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":10.029999999999999,"5min":10.029999999999999,"15min":10.029999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.544,"5min":1.544,"15min":1.544},"last":0.66200000000000003}]},{"osd":2,"last update":"Fri Oct 6 01:41:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.67700000000000005},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":10.710000000000001,"5min":10.710000000000001,"15min":10.710000000000001},"last":0.52500000000000002}]},{"osd":3,"last update":"Fri Oct 6 01:41:11 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":3.6509999999999998,"5min":3.6509999999999998,"15min":3.6509999999999998},"last":0.63500000000000001}]},{"osd":4,"last update":"Fri Oct 6 01:41:11 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.44400000000000001}]},{"osd":5,"last update":"Fri Oct 6 01:41:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.7509999999999999,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":0.51500000000000001}]},{"osd":6,"last update":"Fri Oct 6 01:41:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.9370000000000001,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.501}]}]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297760,"kb_used_data":472,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074080,"statfs":{"total":96636764160,"available":96331857920,"internally_reserved":0,"allocated":483328,"data_stored":212762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.441},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.36199999999999999}]},{"osd":1,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.5}]},{"osd":2,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.41599999999999998}]},{"osd":3,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.51200000000000001}]},{"osd":4,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.53600000000000003}]},{"osd":5,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.52500000000000002}]},{"osd":7,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.58599999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297756,"kb_used_data":468,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074084,"statfs":{"total":96636764160,"available":96331862016,"internally_reserved":0,"allocated":479232,"data_stored":212188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.997,"15min":0.997},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":11.957000000000001,"5min":11.957000000000001,"15min":11.957000000000001},"last":0.40500000000000003},{"interface":"front","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":11.917,"5min":11.917,"15min":11.917},"last":0.41799999999999998}]},{"osd":2,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.317}]},{"osd":3,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":6.2450000000000001,"5min":6.2450000000000001,"15min":6.2450000000000001},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":6.2939999999999996,"5min":6.2939999999999996,"15min":6.2939999999999996},"last":0.38100000000000001}]},{"osd":4,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":6.1669999999999998,"5min":6.1669999999999998,"15min":6.1669999999999998},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.495}]},{"osd":5,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":6.2619999999999996,"5min":6.2619999999999996,"15min":6.2619999999999996},"last":0.504},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":6.2350000000000003,"5min":6.2350000000000003,"15min":6.2350000000000003},"last":0.52200000000000002}]},{"osd":6,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":6.141,"5min":6.141,"15min":6.141},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":6.2069999999999999,"5min":6.2069999999999999,"15min":6.2069999999999999},"last":0.56000000000000005}]},{"osd":7,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":6.1040000000000001,"5min":6.1040000000000001,"15min":6.1040000000000001},"last":0.57099999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298332,"kb_used_data":1044,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073508,"statfs":{"total":96636764160,"available":96331272192,"internally_reserved":0,"allocated":1069056,"data_stored":801559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":3.9129999999999998,"5min":3.9129999999999998,"15min":3.9129999999999998},"last":0.35999999999999999}]},{"osd":2,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":15.237,"5min":15.237,"15min":15.237},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":3.7959999999999998,"5min":3.7959999999999998,"15min":3.7959999999999998},"last":0.38700000000000001}]},{"osd":3,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":5.2850000000000001,"5min":5.2850000000000001,"15min":5.2850000000000001},"last":0.34499999999999997},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":15.263,"5min":15.263,"15min":15.263},"last":0.42199999999999999}]},{"osd":4,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":5.2590000000000003,"5min":5.2590000000000003,"15min":5.2590000000000003},"last":0.59199999999999997},{"interface":"front","average":{"1min":1.242,"5min":1.242,"15min":1.242},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":15.211,"5min":15.211,"15min":15.211},"last":0.60299999999999998}]},{"osd":5,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":3.8839999999999999,"5min":3.8839999999999999,"15min":3.8839999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":5.2309999999999999,"5min":5.2309999999999999,"15min":5.2309999999999999},"last":0.623}]},{"osd":6,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.212,"15min":1.212},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":15.175000000000001,"5min":15.175000000000001,"15min":15.175000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":3.859,"5min":3.859,"15min":3.859},"last":0.54600000000000004}]},{"osd":7,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":3.831,"5min":3.831,"15min":3.831},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":5.1959999999999997,"5min":5.1959999999999997,"15min":5.1959999999999997},"last":0.52700000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297768,"kb_used_data":480,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074072,"statfs":{"total":96636764160,"available":96331849728,"internally_reserved":0,"allocated":491520,"data_stored":213676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"last":0.314},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"last":0.27500000000000002}]},{"osd":1,"last update":"Fri Oct 6 01:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.311,"15min":0.311},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.24099999999999999}]},{"osd":3,"last update":"Fri Oct 6 01:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.28699999999999998}]},{"osd":4,"last update":"Fri Oct 6 01:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.69299999999999995}]},{"osd":5,"last update":"Fri Oct 6 01:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.52200000000000002}]},{"osd":6,"last update":"Fri Oct 6 01:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.65900000000000003}]},{"osd":7,"last update":"Fri Oct 6 01:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.63600000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297764,"kb_used_data":476,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074076,"statfs":{"total":96636764160,"available":96331853824,"internally_reserved":0,"allocated":487424,"data_stored":212728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.25},{"interface":"front","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.28399999999999997}]},{"osd":1,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.34599999999999997}]},{"osd":2,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.379}]},{"osd":4,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.57399999999999995}]},{"osd":5,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.50600000000000001}]},{"osd":6,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.48599999999999999}]},{"osd":7,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.60299999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297764,"kb_used_data":476,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074076,"statfs":{"total":96636764160,"available":96331853824,"internally_reserved":0,"allocated":487424,"data_stored":213654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.56899999999999995}]},{"osd":1,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":4.0780000000000003,"5min":4.0780000000000003,"15min":4.0780000000000003},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":4.1050000000000004,"5min":4.1050000000000004,"15min":4.1050000000000004},"last":0.48099999999999998}]},{"osd":2,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.59599999999999997}]},{"osd":3,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.58299999999999996}]},{"osd":5,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.437,"15min":0.437},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.63900000000000001}]},{"osd":6,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.63}]},{"osd":7,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.55800000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297756,"kb_used_data":468,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074084,"statfs":{"total":96636764160,"available":96331862016,"internally_reserved":0,"allocated":479232,"data_stored":212188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.56100000000000005}]},{"osd":1,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.54800000000000004}]},{"osd":2,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.6970000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.40300000000000002}]},{"osd":3,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.53700000000000003}]},{"osd":4,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.58999999999999997}]},{"osd":6,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.51500000000000001}]},{"osd":7,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.821,"5min":1.821,"15min":1.821},"last":0.434},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.499}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T01:41:31.177 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T01:41:31.325 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.324+0000 7f2651484700 1 Processor -- start 2023-10-06T01:41:31.325 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.324+0000 7f2651484700 1 -- start start 2023-10-06T01:41:31.328 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.325+0000 7f2651484700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f264c159400 0x7f264c0ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:31.328 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.325+0000 7f2651484700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f264c0d05d0 0x7f264c0b39f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:31.328 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.325+0000 7f2651484700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f264c0b3560 con 0x7f264c0cd030 2023-10-06T01:41:31.328 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.325+0000 7f2651484700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f264c0cf6f0 con 0x7f264c0d05d0 2023-10-06T01:41:31.328 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.325+0000 7f2651484700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f264c0cf9d0 con 0x7f264c159400 2023-10-06T01:41:31.328 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.325+0000 7f2650c83700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f264c0d05d0 0x7f264c0b39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:31.328 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.325+0000 7f264bfff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f264c159400 0x7f264c0ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:31.328 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.325+0000 7f264bfff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f264c159400 0x7f264c0ccaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.71:49006/0 (socket says 172.21.15.71:49006) 2023-10-06T01:41:31.328 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.325+0000 7f2650c83700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f264c0d05d0 0x7f264c0b39f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:38806/0 (socket says 172.21.15.71:38806) 2023-10-06T01:41:31.328 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.325+0000 7f264bfff700 1 -- 172.21.15.71:0/274318060 learned_addr learned my addr 172.21.15.71:0/274318060 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:31.328 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.326+0000 7f264bfff700 1 -- 172.21.15.71:0/274318060 >> v2:172.21.15.72:3300/0 conn(0x7f264c0d05d0 msgr2=0x7f264c0b39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:31.329 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.326+0000 7f264bfff700 1 --2- 172.21.15.71:0/274318060 >> v2:172.21.15.72:3300/0 conn(0x7f264c0d05d0 0x7f264c0b39f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:31.329 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.326+0000 7f264bfff700 1 -- 172.21.15.71:0/274318060 >> v1:172.21.15.72:6789/0 conn(0x7f264c0cd030 legacy=0x7f264c0cfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:31.329 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.326+0000 7f264bfff700 1 -- 172.21.15.71:0/274318060 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f264c0b2f10 con 0x7f264c159400 2023-10-06T01:41:31.329 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.326+0000 7f264bfff700 1 --2- 172.21.15.71:0/274318060 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f264c159400 0x7f264c0ccaf0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2634009990 tx=0x7f2634009220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d8614c68565f197 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:31.329 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.326+0000 7f264affd700 1 -- 172.21.15.71:0/274318060 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2634009e80 con 0x7f264c159400 2023-10-06T01:41:31.329 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.326+0000 7f264affd700 1 -- 172.21.15.71:0/274318060 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2634005c10 con 0x7f264c159400 2023-10-06T01:41:31.329 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.326+0000 7f264affd700 1 -- 172.21.15.71:0/274318060 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f263400b650 con 0x7f264c159400 2023-10-06T01:41:31.329 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.327+0000 7f2651484700 1 -- 172.21.15.71:0/274318060 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f264c159400 msgr2=0x7f264c0ccaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:31.329 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.327+0000 7f2651484700 1 --2- 172.21.15.71:0/274318060 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f264c159400 0x7f264c0ccaf0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2634009990 tx=0x7f2634009220 comp rx=0 tx=0).stop 2023-10-06T01:41:31.329 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.327+0000 7f2651484700 1 -- 172.21.15.71:0/274318060 shutdown_connections 2023-10-06T01:41:31.329 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.327+0000 7f2651484700 1 --2- 172.21.15.71:0/274318060 >> v2:172.21.15.72:3300/0 conn(0x7f264c0d05d0 0x7f264c0b39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:31.329 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.327+0000 7f2651484700 1 --2- 172.21.15.71:0/274318060 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f264c159400 0x7f264c0ccaf0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:31.330 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.327+0000 7f2651484700 1 -- 172.21.15.71:0/274318060 >> 172.21.15.71:0/274318060 conn(0x7f264c06ac10 msgr2=0x7f264c068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:31.330 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.327+0000 7f2651484700 1 -- 172.21.15.71:0/274318060 shutdown_connections 2023-10-06T01:41:31.330 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.327+0000 7f2651484700 1 -- 172.21.15.71:0/274318060 wait complete. 2023-10-06T01:41:31.332 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.328+0000 7f2651484700 1 Processor -- start 2023-10-06T01:41:31.332 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.328+0000 7f2651484700 1 -- start start 2023-10-06T01:41:31.332 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.329+0000 7f2651484700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f264c0cd030 0x7f264c0cb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:31.332 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.329+0000 7f2651484700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f264c0d05d0 0x7f264c13cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:31.332 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.329+0000 7f2651484700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f264c159400 0x7f264c0c9d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:31.332 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.329+0000 7f2651484700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f264c0cb340 con 0x7f264c159400 2023-10-06T01:41:31.333 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.329+0000 7f2651484700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f264c0cbd10 con 0x7f264c0cd030 2023-10-06T01:41:31.333 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.329+0000 7f2651484700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f264c0ca730 con 0x7f264c0d05d0 2023-10-06T01:41:31.333 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.329+0000 7f2650c83700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f264c159400 0x7f264c0c9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:31.333 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.329+0000 7f2650c83700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f264c159400 0x7f264c0c9d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37760/0 (socket says 172.21.15.71:37760) 2023-10-06T01:41:31.333 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.329+0000 7f2650c83700 1 -- 172.21.15.71:0/1286355191 learned_addr learned my addr 172.21.15.71:0/1286355191 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:31.333 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.329+0000 7f264bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f264c0cd030 0x7f264c0cb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:31.333 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.329+0000 7f264b7fe700 1 --2- 172.21.15.71:0/1286355191 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f264c0d05d0 0x7f264c13cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:31.333 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.329+0000 7f2650c83700 1 -- 172.21.15.71:0/1286355191 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f264c0d05d0 msgr2=0x7f264c13cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:31.333 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.329+0000 7f2650c83700 1 --2- 172.21.15.71:0/1286355191 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f264c0d05d0 0x7f264c13cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:31.333 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.329+0000 7f2650c83700 1 -- 172.21.15.71:0/1286355191 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f264c0cd030 msgr2=0x7f264c0cb7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:31.333 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.329+0000 7f2650c83700 1 --2- 172.21.15.71:0/1286355191 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f264c0cd030 0x7f264c0cb7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:31.334 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.329+0000 7f2650c83700 1 -- 172.21.15.71:0/1286355191 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2634009480 con 0x7f264c159400 2023-10-06T01:41:31.334 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.329+0000 7f2650c83700 1 --2- 172.21.15.71:0/1286355191 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f264c159400 0x7f264c0c9d50 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f2644009ef0 tx=0x7f264400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:31.334 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.329+0000 7f2643fff700 1 -- 172.21.15.71:0/1286355191 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f264400cb70 con 0x7f264c159400 2023-10-06T01:41:31.334 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.329+0000 7f2643fff700 1 -- 172.21.15.71:0/1286355191 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f264400f040 con 0x7f264c159400 2023-10-06T01:41:31.334 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.329+0000 7f2651484700 1 -- 172.21.15.71:0/1286355191 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f264c0caa10 con 0x7f264c159400 2023-10-06T01:41:31.334 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.329+0000 7f2643fff700 1 -- 172.21.15.71:0/1286355191 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2644014480 con 0x7f264c159400 2023-10-06T01:41:31.334 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.329+0000 7f2651484700 1 -- 172.21.15.71:0/1286355191 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f264c0cafd0 con 0x7f264c159400 2023-10-06T01:41:31.334 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.330+0000 7f2651484700 1 -- 172.21.15.71:0/1286355191 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f264c0cf230 con 0x7f264c159400 2023-10-06T01:41:31.334 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.331+0000 7f2643fff700 1 -- 172.21.15.71:0/1286355191 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2644014830 con 0x7f264c159400 2023-10-06T01:41:31.334 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.331+0000 7f2643fff700 1 --2- 172.21.15.71:0/1286355191 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f262c066f30 0x7f262c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:31.334 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.331+0000 7f2643fff700 1 -- 172.21.15.71:0/1286355191 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f26440853f0 con 0x7f264c159400 2023-10-06T01:41:31.334 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.331+0000 7f264bfff700 1 --2- 172.21.15.71:0/1286355191 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f262c066f30 0x7f262c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:31.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.331+0000 7f264bfff700 1 --2- 172.21.15.71:0/1286355191 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f262c066f30 0x7f262c0693e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f264c154310 tx=0x7f2634016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:31.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.335+0000 7f2643fff700 1 -- 172.21.15.71:0/1286355191 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f26440523c0 con 0x7f264c159400 2023-10-06T01:41:31.514 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.514+0000 7f2651484700 1 -- 172.21.15.71:0/1286355191 --> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f264c0b3260 con 0x7f262c066f30 2023-10-06T01:41:31.522 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.522+0000 7f2643fff700 1 -- 172.21.15.71:0/1286355191 <== mgr.4107 v2:172.21.15.71:6832/90436 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310770 (secure 0 0 0) 0x7f264c0b3260 con 0x7f262c066f30 2023-10-06T01:41:31.526 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:41:31.528 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.525+0000 7f2651484700 1 -- 172.21.15.71:0/1286355191 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f262c066f30 msgr2=0x7f262c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:31.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.525+0000 7f2651484700 1 --2- 172.21.15.71:0/1286355191 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f262c066f30 0x7f262c0693e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f264c154310 tx=0x7f2634016000 comp rx=0 tx=0).stop 2023-10-06T01:41:31.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.525+0000 7f2651484700 1 -- 172.21.15.71:0/1286355191 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f264c159400 msgr2=0x7f264c0c9d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:31.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.525+0000 7f2651484700 1 --2- 172.21.15.71:0/1286355191 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f264c159400 0x7f264c0c9d50 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f2644009ef0 tx=0x7f264400b040 comp rx=0 tx=0).stop 2023-10-06T01:41:31.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.525+0000 7f2651484700 1 -- 172.21.15.71:0/1286355191 shutdown_connections 2023-10-06T01:41:31.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.525+0000 7f2651484700 1 --2- 172.21.15.71:0/1286355191 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f264c159400 0x7f264c0c9d50 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:31.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.525+0000 7f2651484700 1 --2- 172.21.15.71:0/1286355191 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f262c066f30 0x7f262c0693e0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:31.529 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.525+0000 7f2651484700 1 --2- 172.21.15.71:0/1286355191 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f264c0cd030 0x7f264c0cb7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:31.530 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.525+0000 7f2651484700 1 --2- 172.21.15.71:0/1286355191 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f264c0d05d0 0x7f264c13cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:31.530 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.525+0000 7f2651484700 1 -- 172.21.15.71:0/1286355191 >> 172.21.15.71:0/1286355191 conn(0x7f264c06ac10 msgr2=0x7f264c0b5030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:31.530 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.525+0000 7f2651484700 1 -- 172.21.15.71:0/1286355191 shutdown_connections 2023-10-06T01:41:31.530 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.525+0000 7f2651484700 1 -- 172.21.15.71:0/1286355191 wait complete. 2023-10-06T01:41:31.530 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2023-10-06T01:41:31.538 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":75,"stamp":"2023-10-06T01:41:30.578633+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":156,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2383236,"kb_used_data":4932,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752591484,"statfs":{"total":773094113280,"available":770653679616,"internally_reserved":0,"allocated":5050368,"data_stored":2881331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.485959"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.828660+0000","last_change":"2023-10-06T01:41:26.827558+0000","last_active":"2023-10-06T01:41:26.828660+0000","last_peered":"2023-10-06T01:41:26.828660+0000","last_clean":"2023-10-06T01:41:26.828660+0000","last_became_active":"2023-10-06T01:41:26.827254+0000","last_became_peered":"2023-10-06T01:41:26.827254+0000","last_unstale":"2023-10-06T01:41:26.828660+0000","last_undegraded":"2023-10-06T01:41:26.828660+0000","last_fullsized":"2023-10-06T01:41:26.828660+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:14:16.658005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.835682+0000","last_change":"2023-10-06T01:41:26.834572+0000","last_active":"2023-10-06T01:41:26.835682+0000","last_peered":"2023-10-06T01:41:26.835682+0000","last_clean":"2023-10-06T01:41:26.835682+0000","last_became_active":"2023-10-06T01:41:26.834299+0000","last_became_peered":"2023-10-06T01:41:26.834299+0000","last_unstale":"2023-10-06T01:41:26.835682+0000","last_undegraded":"2023-10-06T01:41:26.835682+0000","last_fullsized":"2023-10-06T01:41:26.835682+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:08:44.723266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.825626+0000","last_change":"2023-10-06T01:41:26.821688+0000","last_active":"2023-10-06T01:41:26.825626+0000","last_peered":"2023-10-06T01:41:26.825626+0000","last_clean":"2023-10-06T01:41:26.825626+0000","last_became_active":"2023-10-06T01:41:26.821424+0000","last_became_peered":"2023-10-06T01:41:26.821424+0000","last_unstale":"2023-10-06T01:41:26.825626+0000","last_undegraded":"2023-10-06T01:41:26.825626+0000","last_fullsized":"2023-10-06T01:41:26.825626+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:52:02.886097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.833219+0000","last_change":"2023-10-06T01:41:26.832578+0000","last_active":"2023-10-06T01:41:26.833219+0000","last_peered":"2023-10-06T01:41:26.833219+0000","last_clean":"2023-10-06T01:41:26.833219+0000","last_became_active":"2023-10-06T01:41:26.832401+0000","last_became_peered":"2023-10-06T01:41:26.832401+0000","last_unstale":"2023-10-06T01:41:26.833219+0000","last_undegraded":"2023-10-06T01:41:26.833219+0000","last_fullsized":"2023-10-06T01:41:26.833219+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:01:51.254365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.833668+0000","last_change":"2023-10-06T01:41:26.832196+0000","last_active":"2023-10-06T01:41:26.833668+0000","last_peered":"2023-10-06T01:41:26.833668+0000","last_clean":"2023-10-06T01:41:26.833668+0000","last_became_active":"2023-10-06T01:41:26.831826+0000","last_became_peered":"2023-10-06T01:41:26.831826+0000","last_unstale":"2023-10-06T01:41:26.833668+0000","last_undegraded":"2023-10-06T01:41:26.833668+0000","last_fullsized":"2023-10-06T01:41:26.833668+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:03:47.822189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.828804+0000","last_change":"2023-10-06T01:41:26.823100+0000","last_active":"2023-10-06T01:41:26.828804+0000","last_peered":"2023-10-06T01:41:26.828804+0000","last_clean":"2023-10-06T01:41:26.828804+0000","last_became_active":"2023-10-06T01:41:26.821627+0000","last_became_peered":"2023-10-06T01:41:26.821627+0000","last_unstale":"2023-10-06T01:41:26.828804+0000","last_undegraded":"2023-10-06T01:41:26.828804+0000","last_fullsized":"2023-10-06T01:41:26.828804+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:18:34.124375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.828287+0000","last_change":"2023-10-06T01:41:26.827224+0000","last_active":"2023-10-06T01:41:26.828287+0000","last_peered":"2023-10-06T01:41:26.828287+0000","last_clean":"2023-10-06T01:41:26.828287+0000","last_became_active":"2023-10-06T01:41:26.826393+0000","last_became_peered":"2023-10-06T01:41:26.826393+0000","last_unstale":"2023-10-06T01:41:26.828287+0000","last_undegraded":"2023-10-06T01:41:26.828287+0000","last_fullsized":"2023-10-06T01:41:26.828287+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:18:29.375501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.832594+0000","last_change":"2023-10-06T01:41:26.831677+0000","last_active":"2023-10-06T01:41:26.832594+0000","last_peered":"2023-10-06T01:41:26.832594+0000","last_clean":"2023-10-06T01:41:26.832594+0000","last_became_active":"2023-10-06T01:41:26.831441+0000","last_became_peered":"2023-10-06T01:41:26.831441+0000","last_unstale":"2023-10-06T01:41:26.832594+0000","last_undegraded":"2023-10-06T01:41:26.832594+0000","last_fullsized":"2023-10-06T01:41:26.832594+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:43:40.038663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.831498+0000","last_change":"2023-10-06T01:41:26.824289+0000","last_active":"2023-10-06T01:41:26.831498+0000","last_peered":"2023-10-06T01:41:26.831498+0000","last_clean":"2023-10-06T01:41:26.831498+0000","last_became_active":"2023-10-06T01:41:26.823622+0000","last_became_peered":"2023-10-06T01:41:26.823622+0000","last_unstale":"2023-10-06T01:41:26.831498+0000","last_undegraded":"2023-10-06T01:41:26.831498+0000","last_fullsized":"2023-10-06T01:41:26.831498+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:18:34.124375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.833848+0000","last_change":"2023-10-06T01:41:26.833145+0000","last_active":"2023-10-06T01:41:26.833848+0000","last_peered":"2023-10-06T01:41:26.833848+0000","last_clean":"2023-10-06T01:41:26.833848+0000","last_became_active":"2023-10-06T01:41:26.832828+0000","last_became_peered":"2023-10-06T01:41:26.832828+0000","last_unstale":"2023-10-06T01:41:26.833848+0000","last_undegraded":"2023-10-06T01:41:26.833848+0000","last_fullsized":"2023-10-06T01:41:26.833848+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:06:06.225550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.832397+0000","last_change":"2023-10-06T01:41:26.826901+0000","last_active":"2023-10-06T01:41:26.832397+0000","last_peered":"2023-10-06T01:41:26.832397+0000","last_clean":"2023-10-06T01:41:26.832397+0000","last_became_active":"2023-10-06T01:41:26.826646+0000","last_became_peered":"2023-10-06T01:41:26.826646+0000","last_unstale":"2023-10-06T01:41:26.832397+0000","last_undegraded":"2023-10-06T01:41:26.832397+0000","last_fullsized":"2023-10-06T01:41:26.832397+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:12:28.103885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.830082+0000","last_change":"2023-10-06T01:41:26.826137+0000","last_active":"2023-10-06T01:41:26.830082+0000","last_peered":"2023-10-06T01:41:26.830082+0000","last_clean":"2023-10-06T01:41:26.830082+0000","last_became_active":"2023-10-06T01:41:26.825488+0000","last_became_peered":"2023-10-06T01:41:26.825488+0000","last_unstale":"2023-10-06T01:41:26.830082+0000","last_undegraded":"2023-10-06T01:41:26.830082+0000","last_fullsized":"2023-10-06T01:41:26.830082+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:27:59.329803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.828348+0000","last_change":"2023-10-06T01:41:26.823986+0000","last_active":"2023-10-06T01:41:26.828348+0000","last_peered":"2023-10-06T01:41:26.828348+0000","last_clean":"2023-10-06T01:41:26.828348+0000","last_became_active":"2023-10-06T01:41:26.823610+0000","last_became_peered":"2023-10-06T01:41:26.823610+0000","last_unstale":"2023-10-06T01:41:26.828348+0000","last_undegraded":"2023-10-06T01:41:26.828348+0000","last_fullsized":"2023-10-06T01:41:26.828348+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:49:42.258001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.832101+0000","last_change":"2023-10-06T01:41:26.823787+0000","last_active":"2023-10-06T01:41:26.832101+0000","last_peered":"2023-10-06T01:41:26.832101+0000","last_clean":"2023-10-06T01:41:26.832101+0000","last_became_active":"2023-10-06T01:41:26.823527+0000","last_became_peered":"2023-10-06T01:41:26.823527+0000","last_unstale":"2023-10-06T01:41:26.832101+0000","last_undegraded":"2023-10-06T01:41:26.832101+0000","last_fullsized":"2023-10-06T01:41:26.832101+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:52:02.886097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.824178+0000","last_change":"2023-10-06T01:41:26.819931+0000","last_active":"2023-10-06T01:41:26.824178+0000","last_peered":"2023-10-06T01:41:26.824178+0000","last_clean":"2023-10-06T01:41:26.824178+0000","last_became_active":"2023-10-06T01:41:26.819675+0000","last_became_peered":"2023-10-06T01:41:26.819675+0000","last_unstale":"2023-10-06T01:41:26.824178+0000","last_undegraded":"2023-10-06T01:41:26.824178+0000","last_fullsized":"2023-10-06T01:41:26.824178+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:01:33.092370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.834565+0000","last_change":"2023-10-06T01:41:26.833492+0000","last_active":"2023-10-06T01:41:26.834565+0000","last_peered":"2023-10-06T01:41:26.834565+0000","last_clean":"2023-10-06T01:41:26.834565+0000","last_became_active":"2023-10-06T01:41:26.833121+0000","last_became_peered":"2023-10-06T01:41:26.833121+0000","last_unstale":"2023-10-06T01:41:26.834565+0000","last_undegraded":"2023-10-06T01:41:26.834565+0000","last_fullsized":"2023-10-06T01:41:26.834565+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:01:59.421328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.826704+0000","last_change":"2023-10-06T01:41:26.825219+0000","last_active":"2023-10-06T01:41:26.826704+0000","last_peered":"2023-10-06T01:41:26.826704+0000","last_clean":"2023-10-06T01:41:26.826704+0000","last_became_active":"2023-10-06T01:41:26.824341+0000","last_became_peered":"2023-10-06T01:41:26.824341+0000","last_unstale":"2023-10-06T01:41:26.826704+0000","last_undegraded":"2023-10-06T01:41:26.826704+0000","last_fullsized":"2023-10-06T01:41:26.826704+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:39:56.013958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.835710+0000","last_change":"2023-10-06T01:41:26.833788+0000","last_active":"2023-10-06T01:41:26.835710+0000","last_peered":"2023-10-06T01:41:26.835710+0000","last_clean":"2023-10-06T01:41:26.835710+0000","last_became_active":"2023-10-06T01:41:26.833160+0000","last_became_peered":"2023-10-06T01:41:26.833160+0000","last_unstale":"2023-10-06T01:41:26.835710+0000","last_undegraded":"2023-10-06T01:41:26.835710+0000","last_fullsized":"2023-10-06T01:41:26.835710+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:48:01.369719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.831361+0000","last_change":"2023-10-06T01:41:26.829947+0000","last_active":"2023-10-06T01:41:26.831361+0000","last_peered":"2023-10-06T01:41:26.831361+0000","last_clean":"2023-10-06T01:41:26.831361+0000","last_became_active":"2023-10-06T01:41:26.829659+0000","last_became_peered":"2023-10-06T01:41:26.829659+0000","last_unstale":"2023-10-06T01:41:26.831361+0000","last_undegraded":"2023-10-06T01:41:26.831361+0000","last_fullsized":"2023-10-06T01:41:26.831361+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:24:52.262682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.830148+0000","last_change":"2023-10-06T01:41:26.827260+0000","last_active":"2023-10-06T01:41:26.830148+0000","last_peered":"2023-10-06T01:41:26.830148+0000","last_clean":"2023-10-06T01:41:26.830148+0000","last_became_active":"2023-10-06T01:41:26.826780+0000","last_became_peered":"2023-10-06T01:41:26.826780+0000","last_unstale":"2023-10-06T01:41:26.830148+0000","last_undegraded":"2023-10-06T01:41:26.830148+0000","last_fullsized":"2023-10-06T01:41:26.830148+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:49:31.447635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.825956+0000","last_change":"2023-10-06T01:41:26.820610+0000","last_active":"2023-10-06T01:41:26.825956+0000","last_peered":"2023-10-06T01:41:26.825956+0000","last_clean":"2023-10-06T01:41:26.825956+0000","last_became_active":"2023-10-06T01:41:26.820352+0000","last_became_peered":"2023-10-06T01:41:26.820352+0000","last_unstale":"2023-10-06T01:41:26.825956+0000","last_undegraded":"2023-10-06T01:41:26.825956+0000","last_fullsized":"2023-10-06T01:41:26.825956+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:06:06.225550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.832332+0000","last_change":"2023-10-06T01:41:26.826878+0000","last_active":"2023-10-06T01:41:26.832332+0000","last_peered":"2023-10-06T01:41:26.832332+0000","last_clean":"2023-10-06T01:41:26.832332+0000","last_became_active":"2023-10-06T01:41:26.826618+0000","last_became_peered":"2023-10-06T01:41:26.826618+0000","last_unstale":"2023-10-06T01:41:26.832332+0000","last_undegraded":"2023-10-06T01:41:26.832332+0000","last_fullsized":"2023-10-06T01:41:26.832332+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:23:49.561289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.829399+0000","last_change":"2023-10-06T01:41:26.823743+0000","last_active":"2023-10-06T01:41:26.829399+0000","last_peered":"2023-10-06T01:41:26.829399+0000","last_clean":"2023-10-06T01:41:26.829399+0000","last_became_active":"2023-10-06T01:41:26.821147+0000","last_became_peered":"2023-10-06T01:41:26.821147+0000","last_unstale":"2023-10-06T01:41:26.829399+0000","last_undegraded":"2023-10-06T01:41:26.829399+0000","last_fullsized":"2023-10-06T01:41:26.829399+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:35:09.682504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.823577+0000","last_change":"2023-10-06T01:41:26.822044+0000","last_active":"2023-10-06T01:41:26.823577+0000","last_peered":"2023-10-06T01:41:26.823577+0000","last_clean":"2023-10-06T01:41:26.823577+0000","last_became_active":"2023-10-06T01:41:26.821848+0000","last_became_peered":"2023-10-06T01:41:26.821848+0000","last_unstale":"2023-10-06T01:41:26.823577+0000","last_undegraded":"2023-10-06T01:41:26.823577+0000","last_fullsized":"2023-10-06T01:41:26.823577+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:52:39.363663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.829300+0000","last_change":"2023-10-06T01:41:26.824652+0000","last_active":"2023-10-06T01:41:26.829300+0000","last_peered":"2023-10-06T01:41:26.829300+0000","last_clean":"2023-10-06T01:41:26.829300+0000","last_became_active":"2023-10-06T01:41:26.824400+0000","last_became_peered":"2023-10-06T01:41:26.824400+0000","last_unstale":"2023-10-06T01:41:26.829300+0000","last_undegraded":"2023-10-06T01:41:26.829300+0000","last_fullsized":"2023-10-06T01:41:26.829300+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:41:44.253849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.827151+0000","last_change":"2023-10-06T01:41:26.823376+0000","last_active":"2023-10-06T01:41:26.827151+0000","last_peered":"2023-10-06T01:41:26.827151+0000","last_clean":"2023-10-06T01:41:26.827151+0000","last_became_active":"2023-10-06T01:41:26.823125+0000","last_became_peered":"2023-10-06T01:41:26.823125+0000","last_unstale":"2023-10-06T01:41:26.827151+0000","last_undegraded":"2023-10-06T01:41:26.827151+0000","last_fullsized":"2023-10-06T01:41:26.827151+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:02:47.981436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.826669+0000","last_change":"2023-10-06T01:41:26.825096+0000","last_active":"2023-10-06T01:41:26.826669+0000","last_peered":"2023-10-06T01:41:26.826669+0000","last_clean":"2023-10-06T01:41:26.826669+0000","last_became_active":"2023-10-06T01:41:26.823940+0000","last_became_peered":"2023-10-06T01:41:26.823940+0000","last_unstale":"2023-10-06T01:41:26.826669+0000","last_undegraded":"2023-10-06T01:41:26.826669+0000","last_fullsized":"2023-10-06T01:41:26.826669+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:51:56.204830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.830104+0000","last_change":"2023-10-06T01:41:26.826290+0000","last_active":"2023-10-06T01:41:26.830104+0000","last_peered":"2023-10-06T01:41:26.830104+0000","last_clean":"2023-10-06T01:41:26.830104+0000","last_became_active":"2023-10-06T01:41:26.825851+0000","last_became_peered":"2023-10-06T01:41:26.825851+0000","last_unstale":"2023-10-06T01:41:26.830104+0000","last_undegraded":"2023-10-06T01:41:26.830104+0000","last_fullsized":"2023-10-06T01:41:26.830104+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:18:29.375501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.829345+0000","last_change":"2023-10-06T01:41:26.824866+0000","last_active":"2023-10-06T01:41:26.829345+0000","last_peered":"2023-10-06T01:41:26.829345+0000","last_clean":"2023-10-06T01:41:26.829345+0000","last_became_active":"2023-10-06T01:41:26.824586+0000","last_became_peered":"2023-10-06T01:41:26.824586+0000","last_unstale":"2023-10-06T01:41:26.829345+0000","last_undegraded":"2023-10-06T01:41:26.829345+0000","last_fullsized":"2023-10-06T01:41:26.829345+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:49:31.447635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.823592+0000","last_change":"2023-10-06T01:41:26.820900+0000","last_active":"2023-10-06T01:41:26.823592+0000","last_peered":"2023-10-06T01:41:26.823592+0000","last_clean":"2023-10-06T01:41:26.823592+0000","last_became_active":"2023-10-06T01:41:26.820629+0000","last_became_peered":"2023-10-06T01:41:26.820629+0000","last_unstale":"2023-10-06T01:41:26.823592+0000","last_undegraded":"2023-10-06T01:41:26.823592+0000","last_fullsized":"2023-10-06T01:41:26.823592+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:43:40.038663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.828389+0000","last_change":"2023-10-06T01:41:26.822928+0000","last_active":"2023-10-06T01:41:26.828389+0000","last_peered":"2023-10-06T01:41:26.828389+0000","last_clean":"2023-10-06T01:41:26.828389+0000","last_became_active":"2023-10-06T01:41:26.822683+0000","last_became_peered":"2023-10-06T01:41:26.822683+0000","last_unstale":"2023-10-06T01:41:26.828389+0000","last_undegraded":"2023-10-06T01:41:26.828389+0000","last_fullsized":"2023-10-06T01:41:26.828389+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:43:40.038663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.825090+0000","last_change":"2023-10-06T01:41:26.821793+0000","last_active":"2023-10-06T01:41:26.825090+0000","last_peered":"2023-10-06T01:41:26.825090+0000","last_clean":"2023-10-06T01:41:26.825090+0000","last_became_active":"2023-10-06T01:41:26.821541+0000","last_became_peered":"2023-10-06T01:41:26.821541+0000","last_unstale":"2023-10-06T01:41:26.825090+0000","last_undegraded":"2023-10-06T01:41:26.825090+0000","last_fullsized":"2023-10-06T01:41:26.825090+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:23:14.876172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.824247+0000","last_change":"2023-10-06T01:41:26.823092+0000","last_active":"2023-10-06T01:41:26.824247+0000","last_peered":"2023-10-06T01:41:26.824247+0000","last_clean":"2023-10-06T01:41:26.824247+0000","last_became_active":"2023-10-06T01:41:26.822856+0000","last_became_peered":"2023-10-06T01:41:26.822856+0000","last_unstale":"2023-10-06T01:41:26.824247+0000","last_undegraded":"2023-10-06T01:41:26.824247+0000","last_fullsized":"2023-10-06T01:41:26.824247+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:02:47.981436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"40'4","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:27.131134+0000","last_change":"2023-10-06T01:41:26.111498+0000","last_active":"2023-10-06T01:41:27.131134+0000","last_peered":"2023-10-06T01:41:27.131134+0000","last_clean":"2023-10-06T01:41:27.131134+0000","last_became_active":"2023-10-06T01:41:26.111208+0000","last_became_peered":"2023-10-06T01:41:26.111208+0000","last_unstale":"2023-10-06T01:41:27.131134+0000","last_undegraded":"2023-10-06T01:41:27.131134+0000","last_fullsized":"2023-10-06T01:41:27.131134+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_clean_scrub_stamp":"2023-10-06T01:41:25.085467+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:20.212462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.829347+0000","last_change":"2023-10-06T01:41:26.825201+0000","last_active":"2023-10-06T01:41:26.829347+0000","last_peered":"2023-10-06T01:41:26.829347+0000","last_clean":"2023-10-06T01:41:26.829347+0000","last_became_active":"2023-10-06T01:41:26.824955+0000","last_became_peered":"2023-10-06T01:41:26.824955+0000","last_unstale":"2023-10-06T01:41:26.829347+0000","last_undegraded":"2023-10-06T01:41:26.829347+0000","last_fullsized":"2023-10-06T01:41:26.829347+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:02:47.981436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"40'1","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:27.126970+0000","last_change":"2023-10-06T01:41:26.120756+0000","last_active":"2023-10-06T01:41:27.126970+0000","last_peered":"2023-10-06T01:41:27.126970+0000","last_clean":"2023-10-06T01:41:27.126970+0000","last_became_active":"2023-10-06T01:41:26.120489+0000","last_became_peered":"2023-10-06T01:41:26.120489+0000","last_unstale":"2023-10-06T01:41:27.126970+0000","last_undegraded":"2023-10-06T01:41:27.126970+0000","last_fullsized":"2023-10-06T01:41:27.126970+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_clean_scrub_stamp":"2023-10-06T01:41:25.085467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:14:15.651618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.830224+0000","last_change":"2023-10-06T01:41:26.827507+0000","last_active":"2023-10-06T01:41:26.830224+0000","last_peered":"2023-10-06T01:41:26.830224+0000","last_clean":"2023-10-06T01:41:26.830224+0000","last_became_active":"2023-10-06T01:41:26.827218+0000","last_became_peered":"2023-10-06T01:41:26.827218+0000","last_unstale":"2023-10-06T01:41:26.830224+0000","last_undegraded":"2023-10-06T01:41:26.830224+0000","last_fullsized":"2023-10-06T01:41:26.830224+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:18:27.983245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"40'2","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:27.126231+0000","last_change":"2023-10-06T01:41:26.112124+0000","last_active":"2023-10-06T01:41:27.126231+0000","last_peered":"2023-10-06T01:41:27.126231+0000","last_clean":"2023-10-06T01:41:27.126231+0000","last_became_active":"2023-10-06T01:41:26.111199+0000","last_became_peered":"2023-10-06T01:41:26.111199+0000","last_unstale":"2023-10-06T01:41:27.126231+0000","last_undegraded":"2023-10-06T01:41:27.126231+0000","last_fullsized":"2023-10-06T01:41:27.126231+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_clean_scrub_stamp":"2023-10-06T01:41:25.085467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:41:43.247462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.827597+0000","last_change":"2023-10-06T01:41:26.825431+0000","last_active":"2023-10-06T01:41:26.827597+0000","last_peered":"2023-10-06T01:41:26.827597+0000","last_clean":"2023-10-06T01:41:26.827597+0000","last_became_active":"2023-10-06T01:41:26.824877+0000","last_became_peered":"2023-10-06T01:41:26.824877+0000","last_unstale":"2023-10-06T01:41:26.827597+0000","last_undegraded":"2023-10-06T01:41:26.827597+0000","last_fullsized":"2023-10-06T01:41:26.827597+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:57:16.248663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"40'2","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:27.131024+0000","last_change":"2023-10-06T01:41:26.115205+0000","last_active":"2023-10-06T01:41:27.131024+0000","last_peered":"2023-10-06T01:41:27.131024+0000","last_clean":"2023-10-06T01:41:27.131024+0000","last_became_active":"2023-10-06T01:41:26.114921+0000","last_became_peered":"2023-10-06T01:41:26.114921+0000","last_unstale":"2023-10-06T01:41:27.131024+0000","last_undegraded":"2023-10-06T01:41:27.131024+0000","last_fullsized":"2023-10-06T01:41:27.131024+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_clean_scrub_stamp":"2023-10-06T01:41:25.085467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:49:41.251613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.825126+0000","last_change":"2023-10-06T01:41:26.824093+0000","last_active":"2023-10-06T01:41:26.825126+0000","last_peered":"2023-10-06T01:41:26.825126+0000","last_clean":"2023-10-06T01:41:26.825126+0000","last_became_active":"2023-10-06T01:41:26.823806+0000","last_became_peered":"2023-10-06T01:41:26.823806+0000","last_unstale":"2023-10-06T01:41:26.825126+0000","last_undegraded":"2023-10-06T01:41:26.825126+0000","last_fullsized":"2023-10-06T01:41:26.825126+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:06:06.225550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"40'1","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:27.127782+0000","last_change":"2023-10-06T01:41:26.115009+0000","last_active":"2023-10-06T01:41:27.127782+0000","last_peered":"2023-10-06T01:41:27.127782+0000","last_clean":"2023-10-06T01:41:27.127782+0000","last_became_active":"2023-10-06T01:41:26.114791+0000","last_became_peered":"2023-10-06T01:41:26.114791+0000","last_unstale":"2023-10-06T01:41:27.127782+0000","last_undegraded":"2023-10-06T01:41:27.127782+0000","last_fullsized":"2023-10-06T01:41:27.127782+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_clean_scrub_stamp":"2023-10-06T01:41:25.085467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:01:58.414941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.832519+0000","last_change":"2023-10-06T01:41:26.827259+0000","last_active":"2023-10-06T01:41:26.832519+0000","last_peered":"2023-10-06T01:41:26.832519+0000","last_clean":"2023-10-06T01:41:26.832519+0000","last_became_active":"2023-10-06T01:41:26.824329+0000","last_became_peered":"2023-10-06T01:41:26.824329+0000","last_unstale":"2023-10-06T01:41:26.832519+0000","last_undegraded":"2023-10-06T01:41:26.832519+0000","last_fullsized":"2023-10-06T01:41:26.832519+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:39:56.013958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"40'1","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:27.126688+0000","last_change":"2023-10-06T01:41:26.112833+0000","last_active":"2023-10-06T01:41:27.126688+0000","last_peered":"2023-10-06T01:41:27.126688+0000","last_clean":"2023-10-06T01:41:27.126688+0000","last_became_active":"2023-10-06T01:41:26.112476+0000","last_became_peered":"2023-10-06T01:41:26.112476+0000","last_unstale":"2023-10-06T01:41:27.126688+0000","last_undegraded":"2023-10-06T01:41:27.126688+0000","last_fullsized":"2023-10-06T01:41:27.126688+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_clean_scrub_stamp":"2023-10-06T01:41:25.085467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:18:28.369114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.832554+0000","last_change":"2023-10-06T01:41:26.829731+0000","last_active":"2023-10-06T01:41:26.832554+0000","last_peered":"2023-10-06T01:41:26.832554+0000","last_clean":"2023-10-06T01:41:26.832554+0000","last_became_active":"2023-10-06T01:41:26.829595+0000","last_became_peered":"2023-10-06T01:41:26.829595+0000","last_unstale":"2023-10-06T01:41:26.832554+0000","last_undegraded":"2023-10-06T01:41:26.832554+0000","last_fullsized":"2023-10-06T01:41:26.832554+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:49:52.344585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.818298+0000","last_change":"2023-10-06T01:41:26.110569+0000","last_active":"2023-10-06T01:41:26.818298+0000","last_peered":"2023-10-06T01:41:26.818298+0000","last_clean":"2023-10-06T01:41:26.818298+0000","last_became_active":"2023-10-06T01:41:26.110282+0000","last_became_peered":"2023-10-06T01:41:26.110282+0000","last_unstale":"2023-10-06T01:41:26.818298+0000","last_undegraded":"2023-10-06T01:41:26.818298+0000","last_fullsized":"2023-10-06T01:41:26.818298+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_clean_scrub_stamp":"2023-10-06T01:41:25.085467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:36:16.367983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.825581+0000","last_change":"2023-10-06T01:41:26.821335+0000","last_active":"2023-10-06T01:41:26.825581+0000","last_peered":"2023-10-06T01:41:26.825581+0000","last_clean":"2023-10-06T01:41:26.825581+0000","last_became_active":"2023-10-06T01:41:26.820993+0000","last_became_peered":"2023-10-06T01:41:26.820993+0000","last_unstale":"2023-10-06T01:41:26.825581+0000","last_undegraded":"2023-10-06T01:41:26.825581+0000","last_fullsized":"2023-10-06T01:41:26.825581+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:21.218850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.820907+0000","last_change":"2023-10-06T01:41:26.113998+0000","last_active":"2023-10-06T01:41:26.820907+0000","last_peered":"2023-10-06T01:41:26.820907+0000","last_clean":"2023-10-06T01:41:26.820907+0000","last_became_active":"2023-10-06T01:41:26.113113+0000","last_became_peered":"2023-10-06T01:41:26.113113+0000","last_unstale":"2023-10-06T01:41:26.820907+0000","last_undegraded":"2023-10-06T01:41:26.820907+0000","last_fullsized":"2023-10-06T01:41:26.820907+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_clean_scrub_stamp":"2023-10-06T01:41:25.085467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:57:15.242276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.835722+0000","last_change":"2023-10-06T01:41:26.833973+0000","last_active":"2023-10-06T01:41:26.835722+0000","last_peered":"2023-10-06T01:41:26.835722+0000","last_clean":"2023-10-06T01:41:26.835722+0000","last_became_active":"2023-10-06T01:41:26.833525+0000","last_became_peered":"2023-10-06T01:41:26.833525+0000","last_unstale":"2023-10-06T01:41:26.835722+0000","last_undegraded":"2023-10-06T01:41:26.835722+0000","last_fullsized":"2023-10-06T01:41:26.835722+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:21:56.382339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.813541+0000","last_change":"2023-10-06T01:41:26.102557+0000","last_active":"2023-10-06T01:41:26.813541+0000","last_peered":"2023-10-06T01:41:26.813541+0000","last_clean":"2023-10-06T01:41:26.813541+0000","last_became_active":"2023-10-06T01:41:26.102247+0000","last_became_peered":"2023-10-06T01:41:26.102247+0000","last_unstale":"2023-10-06T01:41:26.813541+0000","last_undegraded":"2023-10-06T01:41:26.813541+0000","last_fullsized":"2023-10-06T01:41:26.813541+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_clean_scrub_stamp":"2023-10-06T01:41:25.085467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:50:00.275736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.830775+0000","last_change":"2023-10-06T01:41:26.828572+0000","last_active":"2023-10-06T01:41:26.830775+0000","last_peered":"2023-10-06T01:41:26.830775+0000","last_clean":"2023-10-06T01:41:26.830775+0000","last_became_active":"2023-10-06T01:41:26.828292+0000","last_became_peered":"2023-10-06T01:41:26.828292+0000","last_unstale":"2023-10-06T01:41:26.830775+0000","last_undegraded":"2023-10-06T01:41:26.830775+0000","last_fullsized":"2023-10-06T01:41:26.830775+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:27:59.329803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.821172+0000","last_change":"2023-10-06T01:41:26.114744+0000","last_active":"2023-10-06T01:41:26.821172+0000","last_peered":"2023-10-06T01:41:26.821172+0000","last_clean":"2023-10-06T01:41:26.821172+0000","last_became_active":"2023-10-06T01:41:26.113390+0000","last_became_peered":"2023-10-06T01:41:26.113390+0000","last_unstale":"2023-10-06T01:41:26.821172+0000","last_undegraded":"2023-10-06T01:41:26.821172+0000","last_fullsized":"2023-10-06T01:41:26.821172+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_clean_scrub_stamp":"2023-10-06T01:41:25.085467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:06.865277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.823919+0000","last_change":"2023-10-06T01:41:26.819193+0000","last_active":"2023-10-06T01:41:26.823919+0000","last_peered":"2023-10-06T01:41:26.823919+0000","last_clean":"2023-10-06T01:41:26.823919+0000","last_became_active":"2023-10-06T01:41:26.818921+0000","last_became_peered":"2023-10-06T01:41:26.818921+0000","last_unstale":"2023-10-06T01:41:26.823919+0000","last_undegraded":"2023-10-06T01:41:26.823919+0000","last_fullsized":"2023-10-06T01:41:26.823919+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:52:02.886097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"40'3","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:27.127498+0000","last_change":"2023-10-06T01:41:26.122005+0000","last_active":"2023-10-06T01:41:27.127498+0000","last_peered":"2023-10-06T01:41:27.127498+0000","last_clean":"2023-10-06T01:41:27.127498+0000","last_became_active":"2023-10-06T01:41:26.121719+0000","last_became_peered":"2023-10-06T01:41:26.121719+0000","last_unstale":"2023-10-06T01:41:27.127498+0000","last_undegraded":"2023-10-06T01:41:27.127498+0000","last_fullsized":"2023-10-06T01:41:27.127498+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_clean_scrub_stamp":"2023-10-06T01:41:25.085467+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:36:16.367983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.830792+0000","last_change":"2023-10-06T01:41:26.828842+0000","last_active":"2023-10-06T01:41:26.830792+0000","last_peered":"2023-10-06T01:41:26.830792+0000","last_clean":"2023-10-06T01:41:26.830792+0000","last_became_active":"2023-10-06T01:41:26.828434+0000","last_became_peered":"2023-10-06T01:41:26.828434+0000","last_unstale":"2023-10-06T01:41:26.830792+0000","last_undegraded":"2023-10-06T01:41:26.830792+0000","last_fullsized":"2023-10-06T01:41:26.830792+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:09:10.516132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"40'6","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:27.131909+0000","last_change":"2023-10-06T01:41:26.102865+0000","last_active":"2023-10-06T01:41:27.131909+0000","last_peered":"2023-10-06T01:41:27.131909+0000","last_clean":"2023-10-06T01:41:27.131909+0000","last_became_active":"2023-10-06T01:41:26.102602+0000","last_became_peered":"2023-10-06T01:41:26.102602+0000","last_unstale":"2023-10-06T01:41:27.131909+0000","last_undegraded":"2023-10-06T01:41:27.131909+0000","last_fullsized":"2023-10-06T01:41:27.131909+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_clean_scrub_stamp":"2023-10-06T01:41:25.085467+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:30:56.249670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.834995+0000","last_change":"2023-10-06T01:41:26.833904+0000","last_active":"2023-10-06T01:41:26.834995+0000","last_peered":"2023-10-06T01:41:26.834995+0000","last_clean":"2023-10-06T01:41:26.834995+0000","last_became_active":"2023-10-06T01:41:26.833625+0000","last_became_peered":"2023-10-06T01:41:26.833625+0000","last_unstale":"2023-10-06T01:41:26.834995+0000","last_undegraded":"2023-10-06T01:41:26.834995+0000","last_fullsized":"2023-10-06T01:41:26.834995+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:16:32.023169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"40'2","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:27.130858+0000","last_change":"2023-10-06T01:41:26.113405+0000","last_active":"2023-10-06T01:41:27.130858+0000","last_peered":"2023-10-06T01:41:27.130858+0000","last_clean":"2023-10-06T01:41:27.130858+0000","last_became_active":"2023-10-06T01:41:26.113166+0000","last_became_peered":"2023-10-06T01:41:26.113166+0000","last_unstale":"2023-10-06T01:41:27.130858+0000","last_undegraded":"2023-10-06T01:41:27.130858+0000","last_fullsized":"2023-10-06T01:41:27.130858+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_clean_scrub_stamp":"2023-10-06T01:41:25.085467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:52:38.357276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.831503+0000","last_change":"2023-10-06T01:41:26.823968+0000","last_active":"2023-10-06T01:41:26.831503+0000","last_peered":"2023-10-06T01:41:26.831503+0000","last_clean":"2023-10-06T01:41:26.831503+0000","last_became_active":"2023-10-06T01:41:26.823694+0000","last_became_peered":"2023-10-06T01:41:26.823694+0000","last_unstale":"2023-10-06T01:41:26.831503+0000","last_undegraded":"2023-10-06T01:41:26.831503+0000","last_fullsized":"2023-10-06T01:41:26.831503+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:14:19.138080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.822208+0000","last_change":"2023-10-06T01:41:26.114851+0000","last_active":"2023-10-06T01:41:26.822208+0000","last_peered":"2023-10-06T01:41:26.822208+0000","last_clean":"2023-10-06T01:41:26.822208+0000","last_became_active":"2023-10-06T01:41:26.114589+0000","last_became_peered":"2023-10-06T01:41:26.114589+0000","last_unstale":"2023-10-06T01:41:26.822208+0000","last_undegraded":"2023-10-06T01:41:26.822208+0000","last_fullsized":"2023-10-06T01:41:26.822208+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_clean_scrub_stamp":"2023-10-06T01:41:25.085467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:57:15.242276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.824277+0000","last_change":"2023-10-06T01:41:26.821348+0000","last_active":"2023-10-06T01:41:26.824277+0000","last_peered":"2023-10-06T01:41:26.824277+0000","last_clean":"2023-10-06T01:41:26.824277+0000","last_became_active":"2023-10-06T01:41:26.821104+0000","last_became_peered":"2023-10-06T01:41:26.821104+0000","last_unstale":"2023-10-06T01:41:26.824277+0000","last_undegraded":"2023-10-06T01:41:26.824277+0000","last_fullsized":"2023-10-06T01:41:26.824277+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:01:51.254365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.811514+0000","last_change":"2023-10-06T01:41:26.110222+0000","last_active":"2023-10-06T01:41:26.811514+0000","last_peered":"2023-10-06T01:41:26.811514+0000","last_clean":"2023-10-06T01:41:26.811514+0000","last_became_active":"2023-10-06T01:41:26.109982+0000","last_became_peered":"2023-10-06T01:41:26.109982+0000","last_unstale":"2023-10-06T01:41:26.811514+0000","last_undegraded":"2023-10-06T01:41:26.811514+0000","last_fullsized":"2023-10-06T01:41:26.811514+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_clean_scrub_stamp":"2023-10-06T01:41:25.085467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:35:08.676117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.831081+0000","last_change":"2023-10-06T01:41:26.829159+0000","last_active":"2023-10-06T01:41:26.831081+0000","last_peered":"2023-10-06T01:41:26.831081+0000","last_clean":"2023-10-06T01:41:26.831081+0000","last_became_active":"2023-10-06T01:41:26.828473+0000","last_became_peered":"2023-10-06T01:41:26.828473+0000","last_unstale":"2023-10-06T01:41:26.831081+0000","last_undegraded":"2023-10-06T01:41:26.831081+0000","last_fullsized":"2023-10-06T01:41:26.831081+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:18:27.983245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"40'8","reported_seq":18,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:27.131862+0000","last_change":"2023-10-06T01:41:26.118344+0000","last_active":"2023-10-06T01:41:27.131862+0000","last_peered":"2023-10-06T01:41:27.131862+0000","last_clean":"2023-10-06T01:41:27.131862+0000","last_became_active":"2023-10-06T01:41:26.118109+0000","last_became_peered":"2023-10-06T01:41:26.118109+0000","last_unstale":"2023-10-06T01:41:27.131862+0000","last_undegraded":"2023-10-06T01:41:27.131862+0000","last_fullsized":"2023-10-06T01:41:27.131862+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_clean_scrub_stamp":"2023-10-06T01:41:25.085467+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:02:46.975049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.827173+0000","last_change":"2023-10-06T01:41:26.824838+0000","last_active":"2023-10-06T01:41:26.827173+0000","last_peered":"2023-10-06T01:41:26.827173+0000","last_clean":"2023-10-06T01:41:26.827173+0000","last_became_active":"2023-10-06T01:41:26.824590+0000","last_became_peered":"2023-10-06T01:41:26.824590+0000","last_unstale":"2023-10-06T01:41:26.827173+0000","last_undegraded":"2023-10-06T01:41:26.827173+0000","last_fullsized":"2023-10-06T01:41:26.827173+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:23:42.756115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"40'1","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:27.130088+0000","last_change":"2023-10-06T01:41:26.104337+0000","last_active":"2023-10-06T01:41:27.130088+0000","last_peered":"2023-10-06T01:41:27.130088+0000","last_clean":"2023-10-06T01:41:27.130088+0000","last_became_active":"2023-10-06T01:41:26.104069+0000","last_became_peered":"2023-10-06T01:41:26.104069+0000","last_unstale":"2023-10-06T01:41:27.130088+0000","last_undegraded":"2023-10-06T01:41:27.130088+0000","last_fullsized":"2023-10-06T01:41:27.130088+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_clean_scrub_stamp":"2023-10-06T01:41:25.085467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:31:40.433231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.832404+0000","last_change":"2023-10-06T01:41:26.829421+0000","last_active":"2023-10-06T01:41:26.832404+0000","last_peered":"2023-10-06T01:41:26.832404+0000","last_clean":"2023-10-06T01:41:26.832404+0000","last_became_active":"2023-10-06T01:41:26.827337+0000","last_became_peered":"2023-10-06T01:41:26.827337+0000","last_unstale":"2023-10-06T01:41:26.832404+0000","last_undegraded":"2023-10-06T01:41:26.832404+0000","last_fullsized":"2023-10-06T01:41:26.832404+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:18:27.983245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"40'2","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:27.126533+0000","last_change":"2023-10-06T01:41:26.107747+0000","last_active":"2023-10-06T01:41:27.126533+0000","last_peered":"2023-10-06T01:41:27.126533+0000","last_clean":"2023-10-06T01:41:27.126533+0000","last_became_active":"2023-10-06T01:41:26.107474+0000","last_became_peered":"2023-10-06T01:41:26.107474+0000","last_unstale":"2023-10-06T01:41:27.126533+0000","last_undegraded":"2023-10-06T01:41:27.126533+0000","last_fullsized":"2023-10-06T01:41:27.126533+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_clean_scrub_stamp":"2023-10-06T01:41:25.085467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:09:09.509744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.829732+0000","last_change":"2023-10-06T01:41:26.823654+0000","last_active":"2023-10-06T01:41:26.829732+0000","last_peered":"2023-10-06T01:41:26.829732+0000","last_clean":"2023-10-06T01:41:26.829732+0000","last_became_active":"2023-10-06T01:41:26.823304+0000","last_became_peered":"2023-10-06T01:41:26.823304+0000","last_unstale":"2023-10-06T01:41:26.829732+0000","last_undegraded":"2023-10-06T01:41:26.829732+0000","last_fullsized":"2023-10-06T01:41:26.829732+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:58:55.761307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"40'1","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:27.137536+0000","last_change":"2023-10-06T01:41:26.109890+0000","last_active":"2023-10-06T01:41:27.137536+0000","last_peered":"2023-10-06T01:41:27.137536+0000","last_clean":"2023-10-06T01:41:27.137536+0000","last_became_active":"2023-10-06T01:41:26.109479+0000","last_became_peered":"2023-10-06T01:41:26.109479+0000","last_unstale":"2023-10-06T01:41:27.137536+0000","last_undegraded":"2023-10-06T01:41:27.137536+0000","last_fullsized":"2023-10-06T01:41:27.137536+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_clean_scrub_stamp":"2023-10-06T01:41:25.085467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:20.212462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.829832+0000","last_change":"2023-10-06T01:41:26.823377+0000","last_active":"2023-10-06T01:41:26.829832+0000","last_peered":"2023-10-06T01:41:26.829832+0000","last_clean":"2023-10-06T01:41:26.829832+0000","last_became_active":"2023-10-06T01:41:26.822712+0000","last_became_peered":"2023-10-06T01:41:26.822712+0000","last_unstale":"2023-10-06T01:41:26.829832+0000","last_undegraded":"2023-10-06T01:41:26.829832+0000","last_fullsized":"2023-10-06T01:41:26.829832+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:36:17.374371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.811914+0000","last_change":"2023-10-06T01:41:26.120015+0000","last_active":"2023-10-06T01:41:26.811914+0000","last_peered":"2023-10-06T01:41:26.811914+0000","last_clean":"2023-10-06T01:41:26.811914+0000","last_became_active":"2023-10-06T01:41:26.119751+0000","last_became_peered":"2023-10-06T01:41:26.119751+0000","last_unstale":"2023-10-06T01:41:26.811914+0000","last_undegraded":"2023-10-06T01:41:26.811914+0000","last_fullsized":"2023-10-06T01:41:26.811914+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_clean_scrub_stamp":"2023-10-06T01:41:25.085467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:57:15.242276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.825879+0000","last_change":"2023-10-06T01:41:26.818911+0000","last_active":"2023-10-06T01:41:26.825879+0000","last_peered":"2023-10-06T01:41:26.825879+0000","last_clean":"2023-10-06T01:41:26.825879+0000","last_became_active":"2023-10-06T01:41:26.818659+0000","last_became_peered":"2023-10-06T01:41:26.818659+0000","last_unstale":"2023-10-06T01:41:26.825879+0000","last_undegraded":"2023-10-06T01:41:26.825879+0000","last_fullsized":"2023-10-06T01:41:26.825879+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:23:49.561289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"40'2","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:27.128089+0000","last_change":"2023-10-06T01:41:26.106658+0000","last_active":"2023-10-06T01:41:27.128089+0000","last_peered":"2023-10-06T01:41:27.128089+0000","last_clean":"2023-10-06T01:41:27.128089+0000","last_became_active":"2023-10-06T01:41:26.106433+0000","last_became_peered":"2023-10-06T01:41:26.106433+0000","last_unstale":"2023-10-06T01:41:27.128089+0000","last_undegraded":"2023-10-06T01:41:27.128089+0000","last_fullsized":"2023-10-06T01:41:27.128089+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_clean_scrub_stamp":"2023-10-06T01:41:25.085467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:24:51.256295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.826774+0000","last_change":"2023-10-06T01:41:26.824678+0000","last_active":"2023-10-06T01:41:26.826774+0000","last_peered":"2023-10-06T01:41:26.826774+0000","last_clean":"2023-10-06T01:41:26.826774+0000","last_became_active":"2023-10-06T01:41:26.824450+0000","last_became_peered":"2023-10-06T01:41:26.824450+0000","last_unstale":"2023-10-06T01:41:26.826774+0000","last_undegraded":"2023-10-06T01:41:26.826774+0000","last_fullsized":"2023-10-06T01:41:26.826774+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:49:42.258001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.817718+0000","last_change":"2023-10-06T01:41:26.120648+0000","last_active":"2023-10-06T01:41:26.817718+0000","last_peered":"2023-10-06T01:41:26.817718+0000","last_clean":"2023-10-06T01:41:26.817718+0000","last_became_active":"2023-10-06T01:41:26.120306+0000","last_became_peered":"2023-10-06T01:41:26.120306+0000","last_unstale":"2023-10-06T01:41:26.817718+0000","last_undegraded":"2023-10-06T01:41:26.817718+0000","last_fullsized":"2023-10-06T01:41:26.817718+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_clean_scrub_stamp":"2023-10-06T01:41:25.085467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:50:23.625160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.825072+0000","last_change":"2023-10-06T01:41:26.821644+0000","last_active":"2023-10-06T01:41:26.825072+0000","last_peered":"2023-10-06T01:41:26.825072+0000","last_clean":"2023-10-06T01:41:26.825072+0000","last_became_active":"2023-10-06T01:41:26.821402+0000","last_became_peered":"2023-10-06T01:41:26.821402+0000","last_unstale":"2023-10-06T01:41:26.825072+0000","last_undegraded":"2023-10-06T01:41:26.825072+0000","last_fullsized":"2023-10-06T01:41:26.825072+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:57:16.248663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.820754+0000","last_change":"2023-10-06T01:41:26.113690+0000","last_active":"2023-10-06T01:41:26.820754+0000","last_peered":"2023-10-06T01:41:26.820754+0000","last_clean":"2023-10-06T01:41:26.820754+0000","last_became_active":"2023-10-06T01:41:26.113402+0000","last_became_peered":"2023-10-06T01:41:26.113402+0000","last_unstale":"2023-10-06T01:41:26.820754+0000","last_undegraded":"2023-10-06T01:41:26.820754+0000","last_fullsized":"2023-10-06T01:41:26.820754+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_clean_scrub_stamp":"2023-10-06T01:41:25.085467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:49:41.251613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.831650+0000","last_change":"2023-10-06T01:41:26.824296+0000","last_active":"2023-10-06T01:41:26.831650+0000","last_peered":"2023-10-06T01:41:26.831650+0000","last_clean":"2023-10-06T01:41:26.831650+0000","last_became_active":"2023-10-06T01:41:26.824039+0000","last_became_peered":"2023-10-06T01:41:26.824039+0000","last_unstale":"2023-10-06T01:41:26.831650+0000","last_undegraded":"2023-10-06T01:41:26.831650+0000","last_fullsized":"2023-10-06T01:41:26.831650+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:01:33.092370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.818765+0000","last_change":"2023-10-06T01:41:26.114423+0000","last_active":"2023-10-06T01:41:26.818765+0000","last_peered":"2023-10-06T01:41:26.818765+0000","last_clean":"2023-10-06T01:41:26.818765+0000","last_became_active":"2023-10-06T01:41:26.114134+0000","last_became_peered":"2023-10-06T01:41:26.114134+0000","last_unstale":"2023-10-06T01:41:26.818765+0000","last_undegraded":"2023-10-06T01:41:26.818765+0000","last_fullsized":"2023-10-06T01:41:26.818765+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_clean_scrub_stamp":"2023-10-06T01:41:25.085467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:49:30.441248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.828030+0000","last_change":"2023-10-06T01:41:26.825830+0000","last_active":"2023-10-06T01:41:26.828030+0000","last_peered":"2023-10-06T01:41:26.828030+0000","last_clean":"2023-10-06T01:41:26.828030+0000","last_became_active":"2023-10-06T01:41:26.825556+0000","last_became_peered":"2023-10-06T01:41:26.825556+0000","last_unstale":"2023-10-06T01:41:26.828030+0000","last_undegraded":"2023-10-06T01:41:26.828030+0000","last_fullsized":"2023-10-06T01:41:26.828030+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:18:34.124375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.821104+0000","last_change":"2023-10-06T01:41:26.115006+0000","last_active":"2023-10-06T01:41:26.821104+0000","last_peered":"2023-10-06T01:41:26.821104+0000","last_clean":"2023-10-06T01:41:26.821104+0000","last_became_active":"2023-10-06T01:41:26.114767+0000","last_became_peered":"2023-10-06T01:41:26.114767+0000","last_unstale":"2023-10-06T01:41:26.821104+0000","last_undegraded":"2023-10-06T01:41:26.821104+0000","last_fullsized":"2023-10-06T01:41:26.821104+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_clean_scrub_stamp":"2023-10-06T01:41:25.085467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:23:41.749728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":28,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.814101+0000","last_change":"2023-10-06T01:40:16.930992+0000","last_active":"2023-10-06T01:41:26.814101+0000","last_peered":"2023-10-06T01:41:26.814101+0000","last_clean":"2023-10-06T01:41:26.814101+0000","last_became_active":"2023-10-06T01:40:16.930707+0000","last_became_peered":"2023-10-06T01:40:16.930707+0000","last_unstale":"2023-10-06T01:41:26.814101+0000","last_undegraded":"2023-10-06T01:41:26.814101+0000","last_fullsized":"2023-10-06T01:41:26.814101+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:52:43.316071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.831420+0000","last_change":"2023-10-06T01:41:26.830847+0000","last_active":"2023-10-06T01:41:26.831420+0000","last_peered":"2023-10-06T01:41:26.831420+0000","last_clean":"2023-10-06T01:41:26.831420+0000","last_became_active":"2023-10-06T01:41:26.830535+0000","last_became_peered":"2023-10-06T01:41:26.830535+0000","last_unstale":"2023-10-06T01:41:26.831420+0000","last_undegraded":"2023-10-06T01:41:26.831420+0000","last_fullsized":"2023-10-06T01:41:26.831420+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:50:24.631547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"41'1","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T01:41:27.812820+0000","last_change":"2023-10-06T01:41:26.107258+0000","last_active":"2023-10-06T01:41:27.812820+0000","last_peered":"2023-10-06T01:41:27.812820+0000","last_clean":"2023-10-06T01:41:27.812820+0000","last_became_active":"2023-10-06T01:41:26.107002+0000","last_became_peered":"2023-10-06T01:41:26.107002+0000","last_unstale":"2023-10-06T01:41:27.812820+0000","last_undegraded":"2023-10-06T01:41:27.812820+0000","last_fullsized":"2023-10-06T01:41:27.812820+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_clean_scrub_stamp":"2023-10-06T01:41:25.085467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:49:30.441248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":29,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.817802+0000","last_change":"2023-10-06T01:40:16.651019+0000","last_active":"2023-10-06T01:41:26.817802+0000","last_peered":"2023-10-06T01:41:26.817802+0000","last_clean":"2023-10-06T01:41:26.817802+0000","last_became_active":"2023-10-06T01:40:16.650628+0000","last_became_peered":"2023-10-06T01:40:16.650628+0000","last_unstale":"2023-10-06T01:41:26.817802+0000","last_undegraded":"2023-10-06T01:41:26.817802+0000","last_fullsized":"2023-10-06T01:41:26.817802+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:11:57.218984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.832274+0000","last_change":"2023-10-06T01:41:26.826075+0000","last_active":"2023-10-06T01:41:26.832274+0000","last_peered":"2023-10-06T01:41:26.832274+0000","last_clean":"2023-10-06T01:41:26.832274+0000","last_became_active":"2023-10-06T01:41:26.825861+0000","last_became_peered":"2023-10-06T01:41:26.825861+0000","last_unstale":"2023-10-06T01:41:26.832274+0000","last_undegraded":"2023-10-06T01:41:26.832274+0000","last_fullsized":"2023-10-06T01:41:26.832274+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:14:16.658005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.823557+0000","last_change":"2023-10-06T01:41:26.122062+0000","last_active":"2023-10-06T01:41:26.823557+0000","last_peered":"2023-10-06T01:41:26.823557+0000","last_clean":"2023-10-06T01:41:26.823557+0000","last_became_active":"2023-10-06T01:41:26.121730+0000","last_became_peered":"2023-10-06T01:41:26.121730+0000","last_unstale":"2023-10-06T01:41:26.823557+0000","last_undegraded":"2023-10-06T01:41:26.823557+0000","last_fullsized":"2023-10-06T01:41:26.823557+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_clean_scrub_stamp":"2023-10-06T01:41:25.085467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:50:23.625160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":29,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.814734+0000","last_change":"2023-10-06T01:40:16.781596+0000","last_active":"2023-10-06T01:41:26.814734+0000","last_peered":"2023-10-06T01:41:26.814734+0000","last_clean":"2023-10-06T01:41:26.814734+0000","last_became_active":"2023-10-06T01:40:16.781352+0000","last_became_peered":"2023-10-06T01:40:16.781352+0000","last_unstale":"2023-10-06T01:41:26.814734+0000","last_undegraded":"2023-10-06T01:41:26.814734+0000","last_fullsized":"2023-10-06T01:41:26.814734+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:52:43.316071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.832740+0000","last_change":"2023-10-06T01:41:26.826305+0000","last_active":"2023-10-06T01:41:26.832740+0000","last_peered":"2023-10-06T01:41:26.832740+0000","last_clean":"2023-10-06T01:41:26.832740+0000","last_became_active":"2023-10-06T01:41:26.826061+0000","last_became_peered":"2023-10-06T01:41:26.826061+0000","last_unstale":"2023-10-06T01:41:26.832740+0000","last_undegraded":"2023-10-06T01:41:26.832740+0000","last_fullsized":"2023-10-06T01:41:26.832740+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:08:44.723266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"40'2","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:27.130758+0000","last_change":"2023-10-06T01:41:26.115059+0000","last_active":"2023-10-06T01:41:27.130758+0000","last_peered":"2023-10-06T01:41:27.130758+0000","last_clean":"2023-10-06T01:41:27.130758+0000","last_became_active":"2023-10-06T01:41:26.114788+0000","last_became_peered":"2023-10-06T01:41:26.114788+0000","last_unstale":"2023-10-06T01:41:27.130758+0000","last_undegraded":"2023-10-06T01:41:27.130758+0000","last_fullsized":"2023-10-06T01:41:27.130758+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_clean_scrub_stamp":"2023-10-06T01:41:25.085467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:58:54.754920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":29,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.818993+0000","last_change":"2023-10-06T01:40:16.650826+0000","last_active":"2023-10-06T01:41:26.818993+0000","last_peered":"2023-10-06T01:41:26.818993+0000","last_clean":"2023-10-06T01:41:26.818993+0000","last_became_active":"2023-10-06T01:40:16.650469+0000","last_became_peered":"2023-10-06T01:40:16.650469+0000","last_unstale":"2023-10-06T01:41:26.818993+0000","last_undegraded":"2023-10-06T01:41:26.818993+0000","last_fullsized":"2023-10-06T01:41:26.818993+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:50:23.628212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":181,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.819771+0000","last_change":"2023-10-06T01:40:10.645512+0000","last_active":"2023-10-06T01:41:26.819771+0000","last_peered":"2023-10-06T01:41:26.819771+0000","last_clean":"2023-10-06T01:41:26.819771+0000","last_became_active":"2023-10-06T01:40:10.644601+0000","last_became_peered":"2023-10-06T01:40:10.644601+0000","last_unstale":"2023-10-06T01:41:26.819771+0000","last_undegraded":"2023-10-06T01:41:26.819771+0000","last_fullsized":"2023-10-06T01:41:26.819771+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:09.580865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:09.580865+0000","last_clean_scrub_stamp":"2023-10-06T01:40:09.580865+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:05:28.268591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.832660+0000","last_change":"2023-10-06T01:41:26.831564+0000","last_active":"2023-10-06T01:41:26.832660+0000","last_peered":"2023-10-06T01:41:26.832660+0000","last_clean":"2023-10-06T01:41:26.832660+0000","last_became_active":"2023-10-06T01:41:26.831293+0000","last_became_peered":"2023-10-06T01:41:26.831293+0000","last_unstale":"2023-10-06T01:41:26.832660+0000","last_undegraded":"2023-10-06T01:41:26.832660+0000","last_fullsized":"2023-10-06T01:41:26.832660+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:03:47.822189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.814028+0000","last_change":"2023-10-06T01:41:26.111969+0000","last_active":"2023-10-06T01:41:26.814028+0000","last_peered":"2023-10-06T01:41:26.814028+0000","last_clean":"2023-10-06T01:41:26.814028+0000","last_became_active":"2023-10-06T01:41:26.111442+0000","last_became_peered":"2023-10-06T01:41:26.111442+0000","last_unstale":"2023-10-06T01:41:26.814028+0000","last_undegraded":"2023-10-06T01:41:26.814028+0000","last_fullsized":"2023-10-06T01:41:26.814028+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_clean_scrub_stamp":"2023-10-06T01:41:25.085467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:18:49.326166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":28,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.819853+0000","last_change":"2023-10-06T01:40:16.651332+0000","last_active":"2023-10-06T01:41:26.819853+0000","last_peered":"2023-10-06T01:41:26.819853+0000","last_clean":"2023-10-06T01:41:26.819853+0000","last_became_active":"2023-10-06T01:40:16.651049+0000","last_became_peered":"2023-10-06T01:40:16.651049+0000","last_unstale":"2023-10-06T01:41:26.819853+0000","last_undegraded":"2023-10-06T01:41:26.819853+0000","last_fullsized":"2023-10-06T01:41:26.819853+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:11:57.218984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.829569+0000","last_change":"2023-10-06T01:41:26.824653+0000","last_active":"2023-10-06T01:41:26.829569+0000","last_peered":"2023-10-06T01:41:26.829569+0000","last_clean":"2023-10-06T01:41:26.829569+0000","last_became_active":"2023-10-06T01:41:26.824391+0000","last_became_peered":"2023-10-06T01:41:26.824391+0000","last_unstale":"2023-10-06T01:41:26.829569+0000","last_undegraded":"2023-10-06T01:41:26.829569+0000","last_fullsized":"2023-10-06T01:41:26.829569+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:14:16.658005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.813971+0000","last_change":"2023-10-06T01:41:26.120248+0000","last_active":"2023-10-06T01:41:26.813971+0000","last_peered":"2023-10-06T01:41:26.813971+0000","last_clean":"2023-10-06T01:41:26.813971+0000","last_became_active":"2023-10-06T01:41:26.119964+0000","last_became_peered":"2023-10-06T01:41:26.119964+0000","last_unstale":"2023-10-06T01:41:26.813971+0000","last_undegraded":"2023-10-06T01:41:26.813971+0000","last_fullsized":"2023-10-06T01:41:26.813971+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_clean_scrub_stamp":"2023-10-06T01:41:25.085467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:19:08.833484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":28,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.823631+0000","last_change":"2023-10-06T01:40:16.931106+0000","last_active":"2023-10-06T01:41:26.823631+0000","last_peered":"2023-10-06T01:41:26.823631+0000","last_clean":"2023-10-06T01:41:26.823631+0000","last_became_active":"2023-10-06T01:40:16.930830+0000","last_became_peered":"2023-10-06T01:40:16.930830+0000","last_unstale":"2023-10-06T01:41:26.823631+0000","last_undegraded":"2023-10-06T01:41:26.823631+0000","last_fullsized":"2023-10-06T01:41:26.823631+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:50:23.628212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.826924+0000","last_change":"2023-10-06T01:41:26.821751+0000","last_active":"2023-10-06T01:41:26.826924+0000","last_peered":"2023-10-06T01:41:26.826924+0000","last_clean":"2023-10-06T01:41:26.826924+0000","last_became_active":"2023-10-06T01:41:26.821480+0000","last_became_peered":"2023-10-06T01:41:26.821480+0000","last_unstale":"2023-10-06T01:41:26.826924+0000","last_undegraded":"2023-10-06T01:41:26.826924+0000","last_fullsized":"2023-10-06T01:41:26.826924+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:49:52.344585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.813525+0000","last_change":"2023-10-06T01:41:26.106585+0000","last_active":"2023-10-06T01:41:26.813525+0000","last_peered":"2023-10-06T01:41:26.813525+0000","last_clean":"2023-10-06T01:41:26.813525+0000","last_became_active":"2023-10-06T01:41:26.106249+0000","last_became_peered":"2023-10-06T01:41:26.106249+0000","last_unstale":"2023-10-06T01:41:26.813525+0000","last_undegraded":"2023-10-06T01:41:26.813525+0000","last_fullsized":"2023-10-06T01:41:26.813525+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_clean_scrub_stamp":"2023-10-06T01:41:25.085467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:27:58.323415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":28,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.815340+0000","last_change":"2023-10-06T01:40:16.649379+0000","last_active":"2023-10-06T01:41:26.815340+0000","last_peered":"2023-10-06T01:41:26.815340+0000","last_clean":"2023-10-06T01:41:26.815340+0000","last_became_active":"2023-10-06T01:40:16.649147+0000","last_became_peered":"2023-10-06T01:40:16.649147+0000","last_unstale":"2023-10-06T01:41:26.815340+0000","last_undegraded":"2023-10-06T01:41:26.815340+0000","last_fullsized":"2023-10-06T01:41:26.815340+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:11:57.218984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.825899+0000","last_change":"2023-10-06T01:41:26.819529+0000","last_active":"2023-10-06T01:41:26.825899+0000","last_peered":"2023-10-06T01:41:26.825899+0000","last_clean":"2023-10-06T01:41:26.825899+0000","last_became_active":"2023-10-06T01:41:26.819272+0000","last_became_peered":"2023-10-06T01:41:26.819272+0000","last_unstale":"2023-10-06T01:41:26.825899+0000","last_undegraded":"2023-10-06T01:41:26.825899+0000","last_fullsized":"2023-10-06T01:41:26.825899+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:26.091854+0000","last_clean_scrub_stamp":"2023-10-06T01:41:26.091854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:12:28.103885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.823069+0000","last_change":"2023-10-06T01:41:26.120256+0000","last_active":"2023-10-06T01:41:26.823069+0000","last_peered":"2023-10-06T01:41:26.823069+0000","last_clean":"2023-10-06T01:41:26.823069+0000","last_became_active":"2023-10-06T01:41:26.119859+0000","last_became_peered":"2023-10-06T01:41:26.119859+0000","last_unstale":"2023-10-06T01:41:26.823069+0000","last_undegraded":"2023-10-06T01:41:26.823069+0000","last_fullsized":"2023-10-06T01:41:26.823069+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:25.085467+0000","last_clean_scrub_stamp":"2023-10-06T01:41:25.085467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:02:46.975049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":29,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T01:41:26.816113+0000","last_change":"2023-10-06T01:40:16.651477+0000","last_active":"2023-10-06T01:41:26.816113+0000","last_peered":"2023-10-06T01:41:26.816113+0000","last_clean":"2023-10-06T01:41:26.816113+0000","last_became_active":"2023-10-06T01:40:16.651190+0000","last_became_peered":"2023-10-06T01:40:16.651190+0000","last_unstale":"2023-10-06T01:41:26.816113+0000","last_undegraded":"2023-10-06T01:41:26.816113+0000","last_fullsized":"2023-10-06T01:41:26.816113+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:45:47.422876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298336,"kb_used_data":1048,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073504,"statfs":{"total":96636764160,"available":96331268096,"internally_reserved":0,"allocated":1073152,"data_stored":802576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:41:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":3.6920000000000002,"5min":3.6920000000000002,"15min":3.6920000000000002},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":3.629,"5min":3.629,"15min":3.629},"last":0.622}]},{"osd":1,"last update":"Fri Oct 6 01:41:11 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":10.029999999999999,"5min":10.029999999999999,"15min":10.029999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.544,"5min":1.544,"15min":1.544},"last":0.66200000000000003}]},{"osd":2,"last update":"Fri Oct 6 01:41:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.67700000000000005},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":10.710000000000001,"5min":10.710000000000001,"15min":10.710000000000001},"last":0.52500000000000002}]},{"osd":3,"last update":"Fri Oct 6 01:41:11 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":3.6509999999999998,"5min":3.6509999999999998,"15min":3.6509999999999998},"last":0.63500000000000001}]},{"osd":4,"last update":"Fri Oct 6 01:41:11 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.44400000000000001}]},{"osd":5,"last update":"Fri Oct 6 01:41:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.7509999999999999,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":0.51500000000000001}]},{"osd":6,"last update":"Fri Oct 6 01:41:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.9370000000000001,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.501}]}]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297760,"kb_used_data":472,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074080,"statfs":{"total":96636764160,"available":96331857920,"internally_reserved":0,"allocated":483328,"data_stored":212762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.441},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.36199999999999999}]},{"osd":1,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.5}]},{"osd":2,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.41599999999999998}]},{"osd":3,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.51200000000000001}]},{"osd":4,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.53600000000000003}]},{"osd":5,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.52500000000000002}]},{"osd":7,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.58599999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297756,"kb_used_data":468,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074084,"statfs":{"total":96636764160,"available":96331862016,"internally_reserved":0,"allocated":479232,"data_stored":212188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.997,"15min":0.997},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":11.957000000000001,"5min":11.957000000000001,"15min":11.957000000000001},"last":0.40500000000000003},{"interface":"front","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":11.917,"5min":11.917,"15min":11.917},"last":0.41799999999999998}]},{"osd":2,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.317}]},{"osd":3,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":6.2450000000000001,"5min":6.2450000000000001,"15min":6.2450000000000001},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":6.2939999999999996,"5min":6.2939999999999996,"15min":6.2939999999999996},"last":0.38100000000000001}]},{"osd":4,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":6.1669999999999998,"5min":6.1669999999999998,"15min":6.1669999999999998},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.495}]},{"osd":5,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":6.2619999999999996,"5min":6.2619999999999996,"15min":6.2619999999999996},"last":0.504},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":6.2350000000000003,"5min":6.2350000000000003,"15min":6.2350000000000003},"last":0.52200000000000002}]},{"osd":6,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":6.141,"5min":6.141,"15min":6.141},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":6.2069999999999999,"5min":6.2069999999999999,"15min":6.2069999999999999},"last":0.56000000000000005}]},{"osd":7,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":6.1040000000000001,"5min":6.1040000000000001,"15min":6.1040000000000001},"last":0.57099999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298332,"kb_used_data":1044,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073508,"statfs":{"total":96636764160,"available":96331272192,"internally_reserved":0,"allocated":1069056,"data_stored":801559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":3.9129999999999998,"5min":3.9129999999999998,"15min":3.9129999999999998},"last":0.35999999999999999}]},{"osd":2,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":15.237,"5min":15.237,"15min":15.237},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":3.7959999999999998,"5min":3.7959999999999998,"15min":3.7959999999999998},"last":0.38700000000000001}]},{"osd":3,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":5.2850000000000001,"5min":5.2850000000000001,"15min":5.2850000000000001},"last":0.34499999999999997},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":15.263,"5min":15.263,"15min":15.263},"last":0.42199999999999999}]},{"osd":4,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":5.2590000000000003,"5min":5.2590000000000003,"15min":5.2590000000000003},"last":0.59199999999999997},{"interface":"front","average":{"1min":1.242,"5min":1.242,"15min":1.242},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":15.211,"5min":15.211,"15min":15.211},"last":0.60299999999999998}]},{"osd":5,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":3.8839999999999999,"5min":3.8839999999999999,"15min":3.8839999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":5.2309999999999999,"5min":5.2309999999999999,"15min":5.2309999999999999},"last":0.623}]},{"osd":6,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.212,"15min":1.212},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":15.175000000000001,"5min":15.175000000000001,"15min":15.175000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":3.859,"5min":3.859,"15min":3.859},"last":0.54600000000000004}]},{"osd":7,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":3.831,"5min":3.831,"15min":3.831},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":5.1959999999999997,"5min":5.1959999999999997,"15min":5.1959999999999997},"last":0.52700000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297768,"kb_used_data":480,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074072,"statfs":{"total":96636764160,"available":96331849728,"internally_reserved":0,"allocated":491520,"data_stored":213676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"last":0.314},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"last":0.27500000000000002}]},{"osd":1,"last update":"Fri Oct 6 01:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.311,"15min":0.311},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.24099999999999999}]},{"osd":3,"last update":"Fri Oct 6 01:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.28699999999999998}]},{"osd":4,"last update":"Fri Oct 6 01:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.69299999999999995}]},{"osd":5,"last update":"Fri Oct 6 01:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.52200000000000002}]},{"osd":6,"last update":"Fri Oct 6 01:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.65900000000000003}]},{"osd":7,"last update":"Fri Oct 6 01:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.63600000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297764,"kb_used_data":476,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074076,"statfs":{"total":96636764160,"available":96331853824,"internally_reserved":0,"allocated":487424,"data_stored":212728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.25},{"interface":"front","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.28399999999999997}]},{"osd":1,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.34599999999999997}]},{"osd":2,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.379}]},{"osd":4,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.57399999999999995}]},{"osd":5,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.50600000000000001}]},{"osd":6,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.48599999999999999}]},{"osd":7,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.60299999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297764,"kb_used_data":476,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074076,"statfs":{"total":96636764160,"available":96331853824,"internally_reserved":0,"allocated":487424,"data_stored":213654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.56899999999999995}]},{"osd":1,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":4.0780000000000003,"5min":4.0780000000000003,"15min":4.0780000000000003},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":4.1050000000000004,"5min":4.1050000000000004,"15min":4.1050000000000004},"last":0.48099999999999998}]},{"osd":2,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.59599999999999997}]},{"osd":3,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.58299999999999996}]},{"osd":5,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.437,"15min":0.437},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.63900000000000001}]},{"osd":6,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.63}]},{"osd":7,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.55800000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297756,"kb_used_data":468,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074084,"statfs":{"total":96636764160,"available":96331862016,"internally_reserved":0,"allocated":479232,"data_stored":212188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.56100000000000005}]},{"osd":1,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.54800000000000004}]},{"osd":2,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.6970000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.40300000000000002}]},{"osd":3,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.53700000000000003}]},{"osd":4,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.58999999999999997}]},{"osd":6,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.51500000000000001}]},{"osd":7,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.821,"5min":1.821,"15min":1.821},"last":0.434},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.499}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T01:41:31.545 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T01:41:31.546 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-06T01:41:31.700 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.699+0000 7ffa49a96700 1 Processor -- start 2023-10-06T01:41:31.700 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.699+0000 7ffa49a96700 1 -- start start 2023-10-06T01:41:31.701 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.700+0000 7ffa49a96700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffa440d08b0 0x7ffa4415dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:31.701 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.700+0000 7ffa49a96700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ffa44142890 0x7ffa44142d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:31.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.700+0000 7ffa49a96700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa440cf010 con 0x7ffa440d04e0 2023-10-06T01:41:31.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.700+0000 7ffa49a96700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa440cf250 con 0x7ffa44142890 2023-10-06T01:41:31.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.700+0000 7ffa49a96700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa440cf530 con 0x7ffa440d08b0 2023-10-06T01:41:31.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.700+0000 7ffa43fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ffa44142890 0x7ffa44142d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:31.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.700+0000 7ffa42ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffa440d08b0 0x7ffa4415dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:31.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.700+0000 7ffa42ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffa440d08b0 0x7ffa4415dc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.71:49024/0 (socket says 172.21.15.71:49024) 2023-10-06T01:41:31.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.700+0000 7ffa42ffd700 1 -- 172.21.15.71:0/4168823608 learned_addr learned my addr 172.21.15.71:0/4168823608 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:31.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.700+0000 7ffa43fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ffa44142890 0x7ffa44142d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:38834/0 (socket says 172.21.15.71:38834) 2023-10-06T01:41:31.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.700+0000 7ffa42ffd700 1 -- 172.21.15.71:0/4168823608 >> v2:172.21.15.72:3300/0 conn(0x7ffa44142890 msgr2=0x7ffa44142d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:31.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.700+0000 7ffa42ffd700 1 --2- 172.21.15.71:0/4168823608 >> v2:172.21.15.72:3300/0 conn(0x7ffa44142890 0x7ffa44142d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:31.703 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.701+0000 7ffa42ffd700 1 -- 172.21.15.71:0/4168823608 >> v1:172.21.15.72:6789/0 conn(0x7ffa440d04e0 legacy=0x7ffa440ce900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:31.703 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.701+0000 7ffa42ffd700 1 -- 172.21.15.71:0/4168823608 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa440cf810 con 0x7ffa440d08b0 2023-10-06T01:41:31.703 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.701+0000 7ffa42ffd700 1 --2- 172.21.15.71:0/4168823608 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffa440d08b0 0x7ffa4415dc20 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ffa380099b0 tx=0x7ffa38009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=613e7a3d149e38a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:31.703 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.701+0000 7ffa427fc700 1 -- 172.21.15.71:0/4168823608 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa38009ea0 con 0x7ffa440d08b0 2023-10-06T01:41:31.703 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.701+0000 7ffa427fc700 1 -- 172.21.15.71:0/4168823608 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa3800b860 con 0x7ffa440d08b0 2023-10-06T01:41:31.703 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.701+0000 7ffa427fc700 1 -- 172.21.15.71:0/4168823608 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa3800bc00 con 0x7ffa440d08b0 2023-10-06T01:41:31.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.701+0000 7ffa49a96700 1 -- 172.21.15.71:0/4168823608 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffa440d08b0 msgr2=0x7ffa4415dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:31.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.701+0000 7ffa49a96700 1 --2- 172.21.15.71:0/4168823608 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffa440d08b0 0x7ffa4415dc20 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ffa380099b0 tx=0x7ffa38009250 comp rx=0 tx=0).stop 2023-10-06T01:41:31.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.701+0000 7ffa49a96700 1 -- 172.21.15.71:0/4168823608 shutdown_connections 2023-10-06T01:41:31.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.701+0000 7ffa49a96700 1 --2- 172.21.15.71:0/4168823608 >> v2:172.21.15.72:3300/0 conn(0x7ffa44142890 0x7ffa44142d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:31.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.701+0000 7ffa49a96700 1 --2- 172.21.15.71:0/4168823608 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffa440d08b0 0x7ffa4415dc20 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:31.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.701+0000 7ffa49a96700 1 -- 172.21.15.71:0/4168823608 >> 172.21.15.71:0/4168823608 conn(0x7ffa4406a320 msgr2=0x7ffa4406a720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:31.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.701+0000 7ffa49a96700 1 -- 172.21.15.71:0/4168823608 shutdown_connections 2023-10-06T01:41:31.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.702+0000 7ffa49a96700 1 -- 172.21.15.71:0/4168823608 wait complete. 2023-10-06T01:41:31.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.703+0000 7ffa49a96700 1 Processor -- start 2023-10-06T01:41:31.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.703+0000 7ffa49a96700 1 -- start start 2023-10-06T01:41:31.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.703+0000 7ffa49a96700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa440d04e0 0x7ffa440ad110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:31.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.703+0000 7ffa49a96700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffa440d08b0 0x7ffa4416a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:31.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.703+0000 7ffa49a96700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffa44142890 0x7ffa44158830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:31.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.703+0000 7ffa49a96700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa440ad650 con 0x7ffa44142890 2023-10-06T01:41:31.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.703+0000 7ffa49a96700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa4413f820 con 0x7ffa440d04e0 2023-10-06T01:41:31.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.703+0000 7ffa49a96700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa440a71b0 con 0x7ffa440d08b0 2023-10-06T01:41:31.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.704+0000 7ffa43fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffa44142890 0x7ffa44158830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:31.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.704+0000 7ffa43fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffa44142890 0x7ffa44158830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37768/0 (socket says 172.21.15.71:37768) 2023-10-06T01:41:31.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.704+0000 7ffa43fff700 1 -- 172.21.15.71:0/3070551657 learned_addr learned my addr 172.21.15.71:0/3070551657 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:31.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.704+0000 7ffa42ffd700 1 --2- 172.21.15.71:0/3070551657 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffa440d08b0 0x7ffa4416a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:31.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.704+0000 7ffa437fe700 1 --2- 172.21.15.71:0/3070551657 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa440d04e0 0x7ffa440ad110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:31.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.704+0000 7ffa43fff700 1 -- 172.21.15.71:0/3070551657 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffa440d08b0 msgr2=0x7ffa4416a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:31.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.704+0000 7ffa43fff700 1 --2- 172.21.15.71:0/3070551657 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffa440d08b0 0x7ffa4416a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:31.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.704+0000 7ffa43fff700 1 -- 172.21.15.71:0/3070551657 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa440d04e0 msgr2=0x7ffa440ad110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:31.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.704+0000 7ffa43fff700 1 --2- 172.21.15.71:0/3070551657 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa440d04e0 0x7ffa440ad110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:31.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.704+0000 7ffa43fff700 1 -- 172.21.15.71:0/3070551657 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa380094f0 con 0x7ffa44142890 2023-10-06T01:41:31.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.704+0000 7ffa437fe700 1 --2- 172.21.15.71:0/3070551657 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa440d04e0 0x7ffa440ad110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:41:31.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.704+0000 7ffa43fff700 1 --2- 172.21.15.71:0/3070551657 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffa44142890 0x7ffa44158830 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c00e8d0 tx=0x7ffa3c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:31.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.704+0000 7ffa2b7fe700 1 -- 172.21.15.71:0/3070551657 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa3c013680 con 0x7ffa44142890 2023-10-06T01:41:31.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.704+0000 7ffa2b7fe700 1 -- 172.21.15.71:0/3070551657 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa3c0137e0 con 0x7ffa44142890 2023-10-06T01:41:31.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.704+0000 7ffa2b7fe700 1 -- 172.21.15.71:0/3070551657 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa3c013ba0 con 0x7ffa44142890 2023-10-06T01:41:31.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.704+0000 7ffa49a96700 1 -- 172.21.15.71:0/3070551657 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa440a7490 con 0x7ffa44142890 2023-10-06T01:41:31.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.704+0000 7ffa49a96700 1 -- 172.21.15.71:0/3070551657 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa440a7a50 con 0x7ffa44142890 2023-10-06T01:41:31.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.705+0000 7ffa49a96700 1 -- 172.21.15.71:0/3070551657 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa440aab30 con 0x7ffa44142890 2023-10-06T01:41:31.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.706+0000 7ffa2b7fe700 1 -- 172.21.15.71:0/3070551657 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ffa3c0123d0 con 0x7ffa44142890 2023-10-06T01:41:31.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.706+0000 7ffa2b7fe700 1 --2- 172.21.15.71:0/3070551657 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7ffa30066f30 0x7ffa300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:31.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.706+0000 7ffa2b7fe700 1 -- 172.21.15.71:0/3070551657 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6378+0+0 (secure 0 0 0) 0x7ffa3c084900 con 0x7ffa44142890 2023-10-06T01:41:31.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.706+0000 7ffa437fe700 1 --2- 172.21.15.71:0/3070551657 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7ffa30066f30 0x7ffa300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:31.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.706+0000 7ffa437fe700 1 --2- 172.21.15.71:0/3070551657 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7ffa30066f30 0x7ffa300693e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ffa34007fd0 tx=0x7ffa34009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:31.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.710+0000 7ffa2b7fe700 1 -- 172.21.15.71:0/3070551657 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffa440aab30 con 0x7ffa44142890 2023-10-06T01:41:31.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.966+0000 7ffa49a96700 1 -- 172.21.15.71:0/3070551657 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7ffa440aab30 con 0x7ffa44142890 2023-10-06T01:41:31.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.969+0000 7ffa2b7fe700 1 -- 172.21.15.71:0/3070551657 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+0 (secure 0 0 0) 0x7ffa440aab30 con 0x7ffa44142890 2023-10-06T01:41:31.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.971+0000 7ffa49a96700 1 -- 172.21.15.71:0/3070551657 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7ffa30066f30 msgr2=0x7ffa300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:31.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.971+0000 7ffa49a96700 1 --2- 172.21.15.71:0/3070551657 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7ffa30066f30 0x7ffa300693e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ffa34007fd0 tx=0x7ffa34009040 comp rx=0 tx=0).stop 2023-10-06T01:41:31.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.971+0000 7ffa49a96700 1 -- 172.21.15.71:0/3070551657 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffa44142890 msgr2=0x7ffa44158830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:31.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.971+0000 7ffa49a96700 1 --2- 172.21.15.71:0/3070551657 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffa44142890 0x7ffa44158830 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c00e8d0 tx=0x7ffa3c0091a0 comp rx=0 tx=0).stop 2023-10-06T01:41:31.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.972+0000 7ffa49a96700 1 -- 172.21.15.71:0/3070551657 shutdown_connections 2023-10-06T01:41:31.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.972+0000 7ffa49a96700 1 --2- 172.21.15.71:0/3070551657 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffa44142890 0x7ffa44158830 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:31.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.972+0000 7ffa49a96700 1 --2- 172.21.15.71:0/3070551657 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7ffa30066f30 0x7ffa300693e0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:31.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.972+0000 7ffa49a96700 1 --2- 172.21.15.71:0/3070551657 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa440d04e0 0x7ffa440ad110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:31.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.972+0000 7ffa49a96700 1 --2- 172.21.15.71:0/3070551657 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffa440d08b0 0x7ffa4416a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:31.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.972+0000 7ffa49a96700 1 -- 172.21.15.71:0/3070551657 >> 172.21.15.71:0/3070551657 conn(0x7ffa4406a320 msgr2=0x7ffa44141d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:31.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.972+0000 7ffa49a96700 1 -- 172.21.15.71:0/3070551657 shutdown_connections 2023-10-06T01:41:31.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:31.972+0000 7ffa49a96700 1 -- 172.21.15.71:0/3070551657 wait complete. 2023-10-06T01:41:31.974 INFO:teuthology.orchestra.run.smithi071.stderr:updated caps for client.0 2023-10-06T01:41:31.984 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T01:41:32.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.098+0000 7fe79eadb700 1 Processor -- start 2023-10-06T01:41:32.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.098+0000 7fe79eadb700 1 -- start start 2023-10-06T01:41:32.107 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.099+0000 7fe79eadb700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe7980b27f0 0x7fe79815db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:32.107 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.099+0000 7fe79eadb700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe79815e190 con 0x7fe7980af8b0 2023-10-06T01:41:32.107 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.099+0000 7fe79eadb700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7980cb650 con 0x7fe7980af4e0 2023-10-06T01:41:32.107 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.099+0000 7fe79eadb700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7980b1910 con 0x7fe7980b27f0 2023-10-06T01:41:32.107 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.099+0000 7fe78ffff700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fe7980af8b0 0x7fe79815d460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:58104/0 (socket says 172.21.15.71:58104) 2023-10-06T01:41:32.107 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.099+0000 7fe78ffff700 1 -- 172.21.15.71:0/601330751 learned_addr learned my addr 172.21.15.71:0/601330751 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:41:32.107 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.099+0000 7fe78f7fe700 1 -- 172.21.15.71:0/601330751 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1817174044 0 0) 0x7fe79815e190 con 0x7fe7980af8b0 2023-10-06T01:41:32.107 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.099+0000 7fe79d078700 1 --2- 172.21.15.71:0/601330751 >> v2:172.21.15.72:3300/0 conn(0x7fe7980b27f0 0x7fe79815db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:32.107 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.100+0000 7fe78f7fe700 1 -- 172.21.15.71:0/601330751 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe780003570 con 0x7fe7980af8b0 2023-10-06T01:41:32.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.100+0000 7fe78f7fe700 1 -- 172.21.15.71:0/601330751 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3757470444 0 0) 0x7fe780003570 con 0x7fe7980af8b0 2023-10-06T01:41:32.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.100+0000 7fe78f7fe700 1 -- 172.21.15.71:0/601330751 >> v2:172.21.15.72:3300/0 conn(0x7fe7980b27f0 msgr2=0x7fe79815db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:32.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.100+0000 7fe78f7fe700 1 --2- 172.21.15.71:0/601330751 >> v2:172.21.15.72:3300/0 conn(0x7fe7980b27f0 0x7fe79815db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:32.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.100+0000 7fe78f7fe700 1 -- 172.21.15.71:0/601330751 >> v1:172.21.15.72:6789/0 conn(0x7fe7980af4e0 legacy=0x7fe7980b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:32.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.100+0000 7fe78f7fe700 1 -- 172.21.15.71:0/601330751 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7980ccaf0 con 0x7fe7980af8b0 2023-10-06T01:41:32.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.100+0000 7fe78f7fe700 1 -- 172.21.15.71:0/601330751 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1184243524 0 0) 0x7fe788001470 con 0x7fe7980af8b0 2023-10-06T01:41:32.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.100+0000 7fe78f7fe700 1 -- 172.21.15.71:0/601330751 >> v1:172.21.15.71:6789/0 conn(0x7fe7980af8b0 legacy=0x7fe79815d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:32.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.100+0000 7fe78f7fe700 1 --2- 172.21.15.71:0/601330751 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe780003a60 0x7fe780003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:32.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.100+0000 7fe78f7fe700 1 --2- 172.21.15.71:0/601330751 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe780004810 0x7fe780004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:32.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.100+0000 7fe78f7fe700 1 --2- 172.21.15.71:0/601330751 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7800051c0 0x7fe78000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:32.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.100+0000 7fe78f7fe700 1 -- 172.21.15.71:0/601330751 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7980b1910 con 0x7fe780003a60 2023-10-06T01:41:32.109 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.100+0000 7fe78f7fe700 1 -- 172.21.15.71:0/601330751 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe78000c160 con 0x7fe7800051c0 2023-10-06T01:41:32.109 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.100+0000 7fe78f7fe700 1 -- 172.21.15.71:0/601330751 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe78000c320 con 0x7fe780004810 2023-10-06T01:41:32.109 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.100+0000 7fe79c877700 1 --2- 172.21.15.71:0/601330751 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe780003a60 0x7fe780003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:32.109 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.100+0000 7fe78ffff700 1 --2- 172.21.15.71:0/601330751 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe780004810 0x7fe780004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:32.109 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.100+0000 7fe79d078700 1 --2- 172.21.15.71:0/601330751 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7800051c0 0x7fe78000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:32.109 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.100+0000 7fe79c877700 1 -- 172.21.15.71:0/601330751 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe780004810 msgr2=0x7fe780004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:32.109 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.100+0000 7fe79c877700 1 --2- 172.21.15.71:0/601330751 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe780004810 0x7fe780004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:32.109 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.100+0000 7fe79c877700 1 -- 172.21.15.71:0/601330751 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7800051c0 msgr2=0x7fe78000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:32.109 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.100+0000 7fe79c877700 1 --2- 172.21.15.71:0/601330751 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7800051c0 0x7fe78000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:32.109 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.100+0000 7fe79d078700 1 -- 172.21.15.71:0/601330751 reap_dead start 2023-10-06T01:41:32.109 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.100+0000 7fe79c877700 1 -- 172.21.15.71:0/601330751 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe780003570 con 0x7fe780003a60 2023-10-06T01:41:32.109 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.100+0000 7fe79c877700 1 --2- 172.21.15.71:0/601330751 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe780003a60 0x7fe780003e70 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fe794001fc0 tx=0x7fe794001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9aa6d582137da7c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:32.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.100+0000 7fe78f7fe700 1 -- 172.21.15.71:0/601330751 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe794001950 con 0x7fe780003a60 2023-10-06T01:41:32.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.101+0000 7fe78f7fe700 1 -- 172.21.15.71:0/601330751 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe79400c8b0 con 0x7fe780003a60 2023-10-06T01:41:32.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.101+0000 7fe78f7fe700 1 -- 172.21.15.71:0/601330751 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe79400cc50 con 0x7fe780003a60 2023-10-06T01:41:32.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.101+0000 7fe79eadb700 1 -- 172.21.15.71:0/601330751 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe780003a60 msgr2=0x7fe780003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:32.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.101+0000 7fe79eadb700 1 --2- 172.21.15.71:0/601330751 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe780003a60 0x7fe780003e70 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fe794001fc0 tx=0x7fe794001640 comp rx=0 tx=0).stop 2023-10-06T01:41:32.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.101+0000 7fe79eadb700 1 -- 172.21.15.71:0/601330751 shutdown_connections 2023-10-06T01:41:32.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.101+0000 7fe79eadb700 1 --2- 172.21.15.71:0/601330751 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe780003a60 0x7fe780003e70 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:32.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.101+0000 7fe79eadb700 1 -- 172.21.15.71:0/601330751 >> 172.21.15.71:0/601330751 conn(0x7fe798068680 msgr2=0x7fe798068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:32.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.101+0000 7fe79eadb700 1 -- 172.21.15.71:0/601330751 shutdown_connections 2023-10-06T01:41:32.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.101+0000 7fe79eadb700 1 -- 172.21.15.71:0/601330751 wait complete. 2023-10-06T01:41:32.110 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.102+0000 7fe79eadb700 1 Processor -- start 2023-10-06T01:41:32.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.102+0000 7fe79eadb700 1 -- start start 2023-10-06T01:41:32.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.103+0000 7fe79eadb700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe780003a60 0x7fe7980a76f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:32.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.103+0000 7fe79eadb700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7980c9d20 0x7fe7981579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:32.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.103+0000 7fe79eadb700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe7980b4070 0x7fe7980b44c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:32.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.103+0000 7fe79eadb700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7980b55b0 con 0x7fe780003a60 2023-10-06T01:41:32.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.103+0000 7fe79eadb700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7980a7c30 con 0x7fe7980c9d20 2023-10-06T01:41:32.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.103+0000 7fe79eadb700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7980c7d10 con 0x7fe7980b4070 2023-10-06T01:41:32.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.103+0000 7fe79c877700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe780003a60 0x7fe7980a76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:32.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.103+0000 7fe79c877700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe780003a60 0x7fe7980a76f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37780/0 (socket says 172.21.15.71:37780) 2023-10-06T01:41:32.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.103+0000 7fe79c877700 1 -- 172.21.15.71:0/2741610315 learned_addr learned my addr 172.21.15.71:0/2741610315 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:32.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.103+0000 7fe79d078700 1 --2- 172.21.15.71:0/2741610315 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe7980b4070 0x7fe7980b44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:32.111 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.103+0000 7fe78ffff700 1 --2- 172.21.15.71:0/2741610315 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7980c9d20 0x7fe7981579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:32.112 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.103+0000 7fe79c877700 1 -- 172.21.15.71:0/2741610315 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe7980b4070 msgr2=0x7fe7980b44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:32.112 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.103+0000 7fe79c877700 1 --2- 172.21.15.71:0/2741610315 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe7980b4070 0x7fe7980b44c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:32.112 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.103+0000 7fe79c877700 1 -- 172.21.15.71:0/2741610315 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7980c9d20 msgr2=0x7fe7981579a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:32.112 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.103+0000 7fe79c877700 1 --2- 172.21.15.71:0/2741610315 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7980c9d20 0x7fe7981579a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:32.112 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.103+0000 7fe79c877700 1 -- 172.21.15.71:0/2741610315 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7980b4a00 con 0x7fe780003a60 2023-10-06T01:41:32.112 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.103+0000 7fe79d078700 1 --2- 172.21.15.71:0/2741610315 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe7980b4070 0x7fe7980b44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:41:32.112 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.103+0000 7fe78ffff700 1 --2- 172.21.15.71:0/2741610315 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7980c9d20 0x7fe7981579a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:41:32.112 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.104+0000 7fe79c877700 1 --2- 172.21.15.71:0/2741610315 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe780003a60 0x7fe7980a76f0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fe79400c6a0 tx=0x7fe794015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:32.112 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.104+0000 7fe78cff9700 1 -- 172.21.15.71:0/2741610315 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe794001950 con 0x7fe780003a60 2023-10-06T01:41:32.112 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.104+0000 7fe78cff9700 1 -- 172.21.15.71:0/2741610315 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe79400c6d0 con 0x7fe780003a60 2023-10-06T01:41:32.112 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.104+0000 7fe79eadb700 1 -- 172.21.15.71:0/2741610315 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe79816a6b0 con 0x7fe780003a60 2023-10-06T01:41:32.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.104+0000 7fe78cff9700 1 -- 172.21.15.71:0/2741610315 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe794026630 con 0x7fe780003a60 2023-10-06T01:41:32.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.104+0000 7fe79eadb700 1 -- 172.21.15.71:0/2741610315 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7980c8240 con 0x7fe780003a60 2023-10-06T01:41:32.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.105+0000 7fe79eadb700 1 -- 172.21.15.71:0/2741610315 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe798088aa0 con 0x7fe780003a60 2023-10-06T01:41:32.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.105+0000 7fe78cff9700 1 -- 172.21.15.71:0/2741610315 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe794019030 con 0x7fe780003a60 2023-10-06T01:41:32.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.105+0000 7fe78cff9700 1 --2- 172.21.15.71:0/2741610315 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fe784066fb0 0x7fe784069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:32.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.106+0000 7fe78cff9700 1 -- 172.21.15.71:0/2741610315 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fe794086400 con 0x7fe780003a60 2023-10-06T01:41:32.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.106+0000 7fe78ffff700 1 --2- 172.21.15.71:0/2741610315 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fe784066fb0 0x7fe784069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:32.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.106+0000 7fe78ffff700 1 --2- 172.21.15.71:0/2741610315 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fe784066fb0 0x7fe784069460 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe788001ed0 tx=0x7fe788009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:32.113 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.110+0000 7fe78cff9700 1 -- 172.21.15.71:0/2741610315 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe7940533e0 con 0x7fe780003a60 2023-10-06T01:41:32.334 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.334+0000 7fe79eadb700 1 -- 172.21.15.71:0/2741610315 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe7980cad20 con 0x7fe780003a60 2023-10-06T01:41:32.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.334+0000 7fe78cff9700 1 -- 172.21.15.71:0/2741610315 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4597 (secure 0 0 0) 0x7fe794056a00 con 0x7fe780003a60 2023-10-06T01:41:32.335 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:41:32.336 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5020,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/2765166441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6833","nonce":2765166441},{"type":"v1","addr":"172.21.15.72:6835","nonce":2765166441}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5145,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6836/1993673980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":1993673980},{"type":"v1","addr":"172.21.15.71:6836","nonce":1993673980}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5148,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/3598886363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6835","nonce":3598886363},{"type":"v1","addr":"172.21.15.71:6837","nonce":3598886363}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T01:41:26.474510+0000","modified":"2023-10-06T01:41:30.131784+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5157},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5157":{"gid":5157,"name":"d","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6834/2476889061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":2476889061},{"type":"v1","addr":"172.21.15.72:6834","nonce":2476889061}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T01:41:32.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.336+0000 7fe79eadb700 1 -- 172.21.15.71:0/2741610315 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fe784066fb0 msgr2=0x7fe784069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:32.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.336+0000 7fe79eadb700 1 --2- 172.21.15.71:0/2741610315 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fe784066fb0 0x7fe784069460 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe788001ed0 tx=0x7fe788009040 comp rx=0 tx=0).stop 2023-10-06T01:41:32.338 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.336+0000 7fe79eadb700 1 -- 172.21.15.71:0/2741610315 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe780003a60 msgr2=0x7fe7980a76f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:32.338 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.336+0000 7fe79eadb700 1 --2- 172.21.15.71:0/2741610315 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe780003a60 0x7fe7980a76f0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fe79400c6a0 tx=0x7fe794015000 comp rx=0 tx=0).stop 2023-10-06T01:41:32.338 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.336+0000 7fe79eadb700 1 -- 172.21.15.71:0/2741610315 shutdown_connections 2023-10-06T01:41:32.338 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.336+0000 7fe79eadb700 1 --2- 172.21.15.71:0/2741610315 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe7980b4070 0x7fe7980b44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:32.338 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.336+0000 7fe79eadb700 1 --2- 172.21.15.71:0/2741610315 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe780003a60 0x7fe7980a76f0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:32.338 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.336+0000 7fe79eadb700 1 --2- 172.21.15.71:0/2741610315 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fe784066fb0 0x7fe784069460 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:32.338 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.336+0000 7fe79eadb700 1 --2- 172.21.15.71:0/2741610315 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7980c9d20 0x7fe7981579a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:32.338 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.336+0000 7fe79eadb700 1 -- 172.21.15.71:0/2741610315 >> 172.21.15.71:0/2741610315 conn(0x7fe798068680 msgr2=0x7fe7980cde20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:32.338 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.337+0000 7fe79eadb700 1 -- 172.21.15.71:0/2741610315 shutdown_connections 2023-10-06T01:41:32.338 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.337+0000 7fe79eadb700 1 -- 172.21.15.71:0/2741610315 wait complete. 2023-10-06T01:41:32.339 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 18 2023-10-06T01:41:32.751 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 18, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T01:41:26.474510+0000', 'modified': '2023-10-06T01:41:30.131784+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5157}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5157': {'gid': 5157, 'name': 'd', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.72:6834/2476889061', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.72:6832', 'nonce': 2476889061}, {'type': 'v1', 'addr': '172.21.15.72:6834', 'nonce': 2476889061}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T01:41:32.751 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T01:41:32.752 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-10-06T01:41:32.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.870+0000 7f40357f9700 1 Processor -- start 2023-10-06T01:41:32.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.870+0000 7f40357f9700 1 -- start start 2023-10-06T01:41:32.873 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.870+0000 7f40357f9700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4030086ff0 0x7f4030087470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:32.873 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.870+0000 7f40357f9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f40300b21b0 0x7f40300b2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:32.873 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.870+0000 7f40357f9700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40300b2b70 con 0x7f403015a030 2023-10-06T01:41:32.873 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.870+0000 7f40357f9700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40300b0cf0 con 0x7f4030086ff0 2023-10-06T01:41:32.873 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.870+0000 7f40357f9700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40300879b0 con 0x7f40300b21b0 2023-10-06T01:41:32.873 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.871+0000 7f402e7fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4030086ff0 0x7f4030087470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:32.873 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.871+0000 7f402f7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f40300b21b0 0x7f40300b2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:32.873 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.871+0000 7f402e7fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4030086ff0 0x7f4030087470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:38872/0 (socket says 172.21.15.71:38872) 2023-10-06T01:41:32.873 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.871+0000 7f402f7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f40300b21b0 0x7f40300b2630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.71:49054/0 (socket says 172.21.15.71:49054) 2023-10-06T01:41:32.874 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.871+0000 7f402e7fc700 1 -- 172.21.15.71:0/238120808 learned_addr learned my addr 172.21.15.71:0/238120808 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:32.874 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.871+0000 7f402e7fc700 1 -- 172.21.15.71:0/238120808 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f40300b21b0 msgr2=0x7f40300b2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:32.874 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.871+0000 7f402e7fc700 1 --2- 172.21.15.71:0/238120808 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f40300b21b0 0x7f40300b2630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:32.874 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.871+0000 7f402e7fc700 1 -- 172.21.15.71:0/238120808 >> v1:172.21.15.72:6789/0 conn(0x7f403015a030 legacy=0x7f403015a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:32.874 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.871+0000 7f402e7fc700 1 -- 172.21.15.71:0/238120808 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40300afc50 con 0x7f4030086ff0 2023-10-06T01:41:32.874 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.871+0000 7f402f7fe700 1 --2- 172.21.15.71:0/238120808 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f40300b21b0 0x7f40300b2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:41:32.874 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.871+0000 7f402e7fc700 1 --2- 172.21.15.71:0/238120808 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4030086ff0 0x7f4030087470 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f40180099b0 tx=0x7f4018009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c34c502081146c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:32.874 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.871+0000 7f402dffb700 1 -- 172.21.15.71:0/238120808 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4018009ea0 con 0x7f4030086ff0 2023-10-06T01:41:32.874 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.871+0000 7f402dffb700 1 -- 172.21.15.71:0/238120808 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f401800b860 con 0x7f4030086ff0 2023-10-06T01:41:32.874 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.872+0000 7f402dffb700 1 -- 172.21.15.71:0/238120808 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f401800bc00 con 0x7f4030086ff0 2023-10-06T01:41:32.874 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.872+0000 7f40357f9700 1 -- 172.21.15.71:0/238120808 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4030086ff0 msgr2=0x7f4030087470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:32.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.872+0000 7f40357f9700 1 --2- 172.21.15.71:0/238120808 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4030086ff0 0x7f4030087470 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f40180099b0 tx=0x7f4018009250 comp rx=0 tx=0).stop 2023-10-06T01:41:32.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.872+0000 7f40357f9700 1 -- 172.21.15.71:0/238120808 shutdown_connections 2023-10-06T01:41:32.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.872+0000 7f40357f9700 1 --2- 172.21.15.71:0/238120808 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f40300b21b0 0x7f40300b2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:32.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.872+0000 7f40357f9700 1 --2- 172.21.15.71:0/238120808 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4030086ff0 0x7f4030087470 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:32.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.872+0000 7f40357f9700 1 -- 172.21.15.71:0/238120808 >> 172.21.15.71:0/238120808 conn(0x7f4030068680 msgr2=0x7f4030068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:32.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.872+0000 7f40357f9700 1 -- 172.21.15.71:0/238120808 shutdown_connections 2023-10-06T01:41:32.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.872+0000 7f40357f9700 1 -- 172.21.15.71:0/238120808 wait complete. 2023-10-06T01:41:32.877 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.873+0000 7f40357f9700 1 Processor -- start 2023-10-06T01:41:32.878 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.873+0000 7f40357f9700 1 -- start start 2023-10-06T01:41:32.878 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.874+0000 7f40357f9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4030086ff0 0x7f403016aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:32.878 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.874+0000 7f40357f9700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f40300b21b0 0x7f403016ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:32.878 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.874+0000 7f40357f9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f403015a030 0x7f4030169ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:32.878 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.874+0000 7f40357f9700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f403015a910 con 0x7f40300b21b0 2023-10-06T01:41:32.878 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.874+0000 7f40357f9700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f403016a7a0 con 0x7f403015a030 2023-10-06T01:41:32.878 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.874+0000 7f40357f9700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f403016aa80 con 0x7f4030086ff0 2023-10-06T01:41:32.878 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.874+0000 7f402e7fc700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f40300b21b0 0x7f403016ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:32.878 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.874+0000 7f402e7fc700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f40300b21b0 0x7f403016ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37792/0 (socket says 172.21.15.71:37792) 2023-10-06T01:41:32.878 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.874+0000 7f402e7fc700 1 -- 172.21.15.71:0/583486631 learned_addr learned my addr 172.21.15.71:0/583486631 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:32.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.874+0000 7f402effd700 1 --2- 172.21.15.71:0/583486631 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4030086ff0 0x7f403016aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:32.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.874+0000 7f402f7fe700 1 --2- 172.21.15.71:0/583486631 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f403015a030 0x7f4030169ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:32.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.874+0000 7f402e7fc700 1 -- 172.21.15.71:0/583486631 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4030086ff0 msgr2=0x7f403016aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:32.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.874+0000 7f402e7fc700 1 --2- 172.21.15.71:0/583486631 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4030086ff0 0x7f403016aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:32.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.874+0000 7f402e7fc700 1 -- 172.21.15.71:0/583486631 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f403015a030 msgr2=0x7f4030169ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:32.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.874+0000 7f402e7fc700 1 --2- 172.21.15.71:0/583486631 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f403015a030 0x7f4030169ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:32.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.874+0000 7f402e7fc700 1 -- 172.21.15.71:0/583486631 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4020009420 con 0x7f40300b21b0 2023-10-06T01:41:32.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.875+0000 7f402e7fc700 1 --2- 172.21.15.71:0/583486631 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f40300b21b0 0x7f403016ca40 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f40300cdd90 tx=0x7f4018017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:32.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.875+0000 7f4026ffd700 1 -- 172.21.15.71:0/583486631 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f401800bbe0 con 0x7f40300b21b0 2023-10-06T01:41:32.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.875+0000 7f4026ffd700 1 -- 172.21.15.71:0/583486631 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4018011420 con 0x7f40300b21b0 2023-10-06T01:41:32.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.875+0000 7f40357f9700 1 -- 172.21.15.71:0/583486631 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40180094f0 con 0x7f40300b21b0 2023-10-06T01:41:32.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.875+0000 7f4026ffd700 1 -- 172.21.15.71:0/583486631 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40180117c0 con 0x7f40300b21b0 2023-10-06T01:41:32.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.875+0000 7f40357f9700 1 -- 172.21.15.71:0/583486631 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f403016cf80 con 0x7f40300b21b0 2023-10-06T01:41:32.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.876+0000 7f4026ffd700 1 -- 172.21.15.71:0/583486631 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4018011b70 con 0x7f40300b21b0 2023-10-06T01:41:32.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.876+0000 7f4026ffd700 1 --2- 172.21.15.71:0/583486631 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f4010066f30 0x7f40100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:32.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.877+0000 7f4026ffd700 1 -- 172.21.15.71:0/583486631 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f40180861b0 con 0x7f40300b21b0 2023-10-06T01:41:32.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.877+0000 7f402effd700 1 --2- 172.21.15.71:0/583486631 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f4010066f30 0x7f40100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:32.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.877+0000 7f402effd700 1 --2- 172.21.15.71:0/583486631 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f4010066f30 0x7f40100693e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4028007fd0 tx=0x7f4028009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:32.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.878+0000 7f403eaf1b80 1 Processor -- start 2023-10-06T01:41:32.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.879+0000 7f403eaf1b80 1 -- start start 2023-10-06T01:41:32.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.879+0000 7f403eaf1b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x559b4b512840 0x559b4b512c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:32.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.879+0000 7f403eaf1b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559b4b513cc0 0x559b4b5626c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:32.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.879+0000 7f403eaf1b80 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x559b4b562c00 0x559b4b563050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:32.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.879+0000 7f403eaf1b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b4b469a70 con 0x559b4b513cc0 2023-10-06T01:41:32.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.879+0000 7f403eaf1b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b4b467270 con 0x559b4b512840 2023-10-06T01:41:32.889 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.879+0000 7f403eaf1b80 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x559b4b463060 con 0x559b4b562c00 2023-10-06T01:41:32.889 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.879+0000 7f402e7fc700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559b4b513cc0 0x559b4b5626c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:32.889 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.879+0000 7f402e7fc700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559b4b513cc0 0x559b4b5626c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37800/0 (socket says 172.21.15.71:37800) 2023-10-06T01:41:32.889 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.879+0000 7f402e7fc700 1 -- 172.21.15.71:0/1474587873 learned_addr learned my addr 172.21.15.71:0/1474587873 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:32.889 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.880+0000 7f402effd700 1 --2- 172.21.15.71:0/1474587873 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x559b4b512840 0x559b4b512c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:32.889 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.880+0000 7f402f7fe700 1 --2- 172.21.15.71:0/1474587873 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x559b4b562c00 0x559b4b563050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:32.889 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.880+0000 7f402e7fc700 1 -- 172.21.15.71:0/1474587873 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x559b4b562c00 msgr2=0x559b4b563050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:32.889 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.880+0000 7f402e7fc700 1 --2- 172.21.15.71:0/1474587873 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x559b4b562c00 0x559b4b563050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:32.889 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.880+0000 7f402e7fc700 1 -- 172.21.15.71:0/1474587873 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x559b4b512840 msgr2=0x559b4b512c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:32.889 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.880+0000 7f402e7fc700 1 --2- 172.21.15.71:0/1474587873 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x559b4b512840 0x559b4b512c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:32.890 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.880+0000 7f402e7fc700 1 -- 172.21.15.71:0/1474587873 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559b4b2fd270 con 0x559b4b513cc0 2023-10-06T01:41:32.890 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.880+0000 7f402effd700 1 --2- 172.21.15.71:0/1474587873 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x559b4b512840 0x559b4b512c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:41:32.890 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.880+0000 7f402e7fc700 1 --2- 172.21.15.71:0/1474587873 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559b4b513cc0 0x559b4b5626c0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f4018084430 tx=0x7f4018003040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42a52a32c857550e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:32.890 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.880+0000 7f400ffff700 1 -- 172.21.15.71:0/1474587873 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4018057540 con 0x559b4b513cc0 2023-10-06T01:41:32.890 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.880+0000 7f400ffff700 1 -- 172.21.15.71:0/1474587873 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4018056e40 con 0x559b4b513cc0 2023-10-06T01:41:32.890 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.880+0000 7f400ffff700 1 -- 172.21.15.71:0/1474587873 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f401805a090 con 0x559b4b513cc0 2023-10-06T01:41:32.890 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.881+0000 7f403eaf1b80 1 -- 172.21.15.71:0/1474587873 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559b4b513cc0 msgr2=0x559b4b5626c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:32.890 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.881+0000 7f403eaf1b80 1 --2- 172.21.15.71:0/1474587873 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559b4b513cc0 0x559b4b5626c0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f4018084430 tx=0x7f4018003040 comp rx=0 tx=0).stop 2023-10-06T01:41:32.890 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.881+0000 7f403eaf1b80 1 -- 172.21.15.71:0/1474587873 shutdown_connections 2023-10-06T01:41:32.890 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.881+0000 7f403eaf1b80 1 --2- 172.21.15.71:0/1474587873 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x559b4b562c00 0x559b4b563050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:32.891 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.881+0000 7f403eaf1b80 1 --2- 172.21.15.71:0/1474587873 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x559b4b512840 0x559b4b512c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:32.891 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.881+0000 7f403eaf1b80 1 --2- 172.21.15.71:0/1474587873 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559b4b513cc0 0x559b4b5626c0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:32.891 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.881+0000 7f403eaf1b80 1 -- 172.21.15.71:0/1474587873 >> 172.21.15.71:0/1474587873 conn(0x559b4b514160 msgr2=0x559b4b514530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:32.891 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.881+0000 7f403eaf1b80 1 -- 172.21.15.71:0/1474587873 shutdown_connections 2023-10-06T01:41:32.891 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.881+0000 7f403eaf1b80 1 -- 172.21.15.71:0/1474587873 wait complete. 2023-10-06T01:41:32.891 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.881+0000 7f403eaf1b80 1 -- start start 2023-10-06T01:41:32.891 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.881+0000 7f403eaf1b80 1 Processor -- start 2023-10-06T01:41:32.891 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.882+0000 7f403eaf1b80 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x559b4b512840 0x559b4b53bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:32.891 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.882+0000 7f403eaf1b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559b4b513cc0 0x559b4b5590a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:32.891 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.882+0000 7f403eaf1b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x559b4b562c00 0x559b4b50db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:32.892 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.882+0000 7f403eaf1b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b4b40e890 con 0x559b4b513cc0 2023-10-06T01:41:32.892 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.882+0000 7f403eaf1b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b4b429ea0 con 0x559b4b562c00 2023-10-06T01:41:32.892 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.882+0000 7f403eaf1b80 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x559b4b2e5e30 con 0x559b4b512840 2023-10-06T01:41:32.892 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.882+0000 7f403eaf1b80 10 client.0 _ll_register_callbacks cb 0x559b4b4d5e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T01:41:32.892 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.882+0000 7f402e7fc700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559b4b513cc0 0x559b4b5590a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:32.892 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.882+0000 7f402e7fc700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559b4b513cc0 0x559b4b5590a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37810/0 (socket says 172.21.15.71:37810) 2023-10-06T01:41:32.892 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.882+0000 7f402e7fc700 1 -- 172.21.15.71:0/2339413394 learned_addr learned my addr 172.21.15.71:0/2339413394 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:32.892 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.882+0000 7f402effd700 1 --2- 172.21.15.71:0/2339413394 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x559b4b512840 0x559b4b53bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:32.892 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.882+0000 7f402f7fe700 1 --2- 172.21.15.71:0/2339413394 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x559b4b562c00 0x559b4b50db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:32.892 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.883+0000 7f402e7fc700 1 -- 172.21.15.71:0/2339413394 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x559b4b512840 msgr2=0x559b4b53bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:32.892 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.883+0000 7f402e7fc700 1 --2- 172.21.15.71:0/2339413394 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x559b4b512840 0x559b4b53bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:32.892 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.883+0000 7f402e7fc700 1 -- 172.21.15.71:0/2339413394 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x559b4b562c00 msgr2=0x559b4b50db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:32.893 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.883+0000 7f402e7fc700 1 --2- 172.21.15.71:0/2339413394 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x559b4b562c00 0x559b4b50db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:32.893 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.883+0000 7f402e7fc700 1 -- 172.21.15.71:0/2339413394 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f403016cf80 con 0x559b4b513cc0 2023-10-06T01:41:32.893 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.883+0000 7f402e7fc700 1 --2- 172.21.15.71:0/2339413394 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559b4b513cc0 0x559b4b5590a0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f4018084510 tx=0x7f401802f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40cc60e4d0aa389d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:32.893 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.883+0000 7f400d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2023-10-06T01:41:32.893 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.883+0000 7f400d7fa700 1 -- 172.21.15.71:0/2339413394 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4018057540 con 0x559b4b513cc0 2023-10-06T01:41:32.893 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.883+0000 7f400d7fa700 1 -- 172.21.15.71:0/2339413394 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(41..41 src has 1..41) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f401805dde0 con 0x559b4b513cc0 2023-10-06T01:41:32.893 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.883+0000 7f403eaf1b80 1 -- 172.21.15.71:0/2339413394 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559b4b507940 con 0x559b4b513cc0 2023-10-06T01:41:32.893 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.883+0000 7f400d7fa700 1 -- 172.21.15.71:0/2339413394 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f401805a090 con 0x559b4b513cc0 2023-10-06T01:41:32.893 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.883+0000 7f403eaf1b80 10 client.5319 fetch_fsmap learned FSMap version 18 2023-10-06T01:41:32.893 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.883+0000 7f403eaf1b80 1 -- 172.21.15.71:0/2339413394 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x559b4b29ffe0 con 0x559b4b513cc0 2023-10-06T01:41:32.893 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.883+0000 7f400d7fa700 1 -- 172.21.15.71:0/2339413394 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559b4b507940 con 0x559b4b513cc0 2023-10-06T01:41:32.894 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.883+0000 7f400d7fa700 1 -- 172.21.15.71:0/2339413394 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 18) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f401805d950 con 0x559b4b513cc0 2023-10-06T01:41:32.894 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.883+0000 7f403eaf1b80 10 client.5319 fetch_fsmap finished waiting for FSMap version 18 2023-10-06T01:41:32.894 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.883+0000 7f403eaf1b80 10 client.5319 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-06T01:41:32.894 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.883+0000 7f403eaf1b80 20 client.5319 populate_metadata read hostname 'smithi071' 2023-10-06T01:41:32.894 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.883+0000 7f403eaf1b80 1 --2- 172.21.15.71:0/2339413394 >> [v2:172.21.15.72:6832/2476889061,v1:172.21.15.72:6834/2476889061] conn(0x559b4b551a60 0x559b4b551e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:32.894 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.883+0000 7f403eaf1b80 4 client.5319 mds_command: new command op to 5157 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T01:41:32.894 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.883+0000 7f403eaf1b80 1 -- 172.21.15.71:0/2339413394 --> [v2:172.21.15.72:6832/2476889061,v1:172.21.15.72:6834/2476889061] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559b4b4e4870 con 0x559b4b551a60 2023-10-06T01:41:32.894 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.884+0000 7f402effd700 1 --2- 172.21.15.71:0/2339413394 >> [v2:172.21.15.72:6832/2476889061,v1:172.21.15.72:6834/2476889061] conn(0x559b4b551a60 0x559b4b551e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:32.894 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.884+0000 7f400d7fa700 10 client.5319 ms_handle_connect on v2:172.21.15.72:6832/2476889061 2023-10-06T01:41:32.894 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.884+0000 7f402effd700 1 --2- 172.21.15.71:0/2339413394 >> [v2:172.21.15.72:6832/2476889061,v1:172.21.15.72:6834/2476889061] conn(0x559b4b551a60 0x559b4b551e30 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de1c5878357ab0a7 server_cookie=1f043fc623dd6459 in_seq=0 out_seq=0 2023-10-06T01:41:32.895 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.885+0000 7f400d7fa700 1 -- 172.21.15.71:0/2339413394 <== mds.0 v2:172.21.15.72:6832/2476889061 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x559b4b4e4870 con 0x559b4b551a60 2023-10-06T01:41:32.895 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.885+0000 7f400d7fa700 10 client.5319 handle_command_reply: tid=0 2023-10-06T01:41:32.895 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.885+0000 7f403eaf1b80 1 client.5319 shutdown 2023-10-06T01:41:32.895 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.885+0000 7f403eaf1b80 1 -- 172.21.15.71:0/2339413394 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559b4b513cc0 msgr2=0x559b4b5590a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:32.895 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.885+0000 7f403eaf1b80 1 --2- 172.21.15.71:0/2339413394 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559b4b513cc0 0x559b4b5590a0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f4018084510 tx=0x7f401802f000 comp rx=0 tx=0).stop 2023-10-06T01:41:32.895 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.885+0000 7f403eaf1b80 1 -- 172.21.15.71:0/2339413394 shutdown_connections 2023-10-06T01:41:32.895 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.885+0000 7f403eaf1b80 1 --2- 172.21.15.71:0/2339413394 >> [v2:172.21.15.72:6832/2476889061,v1:172.21.15.72:6834/2476889061] conn(0x559b4b551a60 0x559b4b551e30 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:32.895 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.885+0000 7f403eaf1b80 1 --2- 172.21.15.71:0/2339413394 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x559b4b562c00 0x559b4b50db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:32.895 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.885+0000 7f400d7fa700 0 client.5319 ms_handle_reset on v2:172.21.15.72:6832/2476889061 2023-10-06T01:41:32.895 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.885+0000 7f403eaf1b80 1 --2- 172.21.15.71:0/2339413394 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x559b4b512840 0x559b4b53bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:32.895 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.885+0000 7f403eaf1b80 1 --2- 172.21.15.71:0/2339413394 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559b4b513cc0 0x559b4b5590a0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:32.896 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.885+0000 7f403eaf1b80 1 -- 172.21.15.71:0/2339413394 >> 172.21.15.71:0/2339413394 conn(0x559b4b514160 msgr2=0x559b4b5561f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:32.896 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.885+0000 7f403eaf1b80 1 -- 172.21.15.71:0/2339413394 shutdown_connections 2023-10-06T01:41:32.896 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.885+0000 7f403eaf1b80 1 -- 172.21.15.71:0/2339413394 wait complete. 2023-10-06T01:41:32.896 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.885+0000 7f403eaf1b80 20 client.5319 trim_cache size 0 max 16384 2023-10-06T01:41:32.902 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.901+0000 7f403eaf1b80 1 Processor -- start 2023-10-06T01:41:32.902 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.901+0000 7f403eaf1b80 1 -- start start 2023-10-06T01:41:32.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.902+0000 7f403eaf1b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x559b4b512840 0x559b4b558e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:32.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.902+0000 7f403eaf1b80 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x559b4b513cc0 0x559b4b55bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:32.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.902+0000 7f403eaf1b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559b4b562c00 0x559b4b55c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:32.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.902+0000 7f403eaf1b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b4b55b8a0 con 0x559b4b562c00 2023-10-06T01:41:32.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.902+0000 7f403eaf1b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b4b5121c0 con 0x559b4b512840 2023-10-06T01:41:32.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.902+0000 7f403eaf1b80 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x559b4b4eb1e0 con 0x559b4b513cc0 2023-10-06T01:41:32.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.902+0000 7f402f7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559b4b562c00 0x559b4b55c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:32.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.902+0000 7f402f7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559b4b562c00 0x559b4b55c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37816/0 (socket says 172.21.15.71:37816) 2023-10-06T01:41:32.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.902+0000 7f402f7fe700 1 -- 172.21.15.71:0/4266333565 learned_addr learned my addr 172.21.15.71:0/4266333565 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:32.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.902+0000 7f402f7fe700 1 -- 172.21.15.71:0/4266333565 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x559b4b513cc0 msgr2=0x559b4b55bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:32.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.902+0000 7f402f7fe700 1 --2- 172.21.15.71:0/4266333565 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x559b4b513cc0 0x559b4b55bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:32.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.902+0000 7f402f7fe700 1 -- 172.21.15.71:0/4266333565 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x559b4b512840 msgr2=0x559b4b558e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:32.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.902+0000 7f402effd700 1 --2- 172.21.15.71:0/4266333565 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x559b4b512840 0x559b4b558e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:32.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.903+0000 7f402f7fe700 1 --2- 172.21.15.71:0/4266333565 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x559b4b512840 0x559b4b558e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:32.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.903+0000 7f402f7fe700 1 -- 172.21.15.71:0/4266333565 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559b4b431780 con 0x559b4b562c00 2023-10-06T01:41:32.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.903+0000 7f402f7fe700 1 --2- 172.21.15.71:0/4266333565 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559b4b562c00 0x559b4b55c000 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f4020009f80 tx=0x7f4020008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5093dd2274e7ecb9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:32.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.903+0000 7f4024ff9700 1 -- 172.21.15.71:0/4266333565 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4020016db0 con 0x559b4b562c00 2023-10-06T01:41:32.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.903+0000 7f4024ff9700 1 -- 172.21.15.71:0/4266333565 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f402001b070 con 0x559b4b562c00 2023-10-06T01:41:32.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.903+0000 7f4024ff9700 1 -- 172.21.15.71:0/4266333565 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4020017440 con 0x559b4b562c00 2023-10-06T01:41:32.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.903+0000 7f403eaf1b80 1 -- 172.21.15.71:0/4266333565 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559b4b562c00 msgr2=0x559b4b55c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:32.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.903+0000 7f403eaf1b80 1 --2- 172.21.15.71:0/4266333565 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559b4b562c00 0x559b4b55c000 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f4020009f80 tx=0x7f4020008040 comp rx=0 tx=0).stop 2023-10-06T01:41:32.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.903+0000 7f403eaf1b80 1 -- 172.21.15.71:0/4266333565 shutdown_connections 2023-10-06T01:41:32.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.903+0000 7f403eaf1b80 1 --2- 172.21.15.71:0/4266333565 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559b4b562c00 0x559b4b55c000 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:32.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.903+0000 7f403eaf1b80 1 --2- 172.21.15.71:0/4266333565 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x559b4b512840 0x559b4b558e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:32.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.903+0000 7f403eaf1b80 1 --2- 172.21.15.71:0/4266333565 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x559b4b513cc0 0x559b4b55bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:32.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.903+0000 7f403eaf1b80 1 -- 172.21.15.71:0/4266333565 >> 172.21.15.71:0/4266333565 conn(0x559b4b514160 msgr2=0x559b4b515ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:32.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.903+0000 7f403eaf1b80 1 -- 172.21.15.71:0/4266333565 shutdown_connections 2023-10-06T01:41:32.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.903+0000 7f403eaf1b80 1 -- 172.21.15.71:0/4266333565 wait complete. 2023-10-06T01:41:32.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.904+0000 7f403eaf1b80 1 -- start start 2023-10-06T01:41:32.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.904+0000 7f403eaf1b80 1 Processor -- start 2023-10-06T01:41:32.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.905+0000 7f403eaf1b80 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x559b4b512840 0x559b4b5be010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:32.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.905+0000 7f403eaf1b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559b4b513cc0 0x559b4b55bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:32.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.905+0000 7f403eaf1b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x559b4b562c00 0x559b4b55c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:32.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.905+0000 7f403eaf1b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b4b5bfe90 con 0x559b4b513cc0 2023-10-06T01:41:32.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.905+0000 7f403eaf1b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b4b53b330 con 0x559b4b562c00 2023-10-06T01:41:32.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.905+0000 7f403eaf1b80 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x559b4b515ca0 con 0x559b4b512840 2023-10-06T01:41:32.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.905+0000 7f403eaf1b80 10 client.0 _ll_register_callbacks cb 0x559b4b4d5e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T01:41:32.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.905+0000 7f402e7fc700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559b4b513cc0 0x559b4b55bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:32.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.905+0000 7f402e7fc700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559b4b513cc0 0x559b4b55bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37822/0 (socket says 172.21.15.71:37822) 2023-10-06T01:41:32.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.905+0000 7f402e7fc700 1 -- 172.21.15.71:0/2042017396 learned_addr learned my addr 172.21.15.71:0/2042017396 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:32.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.905+0000 7f402f7fe700 1 --2- 172.21.15.71:0/2042017396 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x559b4b562c00 0x559b4b55c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:32.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.905+0000 7f402effd700 1 --2- 172.21.15.71:0/2042017396 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x559b4b512840 0x559b4b5be010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:32.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.905+0000 7f402e7fc700 1 -- 172.21.15.71:0/2042017396 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x559b4b512840 msgr2=0x559b4b5be010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:32.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.905+0000 7f402e7fc700 1 --2- 172.21.15.71:0/2042017396 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x559b4b512840 0x559b4b5be010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:32.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.905+0000 7f402e7fc700 1 -- 172.21.15.71:0/2042017396 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x559b4b562c00 msgr2=0x559b4b55c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:32.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.905+0000 7f402e7fc700 1 --2- 172.21.15.71:0/2042017396 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x559b4b562c00 0x559b4b55c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:32.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.905+0000 7f402e7fc700 1 -- 172.21.15.71:0/2042017396 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4020009c80 con 0x559b4b513cc0 2023-10-06T01:41:32.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.905+0000 7f402effd700 1 --2- 172.21.15.71:0/2042017396 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x559b4b512840 0x559b4b5be010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:41:32.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.905+0000 7f402e7fc700 1 --2- 172.21.15.71:0/2042017396 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559b4b513cc0 0x559b4b55bac0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f4018056a60 tx=0x7f4018003050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=435e030014b729b3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:32.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.905+0000 7f400d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2023-10-06T01:41:32.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.906+0000 7f400d7fa700 1 -- 172.21.15.71:0/2042017396 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40180565e0 con 0x559b4b513cc0 2023-10-06T01:41:32.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.906+0000 7f400d7fa700 1 -- 172.21.15.71:0/2042017396 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(41..41 src has 1..41) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f4018057540 con 0x559b4b513cc0 2023-10-06T01:41:32.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.906+0000 7f403eaf1b80 1 -- 172.21.15.71:0/2042017396 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4018056e40 con 0x559b4b513cc0 2023-10-06T01:41:32.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.906+0000 7f400d7fa700 1 -- 172.21.15.71:0/2042017396 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4018084230 con 0x559b4b513cc0 2023-10-06T01:41:32.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.906+0000 7f403eaf1b80 10 client.5325 fetch_fsmap learned FSMap version 18 2023-10-06T01:41:32.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.906+0000 7f403eaf1b80 1 -- 172.21.15.71:0/2042017396 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x559b4b418470 con 0x559b4b513cc0 2023-10-06T01:41:32.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.906+0000 7f400d7fa700 1 -- 172.21.15.71:0/2042017396 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4018056e40 con 0x559b4b513cc0 2023-10-06T01:41:32.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.906+0000 7f400d7fa700 1 -- 172.21.15.71:0/2042017396 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 18) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f401807eb70 con 0x559b4b513cc0 2023-10-06T01:41:32.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.906+0000 7f403eaf1b80 10 client.5325 fetch_fsmap finished waiting for FSMap version 18 2023-10-06T01:41:32.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.906+0000 7f403eaf1b80 10 client.5325 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-06T01:41:32.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.906+0000 7f403eaf1b80 20 client.5325 populate_metadata read hostname 'smithi071' 2023-10-06T01:41:32.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.906+0000 7f403eaf1b80 1 --2- 172.21.15.71:0/2042017396 >> [v2:172.21.15.72:6832/2476889061,v1:172.21.15.72:6834/2476889061] conn(0x559b4b55cf10 0x559b4b55d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:32.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.906+0000 7f403eaf1b80 4 client.5325 mds_command: new command op to 5157 tid=0[{"prefix": "status"}] 2023-10-06T01:41:32.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.906+0000 7f403eaf1b80 1 -- 172.21.15.71:0/2042017396 --> [v2:172.21.15.72:6832/2476889061,v1:172.21.15.72:6834/2476889061] -- command(tid 0: {"prefix": "status"}) v1 -- 0x559b4b405e00 con 0x559b4b55cf10 2023-10-06T01:41:32.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.906+0000 7f402effd700 1 --2- 172.21.15.71:0/2042017396 >> [v2:172.21.15.72:6832/2476889061,v1:172.21.15.72:6834/2476889061] conn(0x559b4b55cf10 0x559b4b55d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:32.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.906+0000 7f400d7fa700 10 client.5325 ms_handle_connect on v2:172.21.15.72:6832/2476889061 2023-10-06T01:41:32.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.906+0000 7f402effd700 1 --2- 172.21.15.71:0/2042017396 >> [v2:172.21.15.72:6832/2476889061,v1:172.21.15.72:6834/2476889061] conn(0x559b4b55cf10 0x559b4b55d2e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb05cf2fa8b692f8 server_cookie=f42475723aa7572a in_seq=0 out_seq=0 2023-10-06T01:41:32.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.907+0000 7f400d7fa700 1 -- 172.21.15.71:0/2042017396 <== mds.0 v2:172.21.15.72:6832/2476889061 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+318 (crc 0 0 0) 0x559b4b405e00 con 0x559b4b55cf10 2023-10-06T01:41:32.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.907+0000 7f400d7fa700 10 client.5325 handle_command_reply: tid=0 2023-10-06T01:41:32.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.907+0000 7f403eaf1b80 1 client.5325 shutdown 2023-10-06T01:41:32.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.907+0000 7f403eaf1b80 1 -- 172.21.15.71:0/2042017396 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559b4b513cc0 msgr2=0x559b4b55bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:32.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.907+0000 7f403eaf1b80 1 --2- 172.21.15.71:0/2042017396 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559b4b513cc0 0x559b4b55bac0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f4018056a60 tx=0x7f4018003050 comp rx=0 tx=0).stop 2023-10-06T01:41:32.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.907+0000 7f403eaf1b80 1 -- 172.21.15.71:0/2042017396 shutdown_connections 2023-10-06T01:41:32.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.907+0000 7f403eaf1b80 1 --2- 172.21.15.71:0/2042017396 >> [v2:172.21.15.72:6832/2476889061,v1:172.21.15.72:6834/2476889061] conn(0x559b4b55cf10 0x559b4b55d2e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:32.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.907+0000 7f403eaf1b80 1 --2- 172.21.15.71:0/2042017396 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x559b4b562c00 0x559b4b55c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:32.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.907+0000 7f403eaf1b80 1 --2- 172.21.15.71:0/2042017396 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x559b4b512840 0x559b4b5be010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:32.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.907+0000 7f403eaf1b80 1 --2- 172.21.15.71:0/2042017396 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559b4b513cc0 0x559b4b55bac0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:32.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.907+0000 7f400d7fa700 0 client.5325 ms_handle_reset on v2:172.21.15.72:6832/2476889061 2023-10-06T01:41:32.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.907+0000 7f403eaf1b80 1 -- 172.21.15.71:0/2042017396 >> 172.21.15.71:0/2042017396 conn(0x559b4b514160 msgr2=0x559b4b558500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:32.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.907+0000 7f403eaf1b80 1 -- 172.21.15.71:0/2042017396 shutdown_connections 2023-10-06T01:41:32.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.907+0000 7f403eaf1b80 1 -- 172.21.15.71:0/2042017396 wait complete. 2023-10-06T01:41:32.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.907+0000 7f403eaf1b80 20 client.5325 trim_cache size 0 max 16384 2023-10-06T01:41:32.916 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2023-10-06T01:41:32.916 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster_fsid": "1fbf1bd2-f9b4-4599-bea2-f4aa920e9a56", 2023-10-06T01:41:32.916 INFO:teuthology.orchestra.run.smithi071.stdout: "whoami": 0, 2023-10-06T01:41:32.916 INFO:teuthology.orchestra.run.smithi071.stdout: "id": 5157, 2023-10-06T01:41:32.916 INFO:teuthology.orchestra.run.smithi071.stdout: "want_state": "up:active", 2023-10-06T01:41:32.917 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "up:active", 2023-10-06T01:41:32.917 INFO:teuthology.orchestra.run.smithi071.stdout: "fs_name": "cephfs", 2023-10-06T01:41:32.917 INFO:teuthology.orchestra.run.smithi071.stdout: "rank_uptime": 5.788781105, 2023-10-06T01:41:32.917 INFO:teuthology.orchestra.run.smithi071.stdout: "mdsmap_epoch": 18, 2023-10-06T01:41:32.917 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_epoch": 41, 2023-10-06T01:41:32.917 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_epoch_barrier": 41, 2023-10-06T01:41:32.917 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 13.673603707 2023-10-06T01:41:32.917 INFO:teuthology.orchestra.run.smithi071.stdout:} 2023-10-06T01:41:32.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.907+0000 7f40357f9700 1 -- 172.21.15.71:0/583486631 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f4010066f30 msgr2=0x7f40100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:32.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.907+0000 7f40357f9700 1 --2- 172.21.15.71:0/583486631 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f4010066f30 0x7f40100693e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4028007fd0 tx=0x7f4028009040 comp rx=0 tx=0).stop 2023-10-06T01:41:32.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.907+0000 7f40357f9700 1 -- 172.21.15.71:0/583486631 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f40300b21b0 msgr2=0x7f403016ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:32.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.907+0000 7f40357f9700 1 --2- 172.21.15.71:0/583486631 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f40300b21b0 0x7f403016ca40 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f40300cdd90 tx=0x7f4018017000 comp rx=0 tx=0).stop 2023-10-06T01:41:32.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.908+0000 7f40357f9700 1 -- 172.21.15.71:0/583486631 shutdown_connections 2023-10-06T01:41:32.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.908+0000 7f40357f9700 1 --2- 172.21.15.71:0/583486631 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f4010066f30 0x7f40100693e0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:32.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.908+0000 7f40357f9700 1 --2- 172.21.15.71:0/583486631 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f403015a030 0x7f4030169ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:32.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.908+0000 7f40357f9700 1 --2- 172.21.15.71:0/583486631 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4030086ff0 0x7f403016aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:32.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.908+0000 7f40357f9700 1 --2- 172.21.15.71:0/583486631 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f40300b21b0 0x7f403016ca40 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:32.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.908+0000 7f40357f9700 1 -- 172.21.15.71:0/583486631 >> 172.21.15.71:0/583486631 conn(0x7f4030068680 msgr2=0x7f40300b50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:32.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.908+0000 7f40357f9700 1 -- 172.21.15.71:0/583486631 shutdown_connections 2023-10-06T01:41:32.919 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:32.908+0000 7f40357f9700 1 -- 172.21.15.71:0/583486631 wait complete. 2023-10-06T01:41:32.920 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T01:41:33.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:33.033+0000 7f4eba5e1700 1 Processor -- start 2023-10-06T01:41:33.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:33.033+0000 7f4eba5e1700 1 -- start start 2023-10-06T01:41:33.038 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:33.034+0000 7f4eba5e1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4eb40af4e0 0x7f4eb40b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:33.038 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:33.034+0000 7f4eba5e1700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4eb415e190 con 0x7f4eb415db70 2023-10-06T01:41:33.038 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:33.034+0000 7f4eba5e1700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4eb40cb650 con 0x7f4eb40af8b0 2023-10-06T01:41:33.038 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:33.034+0000 7f4eba5e1700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb40b1910 con 0x7f4eb40af4e0 2023-10-06T01:41:33.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:33.034+0000 7f4eb8b7e700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f4eb415db70 0x7f4eb40cbae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:58114/0 (socket says 172.21.15.71:58114) 2023-10-06T01:41:33.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:33.034+0000 7f4eb8b7e700 1 -- 172.21.15.71:0/3813144755 learned_addr learned my addr 172.21.15.71:0/3813144755 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:41:33.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:33.035+0000 7f4eb3fff700 1 --2- 172.21.15.71:0/3813144755 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4eb40af4e0 0x7f4eb40b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:33.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:33.035+0000 7f4eb2ffd700 1 -- 172.21.15.71:0/3813144755 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3078980673 0 0) 0x7f4eb415e190 con 0x7f4eb415db70 2023-10-06T01:41:33.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:33.035+0000 7f4eb2ffd700 1 -- 172.21.15.71:0/3813144755 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e9c003570 con 0x7f4eb415db70 2023-10-06T01:41:33.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:33.035+0000 7f4eb2ffd700 1 -- 172.21.15.71:0/3813144755 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4122611461 0 0) 0x7f4e9c003570 con 0x7f4eb415db70 2023-10-06T01:41:33.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:33.035+0000 7f4eb2ffd700 1 -- 172.21.15.71:0/3813144755 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4eb40af4e0 msgr2=0x7f4eb40b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:33.039 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:33.035+0000 7f4eb2ffd700 1 --2- 172.21.15.71:0/3813144755 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4eb40af4e0 0x7f4eb40b20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:33.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:33.035+0000 7f4eb2ffd700 1 -- 172.21.15.71:0/3813144755 >> v1:172.21.15.72:6789/0 conn(0x7f4eb40af8b0 legacy=0x7f4eb415d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:33.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:33.035+0000 7f4eb2ffd700 1 -- 172.21.15.71:0/3813144755 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eb40cad20 con 0x7f4eb415db70 2023-10-06T01:41:33.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:33.035+0000 7f4eb2ffd700 1 -- 172.21.15.71:0/3813144755 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1184243524 0 0) 0x7f4eac0017f0 con 0x7f4eb415db70 2023-10-06T01:41:33.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:33.035+0000 7f4eb2ffd700 1 -- 172.21.15.71:0/3813144755 >> v1:172.21.15.71:6789/0 conn(0x7f4eb415db70 legacy=0x7f4eb40cbae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:33.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:33.035+0000 7f4eb2ffd700 1 --2- 172.21.15.71:0/3813144755 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e9c003a90 0x7f4e9c003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:33.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:33.035+0000 7f4eb2ffd700 1 --2- 172.21.15.71:0/3813144755 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e9c004810 0x7f4e9c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:33.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:33.035+0000 7f4eb2ffd700 1 --2- 172.21.15.71:0/3813144755 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4eb40af4e0 0x7f4e9c0051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:33.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:33.035+0000 7f4eb2ffd700 1 -- 172.21.15.71:0/3813144755 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb40b1910 con 0x7f4e9c004810 2023-10-06T01:41:33.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:33.035+0000 7f4eb2ffd700 1 -- 172.21.15.71:0/3813144755 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9c00bb60 con 0x7f4e9c003a90 2023-10-06T01:41:33.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:33.035+0000 7f4eb2ffd700 1 -- 172.21.15.71:0/3813144755 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9c00bd20 con 0x7f4eb40af4e0 2023-10-06T01:41:33.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:33.035+0000 7f4eb37fe700 1 --2- 172.21.15.71:0/3813144755 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e9c004810 0x7f4e9c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:33.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:33.035+0000 7f4eb3fff700 1 --2- 172.21.15.71:0/3813144755 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e9c003a90 0x7f4e9c003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:33.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:33.035+0000 7f4eb8b7e700 1 --2- 172.21.15.71:0/3813144755 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4eb40af4e0 0x7f4e9c0051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:33.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:33.035+0000 7f4eb37fe700 1 -- 172.21.15.71:0/3813144755 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4eb40af4e0 msgr2=0x7f4e9c0051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:33.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:33.035+0000 7f4eb37fe700 1 --2- 172.21.15.71:0/3813144755 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4eb40af4e0 0x7f4e9c0051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:33.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:33.035+0000 7f4eb37fe700 1 -- 172.21.15.71:0/3813144755 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e9c003a90 msgr2=0x7f4e9c003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:33.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:33.035+0000 7f4eb37fe700 1 --2- 172.21.15.71:0/3813144755 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e9c003a90 0x7f4e9c003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:33.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:33.035+0000 7f4eb37fe700 1 -- 172.21.15.71:0/3813144755 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e9c003570 con 0x7f4e9c004810 2023-10-06T01:41:33.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:33.035+0000 7f4eb8b7e700 1 --2- 172.21.15.71:0/3813144755 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4eb40af4e0 0x7f4e9c0051e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:41:33.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:33.036+0000 7f4eb37fe700 1 --2- 172.21.15.71:0/3813144755 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e9c004810 0x7f4e9c004c80 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f4ea40018b0 tx=0x7f4ea4007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62ae0df997786416 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:33.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:33.036+0000 7f4eb2ffd700 1 -- 172.21.15.71:0/3813144755 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea4012420 con 0x7f4e9c004810 2023-10-06T01:41:33.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:33.036+0000 7f4eb2ffd700 1 -- 172.21.15.71:0/3813144755 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ea4012580 con 0x7f4e9c004810 2023-10-06T01:41:33.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:33.036+0000 7f4eb2ffd700 1 -- 172.21.15.71:0/3813144755 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea4012920 con 0x7f4e9c004810 2023-10-06T01:41:33.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:33.036+0000 7f4eba5e1700 1 -- 172.21.15.71:0/3813144755 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e9c004810 msgr2=0x7f4e9c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:33.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:33.036+0000 7f4eba5e1700 1 --2- 172.21.15.71:0/3813144755 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e9c004810 0x7f4e9c004c80 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f4ea40018b0 tx=0x7f4ea4007d30 comp rx=0 tx=0).stop 2023-10-06T01:41:33.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:33.036+0000 7f4eb8b7e700 1 -- 172.21.15.71:0/3813144755 reap_dead start 2023-10-06T01:41:33.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:33.036+0000 7f4eba5e1700 1 -- 172.21.15.71:0/3813144755 shutdown_connections 2023-10-06T01:41:33.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:33.036+0000 7f4eba5e1700 1 -- 172.21.15.71:0/3813144755 >> 172.21.15.71:0/3813144755 conn(0x7f4eb4068680 msgr2=0x7f4eb4068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:33.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:33.036+0000 7f4eba5e1700 1 -- 172.21.15.71:0/3813144755 shutdown_connections 2023-10-06T01:41:33.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:33.036+0000 7f4eba5e1700 1 -- 172.21.15.71:0/3813144755 wait complete. 2023-10-06T01:41:33.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:33.037+0000 7f4eba5e1700 1 Processor -- start 2023-10-06T01:41:33.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:33.037+0000 7f4eba5e1700 1 -- start start 2023-10-06T01:41:33.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:33.038+0000 7f4eba5e1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4e9c004810 0x7f4eb40d0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:33.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:33.038+0000 7f4eba5e1700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4eb4152d20 0x7f4eb4153190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:33.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:33.038+0000 7f4eba5e1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4eb40c8820 0x7f4eb40c8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:33.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:33.038+0000 7f4eba5e1700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb415dfb0 con 0x7f4eb4152d20 2023-10-06T01:41:33.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:33.038+0000 7f4eba5e1700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb4153890 con 0x7f4eb40c8820 2023-10-06T01:41:33.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:33.038+0000 7f4eba5e1700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb40cdf20 con 0x7f4e9c004810 2023-10-06T01:41:33.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:33.038+0000 7f4eb37fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4eb4152d20 0x7f4eb4153190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:33.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:33.038+0000 7f4eb37fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4eb4152d20 0x7f4eb4153190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37834/0 (socket says 172.21.15.71:37834) 2023-10-06T01:41:33.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:33.038+0000 7f4eb37fe700 1 -- 172.21.15.71:0/3959951697 learned_addr learned my addr 172.21.15.71:0/3959951697 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:33.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:33.038+0000 7f4eb3fff700 1 --2- 172.21.15.71:0/3959951697 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4e9c004810 0x7f4eb40d0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:33.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:33.039+0000 7f4eb8b7e700 1 --2- 172.21.15.71:0/3959951697 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4eb40c8820 0x7f4eb40c8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:33.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:33.039+0000 7f4eb37fe700 1 -- 172.21.15.71:0/3959951697 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4e9c004810 msgr2=0x7f4eb40d0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:33.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:33.039+0000 7f4eb37fe700 1 --2- 172.21.15.71:0/3959951697 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4e9c004810 0x7f4eb40d0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:33.047 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:33.039+0000 7f4eb37fe700 1 -- 172.21.15.71:0/3959951697 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4eb40c8820 msgr2=0x7f4eb40c8c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:33.047 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:33.039+0000 7f4eb37fe700 1 --2- 172.21.15.71:0/3959951697 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4eb40c8820 0x7f4eb40c8c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:33.047 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:33.039+0000 7f4eb37fe700 1 -- 172.21.15.71:0/3959951697 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eb40c91d0 con 0x7f4eb4152d20 2023-10-06T01:41:33.047 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:33.039+0000 7f4eb8b7e700 1 --2- 172.21.15.71:0/3959951697 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4eb40c8820 0x7f4eb40c8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:41:33.047 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:33.039+0000 7f4eb37fe700 1 --2- 172.21.15.71:0/3959951697 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4eb4152d20 0x7f4eb4153190 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f4ea400c3f0 tx=0x7f4ea4015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:33.047 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:33.039+0000 7f4e9bfff700 1 -- 172.21.15.71:0/3959951697 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea4001200 con 0x7f4eb4152d20 2023-10-06T01:41:33.047 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:33.039+0000 7f4e9bfff700 1 -- 172.21.15.71:0/3959951697 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ea4012c90 con 0x7f4eb4152d20 2023-10-06T01:41:33.047 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:33.039+0000 7f4e9bfff700 1 -- 172.21.15.71:0/3959951697 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea4012920 con 0x7f4eb4152d20 2023-10-06T01:41:33.047 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:33.039+0000 7f4eba5e1700 1 -- 172.21.15.71:0/3959951697 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4eb40cea60 con 0x7f4eb4152d20 2023-10-06T01:41:33.047 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:33.039+0000 7f4eba5e1700 1 -- 172.21.15.71:0/3959951697 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4eb4158760 con 0x7f4eb4152d20 2023-10-06T01:41:33.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:33.040+0000 7f4eba5e1700 1 -- 172.21.15.71:0/3959951697 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4eb40cebf0 con 0x7f4eb4152d20 2023-10-06T01:41:33.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:33.040+0000 7f4e9bfff700 1 -- 172.21.15.71:0/3959951697 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4ea4006a30 con 0x7f4eb4152d20 2023-10-06T01:41:33.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:33.040+0000 7f4e9bfff700 1 --2- 172.21.15.71:0/3959951697 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f4ea0066f30 0x7f4ea00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:33.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:33.041+0000 7f4e9bfff700 1 -- 172.21.15.71:0/3959951697 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f4ea4086270 con 0x7f4eb4152d20 2023-10-06T01:41:33.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:33.041+0000 7f4eb3fff700 1 --2- 172.21.15.71:0/3959951697 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f4ea0066f30 0x7f4ea00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:33.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:33.041+0000 7f4eb3fff700 1 --2- 172.21.15.71:0/3959951697 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f4ea0066f30 0x7f4ea00693e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f4ea8006f00 tx=0x7f4ea8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:33.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:33.045+0000 7f4e9bfff700 1 -- 172.21.15.71:0/3959951697 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4ea4053240 con 0x7f4eb4152d20 2023-10-06T01:41:33.277 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:33.276+0000 7f4eba5e1700 1 -- 172.21.15.71:0/3959951697 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4eb40cb000 con 0x7f4eb4152d20 2023-10-06T01:41:33.277 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:33.277+0000 7f4e9bfff700 1 -- 172.21.15.71:0/3959951697 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) v1 ==== 53+0+73 (secure 0 0 0) 0x7f4ea4056860 con 0x7f4eb4152d20 2023-10-06T01:41:33.277 INFO:teuthology.orchestra.run.smithi071.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T01:41:33.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:33.278+0000 7f4eba5e1700 1 -- 172.21.15.71:0/3959951697 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f4ea0066f30 msgr2=0x7f4ea00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:33.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:33.278+0000 7f4eba5e1700 1 --2- 172.21.15.71:0/3959951697 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f4ea0066f30 0x7f4ea00693e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f4ea8006f00 tx=0x7f4ea8008040 comp rx=0 tx=0).stop 2023-10-06T01:41:33.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:33.278+0000 7f4eba5e1700 1 -- 172.21.15.71:0/3959951697 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4eb4152d20 msgr2=0x7f4eb4153190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:33.280 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:33.278+0000 7f4eba5e1700 1 --2- 172.21.15.71:0/3959951697 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4eb4152d20 0x7f4eb4153190 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f4ea400c3f0 tx=0x7f4ea4015000 comp rx=0 tx=0).stop 2023-10-06T01:41:33.280 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:33.278+0000 7f4eba5e1700 1 -- 172.21.15.71:0/3959951697 shutdown_connections 2023-10-06T01:41:33.280 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:33.278+0000 7f4eba5e1700 1 --2- 172.21.15.71:0/3959951697 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f4ea0066f30 0x7f4ea00693e0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:33.280 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:33.278+0000 7f4eba5e1700 1 --2- 172.21.15.71:0/3959951697 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4eb40c8820 0x7f4eb40c8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:33.280 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:33.278+0000 7f4eba5e1700 1 --2- 172.21.15.71:0/3959951697 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4e9c004810 0x7f4eb40d0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:33.280 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:33.278+0000 7f4eba5e1700 1 --2- 172.21.15.71:0/3959951697 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4eb4152d20 0x7f4eb4153190 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:33.280 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:33.278+0000 7f4eba5e1700 1 -- 172.21.15.71:0/3959951697 >> 172.21.15.71:0/3959951697 conn(0x7f4eb4068680 msgr2=0x7f4eb40b20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:33.280 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:33.279+0000 7f4eba5e1700 1 -- 172.21.15.71:0/3959951697 shutdown_connections 2023-10-06T01:41:33.280 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:33.279+0000 7f4eba5e1700 1 -- 172.21.15.71:0/3959951697 wait complete. 2023-10-06T01:41:33.291 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T01:41:33.291 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T01:41:33.291 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi071.front.sepia.ceph.com 2023-10-06T01:41:33.292 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T01:41:33.292 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T01:41:33.292 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T01:41:33.292 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T01:41:33.292 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T01:41:33.292 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T01:41:33.292 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:41:33.292 DEBUG:teuthology.orchestra.run.smithi071:> ip addr 2023-10-06T01:41:33.307 INFO:teuthology.orchestra.run.smithi071.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T01:41:33.307 INFO:teuthology.orchestra.run.smithi071.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T01:41:33.308 INFO:teuthology.orchestra.run.smithi071.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T01:41:33.308 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:41:33.308 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 ::1/128 scope host 2023-10-06T01:41:33.308 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:41:33.308 INFO:teuthology.orchestra.run.smithi071.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T01:41:33.308 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:d8:aa:4a brd ff:ff:ff:ff:ff:ff 2023-10-06T01:41:33.308 INFO:teuthology.orchestra.run.smithi071.stdout: altname enp7s0f0 2023-10-06T01:41:33.308 INFO:teuthology.orchestra.run.smithi071.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T01:41:33.308 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:d8:aa:4b brd ff:ff:ff:ff:ff:ff 2023-10-06T01:41:33.309 INFO:teuthology.orchestra.run.smithi071.stdout: altname enp7s0f1 2023-10-06T01:41:33.309 INFO:teuthology.orchestra.run.smithi071.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T01:41:33.309 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:8f:d7:64 brd ff:ff:ff:ff:ff:ff 2023-10-06T01:41:33.309 INFO:teuthology.orchestra.run.smithi071.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T01:41:33.309 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:8f:d7:65 brd ff:ff:ff:ff:ff:ff 2023-10-06T01:41:33.309 INFO:teuthology.orchestra.run.smithi071.stdout: inet 172.21.15.71/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T01:41:33.309 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft 42282sec preferred_lft 42282sec 2023-10-06T01:41:33.309 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::ec4:7aff:fe8f:d765/64 scope link 2023-10-06T01:41:33.310 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:41:33.310 INFO:teuthology.orchestra.run.smithi071.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T01:41:33.310 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 26:9a:64:34:3b:3a brd ff:ff:ff:ff:ff:ff 2023-10-06T01:41:33.310 INFO:teuthology.orchestra.run.smithi071.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T01:41:33.310 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:41:33.310 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::44c7:acff:febb:6c0/64 scope link 2023-10-06T01:41:33.310 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:41:33.310 INFO:teuthology.orchestra.run.smithi071.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T01:41:33.311 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 26:9a:64:34:3b:3a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T01:41:33.311 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::249a:64ff:fe34:3b3a/64 scope link 2023-10-06T01:41:33.311 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:41:33.311 INFO:teuthology.orchestra.run.smithi071.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T01:41:33.311 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 8a:01:60:14:cf:f7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T01:41:33.311 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::8801:60ff:fe14:cff7/64 scope link 2023-10-06T01:41:33.311 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:41:33.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:41:33.312 DEBUG:teuthology.orchestra.run.smithi071:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T01:41:33.370 INFO:teuthology.orchestra.run.smithi071.stdout:1 2023-10-06T01:41:33.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:41:33.371 DEBUG:teuthology.orchestra.run.smithi071:> route 2023-10-06T01:41:33.428 INFO:teuthology.orchestra.run.smithi071.stdout:Kernel IP routing table 2023-10-06T01:41:33.428 INFO:teuthology.orchestra.run.smithi071.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T01:41:33.428 INFO:teuthology.orchestra.run.smithi071.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T01:41:33.428 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T01:41:33.428 INFO:teuthology.orchestra.run.smithi071.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T01:41:33.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:41:33.429 DEBUG:teuthology.orchestra.run.smithi071:> (cd / && exec bash -c ' 2023-10-06T01:41:33.429 DEBUG:teuthology.orchestra.run.smithi071:> set -e 2023-10-06T01:41:33.429 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T01:41:33.429 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T01:41:33.429 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T01:41:33.429 DEBUG:teuthology.orchestra.run.smithi071:> ') 2023-10-06T01:41:33.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:41:33.528 DEBUG:teuthology.orchestra.run.smithi071:> ip netns list 2023-10-06T01:41:33.542 INFO:teuthology.orchestra.run.smithi071.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T01:41:33.542 INFO:teuthology.orchestra.run.smithi071.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T01:41:33.542 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T01:41:33.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:41:33.543 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link set brx.0 up 2023-10-06T01:41:33.607 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-06T01:41:33.607 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T01:41:33.607 DEBUG:teuthology.orchestra.run.smithi071:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T01:41:33.661 INFO:teuthology.orchestra.run.smithi071.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T01:41:33.661 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T01:41:33.661 DEBUG:teuthology.orchestra.run.smithi071:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T01:41:33.715 DEBUG:teuthology.orchestra.run.smithi071:> sudo modprobe fuse 2023-10-06T01:41:33.779 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T01:41:33.780 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T01:41:33.843 INFO:teuthology.orchestra.run.smithi071.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T01:41:33.844 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T01:41:33.844 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T01:41:33.844 DEBUG:teuthology.orchestra.run.smithi071:> ls /sys/fs/fuse/connections 2023-10-06T01:41:33.899 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T01:41:33.899 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-06T01:41:33.942 DEBUG:teuthology.orchestra.run.smithi071:> sudo modprobe fuse 2023-10-06T01:41:33.966 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T01:41:33.966 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T01:41:34.023 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi071.stderr:2023-10-06T01:41:34.023+0000 7f7d57552540 -1 init, newargv = 0x5555abbb2fb0 newargc=15 2023-10-06T01:41:34.023 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi071.stderr:ceph-fuse[105335]: starting ceph client 2023-10-06T01:41:34.028 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi071.stderr:ceph-fuse[105335]: starting fuse 2023-10-06T01:41:34.031 INFO:teuthology.orchestra.run.smithi071.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T01:41:34.033 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T01:41:34.033 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T01:41:34.033 DEBUG:teuthology.orchestra.run.smithi071:> ls /sys/fs/fuse/connections 2023-10-06T01:41:34.088 INFO:teuthology.orchestra.run.smithi071.stdout:46 2023-10-06T01:41:34.088 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-10-06T01:41:34.088 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T01:41:34.088 DEBUG:teuthology.orchestra.run.smithi071:> import glob 2023-10-06T01:41:34.088 DEBUG:teuthology.orchestra.run.smithi071:> import re 2023-10-06T01:41:34.089 DEBUG:teuthology.orchestra.run.smithi071:> import os 2023-10-06T01:41:34.089 DEBUG:teuthology.orchestra.run.smithi071:> import subprocess 2023-10-06T01:41:34.089 DEBUG:teuthology.orchestra.run.smithi071:> 2023-10-06T01:41:34.089 DEBUG:teuthology.orchestra.run.smithi071:> def _find_admin_socket(client_name): 2023-10-06T01:41:34.089 DEBUG:teuthology.orchestra.run.smithi071:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-06T01:41:34.089 DEBUG:teuthology.orchestra.run.smithi071:> files = glob.glob(asok_path) 2023-10-06T01:41:34.089 DEBUG:teuthology.orchestra.run.smithi071:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-06T01:41:34.089 DEBUG:teuthology.orchestra.run.smithi071:> 2023-10-06T01:41:34.089 DEBUG:teuthology.orchestra.run.smithi071:> # Given a non-glob path, it better be there 2023-10-06T01:41:34.089 DEBUG:teuthology.orchestra.run.smithi071:> if "*" not in asok_path: 2023-10-06T01:41:34.090 DEBUG:teuthology.orchestra.run.smithi071:> assert(len(files) == 1) 2023-10-06T01:41:34.090 DEBUG:teuthology.orchestra.run.smithi071:> return files[0] 2023-10-06T01:41:34.090 DEBUG:teuthology.orchestra.run.smithi071:> 2023-10-06T01:41:34.090 DEBUG:teuthology.orchestra.run.smithi071:> for f in files: 2023-10-06T01:41:34.090 DEBUG:teuthology.orchestra.run.smithi071:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T01:41:34.090 DEBUG:teuthology.orchestra.run.smithi071:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T01:41:34.090 DEBUG:teuthology.orchestra.run.smithi071:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T01:41:34.090 DEBUG:teuthology.orchestra.run.smithi071:> contents = proc_f.read() 2023-10-06T01:41:34.090 DEBUG:teuthology.orchestra.run.smithi071:> if mountpoint in contents: 2023-10-06T01:41:34.090 DEBUG:teuthology.orchestra.run.smithi071:> return f 2023-10-06T01:41:34.091 DEBUG:teuthology.orchestra.run.smithi071:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T01:41:34.091 DEBUG:teuthology.orchestra.run.smithi071:> 2023-10-06T01:41:34.091 DEBUG:teuthology.orchestra.run.smithi071:> print(_find_admin_socket("client.0")) 2023-10-06T01:41:34.091 DEBUG:teuthology.orchestra.run.smithi071:> ' 2023-10-06T01:41:34.208 INFO:teuthology.orchestra.run.smithi071.stdout:/var/run/ceph/ceph-client.0.105335.asok 2023-10-06T01:41:34.391 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.105335.asok 2023-10-06T01:41:34.391 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T01:41:34.391 DEBUG:teuthology.orchestra.run.smithi071:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.105335.asok status 2023-10-06T01:41:34.540 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2023-10-06T01:41:34.540 INFO:teuthology.orchestra.run.smithi071.stdout: "metadata": { 2023-10-06T01:41:34.541 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_sha1": "736ac5ba72cb47af7d6f6666b1e100f7e20a20e2", 2023-10-06T01:41:34.541 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_version": "ceph version 17.2.6-1296-g736ac5ba (736ac5ba72cb47af7d6f6666b1e100f7e20a20e2) quincy (stable)", 2023-10-06T01:41:34.541 INFO:teuthology.orchestra.run.smithi071.stdout: "entity_id": "0", 2023-10-06T01:41:34.541 INFO:teuthology.orchestra.run.smithi071.stdout: "hostname": "smithi071", 2023-10-06T01:41:34.541 INFO:teuthology.orchestra.run.smithi071.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-06T01:41:34.541 INFO:teuthology.orchestra.run.smithi071.stdout: "pid": "105335", 2023-10-06T01:41:34.541 INFO:teuthology.orchestra.run.smithi071.stdout: "root": "/" 2023-10-06T01:41:34.541 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-06T01:41:34.541 INFO:teuthology.orchestra.run.smithi071.stdout: "dentry_count": 0, 2023-10-06T01:41:34.541 INFO:teuthology.orchestra.run.smithi071.stdout: "dentry_pinned_count": 0, 2023-10-06T01:41:34.541 INFO:teuthology.orchestra.run.smithi071.stdout: "id": 5337, 2023-10-06T01:41:34.542 INFO:teuthology.orchestra.run.smithi071.stdout: "inst": { 2023-10-06T01:41:34.542 INFO:teuthology.orchestra.run.smithi071.stdout: "name": { 2023-10-06T01:41:34.542 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "client", 2023-10-06T01:41:34.542 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 5337 2023-10-06T01:41:34.542 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-06T01:41:34.542 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": { 2023-10-06T01:41:34.542 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2023-10-06T01:41:34.542 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "192.168.0.1:0", 2023-10-06T01:41:34.542 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 3741087564 2023-10-06T01:41:34.542 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-06T01:41:34.542 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-06T01:41:34.543 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": { 2023-10-06T01:41:34.543 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2023-10-06T01:41:34.543 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "192.168.0.1:0", 2023-10-06T01:41:34.543 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 3741087564 2023-10-06T01:41:34.543 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-06T01:41:34.543 INFO:teuthology.orchestra.run.smithi071.stdout: "inst_str": "client.5337 192.168.0.1:0/3741087564", 2023-10-06T01:41:34.543 INFO:teuthology.orchestra.run.smithi071.stdout: "addr_str": "192.168.0.1:0/3741087564", 2023-10-06T01:41:34.543 INFO:teuthology.orchestra.run.smithi071.stdout: "inode_count": 1, 2023-10-06T01:41:34.543 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_epoch": 18, 2023-10-06T01:41:34.543 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_epoch": 41, 2023-10-06T01:41:34.543 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_epoch_barrier": 0, 2023-10-06T01:41:34.543 INFO:teuthology.orchestra.run.smithi071.stdout: "blocklisted": false, 2023-10-06T01:41:34.543 INFO:teuthology.orchestra.run.smithi071.stdout: "fs_name": "cephfs" 2023-10-06T01:41:34.544 INFO:teuthology.orchestra.run.smithi071.stdout:} 2023-10-06T01:41:34.550 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T01:41:34.550 DEBUG:teuthology.orchestra.run.smithi071:> stat --file-system '--printf=%T 2023-10-06T01:41:34.551 DEBUG:teuthology.orchestra.run.smithi071:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-06T01:41:34.566 INFO:teuthology.orchestra.run.smithi071.stdout:fuseblk 2023-10-06T01:41:34.566 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-06T01:41:34.566 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T01:41:34.566 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T01:41:34.632 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T01:41:34.632 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir testdir1) 2023-10-06T01:41:34.693 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T01:41:34.694 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch testdir1/testfile) 2023-10-06T01:41:34.752 DEBUG:teuthology.orchestra.run.smithi071:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T01:41:34.752 DEBUG:teuthology.orchestra.run.smithi071:> import os 2023-10-06T01:41:34.752 DEBUG:teuthology.orchestra.run.smithi071:> import stat 2023-10-06T01:41:34.752 DEBUG:teuthology.orchestra.run.smithi071:> 2023-10-06T01:41:34.753 DEBUG:teuthology.orchestra.run.smithi071:> print(os.stat("/home/ubuntu/cephtest/mnt.0/testdir1").st_ino) 2023-10-06T01:41:34.753 DEBUG:teuthology.orchestra.run.smithi071:> ' 2023-10-06T01:41:34.857 INFO:teuthology.orchestra.run.smithi071.stdout:1099511627776 2023-10-06T01:41:35.045 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi071.front.sepia.ceph.com... 2023-10-06T01:41:35.046 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T01:41:35.046 DEBUG:teuthology.orchestra.run.smithi071:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-06T01:41:35.134 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi071.stderr:ceph-fuse[105335]: fuse finished with error 0 and tester_r 0 2023-10-06T01:41:35.134 INFO:teuthology.orchestra.run:waiting for 900 2023-10-06T01:41:35.215 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi071.front.sepia.ceph.com 2023-10-06T01:41:35.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:41:35.215 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T01:41:35.229 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T01:41:35.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.384+0000 7fad0d873700 1 Processor -- start 2023-10-06T01:41:35.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.384+0000 7fad0d873700 1 -- start start 2023-10-06T01:41:35.387 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.384+0000 7fad0d873700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fad080af4e0 0x7fad080b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:35.387 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.385+0000 7fad0d873700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fad0815db70 0x7fad080b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:35.387 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.385+0000 7fad0d873700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad0815e190 con 0x7fad080af8b0 2023-10-06T01:41:35.387 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.385+0000 7fad0d873700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad080b1910 con 0x7fad0815db70 2023-10-06T01:41:35.387 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.385+0000 7fad0d873700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad0815dfb0 con 0x7fad080af4e0 2023-10-06T01:41:35.387 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.385+0000 7fad077fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fad0815db70 0x7fad080b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:35.387 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.385+0000 7fad06ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fad080af4e0 0x7fad080b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:35.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.385+0000 7fad077fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fad0815db70 0x7fad080b2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:38940/0 (socket says 172.21.15.71:38940) 2023-10-06T01:41:35.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.385+0000 7fad06ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fad080af4e0 0x7fad080b20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.71:49144/0 (socket says 172.21.15.71:49144) 2023-10-06T01:41:35.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.385+0000 7fad077fe700 1 -- 172.21.15.71:0/426898593 learned_addr learned my addr 172.21.15.71:0/426898593 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:35.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.385+0000 7fad06ffd700 1 -- 172.21.15.71:0/426898593 >> v2:172.21.15.72:3300/0 conn(0x7fad0815db70 msgr2=0x7fad080b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:35.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.385+0000 7fad06ffd700 1 --2- 172.21.15.71:0/426898593 >> v2:172.21.15.72:3300/0 conn(0x7fad0815db70 0x7fad080b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:35.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.385+0000 7fad06ffd700 1 -- 172.21.15.71:0/426898593 >> v1:172.21.15.72:6789/0 conn(0x7fad080af8b0 legacy=0x7fad0815d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:35.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.385+0000 7fad06ffd700 1 -- 172.21.15.71:0/426898593 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad080cb650 con 0x7fad080af4e0 2023-10-06T01:41:35.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.385+0000 7fad077fe700 1 --2- 172.21.15.71:0/426898593 >> v2:172.21.15.72:3300/0 conn(0x7fad0815db70 0x7fad080b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:41:35.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.386+0000 7fad06ffd700 1 --2- 172.21.15.71:0/426898593 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fad080af4e0 0x7fad080b20e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7facf80098e0 tx=0x7facf80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c52ffea88f554c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:35.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.386+0000 7fad067fc700 1 -- 172.21.15.71:0/426898593 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf800b640 con 0x7fad080af4e0 2023-10-06T01:41:35.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.386+0000 7fad067fc700 1 -- 172.21.15.71:0/426898593 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facf800b7a0 con 0x7fad080af4e0 2023-10-06T01:41:35.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.386+0000 7fad067fc700 1 -- 172.21.15.71:0/426898593 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf800bb40 con 0x7fad080af4e0 2023-10-06T01:41:35.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.386+0000 7fad0d873700 1 -- 172.21.15.71:0/426898593 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fad080af4e0 msgr2=0x7fad080b20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:35.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.386+0000 7fad0d873700 1 --2- 172.21.15.71:0/426898593 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fad080af4e0 0x7fad080b20e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7facf80098e0 tx=0x7facf80091a0 comp rx=0 tx=0).stop 2023-10-06T01:41:35.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.386+0000 7fad0d873700 1 -- 172.21.15.71:0/426898593 shutdown_connections 2023-10-06T01:41:35.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.386+0000 7fad0d873700 1 --2- 172.21.15.71:0/426898593 >> v2:172.21.15.72:3300/0 conn(0x7fad0815db70 0x7fad080b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:35.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.386+0000 7fad0d873700 1 --2- 172.21.15.71:0/426898593 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fad080af4e0 0x7fad080b20e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:35.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.386+0000 7fad0d873700 1 -- 172.21.15.71:0/426898593 >> 172.21.15.71:0/426898593 conn(0x7fad08068680 msgr2=0x7fad08068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:35.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.386+0000 7fad0d873700 1 -- 172.21.15.71:0/426898593 shutdown_connections 2023-10-06T01:41:35.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.386+0000 7fad0d873700 1 -- 172.21.15.71:0/426898593 wait complete. 2023-10-06T01:41:35.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.387+0000 7fad0d873700 1 Processor -- start 2023-10-06T01:41:35.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.387+0000 7fad0d873700 1 -- start start 2023-10-06T01:41:35.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.388+0000 7fad0d873700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad080af4e0 0x7fad080cde20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:35.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.388+0000 7fad0d873700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fad080af8b0 0x7fad080ce360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:35.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.388+0000 7fad0d873700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fad0815db70 0x7fad080b4a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:35.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.388+0000 7fad0d873700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad0816e800 con 0x7fad0815db70 2023-10-06T01:41:35.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.388+0000 7fad0d873700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad080b4570 con 0x7fad080af4e0 2023-10-06T01:41:35.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.388+0000 7fad0d873700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad0816e520 con 0x7fad080af8b0 2023-10-06T01:41:35.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.388+0000 7fad077fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fad0815db70 0x7fad080b4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:35.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.388+0000 7fad077fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fad0815db70 0x7fad080b4a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37840/0 (socket says 172.21.15.71:37840) 2023-10-06T01:41:35.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.388+0000 7fad077fe700 1 -- 172.21.15.71:0/279913218 learned_addr learned my addr 172.21.15.71:0/279913218 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:35.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.389+0000 7fad06ffd700 1 --2- 172.21.15.71:0/279913218 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad080af4e0 0x7fad080cde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:35.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.389+0000 7facfffff700 1 --2- 172.21.15.71:0/279913218 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fad080af8b0 0x7fad080ce360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:35.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.389+0000 7fad077fe700 1 -- 172.21.15.71:0/279913218 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fad080af8b0 msgr2=0x7fad080ce360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:35.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.389+0000 7fad077fe700 1 --2- 172.21.15.71:0/279913218 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fad080af8b0 0x7fad080ce360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:35.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.389+0000 7fad077fe700 1 -- 172.21.15.71:0/279913218 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad080af4e0 msgr2=0x7fad080cde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:35.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.389+0000 7fad077fe700 1 --2- 172.21.15.71:0/279913218 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad080af4e0 0x7fad080cde20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:35.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.389+0000 7fad077fe700 1 -- 172.21.15.71:0/279913218 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad00009ae0 con 0x7fad0815db70 2023-10-06T01:41:35.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.389+0000 7facfffff700 1 --2- 172.21.15.71:0/279913218 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fad080af8b0 0x7fad080ce360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:41:35.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.389+0000 7fad06ffd700 1 --2- 172.21.15.71:0/279913218 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad080af4e0 0x7fad080cde20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:41:35.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.389+0000 7fad077fe700 1 --2- 172.21.15.71:0/279913218 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fad0815db70 0x7fad080b4a00 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fad00009fd0 tx=0x7fad0000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:35.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.389+0000 7facfeffd700 1 -- 172.21.15.71:0/279913218 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad00018070 con 0x7fad0815db70 2023-10-06T01:41:35.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.389+0000 7facfeffd700 1 -- 172.21.15.71:0/279913218 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad0000f040 con 0x7fad0815db70 2023-10-06T01:41:35.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.389+0000 7fad0d873700 1 -- 172.21.15.71:0/279913218 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facf8009420 con 0x7fad0815db70 2023-10-06T01:41:35.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.389+0000 7facfeffd700 1 -- 172.21.15.71:0/279913218 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad0000cd50 con 0x7fad0815db70 2023-10-06T01:41:35.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.389+0000 7fad0d873700 1 -- 172.21.15.71:0/279913218 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad080b4200 con 0x7fad0815db70 2023-10-06T01:41:35.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.390+0000 7fad0d873700 1 -- 172.21.15.71:0/279913218 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad080b22b0 con 0x7fad0815db70 2023-10-06T01:41:35.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.390+0000 7facfeffd700 1 -- 172.21.15.71:0/279913218 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fad00003020 con 0x7fad0815db70 2023-10-06T01:41:35.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.391+0000 7facfeffd700 1 --2- 172.21.15.71:0/279913218 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7face8066f30 0x7face80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:35.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.391+0000 7facfeffd700 1 -- 172.21.15.71:0/279913218 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fad00084730 con 0x7fad0815db70 2023-10-06T01:41:35.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.391+0000 7fad06ffd700 1 --2- 172.21.15.71:0/279913218 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7face8066f30 0x7face80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:35.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.391+0000 7fad06ffd700 1 --2- 172.21.15.71:0/279913218 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7face8066f30 0x7face80693e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7facf8003080 tx=0x7facf8017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:35.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.395+0000 7facfeffd700 1 -- 172.21.15.71:0/279913218 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fad0004d5a0 con 0x7fad0815db70 2023-10-06T01:41:35.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.623+0000 7fad0d873700 1 -- 172.21.15.71:0/279913218 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fad080b2a50 con 0x7fad0815db70 2023-10-06T01:41:35.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.624+0000 7facfeffd700 1 -- 172.21.15.71:0/279913218 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4597 (secure 0 0 0) 0x7fad00051700 con 0x7fad0815db70 2023-10-06T01:41:35.625 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:41:35.625 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5020,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/2765166441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6833","nonce":2765166441},{"type":"v1","addr":"172.21.15.72:6835","nonce":2765166441}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5145,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6836/1993673980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":1993673980},{"type":"v1","addr":"172.21.15.71:6836","nonce":1993673980}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5148,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/3598886363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6835","nonce":3598886363},{"type":"v1","addr":"172.21.15.71:6837","nonce":3598886363}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T01:41:26.474510+0000","modified":"2023-10-06T01:41:30.131784+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5157},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5157":{"gid":5157,"name":"d","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6834/2476889061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":2476889061},{"type":"v1","addr":"172.21.15.72:6834","nonce":2476889061}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T01:41:35.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.626+0000 7fad0d873700 1 -- 172.21.15.71:0/279913218 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7face8066f30 msgr2=0x7face80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:35.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.626+0000 7fad0d873700 1 --2- 172.21.15.71:0/279913218 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7face8066f30 0x7face80693e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7facf8003080 tx=0x7facf8017000 comp rx=0 tx=0).stop 2023-10-06T01:41:35.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.626+0000 7fad0d873700 1 -- 172.21.15.71:0/279913218 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fad0815db70 msgr2=0x7fad080b4a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:35.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.626+0000 7fad0d873700 1 --2- 172.21.15.71:0/279913218 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fad0815db70 0x7fad080b4a00 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fad00009fd0 tx=0x7fad0000b040 comp rx=0 tx=0).stop 2023-10-06T01:41:35.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.626+0000 7fad0d873700 1 -- 172.21.15.71:0/279913218 shutdown_connections 2023-10-06T01:41:35.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.626+0000 7fad0d873700 1 --2- 172.21.15.71:0/279913218 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fad0815db70 0x7fad080b4a00 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:35.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.626+0000 7fad0d873700 1 --2- 172.21.15.71:0/279913218 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7face8066f30 0x7face80693e0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:35.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.626+0000 7fad0d873700 1 --2- 172.21.15.71:0/279913218 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad080af4e0 0x7fad080cde20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:35.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.626+0000 7fad0d873700 1 --2- 172.21.15.71:0/279913218 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fad080af8b0 0x7fad080ce360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:35.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.626+0000 7fad0d873700 1 -- 172.21.15.71:0/279913218 >> 172.21.15.71:0/279913218 conn(0x7fad08068680 msgr2=0x7fad080ced60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:35.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.626+0000 7fad0d873700 1 -- 172.21.15.71:0/279913218 shutdown_connections 2023-10-06T01:41:35.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.626+0000 7fad0d873700 1 -- 172.21.15.71:0/279913218 wait complete. 2023-10-06T01:41:35.628 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 18 2023-10-06T01:41:35.639 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json flush journal 2023-10-06T01:41:35.789 INFO:teuthology.orchestra.run.smithi072.stdout:{"message":"","return_code":0} 2023-10-06T01:41:35.790 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2023-10-06T01:41:35.790 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail 2:0 2023-10-06T01:41:35.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.903+0000 7fd3cbfab700 1 Processor -- start 2023-10-06T01:41:35.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.903+0000 7fd3cbfab700 1 -- start start 2023-10-06T01:41:35.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.904+0000 7fd3cbfab700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd3c415a030 0x7fd3c415a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:35.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.904+0000 7fd3cbfab700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd3c415a940 0x7fd3c4086ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:35.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.904+0000 7fd3cbfab700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3c40afc50 con 0x7fd3c4087530 2023-10-06T01:41:35.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.904+0000 7fd3cbfab700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3c40879d0 con 0x7fd3c415a030 2023-10-06T01:41:35.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.904+0000 7fd3cbfab700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3c40b0cf0 con 0x7fd3c415a940 2023-10-06T01:41:35.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.904+0000 7fd3c9d47700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd3c415a030 0x7fd3c415a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:35.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.904+0000 7fd3ca548700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fd3c4087530 0x7fd3c40b21b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:58126/0 (socket says 172.21.15.71:58126) 2023-10-06T01:41:35.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.904+0000 7fd3ca548700 1 -- 172.21.15.71:0/1877832160 learned_addr learned my addr 172.21.15.71:0/1877832160 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:41:35.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.904+0000 7fd3c9546700 1 --2- 172.21.15.71:0/1877832160 >> v2:172.21.15.72:3300/0 conn(0x7fd3c415a940 0x7fd3c4086ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:35.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.905+0000 7fd3c9d47700 1 -- 172.21.15.71:0/1877832160 >> v2:172.21.15.72:3300/0 conn(0x7fd3c415a940 msgr2=0x7fd3c4086ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:35.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.905+0000 7fd3c9d47700 1 --2- 172.21.15.71:0/1877832160 >> v2:172.21.15.72:3300/0 conn(0x7fd3c415a940 0x7fd3c4086ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:35.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.905+0000 7fd3c9d47700 1 -- 172.21.15.71:0/1877832160 >> v1:172.21.15.71:6789/0 conn(0x7fd3c4087530 legacy=0x7fd3c40b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:35.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.905+0000 7fd3c9d47700 1 -- 172.21.15.71:0/1877832160 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3c40aff30 con 0x7fd3c415a030 2023-10-06T01:41:35.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.905+0000 7fd3c8d45700 1 -- 172.21.15.71:0/1877832160 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3491152344 0 0) 0x7fd3c40afc50 con 0x7fd3c4087530 2023-10-06T01:41:35.907 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.905+0000 7fd3c9d47700 1 --2- 172.21.15.71:0/1877832160 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd3c415a030 0x7fd3c415a400 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fd3c4157800 tx=0x7fd3c00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7419e460cf5b6660 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:35.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.905+0000 7fd3c8d45700 1 -- 172.21.15.71:0/1877832160 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c0009e80 con 0x7fd3c415a030 2023-10-06T01:41:35.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.905+0000 7fd3c8d45700 1 -- 172.21.15.71:0/1877832160 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3c000b820 con 0x7fd3c415a030 2023-10-06T01:41:35.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.905+0000 7fd3c8d45700 1 -- 172.21.15.71:0/1877832160 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c000bba0 con 0x7fd3c415a030 2023-10-06T01:41:35.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.905+0000 7fd3cbfab700 1 -- 172.21.15.71:0/1877832160 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd3c415a030 msgr2=0x7fd3c415a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:35.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.905+0000 7fd3cbfab700 1 --2- 172.21.15.71:0/1877832160 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd3c415a030 0x7fd3c415a400 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fd3c4157800 tx=0x7fd3c00091a0 comp rx=0 tx=0).stop 2023-10-06T01:41:35.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.905+0000 7fd3cbfab700 1 -- 172.21.15.71:0/1877832160 shutdown_connections 2023-10-06T01:41:35.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.905+0000 7fd3cbfab700 1 --2- 172.21.15.71:0/1877832160 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd3c415a030 0x7fd3c415a400 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:35.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.905+0000 7fd3cbfab700 1 --2- 172.21.15.71:0/1877832160 >> v2:172.21.15.72:3300/0 conn(0x7fd3c415a940 0x7fd3c4086ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:35.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.905+0000 7fd3cbfab700 1 -- 172.21.15.71:0/1877832160 >> 172.21.15.71:0/1877832160 conn(0x7fd3c4068680 msgr2=0x7fd3c4068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:35.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.905+0000 7fd3cbfab700 1 -- 172.21.15.71:0/1877832160 shutdown_connections 2023-10-06T01:41:35.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.905+0000 7fd3cbfab700 1 -- 172.21.15.71:0/1877832160 wait complete. 2023-10-06T01:41:35.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.907+0000 7fd3cbfab700 1 Processor -- start 2023-10-06T01:41:35.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.907+0000 7fd3cbfab700 1 -- start start 2023-10-06T01:41:35.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.907+0000 7fd3cbfab700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd3c4087530 0x7fd3c40c4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:35.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.907+0000 7fd3cbfab700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd3c415a030 0x7fd3c4155d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:35.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.907+0000 7fd3cbfab700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd3c415a940 0x7fd3c40b4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:35.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.907+0000 7fd3cbfab700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c40c4b90 con 0x7fd3c415a940 2023-10-06T01:41:35.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.907+0000 7fd3cbfab700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c415b590 con 0x7fd3c4087530 2023-10-06T01:41:35.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.907+0000 7fd3cbfab700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c40c5590 con 0x7fd3c415a030 2023-10-06T01:41:35.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.907+0000 7fd3ca548700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd3c415a940 0x7fd3c40b4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:35.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.907+0000 7fd3ca548700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd3c415a940 0x7fd3c40b4c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37854/0 (socket says 172.21.15.71:37854) 2023-10-06T01:41:35.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.907+0000 7fd3ca548700 1 -- 172.21.15.71:0/3173027092 learned_addr learned my addr 172.21.15.71:0/3173027092 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:35.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.907+0000 7fd3c9d47700 1 --2- 172.21.15.71:0/3173027092 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd3c4087530 0x7fd3c40c4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:35.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.907+0000 7fd3c9546700 1 --2- 172.21.15.71:0/3173027092 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd3c415a030 0x7fd3c4155d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:35.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.908+0000 7fd3ca548700 1 -- 172.21.15.71:0/3173027092 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd3c415a030 msgr2=0x7fd3c4155d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:35.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.908+0000 7fd3ca548700 1 --2- 172.21.15.71:0/3173027092 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd3c415a030 0x7fd3c4155d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:35.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.908+0000 7fd3ca548700 1 -- 172.21.15.71:0/3173027092 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd3c4087530 msgr2=0x7fd3c40c4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:35.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.908+0000 7fd3ca548700 1 --2- 172.21.15.71:0/3173027092 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd3c4087530 0x7fd3c40c4650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:35.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.908+0000 7fd3ca548700 1 -- 172.21.15.71:0/3173027092 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3c0009420 con 0x7fd3c415a940 2023-10-06T01:41:35.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.908+0000 7fd3ca548700 1 --2- 172.21.15.71:0/3173027092 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd3c415a940 0x7fd3c40b4c00 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc00cc90 tx=0x7fd3bc001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:35.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.908+0000 7fd3b9ffb700 1 -- 172.21.15.71:0/3173027092 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3bc00a8b0 con 0x7fd3c415a940 2023-10-06T01:41:35.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.908+0000 7fd3b9ffb700 1 -- 172.21.15.71:0/3173027092 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3bc00aa10 con 0x7fd3c415a940 2023-10-06T01:41:35.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.908+0000 7fd3cbfab700 1 -- 172.21.15.71:0/3173027092 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3c40c5870 con 0x7fd3c415a940 2023-10-06T01:41:35.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.908+0000 7fd3b9ffb700 1 -- 172.21.15.71:0/3173027092 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3bc00add0 con 0x7fd3c415a940 2023-10-06T01:41:35.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.908+0000 7fd3cbfab700 1 -- 172.21.15.71:0/3173027092 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3c40c5e30 con 0x7fd3c415a940 2023-10-06T01:41:35.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.909+0000 7fd3cbfab700 1 -- 172.21.15.71:0/3173027092 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3c415b750 con 0x7fd3c415a940 2023-10-06T01:41:35.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.909+0000 7fd3b9ffb700 1 -- 172.21.15.71:0/3173027092 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd3bc007300 con 0x7fd3c415a940 2023-10-06T01:41:35.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.910+0000 7fd3b9ffb700 1 --2- 172.21.15.71:0/3173027092 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fd3a8066f30 0x7fd3a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:35.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.910+0000 7fd3b9ffb700 1 -- 172.21.15.71:0/3173027092 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fd3bc084af0 con 0x7fd3c415a940 2023-10-06T01:41:35.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.910+0000 7fd3c9d47700 1 --2- 172.21.15.71:0/3173027092 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fd3a8066f30 0x7fd3a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:35.913 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.910+0000 7fd3c9d47700 1 --2- 172.21.15.71:0/3173027092 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fd3a8066f30 0x7fd3a80693e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd3c00093f0 tx=0x7fd3c0017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:35.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:35.914+0000 7fd3b9ffb700 1 -- 172.21.15.71:0/3173027092 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd3bc051b40 con 0x7fd3c415a940 2023-10-06T01:41:36.176 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:36.174+0000 7fd3cbfab700 1 -- 172.21.15.71:0/3173027092 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "2:0"} v 0) v1 -- 0x7fd3c40b0210 con 0x7fd3c415a940 2023-10-06T01:41:36.177 INFO:tasks.ceph.mon.a.smithi071.stderr:2023-10-06T01:41:36.175+0000 7fec89f1c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T01:41:36.180 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:36.179+0000 7fd3b9ffb700 1 -- 172.21.15.71:0/3173027092 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "2:0"}]=0 failed mds gid 5157 v19) v1 ==== 97+0+0 (secure 0 0 0) 0x7fd3bc055160 con 0x7fd3c415a940 2023-10-06T01:41:36.182 INFO:tasks.ceph.mds.d.smithi072.stderr: -2669> 2023-10-06T01:41:31.089+0000 7f55b032d700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T01:41:36.183 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:36.181+0000 7fd3cbfab700 1 -- 172.21.15.71:0/3173027092 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fd3a8066f30 msgr2=0x7fd3a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:36.183 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:36.181+0000 7fd3cbfab700 1 --2- 172.21.15.71:0/3173027092 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fd3a8066f30 0x7fd3a80693e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd3c00093f0 tx=0x7fd3c0017000 comp rx=0 tx=0).stop 2023-10-06T01:41:36.183 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:36.181+0000 7fd3cbfab700 1 -- 172.21.15.71:0/3173027092 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd3c415a940 msgr2=0x7fd3c40b4c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:36.183 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:36.181+0000 7fd3cbfab700 1 --2- 172.21.15.71:0/3173027092 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd3c415a940 0x7fd3c40b4c00 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc00cc90 tx=0x7fd3bc001a80 comp rx=0 tx=0).stop 2023-10-06T01:41:36.183 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:36.181+0000 7fd3cbfab700 1 -- 172.21.15.71:0/3173027092 shutdown_connections 2023-10-06T01:41:36.183 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:36.181+0000 7fd3cbfab700 1 --2- 172.21.15.71:0/3173027092 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd3c415a940 0x7fd3c40b4c00 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:36.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:36.181+0000 7fd3cbfab700 1 --2- 172.21.15.71:0/3173027092 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fd3a8066f30 0x7fd3a80693e0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:36.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:36.181+0000 7fd3cbfab700 1 --2- 172.21.15.71:0/3173027092 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd3c4087530 0x7fd3c40c4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:36.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:36.181+0000 7fd3cbfab700 1 --2- 172.21.15.71:0/3173027092 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd3c415a030 0x7fd3c4155d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:36.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:36.181+0000 7fd3cbfab700 1 -- 172.21.15.71:0/3173027092 >> 172.21.15.71:0/3173027092 conn(0x7fd3c4068680 msgr2=0x7fd3c40b2170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:36.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:36.181+0000 7fd3cbfab700 1 -- 172.21.15.71:0/3173027092 shutdown_connections 2023-10-06T01:41:36.184 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:36.181+0000 7fd3cbfab700 1 -- 172.21.15.71:0/3173027092 wait complete. 2023-10-06T01:41:36.184 INFO:teuthology.orchestra.run.smithi071.stderr:failed mds gid 5157 2023-10-06T01:41:36.197 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T01:41:36.207 INFO:tasks.ceph.mds.d.smithi072.stdout:starting mds.d at 2023-10-06T01:41:36.312 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:36.310+0000 7f23d211a700 1 Processor -- start 2023-10-06T01:41:36.312 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:36.310+0000 7f23d211a700 1 -- start start 2023-10-06T01:41:36.314 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:36.311+0000 7f23d211a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f23cc15ca10 0x7f23cc069f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:36.314 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:36.311+0000 7f23d211a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f23cc15cde0 0x7f23cc0b2360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:36.314 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:36.311+0000 7f23d211a700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23cc0b1ed0 con 0x7f23cc067d10 2023-10-06T01:41:36.314 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:36.311+0000 7f23d211a700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23cc0879c0 con 0x7f23cc15ca10 2023-10-06T01:41:36.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:36.311+0000 7f23d211a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23cc0cec50 con 0x7f23cc15cde0 2023-10-06T01:41:36.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:36.311+0000 7f23cb7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f23cc15ca10 0x7f23cc069f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:36.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:36.311+0000 7f23cbfff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f23cc15cde0 0x7f23cc0b2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:36.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:36.311+0000 7f23cb7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f23cc15ca10 0x7f23cc069f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:38962/0 (socket says 172.21.15.71:38962) 2023-10-06T01:41:36.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:36.311+0000 7f23cbfff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f23cc15cde0 0x7f23cc0b2360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.71:49182/0 (socket says 172.21.15.71:49182) 2023-10-06T01:41:36.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:36.311+0000 7f23cb7fe700 1 -- 172.21.15.71:0/1680421260 learned_addr learned my addr 172.21.15.71:0/1680421260 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:36.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:36.312+0000 7f23cb7fe700 1 -- 172.21.15.71:0/1680421260 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f23cc15cde0 msgr2=0x7f23cc0b2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:36.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:36.312+0000 7f23cb7fe700 1 --2- 172.21.15.71:0/1680421260 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f23cc15cde0 0x7f23cc0b2360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:36.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:36.312+0000 7f23cb7fe700 1 -- 172.21.15.71:0/1680421260 >> v1:172.21.15.72:6789/0 conn(0x7f23cc067d10 legacy=0x7f23cc06a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:36.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:36.312+0000 7f23cb7fe700 1 -- 172.21.15.71:0/1680421260 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23cc0cef30 con 0x7f23cc15ca10 2023-10-06T01:41:36.315 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:36.312+0000 7f23cbfff700 1 --2- 172.21.15.71:0/1680421260 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f23cc15cde0 0x7f23cc0b2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:41:36.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:36.312+0000 7f23cb7fe700 1 --2- 172.21.15.71:0/1680421260 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23cc15ca10 0x7f23cc069f70 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f23bc009f70 tx=0x7f23bc009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8dcd21cef59b0fd5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:36.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:36.312+0000 7f23ca7fc700 1 -- 172.21.15.71:0/1680421260 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23bc00e070 con 0x7f23cc15ca10 2023-10-06T01:41:36.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:36.312+0000 7f23ca7fc700 1 -- 172.21.15.71:0/1680421260 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23bc00ba20 con 0x7f23cc15ca10 2023-10-06T01:41:36.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:36.312+0000 7f23ca7fc700 1 -- 172.21.15.71:0/1680421260 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23bc0092e0 con 0x7f23cc15ca10 2023-10-06T01:41:36.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:36.313+0000 7f23d211a700 1 -- 172.21.15.71:0/1680421260 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23cc15ca10 msgr2=0x7f23cc069f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:36.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:36.313+0000 7f23d211a700 1 --2- 172.21.15.71:0/1680421260 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23cc15ca10 0x7f23cc069f70 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f23bc009f70 tx=0x7f23bc009840 comp rx=0 tx=0).stop 2023-10-06T01:41:36.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:36.313+0000 7f23d211a700 1 -- 172.21.15.71:0/1680421260 shutdown_connections 2023-10-06T01:41:36.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:36.313+0000 7f23d211a700 1 --2- 172.21.15.71:0/1680421260 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f23cc15cde0 0x7f23cc0b2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:36.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:36.313+0000 7f23d211a700 1 --2- 172.21.15.71:0/1680421260 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23cc15ca10 0x7f23cc069f70 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:36.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:36.313+0000 7f23d211a700 1 -- 172.21.15.71:0/1680421260 >> 172.21.15.71:0/1680421260 conn(0x7f23cc067910 msgr2=0x7f23cc0ce160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:36.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:36.313+0000 7f23d211a700 1 -- 172.21.15.71:0/1680421260 shutdown_connections 2023-10-06T01:41:36.316 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:36.313+0000 7f23d211a700 1 -- 172.21.15.71:0/1680421260 wait complete. 2023-10-06T01:41:36.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:36.314+0000 7f23d211a700 1 Processor -- start 2023-10-06T01:41:36.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:36.314+0000 7f23d211a700 1 -- start start 2023-10-06T01:41:36.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:36.315+0000 7f23d211a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f23cc067d10 0x7f23cc151b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:36.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:36.315+0000 7f23d211a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23cc15ca10 0x7f23cc0b0440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:36.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:36.315+0000 7f23d211a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f23cc15cde0 0x7f23cc153250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:36.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:36.315+0000 7f23d211a700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23cc152040 con 0x7f23cc15cde0 2023-10-06T01:41:36.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:36.315+0000 7f23d211a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23cc0affb0 con 0x7f23cc15ca10 2023-10-06T01:41:36.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:36.315+0000 7f23d211a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23cc0af3a0 con 0x7f23cc067d10 2023-10-06T01:41:36.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:36.315+0000 7f23cbfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f23cc15cde0 0x7f23cc153250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:36.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:36.315+0000 7f23cbfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f23cc15cde0 0x7f23cc153250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37858/0 (socket says 172.21.15.71:37858) 2023-10-06T01:41:36.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:36.315+0000 7f23cbfff700 1 -- 172.21.15.71:0/2784097548 learned_addr learned my addr 172.21.15.71:0/2784097548 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:36.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:36.315+0000 7f23caffd700 1 --2- 172.21.15.71:0/2784097548 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23cc15ca10 0x7f23cc0b0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:36.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:36.315+0000 7f23cb7fe700 1 --2- 172.21.15.71:0/2784097548 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f23cc067d10 0x7f23cc151b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:36.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:36.315+0000 7f23cbfff700 1 -- 172.21.15.71:0/2784097548 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f23cc067d10 msgr2=0x7f23cc151b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:36.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:36.315+0000 7f23cbfff700 1 --2- 172.21.15.71:0/2784097548 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f23cc067d10 0x7f23cc151b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:36.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:36.315+0000 7f23cbfff700 1 -- 172.21.15.71:0/2784097548 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23cc15ca10 msgr2=0x7f23cc0b0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:36.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:36.315+0000 7f23cbfff700 1 --2- 172.21.15.71:0/2784097548 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23cc15ca10 0x7f23cc0b0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:36.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:36.315+0000 7f23cbfff700 1 -- 172.21.15.71:0/2784097548 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23c4009420 con 0x7f23cc15cde0 2023-10-06T01:41:36.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:36.315+0000 7f23cbfff700 1 --2- 172.21.15.71:0/2784097548 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f23cc15cde0 0x7f23cc153250 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f23c400ea50 tx=0x7f23c40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:36.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:36.315+0000 7f23b37fe700 1 -- 172.21.15.71:0/2784097548 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c400ee90 con 0x7f23cc15cde0 2023-10-06T01:41:36.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:36.315+0000 7f23b37fe700 1 -- 172.21.15.71:0/2784097548 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23c400c8e0 con 0x7f23cc15cde0 2023-10-06T01:41:36.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:36.315+0000 7f23d211a700 1 -- 172.21.15.71:0/2784097548 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23bc009ae0 con 0x7f23cc15cde0 2023-10-06T01:41:36.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:36.315+0000 7f23b37fe700 1 -- 172.21.15.71:0/2784097548 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c400cca0 con 0x7f23cc15cde0 2023-10-06T01:41:36.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:36.316+0000 7f23d211a700 1 -- 172.21.15.71:0/2784097548 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23cc0af960 con 0x7f23cc15cde0 2023-10-06T01:41:36.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:36.316+0000 7f23d211a700 1 -- 172.21.15.71:0/2784097548 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23cc06e8d0 con 0x7f23cc15cde0 2023-10-06T01:41:36.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:36.317+0000 7f23b37fe700 1 -- 172.21.15.71:0/2784097548 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f23c4013680 con 0x7f23cc15cde0 2023-10-06T01:41:36.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:36.317+0000 7f23b37fe700 1 --2- 172.21.15.71:0/2784097548 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f23b8066f30 0x7f23b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:36.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:36.317+0000 7f23b37fe700 1 -- 172.21.15.71:0/2784097548 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f23c4084910 con 0x7f23cc15cde0 2023-10-06T01:41:36.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:36.317+0000 7f23cb7fe700 1 --2- 172.21.15.71:0/2784097548 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f23b8066f30 0x7f23b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:36.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:36.318+0000 7f23cb7fe700 1 --2- 172.21.15.71:0/2784097548 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f23b8066f30 0x7f23b80693e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f23bc009880 tx=0x7f23bc018000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:36.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:36.321+0000 7f23b37fe700 1 -- 172.21.15.71:0/2784097548 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f23c4051810 con 0x7f23cc15cde0 2023-10-06T01:41:36.546 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:36.544+0000 7f23d211a700 1 -- 172.21.15.71:0/2784097548 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f23cc0b00f0 con 0x7f23cc15cde0 2023-10-06T01:41:36.546 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:36.545+0000 7f23b37fe700 1 -- 172.21.15.71:0/2784097548 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+3841 (secure 0 0 0) 0x7f23c4054e30 con 0x7f23cc15cde0 2023-10-06T01:41:36.547 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:41:36.547 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":20,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5020,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/2765166441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6833","nonce":2765166441},{"type":"v1","addr":"172.21.15.72:6835","nonce":2765166441}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5145,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6836/1993673980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":1993673980},{"type":"v1","addr":"172.21.15.71:6836","nonce":1993673980}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T01:41:26.474510+0000","modified":"2023-10-06T01:41:36.180781+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":42,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5148},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5148":{"gid":5148,"name":"a","rank":0,"incarnation":20,"state":"up:replay","state_seq":1,"addr":"172.21.15.71:6837/3598886363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6835","nonce":3598886363},{"type":"v1","addr":"172.21.15.71:6837","nonce":3598886363}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T01:41:36.548 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:36.546+0000 7f23d211a700 1 -- 172.21.15.71:0/2784097548 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f23b8066f30 msgr2=0x7f23b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:36.549 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:36.547+0000 7f23d211a700 1 --2- 172.21.15.71:0/2784097548 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f23b8066f30 0x7f23b80693e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f23bc009880 tx=0x7f23bc018000 comp rx=0 tx=0).stop 2023-10-06T01:41:36.549 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:36.547+0000 7f23d211a700 1 -- 172.21.15.71:0/2784097548 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f23cc15cde0 msgr2=0x7f23cc153250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:36.549 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:36.547+0000 7f23d211a700 1 --2- 172.21.15.71:0/2784097548 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f23cc15cde0 0x7f23cc153250 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f23c400ea50 tx=0x7f23c40091a0 comp rx=0 tx=0).stop 2023-10-06T01:41:36.549 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:36.547+0000 7f23d211a700 1 -- 172.21.15.71:0/2784097548 shutdown_connections 2023-10-06T01:41:36.549 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:36.547+0000 7f23d211a700 1 --2- 172.21.15.71:0/2784097548 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f23cc15cde0 0x7f23cc153250 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:36.549 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:36.547+0000 7f23d211a700 1 --2- 172.21.15.71:0/2784097548 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f23cc067d10 0x7f23cc151b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:36.549 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:36.547+0000 7f23d211a700 1 --2- 172.21.15.71:0/2784097548 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f23b8066f30 0x7f23b80693e0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:36.549 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:36.547+0000 7f23d211a700 1 --2- 172.21.15.71:0/2784097548 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23cc15ca10 0x7f23cc0b0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:36.549 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:36.547+0000 7f23d211a700 1 -- 172.21.15.71:0/2784097548 >> 172.21.15.71:0/2784097548 conn(0x7f23cc067910 msgr2=0x7f23cc06dc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:36.550 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:36.547+0000 7f23d211a700 1 -- 172.21.15.71:0/2784097548 shutdown_connections 2023-10-06T01:41:36.550 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:36.547+0000 7f23d211a700 1 -- 172.21.15.71:0/2784097548 wait complete. 2023-10-06T01:41:36.550 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 20 2023-10-06T01:41:36.963 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 20, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T01:41:26.474510+0000', 'modified': '2023-10-06T01:41:36.180781+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 42, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5148}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5148': {'gid': 5148, 'name': 'a', 'rank': 0, 'incarnation': 20, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.71:6837/3598886363', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6835', 'nonce': 3598886363}, {'type': 'v1', 'addr': '172.21.15.71:6837', 'nonce': 3598886363}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T01:41:36.963 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5148:up:replay 2023-10-06T01:41:37.963 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T01:41:38.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:38.088+0000 7f06ca11c700 1 Processor -- start 2023-10-06T01:41:38.090 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:38.088+0000 7f06ca11c700 1 -- start start 2023-10-06T01:41:38.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:38.089+0000 7f06ca11c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f06c406e520 0x7f06c4069de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:38.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:38.089+0000 7f06ca11c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f06c41597c0 0x7f06c406a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:38.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:38.089+0000 7f06ca11c700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06c4069950 con 0x7f06c41593f0 2023-10-06T01:41:38.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:38.089+0000 7f06ca11c700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06c40b2850 con 0x7f06c41597c0 2023-10-06T01:41:38.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:38.089+0000 7f06ca11c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06c40b1fb0 con 0x7f06c406e520 2023-10-06T01:41:38.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:38.089+0000 7f06c3fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f06c41597c0 0x7f06c406a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:38.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:38.089+0000 7f06c3fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f06c41597c0 0x7f06c406a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37860/0 (socket says 172.21.15.71:37860) 2023-10-06T01:41:38.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:38.089+0000 7f06c3fff700 1 -- 172.21.15.71:0/3678496898 learned_addr learned my addr 172.21.15.71:0/3678496898 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:38.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:38.090+0000 7f06c2ffd700 1 --2- 172.21.15.71:0/3678496898 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f06c406e520 0x7f06c4069de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:38.093 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:38.090+0000 7f06c3fff700 1 -- 172.21.15.71:0/3678496898 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f06c406e520 msgr2=0x7f06c4069de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:38.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:38.090+0000 7f06c3fff700 1 --2- 172.21.15.71:0/3678496898 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f06c406e520 0x7f06c4069de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:38.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:38.090+0000 7f06c3fff700 1 -- 172.21.15.71:0/3678496898 >> v1:172.21.15.72:6789/0 conn(0x7f06c41593f0 legacy=0x7f06c406de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:38.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:38.090+0000 7f06c3fff700 1 -- 172.21.15.71:0/3678496898 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c40b2290 con 0x7f06c41597c0 2023-10-06T01:41:38.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:38.090+0000 7f06c3fff700 1 --2- 172.21.15.71:0/3678496898 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06c41597c0 0x7f06c406a320 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f06bc0099b0 tx=0x7f06bc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eff627f8539f7f9c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:38.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:38.090+0000 7f06c27fc700 1 -- 172.21.15.71:0/3678496898 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06bc00b820 con 0x7f06c41597c0 2023-10-06T01:41:38.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:38.090+0000 7f06c27fc700 1 -- 172.21.15.71:0/3678496898 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06bc00b980 con 0x7f06c41597c0 2023-10-06T01:41:38.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:38.090+0000 7f06c27fc700 1 -- 172.21.15.71:0/3678496898 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06bc00bd20 con 0x7f06c41597c0 2023-10-06T01:41:38.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:38.091+0000 7f06ca11c700 1 -- 172.21.15.71:0/3678496898 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06c41597c0 msgr2=0x7f06c406a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:38.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:38.091+0000 7f06ca11c700 1 --2- 172.21.15.71:0/3678496898 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06c41597c0 0x7f06c406a320 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f06bc0099b0 tx=0x7f06bc009250 comp rx=0 tx=0).stop 2023-10-06T01:41:38.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:38.091+0000 7f06ca11c700 1 -- 172.21.15.71:0/3678496898 shutdown_connections 2023-10-06T01:41:38.094 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:38.091+0000 7f06ca11c700 1 --2- 172.21.15.71:0/3678496898 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06c41597c0 0x7f06c406a320 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:38.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:38.091+0000 7f06ca11c700 1 --2- 172.21.15.71:0/3678496898 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f06c406e520 0x7f06c4069de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:38.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:38.091+0000 7f06ca11c700 1 -- 172.21.15.71:0/3678496898 >> 172.21.15.71:0/3678496898 conn(0x7f06c406cff0 msgr2=0x7f06c40afaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:38.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:38.091+0000 7f06ca11c700 1 -- 172.21.15.71:0/3678496898 shutdown_connections 2023-10-06T01:41:38.095 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:38.091+0000 7f06ca11c700 1 -- 172.21.15.71:0/3678496898 wait complete. 2023-10-06T01:41:38.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:38.092+0000 7f06ca11c700 1 Processor -- start 2023-10-06T01:41:38.097 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:38.092+0000 7f06ca11c700 1 -- start start 2023-10-06T01:41:38.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:38.093+0000 7f06ca11c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06c406e520 0x7f06c4154320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:38.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:38.093+0000 7f06ca11c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f06c41593f0 0x7f06c40c92f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:38.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:38.093+0000 7f06ca11c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06c41597c0 0x7f06c4169780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:38.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:38.093+0000 7f06ca11c700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c40ca800 con 0x7f06c406e520 2023-10-06T01:41:38.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:38.093+0000 7f06ca11c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c4154860 con 0x7f06c41597c0 2023-10-06T01:41:38.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:38.093+0000 7f06ca11c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06c40c9bf0 con 0x7f06c41593f0 2023-10-06T01:41:38.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:38.093+0000 7f06c37fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06c406e520 0x7f06c4154320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:38.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:38.093+0000 7f06c37fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06c406e520 0x7f06c4154320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37866/0 (socket says 172.21.15.71:37866) 2023-10-06T01:41:38.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:38.093+0000 7f06c37fe700 1 -- 172.21.15.71:0/3210620626 learned_addr learned my addr 172.21.15.71:0/3210620626 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:38.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:38.093+0000 7f06c2ffd700 1 --2- 172.21.15.71:0/3210620626 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f06c41593f0 0x7f06c40c92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:38.098 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:38.093+0000 7f06c3fff700 1 --2- 172.21.15.71:0/3210620626 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06c41597c0 0x7f06c4169780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:38.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:38.093+0000 7f06c37fe700 1 -- 172.21.15.71:0/3210620626 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f06c41593f0 msgr2=0x7f06c40c92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:38.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:38.093+0000 7f06c37fe700 1 --2- 172.21.15.71:0/3210620626 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f06c41593f0 0x7f06c40c92f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:38.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:38.093+0000 7f06c37fe700 1 -- 172.21.15.71:0/3210620626 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06c41597c0 msgr2=0x7f06c4169780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:38.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:38.093+0000 7f06c37fe700 1 --2- 172.21.15.71:0/3210620626 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06c41597c0 0x7f06c4169780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:38.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:38.093+0000 7f06c37fe700 1 -- 172.21.15.71:0/3210620626 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06bc0094f0 con 0x7f06c406e520 2023-10-06T01:41:38.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:38.093+0000 7f06c3fff700 1 --2- 172.21.15.71:0/3210620626 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06c41597c0 0x7f06c4169780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:41:38.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:38.093+0000 7f06c37fe700 1 --2- 172.21.15.71:0/3210620626 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06c406e520 0x7f06c4154320 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f06b400c950 tx=0x7f06b4002760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:38.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:38.093+0000 7f06ab7fe700 1 -- 172.21.15.71:0/3210620626 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b4012630 con 0x7f06c406e520 2023-10-06T01:41:38.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:38.093+0000 7f06ab7fe700 1 -- 172.21.15.71:0/3210620626 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06b4012790 con 0x7f06c406e520 2023-10-06T01:41:38.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:38.093+0000 7f06ca11c700 1 -- 172.21.15.71:0/3210620626 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06c40c9ed0 con 0x7f06c406e520 2023-10-06T01:41:38.099 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:38.093+0000 7f06ab7fe700 1 -- 172.21.15.71:0/3210620626 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b4012b50 con 0x7f06c406e520 2023-10-06T01:41:38.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:38.093+0000 7f06ca11c700 1 -- 172.21.15.71:0/3210620626 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06c40ca490 con 0x7f06c406e520 2023-10-06T01:41:38.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:38.094+0000 7f06ca11c700 1 -- 172.21.15.71:0/3210620626 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06c40caae0 con 0x7f06c406e520 2023-10-06T01:41:38.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:38.095+0000 7f06ab7fe700 1 -- 172.21.15.71:0/3210620626 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f06b400a420 con 0x7f06c406e520 2023-10-06T01:41:38.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:38.095+0000 7f06ab7fe700 1 --2- 172.21.15.71:0/3210620626 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f06b0066f30 0x7f06b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:38.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:38.095+0000 7f06ab7fe700 1 -- 172.21.15.71:0/3210620626 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f06b4084ce0 con 0x7f06c406e520 2023-10-06T01:41:38.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:38.095+0000 7f06c2ffd700 1 --2- 172.21.15.71:0/3210620626 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f06b0066f30 0x7f06b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:38.100 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:38.096+0000 7f06c2ffd700 1 --2- 172.21.15.71:0/3210620626 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f06b0066f30 0x7f06b00693e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f06c40ad840 tx=0x7f06b8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:38.101 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:38.099+0000 7f06ab7fe700 1 -- 172.21.15.71:0/3210620626 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f06b4051d10 con 0x7f06c406e520 2023-10-06T01:41:38.326 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:38.324+0000 7f06ca11c700 1 -- 172.21.15.71:0/3210620626 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f06c40b2570 con 0x7f06c406e520 2023-10-06T01:41:38.326 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:38.325+0000 7f06ab7fe700 1 -- 172.21.15.71:0/3210620626 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4598 (secure 0 0 0) 0x7f06b4055330 con 0x7f06c406e520 2023-10-06T01:41:38.327 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:41:38.327 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4889,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6834/1688339815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":1688339815},{"type":"v1","addr":"172.21.15.72:6834","nonce":1688339815}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5020,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/2765166441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6833","nonce":2765166441},{"type":"v1","addr":"172.21.15.72:6835","nonce":2765166441}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5145,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6836/1993673980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":1993673980},{"type":"v1","addr":"172.21.15.71:6836","nonce":1993673980}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T01:41:26.474510+0000","modified":"2023-10-06T01:41:38.186756+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":42,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5148},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5148":{"gid":5148,"name":"a","rank":0,"incarnation":20,"state":"up:rejoin","state_seq":7,"addr":"172.21.15.71:6837/3598886363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6835","nonce":3598886363},{"type":"v1","addr":"172.21.15.71:6837","nonce":3598886363}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T01:41:38.329 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:38.327+0000 7f06ca11c700 1 -- 172.21.15.71:0/3210620626 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f06b0066f30 msgr2=0x7f06b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:38.329 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:38.327+0000 7f06ca11c700 1 --2- 172.21.15.71:0/3210620626 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f06b0066f30 0x7f06b00693e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f06c40ad840 tx=0x7f06b8008040 comp rx=0 tx=0).stop 2023-10-06T01:41:38.329 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:38.327+0000 7f06ca11c700 1 -- 172.21.15.71:0/3210620626 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06c406e520 msgr2=0x7f06c4154320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:38.329 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:38.327+0000 7f06ca11c700 1 --2- 172.21.15.71:0/3210620626 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06c406e520 0x7f06c4154320 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f06b400c950 tx=0x7f06b4002760 comp rx=0 tx=0).stop 2023-10-06T01:41:38.329 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:38.327+0000 7f06ca11c700 1 -- 172.21.15.71:0/3210620626 shutdown_connections 2023-10-06T01:41:38.329 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:38.327+0000 7f06ca11c700 1 --2- 172.21.15.71:0/3210620626 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f06b0066f30 0x7f06b00693e0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:38.329 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:38.327+0000 7f06ca11c700 1 --2- 172.21.15.71:0/3210620626 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06c41597c0 0x7f06c4169780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:38.330 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:38.327+0000 7f06ca11c700 1 --2- 172.21.15.71:0/3210620626 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06c406e520 0x7f06c4154320 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:38.330 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:38.327+0000 7f06ca11c700 1 --2- 172.21.15.71:0/3210620626 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f06c41593f0 0x7f06c40c92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:38.330 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:38.327+0000 7f06ca11c700 1 -- 172.21.15.71:0/3210620626 >> 172.21.15.71:0/3210620626 conn(0x7f06c406cff0 msgr2=0x7f06c415b240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:38.330 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:38.327+0000 7f06ca11c700 1 -- 172.21.15.71:0/3210620626 shutdown_connections 2023-10-06T01:41:38.330 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:38.327+0000 7f06ca11c700 1 -- 172.21.15.71:0/3210620626 wait complete. 2023-10-06T01:41:38.330 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 22 2023-10-06T01:41:38.743 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 22, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T01:41:26.474510+0000', 'modified': '2023-10-06T01:41:38.186756+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 42, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5148}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5148': {'gid': 5148, 'name': 'a', 'rank': 0, 'incarnation': 20, 'state': 'up:rejoin', 'state_seq': 7, 'addr': '172.21.15.71:6837/3598886363', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6835', 'nonce': 3598886363}, {'type': 'v1', 'addr': '172.21.15.71:6837', 'nonce': 3598886363}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T01:41:38.743 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5148:up:rejoin 2023-10-06T01:41:39.744 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T01:41:39.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:39.869+0000 7fb5cf2b9700 1 Processor -- start 2023-10-06T01:41:39.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:39.870+0000 7fb5cf2b9700 1 -- start start 2023-10-06T01:41:39.873 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:39.870+0000 7fb5cf2b9700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fb5c80af4e0 0x7fb5c80b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:39.873 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:39.870+0000 7fb5cf2b9700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb5c815db70 0x7fb5c80b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:39.873 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:39.870+0000 7fb5cf2b9700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5c815e190 con 0x7fb5c80af8b0 2023-10-06T01:41:39.873 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:39.870+0000 7fb5cf2b9700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5c80b1910 con 0x7fb5c80af4e0 2023-10-06T01:41:39.873 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:39.870+0000 7fb5cf2b9700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5c815dfa0 con 0x7fb5c815db70 2023-10-06T01:41:39.873 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:39.871+0000 7fb5cd055700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fb5c80af4e0 0x7fb5c80b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:39.874 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:39.871+0000 7fb5cc854700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fb5c80af8b0 0x7fb5c815d460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:58398/0 (socket says 172.21.15.71:58398) 2023-10-06T01:41:39.874 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:39.871+0000 7fb5cc854700 1 -- 172.21.15.71:0/1817597849 learned_addr learned my addr 172.21.15.71:0/1817597849 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:41:39.874 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:39.871+0000 7fb5cd856700 1 --2- 172.21.15.71:0/1817597849 >> v2:172.21.15.72:3300/0 conn(0x7fb5c815db70 0x7fb5c80b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:39.874 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:39.871+0000 7fb5cd055700 1 -- 172.21.15.71:0/1817597849 >> v2:172.21.15.72:3300/0 conn(0x7fb5c815db70 msgr2=0x7fb5c80b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:39.874 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:39.871+0000 7fb5cd055700 1 --2- 172.21.15.71:0/1817597849 >> v2:172.21.15.72:3300/0 conn(0x7fb5c815db70 0x7fb5c80b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:39.874 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:39.871+0000 7fb5cd055700 1 -- 172.21.15.71:0/1817597849 >> v1:172.21.15.71:6789/0 conn(0x7fb5c80af8b0 legacy=0x7fb5c815d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:39.874 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:39.871+0000 7fb5cd055700 1 -- 172.21.15.71:0/1817597849 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5c80cb650 con 0x7fb5c80af4e0 2023-10-06T01:41:39.874 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:39.871+0000 7fb5bffff700 1 -- 172.21.15.71:0/1817597849 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 712115341 0 0) 0x7fb5c815e190 con 0x7fb5c80af8b0 2023-10-06T01:41:39.874 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:39.871+0000 7fb5cd055700 1 --2- 172.21.15.71:0/1817597849 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5c80af4e0 0x7fb5c80b20e0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fb5c80c7280 tx=0x7fb5c4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1fe52bc77dcd1b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:39.874 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:39.871+0000 7fb5bffff700 1 -- 172.21.15.71:0/1817597849 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c400e070 con 0x7fb5c80af4e0 2023-10-06T01:41:39.874 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:39.871+0000 7fb5bffff700 1 -- 172.21.15.71:0/1817597849 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5c400bc30 con 0x7fb5c80af4e0 2023-10-06T01:41:39.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:39.871+0000 7fb5bffff700 1 -- 172.21.15.71:0/1817597849 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c4012430 con 0x7fb5c80af4e0 2023-10-06T01:41:39.877 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:39.872+0000 7fb5cf2b9700 1 -- 172.21.15.71:0/1817597849 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5c80af4e0 msgr2=0x7fb5c80b20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:39.878 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:39.872+0000 7fb5cf2b9700 1 --2- 172.21.15.71:0/1817597849 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5c80af4e0 0x7fb5c80b20e0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fb5c80c7280 tx=0x7fb5c4009780 comp rx=0 tx=0).stop 2023-10-06T01:41:39.878 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:39.872+0000 7fb5cf2b9700 1 -- 172.21.15.71:0/1817597849 shutdown_connections 2023-10-06T01:41:39.878 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:39.872+0000 7fb5cf2b9700 1 --2- 172.21.15.71:0/1817597849 >> v2:172.21.15.72:3300/0 conn(0x7fb5c815db70 0x7fb5c80b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:39.878 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:39.872+0000 7fb5cf2b9700 1 --2- 172.21.15.71:0/1817597849 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5c80af4e0 0x7fb5c80b20e0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:39.878 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:39.872+0000 7fb5cf2b9700 1 -- 172.21.15.71:0/1817597849 >> 172.21.15.71:0/1817597849 conn(0x7fb5c8068680 msgr2=0x7fb5c8068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:39.878 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:39.872+0000 7fb5cf2b9700 1 -- 172.21.15.71:0/1817597849 shutdown_connections 2023-10-06T01:41:39.878 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:39.872+0000 7fb5cf2b9700 1 -- 172.21.15.71:0/1817597849 wait complete. 2023-10-06T01:41:39.878 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:39.873+0000 7fb5cf2b9700 1 Processor -- start 2023-10-06T01:41:39.878 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:39.873+0000 7fb5cf2b9700 1 -- start start 2023-10-06T01:41:39.878 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:39.874+0000 7fb5cf2b9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb5c80af4e0 0x7fb5c80c9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:39.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:39.874+0000 7fb5cf2b9700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5c80af8b0 0x7fb5c816d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:39.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:39.874+0000 7fb5cf2b9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5c815db70 0x7fb5c816db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:39.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:39.874+0000 7fb5cf2b9700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c80cf090 con 0x7fb5c80af8b0 2023-10-06T01:41:39.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:39.874+0000 7fb5cf2b9700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c80c8e90 con 0x7fb5c815db70 2023-10-06T01:41:39.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:39.874+0000 7fb5cf2b9700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c80c85f0 con 0x7fb5c80af4e0 2023-10-06T01:41:39.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:39.874+0000 7fb5cc854700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5c80af8b0 0x7fb5c816d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:39.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:39.874+0000 7fb5cc854700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5c80af8b0 0x7fb5c816d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57904/0 (socket says 172.21.15.71:57904) 2023-10-06T01:41:39.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:39.874+0000 7fb5cc854700 1 -- 172.21.15.71:0/1444175511 learned_addr learned my addr 172.21.15.71:0/1444175511 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:39.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:39.874+0000 7fb5cd856700 1 --2- 172.21.15.71:0/1444175511 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5c815db70 0x7fb5c816db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:39.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:39.874+0000 7fb5cc854700 1 -- 172.21.15.71:0/1444175511 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb5c80af4e0 msgr2=0x7fb5c80c9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:39.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:39.874+0000 7fb5cc854700 1 --2- 172.21.15.71:0/1444175511 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb5c80af4e0 0x7fb5c80c9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:39.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:39.874+0000 7fb5cc854700 1 -- 172.21.15.71:0/1444175511 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5c815db70 msgr2=0x7fb5c816db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:39.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:39.874+0000 7fb5cc854700 1 --2- 172.21.15.71:0/1444175511 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5c815db70 0x7fb5c816db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:39.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:39.874+0000 7fb5cc854700 1 -- 172.21.15.71:0/1444175511 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5c4009a20 con 0x7fb5c80af8b0 2023-10-06T01:41:39.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:39.875+0000 7fb5cc854700 1 --2- 172.21.15.71:0/1444175511 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5c80af8b0 0x7fb5c816d5f0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fb5b800c810 tx=0x7fb5b8007db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:39.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:39.875+0000 7fb5bd7fa700 1 -- 172.21.15.71:0/1444175511 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b8005c00 con 0x7fb5c80af8b0 2023-10-06T01:41:39.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:39.875+0000 7fb5bd7fa700 1 -- 172.21.15.71:0/1444175511 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5b8005d60 con 0x7fb5c80af8b0 2023-10-06T01:41:39.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:39.875+0000 7fb5cf2b9700 1 -- 172.21.15.71:0/1444175511 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5c80c88d0 con 0x7fb5c80af8b0 2023-10-06T01:41:39.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:39.875+0000 7fb5bd7fa700 1 -- 172.21.15.71:0/1444175511 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b8007320 con 0x7fb5c80af8b0 2023-10-06T01:41:39.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:39.875+0000 7fb5cf2b9700 1 -- 172.21.15.71:0/1444175511 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5c80ca000 con 0x7fb5c80af8b0 2023-10-06T01:41:39.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:39.876+0000 7fb5cf2b9700 1 -- 172.21.15.71:0/1444175511 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5c8088aa0 con 0x7fb5c80af8b0 2023-10-06T01:41:39.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:39.876+0000 7fb5bd7fa700 1 -- 172.21.15.71:0/1444175511 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb5b801b400 con 0x7fb5c80af8b0 2023-10-06T01:41:39.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:39.876+0000 7fb5bd7fa700 1 --2- 172.21.15.71:0/1444175511 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fb5ac066f30 0x7fb5ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:39.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:39.877+0000 7fb5bd7fa700 1 -- 172.21.15.71:0/1444175511 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fb5b80842e0 con 0x7fb5c80af8b0 2023-10-06T01:41:39.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:39.877+0000 7fb5cd055700 1 --2- 172.21.15.71:0/1444175511 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fb5ac066f30 0x7fb5ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:39.881 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:39.877+0000 7fb5cd055700 1 --2- 172.21.15.71:0/1444175511 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fb5ac066f30 0x7fb5ac0693e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb5c80c7280 tx=0x7fb5c4019000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:39.882 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:39.881+0000 7fb5bd7fa700 1 -- 172.21.15.71:0/1444175511 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb5b80512e0 con 0x7fb5c80af8b0 2023-10-06T01:41:40.073 INFO:tasks.ceph.mds.a.smithi071.stderr:2023-10-06T01:41:40.071+0000 7f6a687b7700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T01:41:40.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.102+0000 7fb5cf2b9700 1 -- 172.21.15.71:0/1444175511 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb5c80cf1d0 con 0x7fb5c80af8b0 2023-10-06T01:41:40.104 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.103+0000 7fb5bd7fa700 1 -- 172.21.15.71:0/1444175511 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4598 (secure 0 0 0) 0x7fb5b8054900 con 0x7fb5c80af8b0 2023-10-06T01:41:40.105 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:41:40.105 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":23,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4889,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6834/1688339815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":1688339815},{"type":"v1","addr":"172.21.15.72:6834","nonce":1688339815}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5020,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/2765166441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6833","nonce":2765166441},{"type":"v1","addr":"172.21.15.72:6835","nonce":2765166441}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5145,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6836/1993673980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":1993673980},{"type":"v1","addr":"172.21.15.71:6836","nonce":1993673980}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T01:41:26.474510+0000","modified":"2023-10-06T01:41:39.188518+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":42,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5148},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5148":{"gid":5148,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.71:6837/3598886363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6835","nonce":3598886363},{"type":"v1","addr":"172.21.15.71:6837","nonce":3598886363}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T01:41:40.107 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.105+0000 7fb5cf2b9700 1 -- 172.21.15.71:0/1444175511 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fb5ac066f30 msgr2=0x7fb5ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:40.107 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.105+0000 7fb5cf2b9700 1 --2- 172.21.15.71:0/1444175511 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fb5ac066f30 0x7fb5ac0693e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb5c80c7280 tx=0x7fb5c4019000 comp rx=0 tx=0).stop 2023-10-06T01:41:40.107 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.105+0000 7fb5cf2b9700 1 -- 172.21.15.71:0/1444175511 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5c80af8b0 msgr2=0x7fb5c816d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:40.107 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.105+0000 7fb5cf2b9700 1 --2- 172.21.15.71:0/1444175511 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5c80af8b0 0x7fb5c816d5f0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fb5b800c810 tx=0x7fb5b8007db0 comp rx=0 tx=0).stop 2023-10-06T01:41:40.107 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.105+0000 7fb5cf2b9700 1 -- 172.21.15.71:0/1444175511 shutdown_connections 2023-10-06T01:41:40.107 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.105+0000 7fb5cf2b9700 1 --2- 172.21.15.71:0/1444175511 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fb5ac066f30 0x7fb5ac0693e0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:40.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.105+0000 7fb5cf2b9700 1 --2- 172.21.15.71:0/1444175511 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5c815db70 0x7fb5c816db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:40.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.105+0000 7fb5cf2b9700 1 --2- 172.21.15.71:0/1444175511 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb5c80af4e0 0x7fb5c80c9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:40.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.105+0000 7fb5cf2b9700 1 --2- 172.21.15.71:0/1444175511 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5c80af8b0 0x7fb5c816d5f0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:40.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.105+0000 7fb5cf2b9700 1 -- 172.21.15.71:0/1444175511 >> 172.21.15.71:0/1444175511 conn(0x7fb5c8068680 msgr2=0x7fb5c80b54f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:40.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.105+0000 7fb5cf2b9700 1 -- 172.21.15.71:0/1444175511 shutdown_connections 2023-10-06T01:41:40.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.105+0000 7fb5cf2b9700 1 -- 172.21.15.71:0/1444175511 wait complete. 2023-10-06T01:41:40.108 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 23 2023-10-06T01:41:40.521 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 23, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T01:41:26.474510+0000', 'modified': '2023-10-06T01:41:39.188518+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 42, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5148}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5148': {'gid': 5148, 'name': 'a', 'rank': 0, 'incarnation': 20, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.71:6837/3598886363', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6835', 'nonce': 3598886363}, {'type': 'v1', 'addr': '172.21.15.71:6837', 'nonce': 3598886363}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T01:41:40.521 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T01:41:40.521 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-06T01:41:40.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.636+0000 7ffb8bfff700 1 Processor -- start 2023-10-06T01:41:40.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.636+0000 7ffb8bfff700 1 -- start start 2023-10-06T01:41:40.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.637+0000 7ffb8bfff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ffb8c159400 0x7ffb8c0ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:40.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.637+0000 7ffb8bfff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb8c0b3560 con 0x7ffb8c0cd030 2023-10-06T01:41:40.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.637+0000 7ffb8bfff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb8c0cf6f0 con 0x7ffb8c0d05d0 2023-10-06T01:41:40.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.637+0000 7ffb8bfff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb8c0cf9d0 con 0x7ffb8c159400 2023-10-06T01:41:40.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.637+0000 7ffb8affd700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ffb8c159400 0x7ffb8c0ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:40.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.637+0000 7ffb8affd700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ffb8c159400 0x7ffb8c0ccaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57920/0 (socket says 172.21.15.71:57920) 2023-10-06T01:41:40.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.637+0000 7ffb827fc700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7ffb8c0cd030 0x7ffb8c0cfec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:58414/0 (socket says 172.21.15.71:58414) 2023-10-06T01:41:40.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.637+0000 7ffb8affd700 1 -- 172.21.15.71:0/2594455040 learned_addr learned my addr 172.21.15.71:0/2594455040 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:40.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.637+0000 7ffb8affd700 1 -- 172.21.15.71:0/2594455040 >> v1:172.21.15.72:6789/0 conn(0x7ffb8c0d05d0 legacy=0x7ffb8c0b39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:40.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.637+0000 7ffb8affd700 1 -- 172.21.15.71:0/2594455040 >> v1:172.21.15.71:6789/0 conn(0x7ffb8c0cd030 legacy=0x7ffb8c0cfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:40.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.637+0000 7ffb8a7fc700 1 -- 172.21.15.71:0/2594455040 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4116165723 0 0) 0x7ffb8c0b3560 con 0x7ffb8c0cd030 2023-10-06T01:41:40.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.637+0000 7ffb8affd700 1 -- 172.21.15.71:0/2594455040 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb8c0b2f10 con 0x7ffb8c159400 2023-10-06T01:41:40.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.638+0000 7ffb8affd700 1 --2- 172.21.15.71:0/2594455040 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffb8c159400 0x7ffb8c0ccaf0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c009990 tx=0x7ffb7c009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5e26b81f07aa9a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:40.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.638+0000 7ffb8a7fc700 1 -- 172.21.15.71:0/2594455040 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb7c005c10 con 0x7ffb8c159400 2023-10-06T01:41:40.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.638+0000 7ffb8a7fc700 1 -- 172.21.15.71:0/2594455040 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb7c005d70 con 0x7ffb8c159400 2023-10-06T01:41:40.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.638+0000 7ffb8a7fc700 1 -- 172.21.15.71:0/2594455040 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb7c00b840 con 0x7ffb8c159400 2023-10-06T01:41:40.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.638+0000 7ffb8bfff700 1 -- 172.21.15.71:0/2594455040 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffb8c159400 msgr2=0x7ffb8c0ccaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:40.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.638+0000 7ffb8bfff700 1 --2- 172.21.15.71:0/2594455040 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffb8c159400 0x7ffb8c0ccaf0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c009990 tx=0x7ffb7c009220 comp rx=0 tx=0).stop 2023-10-06T01:41:40.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.638+0000 7ffb8bfff700 1 -- 172.21.15.71:0/2594455040 shutdown_connections 2023-10-06T01:41:40.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.638+0000 7ffb8bfff700 1 --2- 172.21.15.71:0/2594455040 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffb8c159400 0x7ffb8c0ccaf0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:40.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.638+0000 7ffb8bfff700 1 -- 172.21.15.71:0/2594455040 >> 172.21.15.71:0/2594455040 conn(0x7ffb8c06ac10 msgr2=0x7ffb8c068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:40.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.638+0000 7ffb8bfff700 1 -- 172.21.15.71:0/2594455040 shutdown_connections 2023-10-06T01:41:40.642 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.638+0000 7ffb8bfff700 1 -- 172.21.15.71:0/2594455040 wait complete. 2023-10-06T01:41:40.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.639+0000 7ffb8bfff700 1 Processor -- start 2023-10-06T01:41:40.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.640+0000 7ffb8bfff700 1 -- start start 2023-10-06T01:41:40.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.640+0000 7ffb8bfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffb8c0cd030 0x7ffb8c14da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:40.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.640+0000 7ffb8bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb8c0d05d0 0x7ffb8c14ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:40.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.640+0000 7ffb8bfff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb8c159400 0x7ffb8c1548a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:40.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.640+0000 7ffb8bfff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8c15a3d0 con 0x7ffb8c0cd030 2023-10-06T01:41:40.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.640+0000 7ffb8bfff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8c14f2b0 con 0x7ffb8c0d05d0 2023-10-06T01:41:40.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.640+0000 7ffb8bfff700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8c14f590 con 0x7ffb8c159400 2023-10-06T01:41:40.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.640+0000 7ffb8affd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffb8c0cd030 0x7ffb8c14da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:40.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.640+0000 7ffb8affd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffb8c0cd030 0x7ffb8c14da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57930/0 (socket says 172.21.15.71:57930) 2023-10-06T01:41:40.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.640+0000 7ffb8affd700 1 -- 172.21.15.71:0/2704477408 learned_addr learned my addr 172.21.15.71:0/2704477408 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:40.645 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.641+0000 7ffb8affd700 1 -- 172.21.15.71:0/2704477408 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb8c159400 msgr2=0x7ffb8c1548a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:40.646 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.641+0000 7ffb8affd700 1 --2- 172.21.15.71:0/2704477408 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb8c159400 0x7ffb8c1548a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:40.646 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.641+0000 7ffb8affd700 1 -- 172.21.15.71:0/2704477408 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb8c0d05d0 msgr2=0x7ffb8c14ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:40.646 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.641+0000 7ffb8affd700 1 --2- 172.21.15.71:0/2704477408 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb8c0d05d0 0x7ffb8c14ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:40.646 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.641+0000 7ffb8affd700 1 -- 172.21.15.71:0/2704477408 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb7c009480 con 0x7ffb8c0cd030 2023-10-06T01:41:40.646 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.641+0000 7ffb8affd700 1 --2- 172.21.15.71:0/2704477408 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffb8c0cd030 0x7ffb8c14da40 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c009260 tx=0x7ffb7c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:40.646 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.641+0000 7ffb837fe700 1 -- 172.21.15.71:0/2704477408 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb7c000d10 con 0x7ffb8c0cd030 2023-10-06T01:41:40.646 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.641+0000 7ffb837fe700 1 -- 172.21.15.71:0/2704477408 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb7c011cc0 con 0x7ffb8c0cd030 2023-10-06T01:41:40.646 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.641+0000 7ffb8bfff700 1 -- 172.21.15.71:0/2704477408 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb8c159d80 con 0x7ffb8c0cd030 2023-10-06T01:41:40.646 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.641+0000 7ffb837fe700 1 -- 172.21.15.71:0/2704477408 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb7c01d6a0 con 0x7ffb8c0cd030 2023-10-06T01:41:40.646 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.641+0000 7ffb8bfff700 1 -- 172.21.15.71:0/2704477408 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb8c14efa0 con 0x7ffb8c0cd030 2023-10-06T01:41:40.646 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.642+0000 7ffb837fe700 1 -- 172.21.15.71:0/2704477408 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ffb7c01dad0 con 0x7ffb8c0cd030 2023-10-06T01:41:40.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.642+0000 7ffb837fe700 1 --2- 172.21.15.71:0/2704477408 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7ffb6c066f30 0x7ffb6c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:40.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.643+0000 7ffb837fe700 1 -- 172.21.15.71:0/2704477408 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6464+0+0 (secure 0 0 0) 0x7ffb7c0863e0 con 0x7ffb8c0cd030 2023-10-06T01:41:40.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.643+0000 7ffb827fc700 1 --2- 172.21.15.71:0/2704477408 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7ffb6c066f30 0x7ffb6c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:40.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.643+0000 7ffb827fc700 1 --2- 172.21.15.71:0/2704477408 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7ffb6c066f30 0x7ffb6c0693e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ffb740011e0 tx=0x7ffb740079b0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:40.653 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.645+0000 7ffb9a836b80 1 Processor -- start 2023-10-06T01:41:40.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.645+0000 7ffb9a836b80 1 -- start start 2023-10-06T01:41:40.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.645+0000 7ffb9a836b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a26d183e50 0x55a26d15ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:40.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.646+0000 7ffb9a836b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a26d1642c0 0x55a26d15f200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:40.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.646+0000 7ffb9a836b80 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a26d165a10 0x55a26d15f740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:40.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.646+0000 7ffb9a836b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a26d0b9a70 con 0x55a26d183e50 2023-10-06T01:41:40.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.646+0000 7ffb9a836b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a26d0b7270 con 0x55a26d1642c0 2023-10-06T01:41:40.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.646+0000 7ffb9a836b80 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a26d0b3060 con 0x55a26d165a10 2023-10-06T01:41:40.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.646+0000 7ffb8affd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a26d183e50 0x55a26d15ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:40.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.646+0000 7ffb8affd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a26d183e50 0x55a26d15ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57932/0 (socket says 172.21.15.71:57932) 2023-10-06T01:41:40.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.646+0000 7ffb8affd700 1 -- 172.21.15.71:0/174282225 learned_addr learned my addr 172.21.15.71:0/174282225 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:40.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.646+0000 7ffb8b7fe700 1 --2- 172.21.15.71:0/174282225 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a26d165a10 0x55a26d15f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:40.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.646+0000 7ffb827fc700 1 --2- 172.21.15.71:0/174282225 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a26d1642c0 0x55a26d15f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:40.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.646+0000 7ffb8affd700 1 -- 172.21.15.71:0/174282225 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a26d165a10 msgr2=0x55a26d15f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:40.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.646+0000 7ffb8affd700 1 --2- 172.21.15.71:0/174282225 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a26d165a10 0x55a26d15f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:40.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.646+0000 7ffb8affd700 1 -- 172.21.15.71:0/174282225 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a26d1642c0 msgr2=0x55a26d15f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:40.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.646+0000 7ffb8affd700 1 --2- 172.21.15.71:0/174282225 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a26d1642c0 0x55a26d15f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:40.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.646+0000 7ffb8affd700 1 -- 172.21.15.71:0/174282225 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a26cf4d270 con 0x55a26d183e50 2023-10-06T01:41:40.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.646+0000 7ffb8b7fe700 1 --2- 172.21.15.71:0/174282225 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a26d165a10 0x55a26d15f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:41:40.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.646+0000 7ffb8affd700 1 --2- 172.21.15.71:0/174282225 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a26d183e50 0x55a26d15ecc0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c084640 tx=0x7ffb7c084570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=901ca988530e479 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:40.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.646+0000 7ffb6bfff700 1 -- 172.21.15.71:0/174282225 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb7c06d070 con 0x55a26d183e50 2023-10-06T01:41:40.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.646+0000 7ffb6bfff700 1 -- 172.21.15.71:0/174282225 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb7c057720 con 0x55a26d183e50 2023-10-06T01:41:40.656 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.646+0000 7ffb6bfff700 1 -- 172.21.15.71:0/174282225 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb7c057020 con 0x55a26d183e50 2023-10-06T01:41:40.656 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.647+0000 7ffb9a836b80 1 -- 172.21.15.71:0/174282225 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a26d183e50 msgr2=0x55a26d15ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:40.656 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.647+0000 7ffb9a836b80 1 --2- 172.21.15.71:0/174282225 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a26d183e50 0x55a26d15ecc0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c084640 tx=0x7ffb7c084570 comp rx=0 tx=0).stop 2023-10-06T01:41:40.656 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.647+0000 7ffb9a836b80 1 -- 172.21.15.71:0/174282225 shutdown_connections 2023-10-06T01:41:40.656 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.647+0000 7ffb9a836b80 1 --2- 172.21.15.71:0/174282225 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a26d165a10 0x55a26d15f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:40.656 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.647+0000 7ffb9a836b80 1 --2- 172.21.15.71:0/174282225 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a26d183e50 0x55a26d15ecc0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:40.656 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.647+0000 7ffb9a836b80 1 --2- 172.21.15.71:0/174282225 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a26d1642c0 0x55a26d15f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:40.656 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.647+0000 7ffb9a836b80 1 -- 172.21.15.71:0/174282225 >> 172.21.15.71:0/174282225 conn(0x55a26d163e80 msgr2=0x55a26d1646b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:40.656 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.647+0000 7ffb9a836b80 1 -- 172.21.15.71:0/174282225 shutdown_connections 2023-10-06T01:41:40.656 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.647+0000 7ffb9a836b80 1 -- 172.21.15.71:0/174282225 wait complete. 2023-10-06T01:41:40.656 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.648+0000 7ffb9a836b80 1 -- start start 2023-10-06T01:41:40.656 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.648+0000 7ffb9a836b80 1 Processor -- start 2023-10-06T01:41:40.657 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.648+0000 7ffb9a836b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a26d1642c0 0x55a26d1bc340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:40.657 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.648+0000 7ffb9a836b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a26d165a10 0x55a26d18cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:40.657 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.649+0000 7ffb9a836b80 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a26d183e50 0x55a26d17d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:40.657 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.649+0000 7ffb9a836b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a26d05e890 con 0x55a26d1642c0 2023-10-06T01:41:40.657 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.649+0000 7ffb9a836b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a26d079ea0 con 0x55a26d165a10 2023-10-06T01:41:40.657 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.649+0000 7ffb9a836b80 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a26cf35e30 con 0x55a26d183e50 2023-10-06T01:41:40.657 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.649+0000 7ffb8affd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a26d1642c0 0x55a26d1bc340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:40.657 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.649+0000 7ffb9a836b80 10 client.0 _ll_register_callbacks cb 0x55a26d126020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T01:41:40.657 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.649+0000 7ffb8affd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a26d1642c0 0x55a26d1bc340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57942/0 (socket says 172.21.15.71:57942) 2023-10-06T01:41:40.657 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.649+0000 7ffb8affd700 1 -- 172.21.15.71:0/564319255 learned_addr learned my addr 172.21.15.71:0/564319255 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:40.657 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.649+0000 7ffb8b7fe700 1 --2- 172.21.15.71:0/564319255 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a26d183e50 0x55a26d17d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:40.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.649+0000 7ffb827fc700 1 --2- 172.21.15.71:0/564319255 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a26d165a10 0x55a26d18cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:40.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.649+0000 7ffb8affd700 1 -- 172.21.15.71:0/564319255 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a26d183e50 msgr2=0x55a26d17d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:40.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.649+0000 7ffb8affd700 1 --2- 172.21.15.71:0/564319255 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a26d183e50 0x55a26d17d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:40.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.649+0000 7ffb8affd700 1 -- 172.21.15.71:0/564319255 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a26d165a10 msgr2=0x55a26d18cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:40.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.649+0000 7ffb8affd700 1 --2- 172.21.15.71:0/564319255 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a26d165a10 0x55a26d18cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:40.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.649+0000 7ffb8affd700 1 -- 172.21.15.71:0/564319255 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb8c14efa0 con 0x55a26d1642c0 2023-10-06T01:41:40.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.649+0000 7ffb8affd700 1 --2- 172.21.15.71:0/564319255 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a26d1642c0 0x55a26d1bc340 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c003080 tx=0x7ffb7c05c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7b715390accc1e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:40.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.649+0000 7ffb697fa700 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2023-10-06T01:41:40.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.649+0000 7ffb697fa700 1 -- 172.21.15.71:0/564319255 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb7c06d050 con 0x55a26d1642c0 2023-10-06T01:41:40.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.649+0000 7ffb697fa700 1 -- 172.21.15.71:0/564319255 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(42..42 src has 1..42) v4 ==== 6464+0+0 (secure 0 0 0) 0x7ffb7c057020 con 0x55a26d1642c0 2023-10-06T01:41:40.658 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.649+0000 7ffb9a836b80 1 -- 172.21.15.71:0/564319255 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a26d157940 con 0x55a26d1642c0 2023-10-06T01:41:40.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.649+0000 7ffb697fa700 1 -- 172.21.15.71:0/564319255 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffb7c053730 con 0x55a26d1642c0 2023-10-06T01:41:40.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.649+0000 7ffb9a836b80 10 client.5391 fetch_fsmap learned FSMap version 23 2023-10-06T01:41:40.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.649+0000 7ffb9a836b80 1 -- 172.21.15.71:0/564319255 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) v3 -- 0x55a26ceeffe0 con 0x55a26d1642c0 2023-10-06T01:41:40.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.649+0000 7ffb697fa700 1 -- 172.21.15.71:0/564319255 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a26d157940 con 0x55a26d1642c0 2023-10-06T01:41:40.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.649+0000 7ffb697fa700 1 -- 172.21.15.71:0/564319255 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 23) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ffb7c018030 con 0x55a26d1642c0 2023-10-06T01:41:40.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.650+0000 7ffb9a836b80 10 client.5391 fetch_fsmap finished waiting for FSMap version 23 2023-10-06T01:41:40.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.650+0000 7ffb9a836b80 10 client.5391 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T01:41:40.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.650+0000 7ffb9a836b80 20 client.5391 populate_metadata read hostname 'smithi071' 2023-10-06T01:41:40.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.650+0000 7ffb9a836b80 1 --2- 172.21.15.71:0/564319255 >> [v2:172.21.15.71:6835/3598886363,v1:172.21.15.71:6837/3598886363] conn(0x55a26d17df20 0x55a26d17e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:40.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.650+0000 7ffb9a836b80 4 client.5391 mds_command: new command op to 5148 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T01:41:40.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.650+0000 7ffb9a836b80 1 -- 172.21.15.71:0/564319255 --> [v2:172.21.15.71:6835/3598886363,v1:172.21.15.71:6837/3598886363] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a26d134870 con 0x55a26d17df20 2023-10-06T01:41:40.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.650+0000 7ffb827fc700 1 --2- 172.21.15.71:0/564319255 >> [v2:172.21.15.71:6835/3598886363,v1:172.21.15.71:6837/3598886363] conn(0x55a26d17df20 0x55a26d17e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:40.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.650+0000 7ffb697fa700 10 client.5391 ms_handle_connect on v2:172.21.15.71:6835/3598886363 2023-10-06T01:41:40.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.650+0000 7ffb827fc700 1 --2- 172.21.15.71:0/564319255 >> [v2:172.21.15.71:6835/3598886363,v1:172.21.15.71:6837/3598886363] conn(0x55a26d17df20 0x55a26d17e2f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3da4fe153fb7353f server_cookie=eef8369e17b8b9d in_seq=0 out_seq=0 2023-10-06T01:41:40.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.650+0000 7ffb697fa700 1 -- 172.21.15.71:0/564319255 <== mds.0 v2:172.21.15.71:6835/3598886363 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55a26d134870 con 0x55a26d17df20 2023-10-06T01:41:40.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.650+0000 7ffb697fa700 10 client.5391 handle_command_reply: tid=0 2023-10-06T01:41:40.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.650+0000 7ffb9a836b80 1 client.5391 shutdown 2023-10-06T01:41:40.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.651+0000 7ffb9a836b80 1 -- 172.21.15.71:0/564319255 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a26d1642c0 msgr2=0x55a26d1bc340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:40.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.651+0000 7ffb9a836b80 1 --2- 172.21.15.71:0/564319255 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a26d1642c0 0x55a26d1bc340 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c003080 tx=0x7ffb7c05c000 comp rx=0 tx=0).stop 2023-10-06T01:41:40.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.651+0000 7ffb9a836b80 1 -- 172.21.15.71:0/564319255 shutdown_connections 2023-10-06T01:41:40.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.651+0000 7ffb9a836b80 1 --2- 172.21.15.71:0/564319255 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a26d183e50 0x55a26d17d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:40.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.651+0000 7ffb9a836b80 1 --2- 172.21.15.71:0/564319255 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a26d1642c0 0x55a26d1bc340 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:40.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.651+0000 7ffb9a836b80 1 --2- 172.21.15.71:0/564319255 >> [v2:172.21.15.71:6835/3598886363,v1:172.21.15.71:6837/3598886363] conn(0x55a26d17df20 0x55a26d17e2f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:40.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.651+0000 7ffb9a836b80 1 --2- 172.21.15.71:0/564319255 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a26d165a10 0x55a26d18cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:40.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.651+0000 7ffb697fa700 0 client.5391 ms_handle_reset on v2:172.21.15.71:6835/3598886363 2023-10-06T01:41:40.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.651+0000 7ffb9a836b80 1 -- 172.21.15.71:0/564319255 >> 172.21.15.71:0/564319255 conn(0x55a26d163e80 msgr2=0x55a26d164d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:40.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.651+0000 7ffb9a836b80 1 -- 172.21.15.71:0/564319255 shutdown_connections 2023-10-06T01:41:40.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.651+0000 7ffb9a836b80 1 -- 172.21.15.71:0/564319255 wait complete. 2023-10-06T01:41:40.661 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.651+0000 7ffb9a836b80 20 client.5391 trim_cache size 0 max 16384 2023-10-06T01:41:40.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.667+0000 7ffb9a836b80 1 Processor -- start 2023-10-06T01:41:40.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.667+0000 7ffb9a836b80 1 -- start start 2023-10-06T01:41:40.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.668+0000 7ffb9a836b80 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a26d1642c0 0x55a26d17f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:40.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.668+0000 7ffb9a836b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a26d165a10 0x55a26d192560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:40.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.668+0000 7ffb9a836b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a26d183e50 0x55a26d192aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:40.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.668+0000 7ffb9a836b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a26d1cb8a0 con 0x55a26d183e50 2023-10-06T01:41:40.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.668+0000 7ffb9a836b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a26d13b1e0 con 0x55a26d165a10 2023-10-06T01:41:40.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.668+0000 7ffb9a836b80 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a26d1422e0 con 0x55a26d1642c0 2023-10-06T01:41:40.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.668+0000 7ffb8b7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a26d183e50 0x55a26d192aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:40.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.668+0000 7ffb8b7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a26d183e50 0x55a26d192aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57948/0 (socket says 172.21.15.71:57948) 2023-10-06T01:41:40.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.668+0000 7ffb8b7fe700 1 -- 172.21.15.71:0/3735613943 learned_addr learned my addr 172.21.15.71:0/3735613943 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:40.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.668+0000 7ffb827fc700 1 --2- 172.21.15.71:0/3735613943 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a26d165a10 0x55a26d192560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:40.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.668+0000 7ffb8affd700 1 --2- 172.21.15.71:0/3735613943 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a26d1642c0 0x55a26d17f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:40.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.668+0000 7ffb8b7fe700 1 -- 172.21.15.71:0/3735613943 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a26d1642c0 msgr2=0x55a26d17f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:40.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.668+0000 7ffb8b7fe700 1 --2- 172.21.15.71:0/3735613943 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a26d1642c0 0x55a26d17f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:40.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.668+0000 7ffb8b7fe700 1 -- 172.21.15.71:0/3735613943 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a26d165a10 msgr2=0x55a26d192560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:40.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.668+0000 7ffb8b7fe700 1 --2- 172.21.15.71:0/3735613943 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a26d165a10 0x55a26d192560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:40.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.668+0000 7ffb8b7fe700 1 -- 172.21.15.71:0/3735613943 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a26d081780 con 0x55a26d183e50 2023-10-06T01:41:40.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.668+0000 7ffb8affd700 1 --2- 172.21.15.71:0/3735613943 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a26d1642c0 0x55a26d17f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:41:40.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.669+0000 7ffb8b7fe700 1 --2- 172.21.15.71:0/3735613943 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a26d183e50 0x55a26d192aa0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7ffb84003d10 tx=0x7ffb84009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be8f82ee057e7374 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:40.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.669+0000 7ffb80ff9700 1 -- 172.21.15.71:0/3735613943 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb84010650 con 0x55a26d183e50 2023-10-06T01:41:40.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.669+0000 7ffb80ff9700 1 -- 172.21.15.71:0/3735613943 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb840107b0 con 0x55a26d183e50 2023-10-06T01:41:40.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.669+0000 7ffb80ff9700 1 -- 172.21.15.71:0/3735613943 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb84010b30 con 0x55a26d183e50 2023-10-06T01:41:40.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.669+0000 7ffb9a836b80 1 -- 172.21.15.71:0/3735613943 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a26d183e50 msgr2=0x55a26d192aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:40.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.669+0000 7ffb9a836b80 1 --2- 172.21.15.71:0/3735613943 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a26d183e50 0x55a26d192aa0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7ffb84003d10 tx=0x7ffb84009040 comp rx=0 tx=0).stop 2023-10-06T01:41:40.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.669+0000 7ffb9a836b80 1 -- 172.21.15.71:0/3735613943 shutdown_connections 2023-10-06T01:41:40.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.669+0000 7ffb9a836b80 1 --2- 172.21.15.71:0/3735613943 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a26d183e50 0x55a26d192aa0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:40.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.669+0000 7ffb9a836b80 1 --2- 172.21.15.71:0/3735613943 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a26d1642c0 0x55a26d17f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:40.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.669+0000 7ffb9a836b80 1 --2- 172.21.15.71:0/3735613943 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a26d165a10 0x55a26d192560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:40.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.669+0000 7ffb9a836b80 1 -- 172.21.15.71:0/3735613943 >> 172.21.15.71:0/3735613943 conn(0x55a26d163e80 msgr2=0x55a26d1830f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:40.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.669+0000 7ffb9a836b80 1 -- 172.21.15.71:0/3735613943 shutdown_connections 2023-10-06T01:41:40.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.669+0000 7ffb9a836b80 1 -- 172.21.15.71:0/3735613943 wait complete. 2023-10-06T01:41:40.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.670+0000 7ffb9a836b80 1 -- start start 2023-10-06T01:41:40.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.670+0000 7ffb9a836b80 1 Processor -- start 2023-10-06T01:41:40.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.671+0000 7ffb9a836b80 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a26d1642c0 0x55a26d20e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:40.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.671+0000 7ffb9a836b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a26d165a10 0x55a26d15ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:40.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.671+0000 7ffb9a836b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a26d183e50 0x55a26d15f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:40.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.671+0000 7ffb9a836b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a26d1bb470 con 0x55a26d165a10 2023-10-06T01:41:40.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.671+0000 7ffb9a836b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a26d1a7cc0 con 0x55a26d183e50 2023-10-06T01:41:40.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.671+0000 7ffb9a836b80 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a26d20e900 con 0x55a26d1642c0 2023-10-06T01:41:40.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.671+0000 7ffb9a836b80 10 client.0 _ll_register_callbacks cb 0x55a26d126020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T01:41:40.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.671+0000 7ffb827fc700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a26d165a10 0x55a26d15ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:40.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.671+0000 7ffb827fc700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a26d165a10 0x55a26d15ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57962/0 (socket says 172.21.15.71:57962) 2023-10-06T01:41:40.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.671+0000 7ffb827fc700 1 -- 172.21.15.71:0/1267124813 learned_addr learned my addr 172.21.15.71:0/1267124813 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:40.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.671+0000 7ffb8affd700 1 --2- 172.21.15.71:0/1267124813 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a26d1642c0 0x55a26d20e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:40.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.671+0000 7ffb8b7fe700 1 --2- 172.21.15.71:0/1267124813 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a26d183e50 0x55a26d15f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:40.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.671+0000 7ffb827fc700 1 -- 172.21.15.71:0/1267124813 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a26d1642c0 msgr2=0x55a26d20e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:40.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.671+0000 7ffb827fc700 1 --2- 172.21.15.71:0/1267124813 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a26d1642c0 0x55a26d20e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:40.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.671+0000 7ffb827fc700 1 -- 172.21.15.71:0/1267124813 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a26d183e50 msgr2=0x55a26d15f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:40.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.671+0000 7ffb827fc700 1 --2- 172.21.15.71:0/1267124813 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a26d183e50 0x55a26d15f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:40.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.671+0000 7ffb827fc700 1 -- 172.21.15.71:0/1267124813 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb8400f040 con 0x55a26d165a10 2023-10-06T01:41:40.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.671+0000 7ffb827fc700 1 --2- 172.21.15.71:0/1267124813 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a26d165a10 0x55a26d15ead0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7ffb74007da0 tx=0x7ffb74018040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ce7447712e404e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:40.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.671+0000 7ffb697fa700 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2023-10-06T01:41:40.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.671+0000 7ffb697fa700 1 -- 172.21.15.71:0/1267124813 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb74028070 con 0x55a26d165a10 2023-10-06T01:41:40.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.671+0000 7ffb697fa700 1 -- 172.21.15.71:0/1267124813 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(42..42 src has 1..42) v4 ==== 6464+0+0 (secure 0 0 0) 0x7ffb74014430 con 0x55a26d165a10 2023-10-06T01:41:40.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.671+0000 7ffb9a836b80 1 -- 172.21.15.71:0/1267124813 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ffb7c057720 con 0x55a26d165a10 2023-10-06T01:41:40.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.672+0000 7ffb697fa700 1 -- 172.21.15.71:0/1267124813 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffb74023910 con 0x55a26d165a10 2023-10-06T01:41:40.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.672+0000 7ffb9a836b80 10 client.5397 fetch_fsmap learned FSMap version 23 2023-10-06T01:41:40.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.672+0000 7ffb9a836b80 1 -- 172.21.15.71:0/1267124813 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) v3 -- 0x55a26d068470 con 0x55a26d165a10 2023-10-06T01:41:40.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.672+0000 7ffb697fa700 1 -- 172.21.15.71:0/1267124813 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb7c057720 con 0x55a26d165a10 2023-10-06T01:41:40.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.672+0000 7ffb697fa700 1 -- 172.21.15.71:0/1267124813 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 23) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ffb74021070 con 0x55a26d165a10 2023-10-06T01:41:40.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.672+0000 7ffb9a836b80 10 client.5397 fetch_fsmap finished waiting for FSMap version 23 2023-10-06T01:41:40.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.672+0000 7ffb9a836b80 10 client.5397 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T01:41:40.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.672+0000 7ffb9a836b80 20 client.5397 populate_metadata read hostname 'smithi071' 2023-10-06T01:41:40.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.672+0000 7ffb9a836b80 1 --2- 172.21.15.71:0/1267124813 >> [v2:172.21.15.71:6835/3598886363,v1:172.21.15.71:6837/3598886363] conn(0x55a26d20ed90 0x55a26d20f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:40.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.672+0000 7ffb9a836b80 4 client.5397 mds_command: new command op to 5148 tid=0[{"prefix": "status"}] 2023-10-06T01:41:40.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.672+0000 7ffb9a836b80 1 -- 172.21.15.71:0/1267124813 --> [v2:172.21.15.71:6835/3598886363,v1:172.21.15.71:6837/3598886363] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55a26d055e00 con 0x55a26d20ed90 2023-10-06T01:41:40.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.672+0000 7ffb8affd700 1 --2- 172.21.15.71:0/1267124813 >> [v2:172.21.15.71:6835/3598886363,v1:172.21.15.71:6837/3598886363] conn(0x55a26d20ed90 0x55a26d20f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:40.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.672+0000 7ffb697fa700 10 client.5397 ms_handle_connect on v2:172.21.15.71:6835/3598886363 2023-10-06T01:41:40.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.672+0000 7ffb8affd700 1 --2- 172.21.15.71:0/1267124813 >> [v2:172.21.15.71:6835/3598886363,v1:172.21.15.71:6837/3598886363] conn(0x55a26d20ed90 0x55a26d20f160 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=81ddcb3a891dff2a server_cookie=41bc846d78435888 in_seq=0 out_seq=0 2023-10-06T01:41:40.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.672+0000 7ffb697fa700 1 -- 172.21.15.71:0/1267124813 <== mds.0 v2:172.21.15.71:6835/3598886363 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55a26d055e00 con 0x55a26d20ed90 2023-10-06T01:41:40.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.672+0000 7ffb697fa700 10 client.5397 handle_command_reply: tid=0 2023-10-06T01:41:40.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.672+0000 7ffb9a836b80 1 client.5397 shutdown 2023-10-06T01:41:40.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.672+0000 7ffb9a836b80 1 -- 172.21.15.71:0/1267124813 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a26d165a10 msgr2=0x55a26d15ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:40.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.672+0000 7ffb9a836b80 1 --2- 172.21.15.71:0/1267124813 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a26d165a10 0x55a26d15ead0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7ffb74007da0 tx=0x7ffb74018040 comp rx=0 tx=0).stop 2023-10-06T01:41:40.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.673+0000 7ffb9a836b80 1 -- 172.21.15.71:0/1267124813 shutdown_connections 2023-10-06T01:41:40.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.673+0000 7ffb9a836b80 1 --2- 172.21.15.71:0/1267124813 >> [v2:172.21.15.71:6835/3598886363,v1:172.21.15.71:6837/3598886363] conn(0x55a26d20ed90 0x55a26d20f160 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:40.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.673+0000 7ffb9a836b80 1 --2- 172.21.15.71:0/1267124813 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a26d183e50 0x55a26d15f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:40.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.673+0000 7ffb697fa700 0 client.5397 ms_handle_reset on v2:172.21.15.71:6835/3598886363 2023-10-06T01:41:40.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.673+0000 7ffb9a836b80 1 --2- 172.21.15.71:0/1267124813 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a26d1642c0 0x55a26d20e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:40.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.673+0000 7ffb9a836b80 1 --2- 172.21.15.71:0/1267124813 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a26d165a10 0x55a26d15ead0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:40.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.673+0000 7ffb9a836b80 1 -- 172.21.15.71:0/1267124813 >> 172.21.15.71:0/1267124813 conn(0x55a26d163e80 msgr2=0x55a26d162870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:40.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.673+0000 7ffb9a836b80 1 -- 172.21.15.71:0/1267124813 shutdown_connections 2023-10-06T01:41:40.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.673+0000 7ffb9a836b80 1 -- 172.21.15.71:0/1267124813 wait complete. 2023-10-06T01:41:40.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.673+0000 7ffb9a836b80 20 client.5397 trim_cache size 0 max 16384 2023-10-06T01:41:40.684 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2023-10-06T01:41:40.684 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster_fsid": "1fbf1bd2-f9b4-4599-bea2-f4aa920e9a56", 2023-10-06T01:41:40.684 INFO:teuthology.orchestra.run.smithi071.stdout: "whoami": 0, 2023-10-06T01:41:40.684 INFO:teuthology.orchestra.run.smithi071.stdout: "id": 5148, 2023-10-06T01:41:40.684 INFO:teuthology.orchestra.run.smithi071.stdout: "want_state": "up:active", 2023-10-06T01:41:40.684 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "up:active", 2023-10-06T01:41:40.684 INFO:teuthology.orchestra.run.smithi071.stdout: "fs_name": "cephfs", 2023-10-06T01:41:40.684 INFO:teuthology.orchestra.run.smithi071.stdout: "rank_uptime": 4.4914480929999998, 2023-10-06T01:41:40.684 INFO:teuthology.orchestra.run.smithi071.stdout: "mdsmap_epoch": 23, 2023-10-06T01:41:40.684 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_epoch": 42, 2023-10-06T01:41:40.685 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_epoch_barrier": 42, 2023-10-06T01:41:40.685 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 21.451880425999999 2023-10-06T01:41:40.685 INFO:teuthology.orchestra.run.smithi071.stdout:} 2023-10-06T01:41:40.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.673+0000 7ffb8bfff700 1 -- 172.21.15.71:0/2704477408 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7ffb6c066f30 msgr2=0x7ffb6c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:40.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.673+0000 7ffb8bfff700 1 --2- 172.21.15.71:0/2704477408 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7ffb6c066f30 0x7ffb6c0693e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ffb740011e0 tx=0x7ffb740079b0 comp rx=0 tx=0).stop 2023-10-06T01:41:40.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.673+0000 7ffb8bfff700 1 -- 172.21.15.71:0/2704477408 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffb8c0cd030 msgr2=0x7ffb8c14da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:40.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.673+0000 7ffb8bfff700 1 --2- 172.21.15.71:0/2704477408 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffb8c0cd030 0x7ffb8c14da40 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c009260 tx=0x7ffb7c015000 comp rx=0 tx=0).stop 2023-10-06T01:41:40.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.673+0000 7ffb8bfff700 1 -- 172.21.15.71:0/2704477408 shutdown_connections 2023-10-06T01:41:40.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.673+0000 7ffb8bfff700 1 --2- 172.21.15.71:0/2704477408 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffb8c159400 0x7ffb8c1548a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:40.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.673+0000 7ffb8bfff700 1 --2- 172.21.15.71:0/2704477408 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffb8c0cd030 0x7ffb8c14da40 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:40.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.673+0000 7ffb8bfff700 1 --2- 172.21.15.71:0/2704477408 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7ffb6c066f30 0x7ffb6c0693e0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:40.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.673+0000 7ffb8bfff700 1 --2- 172.21.15.71:0/2704477408 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb8c0d05d0 0x7ffb8c14ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:40.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.673+0000 7ffb8bfff700 1 -- 172.21.15.71:0/2704477408 >> 172.21.15.71:0/2704477408 conn(0x7ffb8c06ac10 msgr2=0x7ffb8c1583b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:40.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.673+0000 7ffb8bfff700 1 -- 172.21.15.71:0/2704477408 shutdown_connections 2023-10-06T01:41:40.687 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.673+0000 7ffb8bfff700 1 -- 172.21.15.71:0/2704477408 wait complete. 2023-10-06T01:41:40.687 DEBUG:teuthology.orchestra.run.smithi071:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000000.00000000 parent 2023-10-06T01:41:40.725 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.723+0000 7fde90f6f000 1 Processor -- start 2023-10-06T01:41:40.725 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.724+0000 7fde90f6f000 1 -- start start 2023-10-06T01:41:40.729 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.724+0000 7fde90f6f000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55d4a37f12a0 0x55d4a37c83d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:40.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.724+0000 7fde90f6f000 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d4a38965c0 0x55d4a37f2b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:40.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.724+0000 7fde90f6f000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d4a3896990 0x55d4a3809880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:40.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.724+0000 7fde90f6f000 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4a3710980 con 0x55d4a38965c0 2023-10-06T01:41:40.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.724+0000 7fde90f6f000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4a3710620 con 0x55d4a3896990 2023-10-06T01:41:40.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.724+0000 7fde90f6f000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d4a3707400 con 0x55d4a37f12a0 2023-10-06T01:41:40.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.724+0000 7fde899a9700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d4a38965c0 0x55d4a37f2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:40.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.724+0000 7fde899a9700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d4a38965c0 0x55d4a37f2b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57968/0 (socket says 172.21.15.71:57968) 2023-10-06T01:41:40.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.724+0000 7fde899a9700 1 -- 172.21.15.71:0/1833622864 learned_addr learned my addr 172.21.15.71:0/1833622864 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:40.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.724+0000 7fde8a9ab700 1 --2- 172.21.15.71:0/1833622864 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d4a3896990 0x55d4a3809880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:40.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.724+0000 7fde8a1aa700 1 --2- 172.21.15.71:0/1833622864 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55d4a37f12a0 0x55d4a37c83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:40.730 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.725+0000 7fde899a9700 1 -- 172.21.15.71:0/1833622864 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55d4a37f12a0 msgr2=0x55d4a37c83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:40.731 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.725+0000 7fde899a9700 1 --2- 172.21.15.71:0/1833622864 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55d4a37f12a0 0x55d4a37c83d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:40.731 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.725+0000 7fde899a9700 1 -- 172.21.15.71:0/1833622864 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d4a3896990 msgr2=0x55d4a3809880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:40.731 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.725+0000 7fde899a9700 1 --2- 172.21.15.71:0/1833622864 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d4a3896990 0x55d4a3809880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:40.731 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.725+0000 7fde899a9700 1 -- 172.21.15.71:0/1833622864 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde80005db0 con 0x55d4a38965c0 2023-10-06T01:41:40.731 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.725+0000 7fde899a9700 1 --2- 172.21.15.71:0/1833622864 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d4a38965c0 0x55d4a37f2b50 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fde800099a0 tx=0x7fde8000c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe03b8a654946a52 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:40.731 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.725+0000 7fde889a7700 1 -- 172.21.15.71:0/1833622864 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde8000f040 con 0x55d4a38965c0 2023-10-06T01:41:40.731 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.725+0000 7fde889a7700 1 -- 172.21.15.71:0/1833622864 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde80008970 con 0x55d4a38965c0 2023-10-06T01:41:40.731 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.725+0000 7fde889a7700 1 -- 172.21.15.71:0/1833622864 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde80008cf0 con 0x55d4a38965c0 2023-10-06T01:41:40.731 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.725+0000 7fde90f6f000 1 -- 172.21.15.71:0/1833622864 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d4a38965c0 msgr2=0x55d4a37f2b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:40.731 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.725+0000 7fde90f6f000 1 --2- 172.21.15.71:0/1833622864 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d4a38965c0 0x55d4a37f2b50 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fde800099a0 tx=0x7fde8000c040 comp rx=0 tx=0).stop 2023-10-06T01:41:40.731 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.725+0000 7fde90f6f000 1 -- 172.21.15.71:0/1833622864 shutdown_connections 2023-10-06T01:41:40.732 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.725+0000 7fde90f6f000 1 --2- 172.21.15.71:0/1833622864 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d4a3896990 0x55d4a3809880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:40.732 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.725+0000 7fde90f6f000 1 --2- 172.21.15.71:0/1833622864 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55d4a37f12a0 0x55d4a37c83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:40.732 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.725+0000 7fde90f6f000 1 --2- 172.21.15.71:0/1833622864 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d4a38965c0 0x55d4a37f2b50 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:40.732 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.725+0000 7fde90f6f000 1 -- 172.21.15.71:0/1833622864 >> 172.21.15.71:0/1833622864 conn(0x55d4a37c5d50 msgr2=0x55d4a3894830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:40.732 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.725+0000 7fde90f6f000 1 -- 172.21.15.71:0/1833622864 shutdown_connections 2023-10-06T01:41:40.732 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.725+0000 7fde90f6f000 1 -- 172.21.15.71:0/1833622864 wait complete. 2023-10-06T01:41:40.732 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.726+0000 7fde90f6f000 1 Processor -- start 2023-10-06T01:41:40.732 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.726+0000 7fde90f6f000 1 -- start start 2023-10-06T01:41:40.732 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.727+0000 7fde90f6f000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55d4a37f12a0 0x55d4a38af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:40.732 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.727+0000 7fde90f6f000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d4a38965c0 0x55d4a380aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:40.732 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.727+0000 7fde90f6f000 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d4a3896990 0x55d4a380b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:40.733 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.727+0000 7fde90f6f000 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4a38ae950 con 0x55d4a3896990 2023-10-06T01:41:40.733 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.727+0000 7fde90f6f000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4a38aebf0 con 0x55d4a38965c0 2023-10-06T01:41:40.733 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.727+0000 7fde90f6f000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d4a38aee90 con 0x55d4a37f12a0 2023-10-06T01:41:40.733 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.727+0000 7fde8a9ab700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d4a3896990 0x55d4a380b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:40.733 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.727+0000 7fde8a9ab700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d4a3896990 0x55d4a380b3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57976/0 (socket says 172.21.15.71:57976) 2023-10-06T01:41:40.733 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.727+0000 7fde8a9ab700 1 -- 172.21.15.71:0/3490178577 learned_addr learned my addr 172.21.15.71:0/3490178577 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:40.733 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.727+0000 7fde8a1aa700 1 --2- 172.21.15.71:0/3490178577 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55d4a37f12a0 0x55d4a38af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:40.733 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.727+0000 7fde899a9700 1 --2- 172.21.15.71:0/3490178577 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d4a38965c0 0x55d4a380aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:40.733 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.727+0000 7fde8a9ab700 1 -- 172.21.15.71:0/3490178577 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55d4a37f12a0 msgr2=0x55d4a38af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:40.733 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.727+0000 7fde8a9ab700 1 --2- 172.21.15.71:0/3490178577 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55d4a37f12a0 0x55d4a38af5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:40.733 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.727+0000 7fde8a9ab700 1 -- 172.21.15.71:0/3490178577 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d4a38965c0 msgr2=0x55d4a380aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:40.733 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.727+0000 7fde8a9ab700 1 --2- 172.21.15.71:0/3490178577 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55d4a38965c0 0x55d4a380aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:40.734 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.727+0000 7fde8a9ab700 1 -- 172.21.15.71:0/3490178577 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde800095a0 con 0x55d4a3896990 2023-10-06T01:41:40.734 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.727+0000 7fde8a9ab700 1 --2- 172.21.15.71:0/3490178577 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d4a3896990 0x55d4a380b3e0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x55d4a37f21c0 tx=0x7fde84016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:40.734 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.727+0000 7fde7affd700 1 -- 172.21.15.71:0/3490178577 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde840054f0 con 0x55d4a3896990 2023-10-06T01:41:40.734 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.727+0000 7fde7affd700 1 -- 172.21.15.71:0/3490178577 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde84008b80 con 0x55d4a3896990 2023-10-06T01:41:40.734 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.727+0000 7fde90f6f000 1 -- 172.21.15.71:0/3490178577 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde84005cf0 con 0x55d4a3896990 2023-10-06T01:41:40.734 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.727+0000 7fde7affd700 1 -- 172.21.15.71:0/3490178577 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde8401e680 con 0x55d4a3896990 2023-10-06T01:41:40.734 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.727+0000 7fde90f6f000 1 -- 172.21.15.71:0/3490178577 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d4a371f3d0 con 0x55d4a3896990 2023-10-06T01:41:40.736 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.729+0000 7fde7affd700 1 -- 172.21.15.71:0/3490178577 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fde8401eab0 con 0x55d4a3896990 2023-10-06T01:41:40.736 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.729+0000 7fde7affd700 1 --2- 172.21.15.71:0/3490178577 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fde6c065890 0x7fde6c067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:40.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.729+0000 7fde7affd700 1 -- 172.21.15.71:0/3490178577 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fde84085c40 con 0x55d4a3896990 2023-10-06T01:41:40.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.729+0000 7fde8a1aa700 1 --2- 172.21.15.71:0/3490178577 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fde6c065890 0x7fde6c067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:40.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.729+0000 7fde90f6f000 1 --2- 172.21.15.71:0/3490178577 >> [v2:172.21.15.71:6816/90670,v1:172.21.15.71:6817/90670] conn(0x55d4a38aa960 0x55d4a38b7e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:40.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.729+0000 7fde90f6f000 1 -- 172.21.15.71:0/3490178577 --> [v2:172.21.15.71:6816/90670,v1:172.21.15.71:6817/90670] -- osd_op(unknown.0.0:1 6.10 6:0cf6ad0f:::10000000000.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42) v8 -- 0x55d4a38aad60 con 0x55d4a38aa960 2023-10-06T01:41:40.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.729+0000 7fde899a9700 1 --2- 172.21.15.71:0/3490178577 >> [v2:172.21.15.71:6816/90670,v1:172.21.15.71:6817/90670] conn(0x55d4a38aa960 0x55d4a38b7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:40.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.729+0000 7fde8a1aa700 1 --2- 172.21.15.71:0/3490178577 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fde6c065890 0x7fde6c067d40 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fde7c004290 tx=0x7fde7c000f40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:40.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.730+0000 7fde899a9700 1 --2- 172.21.15.71:0/3490178577 >> [v2:172.21.15.71:6816/90670,v1:172.21.15.71:6817/90670] conn(0x55d4a38aa960 0x55d4a38b7e50 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:40.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.731+0000 7fde899a9700 1 -- 172.21.15.71:0/3490178577 <== osd.0 v2:172.21.15.71:6816/90670 1 ==== osd_op_reply(1 10000000000.00000000 [rmxattr] v42'11 uv11 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fde80008b70 con 0x55d4a38aa960 2023-10-06T01:41:40.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.731+0000 7fde90f6f000 1 -- 172.21.15.71:0/3490178577 >> [v2:172.21.15.71:6816/90670,v1:172.21.15.71:6817/90670] conn(0x55d4a38aa960 msgr2=0x55d4a38b7e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:40.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.731+0000 7fde90f6f000 1 --2- 172.21.15.71:0/3490178577 >> [v2:172.21.15.71:6816/90670,v1:172.21.15.71:6817/90670] conn(0x55d4a38aa960 0x55d4a38b7e50 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:40.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.731+0000 7fde90f6f000 1 -- 172.21.15.71:0/3490178577 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fde6c065890 msgr2=0x7fde6c067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:40.738 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.731+0000 7fde90f6f000 1 --2- 172.21.15.71:0/3490178577 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fde6c065890 0x7fde6c067d40 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fde7c004290 tx=0x7fde7c000f40 comp rx=0 tx=0).stop 2023-10-06T01:41:40.738 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.731+0000 7fde90f6f000 1 -- 172.21.15.71:0/3490178577 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d4a3896990 msgr2=0x55d4a380b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:40.738 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.731+0000 7fde90f6f000 1 --2- 172.21.15.71:0/3490178577 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d4a3896990 0x55d4a380b3e0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x55d4a37f21c0 tx=0x7fde84016000 comp rx=0 tx=0).stop 2023-10-06T01:41:40.738 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.731+0000 7fde8a9ab700 1 -- 172.21.15.71:0/3490178577 reap_dead start 2023-10-06T01:41:40.738 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.731+0000 7fde90f6f000 1 -- 172.21.15.71:0/3490178577 shutdown_connections 2023-10-06T01:41:40.738 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.731+0000 7fde90f6f000 1 -- 172.21.15.71:0/3490178577 >> 172.21.15.71:0/3490178577 conn(0x55d4a37c5d50 msgr2=0x55d4a37f4a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:40.738 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.731+0000 7fde90f6f000 1 -- 172.21.15.71:0/3490178577 shutdown_connections 2023-10-06T01:41:40.738 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.732+0000 7fde90f6f000 1 -- 172.21.15.71:0/3490178577 wait complete. 2023-10-06T01:41:40.739 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T01:41:40.891 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.889+0000 7f3692d15700 1 Processor -- start 2023-10-06T01:41:40.891 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.889+0000 7f3692d15700 1 -- start start 2023-10-06T01:41:40.893 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.890+0000 7f3692d15700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f368c159400 0x7f368c0ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:40.893 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.890+0000 7f3692d15700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f368c0d05d0 0x7f368c0b39f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:40.893 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.890+0000 7f3692d15700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f368c0b3560 con 0x7f368c0cd030 2023-10-06T01:41:40.894 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.890+0000 7f3692d15700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f368c0cf6f0 con 0x7f368c159400 2023-10-06T01:41:40.894 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.890+0000 7f3692d15700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f368c0cf9d0 con 0x7f368c0d05d0 2023-10-06T01:41:40.894 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.890+0000 7f3691d13700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f368c159400 0x7f368c0ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:40.894 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.890+0000 7f3691d13700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f368c159400 0x7f368c0ccaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57986/0 (socket says 172.21.15.71:57986) 2023-10-06T01:41:40.894 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.890+0000 7f3691512700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f368c0cd030 0x7f368c0cfec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:58428/0 (socket says 172.21.15.71:58428) 2023-10-06T01:41:40.894 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.890+0000 7f3691d13700 1 -- 172.21.15.71:0/1254466996 learned_addr learned my addr 172.21.15.71:0/1254466996 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:40.894 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.890+0000 7f3692514700 1 --2- 172.21.15.71:0/1254466996 >> v2:172.21.15.72:3300/0 conn(0x7f368c0d05d0 0x7f368c0b39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:40.894 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.890+0000 7f3691d13700 1 -- 172.21.15.71:0/1254466996 >> v2:172.21.15.72:3300/0 conn(0x7f368c0d05d0 msgr2=0x7f368c0b39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:40.894 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.890+0000 7f3691d13700 1 --2- 172.21.15.71:0/1254466996 >> v2:172.21.15.72:3300/0 conn(0x7f368c0d05d0 0x7f368c0b39f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:40.894 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.890+0000 7f3691d13700 1 -- 172.21.15.71:0/1254466996 >> v1:172.21.15.71:6789/0 conn(0x7f368c0cd030 legacy=0x7f368c0cfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:40.894 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.890+0000 7f3691d13700 1 -- 172.21.15.71:0/1254466996 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f368c0b2f10 con 0x7f368c159400 2023-10-06T01:41:40.895 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.890+0000 7f3690d11700 1 -- 172.21.15.71:0/1254466996 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1647336750 0 0) 0x7f368c0b3560 con 0x7f368c0cd030 2023-10-06T01:41:40.895 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.891+0000 7f3691d13700 1 --2- 172.21.15.71:0/1254466996 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f368c159400 0x7f368c0ccaf0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f368c0b34d0 tx=0x7f3684009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe35506dc39560b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:40.895 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.891+0000 7f3690d11700 1 -- 172.21.15.71:0/1254466996 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f368400e070 con 0x7f368c159400 2023-10-06T01:41:40.895 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.891+0000 7f3690d11700 1 -- 172.21.15.71:0/1254466996 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f368400bad0 con 0x7f368c159400 2023-10-06T01:41:40.895 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.891+0000 7f3690d11700 1 -- 172.21.15.71:0/1254466996 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36840092e0 con 0x7f368c159400 2023-10-06T01:41:40.895 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.891+0000 7f3692d15700 1 -- 172.21.15.71:0/1254466996 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f368c159400 msgr2=0x7f368c0ccaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:40.895 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.891+0000 7f3692d15700 1 --2- 172.21.15.71:0/1254466996 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f368c159400 0x7f368c0ccaf0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f368c0b34d0 tx=0x7f3684009840 comp rx=0 tx=0).stop 2023-10-06T01:41:40.895 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.891+0000 7f3692d15700 1 -- 172.21.15.71:0/1254466996 shutdown_connections 2023-10-06T01:41:40.895 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.891+0000 7f3692d15700 1 --2- 172.21.15.71:0/1254466996 >> v2:172.21.15.72:3300/0 conn(0x7f368c0d05d0 0x7f368c0b39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:40.895 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.891+0000 7f3692d15700 1 --2- 172.21.15.71:0/1254466996 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f368c159400 0x7f368c0ccaf0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:40.895 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.891+0000 7f3692d15700 1 -- 172.21.15.71:0/1254466996 >> 172.21.15.71:0/1254466996 conn(0x7f368c06ac10 msgr2=0x7f368c068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:40.896 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.891+0000 7f3692d15700 1 -- 172.21.15.71:0/1254466996 shutdown_connections 2023-10-06T01:41:40.896 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.891+0000 7f3692d15700 1 -- 172.21.15.71:0/1254466996 wait complete. 2023-10-06T01:41:40.898 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.892+0000 7f3692d15700 1 Processor -- start 2023-10-06T01:41:40.898 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.892+0000 7f3692d15700 1 -- start start 2023-10-06T01:41:40.898 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.893+0000 7f3692d15700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f368c0cd030 0x7f368c15c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:40.898 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.893+0000 7f3692d15700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f368c0d05d0 0x7f368c146be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:40.899 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.893+0000 7f3692d15700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f368c159400 0x7f368c15a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:40.899 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.893+0000 7f3692d15700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f368c15bd10 con 0x7f368c0d05d0 2023-10-06T01:41:40.899 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.893+0000 7f3692d15700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f368c147120 con 0x7f368c0cd030 2023-10-06T01:41:40.899 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.893+0000 7f3692d15700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f368c15b100 con 0x7f368c159400 2023-10-06T01:41:40.899 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.893+0000 7f3691512700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f368c0d05d0 0x7f368c146be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:40.899 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.893+0000 7f3691512700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f368c0d05d0 0x7f368c146be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:57994/0 (socket says 172.21.15.71:57994) 2023-10-06T01:41:40.899 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.893+0000 7f3691512700 1 -- 172.21.15.71:0/4021692006 learned_addr learned my addr 172.21.15.71:0/4021692006 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:40.899 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.893+0000 7f3691512700 1 -- 172.21.15.71:0/4021692006 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f368c159400 msgr2=0x7f368c15a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:40.899 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.893+0000 7f3692514700 1 --2- 172.21.15.71:0/4021692006 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f368c159400 0x7f368c15a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:40.899 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.893+0000 7f3691d13700 1 --2- 172.21.15.71:0/4021692006 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f368c0cd030 0x7f368c15c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:40.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.893+0000 7f3691512700 1 --2- 172.21.15.71:0/4021692006 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f368c159400 0x7f368c15a7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:40.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.893+0000 7f3691512700 1 -- 172.21.15.71:0/4021692006 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f368c0cd030 msgr2=0x7f368c15c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:40.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.893+0000 7f3691512700 1 --2- 172.21.15.71:0/4021692006 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f368c0cd030 0x7f368c15c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:40.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.893+0000 7f3691512700 1 -- 172.21.15.71:0/4021692006 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3684009ae0 con 0x7f368c0d05d0 2023-10-06T01:41:40.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.894+0000 7f3691512700 1 --2- 172.21.15.71:0/4021692006 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f368c0d05d0 0x7f368c146be0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f36800011e0 tx=0x7f3680007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:40.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.894+0000 7f3689ffb700 1 -- 172.21.15.71:0/4021692006 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3680007300 con 0x7f368c0d05d0 2023-10-06T01:41:40.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.894+0000 7f3689ffb700 1 -- 172.21.15.71:0/4021692006 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3680007460 con 0x7f368c0d05d0 2023-10-06T01:41:40.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.894+0000 7f3692d15700 1 -- 172.21.15.71:0/4021692006 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f368c15b3e0 con 0x7f368c0d05d0 2023-10-06T01:41:40.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.894+0000 7f3689ffb700 1 -- 172.21.15.71:0/4021692006 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3680004830 con 0x7f368c0d05d0 2023-10-06T01:41:40.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.894+0000 7f3692d15700 1 -- 172.21.15.71:0/4021692006 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f368c15b9a0 con 0x7f368c0d05d0 2023-10-06T01:41:40.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.895+0000 7f3692d15700 1 -- 172.21.15.71:0/4021692006 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f368c0cf340 con 0x7f368c0d05d0 2023-10-06T01:41:40.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.895+0000 7f3689ffb700 1 -- 172.21.15.71:0/4021692006 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3680004be0 con 0x7f368c0d05d0 2023-10-06T01:41:40.901 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.895+0000 7f3689ffb700 1 --2- 172.21.15.71:0/4021692006 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f3678066f30 0x7f36780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:40.901 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.895+0000 7f3689ffb700 1 -- 172.21.15.71:0/4021692006 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f3680083d60 con 0x7f368c0d05d0 2023-10-06T01:41:40.901 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.896+0000 7f3691d13700 1 --2- 172.21.15.71:0/4021692006 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f3678066f30 0x7f36780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:40.901 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.896+0000 7f3691d13700 1 --2- 172.21.15.71:0/4021692006 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f3678066f30 0x7f36780693e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3684009fd0 tx=0x7f3684018000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:40.901 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:40.900+0000 7f3689ffb700 1 -- 172.21.15.71:0/4021692006 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3680050d60 con 0x7f368c0d05d0 2023-10-06T01:41:41.127 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:41.125+0000 7f3692d15700 1 -- 172.21.15.71:0/4021692006 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f368c15be50 con 0x7f368c0d05d0 2023-10-06T01:41:41.127 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:41.125+0000 7f3689ffb700 1 -- 172.21.15.71:0/4021692006 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v23) v1 ==== 53+0+73 (secure 0 0 0) 0x7f3680018020 con 0x7f368c0d05d0 2023-10-06T01:41:41.127 INFO:teuthology.orchestra.run.smithi071.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T01:41:41.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:41.127+0000 7f3692d15700 1 -- 172.21.15.71:0/4021692006 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f3678066f30 msgr2=0x7f36780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:41.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:41.127+0000 7f3692d15700 1 --2- 172.21.15.71:0/4021692006 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f3678066f30 0x7f36780693e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3684009fd0 tx=0x7f3684018000 comp rx=0 tx=0).stop 2023-10-06T01:41:41.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:41.127+0000 7f3692d15700 1 -- 172.21.15.71:0/4021692006 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f368c0d05d0 msgr2=0x7f368c146be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:41.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:41.127+0000 7f3692d15700 1 --2- 172.21.15.71:0/4021692006 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f368c0d05d0 0x7f368c146be0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f36800011e0 tx=0x7f3680007e10 comp rx=0 tx=0).stop 2023-10-06T01:41:41.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:41.127+0000 7f3692d15700 1 -- 172.21.15.71:0/4021692006 shutdown_connections 2023-10-06T01:41:41.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:41.127+0000 7f3692d15700 1 --2- 172.21.15.71:0/4021692006 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f368c159400 0x7f368c15a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:41.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:41.127+0000 7f3692d15700 1 --2- 172.21.15.71:0/4021692006 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f3678066f30 0x7f36780693e0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:41.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:41.127+0000 7f3692d15700 1 --2- 172.21.15.71:0/4021692006 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f368c0cd030 0x7f368c15c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:41.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:41.127+0000 7f3692d15700 1 --2- 172.21.15.71:0/4021692006 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f368c0d05d0 0x7f368c146be0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:41.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:41.127+0000 7f3692d15700 1 -- 172.21.15.71:0/4021692006 >> 172.21.15.71:0/4021692006 conn(0x7f368c06ac10 msgr2=0x7f368c0b46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:41.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:41.128+0000 7f3692d15700 1 -- 172.21.15.71:0/4021692006 shutdown_connections 2023-10-06T01:41:41.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:41.128+0000 7f3692d15700 1 -- 172.21.15.71:0/4021692006 wait complete. 2023-10-06T01:41:41.141 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T01:41:41.141 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T01:41:41.141 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi071.front.sepia.ceph.com 2023-10-06T01:41:41.141 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T01:41:41.141 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T01:41:41.141 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T01:41:41.141 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T01:41:41.141 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T01:41:41.141 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T01:41:41.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:41:41.142 DEBUG:teuthology.orchestra.run.smithi071:> ip addr 2023-10-06T01:41:41.156 INFO:teuthology.orchestra.run.smithi071.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T01:41:41.157 INFO:teuthology.orchestra.run.smithi071.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T01:41:41.157 INFO:teuthology.orchestra.run.smithi071.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T01:41:41.157 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:41:41.157 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 ::1/128 scope host 2023-10-06T01:41:41.157 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:41:41.157 INFO:teuthology.orchestra.run.smithi071.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T01:41:41.157 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:d8:aa:4a brd ff:ff:ff:ff:ff:ff 2023-10-06T01:41:41.157 INFO:teuthology.orchestra.run.smithi071.stdout: altname enp7s0f0 2023-10-06T01:41:41.157 INFO:teuthology.orchestra.run.smithi071.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T01:41:41.157 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:d8:aa:4b brd ff:ff:ff:ff:ff:ff 2023-10-06T01:41:41.158 INFO:teuthology.orchestra.run.smithi071.stdout: altname enp7s0f1 2023-10-06T01:41:41.158 INFO:teuthology.orchestra.run.smithi071.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T01:41:41.158 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:8f:d7:64 brd ff:ff:ff:ff:ff:ff 2023-10-06T01:41:41.158 INFO:teuthology.orchestra.run.smithi071.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T01:41:41.158 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:8f:d7:65 brd ff:ff:ff:ff:ff:ff 2023-10-06T01:41:41.158 INFO:teuthology.orchestra.run.smithi071.stdout: inet 172.21.15.71/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T01:41:41.158 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft 42274sec preferred_lft 42274sec 2023-10-06T01:41:41.158 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::ec4:7aff:fe8f:d765/64 scope link 2023-10-06T01:41:41.158 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:41:41.158 INFO:teuthology.orchestra.run.smithi071.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T01:41:41.158 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 26:9a:64:34:3b:3a brd ff:ff:ff:ff:ff:ff 2023-10-06T01:41:41.158 INFO:teuthology.orchestra.run.smithi071.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T01:41:41.159 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:41:41.159 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::44c7:acff:febb:6c0/64 scope link 2023-10-06T01:41:41.159 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:41:41.159 INFO:teuthology.orchestra.run.smithi071.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T01:41:41.159 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 26:9a:64:34:3b:3a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T01:41:41.159 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::249a:64ff:fe34:3b3a/64 scope link 2023-10-06T01:41:41.159 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:41:41.159 INFO:teuthology.orchestra.run.smithi071.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T01:41:41.159 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 8a:01:60:14:cf:f7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T01:41:41.159 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::8801:60ff:fe14:cff7/64 scope link 2023-10-06T01:41:41.159 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:41:41.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:41:41.160 DEBUG:teuthology.orchestra.run.smithi071:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T01:41:41.219 INFO:teuthology.orchestra.run.smithi071.stdout:1 2023-10-06T01:41:41.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:41:41.221 DEBUG:teuthology.orchestra.run.smithi071:> route 2023-10-06T01:41:41.276 INFO:teuthology.orchestra.run.smithi071.stdout:Kernel IP routing table 2023-10-06T01:41:41.276 INFO:teuthology.orchestra.run.smithi071.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T01:41:41.276 INFO:teuthology.orchestra.run.smithi071.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T01:41:41.276 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T01:41:41.277 INFO:teuthology.orchestra.run.smithi071.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T01:41:41.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:41:41.277 DEBUG:teuthology.orchestra.run.smithi071:> (cd / && exec bash -c ' 2023-10-06T01:41:41.277 DEBUG:teuthology.orchestra.run.smithi071:> set -e 2023-10-06T01:41:41.277 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T01:41:41.277 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T01:41:41.277 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T01:41:41.277 DEBUG:teuthology.orchestra.run.smithi071:> ') 2023-10-06T01:41:41.375 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:41:41.376 DEBUG:teuthology.orchestra.run.smithi071:> ip netns list 2023-10-06T01:41:41.390 INFO:teuthology.orchestra.run.smithi071.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T01:41:41.390 INFO:teuthology.orchestra.run.smithi071.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T01:41:41.390 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T01:41:41.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:41:41.390 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link set brx.0 up 2023-10-06T01:41:41.454 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-06T01:41:41.455 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T01:41:41.455 DEBUG:teuthology.orchestra.run.smithi071:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T01:41:41.511 INFO:teuthology.orchestra.run.smithi071.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T01:41:41.511 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T01:41:41.511 DEBUG:teuthology.orchestra.run.smithi071:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T01:41:41.565 DEBUG:teuthology.orchestra.run.smithi071:> sudo modprobe fuse 2023-10-06T01:41:41.629 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T01:41:41.630 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T01:41:41.693 INFO:teuthology.orchestra.run.smithi071.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T01:41:41.693 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T01:41:41.694 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T01:41:41.694 DEBUG:teuthology.orchestra.run.smithi071:> ls /sys/fs/fuse/connections 2023-10-06T01:41:41.749 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T01:41:41.749 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-06T01:41:41.792 DEBUG:teuthology.orchestra.run.smithi071:> sudo modprobe fuse 2023-10-06T01:41:41.815 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T01:41:41.815 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T01:41:41.873 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi071.stderr:2023-10-06T01:41:41.872+0000 7f13d9591540 -1 init, newargv = 0x55757381c7b0 newargc=15 2023-10-06T01:41:41.873 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi071.stderr:ceph-fuse[106154]: starting ceph client 2023-10-06T01:41:41.877 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi071.stderr:ceph-fuse[106154]: starting fuse 2023-10-06T01:41:41.882 INFO:teuthology.orchestra.run.smithi071.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T01:41:41.883 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T01:41:41.883 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T01:41:41.883 DEBUG:teuthology.orchestra.run.smithi071:> ls /sys/fs/fuse/connections 2023-10-06T01:41:41.938 INFO:teuthology.orchestra.run.smithi071.stdout:46 2023-10-06T01:41:41.938 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-10-06T01:41:41.938 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T01:41:41.938 DEBUG:teuthology.orchestra.run.smithi071:> import glob 2023-10-06T01:41:41.939 DEBUG:teuthology.orchestra.run.smithi071:> import re 2023-10-06T01:41:41.939 DEBUG:teuthology.orchestra.run.smithi071:> import os 2023-10-06T01:41:41.939 DEBUG:teuthology.orchestra.run.smithi071:> import subprocess 2023-10-06T01:41:41.939 DEBUG:teuthology.orchestra.run.smithi071:> 2023-10-06T01:41:41.939 DEBUG:teuthology.orchestra.run.smithi071:> def _find_admin_socket(client_name): 2023-10-06T01:41:41.939 DEBUG:teuthology.orchestra.run.smithi071:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-06T01:41:41.939 DEBUG:teuthology.orchestra.run.smithi071:> files = glob.glob(asok_path) 2023-10-06T01:41:41.939 DEBUG:teuthology.orchestra.run.smithi071:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-06T01:41:41.939 DEBUG:teuthology.orchestra.run.smithi071:> 2023-10-06T01:41:41.939 DEBUG:teuthology.orchestra.run.smithi071:> # Given a non-glob path, it better be there 2023-10-06T01:41:41.939 DEBUG:teuthology.orchestra.run.smithi071:> if "*" not in asok_path: 2023-10-06T01:41:41.940 DEBUG:teuthology.orchestra.run.smithi071:> assert(len(files) == 1) 2023-10-06T01:41:41.940 DEBUG:teuthology.orchestra.run.smithi071:> return files[0] 2023-10-06T01:41:41.940 DEBUG:teuthology.orchestra.run.smithi071:> 2023-10-06T01:41:41.940 DEBUG:teuthology.orchestra.run.smithi071:> for f in files: 2023-10-06T01:41:41.940 DEBUG:teuthology.orchestra.run.smithi071:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T01:41:41.940 DEBUG:teuthology.orchestra.run.smithi071:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T01:41:41.940 DEBUG:teuthology.orchestra.run.smithi071:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T01:41:41.940 DEBUG:teuthology.orchestra.run.smithi071:> contents = proc_f.read() 2023-10-06T01:41:41.941 DEBUG:teuthology.orchestra.run.smithi071:> if mountpoint in contents: 2023-10-06T01:41:41.941 DEBUG:teuthology.orchestra.run.smithi071:> return f 2023-10-06T01:41:41.941 DEBUG:teuthology.orchestra.run.smithi071:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T01:41:41.941 DEBUG:teuthology.orchestra.run.smithi071:> 2023-10-06T01:41:41.941 DEBUG:teuthology.orchestra.run.smithi071:> print(_find_admin_socket("client.0")) 2023-10-06T01:41:41.941 DEBUG:teuthology.orchestra.run.smithi071:> ' 2023-10-06T01:41:42.058 INFO:teuthology.orchestra.run.smithi071.stdout:/var/run/ceph/ceph-client.0.106154.asok 2023-10-06T01:41:42.241 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.106154.asok 2023-10-06T01:41:42.241 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T01:41:42.241 DEBUG:teuthology.orchestra.run.smithi071:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.106154.asok status 2023-10-06T01:41:42.390 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2023-10-06T01:41:42.390 INFO:teuthology.orchestra.run.smithi071.stdout: "metadata": { 2023-10-06T01:41:42.390 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_sha1": "736ac5ba72cb47af7d6f6666b1e100f7e20a20e2", 2023-10-06T01:41:42.391 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_version": "ceph version 17.2.6-1296-g736ac5ba (736ac5ba72cb47af7d6f6666b1e100f7e20a20e2) quincy (stable)", 2023-10-06T01:41:42.391 INFO:teuthology.orchestra.run.smithi071.stdout: "entity_id": "0", 2023-10-06T01:41:42.391 INFO:teuthology.orchestra.run.smithi071.stdout: "hostname": "smithi071", 2023-10-06T01:41:42.391 INFO:teuthology.orchestra.run.smithi071.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-06T01:41:42.391 INFO:teuthology.orchestra.run.smithi071.stdout: "pid": "106154", 2023-10-06T01:41:42.391 INFO:teuthology.orchestra.run.smithi071.stdout: "root": "/" 2023-10-06T01:41:42.391 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-06T01:41:42.391 INFO:teuthology.orchestra.run.smithi071.stdout: "dentry_count": 0, 2023-10-06T01:41:42.391 INFO:teuthology.orchestra.run.smithi071.stdout: "dentry_pinned_count": 0, 2023-10-06T01:41:42.391 INFO:teuthology.orchestra.run.smithi071.stdout: "id": 5418, 2023-10-06T01:41:42.391 INFO:teuthology.orchestra.run.smithi071.stdout: "inst": { 2023-10-06T01:41:42.392 INFO:teuthology.orchestra.run.smithi071.stdout: "name": { 2023-10-06T01:41:42.392 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "client", 2023-10-06T01:41:42.392 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 5418 2023-10-06T01:41:42.392 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-06T01:41:42.392 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": { 2023-10-06T01:41:42.392 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2023-10-06T01:41:42.392 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "192.168.0.1:0", 2023-10-06T01:41:42.392 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 3117677977 2023-10-06T01:41:42.392 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-06T01:41:42.392 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-06T01:41:42.392 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": { 2023-10-06T01:41:42.393 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2023-10-06T01:41:42.393 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "192.168.0.1:0", 2023-10-06T01:41:42.393 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 3117677977 2023-10-06T01:41:42.393 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-06T01:41:42.393 INFO:teuthology.orchestra.run.smithi071.stdout: "inst_str": "client.5418 192.168.0.1:0/3117677977", 2023-10-06T01:41:42.393 INFO:teuthology.orchestra.run.smithi071.stdout: "addr_str": "192.168.0.1:0/3117677977", 2023-10-06T01:41:42.393 INFO:teuthology.orchestra.run.smithi071.stdout: "inode_count": 1, 2023-10-06T01:41:42.393 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_epoch": 23, 2023-10-06T01:41:42.393 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_epoch": 42, 2023-10-06T01:41:42.393 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_epoch_barrier": 0, 2023-10-06T01:41:42.394 INFO:teuthology.orchestra.run.smithi071.stdout: "blocklisted": false, 2023-10-06T01:41:42.394 INFO:teuthology.orchestra.run.smithi071.stdout: "fs_name": "cephfs" 2023-10-06T01:41:42.394 INFO:teuthology.orchestra.run.smithi071.stdout:} 2023-10-06T01:41:42.400 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T01:41:42.400 DEBUG:teuthology.orchestra.run.smithi071:> stat --file-system '--printf=%T 2023-10-06T01:41:42.400 DEBUG:teuthology.orchestra.run.smithi071:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-06T01:41:42.415 INFO:teuthology.orchestra.run.smithi071.stdout:fuseblk 2023-10-06T01:41:42.415 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-06T01:41:42.415 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T01:41:42.416 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T01:41:42.480 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T01:41:42.480 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls testdir1) 2023-10-06T01:41:42.537 INFO:tasks.ceph.mds.a.smithi071.stderr:2023-10-06T01:41:42.536+0000 7f6a64fb0700 -1 log_channel(cluster) log [ERR] : bad backtrace on directory inode 0x10000000000 2023-10-06T01:41:42.538 INFO:teuthology.orchestra.run.smithi071.stdout:testfile 2023-10-06T01:41:42.539 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T01:41:42.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:42.691+0000 7f91a920a700 1 Processor -- start 2023-10-06T01:41:42.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:42.691+0000 7f91a920a700 1 -- start start 2023-10-06T01:41:42.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:42.692+0000 7f91a920a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f91a40af4e0 0x7f91a40b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:42.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:42.692+0000 7f91a920a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f91a415db70 0x7f91a40b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:42.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:42.692+0000 7f91a920a700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91a415e190 con 0x7f91a40af8b0 2023-10-06T01:41:42.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:42.692+0000 7f91a920a700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91a40b1910 con 0x7f91a415db70 2023-10-06T01:41:42.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:42.692+0000 7f91a920a700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91a415dfa0 con 0x7f91a40af4e0 2023-10-06T01:41:42.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:42.692+0000 7f91a359e700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f91a415db70 0x7f91a40b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:42.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:42.692+0000 7f91a359e700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f91a415db70 0x7f91a40b2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:58002/0 (socket says 172.21.15.71:58002) 2023-10-06T01:41:42.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:42.692+0000 7f91a359e700 1 -- 172.21.15.71:0/1911321953 learned_addr learned my addr 172.21.15.71:0/1911321953 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:42.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:42.693+0000 7f91a2d9d700 1 --2- 172.21.15.71:0/1911321953 >> v2:172.21.15.72:3300/0 conn(0x7f91a40af4e0 0x7f91a40b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:42.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:42.693+0000 7f91a359e700 1 -- 172.21.15.71:0/1911321953 >> v2:172.21.15.72:3300/0 conn(0x7f91a40af4e0 msgr2=0x7f91a40b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:42.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:42.693+0000 7f91a359e700 1 --2- 172.21.15.71:0/1911321953 >> v2:172.21.15.72:3300/0 conn(0x7f91a40af4e0 0x7f91a40b20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:42.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:42.693+0000 7f91a359e700 1 -- 172.21.15.71:0/1911321953 >> v1:172.21.15.72:6789/0 conn(0x7f91a40af8b0 legacy=0x7f91a415d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:42.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:42.693+0000 7f91a359e700 1 -- 172.21.15.71:0/1911321953 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91a40cb650 con 0x7f91a415db70 2023-10-06T01:41:42.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:42.693+0000 7f91a359e700 1 --2- 172.21.15.71:0/1911321953 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f91a415db70 0x7f91a40b2620 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f91a40d1360 tx=0x7f919c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf087ee411666cb2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:42.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:42.693+0000 7f91a259c700 1 -- 172.21.15.71:0/1911321953 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f919c00e070 con 0x7f91a415db70 2023-10-06T01:41:42.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:42.693+0000 7f91a259c700 1 -- 172.21.15.71:0/1911321953 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f919c00ba10 con 0x7f91a415db70 2023-10-06T01:41:42.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:42.693+0000 7f91a259c700 1 -- 172.21.15.71:0/1911321953 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f919c0092e0 con 0x7f91a415db70 2023-10-06T01:41:42.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:42.693+0000 7f91a920a700 1 -- 172.21.15.71:0/1911321953 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f91a415db70 msgr2=0x7f91a40b2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:42.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:42.693+0000 7f91a920a700 1 --2- 172.21.15.71:0/1911321953 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f91a415db70 0x7f91a40b2620 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f91a40d1360 tx=0x7f919c009840 comp rx=0 tx=0).stop 2023-10-06T01:41:42.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:42.693+0000 7f91a920a700 1 -- 172.21.15.71:0/1911321953 shutdown_connections 2023-10-06T01:41:42.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:42.693+0000 7f91a920a700 1 --2- 172.21.15.71:0/1911321953 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f91a415db70 0x7f91a40b2620 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:42.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:42.694+0000 7f91a920a700 1 --2- 172.21.15.71:0/1911321953 >> v2:172.21.15.72:3300/0 conn(0x7f91a40af4e0 0x7f91a40b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:42.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:42.694+0000 7f91a920a700 1 -- 172.21.15.71:0/1911321953 >> 172.21.15.71:0/1911321953 conn(0x7f91a4068680 msgr2=0x7f91a4068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:42.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:42.694+0000 7f91a920a700 1 -- 172.21.15.71:0/1911321953 shutdown_connections 2023-10-06T01:41:42.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:42.694+0000 7f91a920a700 1 -- 172.21.15.71:0/1911321953 wait complete. 2023-10-06T01:41:42.700 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:42.695+0000 7f91a920a700 1 Processor -- start 2023-10-06T01:41:42.700 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:42.695+0000 7f91a920a700 1 -- start start 2023-10-06T01:41:42.700 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:42.695+0000 7f91a920a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f91a40af4e0 0x7f91a406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:42.700 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:42.695+0000 7f91a920a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f91a40af8b0 0x7f91a40c6460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:42.700 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:42.695+0000 7f91a920a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91a415db70 0x7f91a40c9870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:42.700 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:42.695+0000 7f91a920a700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91a40c7300 con 0x7f91a40af8b0 2023-10-06T01:41:42.701 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:42.695+0000 7f91a920a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91a406c1f0 con 0x7f91a415db70 2023-10-06T01:41:42.701 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:42.695+0000 7f91a920a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91a406c4d0 con 0x7f91a40af4e0 2023-10-06T01:41:42.701 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:42.696+0000 7f919a59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f91a40af8b0 0x7f91a40c6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:42.701 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:42.696+0000 7f919a59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f91a40af8b0 0x7f91a40c6460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:58010/0 (socket says 172.21.15.71:58010) 2023-10-06T01:41:42.701 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:42.696+0000 7f919a59c700 1 -- 172.21.15.71:0/4242721777 learned_addr learned my addr 172.21.15.71:0/4242721777 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:42.701 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:42.696+0000 7f91a359e700 1 --2- 172.21.15.71:0/4242721777 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91a415db70 0x7f91a40c9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:42.701 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:42.696+0000 7f91a2d9d700 1 --2- 172.21.15.71:0/4242721777 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f91a40af4e0 0x7f91a406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:42.701 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:42.696+0000 7f919a59c700 1 -- 172.21.15.71:0/4242721777 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f91a40af4e0 msgr2=0x7f91a406b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:42.701 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:42.696+0000 7f919a59c700 1 --2- 172.21.15.71:0/4242721777 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f91a40af4e0 0x7f91a406b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:42.701 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:42.696+0000 7f919a59c700 1 -- 172.21.15.71:0/4242721777 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91a415db70 msgr2=0x7f91a40c9870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:42.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:42.696+0000 7f919a59c700 1 --2- 172.21.15.71:0/4242721777 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91a415db70 0x7f91a40c9870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:42.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:42.696+0000 7f919a59c700 1 -- 172.21.15.71:0/4242721777 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f919c009ae0 con 0x7f91a40af8b0 2023-10-06T01:41:42.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:42.696+0000 7f91a359e700 1 --2- 172.21.15.71:0/4242721777 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91a415db70 0x7f91a40c9870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:41:42.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:42.696+0000 7f91a2d9d700 1 --2- 172.21.15.71:0/4242721777 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f91a40af4e0 0x7f91a406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:41:42.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:42.696+0000 7f919a59c700 1 --2- 172.21.15.71:0/4242721777 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f91a40af8b0 0x7f91a40c6460 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f918c00b7e0 tx=0x7f918c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:42.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:42.696+0000 7f919b7fe700 1 -- 172.21.15.71:0/4242721777 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f918c00f510 con 0x7f91a40af8b0 2023-10-06T01:41:42.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:42.696+0000 7f919b7fe700 1 -- 172.21.15.71:0/4242721777 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f918c00f670 con 0x7f91a40af8b0 2023-10-06T01:41:42.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:42.696+0000 7f919b7fe700 1 -- 172.21.15.71:0/4242721777 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f918c00fa10 con 0x7f91a40af8b0 2023-10-06T01:41:42.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:42.696+0000 7f91a920a700 1 -- 172.21.15.71:0/4242721777 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91a406c7b0 con 0x7f91a40af8b0 2023-10-06T01:41:42.703 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:42.696+0000 7f91a920a700 1 -- 172.21.15.71:0/4242721777 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91a406bee0 con 0x7f91a40af8b0 2023-10-06T01:41:42.703 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:42.697+0000 7f91a920a700 1 -- 172.21.15.71:0/4242721777 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91a40c74b0 con 0x7f91a40af8b0 2023-10-06T01:41:42.703 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:42.698+0000 7f919b7fe700 1 -- 172.21.15.71:0/4242721777 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f918c01a400 con 0x7f91a40af8b0 2023-10-06T01:41:42.703 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:42.698+0000 7f919b7fe700 1 --2- 172.21.15.71:0/4242721777 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f9184066f30 0x7f91840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:42.703 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:42.698+0000 7f91a2d9d700 1 --2- 172.21.15.71:0/4242721777 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f9184066f30 0x7f91840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:42.703 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:42.698+0000 7f919b7fe700 1 -- 172.21.15.71:0/4242721777 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f918c084340 con 0x7f91a40af8b0 2023-10-06T01:41:42.703 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:42.698+0000 7f91a2d9d700 1 --2- 172.21.15.71:0/4242721777 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f9184066f30 0x7f91840693e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9194006fd0 tx=0x7f9194008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:42.704 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:42.702+0000 7f919b7fe700 1 -- 172.21.15.71:0/4242721777 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f91a40c74b0 con 0x7f91a40af8b0 2023-10-06T01:41:42.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:42.935+0000 7f91a920a700 1 -- 172.21.15.71:0/4242721777 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f91a40c7440 con 0x7f91a40af8b0 2023-10-06T01:41:42.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:42.936+0000 7f919b7fe700 1 -- 172.21.15.71:0/4242721777 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4598 (secure 0 0 0) 0x7f918c054dd0 con 0x7f91a40af8b0 2023-10-06T01:41:42.938 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:41:42.938 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":23,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4889,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6834/1688339815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":1688339815},{"type":"v1","addr":"172.21.15.72:6834","nonce":1688339815}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5020,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/2765166441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6833","nonce":2765166441},{"type":"v1","addr":"172.21.15.72:6835","nonce":2765166441}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5145,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6836/1993673980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":1993673980},{"type":"v1","addr":"172.21.15.71:6836","nonce":1993673980}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T01:41:26.474510+0000","modified":"2023-10-06T01:41:39.188518+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":42,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5148},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5148":{"gid":5148,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.71:6837/3598886363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6835","nonce":3598886363},{"type":"v1","addr":"172.21.15.71:6837","nonce":3598886363}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T01:41:42.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:42.938+0000 7f91a920a700 1 -- 172.21.15.71:0/4242721777 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f9184066f30 msgr2=0x7f91840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:42.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:42.938+0000 7f91a920a700 1 --2- 172.21.15.71:0/4242721777 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f9184066f30 0x7f91840693e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9194006fd0 tx=0x7f9194008040 comp rx=0 tx=0).stop 2023-10-06T01:41:42.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:42.938+0000 7f91a920a700 1 -- 172.21.15.71:0/4242721777 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f91a40af8b0 msgr2=0x7f91a40c6460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:42.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:42.938+0000 7f91a920a700 1 --2- 172.21.15.71:0/4242721777 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f91a40af8b0 0x7f91a40c6460 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f918c00b7e0 tx=0x7f918c0091a0 comp rx=0 tx=0).stop 2023-10-06T01:41:42.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:42.938+0000 7f91a920a700 1 -- 172.21.15.71:0/4242721777 shutdown_connections 2023-10-06T01:41:42.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:42.938+0000 7f91a920a700 1 --2- 172.21.15.71:0/4242721777 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f9184066f30 0x7f91840693e0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:42.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:42.938+0000 7f91a920a700 1 --2- 172.21.15.71:0/4242721777 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91a415db70 0x7f91a40c9870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:42.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:42.938+0000 7f91a920a700 1 --2- 172.21.15.71:0/4242721777 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f91a40af4e0 0x7f91a406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:42.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:42.938+0000 7f91a920a700 1 --2- 172.21.15.71:0/4242721777 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f91a40af8b0 0x7f91a40c6460 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:42.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:42.938+0000 7f91a920a700 1 -- 172.21.15.71:0/4242721777 >> 172.21.15.71:0/4242721777 conn(0x7f91a4068680 msgr2=0x7f91a40b5070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:42.940 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:42.938+0000 7f91a920a700 1 -- 172.21.15.71:0/4242721777 shutdown_connections 2023-10-06T01:41:42.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:42.938+0000 7f91a920a700 1 -- 172.21.15.71:0/4242721777 wait complete. 2023-10-06T01:41:42.941 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 23 2023-10-06T01:41:42.951 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2023-10-06T01:41:43.095 INFO:teuthology.orchestra.run.smithi071.stdout:{"message":"","return_code":0} 2023-10-06T01:41:43.096 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2023-10-06T01:41:43.096 DEBUG:teuthology.orchestra.run.smithi071:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getxattr 10000000000.00000000 parent 2023-10-06T01:41:43.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.132+0000 7f768f698000 1 Processor -- start 2023-10-06T01:41:43.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.132+0000 7f768f698000 1 -- start start 2023-10-06T01:41:43.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.132+0000 7f768f698000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55f86a8c41b0 0x55f86a87e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:43.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.132+0000 7f768f698000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f86a950500 0x55f86a959bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:43.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.132+0000 7f768f698000 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f86a952de0 0x55f86a95a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:43.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.132+0000 7f768f698000 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f86a7c7980 con 0x55f86a952de0 2023-10-06T01:41:43.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.132+0000 7f768f698000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f86a7c7620 con 0x55f86a950500 2023-10-06T01:41:43.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.132+0000 7f768f698000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f86a7be400 con 0x55f86a8c41b0 2023-10-06T01:41:43.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.132+0000 7f76890d4700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f86a952de0 0x55f86a95a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:43.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.133+0000 7f76890d4700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f86a952de0 0x55f86a95a100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:58028/0 (socket says 172.21.15.71:58028) 2023-10-06T01:41:43.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.133+0000 7f76890d4700 1 -- 172.21.15.71:0/2890280729 learned_addr learned my addr 172.21.15.71:0/2890280729 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:43.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.133+0000 7f76888d3700 1 --2- 172.21.15.71:0/2890280729 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55f86a8c41b0 0x55f86a87e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:43.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.133+0000 7f76880d2700 1 --2- 172.21.15.71:0/2890280729 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f86a950500 0x55f86a959bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:43.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.133+0000 7f76890d4700 1 -- 172.21.15.71:0/2890280729 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55f86a8c41b0 msgr2=0x55f86a87e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:43.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.133+0000 7f76890d4700 1 --2- 172.21.15.71:0/2890280729 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55f86a8c41b0 0x55f86a87e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:43.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.133+0000 7f76890d4700 1 -- 172.21.15.71:0/2890280729 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f86a950500 msgr2=0x55f86a959bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:43.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.133+0000 7f76890d4700 1 --2- 172.21.15.71:0/2890280729 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f86a950500 0x55f86a959bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:43.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.133+0000 7f76890d4700 1 -- 172.21.15.71:0/2890280729 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7678005db0 con 0x55f86a952de0 2023-10-06T01:41:43.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.133+0000 7f76888d3700 1 --2- 172.21.15.71:0/2890280729 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55f86a8c41b0 0x55f86a87e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:41:43.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.133+0000 7f76890d4700 1 --2- 172.21.15.71:0/2890280729 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f86a952de0 0x55f86a95a100 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f768000c500 tx=0x7f7680007040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ced582f58bbee01d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:43.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.133+0000 7f76870d0700 1 -- 172.21.15.71:0/2890280729 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7680010590 con 0x55f86a952de0 2023-10-06T01:41:43.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.133+0000 7f76870d0700 1 -- 172.21.15.71:0/2890280729 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76800106f0 con 0x55f86a952de0 2023-10-06T01:41:43.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.133+0000 7f76870d0700 1 -- 172.21.15.71:0/2890280729 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7680010ab0 con 0x55f86a952de0 2023-10-06T01:41:43.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.133+0000 7f768f698000 1 -- 172.21.15.71:0/2890280729 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f86a952de0 msgr2=0x55f86a95a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:43.140 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.133+0000 7f768f698000 1 --2- 172.21.15.71:0/2890280729 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f86a952de0 0x55f86a95a100 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f768000c500 tx=0x7f7680007040 comp rx=0 tx=0).stop 2023-10-06T01:41:43.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.133+0000 7f768f698000 1 -- 172.21.15.71:0/2890280729 shutdown_connections 2023-10-06T01:41:43.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.133+0000 7f768f698000 1 --2- 172.21.15.71:0/2890280729 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f86a952de0 0x55f86a95a100 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:43.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.133+0000 7f768f698000 1 --2- 172.21.15.71:0/2890280729 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55f86a8c41b0 0x55f86a87e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:43.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.133+0000 7f768f698000 1 --2- 172.21.15.71:0/2890280729 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f86a950500 0x55f86a959bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:43.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.133+0000 7f768f698000 1 -- 172.21.15.71:0/2890280729 >> 172.21.15.71:0/2890280729 conn(0x55f86a87cd50 msgr2=0x55f86a87d7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:43.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.134+0000 7f768f698000 1 -- 172.21.15.71:0/2890280729 shutdown_connections 2023-10-06T01:41:43.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.134+0000 7f768f698000 1 -- 172.21.15.71:0/2890280729 wait complete. 2023-10-06T01:41:43.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.134+0000 7f768f698000 1 Processor -- start 2023-10-06T01:41:43.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.134+0000 7f768f698000 1 -- start start 2023-10-06T01:41:43.141 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.135+0000 7f768f698000 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f86a8c41b0 0x55f86a967100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:43.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.135+0000 7f768f698000 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f86a950500 0x55f86a87d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:43.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.135+0000 7f768f698000 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55f86a952de0 0x55f86a87db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:43.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.135+0000 7f768f698000 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f86a8a9b60 con 0x55f86a950500 2023-10-06T01:41:43.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.135+0000 7f768f698000 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f86a9677a0 con 0x55f86a8c41b0 2023-10-06T01:41:43.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.135+0000 7f768f698000 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f86a967a40 con 0x55f86a952de0 2023-10-06T01:41:43.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.135+0000 7f76880d2700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f86a950500 0x55f86a87d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:43.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.135+0000 7f76880d2700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f86a950500 0x55f86a87d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:58030/0 (socket says 172.21.15.71:58030) 2023-10-06T01:41:43.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.135+0000 7f76880d2700 1 -- 172.21.15.71:0/2059286225 learned_addr learned my addr 172.21.15.71:0/2059286225 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:43.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.135+0000 7f76890d4700 1 --2- 172.21.15.71:0/2059286225 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55f86a952de0 0x55f86a87db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:43.142 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.135+0000 7f76888d3700 1 --2- 172.21.15.71:0/2059286225 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f86a8c41b0 0x55f86a967100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:43.143 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.135+0000 7f76880d2700 1 -- 172.21.15.71:0/2059286225 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55f86a952de0 msgr2=0x55f86a87db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:43.143 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.135+0000 7f76880d2700 1 --2- 172.21.15.71:0/2059286225 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55f86a952de0 0x55f86a87db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:43.143 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.135+0000 7f76880d2700 1 -- 172.21.15.71:0/2059286225 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f86a8c41b0 msgr2=0x55f86a967100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:43.143 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.135+0000 7f76880d2700 1 --2- 172.21.15.71:0/2059286225 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55f86a8c41b0 0x55f86a967100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:43.143 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.135+0000 7f76880d2700 1 -- 172.21.15.71:0/2059286225 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f768000d040 con 0x55f86a950500 2023-10-06T01:41:43.143 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.135+0000 7f76880d2700 1 --2- 172.21.15.71:0/2059286225 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f86a950500 0x55f86a87d630 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f767c003e10 tx=0x7f767c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:43.143 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.135+0000 7f76858cd700 1 -- 172.21.15.71:0/2059286225 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f767c0032e0 con 0x55f86a950500 2023-10-06T01:41:43.143 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.135+0000 7f76858cd700 1 -- 172.21.15.71:0/2059286225 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f767c008040 con 0x55f86a950500 2023-10-06T01:41:43.144 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.136+0000 7f768f698000 1 -- 172.21.15.71:0/2059286225 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f86a7d63d0 con 0x55f86a950500 2023-10-06T01:41:43.144 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.136+0000 7f76858cd700 1 -- 172.21.15.71:0/2059286225 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f767c00bcb0 con 0x55f86a950500 2023-10-06T01:41:43.144 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.136+0000 7f768f698000 1 -- 172.21.15.71:0/2059286225 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f86a7c9ae0 con 0x55f86a950500 2023-10-06T01:41:43.144 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.137+0000 7f76858cd700 1 -- 172.21.15.71:0/2059286225 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f767c001820 con 0x55f86a950500 2023-10-06T01:41:43.147 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.137+0000 7f76858cd700 1 --2- 172.21.15.71:0/2059286225 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7674065890 0x7f7674067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:43.147 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.137+0000 7f76858cd700 1 -- 172.21.15.71:0/2059286225 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f767c0831c0 con 0x55f86a950500 2023-10-06T01:41:43.147 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.137+0000 7f76888d3700 1 --2- 172.21.15.71:0/2059286225 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7674065890 0x7f7674067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:43.147 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.137+0000 7f768f698000 1 --2- 172.21.15.71:0/2059286225 >> [v2:172.21.15.71:6816/90670,v1:172.21.15.71:6817/90670] conn(0x55f86a8a9fc0 0x55f86a8aa3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:43.147 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.138+0000 7f768f698000 1 -- 172.21.15.71:0/2059286225 --> [v2:172.21.15.71:6816/90670,v1:172.21.15.71:6817/90670] -- osd_op(unknown.0.0:1 6.10 6:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42) v8 -- 0x55f86a8aa900 con 0x55f86a8a9fc0 2023-10-06T01:41:43.147 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.138+0000 7f76890d4700 1 --2- 172.21.15.71:0/2059286225 >> [v2:172.21.15.71:6816/90670,v1:172.21.15.71:6817/90670] conn(0x55f86a8a9fc0 0x55f86a8aa3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:43.147 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.138+0000 7f76888d3700 1 --2- 172.21.15.71:0/2059286225 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7674065890 0x7f7674067d40 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7678008410 tx=0x7f7678016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:43.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.138+0000 7f76890d4700 1 --2- 172.21.15.71:0/2059286225 >> [v2:172.21.15.71:6816/90670,v1:172.21.15.71:6817/90670] conn(0x55f86a8a9fc0 0x55f86a8aa3c0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:43.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.138+0000 7f76890d4700 1 -- 172.21.15.71:0/2059286225 <== osd.0 v2:172.21.15.71:6816/90670 1 ==== osd_op_reply(1 10000000000.00000000 [getxattr (64) out=64b] v0'0 uv17 ondisk = 0) v8 ==== 164+0+64 (crc 0 0 0) 0x7f7680017020 con 0x55f86a8a9fc0 2023-10-06T01:41:43.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.138+0000 7f768f698000 1 -- 172.21.15.71:0/2059286225 >> [v2:172.21.15.71:6816/90670,v1:172.21.15.71:6817/90670] conn(0x55f86a8a9fc0 msgr2=0x55f86a8aa3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:43.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.138+0000 7f768f698000 1 --2- 172.21.15.71:0/2059286225 >> [v2:172.21.15.71:6816/90670,v1:172.21.15.71:6817/90670] conn(0x55f86a8a9fc0 0x55f86a8aa3c0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:43.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.138+0000 7f768f698000 1 -- 172.21.15.71:0/2059286225 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7674065890 msgr2=0x7f7674067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:43.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.138+0000 7f768f698000 1 --2- 172.21.15.71:0/2059286225 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7674065890 0x7f7674067d40 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7678008410 tx=0x7f7678016000 comp rx=0 tx=0).stop 2023-10-06T01:41:43.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.138+0000 7f768f698000 1 -- 172.21.15.71:0/2059286225 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f86a950500 msgr2=0x55f86a87d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:43.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.138+0000 7f768f698000 1 --2- 172.21.15.71:0/2059286225 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f86a950500 0x55f86a87d630 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f767c003e10 tx=0x7f767c000bc0 comp rx=0 tx=0).stop 2023-10-06T01:41:43.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.138+0000 7f76890d4700 1 -- 172.21.15.71:0/2059286225 reap_dead start 2023-10-06T01:41:43.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.138+0000 7f768f698000 1 -- 172.21.15.71:0/2059286225 shutdown_connections 2023-10-06T01:41:43.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.138+0000 7f768f698000 1 -- 172.21.15.71:0/2059286225 >> 172.21.15.71:0/2059286225 conn(0x55f86a87cd50 msgr2=0x55f86a87e5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:43.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.138+0000 7f768f698000 1 -- 172.21.15.71:0/2059286225 shutdown_connections 2023-10-06T01:41:43.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.138+0000 7f768f698000 1 -- 172.21.15.71:0/2059286225 wait complete. 2023-10-06T01:41:43.150 INFO:teuthology.orchestra.run.smithi071.stdout::testdir1 2023-10-06T01:41:43.150 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T01:41:43.151 DEBUG:teuthology.orchestra.run.smithi071:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T01:41:43.228 DEBUG:teuthology.orchestra.run.smithi072:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T01:41:43.278 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T01:41:43.278 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi071.front.sepia.ceph.com... 2023-10-06T01:41:43.278 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T01:41:43.279 DEBUG:teuthology.orchestra.run.smithi071:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-06T01:41:43.312 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi071.stderr:ceph-fuse[106154]: fuse finished with error 0 and tester_r 0 2023-10-06T01:41:43.314 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi071.front.sepia.ceph.com 2023-10-06T01:41:43.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:41:43.314 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T01:41:43.467 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi072.front.sepia.ceph.com 2023-10-06T01:41:43.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:41:43.468 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-06T01:41:43.486 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T01:41:43.486 INFO:teuthology.orchestra.run.smithi072.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-10-06T01:41:43.487 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi071.front.sepia.ceph.com 2023-10-06T01:41:43.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:41:43.487 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-06T01:41:43.502 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T01:41:43.502 INFO:teuthology.orchestra.run.smithi071.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-10-06T01:41:43.502 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi072.front.sepia.ceph.com 2023-10-06T01:41:43.503 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:41:43.503 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-06T01:41:43.543 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T01:41:43.544 INFO:teuthology.orchestra.run.smithi072.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-10-06T01:41:43.545 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T01:41:43.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.658+0000 7f9e5fad4700 1 Processor -- start 2023-10-06T01:41:43.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.658+0000 7f9e5fad4700 1 -- start start 2023-10-06T01:41:43.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.659+0000 7f9e5fad4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9e580af8b0 0x7f9e5815d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:43.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.659+0000 7f9e5fad4700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e5815e190 con 0x7f9e580af4e0 2023-10-06T01:41:43.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.659+0000 7f9e5fad4700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e580cb650 con 0x7f9e580b27f0 2023-10-06T01:41:43.666 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.659+0000 7f9e5fad4700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e580b1910 con 0x7f9e580af8b0 2023-10-06T01:41:43.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.659+0000 7f9e5d870700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f9e580af4e0 0x7f9e580b20e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:58436/0 (socket says 172.21.15.71:58436) 2023-10-06T01:41:43.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.659+0000 7f9e5d870700 1 -- 172.21.15.71:0/548541868 learned_addr learned my addr 172.21.15.71:0/548541868 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:41:43.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.659+0000 7f9e5d06f700 1 --2- 172.21.15.71:0/548541868 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9e580af8b0 0x7f9e5815d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:43.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.659+0000 7f9e5c86e700 1 -- 172.21.15.71:0/548541868 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3989379384 0 0) 0x7f9e5815e190 con 0x7f9e580af4e0 2023-10-06T01:41:43.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.659+0000 7f9e5c86e700 1 -- 172.21.15.71:0/548541868 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e44003570 con 0x7f9e580af4e0 2023-10-06T01:41:43.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.660+0000 7f9e5c86e700 1 -- 172.21.15.71:0/548541868 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3455638356 0 0) 0x7f9e580cb650 con 0x7f9e580b27f0 2023-10-06T01:41:43.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.660+0000 7f9e5c86e700 1 -- 172.21.15.71:0/548541868 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e5815e190 con 0x7f9e580b27f0 2023-10-06T01:41:43.667 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.660+0000 7f9e5c86e700 1 -- 172.21.15.71:0/548541868 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1737088137 0 0) 0x7f9e44003570 con 0x7f9e580af4e0 2023-10-06T01:41:43.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.660+0000 7f9e5c86e700 1 -- 172.21.15.71:0/548541868 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9e580af8b0 msgr2=0x7f9e5815d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:43.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.660+0000 7f9e5c86e700 1 --2- 172.21.15.71:0/548541868 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9e580af8b0 0x7f9e5815d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:43.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.660+0000 7f9e5c86e700 1 -- 172.21.15.71:0/548541868 >> v1:172.21.15.72:6789/0 conn(0x7f9e580b27f0 legacy=0x7f9e5815d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:43.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.660+0000 7f9e5c86e700 1 -- 172.21.15.71:0/548541868 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e580ccaf0 con 0x7f9e580af4e0 2023-10-06T01:41:43.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.660+0000 7f9e5c86e700 1 -- 172.21.15.71:0/548541868 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1184243524 0 0) 0x7f9e540017f0 con 0x7f9e580af4e0 2023-10-06T01:41:43.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.660+0000 7f9e5c86e700 1 -- 172.21.15.71:0/548541868 >> v1:172.21.15.71:6789/0 conn(0x7f9e580af4e0 legacy=0x7f9e580b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:43.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.660+0000 7f9e5c86e700 1 --2- 172.21.15.71:0/548541868 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e44003c20 0x7f9e44004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:43.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.660+0000 7f9e5c86e700 1 --2- 172.21.15.71:0/548541868 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e44004810 0x7f9e44004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:43.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.660+0000 7f9e5c86e700 1 --2- 172.21.15.71:0/548541868 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9e580af8b0 0x7f9e440051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:43.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.660+0000 7f9e5c86e700 1 -- 172.21.15.71:0/548541868 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e580b1910 con 0x7f9e44003c20 2023-10-06T01:41:43.668 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.660+0000 7f9e5c86e700 1 -- 172.21.15.71:0/548541868 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e4400bba0 con 0x7f9e44004810 2023-10-06T01:41:43.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.660+0000 7f9e5c86e700 1 -- 172.21.15.71:0/548541868 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e4400bd60 con 0x7f9e580af8b0 2023-10-06T01:41:43.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.660+0000 7f9e5d870700 1 --2- 172.21.15.71:0/548541868 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e44003c20 0x7f9e44004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:43.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.660+0000 7f9e5d06f700 1 --2- 172.21.15.71:0/548541868 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e44004810 0x7f9e44004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:43.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.660+0000 7f9e5e071700 1 --2- 172.21.15.71:0/548541868 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9e580af8b0 0x7f9e440051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:43.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.660+0000 7f9e5d870700 1 -- 172.21.15.71:0/548541868 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9e580af8b0 msgr2=0x7f9e440051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:43.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.660+0000 7f9e5d870700 1 --2- 172.21.15.71:0/548541868 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9e580af8b0 0x7f9e440051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:43.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.660+0000 7f9e5d870700 1 -- 172.21.15.71:0/548541868 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e44004810 msgr2=0x7f9e44004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:43.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.660+0000 7f9e5d870700 1 --2- 172.21.15.71:0/548541868 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e44004810 0x7f9e44004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:43.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.660+0000 7f9e5d870700 1 -- 172.21.15.71:0/548541868 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e44003570 con 0x7f9e44003c20 2023-10-06T01:41:43.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.660+0000 7f9e5d06f700 1 --2- 172.21.15.71:0/548541868 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e44004810 0x7f9e44004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:41:43.669 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.660+0000 7f9e5d870700 1 --2- 172.21.15.71:0/548541868 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e44003c20 0x7f9e44004010 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f9e5400a8f0 tx=0x7f9e580cb5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc16d237ac2e8c60 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:43.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.660+0000 7f9e5c86e700 1 -- 172.21.15.71:0/548541868 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e540070d0 con 0x7f9e44003c20 2023-10-06T01:41:43.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.660+0000 7f9e5c86e700 1 -- 172.21.15.71:0/548541868 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e54007270 con 0x7f9e44003c20 2023-10-06T01:41:43.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.660+0000 7f9e5c86e700 1 -- 172.21.15.71:0/548541868 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e54007630 con 0x7f9e44003c20 2023-10-06T01:41:43.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.661+0000 7f9e5fad4700 1 -- 172.21.15.71:0/548541868 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e44003c20 msgr2=0x7f9e44004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:43.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.661+0000 7f9e5fad4700 1 --2- 172.21.15.71:0/548541868 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e44003c20 0x7f9e44004010 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f9e5400a8f0 tx=0x7f9e580cb5c0 comp rx=0 tx=0).stop 2023-10-06T01:41:43.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.661+0000 7f9e5e071700 1 -- 172.21.15.71:0/548541868 reap_dead start 2023-10-06T01:41:43.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.661+0000 7f9e5fad4700 1 -- 172.21.15.71:0/548541868 shutdown_connections 2023-10-06T01:41:43.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.661+0000 7f9e5fad4700 1 -- 172.21.15.71:0/548541868 >> 172.21.15.71:0/548541868 conn(0x7f9e58068680 msgr2=0x7f9e58068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:43.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.661+0000 7f9e5fad4700 1 -- 172.21.15.71:0/548541868 shutdown_connections 2023-10-06T01:41:43.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.661+0000 7f9e5fad4700 1 -- 172.21.15.71:0/548541868 wait complete. 2023-10-06T01:41:43.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.662+0000 7f9e5fad4700 1 Processor -- start 2023-10-06T01:41:43.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.662+0000 7f9e5fad4700 1 -- start start 2023-10-06T01:41:43.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.663+0000 7f9e5fad4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9e44003c20 0x7f9e58169fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:43.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.663+0000 7f9e5fad4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e580a76e0 0x7f9e580a7b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:43.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.663+0000 7f9e5fad4700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e580ceff0 0x7f9e580cf460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:43.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.663+0000 7f9e5fad4700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e580ceb60 con 0x7f9e580ceff0 2023-10-06T01:41:43.671 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.663+0000 7f9e5fad4700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e580a99b0 con 0x7f9e580a76e0 2023-10-06T01:41:43.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.663+0000 7f9e5fad4700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e580a8090 con 0x7f9e44003c20 2023-10-06T01:41:43.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.663+0000 7f9e5e071700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e580ceff0 0x7f9e580cf460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:43.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.663+0000 7f9e5e071700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e580ceff0 0x7f9e580cf460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:58054/0 (socket says 172.21.15.71:58054) 2023-10-06T01:41:43.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.663+0000 7f9e5e071700 1 -- 172.21.15.71:0/2473901311 learned_addr learned my addr 172.21.15.71:0/2473901311 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:43.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.663+0000 7f9e5d870700 1 --2- 172.21.15.71:0/2473901311 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9e44003c20 0x7f9e58169fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:43.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.663+0000 7f9e5d06f700 1 --2- 172.21.15.71:0/2473901311 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e580a76e0 0x7f9e580a7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:43.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.663+0000 7f9e5e071700 1 -- 172.21.15.71:0/2473901311 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9e44003c20 msgr2=0x7f9e58169fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:43.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.663+0000 7f9e5e071700 1 --2- 172.21.15.71:0/2473901311 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9e44003c20 0x7f9e58169fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:43.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.663+0000 7f9e5e071700 1 -- 172.21.15.71:0/2473901311 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e580a76e0 msgr2=0x7f9e580a7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:43.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.663+0000 7f9e5e071700 1 --2- 172.21.15.71:0/2473901311 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e580a76e0 0x7f9e580a7b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:43.672 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.663+0000 7f9e5e071700 1 -- 172.21.15.71:0/2473901311 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e580cdf50 con 0x7f9e580ceff0 2023-10-06T01:41:43.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.663+0000 7f9e5e071700 1 --2- 172.21.15.71:0/2473901311 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e580ceff0 0x7f9e580cf460 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f9e50000fd0 tx=0x7f9e50009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:43.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.663+0000 7f9e4dffb700 1 -- 172.21.15.71:0/2473901311 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e50006820 con 0x7f9e580ceff0 2023-10-06T01:41:43.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.663+0000 7f9e4dffb700 1 -- 172.21.15.71:0/2473901311 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e50006980 con 0x7f9e580ceff0 2023-10-06T01:41:43.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.663+0000 7f9e5fad4700 1 -- 172.21.15.71:0/2473901311 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e580ce230 con 0x7f9e580ceff0 2023-10-06T01:41:43.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.663+0000 7f9e4dffb700 1 -- 172.21.15.71:0/2473901311 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e50006d40 con 0x7f9e580ceff0 2023-10-06T01:41:43.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.664+0000 7f9e5fad4700 1 -- 172.21.15.71:0/2473901311 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e580ce7f0 con 0x7f9e580ceff0 2023-10-06T01:41:43.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.665+0000 7f9e5fad4700 1 -- 172.21.15.71:0/2473901311 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e580ced10 con 0x7f9e580ceff0 2023-10-06T01:41:43.673 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.665+0000 7f9e4dffb700 1 -- 172.21.15.71:0/2473901311 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9e50007240 con 0x7f9e580ceff0 2023-10-06T01:41:43.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.665+0000 7f9e4dffb700 1 --2- 172.21.15.71:0/2473901311 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f9e3c066f30 0x7f9e3c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:43.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.665+0000 7f9e5d870700 1 --2- 172.21.15.71:0/2473901311 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f9e3c066f30 0x7f9e3c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:43.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.665+0000 7f9e4dffb700 1 -- 172.21.15.71:0/2473901311 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f9e50083c20 con 0x7f9e580ceff0 2023-10-06T01:41:43.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.666+0000 7f9e5d870700 1 --2- 172.21.15.71:0/2473901311 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f9e3c066f30 0x7f9e3c0693e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9e5400a3b0 tx=0x7f9e54013000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:43.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.669+0000 7f9e4dffb700 1 -- 172.21.15.71:0/2473901311 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9e580ced10 con 0x7f9e580ceff0 2023-10-06T01:41:43.896 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.895+0000 7f9e5fad4700 1 -- 172.21.15.71:0/2473901311 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9e580ced10 con 0x7f9e580ceff0 2023-10-06T01:41:43.897 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.895+0000 7f9e4dffb700 1 -- 172.21.15.71:0/2473901311 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4598 (secure 0 0 0) 0x7f9e580ced10 con 0x7f9e580ceff0 2023-10-06T01:41:43.897 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:41:43.897 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":23,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4889,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6834/1688339815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":1688339815},{"type":"v1","addr":"172.21.15.72:6834","nonce":1688339815}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5020,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/2765166441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6833","nonce":2765166441},{"type":"v1","addr":"172.21.15.72:6835","nonce":2765166441}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5145,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6836/1993673980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":1993673980},{"type":"v1","addr":"172.21.15.71:6836","nonce":1993673980}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T01:41:26.474510+0000","modified":"2023-10-06T01:41:39.188518+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":42,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5148},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5148":{"gid":5148,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.71:6837/3598886363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6835","nonce":3598886363},{"type":"v1","addr":"172.21.15.71:6837","nonce":3598886363}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T01:41:43.899 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.897+0000 7f9e5fad4700 1 -- 172.21.15.71:0/2473901311 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f9e3c066f30 msgr2=0x7f9e3c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:43.899 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.897+0000 7f9e5fad4700 1 --2- 172.21.15.71:0/2473901311 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f9e3c066f30 0x7f9e3c0693e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9e5400a3b0 tx=0x7f9e54013000 comp rx=0 tx=0).stop 2023-10-06T01:41:43.899 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.897+0000 7f9e5fad4700 1 -- 172.21.15.71:0/2473901311 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e580ceff0 msgr2=0x7f9e580cf460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:43.899 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.897+0000 7f9e5fad4700 1 --2- 172.21.15.71:0/2473901311 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e580ceff0 0x7f9e580cf460 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f9e50000fd0 tx=0x7f9e50009040 comp rx=0 tx=0).stop 2023-10-06T01:41:43.899 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.897+0000 7f9e5fad4700 1 -- 172.21.15.71:0/2473901311 shutdown_connections 2023-10-06T01:41:43.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.897+0000 7f9e5fad4700 1 --2- 172.21.15.71:0/2473901311 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9e580ceff0 0x7f9e580cf460 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:43.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.897+0000 7f9e5fad4700 1 --2- 172.21.15.71:0/2473901311 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9e44003c20 0x7f9e58169fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:43.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.897+0000 7f9e5fad4700 1 --2- 172.21.15.71:0/2473901311 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f9e3c066f30 0x7f9e3c0693e0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:43.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.897+0000 7f9e5fad4700 1 --2- 172.21.15.71:0/2473901311 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9e580a76e0 0x7f9e580a7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:43.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.897+0000 7f9e5fad4700 1 -- 172.21.15.71:0/2473901311 >> 172.21.15.71:0/2473901311 conn(0x7f9e58068680 msgr2=0x7f9e5815d940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:43.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.897+0000 7f9e5fad4700 1 -- 172.21.15.71:0/2473901311 shutdown_connections 2023-10-06T01:41:43.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:43.897+0000 7f9e5fad4700 1 -- 172.21.15.71:0/2473901311 wait complete. 2023-10-06T01:41:43.900 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 23 2023-10-06T01:41:43.911 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:41:44.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.022+0000 7f44e6723700 1 Processor -- start 2023-10-06T01:41:44.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.022+0000 7f44e6723700 1 -- start start 2023-10-06T01:41:44.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.023+0000 7f44e6723700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f44e00af4e0 0x7f44e00b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:44.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.023+0000 7f44e6723700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f44e00af8b0 0x7f44e00b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:44.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.023+0000 7f44e6723700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44e015e190 con 0x7f44e015d460 2023-10-06T01:41:44.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.023+0000 7f44e6723700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44e00b1910 con 0x7f44e00af8b0 2023-10-06T01:41:44.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.023+0000 7f44e6723700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44e015dfb0 con 0x7f44e00af4e0 2023-10-06T01:41:44.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.023+0000 7f44df7fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f44e00af8b0 0x7f44e00b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:44.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.023+0000 7f44e4cc0700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f44e015d460 0x7f44e015d8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:58440/0 (socket says 172.21.15.71:58440) 2023-10-06T01:41:44.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.023+0000 7f44e4cc0700 1 -- 172.21.15.71:0/1750218099 learned_addr learned my addr 172.21.15.71:0/1750218099 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:41:44.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.023+0000 7f44dffff700 1 --2- 172.21.15.71:0/1750218099 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f44e00af4e0 0x7f44e00b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:44.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.023+0000 7f44df7fe700 1 -- 172.21.15.71:0/1750218099 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f44e00af4e0 msgr2=0x7f44e00b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:44.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.023+0000 7f44df7fe700 1 --2- 172.21.15.71:0/1750218099 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f44e00af4e0 0x7f44e00b20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:44.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.023+0000 7f44df7fe700 1 -- 172.21.15.71:0/1750218099 >> v1:172.21.15.71:6789/0 conn(0x7f44e015d460 legacy=0x7f44e015d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:44.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.024+0000 7f44df7fe700 1 -- 172.21.15.71:0/1750218099 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44e00cb650 con 0x7f44e00af8b0 2023-10-06T01:41:44.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.024+0000 7f44deffd700 1 -- 172.21.15.71:0/1750218099 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2325875 0 0) 0x7f44e015e190 con 0x7f44e015d460 2023-10-06T01:41:44.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.024+0000 7f44df7fe700 1 --2- 172.21.15.71:0/1750218099 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f44e00af8b0 0x7f44e00b2620 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f44d40098e0 tx=0x7f44d40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b56e2588cf0ebbe5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:44.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.024+0000 7f44deffd700 1 -- 172.21.15.71:0/1750218099 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d400b640 con 0x7f44e00af8b0 2023-10-06T01:41:44.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.024+0000 7f44deffd700 1 -- 172.21.15.71:0/1750218099 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44d400b7a0 con 0x7f44e00af8b0 2023-10-06T01:41:44.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.024+0000 7f44deffd700 1 -- 172.21.15.71:0/1750218099 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d400bb40 con 0x7f44e00af8b0 2023-10-06T01:41:44.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.024+0000 7f44e6723700 1 -- 172.21.15.71:0/1750218099 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f44e00af8b0 msgr2=0x7f44e00b2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:44.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.024+0000 7f44e6723700 1 --2- 172.21.15.71:0/1750218099 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f44e00af8b0 0x7f44e00b2620 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f44d40098e0 tx=0x7f44d40091a0 comp rx=0 tx=0).stop 2023-10-06T01:41:44.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.024+0000 7f44e6723700 1 -- 172.21.15.71:0/1750218099 shutdown_connections 2023-10-06T01:41:44.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.024+0000 7f44e6723700 1 --2- 172.21.15.71:0/1750218099 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f44e00af4e0 0x7f44e00b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:44.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.024+0000 7f44e6723700 1 --2- 172.21.15.71:0/1750218099 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f44e00af8b0 0x7f44e00b2620 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:44.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.024+0000 7f44e6723700 1 -- 172.21.15.71:0/1750218099 >> 172.21.15.71:0/1750218099 conn(0x7f44e0068680 msgr2=0x7f44e0068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:44.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.024+0000 7f44e6723700 1 -- 172.21.15.71:0/1750218099 shutdown_connections 2023-10-06T01:41:44.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.024+0000 7f44e6723700 1 -- 172.21.15.71:0/1750218099 wait complete. 2023-10-06T01:41:44.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.025+0000 7f44e6723700 1 Processor -- start 2023-10-06T01:41:44.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.026+0000 7f44e6723700 1 -- start start 2023-10-06T01:41:44.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.026+0000 7f44e6723700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44e00af4e0 0x7f44e00a6d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:44.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.026+0000 7f44e6723700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f44e00af8b0 0x7f44e01676a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:44.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.026+0000 7f44e6723700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f44e015d460 0x7f44e016a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:44.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.026+0000 7f44e6723700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44e0167be0 con 0x7f44e00af8b0 2023-10-06T01:41:44.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.026+0000 7f44e6723700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44e00a7e70 con 0x7f44e00af4e0 2023-10-06T01:41:44.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.026+0000 7f44e6723700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44e00a78b0 con 0x7f44e015d460 2023-10-06T01:41:44.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.026+0000 7f44df7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f44e00af8b0 0x7f44e01676a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:44.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.026+0000 7f44df7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f44e00af8b0 0x7f44e01676a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:58068/0 (socket says 172.21.15.71:58068) 2023-10-06T01:41:44.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.026+0000 7f44df7fe700 1 -- 172.21.15.71:0/156426217 learned_addr learned my addr 172.21.15.71:0/156426217 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:44.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.027+0000 7f44e4cc0700 1 --2- 172.21.15.71:0/156426217 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f44e015d460 0x7f44e016a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:44.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.027+0000 7f44dffff700 1 --2- 172.21.15.71:0/156426217 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44e00af4e0 0x7f44e00a6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:44.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.027+0000 7f44df7fe700 1 -- 172.21.15.71:0/156426217 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f44e015d460 msgr2=0x7f44e016a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:44.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.027+0000 7f44df7fe700 1 --2- 172.21.15.71:0/156426217 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f44e015d460 0x7f44e016a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:44.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.027+0000 7f44df7fe700 1 -- 172.21.15.71:0/156426217 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44e00af4e0 msgr2=0x7f44e00a6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:44.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.027+0000 7f44df7fe700 1 --2- 172.21.15.71:0/156426217 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44e00af4e0 0x7f44e00a6d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:44.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.027+0000 7f44df7fe700 1 -- 172.21.15.71:0/156426217 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44d4009420 con 0x7f44e00af8b0 2023-10-06T01:41:44.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.027+0000 7f44dffff700 1 --2- 172.21.15.71:0/156426217 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44e00af4e0 0x7f44e00a6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:41:44.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.027+0000 7f44df7fe700 1 --2- 172.21.15.71:0/156426217 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f44e00af8b0 0x7f44e01676a0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f44e0089520 tx=0x7f44d4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:44.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.027+0000 7f44c7fff700 1 -- 172.21.15.71:0/156426217 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d400bb20 con 0x7f44e00af8b0 2023-10-06T01:41:44.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.027+0000 7f44c7fff700 1 -- 172.21.15.71:0/156426217 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44d4011420 con 0x7f44e00af8b0 2023-10-06T01:41:44.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.027+0000 7f44e6723700 1 -- 172.21.15.71:0/156426217 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44e00a7b90 con 0x7f44e00af8b0 2023-10-06T01:41:44.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.027+0000 7f44c7fff700 1 -- 172.21.15.71:0/156426217 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d40117a0 con 0x7f44e00af8b0 2023-10-06T01:41:44.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.027+0000 7f44e6723700 1 -- 172.21.15.71:0/156426217 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44e00c8e70 con 0x7f44e00af8b0 2023-10-06T01:41:44.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.028+0000 7f44e6723700 1 -- 172.21.15.71:0/156426217 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44e00c89e0 con 0x7f44e00af8b0 2023-10-06T01:41:44.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.028+0000 7f44c7fff700 1 -- 172.21.15.71:0/156426217 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f44d4011b10 con 0x7f44e00af8b0 2023-10-06T01:41:44.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.029+0000 7f44c7fff700 1 --2- 172.21.15.71:0/156426217 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f44cc066f30 0x7f44cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:44.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.029+0000 7f44c7fff700 1 -- 172.21.15.71:0/156426217 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f44d4085c40 con 0x7f44e00af8b0 2023-10-06T01:41:44.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.029+0000 7f44dffff700 1 --2- 172.21.15.71:0/156426217 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f44cc066f30 0x7f44cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:44.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.029+0000 7f44dffff700 1 --2- 172.21.15.71:0/156426217 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f44cc066f30 0x7f44cc0693e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f44d0006f00 tx=0x7f44d0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:44.035 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.033+0000 7f44c7fff700 1 -- 172.21.15.71:0/156426217 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f44d4052c40 con 0x7f44e00af8b0 2023-10-06T01:41:44.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.215+0000 7f44e6723700 1 -- 172.21.15.71:0/156426217 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f44e00c9060 con 0x7f44e00af8b0 2023-10-06T01:41:44.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.216+0000 7f44c7fff700 1 -- 172.21.15.71:0/156426217 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+17152 (secure 0 0 0) 0x7f44d4056260 con 0x7f44e00af8b0 2023-10-06T01:41:44.217 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:41:44.218 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":42,"fsid":"1fbf1bd2-f9b4-4599-bea2-f4aa920e9a56","created":"2023-10-06T01:39:57.016957+0000","modified":"2023-10-06T01:41:36.177102+0000","last_up_change":"2023-10-06T01:40:08.571643+0000","last_in_change":"2023-10-06T01:39:59.462741+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T01:40:08.610349+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T01:40:15.387434+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-06T01:41:24.561219+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-06T01:41:25.445423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cf059188-fb20-4dbf-95db-dcf57b213d03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":90670},{"type":"v1","addr":"172.21.15.71:6817","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":90670},{"type":"v1","addr":"172.21.15.71:6819","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":90670},{"type":"v1","addr":"172.21.15.71:6823","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":90670},{"type":"v1","addr":"172.21.15.71:6821","nonce":90670}]},"public_addr":"172.21.15.71:6817/90670","cluster_addr":"172.21.15.71:6819/90670","heartbeat_back_addr":"172.21.15.71:6823/90670","heartbeat_front_addr":"172.21.15.71:6821/90670","state":["exists","up"]},{"osd":1,"uuid":"0cff0aae-1799-4fe0-b610-54cf0813c0e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":90669},{"type":"v1","addr":"172.21.15.71:6809","nonce":90669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":90669},{"type":"v1","addr":"172.21.15.71:6811","nonce":90669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":90669},{"type":"v1","addr":"172.21.15.71:6815","nonce":90669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":90669},{"type":"v1","addr":"172.21.15.71:6813","nonce":90669}]},"public_addr":"172.21.15.71:6809/90669","cluster_addr":"172.21.15.71:6811/90669","heartbeat_back_addr":"172.21.15.71:6815/90669","heartbeat_front_addr":"172.21.15.71:6813/90669","state":["exists","up"]},{"osd":2,"uuid":"88d61ddc-9031-44e1-ba8c-546a41e7c8ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":90679},{"type":"v1","addr":"172.21.15.71:6825","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":90679},{"type":"v1","addr":"172.21.15.71:6827","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":90679},{"type":"v1","addr":"172.21.15.71:6831","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":90679},{"type":"v1","addr":"172.21.15.71:6829","nonce":90679}]},"public_addr":"172.21.15.71:6825/90679","cluster_addr":"172.21.15.71:6827/90679","heartbeat_back_addr":"172.21.15.71:6831/90679","heartbeat_front_addr":"172.21.15.71:6829/90679","state":["exists","up"]},{"osd":3,"uuid":"11ed92b7-960b-4a30-a889-a61d3eeb86f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":90668},{"type":"v1","addr":"172.21.15.71:6801","nonce":90668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":90668},{"type":"v1","addr":"172.21.15.71:6803","nonce":90668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":90668},{"type":"v1","addr":"172.21.15.71:6807","nonce":90668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":90668},{"type":"v1","addr":"172.21.15.71:6805","nonce":90668}]},"public_addr":"172.21.15.71:6801/90668","cluster_addr":"172.21.15.71:6803/90668","heartbeat_back_addr":"172.21.15.71:6807/90668","heartbeat_front_addr":"172.21.15.71:6805/90668","state":["exists","up"]},{"osd":4,"uuid":"ae4df784-abdf-4ddf-aefa-780f3ddafef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":90917},{"type":"v1","addr":"172.21.15.72:6801","nonce":90917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":90917},{"type":"v1","addr":"172.21.15.72:6803","nonce":90917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":90917},{"type":"v1","addr":"172.21.15.72:6807","nonce":90917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":90917},{"type":"v1","addr":"172.21.15.72:6805","nonce":90917}]},"public_addr":"172.21.15.72:6801/90917","cluster_addr":"172.21.15.72:6803/90917","heartbeat_back_addr":"172.21.15.72:6807/90917","heartbeat_front_addr":"172.21.15.72:6805/90917","state":["exists","up"]},{"osd":5,"uuid":"5ef0790f-001e-458f-a05b-efae216cf435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":90941},{"type":"v1","addr":"172.21.15.72:6817","nonce":90941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":90941},{"type":"v1","addr":"172.21.15.72:6819","nonce":90941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":90941},{"type":"v1","addr":"172.21.15.72:6827","nonce":90941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":90941},{"type":"v1","addr":"172.21.15.72:6823","nonce":90941}]},"public_addr":"172.21.15.72:6817/90941","cluster_addr":"172.21.15.72:6819/90941","heartbeat_back_addr":"172.21.15.72:6827/90941","heartbeat_front_addr":"172.21.15.72:6823/90941","state":["exists","up"]},{"osd":6,"uuid":"8705aef1-9ae8-4e54-a3c4-c2909fa0ceb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":90918},{"type":"v1","addr":"172.21.15.72:6809","nonce":90918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":90918},{"type":"v1","addr":"172.21.15.72:6811","nonce":90918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":90918},{"type":"v1","addr":"172.21.15.72:6815","nonce":90918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":90918},{"type":"v1","addr":"172.21.15.72:6813","nonce":90918}]},"public_addr":"172.21.15.72:6809/90918","cluster_addr":"172.21.15.72:6811/90918","heartbeat_back_addr":"172.21.15.72:6815/90918","heartbeat_front_addr":"172.21.15.72:6813/90918","state":["exists","up"]},{"osd":7,"uuid":"364c5119-6b13-4c75-b3f0-15e165eff86a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":90948},{"type":"v1","addr":"172.21.15.72:6822","nonce":90948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":90948},{"type":"v1","addr":"172.21.15.72:6826","nonce":90948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":90948},{"type":"v1","addr":"172.21.15.72:6831","nonce":90948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":90948},{"type":"v1","addr":"172.21.15.72:6829","nonce":90948}]},"public_addr":"172.21.15.72:6822/90948","cluster_addr":"172.21.15.72:6826/90948","heartbeat_back_addr":"172.21.15.72:6831/90948","heartbeat_front_addr":"172.21.15.72:6829/90948","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.642976+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.645372+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.619116+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.663042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.599163+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.646411+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.631545+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.669821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.72:6834/2476889061":"2023-10-07T01:41:36.177074+0000","172.21.15.72:6832/2476889061":"2023-10-07T01:41:36.177074+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:41:44.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.218+0000 7f44e6723700 1 -- 172.21.15.71:0/156426217 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f44cc066f30 msgr2=0x7f44cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:44.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.218+0000 7f44e6723700 1 --2- 172.21.15.71:0/156426217 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f44cc066f30 0x7f44cc0693e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f44d0006f00 tx=0x7f44d0008040 comp rx=0 tx=0).stop 2023-10-06T01:41:44.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.218+0000 7f44e6723700 1 -- 172.21.15.71:0/156426217 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f44e00af8b0 msgr2=0x7f44e01676a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:44.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.218+0000 7f44e6723700 1 --2- 172.21.15.71:0/156426217 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f44e00af8b0 0x7f44e01676a0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f44e0089520 tx=0x7f44d4017000 comp rx=0 tx=0).stop 2023-10-06T01:41:44.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.218+0000 7f44e6723700 1 -- 172.21.15.71:0/156426217 shutdown_connections 2023-10-06T01:41:44.220 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.218+0000 7f44e6723700 1 --2- 172.21.15.71:0/156426217 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f44e015d460 0x7f44e016a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:44.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.218+0000 7f44e6723700 1 --2- 172.21.15.71:0/156426217 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f44cc066f30 0x7f44cc0693e0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:44.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.218+0000 7f44e6723700 1 --2- 172.21.15.71:0/156426217 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f44e00af4e0 0x7f44e00a6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:44.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.218+0000 7f44e6723700 1 --2- 172.21.15.71:0/156426217 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f44e00af8b0 0x7f44e01676a0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:44.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.218+0000 7f44e6723700 1 -- 172.21.15.71:0/156426217 >> 172.21.15.71:0/156426217 conn(0x7f44e0068680 msgr2=0x7f44e00d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:44.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.218+0000 7f44e6723700 1 -- 172.21.15.71:0/156426217 shutdown_connections 2023-10-06T01:41:44.221 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.218+0000 7f44e6723700 1 -- 172.21.15.71:0/156426217 wait complete. 2023-10-06T01:41:44.233 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T01:40:08.610349+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T01:40:15.387434+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T01:41:24.561219+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T01:41:25.445423+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T01:41:44.233 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T01:41:44.350 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.349+0000 7fbba4bdc700 1 Processor -- start 2023-10-06T01:41:44.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.349+0000 7fbba4bdc700 1 -- start start 2023-10-06T01:41:44.353 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.350+0000 7fbba4bdc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbba0156d00 0x7fbba0157140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:44.353 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.350+0000 7fbba4bdc700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbba00c90d0 con 0x7fbba006bbb0 2023-10-06T01:41:44.353 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.350+0000 7fbba4bdc700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbba00c7c60 con 0x7fbba006b7e0 2023-10-06T01:41:44.353 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.350+0000 7fbba4bdc700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbba0157680 con 0x7fbba0156d00 2023-10-06T01:41:44.353 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.350+0000 7fbb97fff700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fbba006bbb0 0x7fbba01565f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:58454/0 (socket says 172.21.15.71:58454) 2023-10-06T01:41:44.354 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.350+0000 7fbb97fff700 1 -- 172.21.15.71:0/2629692769 learned_addr learned my addr 172.21.15.71:0/2629692769 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:41:44.354 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.350+0000 7fbb9ed9d700 1 --2- 172.21.15.71:0/2629692769 >> v2:172.21.15.72:3300/0 conn(0x7fbba0156d00 0x7fbba0157140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:44.354 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.350+0000 7fbb9dd9b700 1 -- 172.21.15.71:0/2629692769 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3250086791 0 0) 0x7fbba00c90d0 con 0x7fbba006bbb0 2023-10-06T01:41:44.354 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.350+0000 7fbb9dd9b700 1 -- 172.21.15.71:0/2629692769 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb8c003570 con 0x7fbba006bbb0 2023-10-06T01:41:44.354 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.350+0000 7fbb9ed9d700 1 -- 172.21.15.71:0/2629692769 >> v1:172.21.15.72:6789/0 conn(0x7fbba006b7e0 legacy=0x7fbba00cac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:44.354 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.350+0000 7fbb9ed9d700 1 -- 172.21.15.71:0/2629692769 >> v1:172.21.15.71:6789/0 conn(0x7fbba006bbb0 legacy=0x7fbba01565f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:44.354 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.350+0000 7fbb9ed9d700 1 -- 172.21.15.71:0/2629692769 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbba00c7980 con 0x7fbba0156d00 2023-10-06T01:41:44.354 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.350+0000 7fbb9ed9d700 1 --2- 172.21.15.71:0/2629692769 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbba0156d00 0x7fbba0157140 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fbb98009e60 tx=0x7fbb98009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=770a6dd3bf38fda2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:44.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.351+0000 7fbb9dd9b700 1 -- 172.21.15.71:0/2629692769 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb9800e070 con 0x7fbba0156d00 2023-10-06T01:41:44.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.351+0000 7fbb9dd9b700 1 -- 172.21.15.71:0/2629692769 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb9800bb60 con 0x7fbba0156d00 2023-10-06T01:41:44.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.351+0000 7fbb9dd9b700 1 -- 172.21.15.71:0/2629692769 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb98012430 con 0x7fbba0156d00 2023-10-06T01:41:44.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.351+0000 7fbba4bdc700 1 -- 172.21.15.71:0/2629692769 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbba0156d00 msgr2=0x7fbba0157140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:44.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.351+0000 7fbba4bdc700 1 --2- 172.21.15.71:0/2629692769 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbba0156d00 0x7fbba0157140 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fbb98009e60 tx=0x7fbb98009780 comp rx=0 tx=0).stop 2023-10-06T01:41:44.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.351+0000 7fbba4bdc700 1 -- 172.21.15.71:0/2629692769 shutdown_connections 2023-10-06T01:41:44.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.351+0000 7fbba4bdc700 1 --2- 172.21.15.71:0/2629692769 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbba0156d00 0x7fbba0157140 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:44.355 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.351+0000 7fbba4bdc700 1 -- 172.21.15.71:0/2629692769 >> 172.21.15.71:0/2629692769 conn(0x7fbba006a260 msgr2=0x7fbba00cd030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:44.357 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.351+0000 7fbba4bdc700 1 -- 172.21.15.71:0/2629692769 shutdown_connections 2023-10-06T01:41:44.357 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.351+0000 7fbba4bdc700 1 -- 172.21.15.71:0/2629692769 wait complete. 2023-10-06T01:41:44.360 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.352+0000 7fbba4bdc700 1 Processor -- start 2023-10-06T01:41:44.360 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.352+0000 7fbba4bdc700 1 -- start start 2023-10-06T01:41:44.360 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.353+0000 7fbba4bdc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbba006b7e0 0x7fbba00af270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:44.360 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.353+0000 7fbba4bdc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbba006bbb0 0x7fbba0146bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:44.360 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.353+0000 7fbba4bdc700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbba0156d00 0x7fbba00b1b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:44.361 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.353+0000 7fbba4bdc700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbba0147130 con 0x7fbba0156d00 2023-10-06T01:41:44.361 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.353+0000 7fbba4bdc700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbba00ad120 con 0x7fbba006b7e0 2023-10-06T01:41:44.361 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.353+0000 7fbba4bdc700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbba00b23c0 con 0x7fbba006bbb0 2023-10-06T01:41:44.361 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.353+0000 7fbb9ed9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbba0156d00 0x7fbba00b1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:44.361 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.353+0000 7fbb9ed9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbba0156d00 0x7fbba00b1b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:58082/0 (socket says 172.21.15.71:58082) 2023-10-06T01:41:44.361 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.353+0000 7fbb9ed9d700 1 -- 172.21.15.71:0/3184682695 learned_addr learned my addr 172.21.15.71:0/3184682695 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:44.361 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.353+0000 7fbb97fff700 1 --2- 172.21.15.71:0/3184682695 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbba006bbb0 0x7fbba0146bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:44.361 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.353+0000 7fbb9e59c700 1 --2- 172.21.15.71:0/3184682695 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbba006b7e0 0x7fbba00af270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:44.362 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.353+0000 7fbb9ed9d700 1 -- 172.21.15.71:0/3184682695 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbba006bbb0 msgr2=0x7fbba0146bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:44.362 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.353+0000 7fbb9ed9d700 1 --2- 172.21.15.71:0/3184682695 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbba006bbb0 0x7fbba0146bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:44.362 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.353+0000 7fbb9ed9d700 1 -- 172.21.15.71:0/3184682695 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbba006b7e0 msgr2=0x7fbba00af270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:44.362 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.353+0000 7fbb9ed9d700 1 --2- 172.21.15.71:0/3184682695 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbba006b7e0 0x7fbba00af270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:44.362 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.353+0000 7fbb9ed9d700 1 -- 172.21.15.71:0/3184682695 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb98009a20 con 0x7fbba0156d00 2023-10-06T01:41:44.362 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.353+0000 7fbb97fff700 1 --2- 172.21.15.71:0/3184682695 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbba006bbb0 0x7fbba0146bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:41:44.362 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.353+0000 7fbb9ed9d700 1 --2- 172.21.15.71:0/3184682695 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbba0156d00 0x7fbba00b1b20 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fbb9800b6c0 tx=0x7fbb98019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:44.362 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.354+0000 7fbb967fc700 1 -- 172.21.15.71:0/3184682695 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb98012e30 con 0x7fbba0156d00 2023-10-06T01:41:44.362 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.354+0000 7fbb967fc700 1 -- 172.21.15.71:0/3184682695 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb98021070 con 0x7fbba0156d00 2023-10-06T01:41:44.363 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.354+0000 7fbba4bdc700 1 -- 172.21.15.71:0/3184682695 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbba00ac7f0 con 0x7fbba0156d00 2023-10-06T01:41:44.363 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.354+0000 7fbb967fc700 1 -- 172.21.15.71:0/3184682695 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb98026680 con 0x7fbba0156d00 2023-10-06T01:41:44.363 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.354+0000 7fbba4bdc700 1 -- 172.21.15.71:0/3184682695 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbba00acdb0 con 0x7fbba0156d00 2023-10-06T01:41:44.363 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.355+0000 7fbba4bdc700 1 -- 172.21.15.71:0/3184682695 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbba00ad2b0 con 0x7fbba0156d00 2023-10-06T01:41:44.363 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.355+0000 7fbb967fc700 1 -- 172.21.15.71:0/3184682695 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbb98023030 con 0x7fbba0156d00 2023-10-06T01:41:44.363 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.355+0000 7fbb967fc700 1 --2- 172.21.15.71:0/3184682695 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fbb80066f30 0x7fbb800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:44.363 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.355+0000 7fbb967fc700 1 -- 172.21.15.71:0/3184682695 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fbb980869d0 con 0x7fbba0156d00 2023-10-06T01:41:44.363 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.355+0000 7fbb9e59c700 1 --2- 172.21.15.71:0/3184682695 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fbb80066f30 0x7fbb800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:44.363 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.356+0000 7fbb9e59c700 1 --2- 172.21.15.71:0/3184682695 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fbb80066f30 0x7fbb800693e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fbb90003880 tx=0x7fbb90009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:44.364 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.359+0000 7fbb967fc700 1 -- 172.21.15.71:0/3184682695 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbb98053950 con 0x7fbba0156d00 2023-10-06T01:41:44.544 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.542+0000 7fbba4bdc700 1 -- 172.21.15.71:0/3184682695 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbba00c9350 con 0x7fbba0156d00 2023-10-06T01:41:44.544 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.543+0000 7fbb967fc700 1 -- 172.21.15.71:0/3184682695 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v42) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbb98056f70 con 0x7fbba0156d00 2023-10-06T01:41:44.545 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 1 2023-10-06T01:41:44.546 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.544+0000 7fbba4bdc700 1 -- 172.21.15.71:0/3184682695 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fbb80066f30 msgr2=0x7fbb800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:44.547 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.544+0000 7fbba4bdc700 1 --2- 172.21.15.71:0/3184682695 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fbb80066f30 0x7fbb800693e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fbb90003880 tx=0x7fbb90009040 comp rx=0 tx=0).stop 2023-10-06T01:41:44.547 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.544+0000 7fbba4bdc700 1 -- 172.21.15.71:0/3184682695 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbba0156d00 msgr2=0x7fbba00b1b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:44.547 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.544+0000 7fbba4bdc700 1 --2- 172.21.15.71:0/3184682695 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbba0156d00 0x7fbba00b1b20 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fbb9800b6c0 tx=0x7fbb98019000 comp rx=0 tx=0).stop 2023-10-06T01:41:44.547 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.544+0000 7fbba4bdc700 1 -- 172.21.15.71:0/3184682695 shutdown_connections 2023-10-06T01:41:44.547 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.544+0000 7fbba4bdc700 1 --2- 172.21.15.71:0/3184682695 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbba0156d00 0x7fbba00b1b20 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:44.547 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.544+0000 7fbba4bdc700 1 --2- 172.21.15.71:0/3184682695 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fbb80066f30 0x7fbb800693e0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:44.547 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.544+0000 7fbba4bdc700 1 --2- 172.21.15.71:0/3184682695 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbba006b7e0 0x7fbba00af270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:44.547 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.544+0000 7fbba4bdc700 1 --2- 172.21.15.71:0/3184682695 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbba006bbb0 0x7fbba0146bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:44.547 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.544+0000 7fbba4bdc700 1 -- 172.21.15.71:0/3184682695 >> 172.21.15.71:0/3184682695 conn(0x7fbba006a260 msgr2=0x7fbba0158c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:44.547 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.544+0000 7fbba4bdc700 1 -- 172.21.15.71:0/3184682695 shutdown_connections 2023-10-06T01:41:44.548 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.544+0000 7fbba4bdc700 1 -- 172.21.15.71:0/3184682695 wait complete. 2023-10-06T01:41:44.558 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T01:41:44.677 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.675+0000 7fdfc91ea700 1 Processor -- start 2023-10-06T01:41:44.677 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.675+0000 7fdfc91ea700 1 -- start start 2023-10-06T01:41:44.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.676+0000 7fdfc91ea700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdfc4157d40 0x7fdfc4158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:44.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.676+0000 7fdfc91ea700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdfc406c210 0x7fdfc40c8010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:44.679 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.676+0000 7fdfc91ea700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fdfc40c8550 0x7fdfc4068680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:44.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.676+0000 7fdfc91ea700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfc40c8ad0 con 0x7fdfc40c8550 2023-10-06T01:41:44.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.676+0000 7fdfc91ea700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfc406b730 con 0x7fdfc406c210 2023-10-06T01:41:44.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.676+0000 7fdfc91ea700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc406ba10 con 0x7fdfc4157d40 2023-10-06T01:41:44.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.676+0000 7fdfc359e700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fdfc40c8550 0x7fdfc4068680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:44.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.676+0000 7fdfc359e700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fdfc40c8550 0x7fdfc4068680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:58094/0 (socket says 172.21.15.71:58094) 2023-10-06T01:41:44.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.676+0000 7fdfc359e700 1 -- 172.21.15.71:0/3300753231 learned_addr learned my addr 172.21.15.71:0/3300753231 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:44.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.676+0000 7fdfc2d9d700 1 --2- 172.21.15.71:0/3300753231 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdfc4157d40 0x7fdfc4158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:44.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.676+0000 7fdfba59c700 1 --2- 172.21.15.71:0/3300753231 >> v2:172.21.15.72:3300/0 conn(0x7fdfc406c210 0x7fdfc40c8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:44.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.676+0000 7fdfc359e700 1 -- 172.21.15.71:0/3300753231 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdfc4157d40 msgr2=0x7fdfc4158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:44.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.676+0000 7fdfc359e700 1 --2- 172.21.15.71:0/3300753231 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdfc4157d40 0x7fdfc4158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:44.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.676+0000 7fdfc359e700 1 -- 172.21.15.71:0/3300753231 >> v2:172.21.15.72:3300/0 conn(0x7fdfc406c210 msgr2=0x7fdfc40c8010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:44.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.676+0000 7fdfc359e700 1 --2- 172.21.15.71:0/3300753231 >> v2:172.21.15.72:3300/0 conn(0x7fdfc406c210 0x7fdfc40c8010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:44.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.676+0000 7fdfc359e700 1 -- 172.21.15.71:0/3300753231 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfc406bcf0 con 0x7fdfc40c8550 2023-10-06T01:41:44.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.677+0000 7fdfc2d9d700 1 --2- 172.21.15.71:0/3300753231 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdfc4157d40 0x7fdfc4158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:41:44.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.677+0000 7fdfba59c700 1 --2- 172.21.15.71:0/3300753231 >> v2:172.21.15.72:3300/0 conn(0x7fdfc406c210 0x7fdfc40c8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:41:44.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.677+0000 7fdfc359e700 1 --2- 172.21.15.71:0/3300753231 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdfc40c8550 0x7fdfc4068680 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fdfc406f1b0 tx=0x7fdfbc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62953a5bdc015e50 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:44.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.677+0000 7fdfc259c700 1 -- 172.21.15.71:0/3300753231 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfbc00e070 con 0x7fdfc40c8550 2023-10-06T01:41:44.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.677+0000 7fdfc259c700 1 -- 172.21.15.71:0/3300753231 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfbc00ba50 con 0x7fdfc40c8550 2023-10-06T01:41:44.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.677+0000 7fdfc259c700 1 -- 172.21.15.71:0/3300753231 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfbc0092e0 con 0x7fdfc40c8550 2023-10-06T01:41:44.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.677+0000 7fdfc91ea700 1 -- 172.21.15.71:0/3300753231 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdfc40c8550 msgr2=0x7fdfc4068680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:44.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.677+0000 7fdfc91ea700 1 --2- 172.21.15.71:0/3300753231 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdfc40c8550 0x7fdfc4068680 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fdfc406f1b0 tx=0x7fdfbc009840 comp rx=0 tx=0).stop 2023-10-06T01:41:44.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.677+0000 7fdfc91ea700 1 -- 172.21.15.71:0/3300753231 shutdown_connections 2023-10-06T01:41:44.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.677+0000 7fdfc91ea700 1 --2- 172.21.15.71:0/3300753231 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdfc40c8550 0x7fdfc4068680 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:44.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.677+0000 7fdfc91ea700 1 --2- 172.21.15.71:0/3300753231 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdfc4157d40 0x7fdfc4158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:44.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.677+0000 7fdfc91ea700 1 --2- 172.21.15.71:0/3300753231 >> v2:172.21.15.72:3300/0 conn(0x7fdfc406c210 0x7fdfc40c8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:44.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.677+0000 7fdfc91ea700 1 -- 172.21.15.71:0/3300753231 >> 172.21.15.71:0/3300753231 conn(0x7fdfc406a260 msgr2=0x7fdfc40cd030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:44.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.677+0000 7fdfc91ea700 1 -- 172.21.15.71:0/3300753231 shutdown_connections 2023-10-06T01:41:44.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.677+0000 7fdfc91ea700 1 -- 172.21.15.71:0/3300753231 wait complete. 2023-10-06T01:41:44.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.679+0000 7fdfc91ea700 1 Processor -- start 2023-10-06T01:41:44.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.679+0000 7fdfc91ea700 1 -- start start 2023-10-06T01:41:44.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.679+0000 7fdfc91ea700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdfc406c210 0x7fdfc40b04a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:44.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.679+0000 7fdfc91ea700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdfc40c8550 0x7fdfc40ad2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:44.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.679+0000 7fdfc91ea700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdfc4157d40 0x7fdfc41544d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:44.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.679+0000 7fdfc91ea700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc4154ce0 con 0x7fdfc4157d40 2023-10-06T01:41:44.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.679+0000 7fdfc91ea700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc40ad7f0 con 0x7fdfc406c210 2023-10-06T01:41:44.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.679+0000 7fdfc91ea700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc40b0ba0 con 0x7fdfc40c8550 2023-10-06T01:41:44.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.679+0000 7fdfc359e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdfc4157d40 0x7fdfc41544d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:44.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.679+0000 7fdfc359e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdfc4157d40 0x7fdfc41544d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:58102/0 (socket says 172.21.15.71:58102) 2023-10-06T01:41:44.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.680+0000 7fdfc359e700 1 -- 172.21.15.71:0/134045951 learned_addr learned my addr 172.21.15.71:0/134045951 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:44.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.680+0000 7fdfc2d9d700 1 --2- 172.21.15.71:0/134045951 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdfc406c210 0x7fdfc40b04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:44.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.680+0000 7fdfba59c700 1 --2- 172.21.15.71:0/134045951 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdfc40c8550 0x7fdfc40ad2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:44.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.680+0000 7fdfc359e700 1 -- 172.21.15.71:0/134045951 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdfc40c8550 msgr2=0x7fdfc40ad2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:44.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.680+0000 7fdfc359e700 1 --2- 172.21.15.71:0/134045951 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdfc40c8550 0x7fdfc40ad2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:44.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.680+0000 7fdfc359e700 1 -- 172.21.15.71:0/134045951 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdfc406c210 msgr2=0x7fdfc40b04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:44.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.680+0000 7fdfc359e700 1 --2- 172.21.15.71:0/134045951 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdfc406c210 0x7fdfc40b04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:44.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.680+0000 7fdfc359e700 1 -- 172.21.15.71:0/134045951 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfbc009ae0 con 0x7fdfc4157d40 2023-10-06T01:41:44.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.680+0000 7fdfc2d9d700 1 --2- 172.21.15.71:0/134045951 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdfc406c210 0x7fdfc40b04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:41:44.687 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.680+0000 7fdfc359e700 1 --2- 172.21.15.71:0/134045951 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdfc4157d40 0x7fdfc41544d0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fdfc40cce70 tx=0x7fdfbc018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:44.687 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.680+0000 7fdfbb7fe700 1 -- 172.21.15.71:0/134045951 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfbc0032f0 con 0x7fdfc4157d40 2023-10-06T01:41:44.687 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.680+0000 7fdfbb7fe700 1 -- 172.21.15.71:0/134045951 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfbc008dd0 con 0x7fdfc4157d40 2023-10-06T01:41:44.687 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.680+0000 7fdfc91ea700 1 -- 172.21.15.71:0/134045951 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfc4154a10 con 0x7fdfc4157d40 2023-10-06T01:41:44.687 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.680+0000 7fdfbb7fe700 1 -- 172.21.15.71:0/134045951 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfbc026690 con 0x7fdfc4157d40 2023-10-06T01:41:44.687 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.680+0000 7fdfc91ea700 1 -- 172.21.15.71:0/134045951 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfc4152200 con 0x7fdfc4157d40 2023-10-06T01:41:44.687 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.681+0000 7fdfc91ea700 1 -- 172.21.15.71:0/134045951 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfc40b0da0 con 0x7fdfc4157d40 2023-10-06T01:41:44.687 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.681+0000 7fdfbb7fe700 1 -- 172.21.15.71:0/134045951 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdfbc003040 con 0x7fdfc4157d40 2023-10-06T01:41:44.687 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.682+0000 7fdfbb7fe700 1 --2- 172.21.15.71:0/134045951 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fdfa4066f30 0x7fdfa40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:44.687 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.682+0000 7fdfc2d9d700 1 --2- 172.21.15.71:0/134045951 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fdfa4066f30 0x7fdfa40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:44.687 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.682+0000 7fdfbb7fe700 1 -- 172.21.15.71:0/134045951 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fdfbc086880 con 0x7fdfc4157d40 2023-10-06T01:41:44.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.682+0000 7fdfc2d9d700 1 --2- 172.21.15.71:0/134045951 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fdfa4066f30 0x7fdfa40693e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fdfb4006fd0 tx=0x7fdfb4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:44.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.686+0000 7fdfbb7fe700 1 -- 172.21.15.71:0/134045951 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdfbc0538b0 con 0x7fdfc4157d40 2023-10-06T01:41:44.872 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.870+0000 7fdfc91ea700 1 -- 172.21.15.71:0/134045951 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fdfc4158650 con 0x7fdfc4157d40 2023-10-06T01:41:44.872 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.871+0000 7fdfbb7fe700 1 -- 172.21.15.71:0/134045951 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v42) v1 ==== 92+0+10 (secure 0 0 0) 0x7fdfbc056ed0 con 0x7fdfc4157d40 2023-10-06T01:41:44.873 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 8 2023-10-06T01:41:44.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.873+0000 7fdfc91ea700 1 -- 172.21.15.71:0/134045951 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fdfa4066f30 msgr2=0x7fdfa40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:44.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.873+0000 7fdfc91ea700 1 --2- 172.21.15.71:0/134045951 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fdfa4066f30 0x7fdfa40693e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fdfb4006fd0 tx=0x7fdfb4008040 comp rx=0 tx=0).stop 2023-10-06T01:41:44.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.873+0000 7fdfc91ea700 1 -- 172.21.15.71:0/134045951 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdfc4157d40 msgr2=0x7fdfc41544d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:44.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.873+0000 7fdfc91ea700 1 --2- 172.21.15.71:0/134045951 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdfc4157d40 0x7fdfc41544d0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fdfc40cce70 tx=0x7fdfbc018000 comp rx=0 tx=0).stop 2023-10-06T01:41:44.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.873+0000 7fdfc91ea700 1 -- 172.21.15.71:0/134045951 shutdown_connections 2023-10-06T01:41:44.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.873+0000 7fdfc91ea700 1 --2- 172.21.15.71:0/134045951 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdfc4157d40 0x7fdfc41544d0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:44.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.873+0000 7fdfc91ea700 1 --2- 172.21.15.71:0/134045951 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fdfa4066f30 0x7fdfa40693e0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:44.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.873+0000 7fdfc91ea700 1 --2- 172.21.15.71:0/134045951 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdfc406c210 0x7fdfc40b04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:44.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.873+0000 7fdfc91ea700 1 --2- 172.21.15.71:0/134045951 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdfc40c8550 0x7fdfc40ad2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:44.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.873+0000 7fdfc91ea700 1 -- 172.21.15.71:0/134045951 >> 172.21.15.71:0/134045951 conn(0x7fdfc406a260 msgr2=0x7fdfc40c2690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:44.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.873+0000 7fdfc91ea700 1 -- 172.21.15.71:0/134045951 shutdown_connections 2023-10-06T01:41:44.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:44.873+0000 7fdfc91ea700 1 -- 172.21.15.71:0/134045951 wait complete. 2023-10-06T01:41:44.886 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T01:41:45.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.001+0000 7fef9e265700 1 Processor -- start 2023-10-06T01:41:45.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.002+0000 7fef9e265700 1 -- start start 2023-10-06T01:41:45.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.002+0000 7fef9e265700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fef98157d40 0x7fef98158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:45.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.002+0000 7fef9e265700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fef98068680 0x7fef98068b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:45.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.002+0000 7fef9e265700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef980c8ad0 con 0x7fef9806c210 2023-10-06T01:41:45.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.002+0000 7fef9e265700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef98069040 con 0x7fef98157d40 2023-10-06T01:41:45.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.002+0000 7fef9e265700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef9806b730 con 0x7fef98068680 2023-10-06T01:41:45.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.003+0000 7fef97fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fef98157d40 0x7fef98158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:45.012 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.003+0000 7fef97fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fef98157d40 0x7fef98158110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:58104/0 (socket says 172.21.15.71:58104) 2023-10-06T01:41:45.012 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.003+0000 7fef97fff700 1 -- 172.21.15.71:0/2803756349 learned_addr learned my addr 172.21.15.71:0/2803756349 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:45.012 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.003+0000 7fef9c802700 1 --2- 172.21.15.71:0/2803756349 >> v2:172.21.15.72:3300/0 conn(0x7fef98068680 0x7fef98068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:45.012 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.003+0000 7fef97fff700 1 -- 172.21.15.71:0/2803756349 >> v2:172.21.15.72:3300/0 conn(0x7fef98068680 msgr2=0x7fef98068b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:45.012 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.003+0000 7fef97fff700 1 --2- 172.21.15.71:0/2803756349 >> v2:172.21.15.72:3300/0 conn(0x7fef98068680 0x7fef98068b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:45.012 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.003+0000 7fef97fff700 1 -- 172.21.15.71:0/2803756349 >> v1:172.21.15.72:6789/0 conn(0x7fef9806c210 legacy=0x7fef980c8010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:45.012 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.003+0000 7fef97fff700 1 -- 172.21.15.71:0/2803756349 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef9806ba10 con 0x7fef98157d40 2023-10-06T01:41:45.012 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.003+0000 7fef97fff700 1 --2- 172.21.15.71:0/2803756349 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef98157d40 0x7fef98158110 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fef980c8ee0 tx=0x7fef88009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc8de6b85e188d8e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:45.013 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.003+0000 7fef96ffd700 1 -- 172.21.15.71:0/2803756349 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef8800b860 con 0x7fef98157d40 2023-10-06T01:41:45.013 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.003+0000 7fef96ffd700 1 -- 172.21.15.71:0/2803756349 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef8800b9c0 con 0x7fef98157d40 2023-10-06T01:41:45.013 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.003+0000 7fef96ffd700 1 -- 172.21.15.71:0/2803756349 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef8800bd60 con 0x7fef98157d40 2023-10-06T01:41:45.013 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.004+0000 7fef9e265700 1 -- 172.21.15.71:0/2803756349 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef98157d40 msgr2=0x7fef98158110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:45.013 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.004+0000 7fef9e265700 1 --2- 172.21.15.71:0/2803756349 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef98157d40 0x7fef98158110 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fef980c8ee0 tx=0x7fef88009250 comp rx=0 tx=0).stop 2023-10-06T01:41:45.013 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.004+0000 7fef9e265700 1 -- 172.21.15.71:0/2803756349 shutdown_connections 2023-10-06T01:41:45.014 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.004+0000 7fef9e265700 1 --2- 172.21.15.71:0/2803756349 >> v2:172.21.15.72:3300/0 conn(0x7fef98068680 0x7fef98068b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:45.014 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.004+0000 7fef9e265700 1 --2- 172.21.15.71:0/2803756349 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef98157d40 0x7fef98158110 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:45.014 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.004+0000 7fef9e265700 1 -- 172.21.15.71:0/2803756349 >> 172.21.15.71:0/2803756349 conn(0x7fef9806a260 msgr2=0x7fef980cd030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:45.014 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.004+0000 7fef9e265700 1 -- 172.21.15.71:0/2803756349 shutdown_connections 2023-10-06T01:41:45.014 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.004+0000 7fef9e265700 1 -- 172.21.15.71:0/2803756349 wait complete. 2023-10-06T01:41:45.014 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.005+0000 7fef9e265700 1 Processor -- start 2023-10-06T01:41:45.014 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.005+0000 7fef9e265700 1 -- start start 2023-10-06T01:41:45.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.006+0000 7fef9e265700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef98068680 0x7fef9814f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:45.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.006+0000 7fef9e265700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef9806c210 0x7fef9814db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:45.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.006+0000 7fef9e265700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef98157d40 0x7fef980a88d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:45.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.006+0000 7fef9e265700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef9814faf0 con 0x7fef98068680 2023-10-06T01:41:45.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.006+0000 7fef9e265700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef98151710 con 0x7fef98157d40 2023-10-06T01:41:45.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.006+0000 7fef9e265700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef980cb6d0 con 0x7fef9806c210 2023-10-06T01:41:45.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.006+0000 7fef97fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef98068680 0x7fef9814f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:45.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.006+0000 7fef97fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef98068680 0x7fef9814f5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:58108/0 (socket says 172.21.15.71:58108) 2023-10-06T01:41:45.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.006+0000 7fef97fff700 1 -- 172.21.15.71:0/2524794508 learned_addr learned my addr 172.21.15.71:0/2524794508 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:45.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.006+0000 7fef977fe700 1 --2- 172.21.15.71:0/2524794508 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef9806c210 0x7fef9814db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:45.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.006+0000 7fef9c802700 1 --2- 172.21.15.71:0/2524794508 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef98157d40 0x7fef980a88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:45.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.006+0000 7fef97fff700 1 -- 172.21.15.71:0/2524794508 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef9806c210 msgr2=0x7fef9814db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:45.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.006+0000 7fef97fff700 1 --2- 172.21.15.71:0/2524794508 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef9806c210 0x7fef9814db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:45.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.006+0000 7fef97fff700 1 -- 172.21.15.71:0/2524794508 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef98157d40 msgr2=0x7fef980a88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:45.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.006+0000 7fef97fff700 1 --2- 172.21.15.71:0/2524794508 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef98157d40 0x7fef980a88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:45.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.006+0000 7fef97fff700 1 -- 172.21.15.71:0/2524794508 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef880094f0 con 0x7fef98068680 2023-10-06T01:41:45.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.006+0000 7fef977fe700 1 --2- 172.21.15.71:0/2524794508 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef9806c210 0x7fef9814db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:41:45.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.006+0000 7fef9c802700 1 --2- 172.21.15.71:0/2524794508 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef98157d40 0x7fef980a88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:41:45.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.006+0000 7fef97fff700 1 --2- 172.21.15.71:0/2524794508 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef98068680 0x7fef9814f5b0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fef980cce70 tx=0x7fef88017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:45.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.006+0000 7fef7ffff700 1 -- 172.21.15.71:0/2524794508 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef88011e60 con 0x7fef98068680 2023-10-06T01:41:45.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.007+0000 7fef7ffff700 1 -- 172.21.15.71:0/2524794508 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef8801a630 con 0x7fef98068680 2023-10-06T01:41:45.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.007+0000 7fef9e265700 1 -- 172.21.15.71:0/2524794508 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef9814e0a0 con 0x7fef98068680 2023-10-06T01:41:45.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.007+0000 7fef7ffff700 1 -- 172.21.15.71:0/2524794508 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef8801a9f0 con 0x7fef98068680 2023-10-06T01:41:45.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.007+0000 7fef9e265700 1 -- 172.21.15.71:0/2524794508 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef980cada0 con 0x7fef98068680 2023-10-06T01:41:45.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.008+0000 7fef9e265700 1 -- 172.21.15.71:0/2524794508 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef9806e700 con 0x7fef98068680 2023-10-06T01:41:45.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.008+0000 7fef7ffff700 1 -- 172.21.15.71:0/2524794508 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fef8802d440 con 0x7fef98068680 2023-10-06T01:41:45.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.008+0000 7fef7ffff700 1 --2- 172.21.15.71:0/2524794508 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fef84066f30 0x7fef840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:45.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.008+0000 7fef7ffff700 1 -- 172.21.15.71:0/2524794508 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fef88086330 con 0x7fef98068680 2023-10-06T01:41:45.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.008+0000 7fef977fe700 1 --2- 172.21.15.71:0/2524794508 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fef84066f30 0x7fef840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:45.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.009+0000 7fef977fe700 1 --2- 172.21.15.71:0/2524794508 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fef84066f30 0x7fef840693e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fef9816d7a0 tx=0x7fef8c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:45.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.012+0000 7fef7ffff700 1 -- 172.21.15.71:0/2524794508 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fef880532b0 con 0x7fef98068680 2023-10-06T01:41:45.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.194+0000 7fef9e265700 1 -- 172.21.15.71:0/2524794508 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fef98068420 con 0x7fef98068680 2023-10-06T01:41:45.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.195+0000 7fef7ffff700 1 -- 172.21.15.71:0/2524794508 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v42) v1 ==== 104+0+11 (secure 0 0 0) 0x7fef880568d0 con 0x7fef98068680 2023-10-06T01:41:45.197 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 32 2023-10-06T01:41:45.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.196+0000 7fef9e265700 1 -- 172.21.15.71:0/2524794508 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fef84066f30 msgr2=0x7fef840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:45.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.196+0000 7fef9e265700 1 --2- 172.21.15.71:0/2524794508 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fef84066f30 0x7fef840693e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fef9816d7a0 tx=0x7fef8c009040 comp rx=0 tx=0).stop 2023-10-06T01:41:45.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.196+0000 7fef9e265700 1 -- 172.21.15.71:0/2524794508 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef98068680 msgr2=0x7fef9814f5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:45.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.196+0000 7fef9e265700 1 --2- 172.21.15.71:0/2524794508 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef98068680 0x7fef9814f5b0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fef980cce70 tx=0x7fef88017000 comp rx=0 tx=0).stop 2023-10-06T01:41:45.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.197+0000 7fef9e265700 1 -- 172.21.15.71:0/2524794508 shutdown_connections 2023-10-06T01:41:45.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.197+0000 7fef9e265700 1 --2- 172.21.15.71:0/2524794508 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fef84066f30 0x7fef840693e0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:45.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.197+0000 7fef9e265700 1 --2- 172.21.15.71:0/2524794508 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef98157d40 0x7fef980a88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:45.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.197+0000 7fef9e265700 1 --2- 172.21.15.71:0/2524794508 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef98068680 0x7fef9814f5b0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:45.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.197+0000 7fef9e265700 1 --2- 172.21.15.71:0/2524794508 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef9806c210 0x7fef9814db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:45.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.197+0000 7fef9e265700 1 -- 172.21.15.71:0/2524794508 >> 172.21.15.71:0/2524794508 conn(0x7fef9806a260 msgr2=0x7fef980ada20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:45.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.197+0000 7fef9e265700 1 -- 172.21.15.71:0/2524794508 shutdown_connections 2023-10-06T01:41:45.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.197+0000 7fef9e265700 1 -- 172.21.15.71:0/2524794508 wait complete. 2023-10-06T01:41:45.210 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T01:41:45.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.325+0000 7fae7677a700 1 Processor -- start 2023-10-06T01:41:45.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.325+0000 7fae7677a700 1 -- start start 2023-10-06T01:41:45.329 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.326+0000 7fae7677a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fae700ccd40 0x7fae700cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:45.330 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.326+0000 7fae7677a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fae700cf7e0 0x7fae700b3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:45.330 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.326+0000 7fae7677a700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae7015dd40 con 0x7fae700d0400 2023-10-06T01:41:45.330 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.326+0000 7fae7677a700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae7015e020 con 0x7fae700cf7e0 2023-10-06T01:41:45.330 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.326+0000 7fae7677a700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae700ceaa0 con 0x7fae700ccd40 2023-10-06T01:41:45.330 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.326+0000 7fae74d17700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fae700cf7e0 0x7fae700b3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:45.330 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.326+0000 7fae74d17700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fae700cf7e0 0x7fae700b3aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:58122/0 (socket says 172.21.15.71:58122) 2023-10-06T01:41:45.330 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.326+0000 7fae74d17700 1 -- 172.21.15.71:0/712894041 learned_addr learned my addr 172.21.15.71:0/712894041 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:45.330 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.326+0000 7fae6f7fe700 1 --2- 172.21.15.71:0/712894041 >> v2:172.21.15.72:3300/0 conn(0x7fae700ccd40 0x7fae700cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:45.330 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.327+0000 7fae74d17700 1 -- 172.21.15.71:0/712894041 >> v2:172.21.15.72:3300/0 conn(0x7fae700ccd40 msgr2=0x7fae700cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:45.330 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.327+0000 7fae74d17700 1 --2- 172.21.15.71:0/712894041 >> v2:172.21.15.72:3300/0 conn(0x7fae700ccd40 0x7fae700cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:45.331 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.327+0000 7fae74d17700 1 -- 172.21.15.71:0/712894041 >> v1:172.21.15.72:6789/0 conn(0x7fae700d0400 legacy=0x7fae700b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:45.331 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.327+0000 7fae74d17700 1 -- 172.21.15.71:0/712894041 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae700ced80 con 0x7fae700cf7e0 2023-10-06T01:41:45.331 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.327+0000 7fae74d17700 1 --2- 172.21.15.71:0/712894041 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fae700cf7e0 0x7fae700b3aa0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fae700cd1a0 tx=0x7fae68009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c2e058c52263753 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:45.331 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.327+0000 7fae6effd700 1 -- 172.21.15.71:0/712894041 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae6800e070 con 0x7fae700cf7e0 2023-10-06T01:41:45.331 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.327+0000 7fae6effd700 1 -- 172.21.15.71:0/712894041 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae6800ba20 con 0x7fae700cf7e0 2023-10-06T01:41:45.331 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.327+0000 7fae6effd700 1 -- 172.21.15.71:0/712894041 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae680092e0 con 0x7fae700cf7e0 2023-10-06T01:41:45.331 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.327+0000 7fae7677a700 1 -- 172.21.15.71:0/712894041 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fae700cf7e0 msgr2=0x7fae700b3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:45.331 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.327+0000 7fae7677a700 1 --2- 172.21.15.71:0/712894041 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fae700cf7e0 0x7fae700b3aa0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fae700cd1a0 tx=0x7fae68009840 comp rx=0 tx=0).stop 2023-10-06T01:41:45.331 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.327+0000 7fae7677a700 1 -- 172.21.15.71:0/712894041 shutdown_connections 2023-10-06T01:41:45.331 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.327+0000 7fae7677a700 1 --2- 172.21.15.71:0/712894041 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fae700cf7e0 0x7fae700b3aa0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:45.332 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.327+0000 7fae7677a700 1 --2- 172.21.15.71:0/712894041 >> v2:172.21.15.72:3300/0 conn(0x7fae700ccd40 0x7fae700cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:45.332 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.327+0000 7fae7677a700 1 -- 172.21.15.71:0/712894041 >> 172.21.15.71:0/712894041 conn(0x7fae7006a220 msgr2=0x7fae7006a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:45.332 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.328+0000 7fae7677a700 1 -- 172.21.15.71:0/712894041 shutdown_connections 2023-10-06T01:41:45.332 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.328+0000 7fae7677a700 1 -- 172.21.15.71:0/712894041 wait complete. 2023-10-06T01:41:45.334 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.329+0000 7fae7677a700 1 Processor -- start 2023-10-06T01:41:45.334 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.329+0000 7fae7677a700 1 -- start start 2023-10-06T01:41:45.334 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.329+0000 7fae7677a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fae700ccd40 0x7fae7014ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:45.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.330+0000 7fae7677a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fae700cf7e0 0x7fae7015c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:45.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.330+0000 7fae7677a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fae700d0400 0x7fae7016d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:45.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.330+0000 7fae7677a700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae7016d540 con 0x7fae700cf7e0 2023-10-06T01:41:45.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.330+0000 7fae7677a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae7016d7c0 con 0x7fae700ccd40 2023-10-06T01:41:45.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.330+0000 7fae7677a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae7016daa0 con 0x7fae700d0400 2023-10-06T01:41:45.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.330+0000 7fae6f7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fae700cf7e0 0x7fae7015c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:45.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.330+0000 7fae6f7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fae700cf7e0 0x7fae7015c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:58134/0 (socket says 172.21.15.71:58134) 2023-10-06T01:41:45.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.330+0000 7fae6f7fe700 1 -- 172.21.15.71:0/3785364320 learned_addr learned my addr 172.21.15.71:0/3785364320 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:45.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.330+0000 7fae74d17700 1 --2- 172.21.15.71:0/3785364320 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fae700d0400 0x7fae7016d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:45.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.330+0000 7fae6ffff700 1 --2- 172.21.15.71:0/3785364320 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fae700ccd40 0x7fae7014ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:45.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.330+0000 7fae6f7fe700 1 -- 172.21.15.71:0/3785364320 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fae700d0400 msgr2=0x7fae7016d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:45.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.330+0000 7fae6f7fe700 1 --2- 172.21.15.71:0/3785364320 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fae700d0400 0x7fae7016d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:45.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.330+0000 7fae6f7fe700 1 -- 172.21.15.71:0/3785364320 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fae700ccd40 msgr2=0x7fae7014ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:45.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.330+0000 7fae6f7fe700 1 --2- 172.21.15.71:0/3785364320 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fae700ccd40 0x7fae7014ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:45.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.330+0000 7fae6f7fe700 1 -- 172.21.15.71:0/3785364320 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae68009ae0 con 0x7fae700cf7e0 2023-10-06T01:41:45.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.330+0000 7fae6f7fe700 1 --2- 172.21.15.71:0/3785364320 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fae700cf7e0 0x7fae7015c9c0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fae6400ec80 tx=0x7fae640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:45.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.330+0000 7fae57fff700 1 -- 172.21.15.71:0/3785364320 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae6400c9d0 con 0x7fae700cf7e0 2023-10-06T01:41:45.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.330+0000 7fae57fff700 1 -- 172.21.15.71:0/3785364320 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae6400cb30 con 0x7fae700cf7e0 2023-10-06T01:41:45.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.330+0000 7fae7677a700 1 -- 172.21.15.71:0/3785364320 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae7016dd80 con 0x7fae700cf7e0 2023-10-06T01:41:45.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.330+0000 7fae57fff700 1 -- 172.21.15.71:0/3785364320 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae64013470 con 0x7fae700cf7e0 2023-10-06T01:41:45.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.330+0000 7fae7677a700 1 -- 172.21.15.71:0/3785364320 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae701699a0 con 0x7fae700cf7e0 2023-10-06T01:41:45.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.331+0000 7fae7677a700 1 -- 172.21.15.71:0/3785364320 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae70088760 con 0x7fae700cf7e0 2023-10-06T01:41:45.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.331+0000 7fae57fff700 1 -- 172.21.15.71:0/3785364320 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fae64013820 con 0x7fae700cf7e0 2023-10-06T01:41:45.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.332+0000 7fae57fff700 1 --2- 172.21.15.71:0/3785364320 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fae5c066f30 0x7fae5c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:45.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.332+0000 7fae57fff700 1 -- 172.21.15.71:0/3785364320 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fae64084bb0 con 0x7fae700cf7e0 2023-10-06T01:41:45.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.332+0000 7fae6ffff700 1 --2- 172.21.15.71:0/3785364320 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fae5c066f30 0x7fae5c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:45.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.332+0000 7fae6ffff700 1 --2- 172.21.15.71:0/3785364320 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fae5c066f30 0x7fae5c0693e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fae600037f0 tx=0x7fae60009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:45.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.336+0000 7fae57fff700 1 -- 172.21.15.71:0/3785364320 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fae64051b30 con 0x7fae700cf7e0 2023-10-06T01:41:45.516 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.515+0000 7fae7677a700 1 -- 172.21.15.71:0/3785364320 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fae700ce6c0 con 0x7fae700cf7e0 2023-10-06T01:41:45.517 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.515+0000 7fae57fff700 1 -- 172.21.15.71:0/3785364320 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v42) v1 ==== 100+0+11 (secure 0 0 0) 0x7fae64055150 con 0x7fae700cf7e0 2023-10-06T01:41:45.517 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 64 2023-10-06T01:41:45.519 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.518+0000 7fae7677a700 1 -- 172.21.15.71:0/3785364320 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fae5c066f30 msgr2=0x7fae5c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:45.520 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.518+0000 7fae7677a700 1 --2- 172.21.15.71:0/3785364320 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fae5c066f30 0x7fae5c0693e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fae600037f0 tx=0x7fae60009040 comp rx=0 tx=0).stop 2023-10-06T01:41:45.520 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.518+0000 7fae7677a700 1 -- 172.21.15.71:0/3785364320 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fae700cf7e0 msgr2=0x7fae7015c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:45.520 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.518+0000 7fae7677a700 1 --2- 172.21.15.71:0/3785364320 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fae700cf7e0 0x7fae7015c9c0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fae6400ec80 tx=0x7fae640091a0 comp rx=0 tx=0).stop 2023-10-06T01:41:45.520 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.518+0000 7fae7677a700 1 -- 172.21.15.71:0/3785364320 shutdown_connections 2023-10-06T01:41:45.520 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.518+0000 7fae7677a700 1 --2- 172.21.15.71:0/3785364320 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fae700d0400 0x7fae7016d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:45.520 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.518+0000 7fae7677a700 1 --2- 172.21.15.71:0/3785364320 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fae5c066f30 0x7fae5c0693e0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:45.521 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.518+0000 7fae7677a700 1 --2- 172.21.15.71:0/3785364320 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fae700ccd40 0x7fae7014ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:45.521 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.518+0000 7fae7677a700 1 --2- 172.21.15.71:0/3785364320 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fae700cf7e0 0x7fae7015c9c0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:45.521 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.518+0000 7fae7677a700 1 -- 172.21.15.71:0/3785364320 >> 172.21.15.71:0/3785364320 conn(0x7fae7006a220 msgr2=0x7fae7014e580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:45.521 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.518+0000 7fae7677a700 1 -- 172.21.15.71:0/3785364320 shutdown_connections 2023-10-06T01:41:45.521 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.518+0000 7fae7677a700 1 -- 172.21.15.71:0/3785364320 wait complete. 2023-10-06T01:41:45.531 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T01:41:45.646 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.644+0000 7f2da47d5700 1 Processor -- start 2023-10-06T01:41:45.646 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.644+0000 7f2da47d5700 1 -- start start 2023-10-06T01:41:45.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.645+0000 7f2da47d5700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2d9c067d10 0x7f2d9c06a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:45.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.645+0000 7f2da47d5700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2d9c15cde0 0x7f2d9c0b2360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:45.648 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.645+0000 7f2da47d5700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d9c0b1ed0 con 0x7f2d9c15ca10 2023-10-06T01:41:45.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.645+0000 7f2da47d5700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d9c0879c0 con 0x7f2d9c15cde0 2023-10-06T01:41:45.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.645+0000 7f2da47d5700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d9c0cec50 con 0x7f2d9c067d10 2023-10-06T01:41:45.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.645+0000 7f2da1d70700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2d9c067d10 0x7f2d9c06a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:45.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.645+0000 7f2da2571700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f2d9c15ca10 0x7f2d9c069f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.71:37972/0 (socket says 172.21.15.71:37972) 2023-10-06T01:41:45.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.645+0000 7f2da2571700 1 -- 172.21.15.71:0/1094768294 learned_addr learned my addr 172.21.15.71:0/1094768294 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:41:45.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.645+0000 7f2da2d72700 1 --2- 172.21.15.71:0/1094768294 >> v2:172.21.15.72:3300/0 conn(0x7f2d9c15cde0 0x7f2d9c0b2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:45.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.645+0000 7f2da1d70700 1 -- 172.21.15.71:0/1094768294 >> v2:172.21.15.72:3300/0 conn(0x7f2d9c15cde0 msgr2=0x7f2d9c0b2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:45.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.645+0000 7f2da1d70700 1 --2- 172.21.15.71:0/1094768294 >> v2:172.21.15.72:3300/0 conn(0x7f2d9c15cde0 0x7f2d9c0b2360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:45.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.645+0000 7f2da1d70700 1 -- 172.21.15.71:0/1094768294 >> v1:172.21.15.72:6789/0 conn(0x7f2d9c15ca10 legacy=0x7f2d9c069f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:45.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.645+0000 7f2da1d70700 1 -- 172.21.15.71:0/1094768294 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d9c0cef30 con 0x7f2d9c067d10 2023-10-06T01:41:45.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.645+0000 7f2da1d70700 1 --2- 172.21.15.71:0/1094768294 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2d9c067d10 0x7f2d9c06a680 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2d900098e0 tx=0x7f2d900091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70d7558a4f065587 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:45.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.646+0000 7f2da156f700 1 -- 172.21.15.71:0/1094768294 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d9000b640 con 0x7f2d9c067d10 2023-10-06T01:41:45.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.646+0000 7f2da156f700 1 -- 172.21.15.71:0/1094768294 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d9000b7a0 con 0x7f2d9c067d10 2023-10-06T01:41:45.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.646+0000 7f2da156f700 1 -- 172.21.15.71:0/1094768294 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d9000bb40 con 0x7f2d9c067d10 2023-10-06T01:41:45.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.646+0000 7f2da47d5700 1 -- 172.21.15.71:0/1094768294 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2d9c067d10 msgr2=0x7f2d9c06a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:45.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.646+0000 7f2da47d5700 1 --2- 172.21.15.71:0/1094768294 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2d9c067d10 0x7f2d9c06a680 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2d900098e0 tx=0x7f2d900091a0 comp rx=0 tx=0).stop 2023-10-06T01:41:45.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.646+0000 7f2da47d5700 1 -- 172.21.15.71:0/1094768294 shutdown_connections 2023-10-06T01:41:45.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.646+0000 7f2da47d5700 1 --2- 172.21.15.71:0/1094768294 >> v2:172.21.15.72:3300/0 conn(0x7f2d9c15cde0 0x7f2d9c0b2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:45.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.646+0000 7f2da47d5700 1 --2- 172.21.15.71:0/1094768294 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2d9c067d10 0x7f2d9c06a680 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:45.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.646+0000 7f2da47d5700 1 -- 172.21.15.71:0/1094768294 >> 172.21.15.71:0/1094768294 conn(0x7f2d9c067910 msgr2=0x7f2d9c0ce160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:45.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.646+0000 7f2da47d5700 1 -- 172.21.15.71:0/1094768294 shutdown_connections 2023-10-06T01:41:45.650 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.646+0000 7f2da47d5700 1 -- 172.21.15.71:0/1094768294 wait complete. 2023-10-06T01:41:45.653 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.647+0000 7f2da47d5700 1 Processor -- start 2023-10-06T01:41:45.653 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.647+0000 7f2da47d5700 1 -- start start 2023-10-06T01:41:45.653 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.648+0000 7f2da47d5700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2d9c067d10 0x7f2d9c0c3380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:45.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.648+0000 7f2da47d5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d9c15ca10 0x7f2d9c159a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:45.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.648+0000 7f2da47d5700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2d9c15cde0 0x7f2d9c159f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:45.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.648+0000 7f2da47d5700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d9c09bd30 con 0x7f2d9c15cde0 2023-10-06T01:41:45.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.648+0000 7f2da47d5700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d9c16a9c0 con 0x7f2d9c15ca10 2023-10-06T01:41:45.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.648+0000 7f2da47d5700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d9c098640 con 0x7f2d9c067d10 2023-10-06T01:41:45.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.648+0000 7f2da2d72700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2d9c15cde0 0x7f2d9c159f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:45.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.648+0000 7f2da2d72700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2d9c15cde0 0x7f2d9c159f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:58146/0 (socket says 172.21.15.71:58146) 2023-10-06T01:41:45.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.648+0000 7f2da2d72700 1 -- 172.21.15.71:0/2063138316 learned_addr learned my addr 172.21.15.71:0/2063138316 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:45.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.648+0000 7f2da2571700 1 --2- 172.21.15.71:0/2063138316 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2d9c067d10 0x7f2d9c0c3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:45.654 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.648+0000 7f2da1d70700 1 --2- 172.21.15.71:0/2063138316 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d9c15ca10 0x7f2d9c159a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:45.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.648+0000 7f2da2d72700 1 -- 172.21.15.71:0/2063138316 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2d9c067d10 msgr2=0x7f2d9c0c3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:45.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.648+0000 7f2da2d72700 1 --2- 172.21.15.71:0/2063138316 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2d9c067d10 0x7f2d9c0c3380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:45.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.648+0000 7f2da2d72700 1 -- 172.21.15.71:0/2063138316 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d9c15ca10 msgr2=0x7f2d9c159a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:45.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.648+0000 7f2da2d72700 1 --2- 172.21.15.71:0/2063138316 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d9c15ca10 0x7f2d9c159a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:45.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.648+0000 7f2da2d72700 1 -- 172.21.15.71:0/2063138316 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d90009420 con 0x7f2d9c15cde0 2023-10-06T01:41:45.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.649+0000 7f2da2d72700 1 --2- 172.21.15.71:0/2063138316 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2d9c15cde0 0x7f2d9c159f90 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c00e900 tx=0x7f2d8c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:45.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.649+0000 7f2d9a7fc700 1 -- 172.21.15.71:0/2063138316 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8c013680 con 0x7f2d9c15cde0 2023-10-06T01:41:45.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.649+0000 7f2d9a7fc700 1 -- 172.21.15.71:0/2063138316 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d8c013800 con 0x7f2d9c15cde0 2023-10-06T01:41:45.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.649+0000 7f2d9a7fc700 1 -- 172.21.15.71:0/2063138316 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d8c013bc0 con 0x7f2d9c15cde0 2023-10-06T01:41:45.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.649+0000 7f2da47d5700 1 -- 172.21.15.71:0/2063138316 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d9c097d10 con 0x7f2d9c15cde0 2023-10-06T01:41:45.655 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.649+0000 7f2da47d5700 1 -- 172.21.15.71:0/2063138316 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d9c0982d0 con 0x7f2d9c15cde0 2023-10-06T01:41:45.656 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.650+0000 7f2da47d5700 1 -- 172.21.15.71:0/2063138316 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d9c0987b0 con 0x7f2d9c15cde0 2023-10-06T01:41:45.656 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.650+0000 7f2d9a7fc700 1 -- 172.21.15.71:0/2063138316 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2d8c0123d0 con 0x7f2d9c15cde0 2023-10-06T01:41:45.656 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.651+0000 7f2d9a7fc700 1 --2- 172.21.15.71:0/2063138316 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f2d88066f30 0x7f2d880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:45.656 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.651+0000 7f2d9a7fc700 1 -- 172.21.15.71:0/2063138316 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f2d8c0849b0 con 0x7f2d9c15cde0 2023-10-06T01:41:45.656 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.651+0000 7f2da2571700 1 --2- 172.21.15.71:0/2063138316 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f2d88066f30 0x7f2d880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:45.656 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.651+0000 7f2da2571700 1 --2- 172.21.15.71:0/2063138316 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f2d88066f30 0x7f2d880693e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2d94005ca0 tx=0x7f2d94009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:45.656 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.656+0000 7f2d9a7fc700 1 -- 172.21.15.71:0/2063138316 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2d8c051930 con 0x7f2d9c15cde0 2023-10-06T01:41:45.885 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.883+0000 7f2da47d5700 1 -- 172.21.15.71:0/2063138316 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2d9c06e8d0 con 0x7f2d9c15cde0 2023-10-06T01:41:45.885 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.884+0000 7f2d9a7fc700 1 -- 172.21.15.71:0/2063138316 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4598 (secure 0 0 0) 0x7f2d8c054f50 con 0x7f2d9c15cde0 2023-10-06T01:41:45.885 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:41:45.885 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":23,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4889,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6834/1688339815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":1688339815},{"type":"v1","addr":"172.21.15.72:6834","nonce":1688339815}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5020,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/2765166441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6833","nonce":2765166441},{"type":"v1","addr":"172.21.15.72:6835","nonce":2765166441}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5145,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6836/1993673980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":1993673980},{"type":"v1","addr":"172.21.15.71:6836","nonce":1993673980}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T01:41:26.474510+0000","modified":"2023-10-06T01:41:39.188518+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":42,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5148},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5148":{"gid":5148,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.71:6837/3598886363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6835","nonce":3598886363},{"type":"v1","addr":"172.21.15.71:6837","nonce":3598886363}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T01:41:45.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.887+0000 7f2da47d5700 1 -- 172.21.15.71:0/2063138316 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f2d88066f30 msgr2=0x7f2d880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:45.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.887+0000 7f2da47d5700 1 --2- 172.21.15.71:0/2063138316 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f2d88066f30 0x7f2d880693e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2d94005ca0 tx=0x7f2d94009040 comp rx=0 tx=0).stop 2023-10-06T01:41:45.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.887+0000 7f2da47d5700 1 -- 172.21.15.71:0/2063138316 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2d9c15cde0 msgr2=0x7f2d9c159f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:45.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.887+0000 7f2da47d5700 1 --2- 172.21.15.71:0/2063138316 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2d9c15cde0 0x7f2d9c159f90 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c00e900 tx=0x7f2d8c0091a0 comp rx=0 tx=0).stop 2023-10-06T01:41:45.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.887+0000 7f2da47d5700 1 -- 172.21.15.71:0/2063138316 shutdown_connections 2023-10-06T01:41:45.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.887+0000 7f2da47d5700 1 --2- 172.21.15.71:0/2063138316 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2d9c15cde0 0x7f2d9c159f90 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:45.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.887+0000 7f2da47d5700 1 --2- 172.21.15.71:0/2063138316 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2d9c067d10 0x7f2d9c0c3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:45.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.887+0000 7f2da47d5700 1 --2- 172.21.15.71:0/2063138316 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f2d88066f30 0x7f2d880693e0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:45.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.887+0000 7f2da47d5700 1 --2- 172.21.15.71:0/2063138316 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d9c15ca10 0x7f2d9c159a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:45.889 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.887+0000 7f2da47d5700 1 -- 172.21.15.71:0/2063138316 >> 172.21.15.71:0/2063138316 conn(0x7f2d9c067910 msgr2=0x7f2d9c15b910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:45.889 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.887+0000 7f2da47d5700 1 -- 172.21.15.71:0/2063138316 shutdown_connections 2023-10-06T01:41:45.889 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:45.887+0000 7f2da47d5700 1 -- 172.21.15.71:0/2063138316 wait complete. 2023-10-06T01:41:45.889 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 23 2023-10-06T01:41:45.900 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:41:46.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.013+0000 7f0988261700 1 Processor -- start 2023-10-06T01:41:46.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.014+0000 7f0988261700 1 -- start start 2023-10-06T01:41:46.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.014+0000 7f0988261700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f098006e520 0x7f0980069de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:46.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.014+0000 7f0988261700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0980069950 con 0x7f09801597c0 2023-10-06T01:41:46.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.014+0000 7f0988261700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09800b1fb0 con 0x7f09801593f0 2023-10-06T01:41:46.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.014+0000 7f0988261700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09800b2850 con 0x7f098006e520 2023-10-06T01:41:46.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.015+0000 7f09867fe700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f09801597c0 0x7f098006a320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:58462/0 (socket says 172.21.15.71:58462) 2023-10-06T01:41:46.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.015+0000 7f09867fe700 1 -- 172.21.15.71:0/3041562128 learned_addr learned my addr 172.21.15.71:0/3041562128 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:41:46.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.015+0000 7f09857fc700 1 --2- 172.21.15.71:0/3041562128 >> v2:172.21.15.72:3300/0 conn(0x7f098006e520 0x7f0980069de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:46.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.015+0000 7f0984ffb700 1 -- 172.21.15.71:0/3041562128 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 240962131 0 0) 0x7f0980069950 con 0x7f09801597c0 2023-10-06T01:41:46.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.015+0000 7f0984ffb700 1 -- 172.21.15.71:0/3041562128 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f096c003570 con 0x7f09801597c0 2023-10-06T01:41:46.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.015+0000 7f09857fc700 1 -- 172.21.15.71:0/3041562128 >> v1:172.21.15.72:6789/0 conn(0x7f09801593f0 legacy=0x7f098006de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:46.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.015+0000 7f09857fc700 1 -- 172.21.15.71:0/3041562128 >> v1:172.21.15.71:6789/0 conn(0x7f09801597c0 legacy=0x7f098006a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:46.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.015+0000 7f09857fc700 1 -- 172.21.15.71:0/3041562128 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09800b2290 con 0x7f098006e520 2023-10-06T01:41:46.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.015+0000 7f09857fc700 1 --2- 172.21.15.71:0/3041562128 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f098006e520 0x7f0980069de0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f09700098d0 tx=0x7f0970009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=784a838ce6dcf164 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:46.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.015+0000 7f0984ffb700 1 -- 172.21.15.71:0/3041562128 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0970005c10 con 0x7f098006e520 2023-10-06T01:41:46.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.016+0000 7f0984ffb700 1 -- 172.21.15.71:0/3041562128 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0970005d70 con 0x7f098006e520 2023-10-06T01:41:46.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.016+0000 7f0984ffb700 1 -- 172.21.15.71:0/3041562128 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0970006280 con 0x7f098006e520 2023-10-06T01:41:46.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.016+0000 7f0988261700 1 -- 172.21.15.71:0/3041562128 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f098006e520 msgr2=0x7f0980069de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:46.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.016+0000 7f0988261700 1 --2- 172.21.15.71:0/3041562128 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f098006e520 0x7f0980069de0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f09700098d0 tx=0x7f0970009120 comp rx=0 tx=0).stop 2023-10-06T01:41:46.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.016+0000 7f0988261700 1 -- 172.21.15.71:0/3041562128 shutdown_connections 2023-10-06T01:41:46.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.016+0000 7f0988261700 1 --2- 172.21.15.71:0/3041562128 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f098006e520 0x7f0980069de0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:46.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.016+0000 7f0988261700 1 -- 172.21.15.71:0/3041562128 >> 172.21.15.71:0/3041562128 conn(0x7f098006cff0 msgr2=0x7f09800afaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:46.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.016+0000 7f0988261700 1 -- 172.21.15.71:0/3041562128 shutdown_connections 2023-10-06T01:41:46.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.016+0000 7f0988261700 1 -- 172.21.15.71:0/3041562128 wait complete. 2023-10-06T01:41:46.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.017+0000 7f0988261700 1 Processor -- start 2023-10-06T01:41:46.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.017+0000 7f0988261700 1 -- start start 2023-10-06T01:41:46.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.018+0000 7f0988261700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f098006e520 0x7f09800c9100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:46.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.018+0000 7f0988261700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09801593f0 0x7f0980154400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:46.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.018+0000 7f0988261700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f09801597c0 0x7f09800af430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:46.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.018+0000 7f0988261700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09800c8c70 con 0x7f098006e520 2023-10-06T01:41:46.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.018+0000 7f0988261700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09800c9640 con 0x7f09801593f0 2023-10-06T01:41:46.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.018+0000 7f0988261700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09800caaf0 con 0x7f09801597c0 2023-10-06T01:41:46.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.018+0000 7f0985ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f098006e520 0x7f09800c9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:46.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.018+0000 7f0985ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f098006e520 0x7f09800c9100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:58148/0 (socket says 172.21.15.71:58148) 2023-10-06T01:41:46.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.018+0000 7f0985ffd700 1 -- 172.21.15.71:0/3465965034 learned_addr learned my addr 172.21.15.71:0/3465965034 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:46.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.018+0000 7f09857fc700 1 --2- 172.21.15.71:0/3465965034 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09801593f0 0x7f0980154400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:46.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.018+0000 7f09867fe700 1 --2- 172.21.15.71:0/3465965034 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f09801597c0 0x7f09800af430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:46.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.018+0000 7f0985ffd700 1 -- 172.21.15.71:0/3465965034 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f09801597c0 msgr2=0x7f09800af430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:46.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.018+0000 7f0985ffd700 1 --2- 172.21.15.71:0/3465965034 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f09801597c0 0x7f09800af430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:46.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.018+0000 7f0985ffd700 1 -- 172.21.15.71:0/3465965034 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09801593f0 msgr2=0x7f0980154400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:46.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.018+0000 7f0985ffd700 1 --2- 172.21.15.71:0/3465965034 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09801593f0 0x7f0980154400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:46.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.018+0000 7f0985ffd700 1 -- 172.21.15.71:0/3465965034 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09700093c0 con 0x7f098006e520 2023-10-06T01:41:46.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.018+0000 7f0985ffd700 1 --2- 172.21.15.71:0/3465965034 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f098006e520 0x7f09800c9100 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f097c00c590 tx=0x7f097c00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:46.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.019+0000 7f0975ffb700 1 -- 172.21.15.71:0/3465965034 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f097c011590 con 0x7f098006e520 2023-10-06T01:41:46.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.019+0000 7f0975ffb700 1 -- 172.21.15.71:0/3465965034 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f097c0116f0 con 0x7f098006e520 2023-10-06T01:41:46.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.019+0000 7f0988261700 1 -- 172.21.15.71:0/3465965034 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09800c8340 con 0x7f098006e520 2023-10-06T01:41:46.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.019+0000 7f0975ffb700 1 -- 172.21.15.71:0/3465965034 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f097c011ab0 con 0x7f098006e520 2023-10-06T01:41:46.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.019+0000 7f0988261700 1 -- 172.21.15.71:0/3465965034 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09800c8900 con 0x7f098006e520 2023-10-06T01:41:46.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.020+0000 7f0988261700 1 -- 172.21.15.71:0/3465965034 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09800c8f50 con 0x7f098006e520 2023-10-06T01:41:46.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.020+0000 7f0975ffb700 1 -- 172.21.15.71:0/3465965034 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f097c01b3b0 con 0x7f098006e520 2023-10-06T01:41:46.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.020+0000 7f0975ffb700 1 --2- 172.21.15.71:0/3465965034 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f0964066f30 0x7f09640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:46.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.020+0000 7f0975ffb700 1 -- 172.21.15.71:0/3465965034 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f097c083dd0 con 0x7f098006e520 2023-10-06T01:41:46.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.020+0000 7f09857fc700 1 --2- 172.21.15.71:0/3465965034 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f0964066f30 0x7f09640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:46.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.021+0000 7f09857fc700 1 --2- 172.21.15.71:0/3465965034 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f0964066f30 0x7f09640693e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f098006e920 tx=0x7f0970016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:46.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.026+0000 7f0975ffb700 1 -- 172.21.15.71:0/3465965034 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f097c050d50 con 0x7f098006e520 2023-10-06T01:41:46.210 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.208+0000 7f0988261700 1 -- 172.21.15.71:0/3465965034 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f098006d3f0 con 0x7f098006e520 2023-10-06T01:41:46.211 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.209+0000 7f0975ffb700 1 -- 172.21.15.71:0/3465965034 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+17152 (secure 0 0 0) 0x7f097c017070 con 0x7f098006e520 2023-10-06T01:41:46.211 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:41:46.211 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":42,"fsid":"1fbf1bd2-f9b4-4599-bea2-f4aa920e9a56","created":"2023-10-06T01:39:57.016957+0000","modified":"2023-10-06T01:41:36.177102+0000","last_up_change":"2023-10-06T01:40:08.571643+0000","last_in_change":"2023-10-06T01:39:59.462741+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T01:40:08.610349+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T01:40:15.387434+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-06T01:41:24.561219+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-06T01:41:25.445423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cf059188-fb20-4dbf-95db-dcf57b213d03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":90670},{"type":"v1","addr":"172.21.15.71:6817","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":90670},{"type":"v1","addr":"172.21.15.71:6819","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":90670},{"type":"v1","addr":"172.21.15.71:6823","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":90670},{"type":"v1","addr":"172.21.15.71:6821","nonce":90670}]},"public_addr":"172.21.15.71:6817/90670","cluster_addr":"172.21.15.71:6819/90670","heartbeat_back_addr":"172.21.15.71:6823/90670","heartbeat_front_addr":"172.21.15.71:6821/90670","state":["exists","up"]},{"osd":1,"uuid":"0cff0aae-1799-4fe0-b610-54cf0813c0e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":90669},{"type":"v1","addr":"172.21.15.71:6809","nonce":90669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":90669},{"type":"v1","addr":"172.21.15.71:6811","nonce":90669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":90669},{"type":"v1","addr":"172.21.15.71:6815","nonce":90669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":90669},{"type":"v1","addr":"172.21.15.71:6813","nonce":90669}]},"public_addr":"172.21.15.71:6809/90669","cluster_addr":"172.21.15.71:6811/90669","heartbeat_back_addr":"172.21.15.71:6815/90669","heartbeat_front_addr":"172.21.15.71:6813/90669","state":["exists","up"]},{"osd":2,"uuid":"88d61ddc-9031-44e1-ba8c-546a41e7c8ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":90679},{"type":"v1","addr":"172.21.15.71:6825","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":90679},{"type":"v1","addr":"172.21.15.71:6827","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":90679},{"type":"v1","addr":"172.21.15.71:6831","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":90679},{"type":"v1","addr":"172.21.15.71:6829","nonce":90679}]},"public_addr":"172.21.15.71:6825/90679","cluster_addr":"172.21.15.71:6827/90679","heartbeat_back_addr":"172.21.15.71:6831/90679","heartbeat_front_addr":"172.21.15.71:6829/90679","state":["exists","up"]},{"osd":3,"uuid":"11ed92b7-960b-4a30-a889-a61d3eeb86f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":90668},{"type":"v1","addr":"172.21.15.71:6801","nonce":90668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":90668},{"type":"v1","addr":"172.21.15.71:6803","nonce":90668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":90668},{"type":"v1","addr":"172.21.15.71:6807","nonce":90668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":90668},{"type":"v1","addr":"172.21.15.71:6805","nonce":90668}]},"public_addr":"172.21.15.71:6801/90668","cluster_addr":"172.21.15.71:6803/90668","heartbeat_back_addr":"172.21.15.71:6807/90668","heartbeat_front_addr":"172.21.15.71:6805/90668","state":["exists","up"]},{"osd":4,"uuid":"ae4df784-abdf-4ddf-aefa-780f3ddafef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":90917},{"type":"v1","addr":"172.21.15.72:6801","nonce":90917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":90917},{"type":"v1","addr":"172.21.15.72:6803","nonce":90917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":90917},{"type":"v1","addr":"172.21.15.72:6807","nonce":90917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":90917},{"type":"v1","addr":"172.21.15.72:6805","nonce":90917}]},"public_addr":"172.21.15.72:6801/90917","cluster_addr":"172.21.15.72:6803/90917","heartbeat_back_addr":"172.21.15.72:6807/90917","heartbeat_front_addr":"172.21.15.72:6805/90917","state":["exists","up"]},{"osd":5,"uuid":"5ef0790f-001e-458f-a05b-efae216cf435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":90941},{"type":"v1","addr":"172.21.15.72:6817","nonce":90941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":90941},{"type":"v1","addr":"172.21.15.72:6819","nonce":90941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":90941},{"type":"v1","addr":"172.21.15.72:6827","nonce":90941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":90941},{"type":"v1","addr":"172.21.15.72:6823","nonce":90941}]},"public_addr":"172.21.15.72:6817/90941","cluster_addr":"172.21.15.72:6819/90941","heartbeat_back_addr":"172.21.15.72:6827/90941","heartbeat_front_addr":"172.21.15.72:6823/90941","state":["exists","up"]},{"osd":6,"uuid":"8705aef1-9ae8-4e54-a3c4-c2909fa0ceb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":90918},{"type":"v1","addr":"172.21.15.72:6809","nonce":90918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":90918},{"type":"v1","addr":"172.21.15.72:6811","nonce":90918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":90918},{"type":"v1","addr":"172.21.15.72:6815","nonce":90918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":90918},{"type":"v1","addr":"172.21.15.72:6813","nonce":90918}]},"public_addr":"172.21.15.72:6809/90918","cluster_addr":"172.21.15.72:6811/90918","heartbeat_back_addr":"172.21.15.72:6815/90918","heartbeat_front_addr":"172.21.15.72:6813/90918","state":["exists","up"]},{"osd":7,"uuid":"364c5119-6b13-4c75-b3f0-15e165eff86a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":90948},{"type":"v1","addr":"172.21.15.72:6822","nonce":90948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":90948},{"type":"v1","addr":"172.21.15.72:6826","nonce":90948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":90948},{"type":"v1","addr":"172.21.15.72:6831","nonce":90948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":90948},{"type":"v1","addr":"172.21.15.72:6829","nonce":90948}]},"public_addr":"172.21.15.72:6822/90948","cluster_addr":"172.21.15.72:6826/90948","heartbeat_back_addr":"172.21.15.72:6831/90948","heartbeat_front_addr":"172.21.15.72:6829/90948","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.642976+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.645372+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.619116+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.663042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.599163+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.646411+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.631545+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.669821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.72:6834/2476889061":"2023-10-07T01:41:36.177074+0000","172.21.15.72:6832/2476889061":"2023-10-07T01:41:36.177074+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:41:46.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.212+0000 7f0988261700 1 -- 172.21.15.71:0/3465965034 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f0964066f30 msgr2=0x7f09640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:46.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.212+0000 7f0988261700 1 --2- 172.21.15.71:0/3465965034 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f0964066f30 0x7f09640693e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f098006e920 tx=0x7f0970016000 comp rx=0 tx=0).stop 2023-10-06T01:41:46.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.212+0000 7f0988261700 1 -- 172.21.15.71:0/3465965034 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f098006e520 msgr2=0x7f09800c9100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:46.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.212+0000 7f0988261700 1 --2- 172.21.15.71:0/3465965034 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f098006e520 0x7f09800c9100 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f097c00c590 tx=0x7f097c00c950 comp rx=0 tx=0).stop 2023-10-06T01:41:46.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.212+0000 7f0988261700 1 -- 172.21.15.71:0/3465965034 shutdown_connections 2023-10-06T01:41:46.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.212+0000 7f0988261700 1 --2- 172.21.15.71:0/3465965034 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f09801597c0 0x7f09800af430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:46.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.212+0000 7f0988261700 1 --2- 172.21.15.71:0/3465965034 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f098006e520 0x7f09800c9100 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:46.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.212+0000 7f0988261700 1 --2- 172.21.15.71:0/3465965034 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f0964066f30 0x7f09640693e0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:46.215 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.212+0000 7f0988261700 1 --2- 172.21.15.71:0/3465965034 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09801593f0 0x7f0980154400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:46.215 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.212+0000 7f0988261700 1 -- 172.21.15.71:0/3465965034 >> 172.21.15.71:0/3465965034 conn(0x7f098006cff0 msgr2=0x7f09800ce6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:46.215 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.212+0000 7f0988261700 1 -- 172.21.15.71:0/3465965034 shutdown_connections 2023-10-06T01:41:46.215 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.212+0000 7f0988261700 1 -- 172.21.15.71:0/3465965034 wait complete. 2023-10-06T01:41:46.226 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T01:41:46.226 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T01:41:46.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.338+0000 7f0be3adb700 1 Processor -- start 2023-10-06T01:41:46.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.338+0000 7f0be3adb700 1 -- start start 2023-10-06T01:41:46.342 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.339+0000 7f0be3adb700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0bdc0af8b0 0x7f0bdc15d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:46.342 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.339+0000 7f0be3adb700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0bdc0b27f0 0x7f0bdc15d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:46.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.339+0000 7f0be3adb700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bdc15e190 con 0x7f0bdc0af4e0 2023-10-06T01:41:46.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.339+0000 7f0be3adb700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bdc0b1910 con 0x7f0bdc0b27f0 2023-10-06T01:41:46.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.339+0000 7f0be3adb700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bdc0cb650 con 0x7f0bdc0af8b0 2023-10-06T01:41:46.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.339+0000 7f0be1877700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f0bdc0af4e0 0x7f0bdc0b20e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:58478/0 (socket says 172.21.15.71:58478) 2023-10-06T01:41:46.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.339+0000 7f0be1877700 1 -- 172.21.15.71:0/3992690141 learned_addr learned my addr 172.21.15.71:0/3992690141 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:41:46.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.340+0000 7f0be2078700 1 --2- 172.21.15.71:0/3992690141 >> v2:172.21.15.72:3300/0 conn(0x7f0bdc0b27f0 0x7f0bdc15d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:46.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.340+0000 7f0be1076700 1 --2- 172.21.15.71:0/3992690141 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0bdc0af8b0 0x7f0bdc15d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:46.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.340+0000 7f0be0875700 1 -- 172.21.15.71:0/3992690141 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1213711383 0 0) 0x7f0bdc15e190 con 0x7f0bdc0af4e0 2023-10-06T01:41:46.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.340+0000 7f0be0875700 1 -- 172.21.15.71:0/3992690141 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0bc8003570 con 0x7f0bdc0af4e0 2023-10-06T01:41:46.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.340+0000 7f0be0875700 1 -- 172.21.15.71:0/3992690141 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3962780739 0 0) 0x7f0bc8003570 con 0x7f0bdc0af4e0 2023-10-06T01:41:46.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.340+0000 7f0be1076700 1 -- 172.21.15.71:0/3992690141 >> v2:172.21.15.72:3300/0 conn(0x7f0bdc0b27f0 msgr2=0x7f0bdc15d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:46.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.340+0000 7f0be1076700 1 --2- 172.21.15.71:0/3992690141 >> v2:172.21.15.72:3300/0 conn(0x7f0bdc0b27f0 0x7f0bdc15d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:46.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.340+0000 7f0be1076700 1 -- 172.21.15.71:0/3992690141 >> v1:172.21.15.71:6789/0 conn(0x7f0bdc0af4e0 legacy=0x7f0bdc0b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:46.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.340+0000 7f0be1076700 1 -- 172.21.15.71:0/3992690141 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bdc0ccaf0 con 0x7f0bdc0af8b0 2023-10-06T01:41:46.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.340+0000 7f0be2078700 1 --2- 172.21.15.71:0/3992690141 >> v2:172.21.15.72:3300/0 conn(0x7f0bdc0b27f0 0x7f0bdc15d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:41:46.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.340+0000 7f0be1076700 1 --2- 172.21.15.71:0/3992690141 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0bdc0af8b0 0x7f0bdc15d460 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc0098e0 tx=0x7f0bcc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=98c7fdf680c6f503 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:46.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.340+0000 7f0be0875700 1 -- 172.21.15.71:0/3992690141 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd80017f0 con 0x7f0bdc0af8b0 2023-10-06T01:41:46.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.340+0000 7f0be0875700 1 -- 172.21.15.71:0/3992690141 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bcc011420 con 0x7f0bdc0af8b0 2023-10-06T01:41:46.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.340+0000 7f0be0875700 1 -- 172.21.15.71:0/3992690141 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bcc0117c0 con 0x7f0bdc0af8b0 2023-10-06T01:41:46.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.341+0000 7f0be3adb700 1 -- 172.21.15.71:0/3992690141 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0bdc0af8b0 msgr2=0x7f0bdc15d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:46.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.341+0000 7f0be3adb700 1 --2- 172.21.15.71:0/3992690141 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0bdc0af8b0 0x7f0bdc15d460 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc0098e0 tx=0x7f0bcc0091a0 comp rx=0 tx=0).stop 2023-10-06T01:41:46.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.341+0000 7f0be3adb700 1 -- 172.21.15.71:0/3992690141 shutdown_connections 2023-10-06T01:41:46.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.341+0000 7f0be3adb700 1 --2- 172.21.15.71:0/3992690141 >> v2:172.21.15.72:3300/0 conn(0x7f0bdc0b27f0 0x7f0bdc15d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:46.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.341+0000 7f0be3adb700 1 --2- 172.21.15.71:0/3992690141 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0bdc0af8b0 0x7f0bdc15d460 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:46.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.341+0000 7f0be3adb700 1 -- 172.21.15.71:0/3992690141 >> 172.21.15.71:0/3992690141 conn(0x7f0bdc068680 msgr2=0x7f0bdc068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:46.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.341+0000 7f0be3adb700 1 -- 172.21.15.71:0/3992690141 shutdown_connections 2023-10-06T01:41:46.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.341+0000 7f0be3adb700 1 -- 172.21.15.71:0/3992690141 wait complete. 2023-10-06T01:41:46.349 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.342+0000 7f0be3adb700 1 Processor -- start 2023-10-06T01:41:46.349 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.342+0000 7f0be3adb700 1 -- start start 2023-10-06T01:41:46.349 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.344+0000 7f0be3adb700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0bdc0af4e0 0x7f0bdc0c9d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:46.349 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.344+0000 7f0be3adb700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0bdc0af8b0 0x7f0bdc0a6d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:46.349 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.344+0000 7f0be3adb700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0bdc0b27f0 0x7f0bdc159cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:46.349 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.344+0000 7f0be3adb700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bdc0c99a0 con 0x7f0bdc0af8b0 2023-10-06T01:41:46.349 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.344+0000 7f0be3adb700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bdc15a230 con 0x7f0bdc0b27f0 2023-10-06T01:41:46.349 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.344+0000 7f0be3adb700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bdc0a7fa0 con 0x7f0bdc0af4e0 2023-10-06T01:41:46.349 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.344+0000 7f0be1076700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0bdc0af8b0 0x7f0bdc0a6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:46.349 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.344+0000 7f0be1076700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0bdc0af8b0 0x7f0bdc0a6d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:58156/0 (socket says 172.21.15.71:58156) 2023-10-06T01:41:46.350 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.344+0000 7f0be1076700 1 -- 172.21.15.71:0/174285081 learned_addr learned my addr 172.21.15.71:0/174285081 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:46.350 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.344+0000 7f0be1877700 1 --2- 172.21.15.71:0/174285081 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0bdc0af4e0 0x7f0bdc0c9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:46.350 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.344+0000 7f0be2078700 1 --2- 172.21.15.71:0/174285081 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0bdc0b27f0 0x7f0bdc159cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:46.350 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.344+0000 7f0be1076700 1 -- 172.21.15.71:0/174285081 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0bdc0af4e0 msgr2=0x7f0bdc0c9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:46.350 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.344+0000 7f0be1076700 1 --2- 172.21.15.71:0/174285081 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0bdc0af4e0 0x7f0bdc0c9d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:46.350 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.344+0000 7f0be1076700 1 -- 172.21.15.71:0/174285081 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0bdc0b27f0 msgr2=0x7f0bdc159cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:46.350 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.344+0000 7f0be1076700 1 --2- 172.21.15.71:0/174285081 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0bdc0b27f0 0x7f0bdc159cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:46.350 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.344+0000 7f0be1076700 1 -- 172.21.15.71:0/174285081 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bd4009420 con 0x7f0bdc0af8b0 2023-10-06T01:41:46.350 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.344+0000 7f0be2078700 1 --2- 172.21.15.71:0/174285081 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0bdc0b27f0 0x7f0bdc159cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:41:46.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.344+0000 7f0be1076700 1 --2- 172.21.15.71:0/174285081 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0bdc0af8b0 0x7f0bdc0a6d20 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc0030c0 tx=0x7f0bcc016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:46.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.344+0000 7f0bd1ffb700 1 -- 172.21.15.71:0/174285081 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bcc01cc90 con 0x7f0bdc0af8b0 2023-10-06T01:41:46.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.344+0000 7f0bd1ffb700 1 -- 172.21.15.71:0/174285081 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bcc01cdf0 con 0x7f0bdc0af8b0 2023-10-06T01:41:46.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.344+0000 7f0be3adb700 1 -- 172.21.15.71:0/174285081 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bcc009420 con 0x7f0bdc0af8b0 2023-10-06T01:41:46.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.344+0000 7f0bd1ffb700 1 -- 172.21.15.71:0/174285081 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bcc025680 con 0x7f0bdc0af8b0 2023-10-06T01:41:46.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.344+0000 7f0be3adb700 1 -- 172.21.15.71:0/174285081 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bdc0a7700 con 0x7f0bdc0af8b0 2023-10-06T01:41:46.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.344+0000 7f0be3adb700 1 -- 172.21.15.71:0/174285081 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bdc0c7390 con 0x7f0bdc0af8b0 2023-10-06T01:41:46.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.345+0000 7f0bd1ffb700 1 -- 172.21.15.71:0/174285081 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0bcc0193f0 con 0x7f0bdc0af8b0 2023-10-06T01:41:46.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.345+0000 7f0bd1ffb700 1 --2- 172.21.15.71:0/174285081 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f0bc0066f30 0x7f0bc00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:46.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.345+0000 7f0bd1ffb700 1 -- 172.21.15.71:0/174285081 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f0bcc085bf0 con 0x7f0bdc0af8b0 2023-10-06T01:41:46.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.345+0000 7f0be1877700 1 --2- 172.21.15.71:0/174285081 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f0bc0066f30 0x7f0bc00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:46.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.346+0000 7f0be1877700 1 --2- 172.21.15.71:0/174285081 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f0bc0066f30 0x7f0bc00693e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0bd8001560 tx=0x7f0bd8007ef0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:46.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.350+0000 7f0bd1ffb700 1 -- 172.21.15.71:0/174285081 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0bdc0c7390 con 0x7f0bdc0af8b0 2023-10-06T01:41:46.576 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.574+0000 7f0be3adb700 1 -- 172.21.15.71:0/174285081 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0bdc0c7390 con 0x7f0bdc0af8b0 2023-10-06T01:41:46.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.575+0000 7f0bd1ffb700 1 -- 172.21.15.71:0/174285081 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4598 (secure 0 0 0) 0x7f0bdc0c7390 con 0x7f0bdc0af8b0 2023-10-06T01:41:46.577 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:41:46.578 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":23,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4889,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6834/1688339815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":1688339815},{"type":"v1","addr":"172.21.15.72:6834","nonce":1688339815}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5020,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/2765166441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6833","nonce":2765166441},{"type":"v1","addr":"172.21.15.72:6835","nonce":2765166441}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5145,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6836/1993673980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":1993673980},{"type":"v1","addr":"172.21.15.71:6836","nonce":1993673980}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T01:41:26.474510+0000","modified":"2023-10-06T01:41:39.188518+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":42,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5148},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5148":{"gid":5148,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.71:6837/3598886363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6835","nonce":3598886363},{"type":"v1","addr":"172.21.15.71:6837","nonce":3598886363}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T01:41:46.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.577+0000 7f0be3adb700 1 -- 172.21.15.71:0/174285081 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f0bc0066f30 msgr2=0x7f0bc00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:46.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.577+0000 7f0be3adb700 1 --2- 172.21.15.71:0/174285081 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f0bc0066f30 0x7f0bc00693e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0bd8001560 tx=0x7f0bd8007ef0 comp rx=0 tx=0).stop 2023-10-06T01:41:46.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.577+0000 7f0be3adb700 1 -- 172.21.15.71:0/174285081 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0bdc0af8b0 msgr2=0x7f0bdc0a6d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:46.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.577+0000 7f0be3adb700 1 --2- 172.21.15.71:0/174285081 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0bdc0af8b0 0x7f0bdc0a6d20 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc0030c0 tx=0x7f0bcc016000 comp rx=0 tx=0).stop 2023-10-06T01:41:46.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.577+0000 7f0be3adb700 1 -- 172.21.15.71:0/174285081 shutdown_connections 2023-10-06T01:41:46.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.577+0000 7f0be3adb700 1 --2- 172.21.15.71:0/174285081 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f0bc0066f30 0x7f0bc00693e0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:46.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.577+0000 7f0be3adb700 1 --2- 172.21.15.71:0/174285081 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0bdc0b27f0 0x7f0bdc159cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:46.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.577+0000 7f0be3adb700 1 --2- 172.21.15.71:0/174285081 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0bdc0af4e0 0x7f0bdc0c9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:46.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.577+0000 7f0be3adb700 1 --2- 172.21.15.71:0/174285081 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0bdc0af8b0 0x7f0bdc0a6d20 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:46.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.577+0000 7f0be3adb700 1 -- 172.21.15.71:0/174285081 >> 172.21.15.71:0/174285081 conn(0x7f0bdc068680 msgr2=0x7f0bdc15c690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:46.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.577+0000 7f0be3adb700 1 -- 172.21.15.71:0/174285081 shutdown_connections 2023-10-06T01:41:46.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.577+0000 7f0be3adb700 1 -- 172.21.15.71:0/174285081 wait complete. 2023-10-06T01:41:46.581 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 23 2023-10-06T01:41:46.591 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T01:41:46.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.703+0000 7fd98512a700 1 Processor -- start 2023-10-06T01:41:46.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.703+0000 7fd98512a700 1 -- start start 2023-10-06T01:41:46.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.705+0000 7fd98512a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd9800af4e0 0x7fd9800b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:46.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.705+0000 7fd98512a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd9800af8b0 0x7fd9800b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:46.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.705+0000 7fd98512a700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd98015e190 con 0x7fd98015d460 2023-10-06T01:41:46.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.705+0000 7fd98512a700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9800b1910 con 0x7fd9800af4e0 2023-10-06T01:41:46.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.705+0000 7fd98512a700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd98015dfa0 con 0x7fd9800af8b0 2023-10-06T01:41:46.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.705+0000 7fd97ed9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd9800af4e0 0x7fd9800b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:46.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.705+0000 7fd97f59e700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fd98015d460 0x7fd98015d890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:58490/0 (socket says 172.21.15.71:58490) 2023-10-06T01:41:46.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.705+0000 7fd97ed9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd9800af4e0 0x7fd9800b20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:58158/0 (socket says 172.21.15.71:58158) 2023-10-06T01:41:46.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.705+0000 7fd97f59e700 1 -- 172.21.15.71:0/2305807372 learned_addr learned my addr 172.21.15.71:0/2305807372 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:41:46.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.705+0000 7fd97659c700 1 --2- 172.21.15.71:0/2305807372 >> v2:172.21.15.72:3300/0 conn(0x7fd9800af8b0 0x7fd9800b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:46.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.705+0000 7fd97ed9d700 1 -- 172.21.15.71:0/2305807372 >> v2:172.21.15.72:3300/0 conn(0x7fd9800af8b0 msgr2=0x7fd9800b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:46.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.705+0000 7fd97ed9d700 1 --2- 172.21.15.71:0/2305807372 >> v2:172.21.15.72:3300/0 conn(0x7fd9800af8b0 0x7fd9800b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:46.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.705+0000 7fd97ed9d700 1 -- 172.21.15.71:0/2305807372 >> v1:172.21.15.71:6789/0 conn(0x7fd98015d460 legacy=0x7fd98015d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:46.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.705+0000 7fd97ed9d700 1 -- 172.21.15.71:0/2305807372 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9800cb650 con 0x7fd9800af4e0 2023-10-06T01:41:46.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.705+0000 7fd97e59c700 1 -- 172.21.15.71:0/2305807372 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1378827293 0 0) 0x7fd98015e190 con 0x7fd98015d460 2023-10-06T01:41:46.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.705+0000 7fd97ed9d700 1 --2- 172.21.15.71:0/2305807372 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd9800af4e0 0x7fd9800b20e0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fd9800cdd50 tx=0x7fd9700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7bb5a16fb44994d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:46.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.705+0000 7fd97e59c700 1 -- 172.21.15.71:0/2305807372 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd97000b6b0 con 0x7fd9800af4e0 2023-10-06T01:41:46.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.705+0000 7fd97e59c700 1 -- 172.21.15.71:0/2305807372 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd97000b810 con 0x7fd9800af4e0 2023-10-06T01:41:46.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.705+0000 7fd97e59c700 1 -- 172.21.15.71:0/2305807372 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd97000bbb0 con 0x7fd9800af4e0 2023-10-06T01:41:46.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.705+0000 7fd98512a700 1 -- 172.21.15.71:0/2305807372 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd9800af4e0 msgr2=0x7fd9800b20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:46.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.705+0000 7fd98512a700 1 --2- 172.21.15.71:0/2305807372 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd9800af4e0 0x7fd9800b20e0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fd9800cdd50 tx=0x7fd9700091a0 comp rx=0 tx=0).stop 2023-10-06T01:41:46.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.705+0000 7fd98512a700 1 -- 172.21.15.71:0/2305807372 shutdown_connections 2023-10-06T01:41:46.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.705+0000 7fd98512a700 1 --2- 172.21.15.71:0/2305807372 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd9800af4e0 0x7fd9800b20e0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:46.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.705+0000 7fd98512a700 1 --2- 172.21.15.71:0/2305807372 >> v2:172.21.15.72:3300/0 conn(0x7fd9800af8b0 0x7fd9800b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:46.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.705+0000 7fd98512a700 1 -- 172.21.15.71:0/2305807372 >> 172.21.15.71:0/2305807372 conn(0x7fd980068680 msgr2=0x7fd980068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:46.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.705+0000 7fd98512a700 1 -- 172.21.15.71:0/2305807372 shutdown_connections 2023-10-06T01:41:46.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.705+0000 7fd98512a700 1 -- 172.21.15.71:0/2305807372 wait complete. 2023-10-06T01:41:46.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.706+0000 7fd98512a700 1 Processor -- start 2023-10-06T01:41:46.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.707+0000 7fd98512a700 1 -- start start 2023-10-06T01:41:46.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.707+0000 7fd98512a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd9800af4e0 0x7fd98016b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:46.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.707+0000 7fd98512a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd9800af8b0 0x7fd98016ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:46.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.707+0000 7fd98512a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd98015d460 0x7fd980152280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:46.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.707+0000 7fd98512a700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd98016d390 con 0x7fd9800af8b0 2023-10-06T01:41:46.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.707+0000 7fd98512a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9800c6b00 con 0x7fd9800af4e0 2023-10-06T01:41:46.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.707+0000 7fd98512a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9800c8ba0 con 0x7fd98015d460 2023-10-06T01:41:46.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.707+0000 7fd97659c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd9800af8b0 0x7fd98016ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:46.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.707+0000 7fd97659c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd9800af8b0 0x7fd98016ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:58164/0 (socket says 172.21.15.71:58164) 2023-10-06T01:41:46.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.707+0000 7fd97659c700 1 -- 172.21.15.71:0/4140529492 learned_addr learned my addr 172.21.15.71:0/4140529492 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:46.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.708+0000 7fd97f59e700 1 --2- 172.21.15.71:0/4140529492 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd98015d460 0x7fd980152280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:46.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.708+0000 7fd97ed9d700 1 --2- 172.21.15.71:0/4140529492 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd9800af4e0 0x7fd98016b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:46.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.708+0000 7fd97659c700 1 -- 172.21.15.71:0/4140529492 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd98015d460 msgr2=0x7fd980152280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:46.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.708+0000 7fd97659c700 1 --2- 172.21.15.71:0/4140529492 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd98015d460 0x7fd980152280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:46.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.708+0000 7fd97659c700 1 -- 172.21.15.71:0/4140529492 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd9800af4e0 msgr2=0x7fd98016b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:46.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.708+0000 7fd97659c700 1 --2- 172.21.15.71:0/4140529492 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd9800af4e0 0x7fd98016b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:46.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.708+0000 7fd97659c700 1 -- 172.21.15.71:0/4140529492 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd970009420 con 0x7fd9800af8b0 2023-10-06T01:41:46.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.708+0000 7fd97ed9d700 1 --2- 172.21.15.71:0/4140529492 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd9800af4e0 0x7fd98016b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:41:46.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.708+0000 7fd97659c700 1 --2- 172.21.15.71:0/4140529492 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd9800af8b0 0x7fd98016ce50 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fd96800d860 tx=0x7fd968008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:46.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.708+0000 7fd9777fe700 1 -- 172.21.15.71:0/4140529492 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd968018070 con 0x7fd9800af8b0 2023-10-06T01:41:46.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.708+0000 7fd9777fe700 1 -- 172.21.15.71:0/4140529492 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9680125f0 con 0x7fd9800af8b0 2023-10-06T01:41:46.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.708+0000 7fd98512a700 1 -- 172.21.15.71:0/4140529492 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd980155410 con 0x7fd9800af8b0 2023-10-06T01:41:46.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.708+0000 7fd9777fe700 1 -- 172.21.15.71:0/4140529492 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9680129b0 con 0x7fd9800af8b0 2023-10-06T01:41:46.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.708+0000 7fd98512a700 1 -- 172.21.15.71:0/4140529492 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9800c8830 con 0x7fd9800af8b0 2023-10-06T01:41:46.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.709+0000 7fd98512a700 1 -- 172.21.15.71:0/4140529492 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd980088aa0 con 0x7fd9800af8b0 2023-10-06T01:41:46.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.709+0000 7fd9777fe700 1 -- 172.21.15.71:0/4140529492 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd968012d20 con 0x7fd9800af8b0 2023-10-06T01:41:46.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.710+0000 7fd9777fe700 1 --2- 172.21.15.71:0/4140529492 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fd960066f30 0x7fd9600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:46.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.710+0000 7fd97ed9d700 1 --2- 172.21.15.71:0/4140529492 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fd960066f30 0x7fd9600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:46.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.710+0000 7fd9777fe700 1 -- 172.21.15.71:0/4140529492 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fd968084af0 con 0x7fd9800af8b0 2023-10-06T01:41:46.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.710+0000 7fd97ed9d700 1 --2- 172.21.15.71:0/4140529492 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fd960066f30 0x7fd9600693e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd9700093f0 tx=0x7fd970017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:46.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.715+0000 7fd9777fe700 1 -- 172.21.15.71:0/4140529492 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd968051a70 con 0x7fd9800af8b0 2023-10-06T01:41:46.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.941+0000 7fd98512a700 1 -- 172.21.15.71:0/4140529492 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd9800c8ce0 con 0x7fd9800af8b0 2023-10-06T01:41:46.943 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.942+0000 7fd9777fe700 1 -- 172.21.15.71:0/4140529492 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4598 (secure 0 0 0) 0x7fd968055090 con 0x7fd9800af8b0 2023-10-06T01:41:46.943 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:41:46.943 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":23,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4889,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6834/1688339815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":1688339815},{"type":"v1","addr":"172.21.15.72:6834","nonce":1688339815}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5020,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/2765166441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6833","nonce":2765166441},{"type":"v1","addr":"172.21.15.72:6835","nonce":2765166441}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5145,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6836/1993673980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":1993673980},{"type":"v1","addr":"172.21.15.71:6836","nonce":1993673980}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T01:41:26.474510+0000","modified":"2023-10-06T01:41:39.188518+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":42,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5148},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5148":{"gid":5148,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.71:6837/3598886363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6835","nonce":3598886363},{"type":"v1","addr":"172.21.15.71:6837","nonce":3598886363}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T01:41:46.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.944+0000 7fd98512a700 1 -- 172.21.15.71:0/4140529492 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fd960066f30 msgr2=0x7fd9600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:46.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.944+0000 7fd98512a700 1 --2- 172.21.15.71:0/4140529492 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fd960066f30 0x7fd9600693e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd9700093f0 tx=0x7fd970017000 comp rx=0 tx=0).stop 2023-10-06T01:41:46.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.944+0000 7fd98512a700 1 -- 172.21.15.71:0/4140529492 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd9800af8b0 msgr2=0x7fd98016ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:46.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.944+0000 7fd98512a700 1 --2- 172.21.15.71:0/4140529492 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd9800af8b0 0x7fd98016ce50 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fd96800d860 tx=0x7fd968008040 comp rx=0 tx=0).stop 2023-10-06T01:41:46.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.944+0000 7fd98512a700 1 -- 172.21.15.71:0/4140529492 shutdown_connections 2023-10-06T01:41:46.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.944+0000 7fd98512a700 1 --2- 172.21.15.71:0/4140529492 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd98015d460 0x7fd980152280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:46.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.944+0000 7fd98512a700 1 --2- 172.21.15.71:0/4140529492 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fd960066f30 0x7fd9600693e0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:46.946 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.944+0000 7fd98512a700 1 --2- 172.21.15.71:0/4140529492 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd9800af4e0 0x7fd98016b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:46.946 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.944+0000 7fd98512a700 1 --2- 172.21.15.71:0/4140529492 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd9800af8b0 0x7fd98016ce50 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:46.946 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.944+0000 7fd98512a700 1 -- 172.21.15.71:0/4140529492 >> 172.21.15.71:0/4140529492 conn(0x7fd980068680 msgr2=0x7fd9800b5040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:46.946 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.944+0000 7fd98512a700 1 -- 172.21.15.71:0/4140529492 shutdown_connections 2023-10-06T01:41:46.946 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:46.944+0000 7fd98512a700 1 -- 172.21.15.71:0/4140529492 wait complete. 2023-10-06T01:41:46.946 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 23 2023-10-06T01:41:46.957 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:41:47.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.071+0000 7fdf552fa700 1 Processor -- start 2023-10-06T01:41:47.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.071+0000 7fdf552fa700 1 -- start start 2023-10-06T01:41:47.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.072+0000 7fdf552fa700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fdf5015b3c0 0x7fdf50097d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:47.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.072+0000 7fdf552fa700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdf5015a590 0x7fdf5015a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:47.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.072+0000 7fdf552fa700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf500afb90 con 0x7fdf500b3c50 2023-10-06T01:41:47.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.072+0000 7fdf552fa700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf5015aef0 con 0x7fdf5015b3c0 2023-10-06T01:41:47.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.072+0000 7fdf552fa700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf500b2310 con 0x7fdf5015a590 2023-10-06T01:41:47.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.072+0000 7fdf4effd700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fdf5015b3c0 0x7fdf50097d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:47.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.072+0000 7fdf467fc700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fdf500b3c50 0x7fdf5015b790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:58498/0 (socket says 172.21.15.71:58498) 2023-10-06T01:41:47.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.072+0000 7fdf467fc700 1 -- 172.21.15.71:0/74053961 learned_addr learned my addr 172.21.15.71:0/74053961 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:41:47.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.072+0000 7fdf4effd700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fdf5015b3c0 0x7fdf50097d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:58178/0 (socket says 172.21.15.71:58178) 2023-10-06T01:41:47.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.073+0000 7fdf4effd700 1 -- 172.21.15.71:0/74053961 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdf5015a590 msgr2=0x7fdf5015a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:47.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.073+0000 7fdf4f7fe700 1 --2- 172.21.15.71:0/74053961 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdf5015a590 0x7fdf5015a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:47.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.073+0000 7fdf4e7fc700 1 -- 172.21.15.71:0/74053961 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 753676424 0 0) 0x7fdf500afb90 con 0x7fdf500b3c50 2023-10-06T01:41:47.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.073+0000 7fdf4effd700 1 --2- 172.21.15.71:0/74053961 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdf5015a590 0x7fdf5015a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:47.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.073+0000 7fdf4effd700 1 -- 172.21.15.71:0/74053961 >> v1:172.21.15.71:6789/0 conn(0x7fdf500b3c50 legacy=0x7fdf5015b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:47.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.073+0000 7fdf4effd700 1 -- 172.21.15.71:0/74053961 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf500b25f0 con 0x7fdf5015b3c0 2023-10-06T01:41:47.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.073+0000 7fdf4f7fe700 1 --2- 172.21.15.71:0/74053961 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdf5015a590 0x7fdf5015a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:41:47.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.073+0000 7fdf4effd700 1 --2- 172.21.15.71:0/74053961 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf5015b3c0 0x7fdf50097d70 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fdf400098d0 tx=0x7fdf40009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac6877c74b80328f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:47.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.073+0000 7fdf4e7fc700 1 -- 172.21.15.71:0/74053961 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf40009e70 con 0x7fdf5015b3c0 2023-10-06T01:41:47.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.073+0000 7fdf4e7fc700 1 -- 172.21.15.71:0/74053961 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf40005c10 con 0x7fdf5015b3c0 2023-10-06T01:41:47.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.073+0000 7fdf4e7fc700 1 -- 172.21.15.71:0/74053961 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf4000b650 con 0x7fdf5015b3c0 2023-10-06T01:41:47.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.073+0000 7fdf552fa700 1 -- 172.21.15.71:0/74053961 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf5015b3c0 msgr2=0x7fdf50097d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:47.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.073+0000 7fdf552fa700 1 --2- 172.21.15.71:0/74053961 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf5015b3c0 0x7fdf50097d70 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fdf400098d0 tx=0x7fdf40009120 comp rx=0 tx=0).stop 2023-10-06T01:41:47.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.073+0000 7fdf552fa700 1 -- 172.21.15.71:0/74053961 shutdown_connections 2023-10-06T01:41:47.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.073+0000 7fdf552fa700 1 --2- 172.21.15.71:0/74053961 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdf5015a590 0x7fdf5015a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:47.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.073+0000 7fdf552fa700 1 --2- 172.21.15.71:0/74053961 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf5015b3c0 0x7fdf50097d70 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:47.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.073+0000 7fdf552fa700 1 -- 172.21.15.71:0/74053961 >> 172.21.15.71:0/74053961 conn(0x7fdf50067910 msgr2=0x7fdf500ce160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:47.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.074+0000 7fdf552fa700 1 -- 172.21.15.71:0/74053961 shutdown_connections 2023-10-06T01:41:47.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.074+0000 7fdf552fa700 1 -- 172.21.15.71:0/74053961 wait complete. 2023-10-06T01:41:47.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.075+0000 7fdf552fa700 1 Processor -- start 2023-10-06T01:41:47.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.075+0000 7fdf552fa700 1 -- start start 2023-10-06T01:41:47.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.075+0000 7fdf552fa700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf500b3c50 0x7fdf500acef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:47.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.075+0000 7fdf552fa700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdf5015a590 0x7fdf5009a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:47.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.076+0000 7fdf552fa700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf5015b3c0 0x7fdf5009ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:47.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.076+0000 7fdf552fa700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf500ad430 con 0x7fdf500b3c50 2023-10-06T01:41:47.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.076+0000 7fdf552fa700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf50152180 con 0x7fdf5015b3c0 2023-10-06T01:41:47.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.076+0000 7fdf552fa700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf50152460 con 0x7fdf5015a590 2023-10-06T01:41:47.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.076+0000 7fdf4effd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf500b3c50 0x7fdf500acef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:47.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.076+0000 7fdf4effd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf500b3c50 0x7fdf500acef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:58186/0 (socket says 172.21.15.71:58186) 2023-10-06T01:41:47.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.076+0000 7fdf4effd700 1 -- 172.21.15.71:0/3280477759 learned_addr learned my addr 172.21.15.71:0/3280477759 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:47.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.076+0000 7fdf467fc700 1 --2- 172.21.15.71:0/3280477759 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdf5015a590 0x7fdf5009a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:47.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.076+0000 7fdf4f7fe700 1 --2- 172.21.15.71:0/3280477759 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf5015b3c0 0x7fdf5009ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:47.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.076+0000 7fdf4effd700 1 -- 172.21.15.71:0/3280477759 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdf5015a590 msgr2=0x7fdf5009a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:47.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.076+0000 7fdf4effd700 1 --2- 172.21.15.71:0/3280477759 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdf5015a590 0x7fdf5009a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:47.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.076+0000 7fdf4effd700 1 -- 172.21.15.71:0/3280477759 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf5015b3c0 msgr2=0x7fdf5009ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:47.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.076+0000 7fdf4effd700 1 --2- 172.21.15.71:0/3280477759 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf5015b3c0 0x7fdf5009ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:47.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.076+0000 7fdf4effd700 1 -- 172.21.15.71:0/3280477759 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf400093c0 con 0x7fdf500b3c50 2023-10-06T01:41:47.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.076+0000 7fdf467fc700 1 --2- 172.21.15.71:0/3280477759 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdf5015a590 0x7fdf5009a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:41:47.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.076+0000 7fdf4f7fe700 1 --2- 172.21.15.71:0/3280477759 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf5015b3c0 0x7fdf5009ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:41:47.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.076+0000 7fdf4effd700 1 --2- 172.21.15.71:0/3280477759 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf500b3c50 0x7fdf500acef0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fdf4000b3c0 tx=0x7fdf40016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:47.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.076+0000 7fdf477fe700 1 -- 172.21.15.71:0/3280477759 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf40009e70 con 0x7fdf500b3c50 2023-10-06T01:41:47.081 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.076+0000 7fdf477fe700 1 -- 172.21.15.71:0/3280477759 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf4001dcf0 con 0x7fdf500b3c50 2023-10-06T01:41:47.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.076+0000 7fdf552fa700 1 -- 172.21.15.71:0/3280477759 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf50152740 con 0x7fdf500b3c50 2023-10-06T01:41:47.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.076+0000 7fdf477fe700 1 -- 172.21.15.71:0/3280477759 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf40026680 con 0x7fdf500b3c50 2023-10-06T01:41:47.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.076+0000 7fdf552fa700 1 -- 172.21.15.71:0/3280477759 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf501513b0 con 0x7fdf500b3c50 2023-10-06T01:41:47.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.077+0000 7fdf552fa700 1 -- 172.21.15.71:0/3280477759 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf5006e8d0 con 0x7fdf500b3c50 2023-10-06T01:41:47.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.078+0000 7fdf477fe700 1 -- 172.21.15.71:0/3280477759 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdf4001a420 con 0x7fdf500b3c50 2023-10-06T01:41:47.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.078+0000 7fdf477fe700 1 --2- 172.21.15.71:0/3280477759 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fdf30066f30 0x7fdf300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:47.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.078+0000 7fdf477fe700 1 -- 172.21.15.71:0/3280477759 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fdf40086160 con 0x7fdf500b3c50 2023-10-06T01:41:47.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.078+0000 7fdf467fc700 1 --2- 172.21.15.71:0/3280477759 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fdf30066f30 0x7fdf300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:47.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.078+0000 7fdf467fc700 1 --2- 172.21.15.71:0/3280477759 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fdf30066f30 0x7fdf300693e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fdf50145720 tx=0x7fdf38009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:47.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.082+0000 7fdf477fe700 1 -- 172.21.15.71:0/3280477759 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdf40053160 con 0x7fdf500b3c50 2023-10-06T01:41:47.268 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.267+0000 7fdf552fa700 1 -- 172.21.15.71:0/3280477759 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdf50168790 con 0x7fdf500b3c50 2023-10-06T01:41:47.269 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.268+0000 7fdf477fe700 1 -- 172.21.15.71:0/3280477759 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+17152 (secure 0 0 0) 0x7fdf4001de60 con 0x7fdf500b3c50 2023-10-06T01:41:47.269 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:41:47.269 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":42,"fsid":"1fbf1bd2-f9b4-4599-bea2-f4aa920e9a56","created":"2023-10-06T01:39:57.016957+0000","modified":"2023-10-06T01:41:36.177102+0000","last_up_change":"2023-10-06T01:40:08.571643+0000","last_in_change":"2023-10-06T01:39:59.462741+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T01:40:08.610349+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T01:40:15.387434+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-06T01:41:24.561219+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-06T01:41:25.445423+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cf059188-fb20-4dbf-95db-dcf57b213d03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":90670},{"type":"v1","addr":"172.21.15.71:6817","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":90670},{"type":"v1","addr":"172.21.15.71:6819","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":90670},{"type":"v1","addr":"172.21.15.71:6823","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":90670},{"type":"v1","addr":"172.21.15.71:6821","nonce":90670}]},"public_addr":"172.21.15.71:6817/90670","cluster_addr":"172.21.15.71:6819/90670","heartbeat_back_addr":"172.21.15.71:6823/90670","heartbeat_front_addr":"172.21.15.71:6821/90670","state":["exists","up"]},{"osd":1,"uuid":"0cff0aae-1799-4fe0-b610-54cf0813c0e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":90669},{"type":"v1","addr":"172.21.15.71:6809","nonce":90669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":90669},{"type":"v1","addr":"172.21.15.71:6811","nonce":90669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":90669},{"type":"v1","addr":"172.21.15.71:6815","nonce":90669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":90669},{"type":"v1","addr":"172.21.15.71:6813","nonce":90669}]},"public_addr":"172.21.15.71:6809/90669","cluster_addr":"172.21.15.71:6811/90669","heartbeat_back_addr":"172.21.15.71:6815/90669","heartbeat_front_addr":"172.21.15.71:6813/90669","state":["exists","up"]},{"osd":2,"uuid":"88d61ddc-9031-44e1-ba8c-546a41e7c8ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":90679},{"type":"v1","addr":"172.21.15.71:6825","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":90679},{"type":"v1","addr":"172.21.15.71:6827","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":90679},{"type":"v1","addr":"172.21.15.71:6831","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":90679},{"type":"v1","addr":"172.21.15.71:6829","nonce":90679}]},"public_addr":"172.21.15.71:6825/90679","cluster_addr":"172.21.15.71:6827/90679","heartbeat_back_addr":"172.21.15.71:6831/90679","heartbeat_front_addr":"172.21.15.71:6829/90679","state":["exists","up"]},{"osd":3,"uuid":"11ed92b7-960b-4a30-a889-a61d3eeb86f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":90668},{"type":"v1","addr":"172.21.15.71:6801","nonce":90668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":90668},{"type":"v1","addr":"172.21.15.71:6803","nonce":90668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":90668},{"type":"v1","addr":"172.21.15.71:6807","nonce":90668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":90668},{"type":"v1","addr":"172.21.15.71:6805","nonce":90668}]},"public_addr":"172.21.15.71:6801/90668","cluster_addr":"172.21.15.71:6803/90668","heartbeat_back_addr":"172.21.15.71:6807/90668","heartbeat_front_addr":"172.21.15.71:6805/90668","state":["exists","up"]},{"osd":4,"uuid":"ae4df784-abdf-4ddf-aefa-780f3ddafef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":90917},{"type":"v1","addr":"172.21.15.72:6801","nonce":90917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":90917},{"type":"v1","addr":"172.21.15.72:6803","nonce":90917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":90917},{"type":"v1","addr":"172.21.15.72:6807","nonce":90917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":90917},{"type":"v1","addr":"172.21.15.72:6805","nonce":90917}]},"public_addr":"172.21.15.72:6801/90917","cluster_addr":"172.21.15.72:6803/90917","heartbeat_back_addr":"172.21.15.72:6807/90917","heartbeat_front_addr":"172.21.15.72:6805/90917","state":["exists","up"]},{"osd":5,"uuid":"5ef0790f-001e-458f-a05b-efae216cf435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":90941},{"type":"v1","addr":"172.21.15.72:6817","nonce":90941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":90941},{"type":"v1","addr":"172.21.15.72:6819","nonce":90941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":90941},{"type":"v1","addr":"172.21.15.72:6827","nonce":90941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":90941},{"type":"v1","addr":"172.21.15.72:6823","nonce":90941}]},"public_addr":"172.21.15.72:6817/90941","cluster_addr":"172.21.15.72:6819/90941","heartbeat_back_addr":"172.21.15.72:6827/90941","heartbeat_front_addr":"172.21.15.72:6823/90941","state":["exists","up"]},{"osd":6,"uuid":"8705aef1-9ae8-4e54-a3c4-c2909fa0ceb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":90918},{"type":"v1","addr":"172.21.15.72:6809","nonce":90918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":90918},{"type":"v1","addr":"172.21.15.72:6811","nonce":90918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":90918},{"type":"v1","addr":"172.21.15.72:6815","nonce":90918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":90918},{"type":"v1","addr":"172.21.15.72:6813","nonce":90918}]},"public_addr":"172.21.15.72:6809/90918","cluster_addr":"172.21.15.72:6811/90918","heartbeat_back_addr":"172.21.15.72:6815/90918","heartbeat_front_addr":"172.21.15.72:6813/90918","state":["exists","up"]},{"osd":7,"uuid":"364c5119-6b13-4c75-b3f0-15e165eff86a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":90948},{"type":"v1","addr":"172.21.15.72:6822","nonce":90948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":90948},{"type":"v1","addr":"172.21.15.72:6826","nonce":90948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":90948},{"type":"v1","addr":"172.21.15.72:6831","nonce":90948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":90948},{"type":"v1","addr":"172.21.15.72:6829","nonce":90948}]},"public_addr":"172.21.15.72:6822/90948","cluster_addr":"172.21.15.72:6826/90948","heartbeat_back_addr":"172.21.15.72:6831/90948","heartbeat_front_addr":"172.21.15.72:6829/90948","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.642976+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.645372+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.619116+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.663042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.599163+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.646411+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.631545+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.669821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.72:6834/2476889061":"2023-10-07T01:41:36.177074+0000","172.21.15.72:6832/2476889061":"2023-10-07T01:41:36.177074+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:41:47.271 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.270+0000 7fdf552fa700 1 -- 172.21.15.71:0/3280477759 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fdf30066f30 msgr2=0x7fdf300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:47.271 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.270+0000 7fdf552fa700 1 --2- 172.21.15.71:0/3280477759 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fdf30066f30 0x7fdf300693e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fdf50145720 tx=0x7fdf38009040 comp rx=0 tx=0).stop 2023-10-06T01:41:47.271 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.270+0000 7fdf552fa700 1 -- 172.21.15.71:0/3280477759 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf500b3c50 msgr2=0x7fdf500acef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:47.271 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.270+0000 7fdf552fa700 1 --2- 172.21.15.71:0/3280477759 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf500b3c50 0x7fdf500acef0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fdf4000b3c0 tx=0x7fdf40016000 comp rx=0 tx=0).stop 2023-10-06T01:41:47.271 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.270+0000 7fdf552fa700 1 -- 172.21.15.71:0/3280477759 shutdown_connections 2023-10-06T01:41:47.271 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.270+0000 7fdf552fa700 1 --2- 172.21.15.71:0/3280477759 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fdf30066f30 0x7fdf300693e0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:47.272 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.270+0000 7fdf552fa700 1 --2- 172.21.15.71:0/3280477759 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf5015b3c0 0x7fdf5009ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:47.272 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.270+0000 7fdf552fa700 1 --2- 172.21.15.71:0/3280477759 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf500b3c50 0x7fdf500acef0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:47.272 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.270+0000 7fdf552fa700 1 --2- 172.21.15.71:0/3280477759 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdf5015a590 0x7fdf5009a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:47.272 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.270+0000 7fdf552fa700 1 -- 172.21.15.71:0/3280477759 >> 172.21.15.71:0/3280477759 conn(0x7fdf50067910 msgr2=0x7fdf50156980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:47.272 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.270+0000 7fdf552fa700 1 -- 172.21.15.71:0/3280477759 shutdown_connections 2023-10-06T01:41:47.272 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.270+0000 7fdf552fa700 1 -- 172.21.15.71:0/3280477759 wait complete. 2023-10-06T01:41:47.283 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T01:41:47.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.397+0000 7f1fb939f700 1 Processor -- start 2023-10-06T01:41:47.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.397+0000 7f1fb939f700 1 -- start start 2023-10-06T01:41:47.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.398+0000 7f1fb939f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1fb415a030 0x7f1fb415a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:47.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.398+0000 7f1fb939f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1fb415a940 0x7f1fb4086ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:47.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.398+0000 7f1fb939f700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fb4087960 con 0x7f1fb4087530 2023-10-06T01:41:47.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.398+0000 7f1fb939f700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fb40b0cf0 con 0x7f1fb415a940 2023-10-06T01:41:47.405 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.398+0000 7f1fb939f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb40afc50 con 0x7f1fb415a030 2023-10-06T01:41:47.405 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.398+0000 7f1fb37fe700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f1fb4087530 0x7f1fb40b21b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:58512/0 (socket says 172.21.15.71:58512) 2023-10-06T01:41:47.405 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.398+0000 7f1fb37fe700 1 -- 172.21.15.71:0/1864622237 learned_addr learned my addr 172.21.15.71:0/1864622237 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:41:47.405 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.398+0000 7f1faa7fc700 1 --2- 172.21.15.71:0/1864622237 >> v2:172.21.15.72:3300/0 conn(0x7f1fb415a940 0x7f1fb4086ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:47.405 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.398+0000 7f1fb2ffd700 1 --2- 172.21.15.71:0/1864622237 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1fb415a030 0x7f1fb415a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:47.405 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.398+0000 7f1fb27fc700 1 -- 172.21.15.71:0/1864622237 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2557309675 0 0) 0x7f1fb4087960 con 0x7f1fb4087530 2023-10-06T01:41:47.405 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.398+0000 7f1fb27fc700 1 -- 172.21.15.71:0/1864622237 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1fa0003570 con 0x7f1fb4087530 2023-10-06T01:41:47.405 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.399+0000 7f1fb27fc700 1 -- 172.21.15.71:0/1864622237 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2031373776 0 0) 0x7f1fa0003570 con 0x7f1fb4087530 2023-10-06T01:41:47.405 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.399+0000 7f1fb27fc700 1 -- 172.21.15.71:0/1864622237 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1fb415a030 msgr2=0x7f1fb415a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:47.405 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.399+0000 7f1fb27fc700 1 --2- 172.21.15.71:0/1864622237 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1fb415a030 0x7f1fb415a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:47.406 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.399+0000 7f1fb27fc700 1 -- 172.21.15.71:0/1864622237 >> v2:172.21.15.72:3300/0 conn(0x7f1fb415a940 msgr2=0x7f1fb4086ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:47.406 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.399+0000 7f1fb27fc700 1 --2- 172.21.15.71:0/1864622237 >> v2:172.21.15.72:3300/0 conn(0x7f1fb415a940 0x7f1fb4086ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:47.406 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.399+0000 7f1fb27fc700 1 -- 172.21.15.71:0/1864622237 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fb40aff30 con 0x7f1fb4087530 2023-10-06T01:41:47.406 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.399+0000 7f1fb27fc700 1 -- 172.21.15.71:0/1864622237 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1184243524 0 0) 0x7f1fac0017f0 con 0x7f1fb4087530 2023-10-06T01:41:47.406 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.399+0000 7f1fb27fc700 1 -- 172.21.15.71:0/1864622237 >> v1:172.21.15.71:6789/0 conn(0x7f1fb4087530 legacy=0x7f1fb40b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:47.406 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.399+0000 7f1fb27fc700 1 --2- 172.21.15.71:0/1864622237 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1fa0003a60 0x7f1fa0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:47.406 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.399+0000 7f1fb27fc700 1 --2- 172.21.15.71:0/1864622237 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1fb415a030 0x7f1fa0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:47.406 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.399+0000 7f1fb27fc700 1 --2- 172.21.15.71:0/1864622237 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1fa0004d50 0x7f1fa00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:47.406 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.399+0000 7f1fb27fc700 1 -- 172.21.15.71:0/1864622237 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb40b0cf0 con 0x7f1fa0004d50 2023-10-06T01:41:47.406 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.399+0000 7f1fb27fc700 1 -- 172.21.15.71:0/1864622237 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb40afc50 con 0x7f1fa0003a60 2023-10-06T01:41:47.406 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.399+0000 7f1fb27fc700 1 -- 172.21.15.71:0/1864622237 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa000ba60 con 0x7f1fb415a030 2023-10-06T01:41:47.407 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.399+0000 7f1fb37fe700 1 --2- 172.21.15.71:0/1864622237 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1fa0004d50 0x7f1fa00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:47.407 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.399+0000 7f1fb2ffd700 1 --2- 172.21.15.71:0/1864622237 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1fa0003a60 0x7f1fa0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:47.407 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.399+0000 7f1faa7fc700 1 --2- 172.21.15.71:0/1864622237 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1fb415a030 0x7f1fa0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:47.407 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.399+0000 7f1fb37fe700 1 -- 172.21.15.71:0/1864622237 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1fb415a030 msgr2=0x7f1fa0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:47.407 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.399+0000 7f1fb37fe700 1 --2- 172.21.15.71:0/1864622237 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1fb415a030 0x7f1fa0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:47.407 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.399+0000 7f1fb37fe700 1 -- 172.21.15.71:0/1864622237 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1fa0003a60 msgr2=0x7f1fa0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:47.407 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.399+0000 7f1fb37fe700 1 --2- 172.21.15.71:0/1864622237 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1fa0003a60 0x7f1fa0003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:47.407 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.399+0000 7f1fb37fe700 1 -- 172.21.15.71:0/1864622237 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fa0003570 con 0x7f1fa0004d50 2023-10-06T01:41:47.407 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.399+0000 7f1fb37fe700 1 --2- 172.21.15.71:0/1864622237 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1fa0004d50 0x7f1fa00051c0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f1fac00a970 tx=0x7f1fac002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46059dad9d50ab13 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:47.407 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.399+0000 7f1fb27fc700 1 -- 172.21.15.71:0/1864622237 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fac012440 con 0x7f1fa0004d50 2023-10-06T01:41:47.407 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.399+0000 7f1fb27fc700 1 -- 172.21.15.71:0/1864622237 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fac0125c0 con 0x7f1fa0004d50 2023-10-06T01:41:47.408 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.399+0000 7f1fb27fc700 1 -- 172.21.15.71:0/1864622237 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fac012980 con 0x7f1fa0004d50 2023-10-06T01:41:47.408 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.400+0000 7f1fb939f700 1 -- 172.21.15.71:0/1864622237 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1fa0004d50 msgr2=0x7f1fa00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:47.408 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.400+0000 7f1fb939f700 1 --2- 172.21.15.71:0/1864622237 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1fa0004d50 0x7f1fa00051c0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f1fac00a970 tx=0x7f1fac002210 comp rx=0 tx=0).stop 2023-10-06T01:41:47.408 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.400+0000 7f1fb37fe700 1 -- 172.21.15.71:0/1864622237 reap_dead start 2023-10-06T01:41:47.408 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.400+0000 7f1fb939f700 1 -- 172.21.15.71:0/1864622237 shutdown_connections 2023-10-06T01:41:47.408 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.400+0000 7f1fb939f700 1 -- 172.21.15.71:0/1864622237 >> 172.21.15.71:0/1864622237 conn(0x7f1fb4068680 msgr2=0x7f1fb4068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:47.408 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.400+0000 7f1fb939f700 1 -- 172.21.15.71:0/1864622237 shutdown_connections 2023-10-06T01:41:47.408 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.400+0000 7f1fb939f700 1 -- 172.21.15.71:0/1864622237 wait complete. 2023-10-06T01:41:47.408 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.401+0000 7f1fb939f700 1 Processor -- start 2023-10-06T01:41:47.408 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.401+0000 7f1fb939f700 1 -- start start 2023-10-06T01:41:47.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.402+0000 7f1fb939f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1fa0004d50 0x7f1fb40c5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:47.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.402+0000 7f1fb939f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1fb415d5a0 0x7f1fb4155c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:47.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.402+0000 7f1fb939f700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1fb41561c0 0x7f1fb40ccca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:47.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.402+0000 7f1fb939f700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb40af580 con 0x7f1fb41561c0 2023-10-06T01:41:47.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.402+0000 7f1fb939f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb40c5570 con 0x7f1fa0004d50 2023-10-06T01:41:47.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.402+0000 7f1fb939f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb40c4ba0 con 0x7f1fb415d5a0 2023-10-06T01:41:47.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.402+0000 7f1fb37fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1fb41561c0 0x7f1fb40ccca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:47.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.402+0000 7f1fb37fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1fb41561c0 0x7f1fb40ccca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:58198/0 (socket says 172.21.15.71:58198) 2023-10-06T01:41:47.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.402+0000 7f1fb37fe700 1 -- 172.21.15.71:0/1774527542 learned_addr learned my addr 172.21.15.71:0/1774527542 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:47.409 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.402+0000 7f1fb2ffd700 1 --2- 172.21.15.71:0/1774527542 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1fa0004d50 0x7f1fb40c5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:47.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.402+0000 7f1faa7fc700 1 --2- 172.21.15.71:0/1774527542 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1fb415d5a0 0x7f1fb4155c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:47.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.402+0000 7f1fb37fe700 1 -- 172.21.15.71:0/1774527542 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1fb415d5a0 msgr2=0x7f1fb4155c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:47.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.402+0000 7f1fb37fe700 1 --2- 172.21.15.71:0/1774527542 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1fb415d5a0 0x7f1fb4155c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:47.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.402+0000 7f1fb37fe700 1 -- 172.21.15.71:0/1774527542 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1fa0004d50 msgr2=0x7f1fb40c5030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:47.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.402+0000 7f1fb37fe700 1 --2- 172.21.15.71:0/1774527542 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1fa0004d50 0x7f1fb40c5030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:47.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.402+0000 7f1fb37fe700 1 -- 172.21.15.71:0/1774527542 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fb40c3f90 con 0x7f1fb41561c0 2023-10-06T01:41:47.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.402+0000 7f1fb37fe700 1 --2- 172.21.15.71:0/1774527542 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1fb41561c0 0x7f1fb40ccca0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f1fa0004730 tx=0x7f1fac015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:47.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.402+0000 7f1fab7fe700 1 -- 172.21.15.71:0/1774527542 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fac012440 con 0x7f1fb41561c0 2023-10-06T01:41:47.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.403+0000 7f1fab7fe700 1 -- 172.21.15.71:0/1774527542 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fac0017b0 con 0x7f1fb41561c0 2023-10-06T01:41:47.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.403+0000 7f1fb939f700 1 -- 172.21.15.71:0/1774527542 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fb40c4270 con 0x7f1fb41561c0 2023-10-06T01:41:47.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.403+0000 7f1fab7fe700 1 -- 172.21.15.71:0/1774527542 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fac001f30 con 0x7f1fb41561c0 2023-10-06T01:41:47.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.403+0000 7f1fb939f700 1 -- 172.21.15.71:0/1774527542 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fb40c4830 con 0x7f1fb41561c0 2023-10-06T01:41:47.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.403+0000 7f1fb939f700 1 -- 172.21.15.71:0/1774527542 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fb40c4d50 con 0x7f1fb41561c0 2023-10-06T01:41:47.412 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.404+0000 7f1fab7fe700 1 -- 172.21.15.71:0/1774527542 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1fac019070 con 0x7f1fb41561c0 2023-10-06T01:41:47.412 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.404+0000 7f1fab7fe700 1 --2- 172.21.15.71:0/1774527542 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f1f94066f30 0x7f1f940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:47.412 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.404+0000 7f1fab7fe700 1 -- 172.21.15.71:0/1774527542 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f1fac0866f0 con 0x7f1fb41561c0 2023-10-06T01:41:47.412 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.404+0000 7f1fb2ffd700 1 --2- 172.21.15.71:0/1774527542 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f1f94066f30 0x7f1f940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:47.412 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.405+0000 7f1fb2ffd700 1 --2- 172.21.15.71:0/1774527542 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f1f94066f30 0x7f1f940693e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f1fa4006f00 tx=0x7f1fa4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:47.412 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.408+0000 7f1fab7fe700 1 -- 172.21.15.71:0/1774527542 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1fb40c4d50 con 0x7f1fb41561c0 2023-10-06T01:41:47.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.631+0000 7f1fb939f700 1 -- 172.21.15.71:0/1774527542 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f1fb40c4d10 con 0x7f1fb41561c0 2023-10-06T01:41:47.632 INFO:tasks.ceph.mon.a.smithi071.stderr:2023-10-06T01:41:47.632+0000 7fec89f1c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T01:41:47.636 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.635+0000 7f1fab7fe700 1 -- 172.21.15.71:0/1774527542 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v24) v1 ==== 161+0+0 (secure 0 0 0) 0x7f1fac017090 con 0x7f1fb41561c0 2023-10-06T01:41:47.637 INFO:tasks.ceph.mds.a.smithi071.stderr: -1066> 2023-10-06T01:41:40.071+0000 7f6a687b7700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T01:41:47.637 INFO:tasks.ceph.mds.a.smithi071.stderr: -592> 2023-10-06T01:41:42.536+0000 7f6a64fb0700 -1 log_channel(cluster) log [ERR] : bad backtrace on directory inode 0x10000000000 2023-10-06T01:41:47.638 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.638+0000 7f1fb939f700 1 -- 172.21.15.71:0/1774527542 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f1f94066f30 msgr2=0x7f1f940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:47.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.638+0000 7f1fb939f700 1 --2- 172.21.15.71:0/1774527542 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f1f94066f30 0x7f1f940693e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f1fa4006f00 tx=0x7f1fa4008040 comp rx=0 tx=0).stop 2023-10-06T01:41:47.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.638+0000 7f1fb939f700 1 -- 172.21.15.71:0/1774527542 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1fb41561c0 msgr2=0x7f1fb40ccca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:47.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.638+0000 7f1fb939f700 1 --2- 172.21.15.71:0/1774527542 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1fb41561c0 0x7f1fb40ccca0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f1fa0004730 tx=0x7f1fac015000 comp rx=0 tx=0).stop 2023-10-06T01:41:47.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.638+0000 7f1fb939f700 1 -- 172.21.15.71:0/1774527542 shutdown_connections 2023-10-06T01:41:47.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.638+0000 7f1fb939f700 1 --2- 172.21.15.71:0/1774527542 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1fb41561c0 0x7f1fb40ccca0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:47.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.638+0000 7f1fb939f700 1 --2- 172.21.15.71:0/1774527542 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f1f94066f30 0x7f1f940693e0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:47.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.638+0000 7f1fb939f700 1 --2- 172.21.15.71:0/1774527542 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1fa0004d50 0x7f1fb40c5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:47.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.638+0000 7f1fb939f700 1 --2- 172.21.15.71:0/1774527542 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1fb415d5a0 0x7f1fb4155c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:47.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.638+0000 7f1fb939f700 1 -- 172.21.15.71:0/1774527542 >> 172.21.15.71:0/1774527542 conn(0x7f1fb4068680 msgr2=0x7f1fb40b21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:47.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.638+0000 7f1fb939f700 1 -- 172.21.15.71:0/1774527542 shutdown_connections 2023-10-06T01:41:47.639 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.638+0000 7f1fb939f700 1 -- 172.21.15.71:0/1774527542 wait complete. 2023-10-06T01:41:47.640 INFO:teuthology.orchestra.run.smithi071.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T01:41:47.655 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T01:41:47.663 INFO:tasks.ceph.mds.a.smithi071.stdout:starting mds.a at 2023-10-06T01:41:47.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.771+0000 7f78e51d9700 1 Processor -- start 2023-10-06T01:41:47.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.771+0000 7f78e51d9700 1 -- start start 2023-10-06T01:41:47.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.772+0000 7f78e51d9700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f78e00d0400 0x7f78e00b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:47.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.772+0000 7f78e51d9700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78e00b6170 con 0x7f78e00ccd40 2023-10-06T01:41:47.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.772+0000 7f78e51d9700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78e015dd40 con 0x7f78e00d07d0 2023-10-06T01:41:47.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.772+0000 7f78e51d9700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78e015e020 con 0x7f78e00d0400 2023-10-06T01:41:47.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.772+0000 7f78d659c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f78e00ccd40 0x7f78e00cf2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:58530/0 (socket says 172.21.15.71:58530) 2023-10-06T01:41:47.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.772+0000 7f78d659c700 1 -- 172.21.15.71:0/3390884192 learned_addr learned my addr 172.21.15.71:0/3390884192 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:41:47.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.772+0000 7f78ded9d700 1 --2- 172.21.15.71:0/3390884192 >> v2:172.21.15.72:3300/0 conn(0x7f78e00d0400 0x7f78e00b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:47.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.772+0000 7f78de59c700 1 -- 172.21.15.71:0/3390884192 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1573170366 0 0) 0x7f78e00b6170 con 0x7f78e00ccd40 2023-10-06T01:41:47.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.772+0000 7f78de59c700 1 -- 172.21.15.71:0/3390884192 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78cc003570 con 0x7f78e00ccd40 2023-10-06T01:41:47.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.773+0000 7f78de59c700 1 -- 172.21.15.71:0/3390884192 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1708068672 0 0) 0x7f78cc003570 con 0x7f78e00ccd40 2023-10-06T01:41:47.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.773+0000 7f78de59c700 1 -- 172.21.15.71:0/3390884192 >> v2:172.21.15.72:3300/0 conn(0x7f78e00d0400 msgr2=0x7f78e00b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:47.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.773+0000 7f78de59c700 1 --2- 172.21.15.71:0/3390884192 >> v2:172.21.15.72:3300/0 conn(0x7f78e00d0400 0x7f78e00b5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:47.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.773+0000 7f78de59c700 1 -- 172.21.15.71:0/3390884192 >> v1:172.21.15.72:6789/0 conn(0x7f78e00d07d0 legacy=0x7f78e00b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:47.778 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.773+0000 7f78de59c700 1 -- 172.21.15.71:0/3390884192 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78e00ceaa0 con 0x7f78e00ccd40 2023-10-06T01:41:47.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.773+0000 7f78de59c700 1 -- 172.21.15.71:0/3390884192 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1184243524 0 0) 0x7f78c8001470 con 0x7f78e00ccd40 2023-10-06T01:41:47.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.773+0000 7f78de59c700 1 -- 172.21.15.71:0/3390884192 >> v1:172.21.15.71:6789/0 conn(0x7f78e00ccd40 legacy=0x7f78e00cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:47.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.773+0000 7f78de59c700 1 --2- 172.21.15.71:0/3390884192 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78cc003a60 0x7f78cc003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:47.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.773+0000 7f78de59c700 1 --2- 172.21.15.71:0/3390884192 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f78cc004810 0x7f78cc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:47.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.773+0000 7f78de59c700 1 --2- 172.21.15.71:0/3390884192 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78cc0051c0 0x7f78cc00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:47.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.773+0000 7f78de59c700 1 -- 172.21.15.71:0/3390884192 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78e015e020 con 0x7f78cc003a60 2023-10-06T01:41:47.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.773+0000 7f78de59c700 1 -- 172.21.15.71:0/3390884192 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78cc00c0d0 con 0x7f78cc0051c0 2023-10-06T01:41:47.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.773+0000 7f78de59c700 1 -- 172.21.15.71:0/3390884192 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78cc00c290 con 0x7f78cc004810 2023-10-06T01:41:47.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.773+0000 7f78ded9d700 1 --2- 172.21.15.71:0/3390884192 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78cc003a60 0x7f78cc003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:47.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.773+0000 7f78d659c700 1 --2- 172.21.15.71:0/3390884192 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f78cc004810 0x7f78cc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:47.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.773+0000 7f78df59e700 1 --2- 172.21.15.71:0/3390884192 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78cc0051c0 0x7f78cc00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:47.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.773+0000 7f78ded9d700 1 -- 172.21.15.71:0/3390884192 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f78cc004810 msgr2=0x7f78cc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:47.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.773+0000 7f78ded9d700 1 --2- 172.21.15.71:0/3390884192 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f78cc004810 0x7f78cc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:47.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.773+0000 7f78ded9d700 1 -- 172.21.15.71:0/3390884192 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78cc0051c0 msgr2=0x7f78cc00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:47.781 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.773+0000 7f78ded9d700 1 --2- 172.21.15.71:0/3390884192 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78cc0051c0 0x7f78cc00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:47.781 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.773+0000 7f78df59e700 1 -- 172.21.15.71:0/3390884192 reap_dead start 2023-10-06T01:41:47.781 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.773+0000 7f78ded9d700 1 -- 172.21.15.71:0/3390884192 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78cc003570 con 0x7f78cc003a60 2023-10-06T01:41:47.781 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.773+0000 7f78ded9d700 1 --2- 172.21.15.71:0/3390884192 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78cc003a60 0x7f78cc003e70 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f78d0009bf0 tx=0x7f78d0009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=389f9bfa0af4c1a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:47.781 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.773+0000 7f78de59c700 1 -- 172.21.15.71:0/3390884192 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78d0005a00 con 0x7f78cc003a60 2023-10-06T01:41:47.782 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.774+0000 7f78de59c700 1 -- 172.21.15.71:0/3390884192 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78d0005b60 con 0x7f78cc003a60 2023-10-06T01:41:47.782 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.774+0000 7f78de59c700 1 -- 172.21.15.71:0/3390884192 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78d000e710 con 0x7f78cc003a60 2023-10-06T01:41:47.782 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.774+0000 7f78e51d9700 1 -- 172.21.15.71:0/3390884192 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78cc003a60 msgr2=0x7f78cc003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:47.782 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.774+0000 7f78e51d9700 1 --2- 172.21.15.71:0/3390884192 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78cc003a60 0x7f78cc003e70 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f78d0009bf0 tx=0x7f78d0009120 comp rx=0 tx=0).stop 2023-10-06T01:41:47.782 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.774+0000 7f78e51d9700 1 -- 172.21.15.71:0/3390884192 shutdown_connections 2023-10-06T01:41:47.782 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.774+0000 7f78e51d9700 1 --2- 172.21.15.71:0/3390884192 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78cc003a60 0x7f78cc003e70 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:47.782 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.774+0000 7f78e51d9700 1 -- 172.21.15.71:0/3390884192 >> 172.21.15.71:0/3390884192 conn(0x7f78e006a220 msgr2=0x7f78e006a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:47.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.774+0000 7f78e51d9700 1 -- 172.21.15.71:0/3390884192 shutdown_connections 2023-10-06T01:41:47.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.774+0000 7f78e51d9700 1 -- 172.21.15.71:0/3390884192 wait complete. 2023-10-06T01:41:47.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.775+0000 7f78e51d9700 1 Processor -- start 2023-10-06T01:41:47.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.775+0000 7f78e51d9700 1 -- start start 2023-10-06T01:41:47.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.776+0000 7f78e51d9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f78cc003a60 0x7f78e00c6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:47.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.776+0000 7f78e51d9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78e01592c0 0x7f78e00c5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:47.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.776+0000 7f78e51d9700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78e0159730 0x7f78e00c62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:47.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.776+0000 7f78e51d9700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78e016ad20 con 0x7f78e0159730 2023-10-06T01:41:47.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.776+0000 7f78e51d9700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78e016aa40 con 0x7f78e01592c0 2023-10-06T01:41:47.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.776+0000 7f78e51d9700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78e00c52a0 con 0x7f78cc003a60 2023-10-06T01:41:47.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.776+0000 7f78df59e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78e0159730 0x7f78e00c62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:47.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.776+0000 7f78df59e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78e0159730 0x7f78e00c62c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:58230/0 (socket says 172.21.15.71:58230) 2023-10-06T01:41:47.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.776+0000 7f78df59e700 1 -- 172.21.15.71:0/3624295334 learned_addr learned my addr 172.21.15.71:0/3624295334 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:47.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.776+0000 7f78ded9d700 1 --2- 172.21.15.71:0/3624295334 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f78cc003a60 0x7f78e00c6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:47.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.776+0000 7f78d659c700 1 --2- 172.21.15.71:0/3624295334 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78e01592c0 0x7f78e00c5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:47.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.776+0000 7f78df59e700 1 -- 172.21.15.71:0/3624295334 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f78cc003a60 msgr2=0x7f78e00c6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:47.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.776+0000 7f78df59e700 1 --2- 172.21.15.71:0/3624295334 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f78cc003a60 0x7f78e00c6eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:47.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.776+0000 7f78df59e700 1 -- 172.21.15.71:0/3624295334 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78e01592c0 msgr2=0x7f78e00c5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:47.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.776+0000 7f78df59e700 1 --2- 172.21.15.71:0/3624295334 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78e01592c0 0x7f78e00c5d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:47.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.776+0000 7f78df59e700 1 -- 172.21.15.71:0/3624295334 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78e00c5580 con 0x7f78e0159730 2023-10-06T01:41:47.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.777+0000 7f78df59e700 1 --2- 172.21.15.71:0/3624295334 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78e0159730 0x7f78e00c62c0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f78e00ccc10 tx=0x7f78d8001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:47.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.777+0000 7f78d77fe700 1 -- 172.21.15.71:0/3624295334 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78d8006db0 con 0x7f78e0159730 2023-10-06T01:41:47.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.777+0000 7f78d77fe700 1 -- 172.21.15.71:0/3624295334 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78d800c5a0 con 0x7f78e0159730 2023-10-06T01:41:47.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.777+0000 7f78e51d9700 1 -- 172.21.15.71:0/3624295334 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78e00c5860 con 0x7f78e0159730 2023-10-06T01:41:47.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.777+0000 7f78d77fe700 1 -- 172.21.15.71:0/3624295334 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78d800c960 con 0x7f78e0159730 2023-10-06T01:41:47.788 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.777+0000 7f78e51d9700 1 -- 172.21.15.71:0/3624295334 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78e0153180 con 0x7f78e0159730 2023-10-06T01:41:47.788 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.778+0000 7f78e51d9700 1 -- 172.21.15.71:0/3624295334 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78e00c5100 con 0x7f78e0159730 2023-10-06T01:41:47.788 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.778+0000 7f78d77fe700 1 -- 172.21.15.71:0/3624295334 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f78d80133e0 con 0x7f78e0159730 2023-10-06T01:41:47.788 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.778+0000 7f78d77fe700 1 --2- 172.21.15.71:0/3624295334 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f78c0066f30 0x7f78c00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:47.788 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.779+0000 7f78d77fe700 1 -- 172.21.15.71:0/3624295334 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6550+0+0 (secure 0 0 0) 0x7f78d8084250 con 0x7f78e0159730 2023-10-06T01:41:47.788 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.779+0000 7f78ded9d700 1 --2- 172.21.15.71:0/3624295334 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f78c0066f30 0x7f78c00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:47.788 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.779+0000 7f78ded9d700 1 --2- 172.21.15.71:0/3624295334 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f78c0066f30 0x7f78c00693e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f78d0009160 tx=0x7f78d0019000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:47.788 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:47.783+0000 7f78d77fe700 1 -- 172.21.15.71:0/3624295334 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f78e00c5100 con 0x7f78e0159730 2023-10-06T01:41:48.008 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:48.007+0000 7f78e51d9700 1 -- 172.21.15.71:0/3624295334 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f78e00c5aa0 con 0x7f78e0159730 2023-10-06T01:41:48.637 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:48.636+0000 7f78d77fe700 1 -- 172.21.15.71:0/3624295334 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v25) v1 ==== 104+0+0 (secure 0 0 0) 0x7f78e00c5aa0 con 0x7f78e0159730 2023-10-06T01:41:48.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:48.639+0000 7f78e51d9700 1 -- 172.21.15.71:0/3624295334 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f78c0066f30 msgr2=0x7f78c00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:48.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:48.639+0000 7f78e51d9700 1 --2- 172.21.15.71:0/3624295334 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f78c0066f30 0x7f78c00693e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f78d0009160 tx=0x7f78d0019000 comp rx=0 tx=0).stop 2023-10-06T01:41:48.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:48.639+0000 7f78e51d9700 1 -- 172.21.15.71:0/3624295334 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78e0159730 msgr2=0x7f78e00c62c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:48.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:48.639+0000 7f78e51d9700 1 --2- 172.21.15.71:0/3624295334 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78e0159730 0x7f78e00c62c0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f78e00ccc10 tx=0x7f78d8001640 comp rx=0 tx=0).stop 2023-10-06T01:41:48.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:48.639+0000 7f78e51d9700 1 -- 172.21.15.71:0/3624295334 shutdown_connections 2023-10-06T01:41:48.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:48.639+0000 7f78e51d9700 1 --2- 172.21.15.71:0/3624295334 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78e0159730 0x7f78e00c62c0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:48.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:48.639+0000 7f78e51d9700 1 --2- 172.21.15.71:0/3624295334 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f78cc003a60 0x7f78e00c6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:48.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:48.639+0000 7f78e51d9700 1 --2- 172.21.15.71:0/3624295334 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f78c0066f30 0x7f78c00693e0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:48.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:48.639+0000 7f78e51d9700 1 --2- 172.21.15.71:0/3624295334 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78e01592c0 0x7f78e00c5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:48.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:48.639+0000 7f78e51d9700 1 -- 172.21.15.71:0/3624295334 >> 172.21.15.71:0/3624295334 conn(0x7f78e006a220 msgr2=0x7f78e00b1250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:48.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:48.639+0000 7f78e51d9700 1 -- 172.21.15.71:0/3624295334 shutdown_connections 2023-10-06T01:41:48.641 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:48.639+0000 7f78e51d9700 1 -- 172.21.15.71:0/3624295334 wait complete. 2023-10-06T01:41:48.655 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T01:41:48.817 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:48.816+0000 7f811ce84700 1 Processor -- start 2023-10-06T01:41:48.817 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:48.816+0000 7f811ce84700 1 -- start start 2023-10-06T01:41:48.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:48.817+0000 7f811ce84700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8118142df0 0x7f81180cc350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:48.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:48.817+0000 7f811ce84700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f81180cc890 0x7f81180d0260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:48.819 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:48.817+0000 7f811ce84700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f81180d07a0 0x7f81180cea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:48.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:48.817+0000 7f811ce84700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81180d0c40 con 0x7f81180d07a0 2023-10-06T01:41:48.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:48.817+0000 7f811ce84700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f811815a710 con 0x7f81180cc890 2023-10-06T01:41:48.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:48.817+0000 7f811ce84700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8118159b40 con 0x7f8118142df0 2023-10-06T01:41:48.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:48.817+0000 7f8116d9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f81180d07a0 0x7f81180cea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:48.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:48.817+0000 7f8116d9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f81180d07a0 0x7f81180cea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:58236/0 (socket says 172.21.15.71:58236) 2023-10-06T01:41:48.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:48.817+0000 7f8116d9d700 1 -- 172.21.15.71:0/3610501747 learned_addr learned my addr 172.21.15.71:0/3610501747 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:48.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:48.817+0000 7f811659c700 1 --2- 172.21.15.71:0/3610501747 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8118142df0 0x7f81180cc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:48.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:48.817+0000 7f810dd9b700 1 --2- 172.21.15.71:0/3610501747 >> v2:172.21.15.72:3300/0 conn(0x7f81180cc890 0x7f81180d0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:48.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:48.817+0000 7f8116d9d700 1 -- 172.21.15.71:0/3610501747 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8118142df0 msgr2=0x7f81180cc350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:48.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:48.817+0000 7f8116d9d700 1 --2- 172.21.15.71:0/3610501747 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8118142df0 0x7f81180cc350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:48.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:48.817+0000 7f8116d9d700 1 -- 172.21.15.71:0/3610501747 >> v2:172.21.15.72:3300/0 conn(0x7f81180cc890 msgr2=0x7f81180d0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:48.821 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:48.817+0000 7f8116d9d700 1 --2- 172.21.15.71:0/3610501747 >> v2:172.21.15.72:3300/0 conn(0x7f81180cc890 0x7f81180d0260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:48.821 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:48.817+0000 7f8116d9d700 1 -- 172.21.15.71:0/3610501747 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8118159de0 con 0x7f81180d07a0 2023-10-06T01:41:48.821 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:48.817+0000 7f810dd9b700 1 --2- 172.21.15.71:0/3610501747 >> v2:172.21.15.72:3300/0 conn(0x7f81180cc890 0x7f81180d0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:41:48.821 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:48.817+0000 7f8116d9d700 1 --2- 172.21.15.71:0/3610501747 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81180d07a0 0x7f81180cea80 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f8118067c40 tx=0x7f8110009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46a5fa385b064b40 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:48.821 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:48.818+0000 7f8115d9b700 1 -- 172.21.15.71:0/3610501747 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f811000e070 con 0x7f81180d07a0 2023-10-06T01:41:48.821 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:48.818+0000 7f8115d9b700 1 -- 172.21.15.71:0/3610501747 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f811000ba50 con 0x7f81180d07a0 2023-10-06T01:41:48.821 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:48.818+0000 7f8115d9b700 1 -- 172.21.15.71:0/3610501747 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81100092e0 con 0x7f81180d07a0 2023-10-06T01:41:48.821 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:48.818+0000 7f811ce84700 1 -- 172.21.15.71:0/3610501747 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81180d07a0 msgr2=0x7f81180cea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:48.821 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:48.818+0000 7f811ce84700 1 --2- 172.21.15.71:0/3610501747 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81180d07a0 0x7f81180cea80 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f8118067c40 tx=0x7f8110009840 comp rx=0 tx=0).stop 2023-10-06T01:41:48.821 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:48.818+0000 7f811ce84700 1 -- 172.21.15.71:0/3610501747 shutdown_connections 2023-10-06T01:41:48.821 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:48.818+0000 7f811ce84700 1 --2- 172.21.15.71:0/3610501747 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81180d07a0 0x7f81180cea80 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:48.821 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:48.818+0000 7f811ce84700 1 --2- 172.21.15.71:0/3610501747 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8118142df0 0x7f81180cc350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:48.822 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:48.818+0000 7f811ce84700 1 --2- 172.21.15.71:0/3610501747 >> v2:172.21.15.72:3300/0 conn(0x7f81180cc890 0x7f81180d0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:48.822 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:48.818+0000 7f811ce84700 1 -- 172.21.15.71:0/3610501747 >> 172.21.15.71:0/3610501747 conn(0x7f81180690f0 msgr2=0x7f811806a340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:48.822 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:48.818+0000 7f811ce84700 1 -- 172.21.15.71:0/3610501747 shutdown_connections 2023-10-06T01:41:48.822 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:48.818+0000 7f811ce84700 1 -- 172.21.15.71:0/3610501747 wait complete. 2023-10-06T01:41:48.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:48.819+0000 7f811ce84700 1 Processor -- start 2023-10-06T01:41:48.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:48.819+0000 7f811ce84700 1 -- start start 2023-10-06T01:41:48.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:48.820+0000 7f811ce84700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81180cc890 0x7f8118156b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:48.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:48.820+0000 7f811ce84700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f81180d07a0 0x7f811813b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:48.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:48.820+0000 7f811ce84700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8118142df0 0x7f811813bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:48.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:48.820+0000 7f811ce84700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f811813c360 con 0x7f81180cc890 2023-10-06T01:41:48.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:48.820+0000 7f811ce84700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f811815be10 con 0x7f8118142df0 2023-10-06T01:41:48.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:48.820+0000 7f811ce84700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f811816afd0 con 0x7f81180d07a0 2023-10-06T01:41:48.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:48.820+0000 7f811659c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81180cc890 0x7f8118156b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:48.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:48.820+0000 7f811659c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81180cc890 0x7f8118156b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:58244/0 (socket says 172.21.15.71:58244) 2023-10-06T01:41:48.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:48.820+0000 7f811659c700 1 -- 172.21.15.71:0/3255599821 learned_addr learned my addr 172.21.15.71:0/3255599821 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:48.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:48.820+0000 7f8116d9d700 1 --2- 172.21.15.71:0/3255599821 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8118142df0 0x7f811813bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:48.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:48.820+0000 7f810dd9b700 1 --2- 172.21.15.71:0/3255599821 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f81180d07a0 0x7f811813b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:48.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:48.821+0000 7f811659c700 1 -- 172.21.15.71:0/3255599821 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f81180d07a0 msgr2=0x7f811813b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:48.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:48.821+0000 7f811659c700 1 --2- 172.21.15.71:0/3255599821 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f81180d07a0 0x7f811813b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:48.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:48.821+0000 7f811659c700 1 -- 172.21.15.71:0/3255599821 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8118142df0 msgr2=0x7f811813bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:48.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:48.821+0000 7f811659c700 1 --2- 172.21.15.71:0/3255599821 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8118142df0 0x7f811813bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:48.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:48.821+0000 7f811659c700 1 -- 172.21.15.71:0/3255599821 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8110009ae0 con 0x7f81180cc890 2023-10-06T01:41:48.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:48.821+0000 7f8116d9d700 1 --2- 172.21.15.71:0/3255599821 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8118142df0 0x7f811813bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:41:48.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:48.821+0000 7f811659c700 1 --2- 172.21.15.71:0/3255599821 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81180cc890 0x7f8118156b60 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f810800c7d0 tx=0x7f8108008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:48.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:48.821+0000 7f810effd700 1 -- 172.21.15.71:0/3255599821 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8108011600 con 0x7f81180cc890 2023-10-06T01:41:48.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:48.821+0000 7f810effd700 1 -- 172.21.15.71:0/3255599821 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8108011760 con 0x7f81180cc890 2023-10-06T01:41:48.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:48.821+0000 7f811ce84700 1 -- 172.21.15.71:0/3255599821 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f811816a6a0 con 0x7f81180cc890 2023-10-06T01:41:48.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:48.821+0000 7f810effd700 1 -- 172.21.15.71:0/3255599821 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8108011b20 con 0x7f81180cc890 2023-10-06T01:41:48.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:48.821+0000 7f811ce84700 1 -- 172.21.15.71:0/3255599821 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f811816ac60 con 0x7f81180cc890 2023-10-06T01:41:48.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:48.822+0000 7f811ce84700 1 -- 172.21.15.71:0/3255599821 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8118088ad0 con 0x7f81180cc890 2023-10-06T01:41:48.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:48.822+0000 7f810effd700 1 -- 172.21.15.71:0/3255599821 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f81080193f0 con 0x7f81180cc890 2023-10-06T01:41:48.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:48.823+0000 7f810effd700 1 --2- 172.21.15.71:0/3255599821 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f80f8066f30 0x7f80f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:48.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:48.823+0000 7f810effd700 1 -- 172.21.15.71:0/3255599821 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6550+0+0 (secure 0 0 0) 0x7f8108084c80 con 0x7f81180cc890 2023-10-06T01:41:48.828 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:48.823+0000 7f810dd9b700 1 --2- 172.21.15.71:0/3255599821 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f80f8066f30 0x7f80f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:48.828 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:48.823+0000 7f810dd9b700 1 --2- 172.21.15.71:0/3255599821 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f80f8066f30 0x7f80f80693e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f81181412e0 tx=0x7f8100008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:48.828 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:48.827+0000 7f810effd700 1 -- 172.21.15.71:0/3255599821 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8108051ba0 con 0x7f81180cc890 2023-10-06T01:41:49.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:49.010+0000 7f811ce84700 1 -- 172.21.15.71:0/3255599821 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8118157160 con 0x7f81180cc890 2023-10-06T01:41:49.846 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:49.845+0000 7f810effd700 1 -- 172.21.15.71:0/3255599821 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v44) v1 ==== 181+0+0 (secure 0 0 0) 0x7f81080551c0 con 0x7f81180cc890 2023-10-06T01:41:49.849 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:49.848+0000 7f811ce84700 1 -- 172.21.15.71:0/3255599821 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f80f8066f30 msgr2=0x7f80f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:49.849 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:49.848+0000 7f811ce84700 1 --2- 172.21.15.71:0/3255599821 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f80f8066f30 0x7f80f80693e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f81181412e0 tx=0x7f8100008040 comp rx=0 tx=0).stop 2023-10-06T01:41:49.849 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:49.848+0000 7f811ce84700 1 -- 172.21.15.71:0/3255599821 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81180cc890 msgr2=0x7f8118156b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:49.849 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:49.848+0000 7f811ce84700 1 --2- 172.21.15.71:0/3255599821 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81180cc890 0x7f8118156b60 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f810800c7d0 tx=0x7f8108008040 comp rx=0 tx=0).stop 2023-10-06T01:41:49.849 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:49.848+0000 7f811ce84700 1 -- 172.21.15.71:0/3255599821 shutdown_connections 2023-10-06T01:41:49.849 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:49.848+0000 7f811ce84700 1 --2- 172.21.15.71:0/3255599821 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f80f8066f30 0x7f80f80693e0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:49.849 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:49.848+0000 7f811ce84700 1 --2- 172.21.15.71:0/3255599821 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8118142df0 0x7f811813bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:49.849 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:49.848+0000 7f811ce84700 1 --2- 172.21.15.71:0/3255599821 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81180cc890 0x7f8118156b60 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:49.850 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:49.848+0000 7f811ce84700 1 --2- 172.21.15.71:0/3255599821 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f81180d07a0 0x7f811813b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:49.850 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:49.848+0000 7f811ce84700 1 -- 172.21.15.71:0/3255599821 >> 172.21.15.71:0/3255599821 conn(0x7f81180690f0 msgr2=0x7f811806a340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:49.850 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:49.848+0000 7f811ce84700 1 -- 172.21.15.71:0/3255599821 shutdown_connections 2023-10-06T01:41:49.850 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:49.848+0000 7f811ce84700 1 -- 172.21.15.71:0/3255599821 wait complete. 2023-10-06T01:41:49.850 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'cephfs_metadata' removed 2023-10-06T01:41:49.862 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T01:41:49.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:49.980+0000 7f80e4e51700 1 Processor -- start 2023-10-06T01:41:49.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:49.980+0000 7f80e4e51700 1 -- start start 2023-10-06T01:41:49.983 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:49.981+0000 7f80e4e51700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f80e01593f0 0x7f80e01597c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:49.983 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:49.981+0000 7f80e4e51700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f80e0068d90 0x7f80e015a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:49.983 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:49.981+0000 7f80e4e51700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80e0159fa0 con 0x7f80e00a95b0 2023-10-06T01:41:49.983 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:49.981+0000 7f80e4e51700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80e0159d00 con 0x7f80e0068d90 2023-10-06T01:41:49.983 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:49.981+0000 7f80e4e51700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80e00a9d20 con 0x7f80e01593f0 2023-10-06T01:41:49.983 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:49.981+0000 7f80ded9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f80e0068d90 0x7f80e015a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:49.983 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:49.981+0000 7f80ded9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f80e0068d90 0x7f80e015a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50902/0 (socket says 172.21.15.71:50902) 2023-10-06T01:41:49.983 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:49.981+0000 7f80ded9d700 1 -- 172.21.15.71:0/3570649896 learned_addr learned my addr 172.21.15.71:0/3570649896 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:49.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:49.981+0000 7f80de59c700 1 --2- 172.21.15.71:0/3570649896 >> v2:172.21.15.72:3300/0 conn(0x7f80e01593f0 0x7f80e01597c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:49.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:49.981+0000 7f80ded9d700 1 -- 172.21.15.71:0/3570649896 >> v2:172.21.15.72:3300/0 conn(0x7f80e01593f0 msgr2=0x7f80e01597c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:49.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:49.981+0000 7f80ded9d700 1 --2- 172.21.15.71:0/3570649896 >> v2:172.21.15.72:3300/0 conn(0x7f80e01593f0 0x7f80e01597c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:49.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:49.981+0000 7f80ded9d700 1 -- 172.21.15.71:0/3570649896 >> v1:172.21.15.72:6789/0 conn(0x7f80e00a95b0 legacy=0x7f80e0068680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:49.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:49.981+0000 7f80ded9d700 1 -- 172.21.15.71:0/3570649896 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80e00a9fc0 con 0x7f80e0068d90 2023-10-06T01:41:49.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:49.981+0000 7f80ded9d700 1 --2- 172.21.15.71:0/3570649896 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80e0068d90 0x7f80e015a430 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f80e006e2e0 tx=0x7f80d8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff1482cdbae11155 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:49.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:49.981+0000 7f80dd59a700 1 -- 172.21.15.71:0/3570649896 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d800e070 con 0x7f80e0068d90 2023-10-06T01:41:49.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:49.982+0000 7f80dd59a700 1 -- 172.21.15.71:0/3570649896 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80d800ba10 con 0x7f80e0068d90 2023-10-06T01:41:49.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:49.982+0000 7f80dd59a700 1 -- 172.21.15.71:0/3570649896 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d80092e0 con 0x7f80e0068d90 2023-10-06T01:41:49.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:49.982+0000 7f80e4e51700 1 -- 172.21.15.71:0/3570649896 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80e0068d90 msgr2=0x7f80e015a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:49.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:49.982+0000 7f80e4e51700 1 --2- 172.21.15.71:0/3570649896 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80e0068d90 0x7f80e015a430 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f80e006e2e0 tx=0x7f80d8009840 comp rx=0 tx=0).stop 2023-10-06T01:41:49.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:49.982+0000 7f80e4e51700 1 -- 172.21.15.71:0/3570649896 shutdown_connections 2023-10-06T01:41:49.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:49.982+0000 7f80e4e51700 1 --2- 172.21.15.71:0/3570649896 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80e0068d90 0x7f80e015a430 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:49.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:49.982+0000 7f80e4e51700 1 --2- 172.21.15.71:0/3570649896 >> v2:172.21.15.72:3300/0 conn(0x7f80e01593f0 0x7f80e01597c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:49.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:49.982+0000 7f80e4e51700 1 -- 172.21.15.71:0/3570649896 >> 172.21.15.71:0/3570649896 conn(0x7f80e00af660 msgr2=0x7f80e00afa60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:49.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:49.982+0000 7f80e4e51700 1 -- 172.21.15.71:0/3570649896 shutdown_connections 2023-10-06T01:41:49.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:49.982+0000 7f80e4e51700 1 -- 172.21.15.71:0/3570649896 wait complete. 2023-10-06T01:41:49.988 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:49.983+0000 7f80e4e51700 1 Processor -- start 2023-10-06T01:41:49.988 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:49.983+0000 7f80e4e51700 1 -- start start 2023-10-06T01:41:49.988 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:49.984+0000 7f80e4e51700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f80e0068d90 0x7f80e0150410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:49.988 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:49.984+0000 7f80e4e51700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f80e00a95b0 0x7f80e00cc960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:49.988 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:49.984+0000 7f80e4e51700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80e01593f0 0x7f80e00ccea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:49.988 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:49.984+0000 7f80e4e51700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80e0152620 con 0x7f80e01593f0 2023-10-06T01:41:49.988 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:49.984+0000 7f80e4e51700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80e0150950 con 0x7f80e00a95b0 2023-10-06T01:41:49.988 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:49.984+0000 7f80e4e51700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80e0151a10 con 0x7f80e0068d90 2023-10-06T01:41:49.988 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:49.984+0000 7f80ded9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80e01593f0 0x7f80e00ccea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:49.989 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:49.984+0000 7f80ded9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80e01593f0 0x7f80e00ccea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50916/0 (socket says 172.21.15.71:50916) 2023-10-06T01:41:49.989 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:49.984+0000 7f80ded9d700 1 -- 172.21.15.71:0/1860710360 learned_addr learned my addr 172.21.15.71:0/1860710360 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:49.989 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:49.984+0000 7f80de59c700 1 --2- 172.21.15.71:0/1860710360 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f80e0068d90 0x7f80e0150410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:49.989 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:49.984+0000 7f80ddd9b700 1 --2- 172.21.15.71:0/1860710360 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f80e00a95b0 0x7f80e00cc960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:49.989 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:49.984+0000 7f80ded9d700 1 -- 172.21.15.71:0/1860710360 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f80e0068d90 msgr2=0x7f80e0150410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:49.989 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:49.984+0000 7f80ded9d700 1 --2- 172.21.15.71:0/1860710360 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f80e0068d90 0x7f80e0150410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:49.989 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:49.984+0000 7f80ded9d700 1 -- 172.21.15.71:0/1860710360 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f80e00a95b0 msgr2=0x7f80e00cc960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:49.989 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:49.984+0000 7f80ded9d700 1 --2- 172.21.15.71:0/1860710360 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f80e00a95b0 0x7f80e00cc960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:49.989 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:49.984+0000 7f80ded9d700 1 -- 172.21.15.71:0/1860710360 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80d8009ae0 con 0x7f80e01593f0 2023-10-06T01:41:49.989 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:49.985+0000 7f80ddd9b700 1 --2- 172.21.15.71:0/1860710360 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f80e00a95b0 0x7f80e00cc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:41:49.989 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:49.985+0000 7f80ded9d700 1 --2- 172.21.15.71:0/1860710360 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80e01593f0 0x7f80e00ccea0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f80e006d8d0 tx=0x7f80d8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:49.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:49.985+0000 7f80ce7fc700 1 -- 172.21.15.71:0/1860710360 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d800bee0 con 0x7f80e01593f0 2023-10-06T01:41:49.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:49.985+0000 7f80ce7fc700 1 -- 172.21.15.71:0/1860710360 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80d80032f0 con 0x7f80e01593f0 2023-10-06T01:41:49.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:49.985+0000 7f80e4e51700 1 -- 172.21.15.71:0/1860710360 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80e0151cf0 con 0x7f80e01593f0 2023-10-06T01:41:49.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:49.985+0000 7f80ce7fc700 1 -- 172.21.15.71:0/1860710360 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d801d650 con 0x7f80e01593f0 2023-10-06T01:41:49.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:49.985+0000 7f80e4e51700 1 -- 172.21.15.71:0/1860710360 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80e01522b0 con 0x7f80e01593f0 2023-10-06T01:41:49.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:49.986+0000 7f80e4e51700 1 -- 172.21.15.71:0/1860710360 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80e01529b0 con 0x7f80e01593f0 2023-10-06T01:41:49.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:49.986+0000 7f80ce7fc700 1 -- 172.21.15.71:0/1860710360 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f80d801da80 con 0x7f80e01593f0 2023-10-06T01:41:49.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:49.987+0000 7f80ce7fc700 1 --2- 172.21.15.71:0/1860710360 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f80c0066f30 0x7f80c00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:49.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:49.987+0000 7f80ce7fc700 1 -- 172.21.15.71:0/1860710360 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6112+0+0 (secure 0 0 0) 0x7f80d8085f50 con 0x7f80e01593f0 2023-10-06T01:41:49.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:49.987+0000 7f80de59c700 1 --2- 172.21.15.71:0/1860710360 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f80c0066f30 0x7f80c00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:49.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:49.987+0000 7f80de59c700 1 --2- 172.21.15.71:0/1860710360 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f80c0066f30 0x7f80c00693e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f80d0006fd0 tx=0x7f80d0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:49.991 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:49.991+0000 7f80ce7fc700 1 -- 172.21.15.71:0/1860710360 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f80e01529b0 con 0x7f80e01593f0 2023-10-06T01:41:50.174 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:50.174+0000 7f80e4e51700 1 -- 172.21.15.71:0/1860710360 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f80e01529b0 con 0x7f80e01593f0 2023-10-06T01:41:50.853 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:50.852+0000 7f80ce7fc700 1 -- 172.21.15.71:0/1860710360 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v45) v1 ==== 169+0+0 (secure 0 0 0) 0x7f80e01529b0 con 0x7f80e01593f0 2023-10-06T01:41:50.857 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:50.856+0000 7f80e4e51700 1 -- 172.21.15.71:0/1860710360 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f80c0066f30 msgr2=0x7f80c00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:50.857 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:50.856+0000 7f80e4e51700 1 --2- 172.21.15.71:0/1860710360 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f80c0066f30 0x7f80c00693e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f80d0006fd0 tx=0x7f80d0008040 comp rx=0 tx=0).stop 2023-10-06T01:41:50.857 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:50.856+0000 7f80e4e51700 1 -- 172.21.15.71:0/1860710360 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80e01593f0 msgr2=0x7f80e00ccea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:50.857 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:50.856+0000 7f80e4e51700 1 --2- 172.21.15.71:0/1860710360 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80e01593f0 0x7f80e00ccea0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f80e006d8d0 tx=0x7f80d8017000 comp rx=0 tx=0).stop 2023-10-06T01:41:50.857 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:50.856+0000 7f80e4e51700 1 -- 172.21.15.71:0/1860710360 shutdown_connections 2023-10-06T01:41:50.857 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:50.856+0000 7f80e4e51700 1 --2- 172.21.15.71:0/1860710360 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f80e01593f0 0x7f80e00ccea0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:50.858 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:50.856+0000 7f80e4e51700 1 --2- 172.21.15.71:0/1860710360 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f80e0068d90 0x7f80e0150410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:50.858 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:50.856+0000 7f80e4e51700 1 --2- 172.21.15.71:0/1860710360 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f80c0066f30 0x7f80c00693e0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:50.858 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:50.856+0000 7f80e4e51700 1 --2- 172.21.15.71:0/1860710360 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f80e00a95b0 0x7f80e00cc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:50.858 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:50.856+0000 7f80e4e51700 1 -- 172.21.15.71:0/1860710360 >> 172.21.15.71:0/1860710360 conn(0x7f80e00af660 msgr2=0x7f80e006b6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:50.858 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:50.856+0000 7f80e4e51700 1 -- 172.21.15.71:0/1860710360 shutdown_connections 2023-10-06T01:41:50.858 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:50.856+0000 7f80e4e51700 1 -- 172.21.15.71:0/1860710360 wait complete. 2023-10-06T01:41:50.858 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'cephfs_data' removed 2023-10-06T01:41:50.871 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-06T01:41:50.994 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:50.994+0000 7fd6d1812700 1 Processor -- start 2023-10-06T01:41:50.994 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:50.994+0000 7fd6d1812700 1 -- start start 2023-10-06T01:41:50.997 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:50.994+0000 7fd6d1812700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd6cc1574b0 0x7fd6cc0b0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:50.997 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:50.994+0000 7fd6d1812700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd6cc0c46e0 0x7fd6cc0cbcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:50.997 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:50.994+0000 7fd6d1812700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6cc0c3b40 con 0x7fd6cc0b13f0 2023-10-06T01:41:50.997 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:50.994+0000 7fd6d1812700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6cc0c2f30 con 0x7fd6cc1574b0 2023-10-06T01:41:50.997 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:50.994+0000 7fd6d1812700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6cc0c3210 con 0x7fd6cc0c46e0 2023-10-06T01:41:50.997 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:50.995+0000 7fd6caffd700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd6cc1574b0 0x7fd6cc0b0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:50.997 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:50.995+0000 7fd6caffd700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fd6cc1574b0 0x7fd6cc0b0eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50926/0 (socket says 172.21.15.71:50926) 2023-10-06T01:41:50.997 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:50.995+0000 7fd6caffd700 1 -- 172.21.15.71:0/1491352289 learned_addr learned my addr 172.21.15.71:0/1491352289 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:50.997 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:50.995+0000 7fd6c27fc700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fd6cc0b13f0 0x7fd6cc0c3fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:49658/0 (socket says 172.21.15.71:49658) 2023-10-06T01:41:50.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:50.995+0000 7fd6caffd700 1 -- 172.21.15.71:0/1491352289 >> v2:172.21.15.72:3300/0 conn(0x7fd6cc0c46e0 msgr2=0x7fd6cc0cbcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:50.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:50.995+0000 7fd6caffd700 1 --2- 172.21.15.71:0/1491352289 >> v2:172.21.15.72:3300/0 conn(0x7fd6cc0c46e0 0x7fd6cc0cbcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:50.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:50.995+0000 7fd6caffd700 1 -- 172.21.15.71:0/1491352289 >> v1:172.21.15.71:6789/0 conn(0x7fd6cc0b13f0 legacy=0x7fd6cc0c3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:50.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:50.995+0000 7fd6ca7fc700 1 -- 172.21.15.71:0/1491352289 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3221633055 0 0) 0x7fd6cc0c3b40 con 0x7fd6cc0b13f0 2023-10-06T01:41:50.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:50.995+0000 7fd6caffd700 1 -- 172.21.15.71:0/1491352289 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6cc0c34f0 con 0x7fd6cc1574b0 2023-10-06T01:41:50.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:50.995+0000 7fd6caffd700 1 --2- 172.21.15.71:0/1491352289 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6cc1574b0 0x7fd6cc0b0eb0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc06be40 tx=0x7fd6bc009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e9d22e5a248de13 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:50.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:50.995+0000 7fd6ca7fc700 1 -- 172.21.15.71:0/1491352289 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6bc005c10 con 0x7fd6cc1574b0 2023-10-06T01:41:50.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:50.995+0000 7fd6ca7fc700 1 -- 172.21.15.71:0/1491352289 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6bc005d70 con 0x7fd6cc1574b0 2023-10-06T01:41:50.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:50.995+0000 7fd6ca7fc700 1 -- 172.21.15.71:0/1491352289 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6bc00b880 con 0x7fd6cc1574b0 2023-10-06T01:41:50.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:50.996+0000 7fd6d1812700 1 -- 172.21.15.71:0/1491352289 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6cc1574b0 msgr2=0x7fd6cc0b0eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:50.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:50.996+0000 7fd6d1812700 1 --2- 172.21.15.71:0/1491352289 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6cc1574b0 0x7fd6cc0b0eb0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc06be40 tx=0x7fd6bc009220 comp rx=0 tx=0).stop 2023-10-06T01:41:50.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:50.996+0000 7fd6d1812700 1 -- 172.21.15.71:0/1491352289 shutdown_connections 2023-10-06T01:41:50.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:50.996+0000 7fd6d1812700 1 --2- 172.21.15.71:0/1491352289 >> v2:172.21.15.72:3300/0 conn(0x7fd6cc0c46e0 0x7fd6cc0cbcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:50.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:50.996+0000 7fd6d1812700 1 --2- 172.21.15.71:0/1491352289 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6cc1574b0 0x7fd6cc0b0eb0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:50.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:50.996+0000 7fd6d1812700 1 -- 172.21.15.71:0/1491352289 >> 172.21.15.71:0/1491352289 conn(0x7fd6cc067910 msgr2=0x7fd6cc0ce0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:50.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:50.996+0000 7fd6d1812700 1 -- 172.21.15.71:0/1491352289 shutdown_connections 2023-10-06T01:41:50.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:50.996+0000 7fd6d1812700 1 -- 172.21.15.71:0/1491352289 wait complete. 2023-10-06T01:41:51.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:50.997+0000 7fd6d1812700 1 Processor -- start 2023-10-06T01:41:51.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:50.997+0000 7fd6d1812700 1 -- start start 2023-10-06T01:41:51.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:50.998+0000 7fd6d1812700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6cc0b13f0 0x7fd6cc0c6d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:51.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:50.998+0000 7fd6d1812700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6cc0c46e0 0x7fd6cc167780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:51.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:50.998+0000 7fd6d1812700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd6cc1574b0 0x7fd6cc167cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:51.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:50.998+0000 7fd6d1812700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6cc168e60 con 0x7fd6cc0b13f0 2023-10-06T01:41:51.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:50.998+0000 7fd6d1812700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6cc0c7840 con 0x7fd6cc0c46e0 2023-10-06T01:41:51.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:50.998+0000 7fd6d1812700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6cc0c7b20 con 0x7fd6cc1574b0 2023-10-06T01:41:51.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:50.998+0000 7fd6caffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6cc0b13f0 0x7fd6cc0c6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:51.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:50.998+0000 7fd6caffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6cc0b13f0 0x7fd6cc0c6d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50928/0 (socket says 172.21.15.71:50928) 2023-10-06T01:41:51.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:50.998+0000 7fd6caffd700 1 -- 172.21.15.71:0/1174476104 learned_addr learned my addr 172.21.15.71:0/1174476104 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:51.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:50.998+0000 7fd6c27fc700 1 --2- 172.21.15.71:0/1174476104 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6cc0c46e0 0x7fd6cc167780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:51.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:50.998+0000 7fd6cb7fe700 1 --2- 172.21.15.71:0/1174476104 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd6cc1574b0 0x7fd6cc167cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:51.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:50.998+0000 7fd6caffd700 1 -- 172.21.15.71:0/1174476104 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd6cc1574b0 msgr2=0x7fd6cc167cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:51.003 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:50.998+0000 7fd6caffd700 1 --2- 172.21.15.71:0/1174476104 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd6cc1574b0 0x7fd6cc167cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:51.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:50.998+0000 7fd6caffd700 1 -- 172.21.15.71:0/1174476104 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6cc0c46e0 msgr2=0x7fd6cc167780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:51.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:50.998+0000 7fd6caffd700 1 --2- 172.21.15.71:0/1174476104 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6cc0c46e0 0x7fd6cc167780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:51.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:50.998+0000 7fd6caffd700 1 -- 172.21.15.71:0/1174476104 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6bc009480 con 0x7fd6cc0b13f0 2023-10-06T01:41:51.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:50.998+0000 7fd6caffd700 1 --2- 172.21.15.71:0/1174476104 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6cc0b13f0 0x7fd6cc0c6d70 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc06f5e0 tx=0x7fd6bc016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:51.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:50.998+0000 7fd6c37fe700 1 -- 172.21.15.71:0/1174476104 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6bc011730 con 0x7fd6cc0b13f0 2023-10-06T01:41:51.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:50.998+0000 7fd6c37fe700 1 -- 172.21.15.71:0/1174476104 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6bc020070 con 0x7fd6cc0b13f0 2023-10-06T01:41:51.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:50.998+0000 7fd6c37fe700 1 -- 172.21.15.71:0/1174476104 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6bc011ae0 con 0x7fd6cc0b13f0 2023-10-06T01:41:51.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:50.998+0000 7fd6d1812700 1 -- 172.21.15.71:0/1174476104 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6cc168af0 con 0x7fd6cc0b13f0 2023-10-06T01:41:51.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:50.999+0000 7fd6d1812700 1 -- 172.21.15.71:0/1174476104 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6cc152520 con 0x7fd6cc0b13f0 2023-10-06T01:41:51.004 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:50.999+0000 7fd6d1812700 1 -- 172.21.15.71:0/1174476104 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6cc168950 con 0x7fd6cc0b13f0 2023-10-06T01:41:51.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.000+0000 7fd6c37fe700 1 -- 172.21.15.71:0/1174476104 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd6bc022030 con 0x7fd6cc0b13f0 2023-10-06T01:41:51.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.000+0000 7fd6c37fe700 1 --2- 172.21.15.71:0/1174476104 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fd6ac066f30 0x7fd6ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:51.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.000+0000 7fd6c37fe700 1 -- 172.21.15.71:0/1174476104 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5698+0+0 (secure 0 0 0) 0x7fd6bc085ff0 con 0x7fd6cc0b13f0 2023-10-06T01:41:51.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.000+0000 7fd6c27fc700 1 --2- 172.21.15.71:0/1174476104 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fd6ac066f30 0x7fd6ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:51.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.001+0000 7fd6c27fc700 1 --2- 172.21.15.71:0/1174476104 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fd6ac066f30 0x7fd6ac0693e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd6b4007fd0 tx=0x7fd6b4007d50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:51.005 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.004+0000 7fd6c37fe700 1 -- 172.21.15.71:0/1174476104 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd6cc168950 con 0x7fd6cc0b13f0 2023-10-06T01:41:51.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.198+0000 7fd6d1812700 1 -- 172.21.15.71:0/1174476104 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fd6cc168950 con 0x7fd6cc0b13f0 2023-10-06T01:41:51.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.202+0000 7fd6c37fe700 1 -- 172.21.15.71:0/1174476104 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd6cc168950 con 0x7fd6cc0b13f0 2023-10-06T01:41:51.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.204+0000 7fd6d1812700 1 -- 172.21.15.71:0/1174476104 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fd6ac066f30 msgr2=0x7fd6ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:51.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.204+0000 7fd6d1812700 1 --2- 172.21.15.71:0/1174476104 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fd6ac066f30 0x7fd6ac0693e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd6b4007fd0 tx=0x7fd6b4007d50 comp rx=0 tx=0).stop 2023-10-06T01:41:51.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.204+0000 7fd6d1812700 1 -- 172.21.15.71:0/1174476104 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6cc0b13f0 msgr2=0x7fd6cc0c6d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:51.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.204+0000 7fd6d1812700 1 --2- 172.21.15.71:0/1174476104 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6cc0b13f0 0x7fd6cc0c6d70 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc06f5e0 tx=0x7fd6bc016000 comp rx=0 tx=0).stop 2023-10-06T01:41:51.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.204+0000 7fd6d1812700 1 -- 172.21.15.71:0/1174476104 shutdown_connections 2023-10-06T01:41:51.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.204+0000 7fd6d1812700 1 --2- 172.21.15.71:0/1174476104 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd6cc1574b0 0x7fd6cc167cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:51.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.204+0000 7fd6d1812700 1 --2- 172.21.15.71:0/1174476104 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6cc0b13f0 0x7fd6cc0c6d70 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:51.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.204+0000 7fd6d1812700 1 --2- 172.21.15.71:0/1174476104 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fd6ac066f30 0x7fd6ac0693e0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:51.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.204+0000 7fd6d1812700 1 --2- 172.21.15.71:0/1174476104 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd6cc0c46e0 0x7fd6cc167780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:51.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.204+0000 7fd6d1812700 1 -- 172.21.15.71:0/1174476104 >> 172.21.15.71:0/1174476104 conn(0x7fd6cc067910 msgr2=0x7fd6cc152a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:51.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.204+0000 7fd6d1812700 1 -- 172.21.15.71:0/1174476104 shutdown_connections 2023-10-06T01:41:51.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.204+0000 7fd6d1812700 1 -- 172.21.15.71:0/1174476104 wait complete. 2023-10-06T01:41:51.216 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_auto_repair.TestMDSAutoRepair.test_backtrace_repair' 2023-10-06T01:41:51.331 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.330+0000 7f0d0a1ad700 1 Processor -- start 2023-10-06T01:41:51.331 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.330+0000 7f0d0a1ad700 1 -- start start 2023-10-06T01:41:51.333 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.331+0000 7f0d0a1ad700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0d040af4e0 0x7f0d040b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:51.333 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.331+0000 7f0d0a1ad700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0d040af8b0 0x7f0d040b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:51.333 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.331+0000 7f0d0a1ad700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f0d0415d460 0x7f0d0415d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:51.333 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.331+0000 7f0d0a1ad700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d040b1910 con 0x7f0d0415d460 2023-10-06T01:41:51.333 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.331+0000 7f0d0a1ad700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d0415e190 con 0x7f0d040af4e0 2023-10-06T01:41:51.333 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.331+0000 7f0d0a1ad700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d040cb650 con 0x7f0d040af8b0 2023-10-06T01:41:51.333 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.331+0000 7f0d03fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f0d0415d460 0x7f0d0415d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:51.334 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.331+0000 7f0d03fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f0d0415d460 0x7f0d0415d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50942/0 (socket says 172.21.15.71:50942) 2023-10-06T01:41:51.334 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.331+0000 7f0d03fff700 1 -- 172.21.15.71:0/3972242548 learned_addr learned my addr 172.21.15.71:0/3972242548 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:51.334 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.331+0000 7f0d03fff700 1 -- 172.21.15.71:0/3972242548 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0d040af8b0 msgr2=0x7f0d040b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:51.334 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.331+0000 7f0d03fff700 1 --2- 172.21.15.71:0/3972242548 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0d040af8b0 0x7f0d040b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:51.334 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.331+0000 7f0d03fff700 1 -- 172.21.15.71:0/3972242548 >> v2:172.21.15.72:3300/0 conn(0x7f0d040af4e0 msgr2=0x7f0d040b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:51.334 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.331+0000 7f0d03fff700 1 --2- 172.21.15.71:0/3972242548 >> v2:172.21.15.72:3300/0 conn(0x7f0d040af4e0 0x7f0d040b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:51.334 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.331+0000 7f0d03fff700 1 -- 172.21.15.71:0/3972242548 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d040b2b60 con 0x7f0d0415d460 2023-10-06T01:41:51.334 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.331+0000 7f0d03fff700 1 --2- 172.21.15.71:0/3972242548 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d0415d460 0x7f0d0415d8a0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f0d040d1360 tx=0x7f0cfc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=371d4357e7ec3b45 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:51.334 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.331+0000 7f0d027fc700 1 -- 172.21.15.71:0/3972242548 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cfc00e070 con 0x7f0d0415d460 2023-10-06T01:41:51.334 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.331+0000 7f0d027fc700 1 -- 172.21.15.71:0/3972242548 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cfc00ba50 con 0x7f0d0415d460 2023-10-06T01:41:51.334 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.331+0000 7f0d027fc700 1 -- 172.21.15.71:0/3972242548 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cfc0092e0 con 0x7f0d0415d460 2023-10-06T01:41:51.334 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.332+0000 7f0d0a1ad700 1 -- 172.21.15.71:0/3972242548 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d0415d460 msgr2=0x7f0d0415d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:51.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.332+0000 7f0d0a1ad700 1 --2- 172.21.15.71:0/3972242548 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d0415d460 0x7f0d0415d8a0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f0d040d1360 tx=0x7f0cfc009840 comp rx=0 tx=0).stop 2023-10-06T01:41:51.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.332+0000 7f0d0a1ad700 1 -- 172.21.15.71:0/3972242548 shutdown_connections 2023-10-06T01:41:51.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.332+0000 7f0d0a1ad700 1 --2- 172.21.15.71:0/3972242548 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d0415d460 0x7f0d0415d8a0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:51.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.332+0000 7f0d0a1ad700 1 --2- 172.21.15.71:0/3972242548 >> v2:172.21.15.72:3300/0 conn(0x7f0d040af4e0 0x7f0d040b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:51.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.332+0000 7f0d0a1ad700 1 --2- 172.21.15.71:0/3972242548 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0d040af8b0 0x7f0d040b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:51.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.332+0000 7f0d0a1ad700 1 -- 172.21.15.71:0/3972242548 >> 172.21.15.71:0/3972242548 conn(0x7f0d04068680 msgr2=0x7f0d04068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:51.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.332+0000 7f0d0a1ad700 1 -- 172.21.15.71:0/3972242548 shutdown_connections 2023-10-06T01:41:51.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.332+0000 7f0d0a1ad700 1 -- 172.21.15.71:0/3972242548 wait complete. 2023-10-06T01:41:51.338 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.333+0000 7f0d0a1ad700 1 Processor -- start 2023-10-06T01:41:51.338 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.333+0000 7f0d0a1ad700 1 -- start start 2023-10-06T01:41:51.338 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.334+0000 7f0d0a1ad700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0d040af4e0 0x7f0d04159ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:51.338 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.334+0000 7f0d0a1ad700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d040af8b0 0x7f0d040c9750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:51.338 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.334+0000 7f0d0a1ad700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d0415d460 0x7f0d040c9c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:51.338 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.334+0000 7f0d0a1ad700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0415a220 con 0x7f0d040af8b0 2023-10-06T01:41:51.338 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.334+0000 7f0d0a1ad700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0416ae40 con 0x7f0d0415d460 2023-10-06T01:41:51.338 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.334+0000 7f0d0a1ad700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d040c74a0 con 0x7f0d040af4e0 2023-10-06T01:41:51.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.334+0000 7f0d02ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d040af8b0 0x7f0d040c9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:51.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.334+0000 7f0d02ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d040af8b0 0x7f0d040c9750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50948/0 (socket says 172.21.15.71:50948) 2023-10-06T01:41:51.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.334+0000 7f0d02ffd700 1 -- 172.21.15.71:0/2113725005 learned_addr learned my addr 172.21.15.71:0/2113725005 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:51.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.334+0000 7f0d03fff700 1 --2- 172.21.15.71:0/2113725005 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d0415d460 0x7f0d040c9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:51.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.334+0000 7f0d037fe700 1 --2- 172.21.15.71:0/2113725005 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0d040af4e0 0x7f0d04159ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:51.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.334+0000 7f0d02ffd700 1 -- 172.21.15.71:0/2113725005 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0d040af4e0 msgr2=0x7f0d04159ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:51.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.334+0000 7f0d02ffd700 1 --2- 172.21.15.71:0/2113725005 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0d040af4e0 0x7f0d04159ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:51.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.334+0000 7f0d02ffd700 1 -- 172.21.15.71:0/2113725005 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d0415d460 msgr2=0x7f0d040c9c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:51.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.334+0000 7f0d02ffd700 1 --2- 172.21.15.71:0/2113725005 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d0415d460 0x7f0d040c9c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:51.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.334+0000 7f0d02ffd700 1 -- 172.21.15.71:0/2113725005 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cfc009ae0 con 0x7f0d040af8b0 2023-10-06T01:41:51.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.334+0000 7f0d037fe700 1 --2- 172.21.15.71:0/2113725005 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0d040af4e0 0x7f0d04159ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:41:51.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.334+0000 7f0d02ffd700 1 --2- 172.21.15.71:0/2113725005 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d040af8b0 0x7f0d040c9750 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f0cf800b810 tx=0x7f0cf80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:51.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.335+0000 7f0ceb7fe700 1 -- 172.21.15.71:0/2113725005 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf800f570 con 0x7f0d040af8b0 2023-10-06T01:41:51.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.335+0000 7f0ceb7fe700 1 -- 172.21.15.71:0/2113725005 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cf800f6f0 con 0x7f0d040af8b0 2023-10-06T01:41:51.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.335+0000 7f0d0a1ad700 1 -- 172.21.15.71:0/2113725005 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d040a9640 con 0x7f0d040af8b0 2023-10-06T01:41:51.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.335+0000 7f0ceb7fe700 1 -- 172.21.15.71:0/2113725005 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf800fab0 con 0x7f0d040af8b0 2023-10-06T01:41:51.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.335+0000 7f0d0a1ad700 1 -- 172.21.15.71:0/2113725005 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d040a9360 con 0x7f0d040af8b0 2023-10-06T01:41:51.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.336+0000 7f0d0a1ad700 1 -- 172.21.15.71:0/2113725005 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d040c7300 con 0x7f0d040af8b0 2023-10-06T01:41:51.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.336+0000 7f0ceb7fe700 1 -- 172.21.15.71:0/2113725005 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0cf801a460 con 0x7f0d040af8b0 2023-10-06T01:41:51.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.336+0000 7f0ceb7fe700 1 --2- 172.21.15.71:0/2113725005 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f0cf0066f30 0x7f0cf00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:51.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.336+0000 7f0ceb7fe700 1 -- 172.21.15.71:0/2113725005 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f0cf80841c0 con 0x7f0d040af8b0 2023-10-06T01:41:51.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.336+0000 7f0d037fe700 1 --2- 172.21.15.71:0/2113725005 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f0cf0066f30 0x7f0cf00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:51.340 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.337+0000 7f0d037fe700 1 --2- 172.21.15.71:0/2113725005 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f0cf0066f30 0x7f0cf00693e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f0d040b37b0 tx=0x7f0cf4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:51.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.340+0000 7f0ceb7fe700 1 -- 172.21.15.71:0/2113725005 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0d040c7300 con 0x7f0d040af8b0 2023-10-06T01:41:51.513 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T01:41:51.515 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T01:41:51.601 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.600+0000 7f0d0a1ad700 1 -- 172.21.15.71:0/2113725005 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_auto_repair.TestMDSAutoRepair.test_backtrace_repair"]} v 0) v1 -- 0x7f0d040c7300 con 0x7f0d040af8b0 2023-10-06T01:41:51.851 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.850+0000 7f0ceb7fe700 1 -- 172.21.15.71:0/2113725005 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_auto_repair.TestMDSAutoRepair.test_backtrace_repair"]}]=0 v101) v1 ==== 148+0+0 (secure 0 0 0) 0x7f0d040c7300 con 0x7f0d040af8b0 2023-10-06T01:41:51.853 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.852+0000 7f0d0a1ad700 1 -- 172.21.15.71:0/2113725005 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f0cf0066f30 msgr2=0x7f0cf00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:51.853 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.852+0000 7f0d0a1ad700 1 --2- 172.21.15.71:0/2113725005 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f0cf0066f30 0x7f0cf00693e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f0d040b37b0 tx=0x7f0cf4008040 comp rx=0 tx=0).stop 2023-10-06T01:41:51.853 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.852+0000 7f0d0a1ad700 1 -- 172.21.15.71:0/2113725005 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d040af8b0 msgr2=0x7f0d040c9750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:51.854 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.852+0000 7f0d0a1ad700 1 --2- 172.21.15.71:0/2113725005 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d040af8b0 0x7f0d040c9750 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f0cf800b810 tx=0x7f0cf80091d0 comp rx=0 tx=0).stop 2023-10-06T01:41:51.854 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.852+0000 7f0d0a1ad700 1 -- 172.21.15.71:0/2113725005 shutdown_connections 2023-10-06T01:41:51.854 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.852+0000 7f0d0a1ad700 1 --2- 172.21.15.71:0/2113725005 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f0cf0066f30 0x7f0cf00693e0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:51.854 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.852+0000 7f0d0a1ad700 1 --2- 172.21.15.71:0/2113725005 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d0415d460 0x7f0d040c9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:51.854 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.852+0000 7f0d0a1ad700 1 --2- 172.21.15.71:0/2113725005 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0d040af4e0 0x7f0d04159ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:51.854 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.852+0000 7f0d0a1ad700 1 --2- 172.21.15.71:0/2113725005 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d040af8b0 0x7f0d040c9750 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:51.854 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.852+0000 7f0d0a1ad700 1 -- 172.21.15.71:0/2113725005 >> 172.21.15.71:0/2113725005 conn(0x7f0d04068680 msgr2=0x7f0d04068a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:51.854 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.852+0000 7f0d0a1ad700 1 -- 172.21.15.71:0/2113725005 shutdown_connections 2023-10-06T01:41:51.854 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:51.852+0000 7f0d0a1ad700 1 -- 172.21.15.71:0/2113725005 wait complete. 2023-10-06T01:41:51.865 INFO:tasks.cephfs_test_runner:MDS should verify/fix backtrace on fetch dirfrag ... ok 2023-10-06T01:41:51.865 INFO:tasks.cephfs_test_runner:Starting test: test_mds_readonly (tasks.cephfs.test_auto_repair.TestMDSAutoRepair) test if MDS behave correct when it's readonly 2023-10-06T01:41:51.866 INFO:tasks.cephfs_test_runner:test_mds_readonly (tasks.cephfs.test_auto_repair.TestMDSAutoRepair) 2023-10-06T01:41:51.866 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_auto_repair.TestMDSAutoRepair.test_mds_readonly' 2023-10-06T01:41:52.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.018+0000 7f21c759e700 1 Processor -- start 2023-10-06T01:41:52.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.018+0000 7f21c759e700 1 -- start start 2023-10-06T01:41:52.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.019+0000 7f21c759e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21c8159400 0x7f21c80ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:52.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.019+0000 7f21c759e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f21c80cd030 0x7f21c80cfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:52.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.019+0000 7f21c759e700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f21c80cf1a0 0x7f21c80d0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:52.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.019+0000 7f21c759e700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21c80b3560 con 0x7f21c80cf1a0 2023-10-06T01:41:52.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.019+0000 7f21c759e700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21c80cf6f0 con 0x7f21c80cd030 2023-10-06T01:41:52.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.019+0000 7f21c759e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21c80cf9d0 con 0x7f21c8159400 2023-10-06T01:41:52.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.019+0000 7f21c6d9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f21c80cf1a0 0x7f21c80d0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:52.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.019+0000 7f21c6d9d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f21c80cf1a0 0x7f21c80d0400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50964/0 (socket says 172.21.15.71:50964) 2023-10-06T01:41:52.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.019+0000 7f21c6d9d700 1 -- 172.21.15.71:0/3887728054 learned_addr learned my addr 172.21.15.71:0/3887728054 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:52.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.019+0000 7f21c6d9d700 1 -- 172.21.15.71:0/3887728054 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21c8159400 msgr2=0x7f21c80ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:52.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.019+0000 7f21bdd9b700 1 --2- 172.21.15.71:0/3887728054 >> v2:172.21.15.72:3300/0 conn(0x7f21c80cd030 0x7f21c80cfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:52.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.019+0000 7f21c6d9d700 1 --2- 172.21.15.71:0/3887728054 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21c8159400 0x7f21c80ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:52.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.019+0000 7f21c6d9d700 1 -- 172.21.15.71:0/3887728054 >> v2:172.21.15.72:3300/0 conn(0x7f21c80cd030 msgr2=0x7f21c80cfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:52.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.020+0000 7f21c6d9d700 1 --2- 172.21.15.71:0/3887728054 >> v2:172.21.15.72:3300/0 conn(0x7f21c80cd030 0x7f21c80cfec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:52.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.020+0000 7f21c6d9d700 1 -- 172.21.15.71:0/3887728054 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21c80b2f10 con 0x7f21c80cf1a0 2023-10-06T01:41:52.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.020+0000 7f21bdd9b700 1 --2- 172.21.15.71:0/3887728054 >> v2:172.21.15.72:3300/0 conn(0x7f21c80cd030 0x7f21c80cfec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:41:52.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.020+0000 7f21c6d9d700 1 --2- 172.21.15.71:0/3887728054 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21c80cf1a0 0x7f21c80d0400 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f21c8067ec0 tx=0x7f21c0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4b86c2e7cadc718 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:52.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.020+0000 7f21c5d9b700 1 -- 172.21.15.71:0/3887728054 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c000e070 con 0x7f21c80cf1a0 2023-10-06T01:41:52.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.020+0000 7f21c5d9b700 1 -- 172.21.15.71:0/3887728054 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21c000ba50 con 0x7f21c80cf1a0 2023-10-06T01:41:52.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.020+0000 7f21c5d9b700 1 -- 172.21.15.71:0/3887728054 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c00092e0 con 0x7f21c80cf1a0 2023-10-06T01:41:52.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.020+0000 7f21c759e700 1 -- 172.21.15.71:0/3887728054 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21c80cf1a0 msgr2=0x7f21c80d0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:52.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.020+0000 7f21c759e700 1 --2- 172.21.15.71:0/3887728054 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21c80cf1a0 0x7f21c80d0400 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f21c8067ec0 tx=0x7f21c0009840 comp rx=0 tx=0).stop 2023-10-06T01:41:52.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.020+0000 7f21c759e700 1 -- 172.21.15.71:0/3887728054 shutdown_connections 2023-10-06T01:41:52.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.020+0000 7f21c759e700 1 --2- 172.21.15.71:0/3887728054 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21c80cf1a0 0x7f21c80d0400 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:52.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.020+0000 7f21c759e700 1 --2- 172.21.15.71:0/3887728054 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21c8159400 0x7f21c80ccaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:52.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.020+0000 7f21c759e700 1 --2- 172.21.15.71:0/3887728054 >> v2:172.21.15.72:3300/0 conn(0x7f21c80cd030 0x7f21c80cfec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:52.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.020+0000 7f21c759e700 1 -- 172.21.15.71:0/3887728054 >> 172.21.15.71:0/3887728054 conn(0x7f21c806ac10 msgr2=0x7f21c8068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:52.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.020+0000 7f21c759e700 1 -- 172.21.15.71:0/3887728054 shutdown_connections 2023-10-06T01:41:52.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.020+0000 7f21c759e700 1 -- 172.21.15.71:0/3887728054 wait complete. 2023-10-06T01:41:52.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.022+0000 7f21c759e700 1 Processor -- start 2023-10-06T01:41:52.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.022+0000 7f21c759e700 1 -- start start 2023-10-06T01:41:52.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.022+0000 7f21c759e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21c80cd030 0x7f21c816aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:52.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.022+0000 7f21c759e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21c80cf1a0 0x7f21c8154990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:52.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.022+0000 7f21c759e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21c8159400 0x7f21c80b4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:52.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.022+0000 7f21c759e700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c80c99b0 con 0x7f21c80cd030 2023-10-06T01:41:52.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.022+0000 7f21c759e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c816a6b0 con 0x7f21c80cf1a0 2023-10-06T01:41:52.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.022+0000 7f21c759e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21c80c9080 con 0x7f21c8159400 2023-10-06T01:41:52.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.022+0000 7f21c659c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21c80cd030 0x7f21c816aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:52.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.022+0000 7f21c659c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21c80cd030 0x7f21c816aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50980/0 (socket says 172.21.15.71:50980) 2023-10-06T01:41:52.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.022+0000 7f21c659c700 1 -- 172.21.15.71:0/1154661150 learned_addr learned my addr 172.21.15.71:0/1154661150 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:52.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.023+0000 7f21c659c700 1 -- 172.21.15.71:0/1154661150 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21c8159400 msgr2=0x7f21c80b4280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:52.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.023+0000 7f21c659c700 1 --2- 172.21.15.71:0/1154661150 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21c8159400 0x7f21c80b4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:52.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.023+0000 7f21c659c700 1 -- 172.21.15.71:0/1154661150 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21c80cf1a0 msgr2=0x7f21c8154990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:52.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.023+0000 7f21c659c700 1 --2- 172.21.15.71:0/1154661150 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21c80cf1a0 0x7f21c8154990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:52.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.023+0000 7f21c659c700 1 -- 172.21.15.71:0/1154661150 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21c0009ae0 con 0x7f21c80cd030 2023-10-06T01:41:52.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.023+0000 7f21c659c700 1 --2- 172.21.15.71:0/1154661150 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21c80cd030 0x7f21c816aa00 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f21b800b600 tx=0x7f21b80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:52.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.023+0000 7f21beffd700 1 -- 172.21.15.71:0/1154661150 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b800f510 con 0x7f21c80cd030 2023-10-06T01:41:52.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.023+0000 7f21beffd700 1 -- 172.21.15.71:0/1154661150 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21b800f690 con 0x7f21c80cd030 2023-10-06T01:41:52.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.023+0000 7f21c759e700 1 -- 172.21.15.71:0/1154661150 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21c80c9360 con 0x7f21c80cd030 2023-10-06T01:41:52.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.023+0000 7f21beffd700 1 -- 172.21.15.71:0/1154661150 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b800fa50 con 0x7f21c80cd030 2023-10-06T01:41:52.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.023+0000 7f21c759e700 1 -- 172.21.15.71:0/1154661150 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21c816af40 con 0x7f21c80cd030 2023-10-06T01:41:52.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.024+0000 7f21c759e700 1 -- 172.21.15.71:0/1154661150 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21c80b31f0 con 0x7f21c80cd030 2023-10-06T01:41:52.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.024+0000 7f21beffd700 1 -- 172.21.15.71:0/1154661150 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f21b801a400 con 0x7f21c80cd030 2023-10-06T01:41:52.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.025+0000 7f21beffd700 1 --2- 172.21.15.71:0/1154661150 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f21a8066f30 0x7f21a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:52.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.025+0000 7f21beffd700 1 -- 172.21.15.71:0/1154661150 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f21b8084090 con 0x7f21c80cd030 2023-10-06T01:41:52.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.025+0000 7f21bdd9b700 1 --2- 172.21.15.71:0/1154661150 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f21a8066f30 0x7f21a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:52.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.025+0000 7f21bdd9b700 1 --2- 172.21.15.71:0/1154661150 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f21a8066f30 0x7f21a80693e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f21c816cd90 tx=0x7f21b0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:52.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.029+0000 7f21beffd700 1 -- 172.21.15.71:0/1154661150 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f21b8051380 con 0x7f21c80cd030 2023-10-06T01:41:52.288 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.287+0000 7f21c759e700 1 -- 172.21.15.71:0/1154661150 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_auto_repair.TestMDSAutoRepair.test_mds_readonly"]} v 0) v1 -- 0x7f21c8068420 con 0x7f21c80cd030 2023-10-06T01:41:52.856 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.855+0000 7f21beffd700 1 -- 172.21.15.71:0/1154661150 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_auto_repair.TestMDSAutoRepair.test_mds_readonly"]}]=0 v102) v1 ==== 147+0+0 (secure 0 0 0) 0x7f21b80549a0 con 0x7f21c80cd030 2023-10-06T01:41:52.858 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.857+0000 7f21c759e700 1 -- 172.21.15.71:0/1154661150 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f21a8066f30 msgr2=0x7f21a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:52.858 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.857+0000 7f21c759e700 1 --2- 172.21.15.71:0/1154661150 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f21a8066f30 0x7f21a80693e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f21c816cd90 tx=0x7f21b0008040 comp rx=0 tx=0).stop 2023-10-06T01:41:52.859 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.857+0000 7f21c759e700 1 -- 172.21.15.71:0/1154661150 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21c80cd030 msgr2=0x7f21c816aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:52.859 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.857+0000 7f21c759e700 1 --2- 172.21.15.71:0/1154661150 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21c80cd030 0x7f21c816aa00 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f21b800b600 tx=0x7f21b80091a0 comp rx=0 tx=0).stop 2023-10-06T01:41:52.859 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.857+0000 7f21c759e700 1 -- 172.21.15.71:0/1154661150 shutdown_connections 2023-10-06T01:41:52.859 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.857+0000 7f21c759e700 1 --2- 172.21.15.71:0/1154661150 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f21c8159400 0x7f21c80b4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:52.859 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.857+0000 7f21c759e700 1 --2- 172.21.15.71:0/1154661150 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21c80cd030 0x7f21c816aa00 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:52.859 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.858+0000 7f21c759e700 1 --2- 172.21.15.71:0/1154661150 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f21a8066f30 0x7f21a80693e0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:52.859 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.858+0000 7f21c759e700 1 --2- 172.21.15.71:0/1154661150 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f21c80cf1a0 0x7f21c8154990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:52.859 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.858+0000 7f21c759e700 1 -- 172.21.15.71:0/1154661150 >> 172.21.15.71:0/1154661150 conn(0x7f21c806ac10 msgr2=0x7f21c81584d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:52.859 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.858+0000 7f21c759e700 1 -- 172.21.15.71:0/1154661150 shutdown_connections 2023-10-06T01:41:52.859 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.858+0000 7f21c759e700 1 -- 172.21.15.71:0/1154661150 wait complete. 2023-10-06T01:41:52.871 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-06T01:41:52.991 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.990+0000 7f05d759e700 1 Processor -- start 2023-10-06T01:41:52.991 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.990+0000 7f05d759e700 1 -- start start 2023-10-06T01:41:52.991 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.991+0000 7f05d759e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f05d80cd400 0x7f05d80b1f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:52.991 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.991+0000 7f05d759e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f05d80cd7d0 0x7f05d80b2460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:52.992 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.991+0000 7f05d759e700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05d80b29a0 con 0x7f05d80b0810 2023-10-06T01:41:52.992 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.991+0000 7f05d759e700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05d80af770 con 0x7f05d80cd7d0 2023-10-06T01:41:52.992 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.991+0000 7f05d759e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05d80afa50 con 0x7f05d80cd400 2023-10-06T01:41:52.993 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.991+0000 7f05cdd9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f05d80cd7d0 0x7f05d80b2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:52.993 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.991+0000 7f05d659c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f05d80cd400 0x7f05d80b1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:52.994 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.991+0000 7f05d659c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f05d80cd400 0x7f05d80b1f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.71:47698/0 (socket says 172.21.15.71:47698) 2023-10-06T01:41:52.994 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.991+0000 7f05cdd9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f05d80cd7d0 0x7f05d80b2460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:45562/0 (socket says 172.21.15.71:45562) 2023-10-06T01:41:52.994 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.991+0000 7f05d659c700 1 -- 172.21.15.71:0/510746399 learned_addr learned my addr 172.21.15.71:0/510746399 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:52.994 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.992+0000 7f05d659c700 1 -- 172.21.15.71:0/510746399 >> v2:172.21.15.72:3300/0 conn(0x7f05d80cd7d0 msgr2=0x7f05d80b2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:52.994 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.992+0000 7f05d659c700 1 --2- 172.21.15.71:0/510746399 >> v2:172.21.15.72:3300/0 conn(0x7f05d80cd7d0 0x7f05d80b2460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:52.994 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.992+0000 7f05d659c700 1 -- 172.21.15.71:0/510746399 >> v1:172.21.15.72:6789/0 conn(0x7f05d80b0810 legacy=0x7f05d80d01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:52.994 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.992+0000 7f05d659c700 1 -- 172.21.15.71:0/510746399 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05d80afd30 con 0x7f05d80cd400 2023-10-06T01:41:52.994 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.992+0000 7f05cdd9b700 1 --2- 172.21.15.71:0/510746399 >> v2:172.21.15.72:3300/0 conn(0x7f05d80cd7d0 0x7f05d80b2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:41:52.994 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.992+0000 7f05d659c700 1 --2- 172.21.15.71:0/510746399 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f05d80cd400 0x7f05d80b1f20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f05c8009990 tx=0x7f05c8009220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba16da74fc67d0e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:52.994 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.992+0000 7f05d5d9b700 1 -- 172.21.15.71:0/510746399 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c8009e80 con 0x7f05d80cd400 2023-10-06T01:41:52.995 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.992+0000 7f05d5d9b700 1 -- 172.21.15.71:0/510746399 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05c8005c10 con 0x7f05d80cd400 2023-10-06T01:41:52.995 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.992+0000 7f05d5d9b700 1 -- 172.21.15.71:0/510746399 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c800b650 con 0x7f05d80cd400 2023-10-06T01:41:52.995 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.992+0000 7f05d759e700 1 -- 172.21.15.71:0/510746399 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f05d80cd400 msgr2=0x7f05d80b1f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:52.995 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.992+0000 7f05d759e700 1 --2- 172.21.15.71:0/510746399 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f05d80cd400 0x7f05d80b1f20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f05c8009990 tx=0x7f05c8009220 comp rx=0 tx=0).stop 2023-10-06T01:41:52.995 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.993+0000 7f05d759e700 1 -- 172.21.15.71:0/510746399 shutdown_connections 2023-10-06T01:41:52.995 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.993+0000 7f05d759e700 1 --2- 172.21.15.71:0/510746399 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f05d80cd400 0x7f05d80b1f20 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:52.995 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.993+0000 7f05d759e700 1 --2- 172.21.15.71:0/510746399 >> v2:172.21.15.72:3300/0 conn(0x7f05d80cd7d0 0x7f05d80b2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:52.995 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.993+0000 7f05d759e700 1 -- 172.21.15.71:0/510746399 >> 172.21.15.71:0/510746399 conn(0x7f05d806a110 msgr2=0x7f05d806a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:52.995 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.993+0000 7f05d759e700 1 -- 172.21.15.71:0/510746399 shutdown_connections 2023-10-06T01:41:52.995 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.993+0000 7f05d759e700 1 -- 172.21.15.71:0/510746399 wait complete. 2023-10-06T01:41:52.997 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.994+0000 7f05d759e700 1 Processor -- start 2023-10-06T01:41:52.997 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.994+0000 7f05d759e700 1 -- start start 2023-10-06T01:41:52.997 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.995+0000 7f05d759e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05d80b0810 0x7f05d8154c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:52.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.995+0000 7f05d759e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f05d80cd400 0x7f05d8169f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:52.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.995+0000 7f05d759e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05d8155140 0x7f05d815dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:52.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.995+0000 7f05d759e700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05d816db50 con 0x7f05d8155140 2023-10-06T01:41:52.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.995+0000 7f05d759e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05d816cf40 con 0x7f05d80b0810 2023-10-06T01:41:52.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.995+0000 7f05d759e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05d816d220 con 0x7f05d80cd400 2023-10-06T01:41:52.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.995+0000 7f05d6d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05d8155140 0x7f05d815dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:52.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.995+0000 7f05cdd9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f05d80cd400 0x7f05d8169f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:52.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.995+0000 7f05d6d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05d8155140 0x7f05d815dd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50982/0 (socket says 172.21.15.71:50982) 2023-10-06T01:41:52.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.995+0000 7f05d659c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05d80b0810 0x7f05d8154c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:52.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.995+0000 7f05d6d9d700 1 -- 172.21.15.71:0/1236736042 learned_addr learned my addr 172.21.15.71:0/1236736042 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:52.998 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.995+0000 7f05d6d9d700 1 -- 172.21.15.71:0/1236736042 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f05d80cd400 msgr2=0x7f05d8169f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:52.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.995+0000 7f05d6d9d700 1 --2- 172.21.15.71:0/1236736042 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f05d80cd400 0x7f05d8169f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:52.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.995+0000 7f05d6d9d700 1 -- 172.21.15.71:0/1236736042 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05d80b0810 msgr2=0x7f05d8154c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:52.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.995+0000 7f05d6d9d700 1 --2- 172.21.15.71:0/1236736042 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05d80b0810 0x7f05d8154c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:52.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.995+0000 7f05d6d9d700 1 -- 172.21.15.71:0/1236736042 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05c0009420 con 0x7f05d8155140 2023-10-06T01:41:52.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.995+0000 7f05d659c700 1 --2- 172.21.15.71:0/1236736042 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05d80b0810 0x7f05d8154c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:41:52.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.995+0000 7f05d6d9d700 1 --2- 172.21.15.71:0/1236736042 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05d8155140 0x7f05d815dd20 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f05d000c840 tx=0x7f05d0001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:52.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.995+0000 7f05ceffd700 1 -- 172.21.15.71:0/1236736042 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d0012630 con 0x7f05d8155140 2023-10-06T01:41:52.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.995+0000 7f05ceffd700 1 -- 172.21.15.71:0/1236736042 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05d00127b0 con 0x7f05d8155140 2023-10-06T01:41:52.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.995+0000 7f05d759e700 1 -- 172.21.15.71:0/1236736042 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05c8009480 con 0x7f05d8155140 2023-10-06T01:41:52.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.995+0000 7f05ceffd700 1 -- 172.21.15.71:0/1236736042 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d0012b70 con 0x7f05d8155140 2023-10-06T01:41:52.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.996+0000 7f05d759e700 1 -- 172.21.15.71:0/1236736042 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05d816d7e0 con 0x7f05d8155140 2023-10-06T01:41:52.999 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.996+0000 7f05d759e700 1 -- 172.21.15.71:0/1236736042 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05d80b1240 con 0x7f05d8155140 2023-10-06T01:41:53.000 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.997+0000 7f05ceffd700 1 -- 172.21.15.71:0/1236736042 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f05d001a3a0 con 0x7f05d8155140 2023-10-06T01:41:53.000 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.997+0000 7f05ceffd700 1 --2- 172.21.15.71:0/1236736042 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f05b8066f30 0x7f05b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:53.000 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.997+0000 7f05ceffd700 1 -- 172.21.15.71:0/1236736042 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f05d00844f0 con 0x7f05d8155140 2023-10-06T01:41:53.000 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.997+0000 7f05d659c700 1 --2- 172.21.15.71:0/1236736042 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f05b8066f30 0x7f05b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:53.001 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:52.998+0000 7f05d659c700 1 --2- 172.21.15.71:0/1236736042 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f05b8066f30 0x7f05b80693e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f05c8007fd0 tx=0x7f05c8016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:53.002 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.001+0000 7f05ceffd700 1 -- 172.21.15.71:0/1236736042 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f05d00516c0 con 0x7f05d8155140 2023-10-06T01:41:53.186 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.185+0000 7f05d759e700 1 -- 172.21.15.71:0/1236736042 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f05d80b29a0 con 0x7f05d8155140 2023-10-06T01:41:53.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.191+0000 7f05ceffd700 1 -- 172.21.15.71:0/1236736042 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7f05d80b29a0 con 0x7f05d8155140 2023-10-06T01:41:53.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.193+0000 7f05d759e700 1 -- 172.21.15.71:0/1236736042 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f05b8066f30 msgr2=0x7f05b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:53.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.193+0000 7f05d759e700 1 --2- 172.21.15.71:0/1236736042 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f05b8066f30 0x7f05b80693e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f05c8007fd0 tx=0x7f05c8016000 comp rx=0 tx=0).stop 2023-10-06T01:41:53.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.193+0000 7f05d759e700 1 -- 172.21.15.71:0/1236736042 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05d8155140 msgr2=0x7f05d815dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:53.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.193+0000 7f05d759e700 1 --2- 172.21.15.71:0/1236736042 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05d8155140 0x7f05d815dd20 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f05d000c840 tx=0x7f05d0001670 comp rx=0 tx=0).stop 2023-10-06T01:41:53.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.193+0000 7f05d759e700 1 -- 172.21.15.71:0/1236736042 shutdown_connections 2023-10-06T01:41:53.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.193+0000 7f05d759e700 1 --2- 172.21.15.71:0/1236736042 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05d8155140 0x7f05d815dd20 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:53.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.193+0000 7f05d759e700 1 --2- 172.21.15.71:0/1236736042 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f05b8066f30 0x7f05b80693e0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:53.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.193+0000 7f05d759e700 1 --2- 172.21.15.71:0/1236736042 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05d80b0810 0x7f05d8154c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:53.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.193+0000 7f05d759e700 1 --2- 172.21.15.71:0/1236736042 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f05d80cd400 0x7f05d8169f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:53.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.193+0000 7f05d759e700 1 -- 172.21.15.71:0/1236736042 >> 172.21.15.71:0/1236736042 conn(0x7f05d806a110 msgr2=0x7f05d814f840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:53.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.193+0000 7f05d759e700 1 -- 172.21.15.71:0/1236736042 shutdown_connections 2023-10-06T01:41:53.195 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.193+0000 7f05d759e700 1 -- 172.21.15.71:0/1236736042 wait complete. 2023-10-06T01:41:53.206 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T01:41:53.206 DEBUG:teuthology.orchestra.run.smithi071:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T01:41:53.245 DEBUG:teuthology.orchestra.run.smithi072:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T01:41:53.290 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T01:41:53.290 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-06T01:41:53.291 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T01:41:53.403 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.403+0000 7f23595b3700 1 Processor -- start 2023-10-06T01:41:53.404 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.403+0000 7f23595b3700 1 -- start start 2023-10-06T01:41:53.406 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.404+0000 7f23595b3700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f23540b27f0 0x7f235415db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:53.406 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.404+0000 7f23595b3700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f235415e190 con 0x7f23540af8b0 2023-10-06T01:41:53.406 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.404+0000 7f23595b3700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23540cb650 con 0x7f23540af4e0 2023-10-06T01:41:53.406 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.404+0000 7f23595b3700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23540b1910 con 0x7f23540b27f0 2023-10-06T01:41:53.406 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.404+0000 7f23537fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f23540b27f0 0x7f235415db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:53.406 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.404+0000 7f23537fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f23540b27f0 0x7f235415db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:50998/0 (socket says 172.21.15.71:50998) 2023-10-06T01:41:53.406 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.404+0000 7f23537fe700 1 -- 172.21.15.71:0/1930342187 learned_addr learned my addr 172.21.15.71:0/1930342187 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:53.406 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.404+0000 7f23527fc700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f23540af8b0 0x7f235415d460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:49660/0 (socket says 172.21.15.71:49660) 2023-10-06T01:41:53.407 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.404+0000 7f23537fe700 1 -- 172.21.15.71:0/1930342187 >> v1:172.21.15.72:6789/0 conn(0x7f23540af4e0 legacy=0x7f23540b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:53.407 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.404+0000 7f23537fe700 1 -- 172.21.15.71:0/1930342187 >> v1:172.21.15.71:6789/0 conn(0x7f23540af8b0 legacy=0x7f235415d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:53.407 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.404+0000 7f2351ffb700 1 -- 172.21.15.71:0/1930342187 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 186986426 0 0) 0x7f235415e190 con 0x7f23540af8b0 2023-10-06T01:41:53.407 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.404+0000 7f23537fe700 1 -- 172.21.15.71:0/1930342187 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23540ccaf0 con 0x7f23540b27f0 2023-10-06T01:41:53.407 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.404+0000 7f23537fe700 1 --2- 172.21.15.71:0/1930342187 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f23540b27f0 0x7f235415db70 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f2344009f20 tx=0x7f2344009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8aef2f180e3f3efe server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:53.407 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.404+0000 7f2351ffb700 1 -- 172.21.15.71:0/1930342187 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f234400e070 con 0x7f23540b27f0 2023-10-06T01:41:53.407 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.404+0000 7f2351ffb700 1 -- 172.21.15.71:0/1930342187 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f234400ba40 con 0x7f23540b27f0 2023-10-06T01:41:53.407 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.404+0000 7f2351ffb700 1 -- 172.21.15.71:0/1930342187 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23440092e0 con 0x7f23540b27f0 2023-10-06T01:41:53.407 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.405+0000 7f23595b3700 1 -- 172.21.15.71:0/1930342187 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f23540b27f0 msgr2=0x7f235415db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:53.407 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.405+0000 7f23595b3700 1 --2- 172.21.15.71:0/1930342187 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f23540b27f0 0x7f235415db70 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f2344009f20 tx=0x7f2344009840 comp rx=0 tx=0).stop 2023-10-06T01:41:53.407 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.405+0000 7f23595b3700 1 -- 172.21.15.71:0/1930342187 shutdown_connections 2023-10-06T01:41:53.408 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.405+0000 7f23595b3700 1 --2- 172.21.15.71:0/1930342187 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f23540b27f0 0x7f235415db70 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:53.408 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.405+0000 7f23595b3700 1 -- 172.21.15.71:0/1930342187 >> 172.21.15.71:0/1930342187 conn(0x7f2354068680 msgr2=0x7f2354068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:53.408 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.405+0000 7f23595b3700 1 -- 172.21.15.71:0/1930342187 shutdown_connections 2023-10-06T01:41:53.408 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.405+0000 7f23595b3700 1 -- 172.21.15.71:0/1930342187 wait complete. 2023-10-06T01:41:53.410 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.406+0000 7f23595b3700 1 Processor -- start 2023-10-06T01:41:53.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.406+0000 7f23595b3700 1 -- start start 2023-10-06T01:41:53.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.407+0000 7f23595b3700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f23540af4e0 0x7f235416ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:53.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.407+0000 7f23595b3700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23540af8b0 0x7f235416a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:53.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.407+0000 7f23595b3700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f23540b27f0 0x7f23540c8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:53.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.407+0000 7f23595b3700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23540c89c0 con 0x7f23540af4e0 2023-10-06T01:41:53.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.407+0000 7f23595b3700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23540c9490 con 0x7f23540af8b0 2023-10-06T01:41:53.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.407+0000 7f23595b3700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2354153150 con 0x7f23540b27f0 2023-10-06T01:41:53.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.407+0000 7f2352ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f23540af4e0 0x7f235416ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:53.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.407+0000 7f2352ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f23540af4e0 0x7f235416ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51012/0 (socket says 172.21.15.71:51012) 2023-10-06T01:41:53.411 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.407+0000 7f2352ffd700 1 -- 172.21.15.71:0/1237649737 learned_addr learned my addr 172.21.15.71:0/1237649737 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:53.412 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.407+0000 7f23527fc700 1 --2- 172.21.15.71:0/1237649737 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23540af8b0 0x7f235416a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:53.412 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.407+0000 7f23537fe700 1 --2- 172.21.15.71:0/1237649737 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f23540b27f0 0x7f23540c8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:53.412 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.407+0000 7f2352ffd700 1 -- 172.21.15.71:0/1237649737 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f23540b27f0 msgr2=0x7f23540c8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:53.412 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.407+0000 7f2352ffd700 1 --2- 172.21.15.71:0/1237649737 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f23540b27f0 0x7f23540c8480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:53.412 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.407+0000 7f2352ffd700 1 -- 172.21.15.71:0/1237649737 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23540af8b0 msgr2=0x7f235416a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:53.412 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.407+0000 7f2352ffd700 1 --2- 172.21.15.71:0/1237649737 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23540af8b0 0x7f235416a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:53.412 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.407+0000 7f2352ffd700 1 -- 172.21.15.71:0/1237649737 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2344009ae0 con 0x7f23540af4e0 2023-10-06T01:41:53.412 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.407+0000 7f2352ffd700 1 --2- 172.21.15.71:0/1237649737 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f23540af4e0 0x7f235416ac30 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f234c00c600 tx=0x7f234c007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:53.412 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.407+0000 7f234affd700 1 -- 172.21.15.71:0/1237649737 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f234c011590 con 0x7f23540af4e0 2023-10-06T01:41:53.412 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.407+0000 7f234affd700 1 -- 172.21.15.71:0/1237649737 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f234c011710 con 0x7f23540af4e0 2023-10-06T01:41:53.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.407+0000 7f23595b3700 1 -- 172.21.15.71:0/1237649737 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23540c8bf0 con 0x7f23540af4e0 2023-10-06T01:41:53.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.407+0000 7f234affd700 1 -- 172.21.15.71:0/1237649737 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f234c011ad0 con 0x7f23540af4e0 2023-10-06T01:41:53.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.408+0000 7f23595b3700 1 -- 172.21.15.71:0/1237649737 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23540c91b0 con 0x7f23540af4e0 2023-10-06T01:41:53.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.408+0000 7f23595b3700 1 -- 172.21.15.71:0/1237649737 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2354088aa0 con 0x7f23540af4e0 2023-10-06T01:41:53.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.409+0000 7f234affd700 1 -- 172.21.15.71:0/1237649737 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f234c01c460 con 0x7f23540af4e0 2023-10-06T01:41:53.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.409+0000 7f234affd700 1 --2- 172.21.15.71:0/1237649737 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f2334066f30 0x7f23340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:53.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.409+0000 7f234affd700 1 -- 172.21.15.71:0/1237649737 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f234c084290 con 0x7f23540af4e0 2023-10-06T01:41:53.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.409+0000 7f23527fc700 1 --2- 172.21.15.71:0/1237649737 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f2334066f30 0x7f23340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:53.413 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.410+0000 7f23527fc700 1 --2- 172.21.15.71:0/1237649737 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f2334066f30 0x7f23340693e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2354154fe0 tx=0x7f233c007d50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:53.414 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.414+0000 7f234affd700 1 -- 172.21.15.71:0/1237649737 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f234c051500 con 0x7f23540af4e0 2023-10-06T01:41:53.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.639+0000 7f23595b3700 1 -- 172.21.15.71:0/1237649737 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2354152f20 con 0x7f23540af4e0 2023-10-06T01:41:53.640 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.640+0000 7f234affd700 1 -- 172.21.15.71:0/1237649737 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+3526 (secure 0 0 0) 0x7f234c054b20 con 0x7f23540af4e0 2023-10-06T01:41:53.641 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:41:53.641 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":25,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4889,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6834/1688339815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":1688339815},{"type":"v1","addr":"172.21.15.72:6834","nonce":1688339815}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5020,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/2765166441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6833","nonce":2765166441},{"type":"v1","addr":"172.21.15.72:6835","nonce":2765166441}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5145,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6836/1993673980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":1993673980},{"type":"v1","addr":"172.21.15.71:6836","nonce":1993673980}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5517,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/476294526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6835","nonce":476294526},{"type":"v1","addr":"172.21.15.71:6837","nonce":476294526}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[]} 2023-10-06T01:41:53.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.642+0000 7f23595b3700 1 -- 172.21.15.71:0/1237649737 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f2334066f30 msgr2=0x7f23340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:53.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.642+0000 7f23595b3700 1 --2- 172.21.15.71:0/1237649737 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f2334066f30 0x7f23340693e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2354154fe0 tx=0x7f233c007d50 comp rx=0 tx=0).stop 2023-10-06T01:41:53.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.642+0000 7f23595b3700 1 -- 172.21.15.71:0/1237649737 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f23540af4e0 msgr2=0x7f235416ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:53.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.642+0000 7f23595b3700 1 --2- 172.21.15.71:0/1237649737 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f23540af4e0 0x7f235416ac30 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f234c00c600 tx=0x7f234c007f60 comp rx=0 tx=0).stop 2023-10-06T01:41:53.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.642+0000 7f23595b3700 1 -- 172.21.15.71:0/1237649737 shutdown_connections 2023-10-06T01:41:53.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.642+0000 7f23595b3700 1 --2- 172.21.15.71:0/1237649737 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f23540b27f0 0x7f23540c8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:53.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.642+0000 7f23595b3700 1 --2- 172.21.15.71:0/1237649737 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f23540af4e0 0x7f235416ac30 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:53.643 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.642+0000 7f23595b3700 1 --2- 172.21.15.71:0/1237649737 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f2334066f30 0x7f23340693e0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:53.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.642+0000 7f23595b3700 1 --2- 172.21.15.71:0/1237649737 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23540af8b0 0x7f235416a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:53.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.642+0000 7f23595b3700 1 -- 172.21.15.71:0/1237649737 >> 172.21.15.71:0/1237649737 conn(0x7f2354068680 msgr2=0x7f23540afde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:53.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.642+0000 7f23595b3700 1 -- 172.21.15.71:0/1237649737 shutdown_connections 2023-10-06T01:41:53.644 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.642+0000 7f23595b3700 1 -- 172.21.15.71:0/1237649737 wait complete. 2023-10-06T01:41:53.644 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 25 2023-10-06T01:41:53.655 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T01:41:53.655 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-06T01:41:53.655 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T01:41:53.655 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T01:41:53.656 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T01:41:53.656 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-06T01:41:53.656 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T01:41:53.656 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T01:41:53.656 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T01:41:53.656 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-06T01:41:53.657 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T01:41:53.657 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T01:41:53.657 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T01:41:53.657 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-06T01:41:53.657 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T01:41:53.657 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T01:41:53.664 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T01:41:53.664 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T01:41:53.665 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T01:41:53.665 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T01:41:53.668 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T01:41:53.668 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T01:41:53.668 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T01:41:53.669 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T01:41:53.707 INFO:tasks.ceph.mds.a:Started 2023-10-06T01:41:53.707 DEBUG:teuthology.parallel:result is None 2023-10-06T01:41:53.708 INFO:tasks.ceph.mds.c:Started 2023-10-06T01:41:53.708 DEBUG:teuthology.parallel:result is None 2023-10-06T01:41:53.710 INFO:tasks.ceph.mds.b:Started 2023-10-06T01:41:53.710 DEBUG:teuthology.parallel:result is None 2023-10-06T01:41:53.710 INFO:tasks.ceph.mds.d:Started 2023-10-06T01:41:53.711 DEBUG:teuthology.parallel:result is None 2023-10-06T01:41:53.711 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-06T01:41:53.778 INFO:tasks.ceph.mds.c.smithi071.stdout:starting mds.c at 2023-10-06T01:41:53.779 INFO:tasks.ceph.mds.a.smithi071.stdout:starting mds.a at 2023-10-06T01:41:53.790 INFO:tasks.ceph.mds.d.smithi072.stdout:starting mds.d at 2023-10-06T01:41:53.791 INFO:tasks.ceph.mds.b.smithi072.stdout:starting mds.b at 2023-10-06T01:41:53.833 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.832+0000 7f1435bfe700 1 Processor -- start 2023-10-06T01:41:53.833 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.832+0000 7f1435bfe700 1 -- start start 2023-10-06T01:41:53.835 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.833+0000 7f1435bfe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f1430157d40 0x7f1430158110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:53.835 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.833+0000 7f1435bfe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1430068680 0x7f1430068b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:53.835 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.833+0000 7f1435bfe700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14300c8ad0 con 0x7f143006c210 2023-10-06T01:41:53.835 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.833+0000 7f1435bfe700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1430069040 con 0x7f1430157d40 2023-10-06T01:41:53.835 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.833+0000 7f1435bfe700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f143006b730 con 0x7f1430068680 2023-10-06T01:41:53.836 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.833+0000 7f142f7fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f1430157d40 0x7f1430158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:53.836 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.833+0000 7f142f7fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f1430157d40 0x7f1430158110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51068/0 (socket says 172.21.15.71:51068) 2023-10-06T01:41:53.836 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.833+0000 7f142f7fe700 1 -- 172.21.15.71:0/738711385 learned_addr learned my addr 172.21.15.71:0/738711385 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:53.836 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.833+0000 7f142ffff700 1 --2- 172.21.15.71:0/738711385 >> v2:172.21.15.72:3300/0 conn(0x7f1430068680 0x7f1430068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:53.836 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.833+0000 7f142f7fe700 1 -- 172.21.15.71:0/738711385 >> v2:172.21.15.72:3300/0 conn(0x7f1430068680 msgr2=0x7f1430068b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:53.836 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.833+0000 7f142f7fe700 1 --2- 172.21.15.71:0/738711385 >> v2:172.21.15.72:3300/0 conn(0x7f1430068680 0x7f1430068b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:53.836 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.833+0000 7f142f7fe700 1 -- 172.21.15.71:0/738711385 >> v1:172.21.15.72:6789/0 conn(0x7f143006c210 legacy=0x7f14300c8010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:53.836 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.833+0000 7f142f7fe700 1 -- 172.21.15.71:0/738711385 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f143006ba10 con 0x7f1430157d40 2023-10-06T01:41:53.836 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.833+0000 7f142f7fe700 1 --2- 172.21.15.71:0/738711385 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1430157d40 0x7f1430158110 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f14300c8ee0 tx=0x7f1420009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60b395795967cb69 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:53.836 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.834+0000 7f142effd700 1 -- 172.21.15.71:0/738711385 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1420009e70 con 0x7f1430157d40 2023-10-06T01:41:53.836 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.834+0000 7f142effd700 1 -- 172.21.15.71:0/738711385 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f142000b860 con 0x7f1430157d40 2023-10-06T01:41:53.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.834+0000 7f142effd700 1 -- 172.21.15.71:0/738711385 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142000bc00 con 0x7f1430157d40 2023-10-06T01:41:53.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.834+0000 7f1435bfe700 1 -- 172.21.15.71:0/738711385 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1430157d40 msgr2=0x7f1430158110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:53.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.834+0000 7f1435bfe700 1 --2- 172.21.15.71:0/738711385 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1430157d40 0x7f1430158110 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f14300c8ee0 tx=0x7f1420009250 comp rx=0 tx=0).stop 2023-10-06T01:41:53.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.834+0000 7f1435bfe700 1 -- 172.21.15.71:0/738711385 shutdown_connections 2023-10-06T01:41:53.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.834+0000 7f1435bfe700 1 --2- 172.21.15.71:0/738711385 >> v2:172.21.15.72:3300/0 conn(0x7f1430068680 0x7f1430068b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:53.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.834+0000 7f1435bfe700 1 --2- 172.21.15.71:0/738711385 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1430157d40 0x7f1430158110 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:53.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.834+0000 7f1435bfe700 1 -- 172.21.15.71:0/738711385 >> 172.21.15.71:0/738711385 conn(0x7f143006a260 msgr2=0x7f14300cd030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:53.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.834+0000 7f1435bfe700 1 -- 172.21.15.71:0/738711385 shutdown_connections 2023-10-06T01:41:53.837 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.834+0000 7f1435bfe700 1 -- 172.21.15.71:0/738711385 wait complete. 2023-10-06T01:41:53.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.835+0000 7f1435bfe700 1 Processor -- start 2023-10-06T01:41:53.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.836+0000 7f1435bfe700 1 -- start start 2023-10-06T01:41:53.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.836+0000 7f1435bfe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1430068680 0x7f1430154ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:53.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.836+0000 7f1435bfe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f143006c210 0x7f143014f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:53.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.836+0000 7f1435bfe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1430157d40 0x7f143014da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:53.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.836+0000 7f1435bfe700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14300b0da0 con 0x7f143006c210 2023-10-06T01:41:53.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.836+0000 7f1435bfe700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f143014f9a0 con 0x7f1430068680 2023-10-06T01:41:53.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.836+0000 7f1435bfe700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f143014fc20 con 0x7f1430157d40 2023-10-06T01:41:53.840 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.836+0000 7f1426ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f143006c210 0x7f143014f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:53.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.836+0000 7f1426ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f143006c210 0x7f143014f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51082/0 (socket says 172.21.15.71:51082) 2023-10-06T01:41:53.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.836+0000 7f1426ffd700 1 -- 172.21.15.71:0/3207459523 learned_addr learned my addr 172.21.15.71:0/3207459523 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:53.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.836+0000 7f142ffff700 1 --2- 172.21.15.71:0/3207459523 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1430157d40 0x7f143014da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:53.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.836+0000 7f142f7fe700 1 --2- 172.21.15.71:0/3207459523 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1430068680 0x7f1430154ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:53.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.837+0000 7f1426ffd700 1 -- 172.21.15.71:0/3207459523 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1430157d40 msgr2=0x7f143014da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:53.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.837+0000 7f1426ffd700 1 --2- 172.21.15.71:0/3207459523 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1430157d40 0x7f143014da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:53.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.837+0000 7f1426ffd700 1 -- 172.21.15.71:0/3207459523 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1430068680 msgr2=0x7f1430154ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:53.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.837+0000 7f1426ffd700 1 --2- 172.21.15.71:0/3207459523 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1430068680 0x7f1430154ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:53.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.837+0000 7f1426ffd700 1 -- 172.21.15.71:0/3207459523 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14200094f0 con 0x7f143006c210 2023-10-06T01:41:53.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.837+0000 7f142f7fe700 1 --2- 172.21.15.71:0/3207459523 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1430068680 0x7f1430154ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:41:53.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.837+0000 7f1426ffd700 1 --2- 172.21.15.71:0/3207459523 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f143006c210 0x7f143014f460 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f141800c790 tx=0x7f1418007f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:53.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.837+0000 7f1427fff700 1 -- 172.21.15.71:0/3207459523 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1418011590 con 0x7f143006c210 2023-10-06T01:41:53.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.837+0000 7f1427fff700 1 -- 172.21.15.71:0/3207459523 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14180116f0 con 0x7f143006c210 2023-10-06T01:41:53.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.837+0000 7f1427fff700 1 -- 172.21.15.71:0/3207459523 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1418011ab0 con 0x7f143006c210 2023-10-06T01:41:53.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.837+0000 7f1435bfe700 1 -- 172.21.15.71:0/3207459523 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f143014ff00 con 0x7f143006c210 2023-10-06T01:41:53.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.837+0000 7f1435bfe700 1 -- 172.21.15.71:0/3207459523 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14300b0ff0 con 0x7f143006c210 2023-10-06T01:41:53.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.838+0000 7f1435bfe700 1 -- 172.21.15.71:0/3207459523 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14300b1210 con 0x7f143006c210 2023-10-06T01:41:53.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.838+0000 7f1427fff700 1 -- 172.21.15.71:0/3207459523 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f141801b3b0 con 0x7f143006c210 2023-10-06T01:41:53.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.839+0000 7f1427fff700 1 --2- 172.21.15.71:0/3207459523 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f1410066f30 0x7f14100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:53.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.839+0000 7f1427fff700 1 -- 172.21.15.71:0/3207459523 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f1418083970 con 0x7f143006c210 2023-10-06T01:41:53.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.839+0000 7f142f7fe700 1 --2- 172.21.15.71:0/3207459523 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f1410066f30 0x7f14100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:53.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.839+0000 7f142f7fe700 1 --2- 172.21.15.71:0/3207459523 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f1410066f30 0x7f14100693e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f14300c8ee0 tx=0x7f1420017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:53.843 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:53.843+0000 7f1427fff700 1 -- 172.21.15.71:0/3207459523 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1418050be0 con 0x7f143006c210 2023-10-06T01:41:54.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:54.043+0000 7f1435bfe700 1 -- 172.21.15.71:0/3207459523 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f143006bcf0 con 0x7f143006c210 2023-10-06T01:41:54.886 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:54.885+0000 7f1427fff700 1 -- 172.21.15.71:0/3207459523 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v50) v1 ==== 97+0+0 (secure 0 0 0) 0x7f1418017020 con 0x7f143006c210 2023-10-06T01:41:54.888 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:54.887+0000 7f1435bfe700 1 -- 172.21.15.71:0/3207459523 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f1410066f30 msgr2=0x7f14100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:54.889 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:54.887+0000 7f1435bfe700 1 --2- 172.21.15.71:0/3207459523 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f1410066f30 0x7f14100693e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f14300c8ee0 tx=0x7f1420017000 comp rx=0 tx=0).stop 2023-10-06T01:41:54.889 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:54.887+0000 7f1435bfe700 1 -- 172.21.15.71:0/3207459523 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f143006c210 msgr2=0x7f143014f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:54.889 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:54.887+0000 7f1435bfe700 1 --2- 172.21.15.71:0/3207459523 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f143006c210 0x7f143014f460 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f141800c790 tx=0x7f1418007f20 comp rx=0 tx=0).stop 2023-10-06T01:41:54.889 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:54.887+0000 7f1435bfe700 1 -- 172.21.15.71:0/3207459523 shutdown_connections 2023-10-06T01:41:54.889 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:54.887+0000 7f1435bfe700 1 --2- 172.21.15.71:0/3207459523 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1430157d40 0x7f143014da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:54.889 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:54.887+0000 7f1435bfe700 1 --2- 172.21.15.71:0/3207459523 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f1410066f30 0x7f14100693e0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:54.889 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:54.887+0000 7f1435bfe700 1 --2- 172.21.15.71:0/3207459523 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1430068680 0x7f1430154ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:54.889 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:54.887+0000 7f1435bfe700 1 --2- 172.21.15.71:0/3207459523 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f143006c210 0x7f143014f460 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:54.889 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:54.887+0000 7f1435bfe700 1 -- 172.21.15.71:0/3207459523 >> 172.21.15.71:0/3207459523 conn(0x7f143006a260 msgr2=0x7f14300adb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:54.889 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:54.888+0000 7f1435bfe700 1 -- 172.21.15.71:0/3207459523 shutdown_connections 2023-10-06T01:41:54.890 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:54.888+0000 7f1435bfe700 1 -- 172.21.15.71:0/3207459523 wait complete. 2023-10-06T01:41:54.890 INFO:teuthology.orchestra.run.smithi071.stderr: removed all blocklist entries 2023-10-06T01:41:54.901 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-06T01:41:55.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.016+0000 7f46ab561700 1 Processor -- start 2023-10-06T01:41:55.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.016+0000 7f46ab561700 1 -- start start 2023-10-06T01:41:55.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.017+0000 7f46ab561700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f46a4069e10 0x7f46a40cb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:55.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.017+0000 7f46ab561700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f46a40cf7f0 0x7f46a41592e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:55.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.017+0000 7f46ab561700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46a40cf360 con 0x7f46a40cb5f0 2023-10-06T01:41:55.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.017+0000 7f46ab561700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46a40ce750 con 0x7f46a40cf7f0 2023-10-06T01:41:55.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.017+0000 7f46ab561700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46a40cea30 con 0x7f46a4069e10 2023-10-06T01:41:55.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.017+0000 7f46aad60700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f46a40cf7f0 0x7f46a41592e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:55.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.017+0000 7f46aad60700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f46a40cf7f0 0x7f46a41592e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51096/0 (socket says 172.21.15.71:51096) 2023-10-06T01:41:55.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.017+0000 7f46aad60700 1 -- 172.21.15.71:0/2767168098 learned_addr learned my addr 172.21.15.71:0/2767168098 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:55.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.017+0000 7f46aa55f700 1 --2- 172.21.15.71:0/2767168098 >> v2:172.21.15.72:3300/0 conn(0x7f46a4069e10 0x7f46a40cb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:55.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.017+0000 7f46aad60700 1 -- 172.21.15.71:0/2767168098 >> v2:172.21.15.72:3300/0 conn(0x7f46a4069e10 msgr2=0x7f46a40cb0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:55.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.017+0000 7f46aad60700 1 --2- 172.21.15.71:0/2767168098 >> v2:172.21.15.72:3300/0 conn(0x7f46a4069e10 0x7f46a40cb0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:55.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.017+0000 7f46aad60700 1 -- 172.21.15.71:0/2767168098 >> v1:172.21.15.72:6789/0 conn(0x7f46a40cb5f0 legacy=0x7f46a4158bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:55.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.017+0000 7f46aad60700 1 -- 172.21.15.71:0/2767168098 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46a40ced10 con 0x7f46a40cf7f0 2023-10-06T01:41:55.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.018+0000 7f46aad60700 1 --2- 172.21.15.71:0/2767168098 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f46a40cf7f0 0x7f46a41592e0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f46a4089500 tx=0x7f4694009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dda44ddda55a9003 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:55.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.018+0000 7f46a955d700 1 -- 172.21.15.71:0/2767168098 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469400e070 con 0x7f46a40cf7f0 2023-10-06T01:41:55.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.018+0000 7f46a955d700 1 -- 172.21.15.71:0/2767168098 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f469400ba20 con 0x7f46a40cf7f0 2023-10-06T01:41:55.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.018+0000 7f46a955d700 1 -- 172.21.15.71:0/2767168098 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46940092e0 con 0x7f46a40cf7f0 2023-10-06T01:41:55.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.018+0000 7f46ab561700 1 -- 172.21.15.71:0/2767168098 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f46a40cf7f0 msgr2=0x7f46a41592e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:55.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.018+0000 7f46ab561700 1 --2- 172.21.15.71:0/2767168098 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f46a40cf7f0 0x7f46a41592e0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f46a4089500 tx=0x7f4694009840 comp rx=0 tx=0).stop 2023-10-06T01:41:55.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.018+0000 7f46ab561700 1 -- 172.21.15.71:0/2767168098 shutdown_connections 2023-10-06T01:41:55.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.018+0000 7f46ab561700 1 --2- 172.21.15.71:0/2767168098 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f46a40cf7f0 0x7f46a41592e0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:55.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.018+0000 7f46ab561700 1 --2- 172.21.15.71:0/2767168098 >> v2:172.21.15.72:3300/0 conn(0x7f46a4069e10 0x7f46a40cb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:55.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.018+0000 7f46ab561700 1 -- 172.21.15.71:0/2767168098 >> 172.21.15.71:0/2767168098 conn(0x7f46a40d0ba0 msgr2=0x7f46a40ccb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:55.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.018+0000 7f46ab561700 1 -- 172.21.15.71:0/2767168098 shutdown_connections 2023-10-06T01:41:55.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.018+0000 7f46ab561700 1 -- 172.21.15.71:0/2767168098 wait complete. 2023-10-06T01:41:55.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.019+0000 7f46ab561700 1 Processor -- start 2023-10-06T01:41:55.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.019+0000 7f46ab561700 1 -- start start 2023-10-06T01:41:55.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.020+0000 7f46ab561700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f46a4069e10 0x7f46a40ca160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:55.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.020+0000 7f46ab561700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46a40cb5f0 0x7f46a4169630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:55.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.020+0000 7f46ab561700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f46a40cf7f0 0x7f46a4169b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:55.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.020+0000 7f46ab561700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46a415ec90 con 0x7f46a4069e10 2023-10-06T01:41:55.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.020+0000 7f46ab561700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46a415cba0 con 0x7f46a40cb5f0 2023-10-06T01:41:55.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.020+0000 7f46ab561700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46a40b47f0 con 0x7f46a40cf7f0 2023-10-06T01:41:55.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.020+0000 7f46aa55f700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f46a4069e10 0x7f46a40ca160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:55.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.020+0000 7f46aa55f700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f46a4069e10 0x7f46a40ca160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51104/0 (socket says 172.21.15.71:51104) 2023-10-06T01:41:55.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.020+0000 7f46aa55f700 1 -- 172.21.15.71:0/2555169277 learned_addr learned my addr 172.21.15.71:0/2555169277 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:55.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.020+0000 7f46a9d5e700 1 --2- 172.21.15.71:0/2555169277 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46a40cb5f0 0x7f46a4169630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:55.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.020+0000 7f46aa55f700 1 -- 172.21.15.71:0/2555169277 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f46a40cf7f0 msgr2=0x7f46a4169b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:55.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.020+0000 7f46aa55f700 1 --2- 172.21.15.71:0/2555169277 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f46a40cf7f0 0x7f46a4169b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:55.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.020+0000 7f46aa55f700 1 -- 172.21.15.71:0/2555169277 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46a40cb5f0 msgr2=0x7f46a4169630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:55.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.020+0000 7f46aa55f700 1 --2- 172.21.15.71:0/2555169277 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46a40cb5f0 0x7f46a4169630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:55.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.020+0000 7f46aa55f700 1 -- 172.21.15.71:0/2555169277 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4694009ae0 con 0x7f46a4069e10 2023-10-06T01:41:55.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.020+0000 7f46a9d5e700 1 --2- 172.21.15.71:0/2555169277 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46a40cb5f0 0x7f46a4169630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:41:55.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.021+0000 7f46aa55f700 1 --2- 172.21.15.71:0/2555169277 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f46a4069e10 0x7f46a40ca160 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f469c00ec80 tx=0x7f469c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:55.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.021+0000 7f46a27fc700 1 -- 172.21.15.71:0/2555169277 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469c00c9d0 con 0x7f46a4069e10 2023-10-06T01:41:55.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.021+0000 7f46a27fc700 1 -- 172.21.15.71:0/2555169277 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f469c00cb30 con 0x7f46a4069e10 2023-10-06T01:41:55.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.021+0000 7f46a27fc700 1 -- 172.21.15.71:0/2555169277 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469c013470 con 0x7f46a4069e10 2023-10-06T01:41:55.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.021+0000 7f46ab561700 1 -- 172.21.15.71:0/2555169277 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46a40ca6a0 con 0x7f46a4069e10 2023-10-06T01:41:55.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.021+0000 7f46ab561700 1 -- 172.21.15.71:0/2555169277 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46a40b41a0 con 0x7f46a4069e10 2023-10-06T01:41:55.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.022+0000 7f46ab561700 1 -- 172.21.15.71:0/2555169277 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46a4064aa0 con 0x7f46a4069e10 2023-10-06T01:41:55.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.022+0000 7f46a27fc700 1 -- 172.21.15.71:0/2555169277 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f469c013820 con 0x7f46a4069e10 2023-10-06T01:41:55.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.022+0000 7f46a27fc700 1 --2- 172.21.15.71:0/2555169277 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f4690066f30 0x7f46900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:55.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.023+0000 7f46a9d5e700 1 --2- 172.21.15.71:0/2555169277 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f4690066f30 0x7f46900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:55.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.023+0000 7f46a27fc700 1 -- 172.21.15.71:0/2555169277 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f469c084870 con 0x7f46a4069e10 2023-10-06T01:41:55.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.023+0000 7f46a9d5e700 1 --2- 172.21.15.71:0/2555169277 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f4690066f30 0x7f46900693e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f46a40c5250 tx=0x7f4698009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:55.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.027+0000 7f46a27fc700 1 -- 172.21.15.71:0/2555169277 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f469c051b90 con 0x7f46a4069e10 2023-10-06T01:41:55.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.282+0000 7f46ab561700 1 -- 172.21.15.71:0/2555169277 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f46a40b4540 con 0x7f46a4069e10 2023-10-06T01:41:55.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.283+0000 7f46a27fc700 1 -- 172.21.15.71:0/2555169277 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f469c0551b0 con 0x7f46a4069e10 2023-10-06T01:41:55.284 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:41:55.284 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2023-10-06T01:41:55.284 INFO:teuthology.orchestra.run.smithi071.stdout: "auth_dump": [ 2023-10-06T01:41:55.284 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-06T01:41:55.284 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "mds.a", 2023-10-06T01:41:55.284 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQBLZR9lcoBDKBAAuqBFOnzb876BazeC2Cbhzw==", 2023-10-06T01:41:55.284 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-06T01:41:55.284 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-06T01:41:55.284 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow *", 2023-10-06T01:41:55.285 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow *", 2023-10-06T01:41:55.285 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-06T01:41:55.285 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-06T01:41:55.285 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-06T01:41:55.285 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-06T01:41:55.285 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "mds.b", 2023-10-06T01:41:55.285 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQBLZR9lE79sMxAAm8IQLgkFMY+nP5YQcCZeZg==", 2023-10-06T01:41:55.285 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-06T01:41:55.285 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-06T01:41:55.285 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow *", 2023-10-06T01:41:55.285 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow *", 2023-10-06T01:41:55.285 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-06T01:41:55.286 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-06T01:41:55.286 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-06T01:41:55.286 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-06T01:41:55.286 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "mds.c", 2023-10-06T01:41:55.286 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQBLZR9lC30MLxAAVjECkWzmVuCjwmfytprvTw==", 2023-10-06T01:41:55.286 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-06T01:41:55.286 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-06T01:41:55.286 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow *", 2023-10-06T01:41:55.286 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow *", 2023-10-06T01:41:55.286 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-06T01:41:55.286 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-06T01:41:55.287 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-06T01:41:55.287 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-06T01:41:55.287 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "mds.d", 2023-10-06T01:41:55.287 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQBLZR9loz09OhAAy7MxAbp7ihZerFQfSqBglw==", 2023-10-06T01:41:55.287 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-06T01:41:55.287 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-06T01:41:55.287 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow *", 2023-10-06T01:41:55.287 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow *", 2023-10-06T01:41:55.287 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-06T01:41:55.287 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-06T01:41:55.287 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-06T01:41:55.287 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-06T01:41:55.288 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.0", 2023-10-06T01:41:55.288 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQBPZR9lT45fFxAAviTkT2FYL+NLj6FNrCE5Ng==", 2023-10-06T01:41:55.288 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-06T01:41:55.288 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-06T01:41:55.288 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-06T01:41:55.288 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-06T01:41:55.288 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-06T01:41:55.288 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-06T01:41:55.288 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-06T01:41:55.288 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.1", 2023-10-06T01:41:55.288 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQBSZR9lWpR+FBAA0WaTKl/H0wwNPPPqS1ju3w==", 2023-10-06T01:41:55.288 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-06T01:41:55.288 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-06T01:41:55.289 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-06T01:41:55.289 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-06T01:41:55.289 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-06T01:41:55.289 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-06T01:41:55.289 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-06T01:41:55.289 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.2", 2023-10-06T01:41:55.289 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQBVZR9lFrqxExAABQRNP/VF7HBY7D8WBia/CA==", 2023-10-06T01:41:55.289 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-06T01:41:55.289 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-06T01:41:55.289 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-06T01:41:55.289 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-06T01:41:55.289 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-06T01:41:55.290 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-06T01:41:55.290 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-06T01:41:55.290 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.3", 2023-10-06T01:41:55.290 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQBYZR9lmNBKExAAi3WvWiyerLluzlqwcVv6CA==", 2023-10-06T01:41:55.290 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-06T01:41:55.290 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-06T01:41:55.290 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-06T01:41:55.290 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-06T01:41:55.290 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-06T01:41:55.290 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-06T01:41:55.290 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-06T01:41:55.291 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.4", 2023-10-06T01:41:55.291 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQBeZR9lwv27EBAAX3IDzrKCSWlivcjt4tn+9A==", 2023-10-06T01:41:55.291 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-06T01:41:55.291 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-06T01:41:55.291 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-06T01:41:55.291 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-06T01:41:55.291 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-06T01:41:55.291 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-06T01:41:55.291 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-06T01:41:55.291 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.5", 2023-10-06T01:41:55.291 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQBhZR9lhqzQDhAASmhyOln1kgXSDwK+7YZJyQ==", 2023-10-06T01:41:55.291 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-06T01:41:55.291 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-06T01:41:55.292 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-06T01:41:55.292 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-06T01:41:55.292 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-06T01:41:55.292 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-06T01:41:55.292 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-06T01:41:55.292 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.6", 2023-10-06T01:41:55.292 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQBkZR9lLimVDhAAV8pqtb5zp49hl4HAJM0tfA==", 2023-10-06T01:41:55.292 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-06T01:41:55.292 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-06T01:41:55.292 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-06T01:41:55.292 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-06T01:41:55.292 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-06T01:41:55.293 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-06T01:41:55.293 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-06T01:41:55.293 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "osd.7", 2023-10-06T01:41:55.293 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQBnZR9lDwURDxAABbfmEhouaGSV3tByZdRKKw==", 2023-10-06T01:41:55.293 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-06T01:41:55.293 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow profile osd", 2023-10-06T01:41:55.293 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile osd", 2023-10-06T01:41:55.293 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-06T01:41:55.293 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-06T01:41:55.293 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-06T01:41:55.293 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-06T01:41:55.293 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.0", 2023-10-06T01:41:55.294 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQBMZR9lFadqAhAAjrNmQYFfd+qw3Vup+6+B+Q==", 2023-10-06T01:41:55.294 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-06T01:41:55.294 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-06T01:41:55.294 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow r", 2023-10-06T01:41:55.294 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-06T01:41:55.294 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-06T01:41:55.294 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-06T01:41:55.294 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-06T01:41:55.294 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.1", 2023-10-06T01:41:55.294 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQBMZR9l8Jy+ChAAtqx+Fz4onmRzILbFxuZ5lg==", 2023-10-06T01:41:55.294 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-06T01:41:55.294 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-06T01:41:55.295 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow r", 2023-10-06T01:41:55.295 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow rw", 2023-10-06T01:41:55.295 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow rwx" 2023-10-06T01:41:55.295 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-06T01:41:55.295 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-06T01:41:55.295 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-06T01:41:55.295 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.2", 2023-10-06T01:41:55.295 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQBMZR9lfIDHBxAAPZRU1OPQtHEJ2+ozcMF5pA==", 2023-10-06T01:41:55.295 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-06T01:41:55.295 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-06T01:41:55.295 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow r", 2023-10-06T01:41:55.295 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow rw", 2023-10-06T01:41:55.295 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow rwx" 2023-10-06T01:41:55.296 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-06T01:41:55.296 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-06T01:41:55.296 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-06T01:41:55.296 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.3", 2023-10-06T01:41:55.296 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQBMZR9lC2QVEBAAJiILvy19TnhA32dUBUiWJw==", 2023-10-06T01:41:55.296 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-06T01:41:55.296 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow", 2023-10-06T01:41:55.296 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow r", 2023-10-06T01:41:55.296 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow rw", 2023-10-06T01:41:55.296 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow rwx" 2023-10-06T01:41:55.296 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-06T01:41:55.296 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-06T01:41:55.297 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-06T01:41:55.297 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "client.admin", 2023-10-06T01:41:55.297 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQBLZR9lATqVDRAAh9Fc8DmrYAKrr2ZMnCdIRQ==", 2023-10-06T01:41:55.297 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-06T01:41:55.297 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow *", 2023-10-06T01:41:55.297 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": "allow *", 2023-10-06T01:41:55.297 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow *", 2023-10-06T01:41:55.297 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-06T01:41:55.297 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-06T01:41:55.297 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-06T01:41:55.297 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-06T01:41:55.297 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "mgr.x", 2023-10-06T01:41:55.298 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQBLZR9lcCNIJRAAreWP16OjllwbkDLHYn36tA==", 2023-10-06T01:41:55.298 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-06T01:41:55.298 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow *", 2023-10-06T01:41:55.298 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile mgr", 2023-10-06T01:41:55.298 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-06T01:41:55.298 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-06T01:41:55.298 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-06T01:41:55.298 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-06T01:41:55.298 INFO:teuthology.orchestra.run.smithi071.stdout: "entity": "mgr.y", 2023-10-06T01:41:55.298 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "AQBLZR9lp02wIRAAyzu2xX+9mB6LzZ5qLF8c7w==", 2023-10-06T01:41:55.298 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": { 2023-10-06T01:41:55.298 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": "allow *", 2023-10-06T01:41:55.299 INFO:teuthology.orchestra.run.smithi071.stdout: "mon": "allow profile mgr", 2023-10-06T01:41:55.299 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": "allow *" 2023-10-06T01:41:55.299 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-06T01:41:55.299 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-06T01:41:55.299 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2023-10-06T01:41:55.299 INFO:teuthology.orchestra.run.smithi071.stdout:} 2023-10-06T01:41:55.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.285+0000 7f46ab561700 1 -- 172.21.15.71:0/2555169277 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f4690066f30 msgr2=0x7f46900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:55.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.285+0000 7f46ab561700 1 --2- 172.21.15.71:0/2555169277 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f4690066f30 0x7f46900693e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f46a40c5250 tx=0x7f4698009040 comp rx=0 tx=0).stop 2023-10-06T01:41:55.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.285+0000 7f46ab561700 1 -- 172.21.15.71:0/2555169277 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f46a4069e10 msgr2=0x7f46a40ca160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:55.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.285+0000 7f46ab561700 1 --2- 172.21.15.71:0/2555169277 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f46a4069e10 0x7f46a40ca160 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f469c00ec80 tx=0x7f469c0091a0 comp rx=0 tx=0).stop 2023-10-06T01:41:55.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.285+0000 7f46ab561700 1 -- 172.21.15.71:0/2555169277 shutdown_connections 2023-10-06T01:41:55.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.285+0000 7f46ab561700 1 --2- 172.21.15.71:0/2555169277 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f46a40cf7f0 0x7f46a4169b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:55.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.285+0000 7f46ab561700 1 --2- 172.21.15.71:0/2555169277 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f46a4069e10 0x7f46a40ca160 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:55.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.285+0000 7f46ab561700 1 --2- 172.21.15.71:0/2555169277 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f4690066f30 0x7f46900693e0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:55.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.285+0000 7f46ab561700 1 --2- 172.21.15.71:0/2555169277 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46a40cb5f0 0x7f46a4169630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:55.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.285+0000 7f46ab561700 1 -- 172.21.15.71:0/2555169277 >> 172.21.15.71:0/2555169277 conn(0x7f46a40d0ba0 msgr2=0x7f46a4157ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:55.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.285+0000 7f46ab561700 1 -- 172.21.15.71:0/2555169277 shutdown_connections 2023-10-06T01:41:55.301 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.285+0000 7f46ab561700 1 -- 172.21.15.71:0/2555169277 wait complete. 2023-10-06T01:41:55.302 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:41:55.416 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.415+0000 7f8712b6d700 1 Processor -- start 2023-10-06T01:41:55.416 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.415+0000 7f8712b6d700 1 -- start start 2023-10-06T01:41:55.418 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.416+0000 7f8712b6d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f870c142de0 0x7f870c0ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:55.419 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.416+0000 7f8712b6d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f870c0cd270 0x7f870c0d0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:55.419 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.416+0000 7f8712b6d700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f870c0cf8a0 con 0x7f870c1431b0 2023-10-06T01:41:55.419 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.416+0000 7f8712b6d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f870c0b4100 con 0x7f870c142de0 2023-10-06T01:41:55.419 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.416+0000 7f8712b6d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f870c0cec90 con 0x7f870c0cd270 2023-10-06T01:41:55.419 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.416+0000 7f8710909700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f870c142de0 0x7f870c0ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:55.419 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.416+0000 7f8710909700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f870c142de0 0x7f870c0ccd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51112/0 (socket says 172.21.15.71:51112) 2023-10-06T01:41:55.419 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.416+0000 7f8710909700 1 -- 172.21.15.71:0/1687251178 learned_addr learned my addr 172.21.15.71:0/1687251178 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:55.419 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.416+0000 7f8703fff700 1 --2- 172.21.15.71:0/1687251178 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f870c0cd270 0x7f870c0d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:55.419 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.417+0000 7f8710909700 1 -- 172.21.15.71:0/1687251178 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f870c0cd270 msgr2=0x7f870c0d0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:55.419 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.417+0000 7f8710909700 1 --2- 172.21.15.71:0/1687251178 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f870c0cd270 0x7f870c0d0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:55.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.417+0000 7f8710909700 1 -- 172.21.15.71:0/1687251178 >> v1:172.21.15.72:6789/0 conn(0x7f870c1431b0 legacy=0x7f870c15d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:55.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.417+0000 7f8710909700 1 -- 172.21.15.71:0/1687251178 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f870c0cef70 con 0x7f870c142de0 2023-10-06T01:41:55.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.417+0000 7f8710909700 1 --2- 172.21.15.71:0/1687251178 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f870c142de0 0x7f870c0ccd30 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f87080099b0 tx=0x7f8708009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de542618d3d542c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:55.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.417+0000 7f87037fe700 1 -- 172.21.15.71:0/1687251178 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f870800b860 con 0x7f870c142de0 2023-10-06T01:41:55.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.417+0000 7f87037fe700 1 -- 172.21.15.71:0/1687251178 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f870800b9c0 con 0x7f870c142de0 2023-10-06T01:41:55.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.417+0000 7f87037fe700 1 -- 172.21.15.71:0/1687251178 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f870800bd60 con 0x7f870c142de0 2023-10-06T01:41:55.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.417+0000 7f8712b6d700 1 -- 172.21.15.71:0/1687251178 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f870c142de0 msgr2=0x7f870c0ccd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:55.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.417+0000 7f8712b6d700 1 --2- 172.21.15.71:0/1687251178 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f870c142de0 0x7f870c0ccd30 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f87080099b0 tx=0x7f8708009250 comp rx=0 tx=0).stop 2023-10-06T01:41:55.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.417+0000 7f8712b6d700 1 -- 172.21.15.71:0/1687251178 shutdown_connections 2023-10-06T01:41:55.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.417+0000 7f8712b6d700 1 --2- 172.21.15.71:0/1687251178 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f870c142de0 0x7f870c0ccd30 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:55.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.417+0000 7f8712b6d700 1 --2- 172.21.15.71:0/1687251178 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f870c0cd270 0x7f870c0d0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:55.420 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.417+0000 7f8712b6d700 1 -- 172.21.15.71:0/1687251178 >> 172.21.15.71:0/1687251178 conn(0x7f870c069110 msgr2=0x7f870c06a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:55.421 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.418+0000 7f8712b6d700 1 -- 172.21.15.71:0/1687251178 shutdown_connections 2023-10-06T01:41:55.421 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.418+0000 7f8712b6d700 1 -- 172.21.15.71:0/1687251178 wait complete. 2023-10-06T01:41:55.423 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.419+0000 7f8712b6d700 1 Processor -- start 2023-10-06T01:41:55.423 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.419+0000 7f8712b6d700 1 -- start start 2023-10-06T01:41:55.424 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.419+0000 7f8712b6d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f870c0cd270 0x7f870c13deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:55.424 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.419+0000 7f8712b6d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f870c142de0 0x7f870c152830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:55.424 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.419+0000 7f8712b6d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f870c1431b0 0x7f870c152d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:55.424 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.420+0000 7f8712b6d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f870c0b28b0 con 0x7f870c142de0 2023-10-06T01:41:55.424 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.420+0000 7f8712b6d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f870c153fb0 con 0x7f870c1431b0 2023-10-06T01:41:55.424 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.420+0000 7f8712b6d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f870c1533a0 con 0x7f870c0cd270 2023-10-06T01:41:55.424 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.420+0000 7f8703fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f870c142de0 0x7f870c152830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:55.424 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.420+0000 7f8703fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f870c142de0 0x7f870c152830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51114/0 (socket says 172.21.15.71:51114) 2023-10-06T01:41:55.424 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.420+0000 7f8703fff700 1 -- 172.21.15.71:0/951351208 learned_addr learned my addr 172.21.15.71:0/951351208 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:55.425 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.420+0000 7f8710909700 1 --2- 172.21.15.71:0/951351208 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f870c0cd270 0x7f870c13deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:55.425 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.420+0000 7f871110a700 1 --2- 172.21.15.71:0/951351208 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f870c1431b0 0x7f870c152d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:55.425 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.420+0000 7f8703fff700 1 -- 172.21.15.71:0/951351208 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f870c0cd270 msgr2=0x7f870c13deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:55.425 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.420+0000 7f8703fff700 1 --2- 172.21.15.71:0/951351208 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f870c0cd270 0x7f870c13deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:55.425 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.420+0000 7f8703fff700 1 -- 172.21.15.71:0/951351208 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f870c1431b0 msgr2=0x7f870c152d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:55.425 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.420+0000 7f8703fff700 1 --2- 172.21.15.71:0/951351208 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f870c1431b0 0x7f870c152d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:55.425 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.420+0000 7f8703fff700 1 -- 172.21.15.71:0/951351208 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87080094f0 con 0x7f870c142de0 2023-10-06T01:41:55.425 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.420+0000 7f871110a700 1 --2- 172.21.15.71:0/951351208 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f870c1431b0 0x7f870c152d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:41:55.425 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.420+0000 7f8703fff700 1 --2- 172.21.15.71:0/951351208 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f870c142de0 0x7f870c152830 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f86fc00d7e0 tx=0x7f86fc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:55.425 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.420+0000 7f8700ff9700 1 -- 172.21.15.71:0/951351208 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86fc0125f0 con 0x7f870c142de0 2023-10-06T01:41:55.425 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.420+0000 7f8700ff9700 1 -- 172.21.15.71:0/951351208 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86fc012750 con 0x7f870c142de0 2023-10-06T01:41:55.426 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.420+0000 7f8712b6d700 1 -- 172.21.15.71:0/951351208 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f870c153680 con 0x7f870c142de0 2023-10-06T01:41:55.426 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.420+0000 7f8700ff9700 1 -- 172.21.15.71:0/951351208 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86fc012af0 con 0x7f870c142de0 2023-10-06T01:41:55.426 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.420+0000 7f8712b6d700 1 -- 172.21.15.71:0/951351208 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f870c153c40 con 0x7f870c142de0 2023-10-06T01:41:55.426 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.421+0000 7f8712b6d700 1 -- 172.21.15.71:0/951351208 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f870c154160 con 0x7f870c142de0 2023-10-06T01:41:55.426 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.422+0000 7f8700ff9700 1 -- 172.21.15.71:0/951351208 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f86fc01e460 con 0x7f870c142de0 2023-10-06T01:41:55.426 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.422+0000 7f8700ff9700 1 --2- 172.21.15.71:0/951351208 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f86f8066f30 0x7f86f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:55.426 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.422+0000 7f8710909700 1 --2- 172.21.15.71:0/951351208 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f86f8066f30 0x7f86f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:55.426 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.422+0000 7f8700ff9700 1 -- 172.21.15.71:0/951351208 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f86fc084ab0 con 0x7f870c142de0 2023-10-06T01:41:55.426 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.422+0000 7f8710909700 1 --2- 172.21.15.71:0/951351208 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f86f8066f30 0x7f86f80693e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f87080099b0 tx=0x7f8708017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:55.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.426+0000 7f8700ff9700 1 -- 172.21.15.71:0/951351208 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f870c154160 con 0x7f870c142de0 2023-10-06T01:41:55.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.610+0000 7f8712b6d700 1 -- 172.21.15.71:0/951351208 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f870c154120 con 0x7f870c142de0 2023-10-06T01:41:55.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.611+0000 7f8700ff9700 1 -- 172.21.15.71:0/951351208 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+13807 (secure 0 0 0) 0x7f86fc051dd0 con 0x7f870c142de0 2023-10-06T01:41:55.612 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:41:55.612 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":50,"fsid":"1fbf1bd2-f9b4-4599-bea2-f4aa920e9a56","created":"2023-10-06T01:39:57.016957+0000","modified":"2023-10-06T01:41:54.883379+0000","last_up_change":"2023-10-06T01:40:08.571643+0000","last_in_change":"2023-10-06T01:39:59.462741+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T01:40:08.610349+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T01:40:15.387434+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"cf059188-fb20-4dbf-95db-dcf57b213d03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":90670},{"type":"v1","addr":"172.21.15.71:6817","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":90670},{"type":"v1","addr":"172.21.15.71:6819","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":90670},{"type":"v1","addr":"172.21.15.71:6823","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":90670},{"type":"v1","addr":"172.21.15.71:6821","nonce":90670}]},"public_addr":"172.21.15.71:6817/90670","cluster_addr":"172.21.15.71:6819/90670","heartbeat_back_addr":"172.21.15.71:6823/90670","heartbeat_front_addr":"172.21.15.71:6821/90670","state":["exists","up"]},{"osd":1,"uuid":"0cff0aae-1799-4fe0-b610-54cf0813c0e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":90669},{"type":"v1","addr":"172.21.15.71:6809","nonce":90669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":90669},{"type":"v1","addr":"172.21.15.71:6811","nonce":90669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":90669},{"type":"v1","addr":"172.21.15.71:6815","nonce":90669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":90669},{"type":"v1","addr":"172.21.15.71:6813","nonce":90669}]},"public_addr":"172.21.15.71:6809/90669","cluster_addr":"172.21.15.71:6811/90669","heartbeat_back_addr":"172.21.15.71:6815/90669","heartbeat_front_addr":"172.21.15.71:6813/90669","state":["exists","up"]},{"osd":2,"uuid":"88d61ddc-9031-44e1-ba8c-546a41e7c8ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":90679},{"type":"v1","addr":"172.21.15.71:6825","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":90679},{"type":"v1","addr":"172.21.15.71:6827","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":90679},{"type":"v1","addr":"172.21.15.71:6831","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":90679},{"type":"v1","addr":"172.21.15.71:6829","nonce":90679}]},"public_addr":"172.21.15.71:6825/90679","cluster_addr":"172.21.15.71:6827/90679","heartbeat_back_addr":"172.21.15.71:6831/90679","heartbeat_front_addr":"172.21.15.71:6829/90679","state":["exists","up"]},{"osd":3,"uuid":"11ed92b7-960b-4a30-a889-a61d3eeb86f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":90668},{"type":"v1","addr":"172.21.15.71:6801","nonce":90668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":90668},{"type":"v1","addr":"172.21.15.71:6803","nonce":90668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":90668},{"type":"v1","addr":"172.21.15.71:6807","nonce":90668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":90668},{"type":"v1","addr":"172.21.15.71:6805","nonce":90668}]},"public_addr":"172.21.15.71:6801/90668","cluster_addr":"172.21.15.71:6803/90668","heartbeat_back_addr":"172.21.15.71:6807/90668","heartbeat_front_addr":"172.21.15.71:6805/90668","state":["exists","up"]},{"osd":4,"uuid":"ae4df784-abdf-4ddf-aefa-780f3ddafef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":90917},{"type":"v1","addr":"172.21.15.72:6801","nonce":90917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":90917},{"type":"v1","addr":"172.21.15.72:6803","nonce":90917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":90917},{"type":"v1","addr":"172.21.15.72:6807","nonce":90917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":90917},{"type":"v1","addr":"172.21.15.72:6805","nonce":90917}]},"public_addr":"172.21.15.72:6801/90917","cluster_addr":"172.21.15.72:6803/90917","heartbeat_back_addr":"172.21.15.72:6807/90917","heartbeat_front_addr":"172.21.15.72:6805/90917","state":["exists","up"]},{"osd":5,"uuid":"5ef0790f-001e-458f-a05b-efae216cf435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":90941},{"type":"v1","addr":"172.21.15.72:6817","nonce":90941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":90941},{"type":"v1","addr":"172.21.15.72:6819","nonce":90941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":90941},{"type":"v1","addr":"172.21.15.72:6827","nonce":90941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":90941},{"type":"v1","addr":"172.21.15.72:6823","nonce":90941}]},"public_addr":"172.21.15.72:6817/90941","cluster_addr":"172.21.15.72:6819/90941","heartbeat_back_addr":"172.21.15.72:6827/90941","heartbeat_front_addr":"172.21.15.72:6823/90941","state":["exists","up"]},{"osd":6,"uuid":"8705aef1-9ae8-4e54-a3c4-c2909fa0ceb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":90918},{"type":"v1","addr":"172.21.15.72:6809","nonce":90918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":90918},{"type":"v1","addr":"172.21.15.72:6811","nonce":90918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":90918},{"type":"v1","addr":"172.21.15.72:6815","nonce":90918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":90918},{"type":"v1","addr":"172.21.15.72:6813","nonce":90918}]},"public_addr":"172.21.15.72:6809/90918","cluster_addr":"172.21.15.72:6811/90918","heartbeat_back_addr":"172.21.15.72:6815/90918","heartbeat_front_addr":"172.21.15.72:6813/90918","state":["exists","up"]},{"osd":7,"uuid":"364c5119-6b13-4c75-b3f0-15e165eff86a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":90948},{"type":"v1","addr":"172.21.15.72:6822","nonce":90948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":90948},{"type":"v1","addr":"172.21.15.72:6826","nonce":90948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":90948},{"type":"v1","addr":"172.21.15.72:6831","nonce":90948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":90948},{"type":"v1","addr":"172.21.15.72:6829","nonce":90948}]},"public_addr":"172.21.15.72:6822/90948","cluster_addr":"172.21.15.72:6826/90948","heartbeat_back_addr":"172.21.15.72:6831/90948","heartbeat_front_addr":"172.21.15.72:6829/90948","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.642976+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.645372+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.619116+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.663042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.599163+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.646411+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.631545+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.669821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:41:55.614 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.613+0000 7f8712b6d700 1 -- 172.21.15.71:0/951351208 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f86f8066f30 msgr2=0x7f86f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:55.614 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.613+0000 7f8712b6d700 1 --2- 172.21.15.71:0/951351208 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f86f8066f30 0x7f86f80693e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f87080099b0 tx=0x7f8708017000 comp rx=0 tx=0).stop 2023-10-06T01:41:55.614 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.613+0000 7f8712b6d700 1 -- 172.21.15.71:0/951351208 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f870c142de0 msgr2=0x7f870c152830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:55.614 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.613+0000 7f8712b6d700 1 --2- 172.21.15.71:0/951351208 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f870c142de0 0x7f870c152830 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f86fc00d7e0 tx=0x7f86fc008040 comp rx=0 tx=0).stop 2023-10-06T01:41:55.614 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.613+0000 7f8712b6d700 1 -- 172.21.15.71:0/951351208 shutdown_connections 2023-10-06T01:41:55.614 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.613+0000 7f8712b6d700 1 --2- 172.21.15.71:0/951351208 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f86f8066f30 0x7f86f80693e0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:55.614 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.613+0000 7f8712b6d700 1 --2- 172.21.15.71:0/951351208 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f870c1431b0 0x7f870c152d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:55.614 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.613+0000 7f8712b6d700 1 --2- 172.21.15.71:0/951351208 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f870c0cd270 0x7f870c13deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:55.614 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.613+0000 7f8712b6d700 1 --2- 172.21.15.71:0/951351208 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f870c142de0 0x7f870c152830 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:55.614 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.613+0000 7f8712b6d700 1 -- 172.21.15.71:0/951351208 >> 172.21.15.71:0/951351208 conn(0x7f870c069110 msgr2=0x7f870c13eb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:55.615 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.613+0000 7f8712b6d700 1 -- 172.21.15.71:0/951351208 shutdown_connections 2023-10-06T01:41:55.615 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.613+0000 7f8712b6d700 1 -- 172.21.15.71:0/951351208 wait complete. 2023-10-06T01:41:55.626 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T01:40:08.610349+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T01:40:15.387434+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-10-06T01:41:55.626 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T01:41:55.742 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.741+0000 7fbde8990700 1 Processor -- start 2023-10-06T01:41:55.742 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.741+0000 7fbde8990700 1 -- start start 2023-10-06T01:41:55.744 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.742+0000 7fbde8990700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbde406cf40 0x7fbde4156a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:55.744 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.742+0000 7fbde8990700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fbde406e030 0x7fbde4156fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:55.744 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.742+0000 7fbde8990700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbde4069790 con 0x7fbde406dc60 2023-10-06T01:41:55.744 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.742+0000 7fbde8990700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbde415aa50 con 0x7fbde406e030 2023-10-06T01:41:55.744 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.742+0000 7fbde8990700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbde41574f0 con 0x7fbde406cf40 2023-10-06T01:41:55.745 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.742+0000 7fbde3fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fbde406e030 0x7fbde4156fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:55.745 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.742+0000 7fbde3fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fbde406e030 0x7fbde4156fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51122/0 (socket says 172.21.15.71:51122) 2023-10-06T01:41:55.745 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.742+0000 7fbde3fff700 1 -- 172.21.15.71:0/689309273 learned_addr learned my addr 172.21.15.71:0/689309273 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:55.745 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.742+0000 7fbde2ffd700 1 --2- 172.21.15.71:0/689309273 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbde406cf40 0x7fbde4156a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:55.745 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.742+0000 7fbde3fff700 1 -- 172.21.15.71:0/689309273 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbde406cf40 msgr2=0x7fbde4156a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:55.745 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.742+0000 7fbde3fff700 1 --2- 172.21.15.71:0/689309273 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbde406cf40 0x7fbde4156a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:55.745 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.742+0000 7fbde3fff700 1 -- 172.21.15.71:0/689309273 >> v1:172.21.15.72:6789/0 conn(0x7fbde406dc60 legacy=0x7fbde4159ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:55.745 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.742+0000 7fbde3fff700 1 -- 172.21.15.71:0/689309273 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbde40c8c00 con 0x7fbde406e030 2023-10-06T01:41:55.745 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.742+0000 7fbde2ffd700 1 --2- 172.21.15.71:0/689309273 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbde406cf40 0x7fbde4156a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:41:55.745 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.742+0000 7fbde3fff700 1 --2- 172.21.15.71:0/689309273 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbde406e030 0x7fbde4156fb0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fbddc0099b0 tx=0x7fbddc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93805bd1d219638c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:55.745 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.743+0000 7fbde27fc700 1 -- 172.21.15.71:0/689309273 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbddc00b820 con 0x7fbde406e030 2023-10-06T01:41:55.746 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.743+0000 7fbde27fc700 1 -- 172.21.15.71:0/689309273 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbddc00b980 con 0x7fbde406e030 2023-10-06T01:41:55.746 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.743+0000 7fbde27fc700 1 -- 172.21.15.71:0/689309273 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbddc00bd20 con 0x7fbde406e030 2023-10-06T01:41:55.746 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.743+0000 7fbde8990700 1 -- 172.21.15.71:0/689309273 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbde406e030 msgr2=0x7fbde4156fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:55.746 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.743+0000 7fbde8990700 1 --2- 172.21.15.71:0/689309273 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbde406e030 0x7fbde4156fb0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fbddc0099b0 tx=0x7fbddc009250 comp rx=0 tx=0).stop 2023-10-06T01:41:55.746 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.743+0000 7fbde8990700 1 -- 172.21.15.71:0/689309273 shutdown_connections 2023-10-06T01:41:55.746 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.743+0000 7fbde8990700 1 --2- 172.21.15.71:0/689309273 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbde406e030 0x7fbde4156fb0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:55.746 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.743+0000 7fbde8990700 1 --2- 172.21.15.71:0/689309273 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbde406cf40 0x7fbde4156a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:55.746 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.743+0000 7fbde8990700 1 -- 172.21.15.71:0/689309273 >> 172.21.15.71:0/689309273 conn(0x7fbde40cea20 msgr2=0x7fbde406c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:55.746 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.743+0000 7fbde8990700 1 -- 172.21.15.71:0/689309273 shutdown_connections 2023-10-06T01:41:55.746 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.743+0000 7fbde8990700 1 -- 172.21.15.71:0/689309273 wait complete. 2023-10-06T01:41:55.749 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.744+0000 7fbde8990700 1 Processor -- start 2023-10-06T01:41:55.749 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.744+0000 7fbde8990700 1 -- start start 2023-10-06T01:41:55.749 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.745+0000 7fbde8990700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbde406cf40 0x7fbde416aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:55.749 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.745+0000 7fbde8990700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbde406dc60 0x7fbde414b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:55.749 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.745+0000 7fbde8990700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbde406e030 0x7fbde416a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:55.749 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.745+0000 7fbde8990700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbde414b6b0 con 0x7fbde406e030 2023-10-06T01:41:55.749 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.745+0000 7fbde8990700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbde416a8a0 con 0x7fbde406cf40 2023-10-06T01:41:55.749 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.745+0000 7fbde8990700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbde40c5000 con 0x7fbde406dc60 2023-10-06T01:41:55.749 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.745+0000 7fbde3fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbde406e030 0x7fbde416a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:55.750 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.745+0000 7fbde3fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbde406e030 0x7fbde416a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51126/0 (socket says 172.21.15.71:51126) 2023-10-06T01:41:55.750 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.745+0000 7fbde3fff700 1 -- 172.21.15.71:0/1634526904 learned_addr learned my addr 172.21.15.71:0/1634526904 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:55.750 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.745+0000 7fbde37fe700 1 --2- 172.21.15.71:0/1634526904 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbde406cf40 0x7fbde416aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:55.750 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.745+0000 7fbde2ffd700 1 --2- 172.21.15.71:0/1634526904 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbde406dc60 0x7fbde414b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:55.750 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.745+0000 7fbde3fff700 1 -- 172.21.15.71:0/1634526904 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbde406dc60 msgr2=0x7fbde414b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:55.750 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.745+0000 7fbde3fff700 1 --2- 172.21.15.71:0/1634526904 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbde406dc60 0x7fbde414b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:55.750 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.745+0000 7fbde3fff700 1 -- 172.21.15.71:0/1634526904 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbde406cf40 msgr2=0x7fbde416aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:55.750 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.745+0000 7fbde3fff700 1 --2- 172.21.15.71:0/1634526904 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbde406cf40 0x7fbde416aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:55.750 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.745+0000 7fbde3fff700 1 -- 172.21.15.71:0/1634526904 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbddc0094f0 con 0x7fbde406e030 2023-10-06T01:41:55.750 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.746+0000 7fbde37fe700 1 --2- 172.21.15.71:0/1634526904 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbde406cf40 0x7fbde416aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:41:55.751 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.746+0000 7fbde3fff700 1 --2- 172.21.15.71:0/1634526904 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbde406e030 0x7fbde416a360 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fbddc009290 tx=0x7fbddc016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:55.751 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.746+0000 7fbddb7fe700 1 -- 172.21.15.71:0/1634526904 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbddc01b450 con 0x7fbde406e030 2023-10-06T01:41:55.751 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.746+0000 7fbddb7fe700 1 -- 172.21.15.71:0/1634526904 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbddc020070 con 0x7fbde406e030 2023-10-06T01:41:55.751 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.746+0000 7fbddb7fe700 1 -- 172.21.15.71:0/1634526904 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbddc01b820 con 0x7fbde406e030 2023-10-06T01:41:55.751 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.746+0000 7fbde8990700 1 -- 172.21.15.71:0/1634526904 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbde40c52e0 con 0x7fbde406e030 2023-10-06T01:41:55.751 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.746+0000 7fbde8990700 1 -- 172.21.15.71:0/1634526904 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbde40c58a0 con 0x7fbde406e030 2023-10-06T01:41:55.751 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.747+0000 7fbde8990700 1 -- 172.21.15.71:0/1634526904 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbde4064ee0 con 0x7fbde406e030 2023-10-06T01:41:55.752 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.747+0000 7fbddb7fe700 1 -- 172.21.15.71:0/1634526904 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbddc022030 con 0x7fbde406e030 2023-10-06T01:41:55.752 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.747+0000 7fbddb7fe700 1 --2- 172.21.15.71:0/1634526904 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fbdc4066f30 0x7fbdc40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:55.752 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.748+0000 7fbddb7fe700 1 -- 172.21.15.71:0/1634526904 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5526+0+0 (secure 0 0 0) 0x7fbddc086590 con 0x7fbde406e030 2023-10-06T01:41:55.752 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.748+0000 7fbde37fe700 1 --2- 172.21.15.71:0/1634526904 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fbdc4066f30 0x7fbdc40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:55.752 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.748+0000 7fbde37fe700 1 --2- 172.21.15.71:0/1634526904 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fbdc4066f30 0x7fbdc40693e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fbdd4007fd0 tx=0x7fbdd4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:55.752 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.752+0000 7fbddb7fe700 1 -- 172.21.15.71:0/1634526904 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbddc0538b0 con 0x7fbde406e030 2023-10-06T01:41:55.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.934+0000 7fbde8990700 1 -- 172.21.15.71:0/1634526904 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbde4064ee0 con 0x7fbde406e030 2023-10-06T01:41:55.935 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.934+0000 7fbddb7fe700 1 -- 172.21.15.71:0/1634526904 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v50) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbddc056ed0 con 0x7fbde406e030 2023-10-06T01:41:55.935 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 1 2023-10-06T01:41:55.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.936+0000 7fbde8990700 1 -- 172.21.15.71:0/1634526904 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fbdc4066f30 msgr2=0x7fbdc40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:55.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.936+0000 7fbde8990700 1 --2- 172.21.15.71:0/1634526904 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fbdc4066f30 0x7fbdc40693e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fbdd4007fd0 tx=0x7fbdd4009040 comp rx=0 tx=0).stop 2023-10-06T01:41:55.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.936+0000 7fbde8990700 1 -- 172.21.15.71:0/1634526904 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbde406e030 msgr2=0x7fbde416a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:55.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.936+0000 7fbde8990700 1 --2- 172.21.15.71:0/1634526904 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbde406e030 0x7fbde416a360 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fbddc009290 tx=0x7fbddc016000 comp rx=0 tx=0).stop 2023-10-06T01:41:55.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.936+0000 7fbde8990700 1 -- 172.21.15.71:0/1634526904 shutdown_connections 2023-10-06T01:41:55.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.936+0000 7fbde8990700 1 --2- 172.21.15.71:0/1634526904 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbde406e030 0x7fbde416a360 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:55.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.936+0000 7fbde8990700 1 --2- 172.21.15.71:0/1634526904 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fbdc4066f30 0x7fbdc40693e0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:55.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.936+0000 7fbde8990700 1 --2- 172.21.15.71:0/1634526904 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbde406cf40 0x7fbde416aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:55.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.936+0000 7fbde8990700 1 --2- 172.21.15.71:0/1634526904 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbde406dc60 0x7fbde414b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:55.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.936+0000 7fbde8990700 1 -- 172.21.15.71:0/1634526904 >> 172.21.15.71:0/1634526904 conn(0x7fbde40cea20 msgr2=0x7fbde40cafc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:55.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.936+0000 7fbde8990700 1 -- 172.21.15.71:0/1634526904 shutdown_connections 2023-10-06T01:41:55.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:55.936+0000 7fbde8990700 1 -- 172.21.15.71:0/1634526904 wait complete. 2023-10-06T01:41:55.949 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T01:41:56.066 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.066+0000 7f6c918ca700 1 Processor -- start 2023-10-06T01:41:56.067 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.066+0000 7f6c918ca700 1 -- start start 2023-10-06T01:41:56.069 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.067+0000 7f6c918ca700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f6c8c0d0400 0x7f6c8c0b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:56.069 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.067+0000 7f6c918ca700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6c8c0d07d0 0x7f6c8c0b3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:56.069 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.067+0000 7f6c918ca700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c8c0b6170 con 0x7f6c8c0ccd40 2023-10-06T01:41:56.069 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.067+0000 7f6c918ca700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c8c15dd40 con 0x7f6c8c0d0400 2023-10-06T01:41:56.069 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.067+0000 7f6c918ca700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c8c15e020 con 0x7f6c8c0d07d0 2023-10-06T01:41:56.069 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.067+0000 7f6c8affd700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f6c8c0d0400 0x7f6c8c0b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:56.069 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.067+0000 7f6c8a7fc700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f6c8c0ccd40 0x7f6c8c0cf2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:49664/0 (socket says 172.21.15.71:49664) 2023-10-06T01:41:56.069 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.067+0000 7f6c8affd700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f6c8c0d0400 0x7f6c8c0b5c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51134/0 (socket says 172.21.15.71:51134) 2023-10-06T01:41:56.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.067+0000 7f6c8a7fc700 1 -- 172.21.15.71:0/699719602 learned_addr learned my addr 172.21.15.71:0/699719602 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:41:56.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.067+0000 7f6c8b7fe700 1 --2- 172.21.15.71:0/699719602 >> v2:172.21.15.72:3300/0 conn(0x7f6c8c0d07d0 0x7f6c8c0b3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:56.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.067+0000 7f6c8affd700 1 -- 172.21.15.71:0/699719602 >> v2:172.21.15.72:3300/0 conn(0x7f6c8c0d07d0 msgr2=0x7f6c8c0b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:56.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.067+0000 7f6c8affd700 1 --2- 172.21.15.71:0/699719602 >> v2:172.21.15.72:3300/0 conn(0x7f6c8c0d07d0 0x7f6c8c0b3aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:56.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.067+0000 7f6c8affd700 1 -- 172.21.15.71:0/699719602 >> v1:172.21.15.71:6789/0 conn(0x7f6c8c0ccd40 legacy=0x7f6c8c0cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:56.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.067+0000 7f6c8affd700 1 -- 172.21.15.71:0/699719602 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c8c0ceaa0 con 0x7f6c8c0d0400 2023-10-06T01:41:56.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.067+0000 7f6c89ffb700 1 -- 172.21.15.71:0/699719602 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3673717691 0 0) 0x7f6c8c0b6170 con 0x7f6c8c0ccd40 2023-10-06T01:41:56.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.067+0000 7f6c8affd700 1 --2- 172.21.15.71:0/699719602 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c8c0d0400 0x7f6c8c0b5c30 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c0cdf50 tx=0x7f6c7c009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a58e7039be9c9421 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:56.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.067+0000 7f6c89ffb700 1 -- 172.21.15.71:0/699719602 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c005c10 con 0x7f6c8c0d0400 2023-10-06T01:41:56.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.067+0000 7f6c89ffb700 1 -- 172.21.15.71:0/699719602 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c7c005d70 con 0x7f6c8c0d0400 2023-10-06T01:41:56.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.067+0000 7f6c89ffb700 1 -- 172.21.15.71:0/699719602 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c006260 con 0x7f6c8c0d0400 2023-10-06T01:41:56.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.068+0000 7f6c918ca700 1 -- 172.21.15.71:0/699719602 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c8c0d0400 msgr2=0x7f6c8c0b5c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:56.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.068+0000 7f6c918ca700 1 --2- 172.21.15.71:0/699719602 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c8c0d0400 0x7f6c8c0b5c30 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c0cdf50 tx=0x7f6c7c009120 comp rx=0 tx=0).stop 2023-10-06T01:41:56.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.068+0000 7f6c918ca700 1 -- 172.21.15.71:0/699719602 shutdown_connections 2023-10-06T01:41:56.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.068+0000 7f6c918ca700 1 --2- 172.21.15.71:0/699719602 >> v2:172.21.15.72:3300/0 conn(0x7f6c8c0d07d0 0x7f6c8c0b3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:56.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.068+0000 7f6c918ca700 1 --2- 172.21.15.71:0/699719602 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c8c0d0400 0x7f6c8c0b5c30 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:56.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.068+0000 7f6c918ca700 1 -- 172.21.15.71:0/699719602 >> 172.21.15.71:0/699719602 conn(0x7f6c8c06a220 msgr2=0x7f6c8c06a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:56.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.068+0000 7f6c918ca700 1 -- 172.21.15.71:0/699719602 shutdown_connections 2023-10-06T01:41:56.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.068+0000 7f6c918ca700 1 -- 172.21.15.71:0/699719602 wait complete. 2023-10-06T01:41:56.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.069+0000 7f6c918ca700 1 Processor -- start 2023-10-06T01:41:56.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.069+0000 7f6c918ca700 1 -- start start 2023-10-06T01:41:56.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.070+0000 7f6c918ca700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c8c0ccd40 0x7f6c8c0b0d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:56.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.070+0000 7f6c918ca700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c8c0d0400 0x7f6c8c0b1240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:56.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.070+0000 7f6c918ca700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6c8c0d07d0 0x7f6c8c15be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:56.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.070+0000 7f6c918ca700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8c148640 con 0x7f6c8c0d0400 2023-10-06T01:41:56.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.070+0000 7f6c918ca700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8c0cbe50 con 0x7f6c8c0ccd40 2023-10-06T01:41:56.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.070+0000 7f6c918ca700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8c147d10 con 0x7f6c8c0d07d0 2023-10-06T01:41:56.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.070+0000 7f6c8a7fc700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c8c0d0400 0x7f6c8c0b1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:56.074 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.070+0000 7f6c8a7fc700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c8c0d0400 0x7f6c8c0b1240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51138/0 (socket says 172.21.15.71:51138) 2023-10-06T01:41:56.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.070+0000 7f6c8a7fc700 1 -- 172.21.15.71:0/3826297213 learned_addr learned my addr 172.21.15.71:0/3826297213 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:56.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.070+0000 7f6c8affd700 1 --2- 172.21.15.71:0/3826297213 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c8c0ccd40 0x7f6c8c0b0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:56.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.070+0000 7f6c8b7fe700 1 --2- 172.21.15.71:0/3826297213 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6c8c0d07d0 0x7f6c8c15be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:56.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.070+0000 7f6c8a7fc700 1 -- 172.21.15.71:0/3826297213 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6c8c0d07d0 msgr2=0x7f6c8c15be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:56.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.070+0000 7f6c8a7fc700 1 --2- 172.21.15.71:0/3826297213 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6c8c0d07d0 0x7f6c8c15be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:56.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.070+0000 7f6c8a7fc700 1 -- 172.21.15.71:0/3826297213 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c8c0ccd40 msgr2=0x7f6c8c0b0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:56.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.070+0000 7f6c8a7fc700 1 --2- 172.21.15.71:0/3826297213 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c8c0ccd40 0x7f6c8c0b0d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:56.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.070+0000 7f6c8a7fc700 1 -- 172.21.15.71:0/3826297213 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c7c0093c0 con 0x7f6c8c0d0400 2023-10-06T01:41:56.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.070+0000 7f6c8b7fe700 1 --2- 172.21.15.71:0/3826297213 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6c8c0d07d0 0x7f6c8c15be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:41:56.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.070+0000 7f6c8affd700 1 --2- 172.21.15.71:0/3826297213 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c8c0ccd40 0x7f6c8c0b0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:41:56.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.070+0000 7f6c8a7fc700 1 --2- 172.21.15.71:0/3826297213 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c8c0d0400 0x7f6c8c0b1240 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f6c8000c810 tx=0x7f6c80007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:56.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.071+0000 7f6c72ffd700 1 -- 172.21.15.71:0/3826297213 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c80005b30 con 0x7f6c8c0d0400 2023-10-06T01:41:56.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.071+0000 7f6c72ffd700 1 -- 172.21.15.71:0/3826297213 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c80005c90 con 0x7f6c8c0d0400 2023-10-06T01:41:56.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.071+0000 7f6c918ca700 1 -- 172.21.15.71:0/3826297213 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c8c147ff0 con 0x7f6c8c0d0400 2023-10-06T01:41:56.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.071+0000 7f6c72ffd700 1 -- 172.21.15.71:0/3826297213 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c80007300 con 0x7f6c8c0d0400 2023-10-06T01:41:56.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.071+0000 7f6c918ca700 1 -- 172.21.15.71:0/3826297213 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c8c15c360 con 0x7f6c8c0d0400 2023-10-06T01:41:56.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.072+0000 7f6c918ca700 1 -- 172.21.15.71:0/3826297213 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c8c088760 con 0x7f6c8c0d0400 2023-10-06T01:41:56.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.072+0000 7f6c72ffd700 1 -- 172.21.15.71:0/3826297213 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6c8001b400 con 0x7f6c8c0d0400 2023-10-06T01:41:56.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.072+0000 7f6c72ffd700 1 --2- 172.21.15.71:0/3826297213 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f6c78066f30 0x7f6c780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:56.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.072+0000 7f6c72ffd700 1 -- 172.21.15.71:0/3826297213 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f6c80083f80 con 0x7f6c8c0d0400 2023-10-06T01:41:56.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.072+0000 7f6c8affd700 1 --2- 172.21.15.71:0/3826297213 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f6c78066f30 0x7f6c780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:56.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.073+0000 7f6c8affd700 1 --2- 172.21.15.71:0/3826297213 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f6c78066f30 0x7f6c780693e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c009160 tx=0x7f6c7c016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:56.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.076+0000 7f6c72ffd700 1 -- 172.21.15.71:0/3826297213 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6c80051320 con 0x7f6c8c0d0400 2023-10-06T01:41:56.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.259+0000 7f6c918ca700 1 -- 172.21.15.71:0/3826297213 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6c8c0ced80 con 0x7f6c8c0d0400 2023-10-06T01:41:56.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.260+0000 7f6c72ffd700 1 -- 172.21.15.71:0/3826297213 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v50) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6c80054940 con 0x7f6c8c0d0400 2023-10-06T01:41:56.261 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 8 2023-10-06T01:41:56.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.262+0000 7f6c918ca700 1 -- 172.21.15.71:0/3826297213 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f6c78066f30 msgr2=0x7f6c780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:56.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.262+0000 7f6c918ca700 1 --2- 172.21.15.71:0/3826297213 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f6c78066f30 0x7f6c780693e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c009160 tx=0x7f6c7c016000 comp rx=0 tx=0).stop 2023-10-06T01:41:56.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.262+0000 7f6c918ca700 1 -- 172.21.15.71:0/3826297213 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c8c0d0400 msgr2=0x7f6c8c0b1240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:56.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.262+0000 7f6c918ca700 1 --2- 172.21.15.71:0/3826297213 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c8c0d0400 0x7f6c8c0b1240 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f6c8000c810 tx=0x7f6c80007df0 comp rx=0 tx=0).stop 2023-10-06T01:41:56.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.262+0000 7f6c918ca700 1 -- 172.21.15.71:0/3826297213 shutdown_connections 2023-10-06T01:41:56.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.262+0000 7f6c918ca700 1 --2- 172.21.15.71:0/3826297213 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6c8c0d07d0 0x7f6c8c15be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:56.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.262+0000 7f6c918ca700 1 --2- 172.21.15.71:0/3826297213 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f6c78066f30 0x7f6c780693e0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:56.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.262+0000 7f6c918ca700 1 --2- 172.21.15.71:0/3826297213 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c8c0ccd40 0x7f6c8c0b0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:56.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.262+0000 7f6c918ca700 1 --2- 172.21.15.71:0/3826297213 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c8c0d0400 0x7f6c8c0b1240 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:56.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.262+0000 7f6c918ca700 1 -- 172.21.15.71:0/3826297213 >> 172.21.15.71:0/3826297213 conn(0x7f6c8c06a220 msgr2=0x7f6c8c087200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:56.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.262+0000 7f6c918ca700 1 -- 172.21.15.71:0/3826297213 shutdown_connections 2023-10-06T01:41:56.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.262+0000 7f6c918ca700 1 -- 172.21.15.71:0/3826297213 wait complete. 2023-10-06T01:41:56.275 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T01:41:56.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.388+0000 7f9fa61c7700 1 Processor -- start 2023-10-06T01:41:56.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.388+0000 7f9fa61c7700 1 -- start start 2023-10-06T01:41:56.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.388+0000 7f9fa61c7700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9fa00af4e0 0x7f9fa00b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:56.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.388+0000 7f9fa61c7700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9fa015db70 0x7f9fa00b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:56.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.388+0000 7f9fa61c7700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fa015e190 con 0x7f9fa00af8b0 2023-10-06T01:41:56.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.388+0000 7f9fa61c7700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fa00b1910 con 0x7f9fa00af4e0 2023-10-06T01:41:56.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.388+0000 7f9fa61c7700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fa015dfa0 con 0x7f9fa015db70 2023-10-06T01:41:56.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.389+0000 7f9f9f7fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9fa00af4e0 0x7f9fa00b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:56.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.389+0000 7f9f9f7fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9fa00af4e0 0x7f9fa00b20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51152/0 (socket says 172.21.15.71:51152) 2023-10-06T01:41:56.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.389+0000 7f9f9f7fe700 1 -- 172.21.15.71:0/1430963201 learned_addr learned my addr 172.21.15.71:0/1430963201 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:56.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.389+0000 7f9f9ffff700 1 --2- 172.21.15.71:0/1430963201 >> v2:172.21.15.72:3300/0 conn(0x7f9fa015db70 0x7f9fa00b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:56.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.389+0000 7f9f9f7fe700 1 -- 172.21.15.71:0/1430963201 >> v2:172.21.15.72:3300/0 conn(0x7f9fa015db70 msgr2=0x7f9fa00b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:56.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.389+0000 7f9f9f7fe700 1 --2- 172.21.15.71:0/1430963201 >> v2:172.21.15.72:3300/0 conn(0x7f9fa015db70 0x7f9fa00b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:56.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.389+0000 7f9f9f7fe700 1 -- 172.21.15.71:0/1430963201 >> v1:172.21.15.72:6789/0 conn(0x7f9fa00af8b0 legacy=0x7f9fa015d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:56.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.389+0000 7f9f9f7fe700 1 -- 172.21.15.71:0/1430963201 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fa00cb650 con 0x7f9fa00af4e0 2023-10-06T01:41:56.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.389+0000 7f9f9f7fe700 1 --2- 172.21.15.71:0/1430963201 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9fa00af4e0 0x7f9fa00b20e0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f9fa00c7280 tx=0x7f9f90009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=171da819db983ee1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:56.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.389+0000 7f9f9e7fc700 1 -- 172.21.15.71:0/1430963201 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f9000b860 con 0x7f9fa00af4e0 2023-10-06T01:41:56.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.389+0000 7f9f9e7fc700 1 -- 172.21.15.71:0/1430963201 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f9000b9c0 con 0x7f9fa00af4e0 2023-10-06T01:41:56.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.389+0000 7f9f9e7fc700 1 -- 172.21.15.71:0/1430963201 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f9000bd60 con 0x7f9fa00af4e0 2023-10-06T01:41:56.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.390+0000 7f9fa61c7700 1 -- 172.21.15.71:0/1430963201 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9fa00af4e0 msgr2=0x7f9fa00b20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:56.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.390+0000 7f9fa61c7700 1 --2- 172.21.15.71:0/1430963201 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9fa00af4e0 0x7f9fa00b20e0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f9fa00c7280 tx=0x7f9f90009250 comp rx=0 tx=0).stop 2023-10-06T01:41:56.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.390+0000 7f9fa61c7700 1 -- 172.21.15.71:0/1430963201 shutdown_connections 2023-10-06T01:41:56.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.390+0000 7f9fa61c7700 1 --2- 172.21.15.71:0/1430963201 >> v2:172.21.15.72:3300/0 conn(0x7f9fa015db70 0x7f9fa00b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:56.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.390+0000 7f9fa61c7700 1 --2- 172.21.15.71:0/1430963201 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9fa00af4e0 0x7f9fa00b20e0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:56.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.390+0000 7f9fa61c7700 1 -- 172.21.15.71:0/1430963201 >> 172.21.15.71:0/1430963201 conn(0x7f9fa0068680 msgr2=0x7f9fa0068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:56.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.390+0000 7f9fa61c7700 1 -- 172.21.15.71:0/1430963201 shutdown_connections 2023-10-06T01:41:56.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.390+0000 7f9fa61c7700 1 -- 172.21.15.71:0/1430963201 wait complete. 2023-10-06T01:41:56.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.391+0000 7f9fa61c7700 1 Processor -- start 2023-10-06T01:41:56.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.391+0000 7f9fa61c7700 1 -- start start 2023-10-06T01:41:56.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.392+0000 7f9fa61c7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9fa00af4e0 0x7f9fa00d0e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:56.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.392+0000 7f9fa61c7700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9fa00af8b0 0x7f9fa0152280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:56.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.392+0000 7f9fa61c7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9fa015db70 0x7f9fa01510d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:56.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.392+0000 7f9fa61c7700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa00cff10 con 0x7f9fa00af8b0 2023-10-06T01:41:56.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.392+0000 7f9fa61c7700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa01527c0 con 0x7f9fa015db70 2023-10-06T01:41:56.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.392+0000 7f9fa61c7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa0151610 con 0x7f9fa00af4e0 2023-10-06T01:41:56.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.392+0000 7f9f9effd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9fa00af8b0 0x7f9fa0152280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:56.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.392+0000 7f9f9effd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9fa00af8b0 0x7f9fa0152280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51166/0 (socket says 172.21.15.71:51166) 2023-10-06T01:41:56.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.392+0000 7f9f9effd700 1 -- 172.21.15.71:0/588464484 learned_addr learned my addr 172.21.15.71:0/588464484 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:56.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.392+0000 7f9f9f7fe700 1 --2- 172.21.15.71:0/588464484 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9fa00af4e0 0x7f9fa00d0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:56.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.392+0000 7f9f9ffff700 1 --2- 172.21.15.71:0/588464484 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9fa015db70 0x7f9fa01510d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:56.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.392+0000 7f9f9effd700 1 -- 172.21.15.71:0/588464484 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9fa00af4e0 msgr2=0x7f9fa00d0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:56.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.392+0000 7f9f9effd700 1 --2- 172.21.15.71:0/588464484 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9fa00af4e0 0x7f9fa00d0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:56.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.392+0000 7f9f9effd700 1 -- 172.21.15.71:0/588464484 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9fa015db70 msgr2=0x7f9fa01510d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:56.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.392+0000 7f9f9effd700 1 --2- 172.21.15.71:0/588464484 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9fa015db70 0x7f9fa01510d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:56.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.392+0000 7f9f9effd700 1 -- 172.21.15.71:0/588464484 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f900094f0 con 0x7f9fa00af8b0 2023-10-06T01:41:56.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.392+0000 7f9f9ffff700 1 --2- 172.21.15.71:0/588464484 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9fa015db70 0x7f9fa01510d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:41:56.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.392+0000 7f9f9effd700 1 --2- 172.21.15.71:0/588464484 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9fa00af8b0 0x7f9fa0152280 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f9f9400c7f0 tx=0x7f9f94007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:56.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.392+0000 7f9f877fe700 1 -- 172.21.15.71:0/588464484 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f94011590 con 0x7f9fa00af8b0 2023-10-06T01:41:56.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.393+0000 7f9fa61c7700 1 -- 172.21.15.71:0/588464484 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fa00d13f0 con 0x7f9fa00af8b0 2023-10-06T01:41:56.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.393+0000 7f9f877fe700 1 -- 172.21.15.71:0/588464484 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f94011710 con 0x7f9fa00af8b0 2023-10-06T01:41:56.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.393+0000 7f9f877fe700 1 -- 172.21.15.71:0/588464484 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f94011ad0 con 0x7f9fa00af8b0 2023-10-06T01:41:56.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.393+0000 7f9fa61c7700 1 -- 172.21.15.71:0/588464484 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fa00cf8c0 con 0x7f9fa00af8b0 2023-10-06T01:41:56.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.394+0000 7f9fa61c7700 1 -- 172.21.15.71:0/588464484 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fa00d0080 con 0x7f9fa00af8b0 2023-10-06T01:41:56.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.394+0000 7f9f877fe700 1 -- 172.21.15.71:0/588464484 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9f9401b3b0 con 0x7f9fa00af8b0 2023-10-06T01:41:56.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.394+0000 7f9f877fe700 1 --2- 172.21.15.71:0/588464484 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f9f8c066f30 0x7f9f8c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:56.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.394+0000 7f9f877fe700 1 -- 172.21.15.71:0/588464484 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f9f940839b0 con 0x7f9fa00af8b0 2023-10-06T01:41:56.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.394+0000 7f9f9f7fe700 1 --2- 172.21.15.71:0/588464484 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f9f8c066f30 0x7f9f8c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:56.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.395+0000 7f9f9f7fe700 1 --2- 172.21.15.71:0/588464484 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f9f8c066f30 0x7f9f8c0693e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9fa00c7280 tx=0x7f9f90017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:56.399 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.398+0000 7f9f877fe700 1 -- 172.21.15.71:0/588464484 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9f94050cd0 con 0x7f9fa00af8b0 2023-10-06T01:41:56.583 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.582+0000 7f9fa61c7700 1 -- 172.21.15.71:0/588464484 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f9fa00b0910 con 0x7f9fa00af8b0 2023-10-06T01:41:56.583 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.582+0000 7f9f877fe700 1 -- 172.21.15.71:0/588464484 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v50) v1 ==== 84+0+126 (secure 0 0 0) 0x7f9f94017070 con 0x7f9fa00af8b0 2023-10-06T01:41:56.583 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:41:56.584 INFO:teuthology.orchestra.run.smithi071.stdout:[ 2023-10-06T01:41:56.584 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-06T01:41:56.584 INFO:teuthology.orchestra.run.smithi071.stdout: "poolnum": 1, 2023-10-06T01:41:56.584 INFO:teuthology.orchestra.run.smithi071.stdout: "poolname": ".mgr" 2023-10-06T01:41:56.584 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-06T01:41:56.584 INFO:teuthology.orchestra.run.smithi071.stdout: { 2023-10-06T01:41:56.584 INFO:teuthology.orchestra.run.smithi071.stdout: "poolnum": 2, 2023-10-06T01:41:56.584 INFO:teuthology.orchestra.run.smithi071.stdout: "poolname": "rbd" 2023-10-06T01:41:56.585 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-06T01:41:56.585 INFO:teuthology.orchestra.run.smithi071.stdout:] 2023-10-06T01:41:56.586 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.584+0000 7f9fa61c7700 1 -- 172.21.15.71:0/588464484 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f9f8c066f30 msgr2=0x7f9f8c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:56.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.584+0000 7f9fa61c7700 1 --2- 172.21.15.71:0/588464484 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f9f8c066f30 0x7f9f8c0693e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9fa00c7280 tx=0x7f9f90017000 comp rx=0 tx=0).stop 2023-10-06T01:41:56.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.584+0000 7f9fa61c7700 1 -- 172.21.15.71:0/588464484 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9fa00af8b0 msgr2=0x7f9fa0152280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:56.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.584+0000 7f9fa61c7700 1 --2- 172.21.15.71:0/588464484 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9fa00af8b0 0x7f9fa0152280 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f9f9400c7f0 tx=0x7f9f94007f50 comp rx=0 tx=0).stop 2023-10-06T01:41:56.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.584+0000 7f9fa61c7700 1 -- 172.21.15.71:0/588464484 shutdown_connections 2023-10-06T01:41:56.587 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.584+0000 7f9fa61c7700 1 --2- 172.21.15.71:0/588464484 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f9f8c066f30 0x7f9f8c0693e0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:56.588 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.584+0000 7f9fa61c7700 1 --2- 172.21.15.71:0/588464484 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9fa015db70 0x7f9fa01510d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:56.588 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.584+0000 7f9fa61c7700 1 --2- 172.21.15.71:0/588464484 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9fa00af4e0 0x7f9fa00d0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:56.588 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.584+0000 7f9fa61c7700 1 --2- 172.21.15.71:0/588464484 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9fa00af8b0 0x7f9fa0152280 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:56.588 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.584+0000 7f9fa61c7700 1 -- 172.21.15.71:0/588464484 >> 172.21.15.71:0/588464484 conn(0x7f9fa0068680 msgr2=0x7f9fa00b23e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:56.588 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.584+0000 7f9fa61c7700 1 -- 172.21.15.71:0/588464484 shutdown_connections 2023-10-06T01:41:56.588 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.584+0000 7f9fa61c7700 1 -- 172.21.15.71:0/588464484 wait complete. 2023-10-06T01:41:56.597 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T01:41:56.598 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T01:41:56.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.715+0000 7f2fdcb2a700 1 Processor -- start 2023-10-06T01:41:56.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.715+0000 7f2fdcb2a700 1 -- start start 2023-10-06T01:41:56.718 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.715+0000 7f2fdcb2a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2fd8142df0 0x7f2fd80cc350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:56.718 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.715+0000 7f2fdcb2a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f2fd80cc890 0x7f2fd80d0260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:56.718 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.715+0000 7f2fdcb2a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2fd80d07a0 0x7f2fd80cea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:56.718 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.715+0000 7f2fdcb2a700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fd80d0c40 con 0x7f2fd80cc890 2023-10-06T01:41:56.718 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.715+0000 7f2fdcb2a700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fd815a710 con 0x7f2fd80d07a0 2023-10-06T01:41:56.718 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.715+0000 7f2fdcb2a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd8159b40 con 0x7f2fd8142df0 2023-10-06T01:41:56.718 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.716+0000 7f2fcdd9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f2fd80cc890 0x7f2fd80d0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:56.718 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.716+0000 7f2fcdd9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f2fd80cc890 0x7f2fd80d0260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51176/0 (socket says 172.21.15.71:51176) 2023-10-06T01:41:56.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.716+0000 7f2fcdd9b700 1 -- 172.21.15.71:0/33982806 learned_addr learned my addr 172.21.15.71:0/33982806 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:56.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.716+0000 7f2fcdd9b700 1 -- 172.21.15.71:0/33982806 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2fd8142df0 msgr2=0x7f2fd80cc350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:56.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.716+0000 7f2fcdd9b700 1 --2- 172.21.15.71:0/33982806 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2fd8142df0 0x7f2fd80cc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:56.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.716+0000 7f2fd6d9d700 1 --2- 172.21.15.71:0/33982806 >> v2:172.21.15.72:3300/0 conn(0x7f2fd80d07a0 0x7f2fd80cea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:56.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.716+0000 7f2fcdd9b700 1 -- 172.21.15.71:0/33982806 >> v2:172.21.15.72:3300/0 conn(0x7f2fd80d07a0 msgr2=0x7f2fd80cea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:56.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.716+0000 7f2fcdd9b700 1 --2- 172.21.15.71:0/33982806 >> v2:172.21.15.72:3300/0 conn(0x7f2fd80d07a0 0x7f2fd80cea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:56.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.716+0000 7f2fcdd9b700 1 -- 172.21.15.71:0/33982806 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fd8159de0 con 0x7f2fd80cc890 2023-10-06T01:41:56.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.716+0000 7f2fd6d9d700 1 --2- 172.21.15.71:0/33982806 >> v2:172.21.15.72:3300/0 conn(0x7f2fd80d07a0 0x7f2fd80cea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:41:56.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.716+0000 7f2fcdd9b700 1 --2- 172.21.15.71:0/33982806 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2fd80cc890 0x7f2fd80d0260 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f2fd8088430 tx=0x7f2fc0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9eea46c751f2fab8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:56.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.716+0000 7f2fd5d9b700 1 -- 172.21.15.71:0/33982806 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc000b860 con 0x7f2fd80cc890 2023-10-06T01:41:56.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.716+0000 7f2fd5d9b700 1 -- 172.21.15.71:0/33982806 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fc000b9c0 con 0x7f2fd80cc890 2023-10-06T01:41:56.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.716+0000 7f2fd5d9b700 1 -- 172.21.15.71:0/33982806 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc000bd60 con 0x7f2fd80cc890 2023-10-06T01:41:56.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.717+0000 7f2fdcb2a700 1 -- 172.21.15.71:0/33982806 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2fd80cc890 msgr2=0x7f2fd80d0260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:56.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.717+0000 7f2fdcb2a700 1 --2- 172.21.15.71:0/33982806 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2fd80cc890 0x7f2fd80d0260 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f2fd8088430 tx=0x7f2fc0009250 comp rx=0 tx=0).stop 2023-10-06T01:41:56.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.717+0000 7f2fdcb2a700 1 -- 172.21.15.71:0/33982806 shutdown_connections 2023-10-06T01:41:56.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.717+0000 7f2fdcb2a700 1 --2- 172.21.15.71:0/33982806 >> v2:172.21.15.72:3300/0 conn(0x7f2fd80d07a0 0x7f2fd80cea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:56.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.717+0000 7f2fdcb2a700 1 --2- 172.21.15.71:0/33982806 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2fd8142df0 0x7f2fd80cc350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:56.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.717+0000 7f2fdcb2a700 1 --2- 172.21.15.71:0/33982806 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2fd80cc890 0x7f2fd80d0260 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:56.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.717+0000 7f2fdcb2a700 1 -- 172.21.15.71:0/33982806 >> 172.21.15.71:0/33982806 conn(0x7f2fd80690f0 msgr2=0x7f2fd806a340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:56.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.717+0000 7f2fdcb2a700 1 -- 172.21.15.71:0/33982806 shutdown_connections 2023-10-06T01:41:56.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.717+0000 7f2fdcb2a700 1 -- 172.21.15.71:0/33982806 wait complete. 2023-10-06T01:41:56.723 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.718+0000 7f2fdcb2a700 1 Processor -- start 2023-10-06T01:41:56.723 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.718+0000 7f2fdcb2a700 1 -- start start 2023-10-06T01:41:56.723 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.719+0000 7f2fdcb2a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2fd80cc890 0x7f2fd8141090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:56.723 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.719+0000 7f2fdcb2a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2fd80d07a0 0x7f2fd80c5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:56.723 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.719+0000 7f2fdcb2a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2fd8142df0 0x7f2fd8156240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:56.723 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.719+0000 7f2fdcb2a700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd8155db0 con 0x7f2fd8142df0 2023-10-06T01:41:56.723 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.719+0000 7f2fdcb2a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd81551e0 con 0x7f2fd80d07a0 2023-10-06T01:41:56.724 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.719+0000 7f2fdcb2a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd8155480 con 0x7f2fd80cc890 2023-10-06T01:41:56.724 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.719+0000 7f2fd6d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2fd8142df0 0x7f2fd8156240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:56.724 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.719+0000 7f2fd6d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2fd8142df0 0x7f2fd8156240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51190/0 (socket says 172.21.15.71:51190) 2023-10-06T01:41:56.724 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.719+0000 7f2fd6d9d700 1 -- 172.21.15.71:0/1602365549 learned_addr learned my addr 172.21.15.71:0/1602365549 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:56.724 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.719+0000 7f2fd659c700 1 --2- 172.21.15.71:0/1602365549 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2fd80cc890 0x7f2fd8141090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:56.724 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.719+0000 7f2fcdd9b700 1 --2- 172.21.15.71:0/1602365549 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2fd80d07a0 0x7f2fd80c5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:56.724 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.719+0000 7f2fd6d9d700 1 -- 172.21.15.71:0/1602365549 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2fd80cc890 msgr2=0x7f2fd8141090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:56.724 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.719+0000 7f2fd6d9d700 1 --2- 172.21.15.71:0/1602365549 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2fd80cc890 0x7f2fd8141090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:56.724 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.719+0000 7f2fd6d9d700 1 -- 172.21.15.71:0/1602365549 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2fd80d07a0 msgr2=0x7f2fd80c5960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:56.724 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.719+0000 7f2fd6d9d700 1 --2- 172.21.15.71:0/1602365549 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2fd80d07a0 0x7f2fd80c5960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:56.724 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.719+0000 7f2fd6d9d700 1 -- 172.21.15.71:0/1602365549 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fc00094f0 con 0x7f2fd8142df0 2023-10-06T01:41:56.724 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.719+0000 7f2fd6d9d700 1 --2- 172.21.15.71:0/1602365549 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2fd8142df0 0x7f2fd8156240 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f2fd000a380 tx=0x7f2fd0007900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:56.725 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.719+0000 7f2fceffd700 1 -- 172.21.15.71:0/1602365549 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd0015440 con 0x7f2fd8142df0 2023-10-06T01:41:56.725 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.719+0000 7f2fceffd700 1 -- 172.21.15.71:0/1602365549 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fd00155a0 con 0x7f2fd8142df0 2023-10-06T01:41:56.725 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.719+0000 7f2fceffd700 1 -- 172.21.15.71:0/1602365549 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd0015960 con 0x7f2fd8142df0 2023-10-06T01:41:56.725 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.719+0000 7f2fdcb2a700 1 -- 172.21.15.71:0/1602365549 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fd8155760 con 0x7f2fd8142df0 2023-10-06T01:41:56.725 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.719+0000 7f2fdcb2a700 1 -- 172.21.15.71:0/1602365549 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fd81415d0 con 0x7f2fd8142df0 2023-10-06T01:41:56.725 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.720+0000 7f2fdcb2a700 1 -- 172.21.15.71:0/1602365549 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fd8088ad0 con 0x7f2fd8142df0 2023-10-06T01:41:56.725 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.721+0000 7f2fceffd700 1 -- 172.21.15.71:0/1602365549 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2fd000d440 con 0x7f2fd8142df0 2023-10-06T01:41:56.725 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.721+0000 7f2fceffd700 1 --2- 172.21.15.71:0/1602365549 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f2fb8066f30 0x7f2fb80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:56.725 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.721+0000 7f2fceffd700 1 -- 172.21.15.71:0/1602365549 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f2fd0084eb0 con 0x7f2fd8142df0 2023-10-06T01:41:56.725 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.721+0000 7f2fd659c700 1 --2- 172.21.15.71:0/1602365549 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f2fb8066f30 0x7f2fb80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:56.725 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.721+0000 7f2fd659c700 1 --2- 172.21.15.71:0/1602365549 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f2fb8066f30 0x7f2fb80693e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f2fd80b2670 tx=0x7f2fc80091a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:56.726 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.725+0000 7f2fceffd700 1 -- 172.21.15.71:0/1602365549 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2fd00521d0 con 0x7f2fd8142df0 2023-10-06T01:41:56.908 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:56.908+0000 7f2fdcb2a700 1 -- 172.21.15.71:0/1602365549 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f2fd815a0c0 con 0x7f2fd8142df0 2023-10-06T01:41:57.898 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:57.897+0000 7f2fceffd700 1 -- 172.21.15.71:0/1602365549 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v51) v1 ==== 138+0+0 (secure 0 0 0) 0x7f2fd001a0b0 con 0x7f2fd8142df0 2023-10-06T01:41:57.902 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:57.901+0000 7f2fdcb2a700 1 -- 172.21.15.71:0/1602365549 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f2fb8066f30 msgr2=0x7f2fb80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:57.902 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:57.901+0000 7f2fdcb2a700 1 --2- 172.21.15.71:0/1602365549 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f2fb8066f30 0x7f2fb80693e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f2fd80b2670 tx=0x7f2fc80091a0 comp rx=0 tx=0).stop 2023-10-06T01:41:57.902 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:57.901+0000 7f2fdcb2a700 1 -- 172.21.15.71:0/1602365549 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2fd8142df0 msgr2=0x7f2fd8156240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:57.902 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:57.901+0000 7f2fdcb2a700 1 --2- 172.21.15.71:0/1602365549 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2fd8142df0 0x7f2fd8156240 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f2fd000a380 tx=0x7f2fd0007900 comp rx=0 tx=0).stop 2023-10-06T01:41:57.902 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:57.901+0000 7f2fdcb2a700 1 -- 172.21.15.71:0/1602365549 shutdown_connections 2023-10-06T01:41:57.902 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:57.901+0000 7f2fdcb2a700 1 --2- 172.21.15.71:0/1602365549 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2fd8142df0 0x7f2fd8156240 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:57.902 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:57.901+0000 7f2fdcb2a700 1 --2- 172.21.15.71:0/1602365549 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2fd80cc890 0x7f2fd8141090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:57.903 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:57.901+0000 7f2fdcb2a700 1 --2- 172.21.15.71:0/1602365549 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f2fb8066f30 0x7f2fb80693e0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:57.903 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:57.901+0000 7f2fdcb2a700 1 --2- 172.21.15.71:0/1602365549 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2fd80d07a0 0x7f2fd80c5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:57.903 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:57.901+0000 7f2fdcb2a700 1 -- 172.21.15.71:0/1602365549 >> 172.21.15.71:0/1602365549 conn(0x7f2fd80690f0 msgr2=0x7f2fd80b44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:57.903 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:57.902+0000 7f2fdcb2a700 1 -- 172.21.15.71:0/1602365549 shutdown_connections 2023-10-06T01:41:57.903 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:57.902+0000 7f2fdcb2a700 1 -- 172.21.15.71:0/1602365549 wait complete. 2023-10-06T01:41:57.906 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'cephfs_metadata' created 2023-10-06T01:41:57.920 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T01:41:58.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:58.046+0000 7f69db175700 1 Processor -- start 2023-10-06T01:41:58.047 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:58.046+0000 7f69db175700 1 -- start start 2023-10-06T01:41:58.050 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:58.047+0000 7f69db175700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f69d4087240 0x7f69d40cde70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:58.050 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:58.047+0000 7f69db175700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69d40cf740 con 0x7f69d4159530 2023-10-06T01:41:58.050 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:58.047+0000 7f69db175700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69d40ceb30 con 0x7f69d4087610 2023-10-06T01:41:58.050 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:58.047+0000 7f69db175700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69d40cee10 con 0x7f69d4087240 2023-10-06T01:41:58.050 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:58.047+0000 7f69d9712700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f69d4159530 0x7f69d40aff20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:49670/0 (socket says 172.21.15.71:49670) 2023-10-06T01:41:58.050 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:58.047+0000 7f69d9712700 1 -- 172.21.15.71:0/3858880355 learned_addr learned my addr 172.21.15.71:0/3858880355 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:41:58.050 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:58.047+0000 7f69d8f11700 1 --2- 172.21.15.71:0/3858880355 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f69d4087240 0x7f69d40cde70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:58.050 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:58.047+0000 7f69d37fe700 1 -- 172.21.15.71:0/3858880355 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 274595898 0 0) 0x7f69d40cf740 con 0x7f69d4159530 2023-10-06T01:41:58.051 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:58.047+0000 7f69d37fe700 1 -- 172.21.15.71:0/3858880355 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69c0003570 con 0x7f69d4159530 2023-10-06T01:41:58.051 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:58.047+0000 7f69d37fe700 1 -- 172.21.15.71:0/3858880355 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1951253687 0 0) 0x7f69d40ceb30 con 0x7f69d4087610 2023-10-06T01:41:58.051 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:58.047+0000 7f69d37fe700 1 -- 172.21.15.71:0/3858880355 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69d40cf740 con 0x7f69d4087610 2023-10-06T01:41:58.051 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:58.047+0000 7f69d37fe700 1 -- 172.21.15.71:0/3858880355 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1248221239 0 0) 0x7f69c0003570 con 0x7f69d4159530 2023-10-06T01:41:58.051 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:58.047+0000 7f69d37fe700 1 -- 172.21.15.71:0/3858880355 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f69d4087240 msgr2=0x7f69d40cde70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:58.051 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:58.047+0000 7f69d37fe700 1 --2- 172.21.15.71:0/3858880355 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f69d4087240 0x7f69d40cde70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:58.051 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:58.047+0000 7f69d37fe700 1 -- 172.21.15.71:0/3858880355 >> v1:172.21.15.72:6789/0 conn(0x7f69d4087610 legacy=0x7f69d4158e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:58.051 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:58.047+0000 7f69d37fe700 1 -- 172.21.15.71:0/3858880355 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69d40cf0f0 con 0x7f69d4159530 2023-10-06T01:41:58.051 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:58.047+0000 7f69d37fe700 1 -- 172.21.15.71:0/3858880355 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1184243524 0 0) 0x7f69cc0017f0 con 0x7f69d4159530 2023-10-06T01:41:58.051 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:58.047+0000 7f69d37fe700 1 -- 172.21.15.71:0/3858880355 >> v1:172.21.15.71:6789/0 conn(0x7f69d4159530 legacy=0x7f69d40aff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:58.051 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:58.047+0000 7f69d37fe700 1 --2- 172.21.15.71:0/3858880355 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69c0003c20 0x7f69c0004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:58.051 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:58.047+0000 7f69d37fe700 1 --2- 172.21.15.71:0/3858880355 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f69d4087240 0x7f69c0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:58.052 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:58.047+0000 7f69d37fe700 1 --2- 172.21.15.71:0/3858880355 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f69c0004d50 0x7f69c00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:58.052 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:58.047+0000 7f69d37fe700 1 -- 172.21.15.71:0/3858880355 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69d40cee10 con 0x7f69c0004d50 2023-10-06T01:41:58.052 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:58.047+0000 7f69d37fe700 1 -- 172.21.15.71:0/3858880355 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69c000bb40 con 0x7f69c0003c20 2023-10-06T01:41:58.052 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:58.047+0000 7f69d37fe700 1 -- 172.21.15.71:0/3858880355 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69c000bd00 con 0x7f69d4087240 2023-10-06T01:41:58.052 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:58.048+0000 7f69d9712700 1 --2- 172.21.15.71:0/3858880355 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f69c0004d50 0x7f69c00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:58.052 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:58.048+0000 7f69d3fff700 1 --2- 172.21.15.71:0/3858880355 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f69d4087240 0x7f69c0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:58.052 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:58.048+0000 7f69d8f11700 1 --2- 172.21.15.71:0/3858880355 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69c0003c20 0x7f69c0004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:58.052 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:58.048+0000 7f69d9712700 1 -- 172.21.15.71:0/3858880355 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f69d4087240 msgr2=0x7f69c0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:58.052 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:58.048+0000 7f69d9712700 1 --2- 172.21.15.71:0/3858880355 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f69d4087240 0x7f69c0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:58.052 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:58.048+0000 7f69d9712700 1 -- 172.21.15.71:0/3858880355 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69c0003c20 msgr2=0x7f69c0004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:58.052 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:58.048+0000 7f69d9712700 1 --2- 172.21.15.71:0/3858880355 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69c0003c20 0x7f69c0004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:58.052 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:58.048+0000 7f69d9712700 1 -- 172.21.15.71:0/3858880355 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69c0003570 con 0x7f69c0004d50 2023-10-06T01:41:58.053 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:58.048+0000 7f69d9712700 1 --2- 172.21.15.71:0/3858880355 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f69c0004d50 0x7f69c00051c0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f69cc00a8d0 tx=0x7f69cc002190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e2ed46e904050d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:58.053 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:58.048+0000 7f69d37fe700 1 -- 172.21.15.71:0/3858880355 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69cc0070d0 con 0x7f69c0004d50 2023-10-06T01:41:58.053 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:58.048+0000 7f69d37fe700 1 -- 172.21.15.71:0/3858880355 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69cc007230 con 0x7f69c0004d50 2023-10-06T01:41:58.053 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:58.048+0000 7f69d37fe700 1 -- 172.21.15.71:0/3858880355 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69cc0075f0 con 0x7f69c0004d50 2023-10-06T01:41:58.053 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:58.049+0000 7f69db175700 1 -- 172.21.15.71:0/3858880355 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f69c0004d50 msgr2=0x7f69c00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:58.053 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:58.049+0000 7f69db175700 1 --2- 172.21.15.71:0/3858880355 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f69c0004d50 0x7f69c00051c0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f69cc00a8d0 tx=0x7f69cc002190 comp rx=0 tx=0).stop 2023-10-06T01:41:58.053 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:58.049+0000 7f69d9712700 1 -- 172.21.15.71:0/3858880355 reap_dead start 2023-10-06T01:41:58.053 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:58.049+0000 7f69db175700 1 -- 172.21.15.71:0/3858880355 shutdown_connections 2023-10-06T01:41:58.053 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:58.049+0000 7f69db175700 1 -- 172.21.15.71:0/3858880355 >> 172.21.15.71:0/3858880355 conn(0x7f69d4069150 msgr2=0x7f69d40d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:58.053 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:58.049+0000 7f69db175700 1 -- 172.21.15.71:0/3858880355 shutdown_connections 2023-10-06T01:41:58.053 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:58.049+0000 7f69db175700 1 -- 172.21.15.71:0/3858880355 wait complete. 2023-10-06T01:41:58.056 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:58.050+0000 7f69db175700 1 Processor -- start 2023-10-06T01:41:58.057 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:58.050+0000 7f69db175700 1 -- start start 2023-10-06T01:41:58.057 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:58.051+0000 7f69db175700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69c0004d50 0x7f69d4153bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:58.057 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:58.051+0000 7f69db175700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f69d41521f0 0x7f69d4152bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:58.057 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:58.051+0000 7f69db175700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f69d4152660 0x7f69d416a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:58.057 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:58.051+0000 7f69db175700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69d415c890 con 0x7f69d4152660 2023-10-06T01:41:58.057 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:58.051+0000 7f69db175700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69d415d310 con 0x7f69c0004d50 2023-10-06T01:41:58.057 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:58.051+0000 7f69db175700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69d416a110 con 0x7f69d41521f0 2023-10-06T01:41:58.057 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:58.051+0000 7f69d9712700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f69d4152660 0x7f69d416a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:58.057 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:58.051+0000 7f69d9712700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f69d4152660 0x7f69d416a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51222/0 (socket says 172.21.15.71:51222) 2023-10-06T01:41:58.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:58.051+0000 7f69d9712700 1 -- 172.21.15.71:0/3618602794 learned_addr learned my addr 172.21.15.71:0/3618602794 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:58.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:58.051+0000 7f69d3fff700 1 --2- 172.21.15.71:0/3618602794 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f69d41521f0 0x7f69d4152bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:58.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:58.051+0000 7f69d8f11700 1 --2- 172.21.15.71:0/3618602794 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69c0004d50 0x7f69d4153bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:58.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:58.051+0000 7f69d9712700 1 -- 172.21.15.71:0/3618602794 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f69d41521f0 msgr2=0x7f69d4152bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:58.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:58.051+0000 7f69d9712700 1 --2- 172.21.15.71:0/3618602794 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f69d41521f0 0x7f69d4152bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:58.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:58.051+0000 7f69d9712700 1 -- 172.21.15.71:0/3618602794 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69c0004d50 msgr2=0x7f69d4153bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:58.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:58.051+0000 7f69d9712700 1 --2- 172.21.15.71:0/3618602794 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69c0004d50 0x7f69d4153bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:58.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:58.051+0000 7f69d9712700 1 -- 172.21.15.71:0/3618602794 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69d416a3b0 con 0x7f69d4152660 2023-10-06T01:41:58.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:58.051+0000 7f69d3fff700 1 --2- 172.21.15.71:0/3618602794 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f69d41521f0 0x7f69d4152bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:41:58.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:58.051+0000 7f69d9712700 1 --2- 172.21.15.71:0/3618602794 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f69d4152660 0x7f69d416a840 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f69c0004790 tx=0x7f69cc016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:58.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:58.051+0000 7f69d0ff9700 1 -- 172.21.15.71:0/3618602794 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69cc004bb0 con 0x7f69d4152660 2023-10-06T01:41:58.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:58.051+0000 7f69d0ff9700 1 -- 172.21.15.71:0/3618602794 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69cc004d10 con 0x7f69d4152660 2023-10-06T01:41:58.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:58.051+0000 7f69db175700 1 -- 172.21.15.71:0/3618602794 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69d415ca70 con 0x7f69d4152660 2023-10-06T01:41:58.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:58.051+0000 7f69d0ff9700 1 -- 172.21.15.71:0/3618602794 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69cc01e680 con 0x7f69d4152660 2023-10-06T01:41:58.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:58.051+0000 7f69db175700 1 -- 172.21.15.71:0/3618602794 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69d415d030 con 0x7f69d4152660 2023-10-06T01:41:58.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:58.052+0000 7f69db175700 1 -- 172.21.15.71:0/3618602794 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69d416a540 con 0x7f69d4152660 2023-10-06T01:41:58.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:58.053+0000 7f69d0ff9700 1 -- 172.21.15.71:0/3618602794 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f69cc01ea30 con 0x7f69d4152660 2023-10-06T01:41:58.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:58.053+0000 7f69d0ff9700 1 --2- 172.21.15.71:0/3618602794 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f69b4066f30 0x7f69b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:58.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:58.053+0000 7f69d0ff9700 1 -- 172.21.15.71:0/3618602794 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5896+0+0 (secure 0 0 0) 0x7f69cc086100 con 0x7f69d4152660 2023-10-06T01:41:58.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:58.053+0000 7f69d8f11700 1 --2- 172.21.15.71:0/3618602794 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f69b4066f30 0x7f69b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:58.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:58.053+0000 7f69d8f11700 1 --2- 172.21.15.71:0/3618602794 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f69b4066f30 0x7f69b40693e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f69d415c7e0 tx=0x7f69c40091a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:58.060 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:58.057+0000 7f69d0ff9700 1 -- 172.21.15.71:0/3618602794 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f69cc0532b0 con 0x7f69d4152660 2023-10-06T01:41:58.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:58.241+0000 7f69db175700 1 -- 172.21.15.71:0/3618602794 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f69d40cf3d0 con 0x7f69d4152660 2023-10-06T01:41:58.906 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:58.905+0000 7f69d0ff9700 1 -- 172.21.15.71:0/3618602794 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v52) v1 ==== 170+0+0 (secure 0 0 0) 0x7f69cc0568d0 con 0x7f69d4152660 2023-10-06T01:41:58.909 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:58.909+0000 7f69db175700 1 -- 172.21.15.71:0/3618602794 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f69b4066f30 msgr2=0x7f69b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:58.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:58.909+0000 7f69db175700 1 --2- 172.21.15.71:0/3618602794 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f69b4066f30 0x7f69b40693e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f69d415c7e0 tx=0x7f69c40091a0 comp rx=0 tx=0).stop 2023-10-06T01:41:58.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:58.909+0000 7f69db175700 1 -- 172.21.15.71:0/3618602794 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f69d4152660 msgr2=0x7f69d416a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:58.910 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:58.909+0000 7f69db175700 1 --2- 172.21.15.71:0/3618602794 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f69d4152660 0x7f69d416a840 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f69c0004790 tx=0x7f69cc016000 comp rx=0 tx=0).stop 2023-10-06T01:41:58.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:58.910+0000 7f69db175700 1 -- 172.21.15.71:0/3618602794 shutdown_connections 2023-10-06T01:41:58.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:58.910+0000 7f69db175700 1 --2- 172.21.15.71:0/3618602794 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f69d4152660 0x7f69d416a840 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:58.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:58.910+0000 7f69db175700 1 --2- 172.21.15.71:0/3618602794 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f69b4066f30 0x7f69b40693e0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:58.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:58.910+0000 7f69db175700 1 --2- 172.21.15.71:0/3618602794 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69c0004d50 0x7f69d4153bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:58.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:58.910+0000 7f69db175700 1 --2- 172.21.15.71:0/3618602794 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f69d41521f0 0x7f69d4152bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:58.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:58.910+0000 7f69db175700 1 -- 172.21.15.71:0/3618602794 >> 172.21.15.71:0/3618602794 conn(0x7f69d4069150 msgr2=0x7f69d40b2210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:58.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:58.911+0000 7f69db175700 1 -- 172.21.15.71:0/3618602794 shutdown_connections 2023-10-06T01:41:58.912 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:58.911+0000 7f69db175700 1 -- 172.21.15.71:0/3618602794 wait complete. 2023-10-06T01:41:58.915 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'cephfs_data' created 2023-10-06T01:41:58.934 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T01:41:59.053 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:59.052+0000 7f18be5f9700 1 Processor -- start 2023-10-06T01:41:59.053 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:59.052+0000 7f18be5f9700 1 -- start start 2023-10-06T01:41:59.053 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:59.053+0000 7f18be5f9700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f18b80d06e0 0x7f18b80b2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:59.053 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:59.053+0000 7f18be5f9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18b80b3910 0x7f18b80caef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:59.053 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:59.053+0000 7f18be5f9700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18b80b4c20 con 0x7f18b80d0310 2023-10-06T01:41:59.054 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:59.053+0000 7f18be5f9700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18b80b57c0 con 0x7f18b80d06e0 2023-10-06T01:41:59.054 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:59.053+0000 7f18be5f9700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18b80b3d50 con 0x7f18b80b3910 2023-10-06T01:41:59.055 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:59.053+0000 7f18bddf8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18b80b3910 0x7f18b80caef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:59.056 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:59.053+0000 7f18bcdf6700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f18b80d06e0 0x7f18b80b2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:59.056 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:59.053+0000 7f18bddf8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18b80b3910 0x7f18b80caef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.71:47870/0 (socket says 172.21.15.71:47870) 2023-10-06T01:41:59.056 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:59.053+0000 7f18bddf8700 1 -- 172.21.15.71:0/1052465098 learned_addr learned my addr 172.21.15.71:0/1052465098 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:59.056 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:59.053+0000 7f18bd5f7700 1 --1- 172.21.15.71:0/1052465098 >> v1:172.21.15.72:6789/0 conn(0x7f18b80d0310 0x7f18b80b50b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.71:45766/0 (socket says 172.21.15.71:45766) 2023-10-06T01:41:59.056 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:59.054+0000 7f18bddf8700 1 -- 172.21.15.71:0/1052465098 >> v2:172.21.15.72:3300/0 conn(0x7f18b80d06e0 msgr2=0x7f18b80b2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:41:59.056 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:59.054+0000 7f18bddf8700 1 --2- 172.21.15.71:0/1052465098 >> v2:172.21.15.72:3300/0 conn(0x7f18b80d06e0 0x7f18b80b2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:59.056 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:59.054+0000 7f18bddf8700 1 -- 172.21.15.71:0/1052465098 >> v1:172.21.15.72:6789/0 conn(0x7f18b80d0310 legacy=0x7f18b80b50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:59.056 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:59.054+0000 7f18affff700 1 -- 172.21.15.71:0/1052465098 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2055746136 0 0) 0x7f18b80b4c20 con 0x7f18b80d0310 2023-10-06T01:41:59.056 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:59.054+0000 7f18bddf8700 1 -- 172.21.15.71:0/1052465098 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18b80b4010 con 0x7f18b80b3910 2023-10-06T01:41:59.056 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:59.054+0000 7f18bcdf6700 1 --2- 172.21.15.71:0/1052465098 >> v2:172.21.15.72:3300/0 conn(0x7f18b80d06e0 0x7f18b80b2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:41:59.056 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:59.054+0000 7f18bddf8700 1 --2- 172.21.15.71:0/1052465098 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18b80b3910 0x7f18b80caef0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f18b0009f20 tx=0x7f18b0009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b264b0851781bfe server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:59.057 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:59.054+0000 7f18affff700 1 -- 172.21.15.71:0/1052465098 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b000e070 con 0x7f18b80b3910 2023-10-06T01:41:59.057 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:59.054+0000 7f18affff700 1 -- 172.21.15.71:0/1052465098 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18b000b9d0 con 0x7f18b80b3910 2023-10-06T01:41:59.057 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:59.054+0000 7f18affff700 1 -- 172.21.15.71:0/1052465098 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b00092e0 con 0x7f18b80b3910 2023-10-06T01:41:59.057 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:59.055+0000 7f18be5f9700 1 -- 172.21.15.71:0/1052465098 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18b80b3910 msgr2=0x7f18b80caef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:59.057 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:59.055+0000 7f18be5f9700 1 --2- 172.21.15.71:0/1052465098 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18b80b3910 0x7f18b80caef0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f18b0009f20 tx=0x7f18b0009840 comp rx=0 tx=0).stop 2023-10-06T01:41:59.057 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:59.055+0000 7f18be5f9700 1 -- 172.21.15.71:0/1052465098 shutdown_connections 2023-10-06T01:41:59.057 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:59.055+0000 7f18be5f9700 1 --2- 172.21.15.71:0/1052465098 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18b80b3910 0x7f18b80caef0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:59.057 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:59.055+0000 7f18be5f9700 1 --2- 172.21.15.71:0/1052465098 >> v2:172.21.15.72:3300/0 conn(0x7f18b80d06e0 0x7f18b80b2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:59.057 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:59.055+0000 7f18be5f9700 1 -- 172.21.15.71:0/1052465098 >> 172.21.15.71:0/1052465098 conn(0x7f18b806a110 msgr2=0x7f18b806a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:59.057 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:59.055+0000 7f18be5f9700 1 -- 172.21.15.71:0/1052465098 shutdown_connections 2023-10-06T01:41:59.057 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:59.055+0000 7f18be5f9700 1 -- 172.21.15.71:0/1052465098 wait complete. 2023-10-06T01:41:59.060 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:59.056+0000 7f18be5f9700 1 Processor -- start 2023-10-06T01:41:59.060 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:59.056+0000 7f18be5f9700 1 -- start start 2023-10-06T01:41:59.060 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:59.057+0000 7f18be5f9700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18b80b3910 0x7f18b8156ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:59.060 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:59.057+0000 7f18be5f9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18b80d0310 0x7f18b815bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:59.060 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:59.057+0000 7f18be5f9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18b80d06e0 0x7f18b80ccc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:59.060 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:59.057+0000 7f18be5f9700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b80c80c0 con 0x7f18b80b3910 2023-10-06T01:41:59.060 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:59.057+0000 7f18be5f9700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b81570e0 con 0x7f18b80d0310 2023-10-06T01:41:59.061 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:59.057+0000 7f18be5f9700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18b80c74b0 con 0x7f18b80d06e0 2023-10-06T01:41:59.061 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:59.057+0000 7f18bd5f7700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18b80b3910 0x7f18b8156ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:59.061 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:59.057+0000 7f18bd5f7700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18b80b3910 0x7f18b8156ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51226/0 (socket says 172.21.15.71:51226) 2023-10-06T01:41:59.061 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:59.057+0000 7f18bd5f7700 1 -- 172.21.15.71:0/4117293096 learned_addr learned my addr 172.21.15.71:0/4117293096 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:41:59.061 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:59.057+0000 7f18bddf8700 1 --2- 172.21.15.71:0/4117293096 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18b80d06e0 0x7f18b80ccc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:59.061 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:59.057+0000 7f18bcdf6700 1 --2- 172.21.15.71:0/4117293096 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18b80d0310 0x7f18b815bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:59.061 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:59.057+0000 7f18bddf8700 1 -- 172.21.15.71:0/4117293096 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18b80d0310 msgr2=0x7f18b815bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:59.061 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:59.057+0000 7f18bddf8700 1 --2- 172.21.15.71:0/4117293096 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18b80d0310 0x7f18b815bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:59.061 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:59.057+0000 7f18bddf8700 1 -- 172.21.15.71:0/4117293096 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18b80b3910 msgr2=0x7f18b8156ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:59.061 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:59.057+0000 7f18bddf8700 1 --2- 172.21.15.71:0/4117293096 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18b80b3910 0x7f18b8156ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:59.061 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:59.057+0000 7f18bddf8700 1 -- 172.21.15.71:0/4117293096 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18a8009420 con 0x7f18b80d06e0 2023-10-06T01:41:59.062 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:59.057+0000 7f18bd5f7700 1 --2- 172.21.15.71:0/4117293096 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18b80b3910 0x7f18b8156ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:41:59.062 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:59.057+0000 7f18bddf8700 1 --2- 172.21.15.71:0/4117293096 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18b80d06e0 0x7f18b80ccc40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f18b0015000 tx=0x7f18b0018000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:59.062 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:59.057+0000 7f18ad7fa700 1 -- 172.21.15.71:0/4117293096 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b0008ad0 con 0x7f18b80d06e0 2023-10-06T01:41:59.062 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:59.057+0000 7f18ad7fa700 1 -- 172.21.15.71:0/4117293096 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18b0008c30 con 0x7f18b80d06e0 2023-10-06T01:41:59.062 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:59.057+0000 7f18be5f9700 1 -- 172.21.15.71:0/4117293096 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18b0009ae0 con 0x7f18b80d06e0 2023-10-06T01:41:59.062 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:59.058+0000 7f18ad7fa700 1 -- 172.21.15.71:0/4117293096 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b001c410 con 0x7f18b80d06e0 2023-10-06T01:41:59.062 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:59.058+0000 7f18be5f9700 1 -- 172.21.15.71:0/4117293096 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18b80c7a70 con 0x7f18b80d06e0 2023-10-06T01:41:59.062 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:59.058+0000 7f18be5f9700 1 -- 172.21.15.71:0/4117293096 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18b8064aa0 con 0x7f18b80d06e0 2023-10-06T01:41:59.062 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:59.059+0000 7f18ad7fa700 1 -- 172.21.15.71:0/4117293096 <== mon.2 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f18b0003040 con 0x7f18b80d06e0 2023-10-06T01:41:59.062 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:59.059+0000 7f18ad7fa700 1 --2- 172.21.15.71:0/4117293096 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f189c066f30 0x7f189c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:41:59.062 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:59.059+0000 7f18ad7fa700 1 -- 172.21.15.71:0/4117293096 <== mon.2 v2:172.21.15.72:3301/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6278+0+0 (secure 0 0 0) 0x7f18b0086170 con 0x7f18b80d06e0 2023-10-06T01:41:59.063 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:59.059+0000 7f18bd5f7700 1 --2- 172.21.15.71:0/4117293096 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f189c066f30 0x7f189c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:41:59.063 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:59.060+0000 7f18bd5f7700 1 --2- 172.21.15.71:0/4117293096 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f189c066f30 0x7f189c0693e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f18b80b00c0 tx=0x7f18b4007e10 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:41:59.064 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:59.064+0000 7f18ad7fa700 1 -- 172.21.15.71:0/4117293096 <== mon.2 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f18b00531a0 con 0x7f18b80d06e0 2023-10-06T01:41:59.288 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:59.288+0000 7f18be5f9700 1 -- 172.21.15.71:0/4117293096 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f18b80b42f0 con 0x7f18b80d06e0 2023-10-06T01:41:59.911 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:59.910+0000 7f18ad7fa700 1 -- 172.21.15.71:0/4117293096 <== mon.2 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v27) v1 ==== 172+0+0 (secure 0 0 0) 0x7f18b00567c0 con 0x7f18b80d06e0 2023-10-06T01:41:59.928 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:59.928+0000 7f18be5f9700 1 -- 172.21.15.71:0/4117293096 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f189c066f30 msgr2=0x7f189c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:59.929 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:59.928+0000 7f18be5f9700 1 --2- 172.21.15.71:0/4117293096 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f189c066f30 0x7f189c0693e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f18b80b00c0 tx=0x7f18b4007e10 comp rx=0 tx=0).stop 2023-10-06T01:41:59.929 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:59.928+0000 7f18be5f9700 1 -- 172.21.15.71:0/4117293096 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18b80d06e0 msgr2=0x7f18b80ccc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:41:59.929 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:59.928+0000 7f18be5f9700 1 --2- 172.21.15.71:0/4117293096 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18b80d06e0 0x7f18b80ccc40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f18b0015000 tx=0x7f18b0018000 comp rx=0 tx=0).stop 2023-10-06T01:41:59.929 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:59.928+0000 7f18be5f9700 1 -- 172.21.15.71:0/4117293096 shutdown_connections 2023-10-06T01:41:59.929 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:59.928+0000 7f18be5f9700 1 --2- 172.21.15.71:0/4117293096 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18b80d06e0 0x7f18b80ccc40 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:59.930 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:59.928+0000 7f18be5f9700 1 --2- 172.21.15.71:0/4117293096 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f18b80b3910 0x7f18b8156ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:59.930 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:59.928+0000 7f18be5f9700 1 --2- 172.21.15.71:0/4117293096 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f189c066f30 0x7f189c0693e0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:59.930 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:59.928+0000 7f18be5f9700 1 --2- 172.21.15.71:0/4117293096 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18b80d0310 0x7f18b815bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:41:59.930 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:59.928+0000 7f18be5f9700 1 -- 172.21.15.71:0/4117293096 >> 172.21.15.71:0/4117293096 conn(0x7f18b806a110 msgr2=0x7f18b80cf5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:41:59.930 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:59.929+0000 7f18be5f9700 1 -- 172.21.15.71:0/4117293096 shutdown_connections 2023-10-06T01:41:59.930 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:41:59.929+0000 7f18be5f9700 1 -- 172.21.15.71:0/4117293096 wait complete. 2023-10-06T01:41:59.931 INFO:teuthology.orchestra.run.smithi071.stderr:new fs with metadata pool 8 and data pool 9 2023-10-06T01:41:59.944 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:42:00.057 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.057+0000 7f126065d700 1 Processor -- start 2023-10-06T01:42:00.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.057+0000 7f126065d700 1 -- start start 2023-10-06T01:42:00.061 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.058+0000 7f126065d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f12580af4e0 0x7f12580b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:00.061 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.058+0000 7f126065d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f125815e190 con 0x7f125815db70 2023-10-06T01:42:00.061 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.058+0000 7f126065d700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12580cb650 con 0x7f12580af8b0 2023-10-06T01:42:00.061 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.058+0000 7f126065d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12580b1910 con 0x7f12580af4e0 2023-10-06T01:42:00.061 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.058+0000 7f125ebfa700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f125815db70 0x7f12580cbae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:33000/0 (socket says 172.21.15.71:33000) 2023-10-06T01:42:00.061 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.058+0000 7f125ebfa700 1 -- 172.21.15.71:0/1058449083 learned_addr learned my addr 172.21.15.71:0/1058449083 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:42:00.061 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.058+0000 7f125e3f9700 1 --2- 172.21.15.71:0/1058449083 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f12580af4e0 0x7f12580b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:00.061 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.058+0000 7f125d3f7700 1 -- 172.21.15.71:0/1058449083 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2628889675 0 0) 0x7f125815e190 con 0x7f125815db70 2023-10-06T01:42:00.061 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.058+0000 7f125d3f7700 1 -- 172.21.15.71:0/1058449083 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1240003570 con 0x7f125815db70 2023-10-06T01:42:00.061 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.058+0000 7f125d3f7700 1 -- 172.21.15.71:0/1058449083 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3477143291 0 0) 0x7f1240003570 con 0x7f125815db70 2023-10-06T01:42:00.062 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.058+0000 7f125d3f7700 1 -- 172.21.15.71:0/1058449083 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f12580af4e0 msgr2=0x7f12580b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:00.062 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.058+0000 7f125d3f7700 1 --2- 172.21.15.71:0/1058449083 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f12580af4e0 0x7f12580b20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:00.062 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.058+0000 7f125d3f7700 1 -- 172.21.15.71:0/1058449083 >> v1:172.21.15.72:6789/0 conn(0x7f12580af8b0 legacy=0x7f125815d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:00.062 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.058+0000 7f125d3f7700 1 -- 172.21.15.71:0/1058449083 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12580cad20 con 0x7f125815db70 2023-10-06T01:42:00.062 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.058+0000 7f125d3f7700 1 -- 172.21.15.71:0/1058449083 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1184243524 0 0) 0x7f1248001470 con 0x7f125815db70 2023-10-06T01:42:00.062 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.058+0000 7f125d3f7700 1 -- 172.21.15.71:0/1058449083 >> v1:172.21.15.71:6789/0 conn(0x7f125815db70 legacy=0x7f12580cbae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:00.062 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.058+0000 7f125d3f7700 1 --2- 172.21.15.71:0/1058449083 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1240003a90 0x7f1240003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:00.062 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.058+0000 7f125d3f7700 1 --2- 172.21.15.71:0/1058449083 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f12580af4e0 0x7f1240004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:00.062 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.058+0000 7f125d3f7700 1 --2- 172.21.15.71:0/1058449083 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1240004d50 0x7f12400051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:00.062 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.058+0000 7f125d3f7700 1 -- 172.21.15.71:0/1058449083 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12580b1910 con 0x7f1240004d50 2023-10-06T01:42:00.062 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.058+0000 7f125d3f7700 1 -- 172.21.15.71:0/1058449083 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f124000bb70 con 0x7f1240003a90 2023-10-06T01:42:00.062 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.058+0000 7f125d3f7700 1 -- 172.21.15.71:0/1058449083 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f124000bd30 con 0x7f12580af4e0 2023-10-06T01:42:00.063 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.059+0000 7f125ebfa700 1 --2- 172.21.15.71:0/1058449083 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1240004d50 0x7f12400051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:00.063 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.059+0000 7f125e3f9700 1 --2- 172.21.15.71:0/1058449083 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1240003a90 0x7f1240003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:00.063 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.059+0000 7f125dbf8700 1 --2- 172.21.15.71:0/1058449083 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f12580af4e0 0x7f1240004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:00.063 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.059+0000 7f125ebfa700 1 -- 172.21.15.71:0/1058449083 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f12580af4e0 msgr2=0x7f1240004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:00.063 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.059+0000 7f125ebfa700 1 --2- 172.21.15.71:0/1058449083 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f12580af4e0 0x7f1240004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:00.063 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.059+0000 7f125ebfa700 1 -- 172.21.15.71:0/1058449083 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1240003a90 msgr2=0x7f1240003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:00.063 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.059+0000 7f125ebfa700 1 --2- 172.21.15.71:0/1058449083 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1240003a90 0x7f1240003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:00.063 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.059+0000 7f125ebfa700 1 -- 172.21.15.71:0/1058449083 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1240003570 con 0x7f1240004d50 2023-10-06T01:42:00.063 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.059+0000 7f125ebfa700 1 --2- 172.21.15.71:0/1058449083 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1240004d50 0x7f12400051c0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f124800c3c0 tx=0x7f1248001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a612844b7b20431 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:00.063 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.059+0000 7f125d3f7700 1 -- 172.21.15.71:0/1058449083 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f124800cc90 con 0x7f1240004d50 2023-10-06T01:42:00.063 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.059+0000 7f125d3f7700 1 -- 172.21.15.71:0/1058449083 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f124800cdf0 con 0x7f1240004d50 2023-10-06T01:42:00.063 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.059+0000 7f125d3f7700 1 -- 172.21.15.71:0/1058449083 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1248005b50 con 0x7f1240004d50 2023-10-06T01:42:00.064 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.060+0000 7f126065d700 1 -- 172.21.15.71:0/1058449083 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1240004d50 msgr2=0x7f12400051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:00.064 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.060+0000 7f126065d700 1 --2- 172.21.15.71:0/1058449083 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1240004d50 0x7f12400051c0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f124800c3c0 tx=0x7f1248001e50 comp rx=0 tx=0).stop 2023-10-06T01:42:00.064 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.060+0000 7f125ebfa700 1 -- 172.21.15.71:0/1058449083 reap_dead start 2023-10-06T01:42:00.064 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.060+0000 7f126065d700 1 -- 172.21.15.71:0/1058449083 shutdown_connections 2023-10-06T01:42:00.064 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.060+0000 7f126065d700 1 -- 172.21.15.71:0/1058449083 >> 172.21.15.71:0/1058449083 conn(0x7f1258068680 msgr2=0x7f1258068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:00.064 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.060+0000 7f126065d700 1 -- 172.21.15.71:0/1058449083 shutdown_connections 2023-10-06T01:42:00.064 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.060+0000 7f126065d700 1 -- 172.21.15.71:0/1058449083 wait complete. 2023-10-06T01:42:00.067 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.061+0000 7f126065d700 1 Processor -- start 2023-10-06T01:42:00.067 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.061+0000 7f126065d700 1 -- start start 2023-10-06T01:42:00.067 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.061+0000 7f126065d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1240004d50 0x7f12580cde20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:00.067 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.062+0000 7f126065d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1258152dc0 0x7f12580cfa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:00.067 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.062+0000 7f126065d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12580ce360 0x7f12580cff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:00.067 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.062+0000 7f126065d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f125815dfb0 con 0x7f1240004d50 2023-10-06T01:42:00.067 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.062+0000 7f126065d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1258151550 con 0x7f12580ce360 2023-10-06T01:42:00.067 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.062+0000 7f126065d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1258169e20 con 0x7f1258152dc0 2023-10-06T01:42:00.067 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.062+0000 7f125e3f9700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1240004d50 0x7f12580cde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:00.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.062+0000 7f125e3f9700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1240004d50 0x7f12580cde20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37940/0 (socket says 172.21.15.71:37940) 2023-10-06T01:42:00.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.062+0000 7f125e3f9700 1 -- 172.21.15.71:0/3357980308 learned_addr learned my addr 172.21.15.71:0/3357980308 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:00.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.062+0000 7f125dbf8700 1 --2- 172.21.15.71:0/3357980308 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1258152dc0 0x7f12580cfa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:00.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.062+0000 7f125ebfa700 1 --2- 172.21.15.71:0/3357980308 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12580ce360 0x7f12580cff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:00.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.062+0000 7f125e3f9700 1 -- 172.21.15.71:0/3357980308 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1258152dc0 msgr2=0x7f12580cfa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:00.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.062+0000 7f125e3f9700 1 --2- 172.21.15.71:0/3357980308 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1258152dc0 0x7f12580cfa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:00.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.062+0000 7f125e3f9700 1 -- 172.21.15.71:0/3357980308 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12580ce360 msgr2=0x7f12580cff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:00.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.062+0000 7f125e3f9700 1 --2- 172.21.15.71:0/3357980308 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12580ce360 0x7f12580cff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:00.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.062+0000 7f125e3f9700 1 -- 172.21.15.71:0/3357980308 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1258153260 con 0x7f1240004d50 2023-10-06T01:42:00.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.062+0000 7f125e3f9700 1 --2- 172.21.15.71:0/3357980308 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1240004d50 0x7f12580cde20 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f1250011f00 tx=0x7f125000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:00.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.062+0000 7f12567fc700 1 -- 172.21.15.71:0/3357980308 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f125000e040 con 0x7f1240004d50 2023-10-06T01:42:00.069 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.062+0000 7f12567fc700 1 -- 172.21.15.71:0/3357980308 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f125000f040 con 0x7f1240004d50 2023-10-06T01:42:00.069 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.062+0000 7f126065d700 1 -- 172.21.15.71:0/3357980308 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1258153540 con 0x7f1240004d50 2023-10-06T01:42:00.069 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.062+0000 7f12567fc700 1 -- 172.21.15.71:0/3357980308 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f125000fe70 con 0x7f1240004d50 2023-10-06T01:42:00.069 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.062+0000 7f126065d700 1 -- 172.21.15.71:0/3357980308 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1258153b00 con 0x7f1240004d50 2023-10-06T01:42:00.069 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.063+0000 7f126065d700 1 -- 172.21.15.71:0/3357980308 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12580b59e0 con 0x7f1240004d50 2023-10-06T01:42:00.069 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.064+0000 7f12567fc700 1 -- 172.21.15.71:0/3357980308 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1250015640 con 0x7f1240004d50 2023-10-06T01:42:00.069 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.064+0000 7f12567fc700 1 --2- 172.21.15.71:0/3357980308 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f1244066f30 0x7f12440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:00.069 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.064+0000 7f12567fc700 1 -- 172.21.15.71:0/3357980308 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f12500853a0 con 0x7f1240004d50 2023-10-06T01:42:00.069 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.064+0000 7f125dbf8700 1 --2- 172.21.15.71:0/3357980308 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f1244066f30 0x7f12440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:00.069 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.064+0000 7f125dbf8700 1 --2- 172.21.15.71:0/3357980308 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f1244066f30 0x7f12440693e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f1258152390 tx=0x7f124c007d30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:00.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.069+0000 7f12567fc700 1 -- 172.21.15.71:0/3357980308 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1250052370 con 0x7f1240004d50 2023-10-06T01:42:00.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.252+0000 7f126065d700 1 -- 172.21.15.71:0/3357980308 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f12580cb000 con 0x7f1240004d50 2023-10-06T01:42:00.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.253+0000 7f12567fc700 1 -- 172.21.15.71:0/3357980308 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+17036 (secure 0 0 0) 0x7f1250055990 con 0x7f1240004d50 2023-10-06T01:42:00.254 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:42:00.254 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":53,"fsid":"1fbf1bd2-f9b4-4599-bea2-f4aa920e9a56","created":"2023-10-06T01:39:57.016957+0000","modified":"2023-10-06T01:41:59.289806+0000","last_up_change":"2023-10-06T01:40:08.571643+0000","last_in_change":"2023-10-06T01:39:59.462741+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T01:40:08.610349+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T01:40:15.387434+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-06T01:41:56.925792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-06T01:41:58.259205+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cf059188-fb20-4dbf-95db-dcf57b213d03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":90670},{"type":"v1","addr":"172.21.15.71:6817","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":90670},{"type":"v1","addr":"172.21.15.71:6819","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":90670},{"type":"v1","addr":"172.21.15.71:6823","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":90670},{"type":"v1","addr":"172.21.15.71:6821","nonce":90670}]},"public_addr":"172.21.15.71:6817/90670","cluster_addr":"172.21.15.71:6819/90670","heartbeat_back_addr":"172.21.15.71:6823/90670","heartbeat_front_addr":"172.21.15.71:6821/90670","state":["exists","up"]},{"osd":1,"uuid":"0cff0aae-1799-4fe0-b610-54cf0813c0e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":90669},{"type":"v1","addr":"172.21.15.71:6809","nonce":90669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":90669},{"type":"v1","addr":"172.21.15.71:6811","nonce":90669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":90669},{"type":"v1","addr":"172.21.15.71:6815","nonce":90669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":90669},{"type":"v1","addr":"172.21.15.71:6813","nonce":90669}]},"public_addr":"172.21.15.71:6809/90669","cluster_addr":"172.21.15.71:6811/90669","heartbeat_back_addr":"172.21.15.71:6815/90669","heartbeat_front_addr":"172.21.15.71:6813/90669","state":["exists","up"]},{"osd":2,"uuid":"88d61ddc-9031-44e1-ba8c-546a41e7c8ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":90679},{"type":"v1","addr":"172.21.15.71:6825","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":90679},{"type":"v1","addr":"172.21.15.71:6827","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":90679},{"type":"v1","addr":"172.21.15.71:6831","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":90679},{"type":"v1","addr":"172.21.15.71:6829","nonce":90679}]},"public_addr":"172.21.15.71:6825/90679","cluster_addr":"172.21.15.71:6827/90679","heartbeat_back_addr":"172.21.15.71:6831/90679","heartbeat_front_addr":"172.21.15.71:6829/90679","state":["exists","up"]},{"osd":3,"uuid":"11ed92b7-960b-4a30-a889-a61d3eeb86f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":90668},{"type":"v1","addr":"172.21.15.71:6801","nonce":90668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":90668},{"type":"v1","addr":"172.21.15.71:6803","nonce":90668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":90668},{"type":"v1","addr":"172.21.15.71:6807","nonce":90668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":90668},{"type":"v1","addr":"172.21.15.71:6805","nonce":90668}]},"public_addr":"172.21.15.71:6801/90668","cluster_addr":"172.21.15.71:6803/90668","heartbeat_back_addr":"172.21.15.71:6807/90668","heartbeat_front_addr":"172.21.15.71:6805/90668","state":["exists","up"]},{"osd":4,"uuid":"ae4df784-abdf-4ddf-aefa-780f3ddafef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":90917},{"type":"v1","addr":"172.21.15.72:6801","nonce":90917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":90917},{"type":"v1","addr":"172.21.15.72:6803","nonce":90917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":90917},{"type":"v1","addr":"172.21.15.72:6807","nonce":90917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":90917},{"type":"v1","addr":"172.21.15.72:6805","nonce":90917}]},"public_addr":"172.21.15.72:6801/90917","cluster_addr":"172.21.15.72:6803/90917","heartbeat_back_addr":"172.21.15.72:6807/90917","heartbeat_front_addr":"172.21.15.72:6805/90917","state":["exists","up"]},{"osd":5,"uuid":"5ef0790f-001e-458f-a05b-efae216cf435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":90941},{"type":"v1","addr":"172.21.15.72:6817","nonce":90941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":90941},{"type":"v1","addr":"172.21.15.72:6819","nonce":90941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":90941},{"type":"v1","addr":"172.21.15.72:6827","nonce":90941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":90941},{"type":"v1","addr":"172.21.15.72:6823","nonce":90941}]},"public_addr":"172.21.15.72:6817/90941","cluster_addr":"172.21.15.72:6819/90941","heartbeat_back_addr":"172.21.15.72:6827/90941","heartbeat_front_addr":"172.21.15.72:6823/90941","state":["exists","up"]},{"osd":6,"uuid":"8705aef1-9ae8-4e54-a3c4-c2909fa0ceb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":90918},{"type":"v1","addr":"172.21.15.72:6809","nonce":90918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":90918},{"type":"v1","addr":"172.21.15.72:6811","nonce":90918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":90918},{"type":"v1","addr":"172.21.15.72:6815","nonce":90918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":90918},{"type":"v1","addr":"172.21.15.72:6813","nonce":90918}]},"public_addr":"172.21.15.72:6809/90918","cluster_addr":"172.21.15.72:6811/90918","heartbeat_back_addr":"172.21.15.72:6815/90918","heartbeat_front_addr":"172.21.15.72:6813/90918","state":["exists","up"]},{"osd":7,"uuid":"364c5119-6b13-4c75-b3f0-15e165eff86a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":90948},{"type":"v1","addr":"172.21.15.72:6822","nonce":90948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":90948},{"type":"v1","addr":"172.21.15.72:6826","nonce":90948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":90948},{"type":"v1","addr":"172.21.15.72:6831","nonce":90948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":90948},{"type":"v1","addr":"172.21.15.72:6829","nonce":90948}]},"public_addr":"172.21.15.72:6822/90948","cluster_addr":"172.21.15.72:6826/90948","heartbeat_back_addr":"172.21.15.72:6831/90948","heartbeat_front_addr":"172.21.15.72:6829/90948","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.642976+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.645372+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.619116+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.663042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.599163+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.646411+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.631545+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.669821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:42:00.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.255+0000 7f126065d700 1 -- 172.21.15.71:0/3357980308 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f1244066f30 msgr2=0x7f12440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:00.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.255+0000 7f126065d700 1 --2- 172.21.15.71:0/3357980308 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f1244066f30 0x7f12440693e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f1258152390 tx=0x7f124c007d30 comp rx=0 tx=0).stop 2023-10-06T01:42:00.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.255+0000 7f126065d700 1 -- 172.21.15.71:0/3357980308 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1240004d50 msgr2=0x7f12580cde20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:00.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.255+0000 7f126065d700 1 --2- 172.21.15.71:0/3357980308 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1240004d50 0x7f12580cde20 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f1250011f00 tx=0x7f125000b040 comp rx=0 tx=0).stop 2023-10-06T01:42:00.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.255+0000 7f126065d700 1 -- 172.21.15.71:0/3357980308 shutdown_connections 2023-10-06T01:42:00.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.255+0000 7f126065d700 1 --2- 172.21.15.71:0/3357980308 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f1244066f30 0x7f12440693e0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:00.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.255+0000 7f126065d700 1 --2- 172.21.15.71:0/3357980308 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f12580ce360 0x7f12580cff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:00.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.255+0000 7f126065d700 1 --2- 172.21.15.71:0/3357980308 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1240004d50 0x7f12580cde20 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:00.257 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.255+0000 7f126065d700 1 --2- 172.21.15.71:0/3357980308 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1258152dc0 0x7f12580cfa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:00.257 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.255+0000 7f126065d700 1 -- 172.21.15.71:0/3357980308 >> 172.21.15.71:0/3357980308 conn(0x7f1258068680 msgr2=0x7f12580afeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:00.257 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.255+0000 7f126065d700 1 -- 172.21.15.71:0/3357980308 shutdown_connections 2023-10-06T01:42:00.257 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.255+0000 7f126065d700 1 -- 172.21.15.71:0/3357980308 wait complete. 2023-10-06T01:42:00.268 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:42:00.382 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.381+0000 7f7e46224700 1 Processor -- start 2023-10-06T01:42:00.382 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.381+0000 7f7e46224700 1 -- start start 2023-10-06T01:42:00.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.382+0000 7f7e46224700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e400b27f0 0x7f7e4015db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:00.384 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.382+0000 7f7e46224700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e4015e190 con 0x7f7e400af4e0 2023-10-06T01:42:00.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.382+0000 7f7e46224700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e400cb650 con 0x7f7e400af8b0 2023-10-06T01:42:00.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.382+0000 7f7e46224700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e400b1910 con 0x7f7e400b27f0 2023-10-06T01:42:00.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.382+0000 7f7e3f7fe700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f7e400af4e0 0x7f7e400b20e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:33012/0 (socket says 172.21.15.71:33012) 2023-10-06T01:42:00.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.382+0000 7f7e3f7fe700 1 -- 172.21.15.71:0/551483391 learned_addr learned my addr 172.21.15.71:0/551483391 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:42:00.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.382+0000 7f7e3ffff700 1 --2- 172.21.15.71:0/551483391 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e400b27f0 0x7f7e4015db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:00.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.382+0000 7f7e3e7fc700 1 -- 172.21.15.71:0/551483391 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1061030902 0 0) 0x7f7e4015e190 con 0x7f7e400af4e0 2023-10-06T01:42:00.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.382+0000 7f7e3e7fc700 1 -- 172.21.15.71:0/551483391 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e28003570 con 0x7f7e400af4e0 2023-10-06T01:42:00.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.382+0000 7f7e3e7fc700 1 -- 172.21.15.71:0/551483391 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 570092634 0 0) 0x7f7e400cb650 con 0x7f7e400af8b0 2023-10-06T01:42:00.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.382+0000 7f7e3e7fc700 1 -- 172.21.15.71:0/551483391 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e4015e190 con 0x7f7e400af8b0 2023-10-06T01:42:00.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.382+0000 7f7e3ffff700 1 -- 172.21.15.71:0/551483391 >> v1:172.21.15.72:6789/0 conn(0x7f7e400af8b0 legacy=0x7f7e4015d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:00.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.382+0000 7f7e3ffff700 1 -- 172.21.15.71:0/551483391 >> v1:172.21.15.71:6789/0 conn(0x7f7e400af4e0 legacy=0x7f7e400b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:00.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.382+0000 7f7e3ffff700 1 -- 172.21.15.71:0/551483391 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e400ccaf0 con 0x7f7e400b27f0 2023-10-06T01:42:00.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.383+0000 7f7e3ffff700 1 --2- 172.21.15.71:0/551483391 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e400b27f0 0x7f7e4015db70 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7e38009910 tx=0x7f7e380091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e95ca5d25da667db server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:00.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.383+0000 7f7e3e7fc700 1 -- 172.21.15.71:0/551483391 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e38011630 con 0x7f7e400b27f0 2023-10-06T01:42:00.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.383+0000 7f7e3e7fc700 1 -- 172.21.15.71:0/551483391 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e38011790 con 0x7f7e400b27f0 2023-10-06T01:42:00.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.383+0000 7f7e3e7fc700 1 -- 172.21.15.71:0/551483391 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e38011b10 con 0x7f7e400b27f0 2023-10-06T01:42:00.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.383+0000 7f7e46224700 1 -- 172.21.15.71:0/551483391 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e400b27f0 msgr2=0x7f7e4015db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:00.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.383+0000 7f7e46224700 1 --2- 172.21.15.71:0/551483391 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e400b27f0 0x7f7e4015db70 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7e38009910 tx=0x7f7e380091a0 comp rx=0 tx=0).stop 2023-10-06T01:42:00.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.383+0000 7f7e46224700 1 -- 172.21.15.71:0/551483391 shutdown_connections 2023-10-06T01:42:00.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.383+0000 7f7e46224700 1 --2- 172.21.15.71:0/551483391 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e400b27f0 0x7f7e4015db70 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:00.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.383+0000 7f7e46224700 1 -- 172.21.15.71:0/551483391 >> 172.21.15.71:0/551483391 conn(0x7f7e40068680 msgr2=0x7f7e40068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:00.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.383+0000 7f7e46224700 1 -- 172.21.15.71:0/551483391 shutdown_connections 2023-10-06T01:42:00.387 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.383+0000 7f7e46224700 1 -- 172.21.15.71:0/551483391 wait complete. 2023-10-06T01:42:00.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.385+0000 7f7e46224700 1 Processor -- start 2023-10-06T01:42:00.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.385+0000 7f7e46224700 1 -- start start 2023-10-06T01:42:00.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.385+0000 7f7e46224700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e400af4e0 0x7f7e400d02f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:00.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.385+0000 7f7e46224700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e400af8b0 0x7f7e40159a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:00.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.385+0000 7f7e46224700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7e400b27f0 0x7f7e400a6d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:00.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.385+0000 7f7e46224700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e400a9600 con 0x7f7e400b27f0 2023-10-06T01:42:00.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.385+0000 7f7e46224700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e400a7c10 con 0x7f7e400af8b0 2023-10-06T01:42:00.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.385+0000 7f7e46224700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e400ce330 con 0x7f7e400af4e0 2023-10-06T01:42:00.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.385+0000 7f7e3ffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7e400b27f0 0x7f7e400a6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:00.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.386+0000 7f7e3ffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7e400b27f0 0x7f7e400a6d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37942/0 (socket says 172.21.15.71:37942) 2023-10-06T01:42:00.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.386+0000 7f7e3ffff700 1 -- 172.21.15.71:0/3261802832 learned_addr learned my addr 172.21.15.71:0/3261802832 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:00.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.386+0000 7f7e3f7fe700 1 --2- 172.21.15.71:0/3261802832 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e400af4e0 0x7f7e400d02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:00.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.386+0000 7f7e3effd700 1 --2- 172.21.15.71:0/3261802832 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e400af8b0 0x7f7e40159a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:00.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.386+0000 7f7e3ffff700 1 -- 172.21.15.71:0/3261802832 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e400af4e0 msgr2=0x7f7e400d02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:00.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.386+0000 7f7e3ffff700 1 --2- 172.21.15.71:0/3261802832 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e400af4e0 0x7f7e400d02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:00.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.386+0000 7f7e3ffff700 1 -- 172.21.15.71:0/3261802832 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e400af8b0 msgr2=0x7f7e40159a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:00.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.386+0000 7f7e3ffff700 1 --2- 172.21.15.71:0/3261802832 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e400af8b0 0x7f7e40159a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:00.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.386+0000 7f7e3ffff700 1 -- 172.21.15.71:0/3261802832 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e38009420 con 0x7f7e400b27f0 2023-10-06T01:42:00.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.386+0000 7f7e3ffff700 1 --2- 172.21.15.71:0/3261802832 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7e400b27f0 0x7f7e400a6d20 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f7e40089520 tx=0x7f7e38017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:00.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.386+0000 7f7e277fe700 1 -- 172.21.15.71:0/3261802832 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e380119d0 con 0x7f7e400b27f0 2023-10-06T01:42:00.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.386+0000 7f7e277fe700 1 -- 172.21.15.71:0/3261802832 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e38025420 con 0x7f7e400b27f0 2023-10-06T01:42:00.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.386+0000 7f7e46224700 1 -- 172.21.15.71:0/3261802832 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e400a9040 con 0x7f7e400b27f0 2023-10-06T01:42:00.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.386+0000 7f7e277fe700 1 -- 172.21.15.71:0/3261802832 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e380257a0 con 0x7f7e400b27f0 2023-10-06T01:42:00.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.386+0000 7f7e46224700 1 -- 172.21.15.71:0/3261802832 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e400cdfc0 con 0x7f7e400b27f0 2023-10-06T01:42:00.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.387+0000 7f7e46224700 1 -- 172.21.15.71:0/3261802832 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e400cde20 con 0x7f7e400b27f0 2023-10-06T01:42:00.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.387+0000 7f7e277fe700 1 -- 172.21.15.71:0/3261802832 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7e38023070 con 0x7f7e400b27f0 2023-10-06T01:42:00.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.388+0000 7f7e277fe700 1 --2- 172.21.15.71:0/3261802832 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7e2c066f30 0x7f7e2c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:00.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.388+0000 7f7e277fe700 1 -- 172.21.15.71:0/3261802832 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f7e38085ce0 con 0x7f7e400b27f0 2023-10-06T01:42:00.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.388+0000 7f7e3f7fe700 1 --2- 172.21.15.71:0/3261802832 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7e2c066f30 0x7f7e2c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:00.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.388+0000 7f7e3f7fe700 1 --2- 172.21.15.71:0/3261802832 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7e2c066f30 0x7f7e2c0693e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7e30005c50 tx=0x7f7e30009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:00.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.392+0000 7f7e277fe700 1 -- 172.21.15.71:0/3261802832 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7e400cde20 con 0x7f7e400b27f0 2023-10-06T01:42:00.576 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.575+0000 7f7e46224700 1 -- 172.21.15.71:0/3261802832 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7e400cde20 con 0x7f7e400b27f0 2023-10-06T01:42:00.576 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.576+0000 7f7e277fe700 1 -- 172.21.15.71:0/3261802832 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+17036 (secure 0 0 0) 0x7f7e400cde20 con 0x7f7e400b27f0 2023-10-06T01:42:00.577 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:42:00.577 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":53,"fsid":"1fbf1bd2-f9b4-4599-bea2-f4aa920e9a56","created":"2023-10-06T01:39:57.016957+0000","modified":"2023-10-06T01:41:59.289806+0000","last_up_change":"2023-10-06T01:40:08.571643+0000","last_in_change":"2023-10-06T01:39:59.462741+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T01:40:08.610349+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T01:40:15.387434+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-06T01:41:56.925792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-06T01:41:58.259205+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cf059188-fb20-4dbf-95db-dcf57b213d03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":90670},{"type":"v1","addr":"172.21.15.71:6817","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":90670},{"type":"v1","addr":"172.21.15.71:6819","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":90670},{"type":"v1","addr":"172.21.15.71:6823","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":90670},{"type":"v1","addr":"172.21.15.71:6821","nonce":90670}]},"public_addr":"172.21.15.71:6817/90670","cluster_addr":"172.21.15.71:6819/90670","heartbeat_back_addr":"172.21.15.71:6823/90670","heartbeat_front_addr":"172.21.15.71:6821/90670","state":["exists","up"]},{"osd":1,"uuid":"0cff0aae-1799-4fe0-b610-54cf0813c0e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":90669},{"type":"v1","addr":"172.21.15.71:6809","nonce":90669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":90669},{"type":"v1","addr":"172.21.15.71:6811","nonce":90669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":90669},{"type":"v1","addr":"172.21.15.71:6815","nonce":90669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":90669},{"type":"v1","addr":"172.21.15.71:6813","nonce":90669}]},"public_addr":"172.21.15.71:6809/90669","cluster_addr":"172.21.15.71:6811/90669","heartbeat_back_addr":"172.21.15.71:6815/90669","heartbeat_front_addr":"172.21.15.71:6813/90669","state":["exists","up"]},{"osd":2,"uuid":"88d61ddc-9031-44e1-ba8c-546a41e7c8ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":90679},{"type":"v1","addr":"172.21.15.71:6825","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":90679},{"type":"v1","addr":"172.21.15.71:6827","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":90679},{"type":"v1","addr":"172.21.15.71:6831","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":90679},{"type":"v1","addr":"172.21.15.71:6829","nonce":90679}]},"public_addr":"172.21.15.71:6825/90679","cluster_addr":"172.21.15.71:6827/90679","heartbeat_back_addr":"172.21.15.71:6831/90679","heartbeat_front_addr":"172.21.15.71:6829/90679","state":["exists","up"]},{"osd":3,"uuid":"11ed92b7-960b-4a30-a889-a61d3eeb86f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":90668},{"type":"v1","addr":"172.21.15.71:6801","nonce":90668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":90668},{"type":"v1","addr":"172.21.15.71:6803","nonce":90668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":90668},{"type":"v1","addr":"172.21.15.71:6807","nonce":90668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":90668},{"type":"v1","addr":"172.21.15.71:6805","nonce":90668}]},"public_addr":"172.21.15.71:6801/90668","cluster_addr":"172.21.15.71:6803/90668","heartbeat_back_addr":"172.21.15.71:6807/90668","heartbeat_front_addr":"172.21.15.71:6805/90668","state":["exists","up"]},{"osd":4,"uuid":"ae4df784-abdf-4ddf-aefa-780f3ddafef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":90917},{"type":"v1","addr":"172.21.15.72:6801","nonce":90917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":90917},{"type":"v1","addr":"172.21.15.72:6803","nonce":90917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":90917},{"type":"v1","addr":"172.21.15.72:6807","nonce":90917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":90917},{"type":"v1","addr":"172.21.15.72:6805","nonce":90917}]},"public_addr":"172.21.15.72:6801/90917","cluster_addr":"172.21.15.72:6803/90917","heartbeat_back_addr":"172.21.15.72:6807/90917","heartbeat_front_addr":"172.21.15.72:6805/90917","state":["exists","up"]},{"osd":5,"uuid":"5ef0790f-001e-458f-a05b-efae216cf435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":90941},{"type":"v1","addr":"172.21.15.72:6817","nonce":90941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":90941},{"type":"v1","addr":"172.21.15.72:6819","nonce":90941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":90941},{"type":"v1","addr":"172.21.15.72:6827","nonce":90941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":90941},{"type":"v1","addr":"172.21.15.72:6823","nonce":90941}]},"public_addr":"172.21.15.72:6817/90941","cluster_addr":"172.21.15.72:6819/90941","heartbeat_back_addr":"172.21.15.72:6827/90941","heartbeat_front_addr":"172.21.15.72:6823/90941","state":["exists","up"]},{"osd":6,"uuid":"8705aef1-9ae8-4e54-a3c4-c2909fa0ceb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":90918},{"type":"v1","addr":"172.21.15.72:6809","nonce":90918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":90918},{"type":"v1","addr":"172.21.15.72:6811","nonce":90918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":90918},{"type":"v1","addr":"172.21.15.72:6815","nonce":90918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":90918},{"type":"v1","addr":"172.21.15.72:6813","nonce":90918}]},"public_addr":"172.21.15.72:6809/90918","cluster_addr":"172.21.15.72:6811/90918","heartbeat_back_addr":"172.21.15.72:6815/90918","heartbeat_front_addr":"172.21.15.72:6813/90918","state":["exists","up"]},{"osd":7,"uuid":"364c5119-6b13-4c75-b3f0-15e165eff86a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":90948},{"type":"v1","addr":"172.21.15.72:6822","nonce":90948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":90948},{"type":"v1","addr":"172.21.15.72:6826","nonce":90948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":90948},{"type":"v1","addr":"172.21.15.72:6831","nonce":90948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":90948},{"type":"v1","addr":"172.21.15.72:6829","nonce":90948}]},"public_addr":"172.21.15.72:6822/90948","cluster_addr":"172.21.15.72:6826/90948","heartbeat_back_addr":"172.21.15.72:6831/90948","heartbeat_front_addr":"172.21.15.72:6829/90948","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.642976+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.645372+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.619116+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.663042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.599163+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.646411+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.631545+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.669821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:42:00.579 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.578+0000 7f7e46224700 1 -- 172.21.15.71:0/3261802832 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7e2c066f30 msgr2=0x7f7e2c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:00.579 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.578+0000 7f7e46224700 1 --2- 172.21.15.71:0/3261802832 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7e2c066f30 0x7f7e2c0693e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7e30005c50 tx=0x7f7e30009040 comp rx=0 tx=0).stop 2023-10-06T01:42:00.579 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.578+0000 7f7e46224700 1 -- 172.21.15.71:0/3261802832 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7e400b27f0 msgr2=0x7f7e400a6d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:00.579 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.578+0000 7f7e46224700 1 --2- 172.21.15.71:0/3261802832 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7e400b27f0 0x7f7e400a6d20 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f7e40089520 tx=0x7f7e38017000 comp rx=0 tx=0).stop 2023-10-06T01:42:00.579 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.578+0000 7f7e46224700 1 -- 172.21.15.71:0/3261802832 shutdown_connections 2023-10-06T01:42:00.579 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.578+0000 7f7e46224700 1 --2- 172.21.15.71:0/3261802832 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7e400b27f0 0x7f7e400a6d20 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:00.579 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.578+0000 7f7e46224700 1 --2- 172.21.15.71:0/3261802832 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e400af4e0 0x7f7e400d02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:00.579 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.578+0000 7f7e46224700 1 --2- 172.21.15.71:0/3261802832 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7e2c066f30 0x7f7e2c0693e0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:00.579 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.578+0000 7f7e46224700 1 --2- 172.21.15.71:0/3261802832 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e400af8b0 0x7f7e40159a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:00.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.578+0000 7f7e46224700 1 -- 172.21.15.71:0/3261802832 >> 172.21.15.71:0/3261802832 conn(0x7f7e40068680 msgr2=0x7f7e4015c670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:00.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.578+0000 7f7e46224700 1 -- 172.21.15.71:0/3261802832 shutdown_connections 2023-10-06T01:42:00.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.578+0000 7f7e46224700 1 -- 172.21.15.71:0/3261802832 wait complete. 2023-10-06T01:42:00.591 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T01:42:00.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.708+0000 7f1b0e3dc700 1 Processor -- start 2023-10-06T01:42:00.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.708+0000 7f1b0e3dc700 1 -- start start 2023-10-06T01:42:00.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.709+0000 7f1b0e3dc700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f1b080cd400 0x7f1b080b1f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:00.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.709+0000 7f1b0e3dc700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b080af770 con 0x7f1b080cd7d0 2023-10-06T01:42:00.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.709+0000 7f1b0e3dc700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b080afa50 con 0x7f1b080b0810 2023-10-06T01:42:00.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.709+0000 7f1b0e3dc700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b080afd30 con 0x7f1b080cd400 2023-10-06T01:42:00.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.709+0000 7f1b0d3da700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f1b080cd400 0x7f1b080b1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:00.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.709+0000 7f1b0cbd9700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f1b080cd7d0 0x7f1b080d01a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:33018/0 (socket says 172.21.15.71:33018) 2023-10-06T01:42:00.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.709+0000 7f1b0cbd9700 1 -- 172.21.15.71:0/247363275 learned_addr learned my addr 172.21.15.71:0/247363275 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:42:00.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.709+0000 7f1b0d3da700 1 -- 172.21.15.71:0/247363275 >> v1:172.21.15.72:6789/0 conn(0x7f1b080b0810 legacy=0x7f1b0815a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:00.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.709+0000 7f1b0d3da700 1 -- 172.21.15.71:0/247363275 >> v1:172.21.15.71:6789/0 conn(0x7f1b080cd7d0 legacy=0x7f1b080d01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:00.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.709+0000 7f1b0d3da700 1 -- 172.21.15.71:0/247363275 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b080b0010 con 0x7f1b080cd400 2023-10-06T01:42:00.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.710+0000 7f1b0d3da700 1 --2- 172.21.15.71:0/247363275 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1b080cd400 0x7f1b080b1f20 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f1af8009ee0 tx=0x7f1af8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7de922a0b21e2ef0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:00.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.710+0000 7f1b07fff700 1 -- 172.21.15.71:0/247363275 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af800e070 con 0x7f1b080cd400 2023-10-06T01:42:00.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.710+0000 7f1b07fff700 1 -- 172.21.15.71:0/247363275 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1af800bc10 con 0x7f1b080cd400 2023-10-06T01:42:00.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.710+0000 7f1b07fff700 1 -- 172.21.15.71:0/247363275 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af8012430 con 0x7f1b080cd400 2023-10-06T01:42:00.716 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.710+0000 7f1b0e3dc700 1 -- 172.21.15.71:0/247363275 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1b080cd400 msgr2=0x7f1b080b1f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:00.717 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.710+0000 7f1b0e3dc700 1 --2- 172.21.15.71:0/247363275 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1b080cd400 0x7f1b080b1f20 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f1af8009ee0 tx=0x7f1af8009780 comp rx=0 tx=0).stop 2023-10-06T01:42:00.717 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.710+0000 7f1b0e3dc700 1 -- 172.21.15.71:0/247363275 shutdown_connections 2023-10-06T01:42:00.717 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.710+0000 7f1b0e3dc700 1 --2- 172.21.15.71:0/247363275 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1b080cd400 0x7f1b080b1f20 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:00.717 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.710+0000 7f1b0e3dc700 1 -- 172.21.15.71:0/247363275 >> 172.21.15.71:0/247363275 conn(0x7f1b0806a110 msgr2=0x7f1b0806a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:00.717 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.710+0000 7f1b0e3dc700 1 -- 172.21.15.71:0/247363275 shutdown_connections 2023-10-06T01:42:00.717 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.710+0000 7f1b0e3dc700 1 -- 172.21.15.71:0/247363275 wait complete. 2023-10-06T01:42:00.717 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.711+0000 7f1b0e3dc700 1 Processor -- start 2023-10-06T01:42:00.717 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.711+0000 7f1b0e3dc700 1 -- start start 2023-10-06T01:42:00.718 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.712+0000 7f1b0e3dc700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1b080b0810 0x7f1b08169070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:00.718 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.712+0000 7f1b0e3dc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b080cd400 0x7f1b080c4b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:00.718 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.712+0000 7f1b0e3dc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1b080c50a0 0x7f1b080c92c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:00.718 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.712+0000 7f1b0e3dc700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b081597f0 con 0x7f1b080b0810 2023-10-06T01:42:00.718 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.712+0000 7f1b0e3dc700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b080c55b0 con 0x7f1b080cd400 2023-10-06T01:42:00.718 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.712+0000 7f1b0e3dc700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b080c5890 con 0x7f1b080c50a0 2023-10-06T01:42:00.718 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.712+0000 7f1b0d3da700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1b080b0810 0x7f1b08169070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:00.718 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.712+0000 7f1b0d3da700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1b080b0810 0x7f1b08169070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37970/0 (socket says 172.21.15.71:37970) 2023-10-06T01:42:00.718 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.712+0000 7f1b0d3da700 1 -- 172.21.15.71:0/3900595567 learned_addr learned my addr 172.21.15.71:0/3900595567 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:00.718 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.713+0000 7f1b0cbd9700 1 --2- 172.21.15.71:0/3900595567 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b080cd400 0x7f1b080c4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:00.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.713+0000 7f1b0dbdb700 1 --2- 172.21.15.71:0/3900595567 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1b080c50a0 0x7f1b080c92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:00.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.713+0000 7f1b0d3da700 1 -- 172.21.15.71:0/3900595567 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1b080c50a0 msgr2=0x7f1b080c92c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:00.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.713+0000 7f1b0d3da700 1 --2- 172.21.15.71:0/3900595567 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1b080c50a0 0x7f1b080c92c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:00.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.713+0000 7f1b0d3da700 1 -- 172.21.15.71:0/3900595567 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b080cd400 msgr2=0x7f1b080c4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:00.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.713+0000 7f1b0d3da700 1 --2- 172.21.15.71:0/3900595567 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b080cd400 0x7f1b080c4b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:00.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.713+0000 7f1b0d3da700 1 -- 172.21.15.71:0/3900595567 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1af8009a20 con 0x7f1b080b0810 2023-10-06T01:42:00.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.713+0000 7f1b0d3da700 1 --2- 172.21.15.71:0/3900595567 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1b080b0810 0x7f1b08169070 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f1af800b6c0 tx=0x7f1af8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:00.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.713+0000 7f1b057fa700 1 -- 172.21.15.71:0/3900595567 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af8012ea0 con 0x7f1b080b0810 2023-10-06T01:42:00.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.713+0000 7f1b057fa700 1 -- 172.21.15.71:0/3900595567 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1af8021070 con 0x7f1b080b0810 2023-10-06T01:42:00.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.713+0000 7f1b0e3dc700 1 -- 172.21.15.71:0/3900595567 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b080c5b70 con 0x7f1b080b0810 2023-10-06T01:42:00.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.713+0000 7f1b057fa700 1 -- 172.21.15.71:0/3900595567 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af8026660 con 0x7f1b080b0810 2023-10-06T01:42:00.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.713+0000 7f1b0e3dc700 1 -- 172.21.15.71:0/3900595567 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b08169ad0 con 0x7f1b080b0810 2023-10-06T01:42:00.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.714+0000 7f1b0e3dc700 1 -- 172.21.15.71:0/3900595567 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b08064aa0 con 0x7f1b080b0810 2023-10-06T01:42:00.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.714+0000 7f1b057fa700 1 -- 172.21.15.71:0/3900595567 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1af8023030 con 0x7f1b080b0810 2023-10-06T01:42:00.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.715+0000 7f1b057fa700 1 --2- 172.21.15.71:0/3900595567 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f1af4066f30 0x7f1af40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:00.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.715+0000 7f1b057fa700 1 -- 172.21.15.71:0/3900595567 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f1af8086ae0 con 0x7f1b080b0810 2023-10-06T01:42:00.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.715+0000 7f1b0cbd9700 1 --2- 172.21.15.71:0/3900595567 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f1af4066f30 0x7f1af40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:00.720 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.715+0000 7f1b0cbd9700 1 --2- 172.21.15.71:0/3900595567 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f1af4066f30 0x7f1af40693e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f1b0815c9b0 tx=0x7f1afc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:00.721 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.719+0000 7f1b057fa700 1 -- 172.21.15.71:0/3900595567 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1af8053ab0 con 0x7f1b080b0810 2023-10-06T01:42:00.946 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:00.945+0000 7f1b0e3dc700 1 -- 172.21.15.71:0/3900595567 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f1b080b02f0 con 0x7f1b080b0810 2023-10-06T01:42:01.929 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:01.928+0000 7f1b057fa700 1 -- 172.21.15.71:0/3900595567 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v30) v1 ==== 118+0+0 (secure 0 0 0) 0x7f1af80570d0 con 0x7f1b080b0810 2023-10-06T01:42:01.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:01.930+0000 7f1b0e3dc700 1 -- 172.21.15.71:0/3900595567 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f1af4066f30 msgr2=0x7f1af40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:01.931 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:01.930+0000 7f1b0e3dc700 1 --2- 172.21.15.71:0/3900595567 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f1af4066f30 0x7f1af40693e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f1b0815c9b0 tx=0x7f1afc009040 comp rx=0 tx=0).stop 2023-10-06T01:42:01.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:01.930+0000 7f1b0e3dc700 1 -- 172.21.15.71:0/3900595567 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1b080b0810 msgr2=0x7f1b08169070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:01.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:01.930+0000 7f1b0e3dc700 1 --2- 172.21.15.71:0/3900595567 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1b080b0810 0x7f1b08169070 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f1af800b6c0 tx=0x7f1af8018000 comp rx=0 tx=0).stop 2023-10-06T01:42:01.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:01.930+0000 7f1b0e3dc700 1 -- 172.21.15.71:0/3900595567 shutdown_connections 2023-10-06T01:42:01.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:01.930+0000 7f1b0e3dc700 1 --2- 172.21.15.71:0/3900595567 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1b080c50a0 0x7f1b080c92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:01.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:01.930+0000 7f1b0e3dc700 1 --2- 172.21.15.71:0/3900595567 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1b080b0810 0x7f1b08169070 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:01.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:01.931+0000 7f1b0e3dc700 1 --2- 172.21.15.71:0/3900595567 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f1af4066f30 0x7f1af40693e0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:01.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:01.931+0000 7f1b0e3dc700 1 --2- 172.21.15.71:0/3900595567 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b080cd400 0x7f1b080c4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:01.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:01.931+0000 7f1b0e3dc700 1 -- 172.21.15.71:0/3900595567 >> 172.21.15.71:0/3900595567 conn(0x7f1b0806a110 msgr2=0x7f1b080cdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:01.932 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:01.931+0000 7f1b0e3dc700 1 -- 172.21.15.71:0/3900595567 shutdown_connections 2023-10-06T01:42:01.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:01.931+0000 7f1b0e3dc700 1 -- 172.21.15.71:0/3900595567 wait complete. 2023-10-06T01:42:01.945 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T01:42:02.066 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:02.065+0000 7fa6192d1700 1 Processor -- start 2023-10-06T01:42:02.066 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:02.065+0000 7fa6192d1700 1 -- start start 2023-10-06T01:42:02.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:02.066+0000 7fa6192d1700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa614154100 0x7fa61406b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:02.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:02.066+0000 7fa6192d1700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6140b0580 con 0x7fa614153d30 2023-10-06T01:42:02.068 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:02.066+0000 7fa6192d1700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6140af9e0 con 0x7fa61406bba0 2023-10-06T01:42:02.069 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:02.066+0000 7fa6192d1700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6140aeed0 con 0x7fa614154100 2023-10-06T01:42:02.069 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:02.066+0000 7fa612ffd700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fa614153d30 0x7fa6140afe70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:33022/0 (socket says 172.21.15.71:33022) 2023-10-06T01:42:02.069 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:02.066+0000 7fa612ffd700 1 -- 172.21.15.71:0/1022569953 learned_addr learned my addr 172.21.15.71:0/1022569953 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:42:02.069 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:02.066+0000 7fa6127fc700 1 --2- 172.21.15.71:0/1022569953 >> v2:172.21.15.72:3300/0 conn(0x7fa614154100 0x7fa61406b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:02.069 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:02.066+0000 7fa611ffb700 1 -- 172.21.15.71:0/1022569953 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3653460816 0 0) 0x7fa60c001490 con 0x7fa614153d30 2023-10-06T01:42:02.069 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:02.066+0000 7fa611ffb700 1 -- 172.21.15.71:0/1022569953 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa600003570 con 0x7fa614153d30 2023-10-06T01:42:02.069 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:02.066+0000 7fa611ffb700 1 -- 172.21.15.71:0/1022569953 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3123318867 0 0) 0x7fa6140af9e0 con 0x7fa61406bba0 2023-10-06T01:42:02.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:02.066+0000 7fa611ffb700 1 -- 172.21.15.71:0/1022569953 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa60c001490 con 0x7fa61406bba0 2023-10-06T01:42:02.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:02.066+0000 7fa6127fc700 1 -- 172.21.15.71:0/1022569953 >> v1:172.21.15.72:6789/0 conn(0x7fa61406bba0 legacy=0x7fa6140b1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:02.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:02.066+0000 7fa611ffb700 1 -- 172.21.15.71:0/1022569953 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3071597029 0 0) 0x7fa600003570 con 0x7fa614153d30 2023-10-06T01:42:02.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:02.066+0000 7fa6127fc700 1 -- 172.21.15.71:0/1022569953 >> v1:172.21.15.71:6789/0 conn(0x7fa614153d30 legacy=0x7fa6140afe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:02.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:02.066+0000 7fa6127fc700 1 -- 172.21.15.71:0/1022569953 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6140af0b0 con 0x7fa614154100 2023-10-06T01:42:02.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:02.067+0000 7fa6127fc700 1 --2- 172.21.15.71:0/1022569953 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa614154100 0x7fa61406b660 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc0098e0 tx=0x7fa5fc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e0e112ce2dd6bad server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:02.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:02.067+0000 7fa611ffb700 1 -- 172.21.15.71:0/1022569953 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa60c001980 con 0x7fa614154100 2023-10-06T01:42:02.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:02.067+0000 7fa611ffb700 1 -- 172.21.15.71:0/1022569953 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5fc011420 con 0x7fa614154100 2023-10-06T01:42:02.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:02.067+0000 7fa611ffb700 1 -- 172.21.15.71:0/1022569953 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5fc0117c0 con 0x7fa614154100 2023-10-06T01:42:02.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:02.067+0000 7fa6192d1700 1 -- 172.21.15.71:0/1022569953 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa614154100 msgr2=0x7fa61406b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:02.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:02.067+0000 7fa6192d1700 1 --2- 172.21.15.71:0/1022569953 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa614154100 0x7fa61406b660 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc0098e0 tx=0x7fa5fc0091a0 comp rx=0 tx=0).stop 2023-10-06T01:42:02.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:02.067+0000 7fa6192d1700 1 -- 172.21.15.71:0/1022569953 shutdown_connections 2023-10-06T01:42:02.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:02.067+0000 7fa6192d1700 1 --2- 172.21.15.71:0/1022569953 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa614154100 0x7fa61406b660 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:02.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:02.067+0000 7fa6192d1700 1 -- 172.21.15.71:0/1022569953 >> 172.21.15.71:0/1022569953 conn(0x7fa6140cc110 msgr2=0x7fa6140cc510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:02.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:02.067+0000 7fa6192d1700 1 -- 172.21.15.71:0/1022569953 shutdown_connections 2023-10-06T01:42:02.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:02.067+0000 7fa6192d1700 1 -- 172.21.15.71:0/1022569953 wait complete. 2023-10-06T01:42:02.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:02.068+0000 7fa6192d1700 1 Processor -- start 2023-10-06T01:42:02.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:02.068+0000 7fa6192d1700 1 -- start start 2023-10-06T01:42:02.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:02.069+0000 7fa6192d1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa61406bba0 0x7fa61414fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:02.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:02.069+0000 7fa6192d1700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa614153d30 0x7fa6140adb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:02.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:02.069+0000 7fa6192d1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa614154100 0x7fa6140ae060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:02.075 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:02.069+0000 7fa6192d1700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa614156e60 con 0x7fa614153d30 2023-10-06T01:42:02.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:02.069+0000 7fa6192d1700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6140aaf80 con 0x7fa614154100 2023-10-06T01:42:02.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:02.069+0000 7fa6192d1700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6140aa370 con 0x7fa61406bba0 2023-10-06T01:42:02.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:02.069+0000 7fa6127fc700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa614153d30 0x7fa6140adb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:02.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:02.069+0000 7fa6127fc700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa614153d30 0x7fa6140adb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37974/0 (socket says 172.21.15.71:37974) 2023-10-06T01:42:02.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:02.069+0000 7fa6127fc700 1 -- 172.21.15.71:0/2727074562 learned_addr learned my addr 172.21.15.71:0/2727074562 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:02.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:02.070+0000 7fa612ffd700 1 --2- 172.21.15.71:0/2727074562 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa61406bba0 0x7fa61414fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:02.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:02.070+0000 7fa6137fe700 1 --2- 172.21.15.71:0/2727074562 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa614154100 0x7fa6140ae060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:02.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:02.070+0000 7fa6127fc700 1 -- 172.21.15.71:0/2727074562 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa61406bba0 msgr2=0x7fa61414fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:02.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:02.070+0000 7fa6127fc700 1 --2- 172.21.15.71:0/2727074562 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa61406bba0 0x7fa61414fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:02.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:02.070+0000 7fa6127fc700 1 -- 172.21.15.71:0/2727074562 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa614154100 msgr2=0x7fa6140ae060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:02.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:02.070+0000 7fa6127fc700 1 --2- 172.21.15.71:0/2727074562 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa614154100 0x7fa6140ae060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:02.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:02.070+0000 7fa6127fc700 1 -- 172.21.15.71:0/2727074562 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5fc009420 con 0x7fa614153d30 2023-10-06T01:42:02.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:02.070+0000 7fa612ffd700 1 --2- 172.21.15.71:0/2727074562 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa61406bba0 0x7fa61414fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:42:02.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:02.070+0000 7fa6137fe700 1 --2- 172.21.15.71:0/2727074562 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa614154100 0x7fa6140ae060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:42:02.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:02.070+0000 7fa6127fc700 1 --2- 172.21.15.71:0/2727074562 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa614153d30 0x7fa6140adb20 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc002000 tx=0x7fa5fc016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:02.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:02.070+0000 7fa60affd700 1 -- 172.21.15.71:0/2727074562 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5fc01cc90 con 0x7fa614153d30 2023-10-06T01:42:02.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:02.070+0000 7fa60affd700 1 -- 172.21.15.71:0/2727074562 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5fc01cdf0 con 0x7fa614153d30 2023-10-06T01:42:02.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:02.070+0000 7fa6192d1700 1 -- 172.21.15.71:0/2727074562 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6140aa650 con 0x7fa614153d30 2023-10-06T01:42:02.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:02.070+0000 7fa60affd700 1 -- 172.21.15.71:0/2727074562 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5fc01a6a0 con 0x7fa614153d30 2023-10-06T01:42:02.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:02.070+0000 7fa6192d1700 1 -- 172.21.15.71:0/2727074562 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6140aac10 con 0x7fa614153d30 2023-10-06T01:42:02.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:02.071+0000 7fa6192d1700 1 -- 172.21.15.71:0/2727074562 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa61406d430 con 0x7fa614153d30 2023-10-06T01:42:02.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:02.071+0000 7fa60affd700 1 -- 172.21.15.71:0/2727074562 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa5fc01aa50 con 0x7fa614153d30 2023-10-06T01:42:02.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:02.072+0000 7fa60affd700 1 --2- 172.21.15.71:0/2727074562 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fa5f4066f30 0x7fa5f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:02.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:02.072+0000 7fa60affd700 1 -- 172.21.15.71:0/2727074562 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fa5fc085e30 con 0x7fa614153d30 2023-10-06T01:42:02.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:02.072+0000 7fa612ffd700 1 --2- 172.21.15.71:0/2727074562 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fa5f4066f30 0x7fa5f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:02.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:02.072+0000 7fa612ffd700 1 --2- 172.21.15.71:0/2727074562 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fa5f4066f30 0x7fa5f40693e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa60c001460 tx=0x7fa60c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:02.080 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:02.076+0000 7fa60affd700 1 -- 172.21.15.71:0/2727074562 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa5fc052e00 con 0x7fa614153d30 2023-10-06T01:42:02.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:02.298+0000 7fa6192d1700 1 -- 172.21.15.71:0/2727074562 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fa614157300 con 0x7fa614153d30 2023-10-06T01:42:02.930 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:02.930+0000 7fa60affd700 1 -- 172.21.15.71:0/2727074562 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v31) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa5fc029020 con 0x7fa614153d30 2023-10-06T01:42:02.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:02.932+0000 7fa6192d1700 1 -- 172.21.15.71:0/2727074562 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fa5f4066f30 msgr2=0x7fa5f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:02.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:02.932+0000 7fa6192d1700 1 --2- 172.21.15.71:0/2727074562 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fa5f4066f30 0x7fa5f40693e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa60c001460 tx=0x7fa60c009040 comp rx=0 tx=0).stop 2023-10-06T01:42:02.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:02.932+0000 7fa6192d1700 1 -- 172.21.15.71:0/2727074562 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa614153d30 msgr2=0x7fa6140adb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:02.933 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:02.932+0000 7fa6192d1700 1 --2- 172.21.15.71:0/2727074562 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa614153d30 0x7fa6140adb20 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc002000 tx=0x7fa5fc016000 comp rx=0 tx=0).stop 2023-10-06T01:42:02.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:02.932+0000 7fa6192d1700 1 -- 172.21.15.71:0/2727074562 shutdown_connections 2023-10-06T01:42:02.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:02.932+0000 7fa6192d1700 1 --2- 172.21.15.71:0/2727074562 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fa5f4066f30 0x7fa5f40693e0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:02.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:02.932+0000 7fa6192d1700 1 --2- 172.21.15.71:0/2727074562 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa614154100 0x7fa6140ae060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:02.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:02.932+0000 7fa6192d1700 1 --2- 172.21.15.71:0/2727074562 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa61406bba0 0x7fa61414fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:02.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:02.932+0000 7fa6192d1700 1 --2- 172.21.15.71:0/2727074562 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa614153d30 0x7fa6140adb20 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:02.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:02.932+0000 7fa6192d1700 1 -- 172.21.15.71:0/2727074562 >> 172.21.15.71:0/2727074562 conn(0x7fa6140cc110 msgr2=0x7fa6141512c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:02.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:02.932+0000 7fa6192d1700 1 -- 172.21.15.71:0/2727074562 shutdown_connections 2023-10-06T01:42:02.934 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:02.932+0000 7fa6192d1700 1 -- 172.21.15.71:0/2727074562 wait complete. 2023-10-06T01:42:02.947 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T01:42:03.062 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.061+0000 7fadcbfff700 1 Processor -- start 2023-10-06T01:42:03.062 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.061+0000 7fadcbfff700 1 -- start start 2023-10-06T01:42:03.064 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.062+0000 7fadcbfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fadcc0d05d0 0x7fadcc1641d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:03.064 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.062+0000 7fadcbfff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadcc0b3560 con 0x7fadcc159400 2023-10-06T01:42:03.065 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.062+0000 7fadcbfff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadcc0cf6f0 con 0x7fadcc0cf1a0 2023-10-06T01:42:03.065 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.062+0000 7fadcbfff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadcc0cf9d0 con 0x7fadcc0d05d0 2023-10-06T01:42:03.065 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.062+0000 7fadcaffd700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fadcc159400 0x7fadcc0ccaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:33032/0 (socket says 172.21.15.71:33032) 2023-10-06T01:42:03.065 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.062+0000 7fadcaffd700 1 -- 172.21.15.71:0/977865994 learned_addr learned my addr 172.21.15.71:0/977865994 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:42:03.065 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.062+0000 7fadcb7fe700 1 --2- 172.21.15.71:0/977865994 >> v2:172.21.15.72:3300/0 conn(0x7fadcc0d05d0 0x7fadcc1641d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:03.065 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.062+0000 7fadca7fc700 1 -- 172.21.15.71:0/977865994 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1418706599 0 0) 0x7fadcc0b3560 con 0x7fadcc159400 2023-10-06T01:42:03.065 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.062+0000 7fadca7fc700 1 -- 172.21.15.71:0/977865994 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fadb8003570 con 0x7fadcc159400 2023-10-06T01:42:03.065 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.063+0000 7fadca7fc700 1 -- 172.21.15.71:0/977865994 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3009679209 0 0) 0x7fadcc0cf6f0 con 0x7fadcc0cf1a0 2023-10-06T01:42:03.065 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.063+0000 7fadca7fc700 1 -- 172.21.15.71:0/977865994 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fadcc0b3560 con 0x7fadcc0cf1a0 2023-10-06T01:42:03.065 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.063+0000 7fadcb7fe700 1 -- 172.21.15.71:0/977865994 >> v1:172.21.15.72:6789/0 conn(0x7fadcc0cf1a0 legacy=0x7fadcc0cfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:03.065 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.063+0000 7fadcb7fe700 1 -- 172.21.15.71:0/977865994 >> v1:172.21.15.71:6789/0 conn(0x7fadcc159400 legacy=0x7fadcc0ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:03.066 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.063+0000 7fadca7fc700 1 -- 172.21.15.71:0/977865994 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3289478109 0 0) 0x7fadb8003570 con 0x7fadcc159400 2023-10-06T01:42:03.066 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.063+0000 7fadcb7fe700 1 -- 172.21.15.71:0/977865994 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadcc0b2f10 con 0x7fadcc0d05d0 2023-10-06T01:42:03.066 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.063+0000 7fadcb7fe700 1 --2- 172.21.15.71:0/977865994 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fadcc0d05d0 0x7fadcc1641d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fadc4009e60 tx=0x7fadc4009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2210944c54d6ecb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:03.066 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.063+0000 7fadca7fc700 1 -- 172.21.15.71:0/977865994 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc400e070 con 0x7fadcc0d05d0 2023-10-06T01:42:03.066 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.063+0000 7fadca7fc700 1 -- 172.21.15.71:0/977865994 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadc400b7a0 con 0x7fadcc0d05d0 2023-10-06T01:42:03.066 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.063+0000 7fadca7fc700 1 -- 172.21.15.71:0/977865994 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadbc0015f0 con 0x7fadcc0d05d0 2023-10-06T01:42:03.066 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.063+0000 7fadcbfff700 1 -- 172.21.15.71:0/977865994 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fadcc0d05d0 msgr2=0x7fadcc1641d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:03.066 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.063+0000 7fadcbfff700 1 --2- 172.21.15.71:0/977865994 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fadcc0d05d0 0x7fadcc1641d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fadc4009e60 tx=0x7fadc4009780 comp rx=0 tx=0).stop 2023-10-06T01:42:03.066 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.064+0000 7fadcbfff700 1 -- 172.21.15.71:0/977865994 shutdown_connections 2023-10-06T01:42:03.066 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.064+0000 7fadcbfff700 1 --2- 172.21.15.71:0/977865994 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fadcc0d05d0 0x7fadcc1641d0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:03.067 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.064+0000 7fadcbfff700 1 -- 172.21.15.71:0/977865994 >> 172.21.15.71:0/977865994 conn(0x7fadcc06ac10 msgr2=0x7fadcc068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:03.067 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.064+0000 7fadcbfff700 1 -- 172.21.15.71:0/977865994 shutdown_connections 2023-10-06T01:42:03.067 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.064+0000 7fadcbfff700 1 -- 172.21.15.71:0/977865994 wait complete. 2023-10-06T01:42:03.069 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.065+0000 7fadcbfff700 1 Processor -- start 2023-10-06T01:42:03.069 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.065+0000 7fadcbfff700 1 -- start start 2023-10-06T01:42:03.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.065+0000 7fadcbfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fadcc0cf1a0 0x7fadcc16adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:03.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.065+0000 7fadcbfff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fadcc0d05d0 0x7fadcc15b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:03.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.066+0000 7fadcbfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fadcc159400 0x7fadcc15bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:03.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.066+0000 7fadcbfff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadcc15b500 con 0x7fadcc0cf1a0 2023-10-06T01:42:03.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.066+0000 7fadcbfff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadcc15a8f0 con 0x7fadcc159400 2023-10-06T01:42:03.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.066+0000 7fadcbfff700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadcc15abd0 con 0x7fadcc0d05d0 2023-10-06T01:42:03.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.066+0000 7fadcaffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fadcc0cf1a0 0x7fadcc16adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:03.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.066+0000 7fadcaffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fadcc0cf1a0 0x7fadcc16adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37984/0 (socket says 172.21.15.71:37984) 2023-10-06T01:42:03.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.066+0000 7fadcaffd700 1 -- 172.21.15.71:0/1941074419 learned_addr learned my addr 172.21.15.71:0/1941074419 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:03.070 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.066+0000 7fadcaffd700 1 -- 172.21.15.71:0/1941074419 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fadcc0d05d0 msgr2=0x7fadcc15b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:03.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.066+0000 7fadcaffd700 1 --2- 172.21.15.71:0/1941074419 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fadcc0d05d0 0x7fadcc15b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:03.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.066+0000 7fadcaffd700 1 -- 172.21.15.71:0/1941074419 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fadcc159400 msgr2=0x7fadcc15bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:03.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.066+0000 7fadcb7fe700 1 --2- 172.21.15.71:0/1941074419 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fadcc159400 0x7fadcc15bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:03.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.066+0000 7fadcaffd700 1 --2- 172.21.15.71:0/1941074419 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fadcc159400 0x7fadcc15bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:03.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.066+0000 7fadcaffd700 1 -- 172.21.15.71:0/1941074419 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadc4009a20 con 0x7fadcc0cf1a0 2023-10-06T01:42:03.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.066+0000 7fadcaffd700 1 --2- 172.21.15.71:0/1941074419 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fadcc0cf1a0 0x7fadcc16adf0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fadbc00c810 tx=0x7fadbc0016e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:03.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.066+0000 7fadc37fe700 1 -- 172.21.15.71:0/1941074419 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadbc007300 con 0x7fadcc0cf1a0 2023-10-06T01:42:03.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.066+0000 7fadc37fe700 1 -- 172.21.15.71:0/1941074419 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadbc007460 con 0x7fadcc0cf1a0 2023-10-06T01:42:03.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.066+0000 7fadcbfff700 1 -- 172.21.15.71:0/1941074419 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadcc15aeb0 con 0x7fadcc0cf1a0 2023-10-06T01:42:03.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.066+0000 7fadc37fe700 1 -- 172.21.15.71:0/1941074419 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadbc0057f0 con 0x7fadcc0cf1a0 2023-10-06T01:42:03.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.066+0000 7fadcbfff700 1 -- 172.21.15.71:0/1941074419 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadcc16b330 con 0x7fadcc0cf1a0 2023-10-06T01:42:03.071 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.067+0000 7fadcbfff700 1 -- 172.21.15.71:0/1941074419 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadcc0b4dc0 con 0x7fadcc0cf1a0 2023-10-06T01:42:03.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.067+0000 7fadc37fe700 1 -- 172.21.15.71:0/1941074419 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fadbc005c40 con 0x7fadcc0cf1a0 2023-10-06T01:42:03.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.068+0000 7fadc37fe700 1 --2- 172.21.15.71:0/1941074419 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fadac066f30 0x7fadac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:03.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.068+0000 7fadc37fe700 1 -- 172.21.15.71:0/1941074419 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fadbc0844c0 con 0x7fadcc0cf1a0 2023-10-06T01:42:03.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.068+0000 7fadc27fc700 1 --2- 172.21.15.71:0/1941074419 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fadac066f30 0x7fadac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:03.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.068+0000 7fadc27fc700 1 --2- 172.21.15.71:0/1941074419 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fadac066f30 0x7fadac0693e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fadcc04c500 tx=0x7fadb40079d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:03.072 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.072+0000 7fadc37fe700 1 -- 172.21.15.71:0/1941074419 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fadbc051510 con 0x7fadcc0cf1a0 2023-10-06T01:42:03.296 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.295+0000 7fadcbfff700 1 -- 172.21.15.71:0/1941074419 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fadcc068420 con 0x7fadcc0cf1a0 2023-10-06T01:42:03.296 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.296+0000 7fadc37fe700 1 -- 172.21.15.71:0/1941074419 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4591 (secure 0 0 0) 0x7fadbc054b30 con 0x7fadcc0cf1a0 2023-10-06T01:42:03.297 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:42:03.297 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":31,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5021,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6834/924027954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":924027954},{"type":"v1","addr":"172.21.15.72:6834","nonce":924027954}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5574,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6836/2482160960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":2482160960},{"type":"v1","addr":"172.21.15.71:6836","nonce":2482160960}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5577,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/2163703913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6835","nonce":2163703913},{"type":"v1","addr":"172.21.15.71:6837","nonce":2163703913}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T01:41:59.290125+0000","modified":"2023-10-06T01:42:02.927924+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5586},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5586":{"gid":5586,"name":"b","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6835/627948818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6833","nonce":627948818},{"type":"v1","addr":"172.21.15.72:6835","nonce":627948818}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T01:42:03.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.298+0000 7fadcbfff700 1 -- 172.21.15.71:0/1941074419 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fadac066f30 msgr2=0x7fadac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:03.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.298+0000 7fadcbfff700 1 --2- 172.21.15.71:0/1941074419 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fadac066f30 0x7fadac0693e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fadcc04c500 tx=0x7fadb40079d0 comp rx=0 tx=0).stop 2023-10-06T01:42:03.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.298+0000 7fadcbfff700 1 -- 172.21.15.71:0/1941074419 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fadcc0cf1a0 msgr2=0x7fadcc16adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:03.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.298+0000 7fadcbfff700 1 --2- 172.21.15.71:0/1941074419 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fadcc0cf1a0 0x7fadcc16adf0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fadbc00c810 tx=0x7fadbc0016e0 comp rx=0 tx=0).stop 2023-10-06T01:42:03.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.298+0000 7fadcbfff700 1 -- 172.21.15.71:0/1941074419 shutdown_connections 2023-10-06T01:42:03.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.298+0000 7fadcbfff700 1 --2- 172.21.15.71:0/1941074419 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fadac066f30 0x7fadac0693e0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:03.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.298+0000 7fadcbfff700 1 --2- 172.21.15.71:0/1941074419 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fadcc159400 0x7fadcc15bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:03.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.298+0000 7fadcbfff700 1 --2- 172.21.15.71:0/1941074419 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fadcc0cf1a0 0x7fadcc16adf0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:03.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.298+0000 7fadcbfff700 1 --2- 172.21.15.71:0/1941074419 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fadcc0d05d0 0x7fadcc15b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:03.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.298+0000 7fadcbfff700 1 -- 172.21.15.71:0/1941074419 >> 172.21.15.71:0/1941074419 conn(0x7fadcc06ac10 msgr2=0x7fadcc0b4280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:03.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.298+0000 7fadcbfff700 1 -- 172.21.15.71:0/1941074419 shutdown_connections 2023-10-06T01:42:03.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.298+0000 7fadcbfff700 1 -- 172.21.15.71:0/1941074419 wait complete. 2023-10-06T01:42:03.300 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 31 2023-10-06T01:42:03.311 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:42:03.425 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.424+0000 7fa555bf7700 1 Processor -- start 2023-10-06T01:42:03.425 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.424+0000 7fa555bf7700 1 -- start start 2023-10-06T01:42:03.427 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.425+0000 7fa555bf7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa5500af4e0 0x7fa5500b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:03.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.425+0000 7fa555bf7700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa55015db70 0x7fa5500b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:03.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.425+0000 7fa555bf7700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa55015e190 con 0x7fa5500af8b0 2023-10-06T01:42:03.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.425+0000 7fa555bf7700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5500b1910 con 0x7fa55015db70 2023-10-06T01:42:03.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.425+0000 7fa555bf7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa55015dfb0 con 0x7fa5500af4e0 2023-10-06T01:42:03.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.425+0000 7fa54effd700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fa5500af8b0 0x7fa55015d460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:33046/0 (socket says 172.21.15.71:33046) 2023-10-06T01:42:03.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.425+0000 7fa54effd700 1 -- 172.21.15.71:0/2491136609 learned_addr learned my addr 172.21.15.71:0/2491136609 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:42:03.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.425+0000 7fa54ffff700 1 --2- 172.21.15.71:0/2491136609 >> v2:172.21.15.72:3300/0 conn(0x7fa55015db70 0x7fa5500b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:03.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.426+0000 7fa54f7fe700 1 --2- 172.21.15.71:0/2491136609 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa5500af4e0 0x7fa5500b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:03.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.426+0000 7fa54e7fc700 1 -- 172.21.15.71:0/2491136609 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2954539882 0 0) 0x7fa55015e190 con 0x7fa5500af8b0 2023-10-06T01:42:03.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.426+0000 7fa54e7fc700 1 -- 172.21.15.71:0/2491136609 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa538003570 con 0x7fa5500af8b0 2023-10-06T01:42:03.428 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.426+0000 7fa54ffff700 1 -- 172.21.15.71:0/2491136609 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa5500af4e0 msgr2=0x7fa5500b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:03.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.426+0000 7fa54ffff700 1 --2- 172.21.15.71:0/2491136609 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa5500af4e0 0x7fa5500b20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:03.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.426+0000 7fa54e7fc700 1 -- 172.21.15.71:0/2491136609 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3445195307 0 0) 0x7fa538003570 con 0x7fa5500af8b0 2023-10-06T01:42:03.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.426+0000 7fa54ffff700 1 -- 172.21.15.71:0/2491136609 >> v1:172.21.15.71:6789/0 conn(0x7fa5500af8b0 legacy=0x7fa55015d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:03.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.426+0000 7fa54ffff700 1 -- 172.21.15.71:0/2491136609 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5500cb650 con 0x7fa55015db70 2023-10-06T01:42:03.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.426+0000 7fa54f7fe700 1 --2- 172.21.15.71:0/2491136609 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa5500af4e0 0x7fa5500b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:42:03.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.426+0000 7fa54ffff700 1 --2- 172.21.15.71:0/2491136609 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa55015db70 0x7fa5500b2620 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa548009e60 tx=0x7fa548009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=27903e813faec02b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:03.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.426+0000 7fa54e7fc700 1 -- 172.21.15.71:0/2491136609 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa54800e070 con 0x7fa55015db70 2023-10-06T01:42:03.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.426+0000 7fa54e7fc700 1 -- 172.21.15.71:0/2491136609 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa54800b7a0 con 0x7fa55015db70 2023-10-06T01:42:03.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.426+0000 7fa54e7fc700 1 -- 172.21.15.71:0/2491136609 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa544001470 con 0x7fa55015db70 2023-10-06T01:42:03.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.427+0000 7fa555bf7700 1 -- 172.21.15.71:0/2491136609 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa55015db70 msgr2=0x7fa5500b2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:03.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.427+0000 7fa555bf7700 1 --2- 172.21.15.71:0/2491136609 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa55015db70 0x7fa5500b2620 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa548009e60 tx=0x7fa548009780 comp rx=0 tx=0).stop 2023-10-06T01:42:03.429 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.427+0000 7fa555bf7700 1 -- 172.21.15.71:0/2491136609 shutdown_connections 2023-10-06T01:42:03.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.427+0000 7fa555bf7700 1 --2- 172.21.15.71:0/2491136609 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa55015db70 0x7fa5500b2620 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:03.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.427+0000 7fa555bf7700 1 --2- 172.21.15.71:0/2491136609 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa5500af4e0 0x7fa5500b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:03.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.427+0000 7fa555bf7700 1 -- 172.21.15.71:0/2491136609 >> 172.21.15.71:0/2491136609 conn(0x7fa550068680 msgr2=0x7fa550068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:03.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.427+0000 7fa555bf7700 1 -- 172.21.15.71:0/2491136609 shutdown_connections 2023-10-06T01:42:03.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.427+0000 7fa555bf7700 1 -- 172.21.15.71:0/2491136609 wait complete. 2023-10-06T01:42:03.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.428+0000 7fa555bf7700 1 Processor -- start 2023-10-06T01:42:03.432 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.428+0000 7fa555bf7700 1 -- start start 2023-10-06T01:42:03.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.429+0000 7fa555bf7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa5500af4e0 0x7fa5500ce950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:03.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.429+0000 7fa555bf7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5500af8b0 0x7fa5500ccc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:03.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.429+0000 7fa555bf7700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa55015db70 0x7fa550150730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:03.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.429+0000 7fa555bf7700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5500c9380 con 0x7fa55015db70 2023-10-06T01:42:03.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.429+0000 7fa555bf7700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5500c9620 con 0x7fa5500af8b0 2023-10-06T01:42:03.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.429+0000 7fa555bf7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5500c9900 con 0x7fa5500af4e0 2023-10-06T01:42:03.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.429+0000 7fa54ffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa55015db70 0x7fa550150730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:03.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.429+0000 7fa54ffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa55015db70 0x7fa550150730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:37994/0 (socket says 172.21.15.71:37994) 2023-10-06T01:42:03.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.429+0000 7fa54ffff700 1 -- 172.21.15.71:0/1639880723 learned_addr learned my addr 172.21.15.71:0/1639880723 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:03.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.429+0000 7fa54f7fe700 1 --2- 172.21.15.71:0/1639880723 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa5500af4e0 0x7fa5500ce950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:03.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.429+0000 7fa54effd700 1 --2- 172.21.15.71:0/1639880723 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5500af8b0 0x7fa5500ccc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:03.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.429+0000 7fa54ffff700 1 -- 172.21.15.71:0/1639880723 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa5500af4e0 msgr2=0x7fa5500ce950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:03.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.429+0000 7fa54ffff700 1 --2- 172.21.15.71:0/1639880723 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa5500af4e0 0x7fa5500ce950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:03.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.429+0000 7fa54ffff700 1 -- 172.21.15.71:0/1639880723 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5500af8b0 msgr2=0x7fa5500ccc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:03.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.429+0000 7fa54ffff700 1 --2- 172.21.15.71:0/1639880723 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5500af8b0 0x7fa5500ccc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:03.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.429+0000 7fa54ffff700 1 -- 172.21.15.71:0/1639880723 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa540009420 con 0x7fa55015db70 2023-10-06T01:42:03.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.429+0000 7fa54ffff700 1 --2- 172.21.15.71:0/1639880723 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa55015db70 0x7fa550150730 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fa5480097c0 tx=0x7fa548018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:03.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.429+0000 7fa5377fe700 1 -- 172.21.15.71:0/1639880723 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa548012af0 con 0x7fa55015db70 2023-10-06T01:42:03.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.429+0000 7fa5377fe700 1 -- 172.21.15.71:0/1639880723 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa548012c50 con 0x7fa55015db70 2023-10-06T01:42:03.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.429+0000 7fa5377fe700 1 -- 172.21.15.71:0/1639880723 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5480276c0 con 0x7fa55015db70 2023-10-06T01:42:03.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.429+0000 7fa555bf7700 1 -- 172.21.15.71:0/1639880723 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa548009a20 con 0x7fa55015db70 2023-10-06T01:42:03.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.429+0000 7fa555bf7700 1 -- 172.21.15.71:0/1639880723 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5500cd720 con 0x7fa55015db70 2023-10-06T01:42:03.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.430+0000 7fa555bf7700 1 -- 172.21.15.71:0/1639880723 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5500c9e20 con 0x7fa55015db70 2023-10-06T01:42:03.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.431+0000 7fa5377fe700 1 -- 172.21.15.71:0/1639880723 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa548024070 con 0x7fa55015db70 2023-10-06T01:42:03.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.431+0000 7fa5377fe700 1 --2- 172.21.15.71:0/1639880723 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fa53c066f30 0x7fa53c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:03.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.431+0000 7fa5377fe700 1 -- 172.21.15.71:0/1639880723 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fa548086d90 con 0x7fa55015db70 2023-10-06T01:42:03.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.431+0000 7fa54f7fe700 1 --2- 172.21.15.71:0/1639880723 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fa53c066f30 0x7fa53c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:03.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.431+0000 7fa54f7fe700 1 --2- 172.21.15.71:0/1639880723 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fa53c066f30 0x7fa53c0693e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fa540009ea0 tx=0x7fa5400091a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:03.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.435+0000 7fa5377fe700 1 -- 172.21.15.71:0/1639880723 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa5500c9e20 con 0x7fa55015db70 2023-10-06T01:42:03.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.618+0000 7fa555bf7700 1 -- 172.21.15.71:0/1639880723 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa5500c9e20 con 0x7fa55015db70 2023-10-06T01:42:03.620 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.619+0000 7fa5377fe700 1 -- 172.21.15.71:0/1639880723 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+17023 (secure 0 0 0) 0x7fa5500c9e20 con 0x7fa55015db70 2023-10-06T01:42:03.620 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:42:03.620 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":54,"fsid":"1fbf1bd2-f9b4-4599-bea2-f4aa920e9a56","created":"2023-10-06T01:39:57.016957+0000","modified":"2023-10-06T01:42:00.902734+0000","last_up_change":"2023-10-06T01:40:08.571643+0000","last_in_change":"2023-10-06T01:39:59.462741+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T01:40:08.610349+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T01:40:15.387434+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-06T01:41:56.925792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-06T01:41:58.259205+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cf059188-fb20-4dbf-95db-dcf57b213d03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":90670},{"type":"v1","addr":"172.21.15.71:6817","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":90670},{"type":"v1","addr":"172.21.15.71:6819","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":90670},{"type":"v1","addr":"172.21.15.71:6823","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":90670},{"type":"v1","addr":"172.21.15.71:6821","nonce":90670}]},"public_addr":"172.21.15.71:6817/90670","cluster_addr":"172.21.15.71:6819/90670","heartbeat_back_addr":"172.21.15.71:6823/90670","heartbeat_front_addr":"172.21.15.71:6821/90670","state":["exists","up"]},{"osd":1,"uuid":"0cff0aae-1799-4fe0-b610-54cf0813c0e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":90669},{"type":"v1","addr":"172.21.15.71:6809","nonce":90669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":90669},{"type":"v1","addr":"172.21.15.71:6811","nonce":90669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":90669},{"type":"v1","addr":"172.21.15.71:6815","nonce":90669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":90669},{"type":"v1","addr":"172.21.15.71:6813","nonce":90669}]},"public_addr":"172.21.15.71:6809/90669","cluster_addr":"172.21.15.71:6811/90669","heartbeat_back_addr":"172.21.15.71:6815/90669","heartbeat_front_addr":"172.21.15.71:6813/90669","state":["exists","up"]},{"osd":2,"uuid":"88d61ddc-9031-44e1-ba8c-546a41e7c8ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":90679},{"type":"v1","addr":"172.21.15.71:6825","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":90679},{"type":"v1","addr":"172.21.15.71:6827","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":90679},{"type":"v1","addr":"172.21.15.71:6831","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":90679},{"type":"v1","addr":"172.21.15.71:6829","nonce":90679}]},"public_addr":"172.21.15.71:6825/90679","cluster_addr":"172.21.15.71:6827/90679","heartbeat_back_addr":"172.21.15.71:6831/90679","heartbeat_front_addr":"172.21.15.71:6829/90679","state":["exists","up"]},{"osd":3,"uuid":"11ed92b7-960b-4a30-a889-a61d3eeb86f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":90668},{"type":"v1","addr":"172.21.15.71:6801","nonce":90668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":90668},{"type":"v1","addr":"172.21.15.71:6803","nonce":90668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":90668},{"type":"v1","addr":"172.21.15.71:6807","nonce":90668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":90668},{"type":"v1","addr":"172.21.15.71:6805","nonce":90668}]},"public_addr":"172.21.15.71:6801/90668","cluster_addr":"172.21.15.71:6803/90668","heartbeat_back_addr":"172.21.15.71:6807/90668","heartbeat_front_addr":"172.21.15.71:6805/90668","state":["exists","up"]},{"osd":4,"uuid":"ae4df784-abdf-4ddf-aefa-780f3ddafef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":90917},{"type":"v1","addr":"172.21.15.72:6801","nonce":90917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":90917},{"type":"v1","addr":"172.21.15.72:6803","nonce":90917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":90917},{"type":"v1","addr":"172.21.15.72:6807","nonce":90917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":90917},{"type":"v1","addr":"172.21.15.72:6805","nonce":90917}]},"public_addr":"172.21.15.72:6801/90917","cluster_addr":"172.21.15.72:6803/90917","heartbeat_back_addr":"172.21.15.72:6807/90917","heartbeat_front_addr":"172.21.15.72:6805/90917","state":["exists","up"]},{"osd":5,"uuid":"5ef0790f-001e-458f-a05b-efae216cf435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":90941},{"type":"v1","addr":"172.21.15.72:6817","nonce":90941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":90941},{"type":"v1","addr":"172.21.15.72:6819","nonce":90941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":90941},{"type":"v1","addr":"172.21.15.72:6827","nonce":90941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":90941},{"type":"v1","addr":"172.21.15.72:6823","nonce":90941}]},"public_addr":"172.21.15.72:6817/90941","cluster_addr":"172.21.15.72:6819/90941","heartbeat_back_addr":"172.21.15.72:6827/90941","heartbeat_front_addr":"172.21.15.72:6823/90941","state":["exists","up"]},{"osd":6,"uuid":"8705aef1-9ae8-4e54-a3c4-c2909fa0ceb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":90918},{"type":"v1","addr":"172.21.15.72:6809","nonce":90918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":90918},{"type":"v1","addr":"172.21.15.72:6811","nonce":90918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":90918},{"type":"v1","addr":"172.21.15.72:6815","nonce":90918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":90918},{"type":"v1","addr":"172.21.15.72:6813","nonce":90918}]},"public_addr":"172.21.15.72:6809/90918","cluster_addr":"172.21.15.72:6811/90918","heartbeat_back_addr":"172.21.15.72:6815/90918","heartbeat_front_addr":"172.21.15.72:6813/90918","state":["exists","up"]},{"osd":7,"uuid":"364c5119-6b13-4c75-b3f0-15e165eff86a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":90948},{"type":"v1","addr":"172.21.15.72:6822","nonce":90948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":90948},{"type":"v1","addr":"172.21.15.72:6826","nonce":90948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":90948},{"type":"v1","addr":"172.21.15.72:6831","nonce":90948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":90948},{"type":"v1","addr":"172.21.15.72:6829","nonce":90948}]},"public_addr":"172.21.15.72:6822/90948","cluster_addr":"172.21.15.72:6826/90948","heartbeat_back_addr":"172.21.15.72:6831/90948","heartbeat_front_addr":"172.21.15.72:6829/90948","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.642976+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.645372+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.619116+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.663042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.599163+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.646411+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.631545+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.669821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:42:03.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.621+0000 7fa555bf7700 1 -- 172.21.15.71:0/1639880723 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fa53c066f30 msgr2=0x7fa53c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:03.622 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.621+0000 7fa555bf7700 1 --2- 172.21.15.71:0/1639880723 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fa53c066f30 0x7fa53c0693e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fa540009ea0 tx=0x7fa5400091a0 comp rx=0 tx=0).stop 2023-10-06T01:42:03.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.621+0000 7fa555bf7700 1 -- 172.21.15.71:0/1639880723 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa55015db70 msgr2=0x7fa550150730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:03.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.621+0000 7fa555bf7700 1 --2- 172.21.15.71:0/1639880723 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa55015db70 0x7fa550150730 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fa5480097c0 tx=0x7fa548018000 comp rx=0 tx=0).stop 2023-10-06T01:42:03.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.621+0000 7fa555bf7700 1 -- 172.21.15.71:0/1639880723 shutdown_connections 2023-10-06T01:42:03.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.621+0000 7fa555bf7700 1 --2- 172.21.15.71:0/1639880723 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa55015db70 0x7fa550150730 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:03.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.621+0000 7fa555bf7700 1 --2- 172.21.15.71:0/1639880723 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa5500af4e0 0x7fa5500ce950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:03.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.621+0000 7fa555bf7700 1 --2- 172.21.15.71:0/1639880723 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fa53c066f30 0x7fa53c0693e0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:03.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.621+0000 7fa555bf7700 1 --2- 172.21.15.71:0/1639880723 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5500af8b0 0x7fa5500ccc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:03.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.622+0000 7fa555bf7700 1 -- 172.21.15.71:0/1639880723 >> 172.21.15.71:0/1639880723 conn(0x7fa550068680 msgr2=0x7fa550068a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:03.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.622+0000 7fa555bf7700 1 -- 172.21.15.71:0/1639880723 shutdown_connections 2023-10-06T01:42:03.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.622+0000 7fa555bf7700 1 -- 172.21.15.71:0/1639880723 wait complete. 2023-10-06T01:42:03.634 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T01:42:03.635 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T01:42:03.748 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.747+0000 7f51cff54700 1 Processor -- start 2023-10-06T01:42:03.748 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.747+0000 7f51cff54700 1 -- start start 2023-10-06T01:42:03.749 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.748+0000 7f51cff54700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f51c80af8b0 0x7f51c815d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:03.749 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.748+0000 7f51cff54700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51c815e190 con 0x7f51c80af4e0 2023-10-06T01:42:03.749 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.748+0000 7f51cff54700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51c80cb650 con 0x7f51c80b27f0 2023-10-06T01:42:03.749 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.748+0000 7f51cff54700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51c80b1910 con 0x7f51c80af8b0 2023-10-06T01:42:03.749 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.748+0000 7f51cdcf0700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f51c80af4e0 0x7f51c80b20e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:33062/0 (socket says 172.21.15.71:33062) 2023-10-06T01:42:03.749 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.748+0000 7f51cdcf0700 1 -- 172.21.15.71:0/2411525144 learned_addr learned my addr 172.21.15.71:0/2411525144 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:42:03.752 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.749+0000 7f51cd4ef700 1 --2- 172.21.15.71:0/2411525144 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f51c80af8b0 0x7f51c815d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:03.752 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.749+0000 7f51cccee700 1 -- 172.21.15.71:0/2411525144 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 454543514 0 0) 0x7f51c815e190 con 0x7f51c80af4e0 2023-10-06T01:42:03.752 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.749+0000 7f51cccee700 1 -- 172.21.15.71:0/2411525144 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51b4003570 con 0x7f51c80af4e0 2023-10-06T01:42:03.752 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.749+0000 7f51cccee700 1 -- 172.21.15.71:0/2411525144 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3826106812 0 0) 0x7f51b4003570 con 0x7f51c80af4e0 2023-10-06T01:42:03.752 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.749+0000 7f51cccee700 1 -- 172.21.15.71:0/2411525144 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f51c80af8b0 msgr2=0x7f51c815d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:03.752 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.749+0000 7f51cccee700 1 --2- 172.21.15.71:0/2411525144 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f51c80af8b0 0x7f51c815d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:03.752 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.749+0000 7f51cccee700 1 -- 172.21.15.71:0/2411525144 >> v1:172.21.15.72:6789/0 conn(0x7f51c80b27f0 legacy=0x7f51c815d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:03.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.749+0000 7f51cccee700 1 -- 172.21.15.71:0/2411525144 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51c80ccaf0 con 0x7f51c80af4e0 2023-10-06T01:42:03.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.749+0000 7f51cccee700 1 -- 172.21.15.71:0/2411525144 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1184243524 0 0) 0x7f51c40017f0 con 0x7f51c80af4e0 2023-10-06T01:42:03.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.749+0000 7f51cccee700 1 -- 172.21.15.71:0/2411525144 >> v1:172.21.15.71:6789/0 conn(0x7f51c80af4e0 legacy=0x7f51c80b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:03.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.749+0000 7f51cccee700 1 --2- 172.21.15.71:0/2411525144 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f51c80af8b0 0x7f51b4003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:03.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.749+0000 7f51cccee700 1 --2- 172.21.15.71:0/2411525144 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51b4004010 0x7f51b4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:03.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.749+0000 7f51cccee700 1 --2- 172.21.15.71:0/2411525144 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f51b4004d50 0x7f51b40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:03.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.749+0000 7f51cccee700 1 -- 172.21.15.71:0/2411525144 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51c80b1910 con 0x7f51b4004d50 2023-10-06T01:42:03.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.749+0000 7f51cccee700 1 -- 172.21.15.71:0/2411525144 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51b400bbf0 con 0x7f51b4004010 2023-10-06T01:42:03.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.749+0000 7f51cccee700 1 -- 172.21.15.71:0/2411525144 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51b400bdb0 con 0x7f51c80af8b0 2023-10-06T01:42:03.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.749+0000 7f51ce4f1700 1 --2- 172.21.15.71:0/2411525144 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f51b4004d50 0x7f51b40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:03.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.749+0000 7f51cd4ef700 1 --2- 172.21.15.71:0/2411525144 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51b4004010 0x7f51b4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:03.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.749+0000 7f51cdcf0700 1 --2- 172.21.15.71:0/2411525144 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f51c80af8b0 0x7f51b4003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:03.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.749+0000 7f51ce4f1700 1 -- 172.21.15.71:0/2411525144 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f51c80af8b0 msgr2=0x7f51b4003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:03.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.749+0000 7f51ce4f1700 1 --2- 172.21.15.71:0/2411525144 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f51c80af8b0 0x7f51b4003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:03.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.749+0000 7f51ce4f1700 1 -- 172.21.15.71:0/2411525144 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51b4004010 msgr2=0x7f51b4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:03.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.749+0000 7f51ce4f1700 1 --2- 172.21.15.71:0/2411525144 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51b4004010 0x7f51b4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:03.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.749+0000 7f51ce4f1700 1 -- 172.21.15.71:0/2411525144 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51b4003570 con 0x7f51b4004d50 2023-10-06T01:42:03.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.749+0000 7f51ce4f1700 1 --2- 172.21.15.71:0/2411525144 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f51b4004d50 0x7f51b40051c0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f51c0001880 tx=0x7f51c0007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e62fb3bdf2c7ed2c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:03.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.750+0000 7f51cccee700 1 -- 172.21.15.71:0/2411525144 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51c0012420 con 0x7f51b4004d50 2023-10-06T01:42:03.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.750+0000 7f51cccee700 1 -- 172.21.15.71:0/2411525144 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51c0012580 con 0x7f51b4004d50 2023-10-06T01:42:03.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.750+0000 7f51cccee700 1 -- 172.21.15.71:0/2411525144 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51c0012920 con 0x7f51b4004d50 2023-10-06T01:42:03.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.750+0000 7f51cff54700 1 -- 172.21.15.71:0/2411525144 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f51b4004d50 msgr2=0x7f51b40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:03.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.750+0000 7f51cff54700 1 --2- 172.21.15.71:0/2411525144 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f51b4004d50 0x7f51b40051c0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f51c0001880 tx=0x7f51c0007d30 comp rx=0 tx=0).stop 2023-10-06T01:42:03.755 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.750+0000 7f51ce4f1700 1 -- 172.21.15.71:0/2411525144 reap_dead start 2023-10-06T01:42:03.755 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.750+0000 7f51cff54700 1 -- 172.21.15.71:0/2411525144 shutdown_connections 2023-10-06T01:42:03.755 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.750+0000 7f51cff54700 1 -- 172.21.15.71:0/2411525144 >> 172.21.15.71:0/2411525144 conn(0x7f51c8068680 msgr2=0x7f51c8068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:03.755 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.750+0000 7f51cff54700 1 -- 172.21.15.71:0/2411525144 shutdown_connections 2023-10-06T01:42:03.755 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.750+0000 7f51cff54700 1 -- 172.21.15.71:0/2411525144 wait complete. 2023-10-06T01:42:03.755 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.751+0000 7f51cff54700 1 Processor -- start 2023-10-06T01:42:03.755 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.751+0000 7f51cff54700 1 -- start start 2023-10-06T01:42:03.758 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.752+0000 7f51cff54700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51b4004d50 0x7f51c8154c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:03.758 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.752+0000 7f51cff54700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f51c80ce7e0 0x7f51c8156170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:03.758 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.752+0000 7f51cff54700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f51c81566b0 0x7f51c80cf220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:03.758 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.752+0000 7f51cff54700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51c8156b50 con 0x7f51c81566b0 2023-10-06T01:42:03.758 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.752+0000 7f51cff54700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51c80c7970 con 0x7f51b4004d50 2023-10-06T01:42:03.758 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.752+0000 7f51cff54700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51c80c87d0 con 0x7f51c80ce7e0 2023-10-06T01:42:03.758 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.752+0000 7f51ce4f1700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f51c81566b0 0x7f51c80cf220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:03.758 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.752+0000 7f51ce4f1700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f51c81566b0 0x7f51c80cf220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38008/0 (socket says 172.21.15.71:38008) 2023-10-06T01:42:03.758 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.752+0000 7f51ce4f1700 1 -- 172.21.15.71:0/170647785 learned_addr learned my addr 172.21.15.71:0/170647785 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:03.758 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.752+0000 7f51cdcf0700 1 --2- 172.21.15.71:0/170647785 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51b4004d50 0x7f51c8154c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:03.759 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.752+0000 7f51ce4f1700 1 -- 172.21.15.71:0/170647785 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f51c80ce7e0 msgr2=0x7f51c8156170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:03.759 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.752+0000 7f51cd4ef700 1 --2- 172.21.15.71:0/170647785 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f51c80ce7e0 0x7f51c8156170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:03.759 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.752+0000 7f51ce4f1700 1 --2- 172.21.15.71:0/170647785 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f51c80ce7e0 0x7f51c8156170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:03.759 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.752+0000 7f51ce4f1700 1 -- 172.21.15.71:0/170647785 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51b4004d50 msgr2=0x7f51c8154c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:03.759 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.752+0000 7f51ce4f1700 1 --2- 172.21.15.71:0/170647785 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51b4004d50 0x7f51c8154c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:03.759 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.752+0000 7f51ce4f1700 1 -- 172.21.15.71:0/170647785 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51c80c7bc0 con 0x7f51c81566b0 2023-10-06T01:42:03.759 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.752+0000 7f51cdcf0700 1 --2- 172.21.15.71:0/170647785 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51b4004d50 0x7f51c8154c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:42:03.759 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.753+0000 7f51ce4f1700 1 --2- 172.21.15.71:0/170647785 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f51c81566b0 0x7f51c80cf220 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f51c0001e70 tx=0x7f51c0015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:03.759 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.753+0000 7f51bdffb700 1 -- 172.21.15.71:0/170647785 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51c0023070 con 0x7f51c81566b0 2023-10-06T01:42:03.759 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.753+0000 7f51bdffb700 1 -- 172.21.15.71:0/170647785 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51c001e400 con 0x7f51c81566b0 2023-10-06T01:42:03.759 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.753+0000 7f51cff54700 1 -- 172.21.15.71:0/170647785 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51c80c7ea0 con 0x7f51c81566b0 2023-10-06T01:42:03.759 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.753+0000 7f51bdffb700 1 -- 172.21.15.71:0/170647785 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51c001e7c0 con 0x7f51c81566b0 2023-10-06T01:42:03.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.753+0000 7f51cff54700 1 -- 172.21.15.71:0/170647785 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51c80c8460 con 0x7f51c81566b0 2023-10-06T01:42:03.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.754+0000 7f51cff54700 1 -- 172.21.15.71:0/170647785 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51c80c8960 con 0x7f51c81566b0 2023-10-06T01:42:03.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.754+0000 7f51bdffb700 1 -- 172.21.15.71:0/170647785 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f51c0019070 con 0x7f51c81566b0 2023-10-06T01:42:03.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.755+0000 7f51bdffb700 1 --2- 172.21.15.71:0/170647785 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f51ac066f30 0x7f51ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:03.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.755+0000 7f51bdffb700 1 -- 172.21.15.71:0/170647785 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f51c0085310 con 0x7f51c81566b0 2023-10-06T01:42:03.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.755+0000 7f51cdcf0700 1 --2- 172.21.15.71:0/170647785 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f51ac066f30 0x7f51ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:03.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.755+0000 7f51cdcf0700 1 --2- 172.21.15.71:0/170647785 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f51ac066f30 0x7f51ac0693e0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f51c4001920 tx=0x7f51c4006040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:03.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.759+0000 7f51bdffb700 1 -- 172.21.15.71:0/170647785 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f51c00522e0 con 0x7f51c81566b0 2023-10-06T01:42:03.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.941+0000 7f51cff54700 1 -- 172.21.15.71:0/170647785 --> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f51c80cad20 con 0x7f51ac066f30 2023-10-06T01:42:03.950 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.949+0000 7f51bdffb700 1 -- 172.21.15.71:0/170647785 <== mgr.4107 v2:172.21.15.71:6832/90436 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306165 (secure 0 0 0) 0x7f51c80cad20 con 0x7f51ac066f30 2023-10-06T01:42:03.953 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:42:03.956 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.953+0000 7f51cff54700 1 -- 172.21.15.71:0/170647785 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f51ac066f30 msgr2=0x7f51ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:03.956 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.953+0000 7f51cff54700 1 --2- 172.21.15.71:0/170647785 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f51ac066f30 0x7f51ac0693e0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f51c4001920 tx=0x7f51c4006040 comp rx=0 tx=0).stop 2023-10-06T01:42:03.956 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.953+0000 7f51cff54700 1 -- 172.21.15.71:0/170647785 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f51c81566b0 msgr2=0x7f51c80cf220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:03.956 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.953+0000 7f51cff54700 1 --2- 172.21.15.71:0/170647785 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f51c81566b0 0x7f51c80cf220 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f51c0001e70 tx=0x7f51c0015000 comp rx=0 tx=0).stop 2023-10-06T01:42:03.956 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.953+0000 7f51cff54700 1 -- 172.21.15.71:0/170647785 shutdown_connections 2023-10-06T01:42:03.956 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.953+0000 7f51cff54700 1 --2- 172.21.15.71:0/170647785 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f51c81566b0 0x7f51c80cf220 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:03.956 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.953+0000 7f51cff54700 1 --2- 172.21.15.71:0/170647785 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f51ac066f30 0x7f51ac0693e0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:03.956 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.953+0000 7f51cff54700 1 --2- 172.21.15.71:0/170647785 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51b4004d50 0x7f51c8154c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:03.957 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.953+0000 7f51cff54700 1 --2- 172.21.15.71:0/170647785 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f51c80ce7e0 0x7f51c8156170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:03.957 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.953+0000 7f51cff54700 1 -- 172.21.15.71:0/170647785 >> 172.21.15.71:0/170647785 conn(0x7f51c8068680 msgr2=0x7f51c8158380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:03.957 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.953+0000 7f51cff54700 1 -- 172.21.15.71:0/170647785 shutdown_connections 2023-10-06T01:42:03.957 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:03.953+0000 7f51cff54700 1 -- 172.21.15.71:0/170647785 wait complete. 2023-10-06T01:42:03.957 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2023-10-06T01:42:03.965 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":104,"stamp":"2023-10-06T01:42:02.584668+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":186,"acting":186,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2384268,"kb_used_data":5964,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752590452,"statfs":{"total":773094113280,"available":770652622848,"internally_reserved":0,"allocated":6107136,"data_stored":3418511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.687669"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.896742+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.910418+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:41:29.186282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.912402+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:29:11.316429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.916266+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:18:09.749842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.896742+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.915041+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:41:29.186282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.896742+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.909509+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:43:48.006348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.896742+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.907410+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:01:45.573351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.907419+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:24:21.805228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.914029+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:01:33.492883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.908281+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:42:12.631213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.896742+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.896742+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.914746+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:49:48.083851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.911980+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:44:24.458680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.916103+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:03:30.300603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.896742+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.912008+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:30:18.755143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.915155+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:01:33.492883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.912024+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:45:31.777277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.912580+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:58:36.821428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.909350+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:03:59.520161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.896742+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.915878+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:24:39.815662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.920606+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:44:24.458680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.896742+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.911961+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:38:19.366140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.915723+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:45:25.302080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.896742+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.919999+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:38:19.366140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.920324+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:40:12.842857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T01:41:58.922614+0000","last_change":"2023-10-06T01:41:58.922614+0000","last_active":"2023-10-06T01:41:58.922614+0000","last_peered":"2023-10-06T01:41:58.922614+0000","last_clean":"2023-10-06T01:41:58.922614+0000","last_became_active":"2023-10-06T01:41:58.922235+0000","last_became_peered":"2023-10-06T01:41:58.922235+0000","last_unstale":"2023-10-06T01:41:58.922614+0000","last_undegraded":"2023-10-06T01:41:58.922614+0000","last_fullsized":"2023-10-06T01:41:58.922614+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:02.086327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.907363+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:58.335794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T01:41:58.924804+0000","last_change":"2023-10-06T01:41:58.924804+0000","last_active":"2023-10-06T01:41:58.924804+0000","last_peered":"2023-10-06T01:41:58.924804+0000","last_clean":"2023-10-06T01:41:58.924804+0000","last_became_active":"2023-10-06T01:41:58.924520+0000","last_became_peered":"2023-10-06T01:41:58.924520+0000","last_unstale":"2023-10-06T01:41:58.924804+0000","last_undegraded":"2023-10-06T01:41:58.924804+0000","last_fullsized":"2023-10-06T01:41:58.924804+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:45:24.296902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.914449+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:07:25.175365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T01:41:58.923283+0000","last_change":"2023-10-06T01:41:58.923283+0000","last_active":"2023-10-06T01:41:58.923283+0000","last_peered":"2023-10-06T01:41:58.923283+0000","last_clean":"2023-10-06T01:41:58.923283+0000","last_became_active":"2023-10-06T01:41:58.921507+0000","last_became_peered":"2023-10-06T01:41:58.921507+0000","last_unstale":"2023-10-06T01:41:58.923283+0000","last_undegraded":"2023-10-06T01:41:58.923283+0000","last_fullsized":"2023-10-06T01:41:58.923283+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:18:08.744663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.915526+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:05:48.629746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T01:41:58.927325+0000","last_change":"2023-10-06T01:41:58.927325+0000","last_active":"2023-10-06T01:41:58.927325+0000","last_peered":"2023-10-06T01:41:58.927325+0000","last_clean":"2023-10-06T01:41:58.927325+0000","last_became_active":"2023-10-06T01:41:58.927064+0000","last_became_peered":"2023-10-06T01:41:58.927064+0000","last_unstale":"2023-10-06T01:41:58.927325+0000","last_undegraded":"2023-10-06T01:41:58.927325+0000","last_fullsized":"2023-10-06T01:41:58.927325+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:10:11.010664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.908666+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:07:25.175365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:57.891564+0000","last_change":"2023-10-06T01:41:57.899187+0000","last_active":"2023-10-06T01:41:57.891564+0000","last_peered":"2023-10-06T01:41:57.891564+0000","last_clean":"2023-10-06T01:41:57.891564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:57.891564+0000","last_undegraded":"2023-10-06T01:41:57.891564+0000","last_fullsized":"2023-10-06T01:41:57.891564+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:01:32.487705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.910688+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:05:48.629746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T01:41:58.925616+0000","last_change":"2023-10-06T01:41:58.925616+0000","last_active":"2023-10-06T01:41:58.925616+0000","last_peered":"2023-10-06T01:41:58.925616+0000","last_clean":"2023-10-06T01:41:58.925616+0000","last_became_active":"2023-10-06T01:41:58.921298+0000","last_became_peered":"2023-10-06T01:41:58.921298+0000","last_unstale":"2023-10-06T01:41:58.925616+0000","last_undegraded":"2023-10-06T01:41:58.925616+0000","last_fullsized":"2023-10-06T01:41:58.925616+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:24:38.810483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.909788+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:49:01.938924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T01:41:58.918654+0000","last_change":"2023-10-06T01:41:58.918654+0000","last_active":"2023-10-06T01:41:58.918654+0000","last_peered":"2023-10-06T01:41:58.918654+0000","last_clean":"2023-10-06T01:41:58.918654+0000","last_became_active":"2023-10-06T01:41:58.916820+0000","last_became_peered":"2023-10-06T01:41:58.916820+0000","last_unstale":"2023-10-06T01:41:58.918654+0000","last_undegraded":"2023-10-06T01:41:58.918654+0000","last_fullsized":"2023-10-06T01:41:58.918654+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:29:10.311250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.910889+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:40:12.842857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:57.891564+0000","last_change":"2023-10-06T01:41:57.899593+0000","last_active":"2023-10-06T01:41:57.891564+0000","last_peered":"2023-10-06T01:41:57.891564+0000","last_clean":"2023-10-06T01:41:57.891564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:57.891564+0000","last_undegraded":"2023-10-06T01:41:57.891564+0000","last_fullsized":"2023-10-06T01:41:57.891564+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:19:51.858217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.896742+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T01:41:58.928025+0000","last_change":"2023-10-06T01:41:58.928025+0000","last_active":"2023-10-06T01:41:58.928025+0000","last_peered":"2023-10-06T01:41:58.928025+0000","last_clean":"2023-10-06T01:41:58.928025+0000","last_became_active":"2023-10-06T01:41:58.927745+0000","last_became_peered":"2023-10-06T01:41:58.927745+0000","last_unstale":"2023-10-06T01:41:58.928025+0000","last_undegraded":"2023-10-06T01:41:58.928025+0000","last_fullsized":"2023-10-06T01:41:58.928025+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:04:52.797213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.912424+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:10:12.015842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T01:41:58.923640+0000","last_change":"2023-10-06T01:41:58.923640+0000","last_active":"2023-10-06T01:41:58.923640+0000","last_peered":"2023-10-06T01:41:58.923640+0000","last_clean":"2023-10-06T01:41:58.923640+0000","last_became_active":"2023-10-06T01:41:58.923367+0000","last_became_peered":"2023-10-06T01:41:58.923367+0000","last_unstale":"2023-10-06T01:41:58.923640+0000","last_undegraded":"2023-10-06T01:41:58.923640+0000","last_fullsized":"2023-10-06T01:41:58.923640+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:33:28.414752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.907411+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:05:04.598712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T01:41:58.926296+0000","last_change":"2023-10-06T01:41:58.926296+0000","last_active":"2023-10-06T01:41:58.926296+0000","last_peered":"2023-10-06T01:41:58.926296+0000","last_clean":"2023-10-06T01:41:58.926296+0000","last_became_active":"2023-10-06T01:41:58.926034+0000","last_became_peered":"2023-10-06T01:41:58.926034+0000","last_unstale":"2023-10-06T01:41:58.926296+0000","last_undegraded":"2023-10-06T01:41:58.926296+0000","last_fullsized":"2023-10-06T01:41:58.926296+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:47:16.825984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.915435+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:19:52.863396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:57.891564+0000","last_change":"2023-10-06T01:41:57.898932+0000","last_active":"2023-10-06T01:41:57.891564+0000","last_peered":"2023-10-06T01:41:57.891564+0000","last_clean":"2023-10-06T01:41:57.891564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:57.891564+0000","last_undegraded":"2023-10-06T01:41:57.891564+0000","last_fullsized":"2023-10-06T01:41:57.891564+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:58:36.151365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.914388+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:45:25.302080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T01:41:58.923632+0000","last_change":"2023-10-06T01:41:58.923632+0000","last_active":"2023-10-06T01:41:58.923632+0000","last_peered":"2023-10-06T01:41:58.923632+0000","last_clean":"2023-10-06T01:41:58.923632+0000","last_became_active":"2023-10-06T01:41:58.923405+0000","last_became_peered":"2023-10-06T01:41:58.923405+0000","last_unstale":"2023-10-06T01:41:58.923632+0000","last_undegraded":"2023-10-06T01:41:58.923632+0000","last_fullsized":"2023-10-06T01:41:58.923632+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:07:24.731136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.912350+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:51:28.647163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T01:41:58.924504+0000","last_change":"2023-10-06T01:41:58.924504+0000","last_active":"2023-10-06T01:41:58.924504+0000","last_peered":"2023-10-06T01:41:58.924504+0000","last_clean":"2023-10-06T01:41:58.924504+0000","last_became_active":"2023-10-06T01:41:58.924234+0000","last_became_peered":"2023-10-06T01:41:58.924234+0000","last_unstale":"2023-10-06T01:41:58.924504+0000","last_undegraded":"2023-10-06T01:41:58.924504+0000","last_fullsized":"2023-10-06T01:41:58.924504+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:01:44.568173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.896742+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T01:41:58.927423+0000","last_change":"2023-10-06T01:41:58.927423+0000","last_active":"2023-10-06T01:41:58.927423+0000","last_peered":"2023-10-06T01:41:58.927423+0000","last_clean":"2023-10-06T01:41:58.927423+0000","last_became_active":"2023-10-06T01:41:58.927082+0000","last_became_peered":"2023-10-06T01:41:58.927082+0000","last_unstale":"2023-10-06T01:41:58.927423+0000","last_undegraded":"2023-10-06T01:41:58.927423+0000","last_fullsized":"2023-10-06T01:41:58.927423+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:04.780513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.912063+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:30:22.065390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T01:41:58.925098+0000","last_change":"2023-10-06T01:41:58.925098+0000","last_active":"2023-10-06T01:41:58.925098+0000","last_peered":"2023-10-06T01:41:58.925098+0000","last_clean":"2023-10-06T01:41:58.925098+0000","last_became_active":"2023-10-06T01:41:58.924857+0000","last_became_peered":"2023-10-06T01:41:58.924857+0000","last_unstale":"2023-10-06T01:41:58.925098+0000","last_undegraded":"2023-10-06T01:41:58.925098+0000","last_fullsized":"2023-10-06T01:41:58.925098+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:33:57.280587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.914411+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:03.091506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T01:41:58.919223+0000","last_change":"2023-10-06T01:41:58.919223+0000","last_active":"2023-10-06T01:41:58.919223+0000","last_peered":"2023-10-06T01:41:58.919223+0000","last_clean":"2023-10-06T01:41:58.919223+0000","last_became_active":"2023-10-06T01:41:58.918835+0000","last_became_peered":"2023-10-06T01:41:58.918835+0000","last_unstale":"2023-10-06T01:41:58.919223+0000","last_undegraded":"2023-10-06T01:41:58.919223+0000","last_fullsized":"2023-10-06T01:41:58.919223+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:21:25.598775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.914043+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:19:52.863396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T01:41:58.922702+0000","last_change":"2023-10-06T01:41:58.922702+0000","last_active":"2023-10-06T01:41:58.922702+0000","last_peered":"2023-10-06T01:41:58.922702+0000","last_clean":"2023-10-06T01:41:58.922702+0000","last_became_active":"2023-10-06T01:41:58.922346+0000","last_became_peered":"2023-10-06T01:41:58.922346+0000","last_unstale":"2023-10-06T01:41:58.922702+0000","last_undegraded":"2023-10-06T01:41:58.922702+0000","last_fullsized":"2023-10-06T01:41:58.922702+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:45:24.296902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.906906+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:56:38.345981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T01:41:58.912477+0000","last_change":"2023-10-06T01:41:58.912477+0000","last_active":"2023-10-06T01:41:58.912477+0000","last_peered":"2023-10-06T01:41:58.912477+0000","last_clean":"2023-10-06T01:41:58.912477+0000","last_became_active":"2023-10-06T01:41:58.912169+0000","last_became_peered":"2023-10-06T01:41:58.912169+0000","last_unstale":"2023-10-06T01:41:58.912477+0000","last_undegraded":"2023-10-06T01:41:58.912477+0000","last_fullsized":"2023-10-06T01:41:58.912477+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:05:03.593533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.914723+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:41:15.451811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T01:41:58.922312+0000","last_change":"2023-10-06T01:41:58.922312+0000","last_active":"2023-10-06T01:41:58.922312+0000","last_peered":"2023-10-06T01:41:58.922312+0000","last_clean":"2023-10-06T01:41:58.922312+0000","last_became_active":"2023-10-06T01:41:58.922064+0000","last_became_peered":"2023-10-06T01:41:58.922064+0000","last_unstale":"2023-10-06T01:41:58.922312+0000","last_undegraded":"2023-10-06T01:41:58.922312+0000","last_fullsized":"2023-10-06T01:41:58.922312+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:51:27.641984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.909907+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:49:48.083851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T01:41:58.917481+0000","last_change":"2023-10-06T01:41:58.917481+0000","last_active":"2023-10-06T01:41:58.917481+0000","last_peered":"2023-10-06T01:41:58.917481+0000","last_clean":"2023-10-06T01:41:58.917481+0000","last_became_active":"2023-10-06T01:41:58.917211+0000","last_became_peered":"2023-10-06T01:41:58.917211+0000","last_unstale":"2023-10-06T01:41:58.917481+0000","last_undegraded":"2023-10-06T01:41:58.917481+0000","last_fullsized":"2023-10-06T01:41:58.917481+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:21:12.405145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.912792+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:05.785692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:57.891564+0000","last_change":"2023-10-06T01:41:57.899500+0000","last_active":"2023-10-06T01:41:57.891564+0000","last_peered":"2023-10-06T01:41:57.891564+0000","last_clean":"2023-10-06T01:41:57.891564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:57.891564+0000","last_undegraded":"2023-10-06T01:41:57.891564+0000","last_fullsized":"2023-10-06T01:41:57.891564+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:33:28.414752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.906918+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:41:20.410820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T01:41:58.922092+0000","last_change":"2023-10-06T01:41:58.922092+0000","last_active":"2023-10-06T01:41:58.922092+0000","last_peered":"2023-10-06T01:41:58.922092+0000","last_clean":"2023-10-06T01:41:58.922092+0000","last_became_active":"2023-10-06T01:41:58.921857+0000","last_became_peered":"2023-10-06T01:41:58.921857+0000","last_unstale":"2023-10-06T01:41:58.922092+0000","last_undegraded":"2023-10-06T01:41:58.922092+0000","last_fullsized":"2023-10-06T01:41:58.922092+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:25:35.328771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.908924+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:41:15.451811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T01:41:58.917439+0000","last_change":"2023-10-06T01:41:58.917439+0000","last_active":"2023-10-06T01:41:58.917439+0000","last_peered":"2023-10-06T01:41:58.917439+0000","last_clean":"2023-10-06T01:41:58.917439+0000","last_became_active":"2023-10-06T01:41:58.917205+0000","last_became_peered":"2023-10-06T01:41:58.917205+0000","last_unstale":"2023-10-06T01:41:58.917439+0000","last_undegraded":"2023-10-06T01:41:58.917439+0000","last_fullsized":"2023-10-06T01:41:58.917439+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:24:38.810483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.914512+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:03:30.300603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T01:41:58.925582+0000","last_change":"2023-10-06T01:41:58.925582+0000","last_active":"2023-10-06T01:41:58.925582+0000","last_peered":"2023-10-06T01:41:58.925582+0000","last_clean":"2023-10-06T01:41:58.925582+0000","last_became_active":"2023-10-06T01:41:58.923189+0000","last_became_peered":"2023-10-06T01:41:58.923189+0000","last_unstale":"2023-10-06T01:41:58.925582+0000","last_undegraded":"2023-10-06T01:41:58.925582+0000","last_fullsized":"2023-10-06T01:41:58.925582+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:03:29.295425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":38,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-06T01:41:57.903557+0000","last_change":"2023-10-06T01:40:16.930992+0000","last_active":"2023-10-06T01:41:57.903557+0000","last_peered":"2023-10-06T01:41:57.903557+0000","last_clean":"2023-10-06T01:41:57.903557+0000","last_became_active":"2023-10-06T01:40:16.930707+0000","last_became_peered":"2023-10-06T01:40:16.930707+0000","last_unstale":"2023-10-06T01:41:57.903557+0000","last_undegraded":"2023-10-06T01:41:57.903557+0000","last_fullsized":"2023-10-06T01:41:57.903557+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:52:43.316071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.914746+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:43:48.006348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T01:41:58.922335+0000","last_change":"2023-10-06T01:41:58.922335+0000","last_active":"2023-10-06T01:41:58.922335+0000","last_peered":"2023-10-06T01:41:58.922335+0000","last_clean":"2023-10-06T01:41:58.922335+0000","last_became_active":"2023-10-06T01:41:58.922038+0000","last_became_peered":"2023-10-06T01:41:58.922038+0000","last_unstale":"2023-10-06T01:41:58.922335+0000","last_undegraded":"2023-10-06T01:41:58.922335+0000","last_fullsized":"2023-10-06T01:41:58.922335+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:58:36.151365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":38,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-06T01:41:57.904071+0000","last_change":"2023-10-06T01:40:16.651019+0000","last_active":"2023-10-06T01:41:57.904071+0000","last_peered":"2023-10-06T01:41:57.904071+0000","last_clean":"2023-10-06T01:41:57.904071+0000","last_became_active":"2023-10-06T01:40:16.650628+0000","last_became_peered":"2023-10-06T01:40:16.650628+0000","last_unstale":"2023-10-06T01:41:57.904071+0000","last_undegraded":"2023-10-06T01:41:57.904071+0000","last_fullsized":"2023-10-06T01:41:57.904071+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:11:57.218984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.912923+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:33:29.419931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T01:41:58.918081+0000","last_change":"2023-10-06T01:41:58.918081+0000","last_active":"2023-10-06T01:41:58.918081+0000","last_peered":"2023-10-06T01:41:58.918081+0000","last_clean":"2023-10-06T01:41:58.918081+0000","last_became_active":"2023-10-06T01:41:58.912873+0000","last_became_peered":"2023-10-06T01:41:58.912873+0000","last_unstale":"2023-10-06T01:41:58.918081+0000","last_undegraded":"2023-10-06T01:41:58.918081+0000","last_fullsized":"2023-10-06T01:41:58.918081+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:03:29.295425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":36,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-06T01:41:55.479776+0000","last_change":"2023-10-06T01:40:16.781596+0000","last_active":"2023-10-06T01:41:55.479776+0000","last_peered":"2023-10-06T01:41:55.479776+0000","last_clean":"2023-10-06T01:41:55.479776+0000","last_became_active":"2023-10-06T01:40:16.781352+0000","last_became_peered":"2023-10-06T01:40:16.781352+0000","last_unstale":"2023-10-06T01:41:55.479776+0000","last_undegraded":"2023-10-06T01:41:55.479776+0000","last_fullsized":"2023-10-06T01:41:55.479776+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:52:43.316071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.908594+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:24:01.329759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T01:41:58.923132+0000","last_change":"2023-10-06T01:41:58.923132+0000","last_active":"2023-10-06T01:41:58.923132+0000","last_peered":"2023-10-06T01:41:58.923132+0000","last_clean":"2023-10-06T01:41:58.923132+0000","last_became_active":"2023-10-06T01:41:58.922860+0000","last_became_peered":"2023-10-06T01:41:58.922860+0000","last_unstale":"2023-10-06T01:41:58.923132+0000","last_undegraded":"2023-10-06T01:41:58.923132+0000","last_fullsized":"2023-10-06T01:41:58.923132+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:24:20.800050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":38,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-06T01:41:57.904002+0000","last_change":"2023-10-06T01:40:16.650826+0000","last_active":"2023-10-06T01:41:57.904002+0000","last_peered":"2023-10-06T01:41:57.904002+0000","last_clean":"2023-10-06T01:41:57.904002+0000","last_became_active":"2023-10-06T01:40:16.650469+0000","last_became_peered":"2023-10-06T01:40:16.650469+0000","last_unstale":"2023-10-06T01:41:57.904002+0000","last_undegraded":"2023-10-06T01:41:57.904002+0000","last_fullsized":"2023-10-06T01:41:57.904002+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:50:23.628212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":190,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-06T01:41:57.903526+0000","last_change":"2023-10-06T01:40:10.645512+0000","last_active":"2023-10-06T01:41:57.903526+0000","last_peered":"2023-10-06T01:41:57.903526+0000","last_clean":"2023-10-06T01:41:57.903526+0000","last_became_active":"2023-10-06T01:40:10.644601+0000","last_became_peered":"2023-10-06T01:40:10.644601+0000","last_unstale":"2023-10-06T01:41:57.903526+0000","last_undegraded":"2023-10-06T01:41:57.903526+0000","last_fullsized":"2023-10-06T01:41:57.903526+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:09.580865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:09.580865+0000","last_clean_scrub_stamp":"2023-10-06T01:40:09.580865+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:05:28.268591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.915623+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:56:51.126033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T01:41:58.920513+0000","last_change":"2023-10-06T01:41:58.920513+0000","last_active":"2023-10-06T01:41:58.920513+0000","last_peered":"2023-10-06T01:41:58.920513+0000","last_clean":"2023-10-06T01:41:58.920513+0000","last_became_active":"2023-10-06T01:41:58.920202+0000","last_became_peered":"2023-10-06T01:41:58.920202+0000","last_unstale":"2023-10-06T01:41:58.920513+0000","last_undegraded":"2023-10-06T01:41:58.920513+0000","last_fullsized":"2023-10-06T01:41:58.920513+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:53:53.773734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":37,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-06T01:41:57.903617+0000","last_change":"2023-10-06T01:40:16.651332+0000","last_active":"2023-10-06T01:41:57.903617+0000","last_peered":"2023-10-06T01:41:57.903617+0000","last_clean":"2023-10-06T01:41:57.903617+0000","last_became_active":"2023-10-06T01:40:16.651049+0000","last_became_peered":"2023-10-06T01:40:16.651049+0000","last_unstale":"2023-10-06T01:41:57.903617+0000","last_undegraded":"2023-10-06T01:41:57.903617+0000","last_fullsized":"2023-10-06T01:41:57.903617+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:11:57.218984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.914907+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:33:29.419931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T01:41:58.923811+0000","last_change":"2023-10-06T01:41:58.923811+0000","last_active":"2023-10-06T01:41:58.923811+0000","last_peered":"2023-10-06T01:41:58.923811+0000","last_clean":"2023-10-06T01:41:58.923811+0000","last_became_active":"2023-10-06T01:41:58.923398+0000","last_became_peered":"2023-10-06T01:41:58.923398+0000","last_unstale":"2023-10-06T01:41:58.923811+0000","last_undegraded":"2023-10-06T01:41:58.923811+0000","last_fullsized":"2023-10-06T01:41:58.923811+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:01:32.487705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":37,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-06T01:41:57.903415+0000","last_change":"2023-10-06T01:40:16.931106+0000","last_active":"2023-10-06T01:41:57.903415+0000","last_peered":"2023-10-06T01:41:57.903415+0000","last_clean":"2023-10-06T01:41:57.903415+0000","last_became_active":"2023-10-06T01:40:16.930830+0000","last_became_peered":"2023-10-06T01:40:16.930830+0000","last_unstale":"2023-10-06T01:41:57.903415+0000","last_undegraded":"2023-10-06T01:41:57.903415+0000","last_fullsized":"2023-10-06T01:41:57.903415+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:50:23.628212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.912836+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:58:37.156543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T01:41:58.923417+0000","last_change":"2023-10-06T01:41:58.923417+0000","last_active":"2023-10-06T01:41:58.923417+0000","last_peered":"2023-10-06T01:41:58.923417+0000","last_clean":"2023-10-06T01:41:58.923417+0000","last_became_active":"2023-10-06T01:41:58.922483+0000","last_became_peered":"2023-10-06T01:41:58.922483+0000","last_unstale":"2023-10-06T01:41:58.923417+0000","last_undegraded":"2023-10-06T01:41:58.923417+0000","last_fullsized":"2023-10-06T01:41:58.923417+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:07:24.731136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":38,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-06T01:41:57.903592+0000","last_change":"2023-10-06T01:40:16.649379+0000","last_active":"2023-10-06T01:41:57.903592+0000","last_peered":"2023-10-06T01:41:57.903592+0000","last_clean":"2023-10-06T01:41:57.903592+0000","last_became_active":"2023-10-06T01:40:16.649147+0000","last_became_peered":"2023-10-06T01:40:16.649147+0000","last_unstale":"2023-10-06T01:41:57.903592+0000","last_undegraded":"2023-10-06T01:41:57.903592+0000","last_fullsized":"2023-10-06T01:41:57.903592+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:11:57.218984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.910855+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:56:51.126033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T01:41:58.926962+0000","last_change":"2023-10-06T01:41:58.926962+0000","last_active":"2023-10-06T01:41:58.926962+0000","last_peered":"2023-10-06T01:41:58.926962+0000","last_clean":"2023-10-06T01:41:58.926962+0000","last_became_active":"2023-10-06T01:41:58.926758+0000","last_became_peered":"2023-10-06T01:41:58.926758+0000","last_unstale":"2023-10-06T01:41:58.926962+0000","last_undegraded":"2023-10-06T01:41:58.926962+0000","last_fullsized":"2023-10-06T01:41:58.926962+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:58:35.816250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":39,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-06T01:41:57.900751+0000","last_change":"2023-10-06T01:40:16.651477+0000","last_active":"2023-10-06T01:41:57.900751+0000","last_peered":"2023-10-06T01:41:57.900751+0000","last_clean":"2023-10-06T01:41:57.900751+0000","last_became_active":"2023-10-06T01:40:16.651190+0000","last_became_peered":"2023-10-06T01:40:16.651190+0000","last_unstale":"2023-10-06T01:41:57.900751+0000","last_undegraded":"2023-10-06T01:41:57.900751+0000","last_fullsized":"2023-10-06T01:41:57.900751+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:45:47.422876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":104,"acting":104,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298472,"kb_used_data":1184,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073368,"statfs":{"total":96636764160,"available":96331128832,"internally_reserved":0,"allocated":1212416,"data_stored":871942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:41:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":3.6920000000000002,"5min":3.6920000000000002,"15min":3.6920000000000002},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":3.629,"5min":3.629,"15min":3.629},"last":0.55900000000000005}]},{"osd":1,"last update":"Fri Oct 6 01:41:11 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":10.029999999999999,"5min":10.029999999999999,"15min":10.029999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.544,"5min":1.544,"15min":1.544},"last":0.47599999999999998}]},{"osd":2,"last update":"Fri Oct 6 01:41:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.45200000000000001},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":10.710000000000001,"5min":10.710000000000001,"15min":10.710000000000001},"last":0.57399999999999995}]},{"osd":3,"last update":"Fri Oct 6 01:41:11 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":3.6509999999999998,"5min":3.6509999999999998,"15min":3.6509999999999998},"last":0.46700000000000003}]},{"osd":4,"last update":"Fri Oct 6 01:41:11 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.436},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.48499999999999999}]},{"osd":5,"last update":"Fri Oct 6 01:41:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.7509999999999999,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":0.53500000000000003}]},{"osd":6,"last update":"Fri Oct 6 01:41:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.9370000000000001,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":0.498},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.39300000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574874,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297892,"kb_used_data":604,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073948,"statfs":{"total":96636764160,"available":96331722752,"internally_reserved":0,"allocated":618496,"data_stored":281574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.42399999999999999}]},{"osd":1,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.56399999999999995}]},{"osd":2,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.54900000000000004}]},{"osd":3,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.495},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.53600000000000003}]},{"osd":4,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.61599999999999999}]},{"osd":5,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.59499999999999997}]},{"osd":7,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.57299999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297892,"kb_used_data":604,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073948,"statfs":{"total":96636764160,"available":96331722752,"internally_reserved":0,"allocated":618496,"data_stored":281574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.997,"15min":0.997},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":11.957000000000001,"5min":11.957000000000001,"15min":11.957000000000001},"last":0.26500000000000001},{"interface":"front","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":11.917,"5min":11.917,"15min":11.917},"last":0.35299999999999998}]},{"osd":2,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.30199999999999999}]},{"osd":3,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":6.2450000000000001,"5min":6.2450000000000001,"15min":6.2450000000000001},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":6.2939999999999996,"5min":6.2939999999999996,"15min":6.2939999999999996},"last":0.31900000000000001}]},{"osd":4,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":6.1669999999999998,"5min":6.1669999999999998,"15min":6.1669999999999998},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.68500000000000005}]},{"osd":5,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":6.2619999999999996,"5min":6.2619999999999996,"15min":6.2619999999999996},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":6.2350000000000003,"5min":6.2350000000000003,"15min":6.2350000000000003},"last":0.69399999999999995}]},{"osd":6,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":6.141,"5min":6.141,"15min":6.141},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":6.2069999999999999,"5min":6.2069999999999999,"15min":6.2069999999999999},"last":0.66400000000000003}]},{"osd":7,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":6.1040000000000001,"5min":6.1040000000000001,"15min":6.1040000000000001},"last":0.67600000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574874,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298468,"kb_used_data":1180,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073372,"statfs":{"total":96636764160,"available":96331132928,"internally_reserved":0,"allocated":1208320,"data_stored":870981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":3.9129999999999998,"5min":3.9129999999999998,"15min":3.9129999999999998},"last":0.34599999999999997}]},{"osd":2,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":15.237,"5min":15.237,"15min":15.237},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":3.7959999999999998,"5min":3.7959999999999998,"15min":3.7959999999999998},"last":0.30499999999999999}]},{"osd":3,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":5.2850000000000001,"5min":5.2850000000000001,"15min":5.2850000000000001},"last":0.376},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":15.263,"5min":15.263,"15min":15.263},"last":0.39700000000000002}]},{"osd":4,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":5.2590000000000003,"5min":5.2590000000000003,"15min":5.2590000000000003},"last":0.52400000000000002},{"interface":"front","average":{"1min":1.242,"5min":1.242,"15min":1.242},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":15.211,"5min":15.211,"15min":15.211},"last":0.51100000000000001}]},{"osd":5,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":3.8839999999999999,"5min":3.8839999999999999,"15min":3.8839999999999999},"last":0.498},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":5.2309999999999999,"5min":5.2309999999999999,"15min":5.2309999999999999},"last":0.44500000000000001}]},{"osd":6,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.212,"15min":1.212},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":15.175000000000001,"5min":15.175000000000001,"15min":15.175000000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":3.859,"5min":3.859,"15min":3.859},"last":0.46800000000000003}]},{"osd":7,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":3.831,"5min":3.831,"15min":3.831},"last":0.434},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":5.1959999999999997,"5min":5.1959999999999997,"15min":5.1959999999999997},"last":0.48999999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574874,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297880,"kb_used_data":592,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073960,"statfs":{"total":96636764160,"available":96331735040,"internally_reserved":0,"allocated":606208,"data_stored":274646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"last":0.32900000000000001}]},{"osd":1,"last update":"Fri Oct 6 01:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.311,"15min":0.311},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.254}]},{"osd":3,"last update":"Fri Oct 6 01:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.309},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.35099999999999998}]},{"osd":4,"last update":"Fri Oct 6 01:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.48299999999999998}]},{"osd":5,"last update":"Fri Oct 6 01:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.44}]},{"osd":6,"last update":"Fri Oct 6 01:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.58799999999999997}]},{"osd":7,"last update":"Fri Oct 6 01:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.498}]}]},{"osd":3,"up_from":13,"seq":55834574874,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297892,"kb_used_data":604,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073948,"statfs":{"total":96636764160,"available":96331722752,"internally_reserved":0,"allocated":618496,"data_stored":281574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.23200000000000001},{"interface":"front","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.34300000000000003}]},{"osd":1,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.317},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.28899999999999998}]},{"osd":2,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.33400000000000002}]},{"osd":4,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.57899999999999996}]},{"osd":5,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.46300000000000002}]},{"osd":6,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.53500000000000003}]},{"osd":7,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.54600000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297880,"kb_used_data":592,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073960,"statfs":{"total":96636764160,"available":96331735040,"internally_reserved":0,"allocated":606208,"data_stored":274646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.56599999999999995}]},{"osd":1,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":4.0780000000000003,"5min":4.0780000000000003,"15min":4.0780000000000003},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":4.1050000000000004,"5min":4.1050000000000004,"15min":4.1050000000000004},"last":0.61699999999999999}]},{"osd":2,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.67400000000000004}]},{"osd":3,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.63},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.49199999999999999}]},{"osd":5,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.437,"15min":0.437},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.312}]},{"osd":6,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.42299999999999999}]},{"osd":7,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.46100000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574874,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297892,"kb_used_data":604,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073948,"statfs":{"total":96636764160,"available":96331722752,"internally_reserved":0,"allocated":618496,"data_stored":281574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.505},{"interface":"front","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.34000000000000002}]},{"osd":1,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.38}]},{"osd":2,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.6970000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.42499999999999999}]},{"osd":3,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.52800000000000002}]},{"osd":4,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.55500000000000005}]},{"osd":6,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.54500000000000004}]},{"osd":7,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.821,"5min":1.821,"15min":1.821},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.57299999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T01:42:03.974 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T01:42:04.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.119+0000 7fc84744e700 1 Processor -- start 2023-10-06T01:42:04.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.119+0000 7fc84744e700 1 -- start start 2023-10-06T01:42:04.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.120+0000 7fc84744e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc840150740 0x7fc8400c8b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:04.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.120+0000 7fc84744e700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc84006c950 con 0x7fc840150370 2023-10-06T01:42:04.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.120+0000 7fc84744e700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc840069830 con 0x7fc84006cde0 2023-10-06T01:42:04.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.120+0000 7fc84744e700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc840069b10 con 0x7fc840150740 2023-10-06T01:42:04.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.120+0000 7fc8451ea700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fc840150370 0x7fc840069040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:33066/0 (socket says 172.21.15.71:33066) 2023-10-06T01:42:04.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.120+0000 7fc8451ea700 1 -- 172.21.15.71:0/309228462 learned_addr learned my addr 172.21.15.71:0/309228462 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:42:04.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.121+0000 7fc837fff700 1 -- 172.21.15.71:0/309228462 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3136488603 0 0) 0x7fc84006c950 con 0x7fc840150370 2023-10-06T01:42:04.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.121+0000 7fc837fff700 1 -- 172.21.15.71:0/309228462 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc82c003570 con 0x7fc840150370 2023-10-06T01:42:04.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.121+0000 7fc8449e9700 1 --2- 172.21.15.71:0/309228462 >> v2:172.21.15.72:3300/0 conn(0x7fc840150740 0x7fc8400c8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:04.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.121+0000 7fc837fff700 1 -- 172.21.15.71:0/309228462 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2376215175 0 0) 0x7fc82c003570 con 0x7fc840150370 2023-10-06T01:42:04.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.121+0000 7fc837fff700 1 -- 172.21.15.71:0/309228462 >> v2:172.21.15.72:3300/0 conn(0x7fc840150740 msgr2=0x7fc8400c8b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:04.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.121+0000 7fc837fff700 1 --2- 172.21.15.71:0/309228462 >> v2:172.21.15.72:3300/0 conn(0x7fc840150740 0x7fc8400c8b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:04.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.121+0000 7fc837fff700 1 -- 172.21.15.71:0/309228462 >> v1:172.21.15.72:6789/0 conn(0x7fc84006cde0 legacy=0x7fc8400af560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:04.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.121+0000 7fc837fff700 1 -- 172.21.15.71:0/309228462 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc84006c300 con 0x7fc840150370 2023-10-06T01:42:04.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.121+0000 7fc837fff700 1 -- 172.21.15.71:0/309228462 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1184243524 0 0) 0x7fc83c001470 con 0x7fc840150370 2023-10-06T01:42:04.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.121+0000 7fc8449e9700 1 --2- 172.21.15.71:0/309228462 >> v2:172.21.15.72:3300/0 conn(0x7fc840150740 0x7fc8400c8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:42:04.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.121+0000 7fc837fff700 1 -- 172.21.15.71:0/309228462 >> v1:172.21.15.71:6789/0 conn(0x7fc840150370 legacy=0x7fc840069040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:04.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.121+0000 7fc837fff700 1 --2- 172.21.15.71:0/309228462 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc82c003a60 0x7fc82c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:04.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.121+0000 7fc837fff700 1 --2- 172.21.15.71:0/309228462 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc82c004810 0x7fc82c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:04.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.121+0000 7fc837fff700 1 --2- 172.21.15.71:0/309228462 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc82c0052e0 0x7fc82c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:04.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.121+0000 7fc837fff700 1 -- 172.21.15.71:0/309228462 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc840069b10 con 0x7fc82c0052e0 2023-10-06T01:42:04.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.121+0000 7fc837fff700 1 -- 172.21.15.71:0/309228462 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc82c00c230 con 0x7fc82c004810 2023-10-06T01:42:04.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.121+0000 7fc837fff700 1 -- 172.21.15.71:0/309228462 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc82c00c3f0 con 0x7fc82c003a60 2023-10-06T01:42:04.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.121+0000 7fc8459eb700 1 --2- 172.21.15.71:0/309228462 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc82c0052e0 0x7fc82c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:04.127 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.121+0000 7fc8449e9700 1 --2- 172.21.15.71:0/309228462 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc82c004810 0x7fc82c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:04.127 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.121+0000 7fc8451ea700 1 --2- 172.21.15.71:0/309228462 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc82c003a60 0x7fc82c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:04.127 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.121+0000 7fc8459eb700 1 -- 172.21.15.71:0/309228462 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc82c003a60 msgr2=0x7fc82c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:04.127 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.121+0000 7fc8459eb700 1 --2- 172.21.15.71:0/309228462 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc82c003a60 0x7fc82c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:04.127 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.121+0000 7fc8459eb700 1 -- 172.21.15.71:0/309228462 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc82c004810 msgr2=0x7fc82c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:04.127 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.121+0000 7fc8459eb700 1 --2- 172.21.15.71:0/309228462 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc82c004810 0x7fc82c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:04.127 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.121+0000 7fc8459eb700 1 -- 172.21.15.71:0/309228462 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc82c003570 con 0x7fc82c0052e0 2023-10-06T01:42:04.127 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.121+0000 7fc8459eb700 1 -- 172.21.15.71:0/309228462 reap_dead start 2023-10-06T01:42:04.127 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.122+0000 7fc8459eb700 1 --2- 172.21.15.71:0/309228462 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc82c0052e0 0x7fc82c00ba60 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fc838001fc0 tx=0x7fc838001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79fd641ded7c100c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:04.127 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.122+0000 7fc837fff700 1 -- 172.21.15.71:0/309228462 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc838001950 con 0x7fc82c0052e0 2023-10-06T01:42:04.127 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.122+0000 7fc837fff700 1 -- 172.21.15.71:0/309228462 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc83800c8b0 con 0x7fc82c0052e0 2023-10-06T01:42:04.128 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.122+0000 7fc837fff700 1 -- 172.21.15.71:0/309228462 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83800cc90 con 0x7fc82c0052e0 2023-10-06T01:42:04.128 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.122+0000 7fc84744e700 1 -- 172.21.15.71:0/309228462 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc82c0052e0 msgr2=0x7fc82c00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:04.128 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.122+0000 7fc84744e700 1 --2- 172.21.15.71:0/309228462 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc82c0052e0 0x7fc82c00ba60 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fc838001fc0 tx=0x7fc838001640 comp rx=0 tx=0).stop 2023-10-06T01:42:04.128 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.122+0000 7fc84744e700 1 -- 172.21.15.71:0/309228462 shutdown_connections 2023-10-06T01:42:04.128 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.122+0000 7fc84744e700 1 --2- 172.21.15.71:0/309228462 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc82c0052e0 0x7fc82c00ba60 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:04.128 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.122+0000 7fc84744e700 1 -- 172.21.15.71:0/309228462 >> 172.21.15.71:0/309228462 conn(0x7fc84006b6e0 msgr2=0x7fc8400ae170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:04.128 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.122+0000 7fc84744e700 1 -- 172.21.15.71:0/309228462 shutdown_connections 2023-10-06T01:42:04.128 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.122+0000 7fc84744e700 1 -- 172.21.15.71:0/309228462 wait complete. 2023-10-06T01:42:04.128 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.123+0000 7fc84744e700 1 Processor -- start 2023-10-06T01:42:04.128 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.123+0000 7fc84744e700 1 -- start start 2023-10-06T01:42:04.131 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.124+0000 7fc84744e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc82c0052e0 0x7fc84014e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:04.131 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.124+0000 7fc84744e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8400adb30 0x7fc8400adfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:04.131 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.124+0000 7fc84744e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc84015ab50 0x7fc84015aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:04.131 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.124+0000 7fc84744e700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc840155df0 con 0x7fc82c0052e0 2023-10-06T01:42:04.131 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.124+0000 7fc84744e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8400ae4e0 con 0x7fc8400adb30 2023-10-06T01:42:04.131 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.124+0000 7fc84744e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc84014ecf0 con 0x7fc84015ab50 2023-10-06T01:42:04.131 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.124+0000 7fc8451ea700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc82c0052e0 0x7fc84014e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:04.131 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.124+0000 7fc8451ea700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc82c0052e0 0x7fc84014e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38032/0 (socket says 172.21.15.71:38032) 2023-10-06T01:42:04.131 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.124+0000 7fc8451ea700 1 -- 172.21.15.71:0/178048043 learned_addr learned my addr 172.21.15.71:0/178048043 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:04.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.125+0000 7fc8449e9700 1 --2- 172.21.15.71:0/178048043 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8400adb30 0x7fc8400adfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:04.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.125+0000 7fc8459eb700 1 --2- 172.21.15.71:0/178048043 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc84015ab50 0x7fc84015aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:04.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.125+0000 7fc8451ea700 1 -- 172.21.15.71:0/178048043 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc84015ab50 msgr2=0x7fc84015aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:04.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.125+0000 7fc8451ea700 1 --2- 172.21.15.71:0/178048043 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc84015ab50 0x7fc84015aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:04.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.125+0000 7fc8451ea700 1 -- 172.21.15.71:0/178048043 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8400adb30 msgr2=0x7fc8400adfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:04.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.125+0000 7fc8451ea700 1 --2- 172.21.15.71:0/178048043 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8400adb30 0x7fc8400adfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:04.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.125+0000 7fc8451ea700 1 -- 172.21.15.71:0/178048043 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc84015b530 con 0x7fc82c0052e0 2023-10-06T01:42:04.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.125+0000 7fc8451ea700 1 --2- 172.21.15.71:0/178048043 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc82c0052e0 0x7fc84014e7b0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fc83c007390 tx=0x7fc83c001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:04.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.125+0000 7fc8357fa700 1 -- 172.21.15.71:0/178048043 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83c018030 con 0x7fc82c0052e0 2023-10-06T01:42:04.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.125+0000 7fc8357fa700 1 -- 172.21.15.71:0/178048043 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc83c007820 con 0x7fc82c0052e0 2023-10-06T01:42:04.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.125+0000 7fc84744e700 1 -- 172.21.15.71:0/178048043 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc84015b7d0 con 0x7fc82c0052e0 2023-10-06T01:42:04.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.125+0000 7fc8357fa700 1 -- 172.21.15.71:0/178048043 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83c00fb20 con 0x7fc82c0052e0 2023-10-06T01:42:04.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.125+0000 7fc84744e700 1 -- 172.21.15.71:0/178048043 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc84015bd90 con 0x7fc82c0052e0 2023-10-06T01:42:04.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.126+0000 7fc84744e700 1 -- 172.21.15.71:0/178048043 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc84006db40 con 0x7fc82c0052e0 2023-10-06T01:42:04.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.126+0000 7fc8357fa700 1 -- 172.21.15.71:0/178048043 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc83c01b070 con 0x7fc82c0052e0 2023-10-06T01:42:04.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.127+0000 7fc8357fa700 1 --2- 172.21.15.71:0/178048043 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fc824066f30 0x7fc8240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:04.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.127+0000 7fc8357fa700 1 -- 172.21.15.71:0/178048043 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fc83c019070 con 0x7fc82c0052e0 2023-10-06T01:42:04.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.127+0000 7fc8449e9700 1 --2- 172.21.15.71:0/178048043 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fc824066f30 0x7fc8240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:04.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.127+0000 7fc8449e9700 1 --2- 172.21.15.71:0/178048043 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fc824066f30 0x7fc8240693e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc84016cd30 tx=0x7fc830008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:04.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.131+0000 7fc8357fa700 1 -- 172.21.15.71:0/178048043 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc83c051580 con 0x7fc82c0052e0 2023-10-06T01:42:04.197 INFO:tasks.ceph.mds.b.smithi072.stderr:2023-10-06T01:42:04.196+0000 7f15a81ca700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T01:42:04.311 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.310+0000 7fc84744e700 1 -- 172.21.15.71:0/178048043 --> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc84006c5e0 con 0x7fc824066f30 2023-10-06T01:42:04.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.319+0000 7fc8357fa700 1 -- 172.21.15.71:0/178048043 <== mgr.4107 v2:172.21.15.71:6832/90436 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306165 (secure 0 0 0) 0x7fc84006c5e0 con 0x7fc824066f30 2023-10-06T01:42:04.323 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:42:04.326 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.322+0000 7fc84744e700 1 -- 172.21.15.71:0/178048043 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fc824066f30 msgr2=0x7fc8240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:04.326 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.322+0000 7fc84744e700 1 --2- 172.21.15.71:0/178048043 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fc824066f30 0x7fc8240693e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc84016cd30 tx=0x7fc830008040 comp rx=0 tx=0).stop 2023-10-06T01:42:04.326 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.322+0000 7fc84744e700 1 -- 172.21.15.71:0/178048043 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc82c0052e0 msgr2=0x7fc84014e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:04.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.322+0000 7fc84744e700 1 --2- 172.21.15.71:0/178048043 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc82c0052e0 0x7fc84014e7b0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fc83c007390 tx=0x7fc83c001e50 comp rx=0 tx=0).stop 2023-10-06T01:42:04.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.322+0000 7fc84744e700 1 -- 172.21.15.71:0/178048043 shutdown_connections 2023-10-06T01:42:04.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.322+0000 7fc84744e700 1 --2- 172.21.15.71:0/178048043 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc84015ab50 0x7fc84015aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:04.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.322+0000 7fc84744e700 1 --2- 172.21.15.71:0/178048043 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc82c0052e0 0x7fc84014e7b0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:04.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.322+0000 7fc84744e700 1 --2- 172.21.15.71:0/178048043 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fc824066f30 0x7fc8240693e0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:04.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.322+0000 7fc84744e700 1 --2- 172.21.15.71:0/178048043 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8400adb30 0x7fc8400adfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:04.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.322+0000 7fc84744e700 1 -- 172.21.15.71:0/178048043 >> 172.21.15.71:0/178048043 conn(0x7fc84006b6e0 msgr2=0x7fc84014f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:04.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.322+0000 7fc84744e700 1 -- 172.21.15.71:0/178048043 shutdown_connections 2023-10-06T01:42:04.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.322+0000 7fc84744e700 1 -- 172.21.15.71:0/178048043 wait complete. 2023-10-06T01:42:04.327 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2023-10-06T01:42:04.334 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":104,"stamp":"2023-10-06T01:42:02.584668+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":186,"acting":186,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2384268,"kb_used_data":5964,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752590452,"statfs":{"total":773094113280,"available":770652622848,"internally_reserved":0,"allocated":6107136,"data_stored":3418511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.687669"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.896742+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.910418+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:41:29.186282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.912402+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:29:11.316429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.916266+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:18:09.749842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.896742+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.915041+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:41:29.186282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.896742+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.909509+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:43:48.006348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.896742+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.907410+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:01:45.573351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.907419+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:24:21.805228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.914029+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:01:33.492883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.908281+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:42:12.631213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.896742+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.896742+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.914746+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:49:48.083851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.911980+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:44:24.458680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.916103+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:03:30.300603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.896742+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.912008+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:30:18.755143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.915155+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:01:33.492883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.912024+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:45:31.777277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.912580+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:58:36.821428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.909350+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:03:59.520161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.896742+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.915878+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:24:39.815662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.920606+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:44:24.458680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.896742+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.911961+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:38:19.366140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.915723+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:45:25.302080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.896742+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.919999+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:38:19.366140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.920324+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:40:12.842857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T01:41:58.922614+0000","last_change":"2023-10-06T01:41:58.922614+0000","last_active":"2023-10-06T01:41:58.922614+0000","last_peered":"2023-10-06T01:41:58.922614+0000","last_clean":"2023-10-06T01:41:58.922614+0000","last_became_active":"2023-10-06T01:41:58.922235+0000","last_became_peered":"2023-10-06T01:41:58.922235+0000","last_unstale":"2023-10-06T01:41:58.922614+0000","last_undegraded":"2023-10-06T01:41:58.922614+0000","last_fullsized":"2023-10-06T01:41:58.922614+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:02.086327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.907363+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:58.335794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T01:41:58.924804+0000","last_change":"2023-10-06T01:41:58.924804+0000","last_active":"2023-10-06T01:41:58.924804+0000","last_peered":"2023-10-06T01:41:58.924804+0000","last_clean":"2023-10-06T01:41:58.924804+0000","last_became_active":"2023-10-06T01:41:58.924520+0000","last_became_peered":"2023-10-06T01:41:58.924520+0000","last_unstale":"2023-10-06T01:41:58.924804+0000","last_undegraded":"2023-10-06T01:41:58.924804+0000","last_fullsized":"2023-10-06T01:41:58.924804+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:45:24.296902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.914449+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:07:25.175365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T01:41:58.923283+0000","last_change":"2023-10-06T01:41:58.923283+0000","last_active":"2023-10-06T01:41:58.923283+0000","last_peered":"2023-10-06T01:41:58.923283+0000","last_clean":"2023-10-06T01:41:58.923283+0000","last_became_active":"2023-10-06T01:41:58.921507+0000","last_became_peered":"2023-10-06T01:41:58.921507+0000","last_unstale":"2023-10-06T01:41:58.923283+0000","last_undegraded":"2023-10-06T01:41:58.923283+0000","last_fullsized":"2023-10-06T01:41:58.923283+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:18:08.744663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.915526+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:05:48.629746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T01:41:58.927325+0000","last_change":"2023-10-06T01:41:58.927325+0000","last_active":"2023-10-06T01:41:58.927325+0000","last_peered":"2023-10-06T01:41:58.927325+0000","last_clean":"2023-10-06T01:41:58.927325+0000","last_became_active":"2023-10-06T01:41:58.927064+0000","last_became_peered":"2023-10-06T01:41:58.927064+0000","last_unstale":"2023-10-06T01:41:58.927325+0000","last_undegraded":"2023-10-06T01:41:58.927325+0000","last_fullsized":"2023-10-06T01:41:58.927325+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:10:11.010664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.908666+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:07:25.175365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:57.891564+0000","last_change":"2023-10-06T01:41:57.899187+0000","last_active":"2023-10-06T01:41:57.891564+0000","last_peered":"2023-10-06T01:41:57.891564+0000","last_clean":"2023-10-06T01:41:57.891564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:57.891564+0000","last_undegraded":"2023-10-06T01:41:57.891564+0000","last_fullsized":"2023-10-06T01:41:57.891564+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:01:32.487705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.910688+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:05:48.629746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T01:41:58.925616+0000","last_change":"2023-10-06T01:41:58.925616+0000","last_active":"2023-10-06T01:41:58.925616+0000","last_peered":"2023-10-06T01:41:58.925616+0000","last_clean":"2023-10-06T01:41:58.925616+0000","last_became_active":"2023-10-06T01:41:58.921298+0000","last_became_peered":"2023-10-06T01:41:58.921298+0000","last_unstale":"2023-10-06T01:41:58.925616+0000","last_undegraded":"2023-10-06T01:41:58.925616+0000","last_fullsized":"2023-10-06T01:41:58.925616+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:24:38.810483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.909788+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:49:01.938924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T01:41:58.918654+0000","last_change":"2023-10-06T01:41:58.918654+0000","last_active":"2023-10-06T01:41:58.918654+0000","last_peered":"2023-10-06T01:41:58.918654+0000","last_clean":"2023-10-06T01:41:58.918654+0000","last_became_active":"2023-10-06T01:41:58.916820+0000","last_became_peered":"2023-10-06T01:41:58.916820+0000","last_unstale":"2023-10-06T01:41:58.918654+0000","last_undegraded":"2023-10-06T01:41:58.918654+0000","last_fullsized":"2023-10-06T01:41:58.918654+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:29:10.311250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.910889+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:40:12.842857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:57.891564+0000","last_change":"2023-10-06T01:41:57.899593+0000","last_active":"2023-10-06T01:41:57.891564+0000","last_peered":"2023-10-06T01:41:57.891564+0000","last_clean":"2023-10-06T01:41:57.891564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:57.891564+0000","last_undegraded":"2023-10-06T01:41:57.891564+0000","last_fullsized":"2023-10-06T01:41:57.891564+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:19:51.858217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.896742+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T01:41:58.928025+0000","last_change":"2023-10-06T01:41:58.928025+0000","last_active":"2023-10-06T01:41:58.928025+0000","last_peered":"2023-10-06T01:41:58.928025+0000","last_clean":"2023-10-06T01:41:58.928025+0000","last_became_active":"2023-10-06T01:41:58.927745+0000","last_became_peered":"2023-10-06T01:41:58.927745+0000","last_unstale":"2023-10-06T01:41:58.928025+0000","last_undegraded":"2023-10-06T01:41:58.928025+0000","last_fullsized":"2023-10-06T01:41:58.928025+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:04:52.797213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.912424+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:10:12.015842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T01:41:58.923640+0000","last_change":"2023-10-06T01:41:58.923640+0000","last_active":"2023-10-06T01:41:58.923640+0000","last_peered":"2023-10-06T01:41:58.923640+0000","last_clean":"2023-10-06T01:41:58.923640+0000","last_became_active":"2023-10-06T01:41:58.923367+0000","last_became_peered":"2023-10-06T01:41:58.923367+0000","last_unstale":"2023-10-06T01:41:58.923640+0000","last_undegraded":"2023-10-06T01:41:58.923640+0000","last_fullsized":"2023-10-06T01:41:58.923640+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:33:28.414752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.907411+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:05:04.598712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T01:41:58.926296+0000","last_change":"2023-10-06T01:41:58.926296+0000","last_active":"2023-10-06T01:41:58.926296+0000","last_peered":"2023-10-06T01:41:58.926296+0000","last_clean":"2023-10-06T01:41:58.926296+0000","last_became_active":"2023-10-06T01:41:58.926034+0000","last_became_peered":"2023-10-06T01:41:58.926034+0000","last_unstale":"2023-10-06T01:41:58.926296+0000","last_undegraded":"2023-10-06T01:41:58.926296+0000","last_fullsized":"2023-10-06T01:41:58.926296+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:47:16.825984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.915435+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:19:52.863396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:57.891564+0000","last_change":"2023-10-06T01:41:57.898932+0000","last_active":"2023-10-06T01:41:57.891564+0000","last_peered":"2023-10-06T01:41:57.891564+0000","last_clean":"2023-10-06T01:41:57.891564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:57.891564+0000","last_undegraded":"2023-10-06T01:41:57.891564+0000","last_fullsized":"2023-10-06T01:41:57.891564+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:58:36.151365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.914388+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:45:25.302080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T01:41:58.923632+0000","last_change":"2023-10-06T01:41:58.923632+0000","last_active":"2023-10-06T01:41:58.923632+0000","last_peered":"2023-10-06T01:41:58.923632+0000","last_clean":"2023-10-06T01:41:58.923632+0000","last_became_active":"2023-10-06T01:41:58.923405+0000","last_became_peered":"2023-10-06T01:41:58.923405+0000","last_unstale":"2023-10-06T01:41:58.923632+0000","last_undegraded":"2023-10-06T01:41:58.923632+0000","last_fullsized":"2023-10-06T01:41:58.923632+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:07:24.731136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.912350+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:51:28.647163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T01:41:58.924504+0000","last_change":"2023-10-06T01:41:58.924504+0000","last_active":"2023-10-06T01:41:58.924504+0000","last_peered":"2023-10-06T01:41:58.924504+0000","last_clean":"2023-10-06T01:41:58.924504+0000","last_became_active":"2023-10-06T01:41:58.924234+0000","last_became_peered":"2023-10-06T01:41:58.924234+0000","last_unstale":"2023-10-06T01:41:58.924504+0000","last_undegraded":"2023-10-06T01:41:58.924504+0000","last_fullsized":"2023-10-06T01:41:58.924504+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:01:44.568173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.896742+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T01:41:58.927423+0000","last_change":"2023-10-06T01:41:58.927423+0000","last_active":"2023-10-06T01:41:58.927423+0000","last_peered":"2023-10-06T01:41:58.927423+0000","last_clean":"2023-10-06T01:41:58.927423+0000","last_became_active":"2023-10-06T01:41:58.927082+0000","last_became_peered":"2023-10-06T01:41:58.927082+0000","last_unstale":"2023-10-06T01:41:58.927423+0000","last_undegraded":"2023-10-06T01:41:58.927423+0000","last_fullsized":"2023-10-06T01:41:58.927423+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:04.780513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.912063+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:30:22.065390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T01:41:58.925098+0000","last_change":"2023-10-06T01:41:58.925098+0000","last_active":"2023-10-06T01:41:58.925098+0000","last_peered":"2023-10-06T01:41:58.925098+0000","last_clean":"2023-10-06T01:41:58.925098+0000","last_became_active":"2023-10-06T01:41:58.924857+0000","last_became_peered":"2023-10-06T01:41:58.924857+0000","last_unstale":"2023-10-06T01:41:58.925098+0000","last_undegraded":"2023-10-06T01:41:58.925098+0000","last_fullsized":"2023-10-06T01:41:58.925098+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:33:57.280587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.914411+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:03.091506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T01:41:58.919223+0000","last_change":"2023-10-06T01:41:58.919223+0000","last_active":"2023-10-06T01:41:58.919223+0000","last_peered":"2023-10-06T01:41:58.919223+0000","last_clean":"2023-10-06T01:41:58.919223+0000","last_became_active":"2023-10-06T01:41:58.918835+0000","last_became_peered":"2023-10-06T01:41:58.918835+0000","last_unstale":"2023-10-06T01:41:58.919223+0000","last_undegraded":"2023-10-06T01:41:58.919223+0000","last_fullsized":"2023-10-06T01:41:58.919223+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:21:25.598775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.914043+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:19:52.863396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T01:41:58.922702+0000","last_change":"2023-10-06T01:41:58.922702+0000","last_active":"2023-10-06T01:41:58.922702+0000","last_peered":"2023-10-06T01:41:58.922702+0000","last_clean":"2023-10-06T01:41:58.922702+0000","last_became_active":"2023-10-06T01:41:58.922346+0000","last_became_peered":"2023-10-06T01:41:58.922346+0000","last_unstale":"2023-10-06T01:41:58.922702+0000","last_undegraded":"2023-10-06T01:41:58.922702+0000","last_fullsized":"2023-10-06T01:41:58.922702+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:45:24.296902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.906906+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:56:38.345981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T01:41:58.912477+0000","last_change":"2023-10-06T01:41:58.912477+0000","last_active":"2023-10-06T01:41:58.912477+0000","last_peered":"2023-10-06T01:41:58.912477+0000","last_clean":"2023-10-06T01:41:58.912477+0000","last_became_active":"2023-10-06T01:41:58.912169+0000","last_became_peered":"2023-10-06T01:41:58.912169+0000","last_unstale":"2023-10-06T01:41:58.912477+0000","last_undegraded":"2023-10-06T01:41:58.912477+0000","last_fullsized":"2023-10-06T01:41:58.912477+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:05:03.593533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.914723+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:41:15.451811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T01:41:58.922312+0000","last_change":"2023-10-06T01:41:58.922312+0000","last_active":"2023-10-06T01:41:58.922312+0000","last_peered":"2023-10-06T01:41:58.922312+0000","last_clean":"2023-10-06T01:41:58.922312+0000","last_became_active":"2023-10-06T01:41:58.922064+0000","last_became_peered":"2023-10-06T01:41:58.922064+0000","last_unstale":"2023-10-06T01:41:58.922312+0000","last_undegraded":"2023-10-06T01:41:58.922312+0000","last_fullsized":"2023-10-06T01:41:58.922312+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:51:27.641984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.909907+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:49:48.083851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T01:41:58.917481+0000","last_change":"2023-10-06T01:41:58.917481+0000","last_active":"2023-10-06T01:41:58.917481+0000","last_peered":"2023-10-06T01:41:58.917481+0000","last_clean":"2023-10-06T01:41:58.917481+0000","last_became_active":"2023-10-06T01:41:58.917211+0000","last_became_peered":"2023-10-06T01:41:58.917211+0000","last_unstale":"2023-10-06T01:41:58.917481+0000","last_undegraded":"2023-10-06T01:41:58.917481+0000","last_fullsized":"2023-10-06T01:41:58.917481+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:21:12.405145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.912792+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:05.785692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:57.891564+0000","last_change":"2023-10-06T01:41:57.899500+0000","last_active":"2023-10-06T01:41:57.891564+0000","last_peered":"2023-10-06T01:41:57.891564+0000","last_clean":"2023-10-06T01:41:57.891564+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:57.891564+0000","last_undegraded":"2023-10-06T01:41:57.891564+0000","last_fullsized":"2023-10-06T01:41:57.891564+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:33:28.414752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.906918+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:41:20.410820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T01:41:58.922092+0000","last_change":"2023-10-06T01:41:58.922092+0000","last_active":"2023-10-06T01:41:58.922092+0000","last_peered":"2023-10-06T01:41:58.922092+0000","last_clean":"2023-10-06T01:41:58.922092+0000","last_became_active":"2023-10-06T01:41:58.921857+0000","last_became_peered":"2023-10-06T01:41:58.921857+0000","last_unstale":"2023-10-06T01:41:58.922092+0000","last_undegraded":"2023-10-06T01:41:58.922092+0000","last_fullsized":"2023-10-06T01:41:58.922092+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:25:35.328771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.908924+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:41:15.451811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T01:41:58.917439+0000","last_change":"2023-10-06T01:41:58.917439+0000","last_active":"2023-10-06T01:41:58.917439+0000","last_peered":"2023-10-06T01:41:58.917439+0000","last_clean":"2023-10-06T01:41:58.917439+0000","last_became_active":"2023-10-06T01:41:58.917205+0000","last_became_peered":"2023-10-06T01:41:58.917205+0000","last_unstale":"2023-10-06T01:41:58.917439+0000","last_undegraded":"2023-10-06T01:41:58.917439+0000","last_fullsized":"2023-10-06T01:41:58.917439+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:24:38.810483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.914512+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:03:30.300603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T01:41:58.925582+0000","last_change":"2023-10-06T01:41:58.925582+0000","last_active":"2023-10-06T01:41:58.925582+0000","last_peered":"2023-10-06T01:41:58.925582+0000","last_clean":"2023-10-06T01:41:58.925582+0000","last_became_active":"2023-10-06T01:41:58.923189+0000","last_became_peered":"2023-10-06T01:41:58.923189+0000","last_unstale":"2023-10-06T01:41:58.925582+0000","last_undegraded":"2023-10-06T01:41:58.925582+0000","last_fullsized":"2023-10-06T01:41:58.925582+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:03:29.295425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":38,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-06T01:41:57.903557+0000","last_change":"2023-10-06T01:40:16.930992+0000","last_active":"2023-10-06T01:41:57.903557+0000","last_peered":"2023-10-06T01:41:57.903557+0000","last_clean":"2023-10-06T01:41:57.903557+0000","last_became_active":"2023-10-06T01:40:16.930707+0000","last_became_peered":"2023-10-06T01:40:16.930707+0000","last_unstale":"2023-10-06T01:41:57.903557+0000","last_undegraded":"2023-10-06T01:41:57.903557+0000","last_fullsized":"2023-10-06T01:41:57.903557+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:52:43.316071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.914746+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:43:48.006348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T01:41:58.922335+0000","last_change":"2023-10-06T01:41:58.922335+0000","last_active":"2023-10-06T01:41:58.922335+0000","last_peered":"2023-10-06T01:41:58.922335+0000","last_clean":"2023-10-06T01:41:58.922335+0000","last_became_active":"2023-10-06T01:41:58.922038+0000","last_became_peered":"2023-10-06T01:41:58.922038+0000","last_unstale":"2023-10-06T01:41:58.922335+0000","last_undegraded":"2023-10-06T01:41:58.922335+0000","last_fullsized":"2023-10-06T01:41:58.922335+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:58:36.151365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":38,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-06T01:41:57.904071+0000","last_change":"2023-10-06T01:40:16.651019+0000","last_active":"2023-10-06T01:41:57.904071+0000","last_peered":"2023-10-06T01:41:57.904071+0000","last_clean":"2023-10-06T01:41:57.904071+0000","last_became_active":"2023-10-06T01:40:16.650628+0000","last_became_peered":"2023-10-06T01:40:16.650628+0000","last_unstale":"2023-10-06T01:41:57.904071+0000","last_undegraded":"2023-10-06T01:41:57.904071+0000","last_fullsized":"2023-10-06T01:41:57.904071+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:11:57.218984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.912923+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:33:29.419931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T01:41:58.918081+0000","last_change":"2023-10-06T01:41:58.918081+0000","last_active":"2023-10-06T01:41:58.918081+0000","last_peered":"2023-10-06T01:41:58.918081+0000","last_clean":"2023-10-06T01:41:58.918081+0000","last_became_active":"2023-10-06T01:41:58.912873+0000","last_became_peered":"2023-10-06T01:41:58.912873+0000","last_unstale":"2023-10-06T01:41:58.918081+0000","last_undegraded":"2023-10-06T01:41:58.918081+0000","last_fullsized":"2023-10-06T01:41:58.918081+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:03:29.295425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":36,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-06T01:41:55.479776+0000","last_change":"2023-10-06T01:40:16.781596+0000","last_active":"2023-10-06T01:41:55.479776+0000","last_peered":"2023-10-06T01:41:55.479776+0000","last_clean":"2023-10-06T01:41:55.479776+0000","last_became_active":"2023-10-06T01:40:16.781352+0000","last_became_peered":"2023-10-06T01:40:16.781352+0000","last_unstale":"2023-10-06T01:41:55.479776+0000","last_undegraded":"2023-10-06T01:41:55.479776+0000","last_fullsized":"2023-10-06T01:41:55.479776+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:52:43.316071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.908594+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:24:01.329759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T01:41:58.923132+0000","last_change":"2023-10-06T01:41:58.923132+0000","last_active":"2023-10-06T01:41:58.923132+0000","last_peered":"2023-10-06T01:41:58.923132+0000","last_clean":"2023-10-06T01:41:58.923132+0000","last_became_active":"2023-10-06T01:41:58.922860+0000","last_became_peered":"2023-10-06T01:41:58.922860+0000","last_unstale":"2023-10-06T01:41:58.923132+0000","last_undegraded":"2023-10-06T01:41:58.923132+0000","last_fullsized":"2023-10-06T01:41:58.923132+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:24:20.800050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":38,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-06T01:41:57.904002+0000","last_change":"2023-10-06T01:40:16.650826+0000","last_active":"2023-10-06T01:41:57.904002+0000","last_peered":"2023-10-06T01:41:57.904002+0000","last_clean":"2023-10-06T01:41:57.904002+0000","last_became_active":"2023-10-06T01:40:16.650469+0000","last_became_peered":"2023-10-06T01:40:16.650469+0000","last_unstale":"2023-10-06T01:41:57.904002+0000","last_undegraded":"2023-10-06T01:41:57.904002+0000","last_fullsized":"2023-10-06T01:41:57.904002+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:50:23.628212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":190,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-06T01:41:57.903526+0000","last_change":"2023-10-06T01:40:10.645512+0000","last_active":"2023-10-06T01:41:57.903526+0000","last_peered":"2023-10-06T01:41:57.903526+0000","last_clean":"2023-10-06T01:41:57.903526+0000","last_became_active":"2023-10-06T01:40:10.644601+0000","last_became_peered":"2023-10-06T01:40:10.644601+0000","last_unstale":"2023-10-06T01:41:57.903526+0000","last_undegraded":"2023-10-06T01:41:57.903526+0000","last_fullsized":"2023-10-06T01:41:57.903526+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:09.580865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:09.580865+0000","last_clean_scrub_stamp":"2023-10-06T01:40:09.580865+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:05:28.268591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.915623+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:56:51.126033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T01:41:58.920513+0000","last_change":"2023-10-06T01:41:58.920513+0000","last_active":"2023-10-06T01:41:58.920513+0000","last_peered":"2023-10-06T01:41:58.920513+0000","last_clean":"2023-10-06T01:41:58.920513+0000","last_became_active":"2023-10-06T01:41:58.920202+0000","last_became_peered":"2023-10-06T01:41:58.920202+0000","last_unstale":"2023-10-06T01:41:58.920513+0000","last_undegraded":"2023-10-06T01:41:58.920513+0000","last_fullsized":"2023-10-06T01:41:58.920513+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:53:53.773734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":37,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-06T01:41:57.903617+0000","last_change":"2023-10-06T01:40:16.651332+0000","last_active":"2023-10-06T01:41:57.903617+0000","last_peered":"2023-10-06T01:41:57.903617+0000","last_clean":"2023-10-06T01:41:57.903617+0000","last_became_active":"2023-10-06T01:40:16.651049+0000","last_became_peered":"2023-10-06T01:40:16.651049+0000","last_unstale":"2023-10-06T01:41:57.903617+0000","last_undegraded":"2023-10-06T01:41:57.903617+0000","last_fullsized":"2023-10-06T01:41:57.903617+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:11:57.218984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.914907+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:33:29.419931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T01:41:58.923811+0000","last_change":"2023-10-06T01:41:58.923811+0000","last_active":"2023-10-06T01:41:58.923811+0000","last_peered":"2023-10-06T01:41:58.923811+0000","last_clean":"2023-10-06T01:41:58.923811+0000","last_became_active":"2023-10-06T01:41:58.923398+0000","last_became_peered":"2023-10-06T01:41:58.923398+0000","last_unstale":"2023-10-06T01:41:58.923811+0000","last_undegraded":"2023-10-06T01:41:58.923811+0000","last_fullsized":"2023-10-06T01:41:58.923811+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:01:32.487705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":37,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-06T01:41:57.903415+0000","last_change":"2023-10-06T01:40:16.931106+0000","last_active":"2023-10-06T01:41:57.903415+0000","last_peered":"2023-10-06T01:41:57.903415+0000","last_clean":"2023-10-06T01:41:57.903415+0000","last_became_active":"2023-10-06T01:40:16.930830+0000","last_became_peered":"2023-10-06T01:40:16.930830+0000","last_unstale":"2023-10-06T01:41:57.903415+0000","last_undegraded":"2023-10-06T01:41:57.903415+0000","last_fullsized":"2023-10-06T01:41:57.903415+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:50:23.628212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.912836+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:58:37.156543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T01:41:58.923417+0000","last_change":"2023-10-06T01:41:58.923417+0000","last_active":"2023-10-06T01:41:58.923417+0000","last_peered":"2023-10-06T01:41:58.923417+0000","last_clean":"2023-10-06T01:41:58.923417+0000","last_became_active":"2023-10-06T01:41:58.922483+0000","last_became_peered":"2023-10-06T01:41:58.922483+0000","last_unstale":"2023-10-06T01:41:58.923417+0000","last_undegraded":"2023-10-06T01:41:58.923417+0000","last_fullsized":"2023-10-06T01:41:58.923417+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:07:24.731136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":38,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-06T01:41:57.903592+0000","last_change":"2023-10-06T01:40:16.649379+0000","last_active":"2023-10-06T01:41:57.903592+0000","last_peered":"2023-10-06T01:41:57.903592+0000","last_clean":"2023-10-06T01:41:57.903592+0000","last_became_active":"2023-10-06T01:40:16.649147+0000","last_became_peered":"2023-10-06T01:40:16.649147+0000","last_unstale":"2023-10-06T01:41:57.903592+0000","last_undegraded":"2023-10-06T01:41:57.903592+0000","last_fullsized":"2023-10-06T01:41:57.903592+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:11:57.218984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T01:41:58.896742+0000","last_change":"2023-10-06T01:41:58.910855+0000","last_active":"2023-10-06T01:41:58.896742+0000","last_peered":"2023-10-06T01:41:58.896742+0000","last_clean":"2023-10-06T01:41:58.896742+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:41:58.896742+0000","last_undegraded":"2023-10-06T01:41:58.896742+0000","last_fullsized":"2023-10-06T01:41:58.896742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:56:51.126033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":8,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-06T01:41:58.926962+0000","last_change":"2023-10-06T01:41:58.926962+0000","last_active":"2023-10-06T01:41:58.926962+0000","last_peered":"2023-10-06T01:41:58.926962+0000","last_clean":"2023-10-06T01:41:58.926962+0000","last_became_active":"2023-10-06T01:41:58.926758+0000","last_became_peered":"2023-10-06T01:41:58.926758+0000","last_unstale":"2023-10-06T01:41:58.926962+0000","last_undegraded":"2023-10-06T01:41:58.926962+0000","last_fullsized":"2023-10-06T01:41:58.926962+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:58:35.816250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":39,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-06T01:41:57.900751+0000","last_change":"2023-10-06T01:40:16.651477+0000","last_active":"2023-10-06T01:41:57.900751+0000","last_peered":"2023-10-06T01:41:57.900751+0000","last_clean":"2023-10-06T01:41:57.900751+0000","last_became_active":"2023-10-06T01:40:16.651190+0000","last_became_peered":"2023-10-06T01:40:16.651190+0000","last_unstale":"2023-10-06T01:41:57.900751+0000","last_undegraded":"2023-10-06T01:41:57.900751+0000","last_fullsized":"2023-10-06T01:41:57.900751+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:45:47.422876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":104,"acting":104,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298472,"kb_used_data":1184,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073368,"statfs":{"total":96636764160,"available":96331128832,"internally_reserved":0,"allocated":1212416,"data_stored":871942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:41:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":3.6920000000000002,"5min":3.6920000000000002,"15min":3.6920000000000002},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":3.629,"5min":3.629,"15min":3.629},"last":0.55900000000000005}]},{"osd":1,"last update":"Fri Oct 6 01:41:11 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":10.029999999999999,"5min":10.029999999999999,"15min":10.029999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.544,"5min":1.544,"15min":1.544},"last":0.47599999999999998}]},{"osd":2,"last update":"Fri Oct 6 01:41:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.45200000000000001},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":10.710000000000001,"5min":10.710000000000001,"15min":10.710000000000001},"last":0.57399999999999995}]},{"osd":3,"last update":"Fri Oct 6 01:41:11 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":3.6509999999999998,"5min":3.6509999999999998,"15min":3.6509999999999998},"last":0.46700000000000003}]},{"osd":4,"last update":"Fri Oct 6 01:41:11 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.436},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.48499999999999999}]},{"osd":5,"last update":"Fri Oct 6 01:41:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.7509999999999999,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":0.53500000000000003}]},{"osd":6,"last update":"Fri Oct 6 01:41:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.9370000000000001,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":0.498},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.39300000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574874,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297892,"kb_used_data":604,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073948,"statfs":{"total":96636764160,"available":96331722752,"internally_reserved":0,"allocated":618496,"data_stored":281574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.42399999999999999}]},{"osd":1,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.56399999999999995}]},{"osd":2,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.54900000000000004}]},{"osd":3,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.495},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.53600000000000003}]},{"osd":4,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.61599999999999999}]},{"osd":5,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.59499999999999997}]},{"osd":7,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.57299999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297892,"kb_used_data":604,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073948,"statfs":{"total":96636764160,"available":96331722752,"internally_reserved":0,"allocated":618496,"data_stored":281574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.997,"15min":0.997},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":11.957000000000001,"5min":11.957000000000001,"15min":11.957000000000001},"last":0.26500000000000001},{"interface":"front","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":11.917,"5min":11.917,"15min":11.917},"last":0.35299999999999998}]},{"osd":2,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.30199999999999999}]},{"osd":3,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":6.2450000000000001,"5min":6.2450000000000001,"15min":6.2450000000000001},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":6.2939999999999996,"5min":6.2939999999999996,"15min":6.2939999999999996},"last":0.31900000000000001}]},{"osd":4,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":6.1669999999999998,"5min":6.1669999999999998,"15min":6.1669999999999998},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.68500000000000005}]},{"osd":5,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":6.2619999999999996,"5min":6.2619999999999996,"15min":6.2619999999999996},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":6.2350000000000003,"5min":6.2350000000000003,"15min":6.2350000000000003},"last":0.69399999999999995}]},{"osd":6,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":6.141,"5min":6.141,"15min":6.141},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":6.2069999999999999,"5min":6.2069999999999999,"15min":6.2069999999999999},"last":0.66400000000000003}]},{"osd":7,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":6.1040000000000001,"5min":6.1040000000000001,"15min":6.1040000000000001},"last":0.67600000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574874,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298468,"kb_used_data":1180,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073372,"statfs":{"total":96636764160,"available":96331132928,"internally_reserved":0,"allocated":1208320,"data_stored":870981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":3.9129999999999998,"5min":3.9129999999999998,"15min":3.9129999999999998},"last":0.34599999999999997}]},{"osd":2,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":15.237,"5min":15.237,"15min":15.237},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":3.7959999999999998,"5min":3.7959999999999998,"15min":3.7959999999999998},"last":0.30499999999999999}]},{"osd":3,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":5.2850000000000001,"5min":5.2850000000000001,"15min":5.2850000000000001},"last":0.376},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":15.263,"5min":15.263,"15min":15.263},"last":0.39700000000000002}]},{"osd":4,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":5.2590000000000003,"5min":5.2590000000000003,"15min":5.2590000000000003},"last":0.52400000000000002},{"interface":"front","average":{"1min":1.242,"5min":1.242,"15min":1.242},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":15.211,"5min":15.211,"15min":15.211},"last":0.51100000000000001}]},{"osd":5,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":3.8839999999999999,"5min":3.8839999999999999,"15min":3.8839999999999999},"last":0.498},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":5.2309999999999999,"5min":5.2309999999999999,"15min":5.2309999999999999},"last":0.44500000000000001}]},{"osd":6,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.212,"15min":1.212},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":15.175000000000001,"5min":15.175000000000001,"15min":15.175000000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":3.859,"5min":3.859,"15min":3.859},"last":0.46800000000000003}]},{"osd":7,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":3.831,"5min":3.831,"15min":3.831},"last":0.434},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":5.1959999999999997,"5min":5.1959999999999997,"15min":5.1959999999999997},"last":0.48999999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574874,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297880,"kb_used_data":592,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073960,"statfs":{"total":96636764160,"available":96331735040,"internally_reserved":0,"allocated":606208,"data_stored":274646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"last":0.32900000000000001}]},{"osd":1,"last update":"Fri Oct 6 01:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.311,"15min":0.311},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.254}]},{"osd":3,"last update":"Fri Oct 6 01:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.309},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.35099999999999998}]},{"osd":4,"last update":"Fri Oct 6 01:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.48299999999999998}]},{"osd":5,"last update":"Fri Oct 6 01:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.44}]},{"osd":6,"last update":"Fri Oct 6 01:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.58799999999999997}]},{"osd":7,"last update":"Fri Oct 6 01:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.498}]}]},{"osd":3,"up_from":13,"seq":55834574874,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297892,"kb_used_data":604,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073948,"statfs":{"total":96636764160,"available":96331722752,"internally_reserved":0,"allocated":618496,"data_stored":281574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.23200000000000001},{"interface":"front","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.34300000000000003}]},{"osd":1,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.317},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.28899999999999998}]},{"osd":2,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.33400000000000002}]},{"osd":4,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.57899999999999996}]},{"osd":5,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.46300000000000002}]},{"osd":6,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.53500000000000003}]},{"osd":7,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.54600000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297880,"kb_used_data":592,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073960,"statfs":{"total":96636764160,"available":96331735040,"internally_reserved":0,"allocated":606208,"data_stored":274646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.56599999999999995}]},{"osd":1,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":4.0780000000000003,"5min":4.0780000000000003,"15min":4.0780000000000003},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":4.1050000000000004,"5min":4.1050000000000004,"15min":4.1050000000000004},"last":0.61699999999999999}]},{"osd":2,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.67400000000000004}]},{"osd":3,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.63},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.49199999999999999}]},{"osd":5,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.437,"15min":0.437},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.312}]},{"osd":6,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.42299999999999999}]},{"osd":7,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.46100000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574874,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297892,"kb_used_data":604,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073948,"statfs":{"total":96636764160,"available":96331722752,"internally_reserved":0,"allocated":618496,"data_stored":281574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.505},{"interface":"front","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.34000000000000002}]},{"osd":1,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.38}]},{"osd":2,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.6970000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.42499999999999999}]},{"osd":3,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.52800000000000002}]},{"osd":4,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.55500000000000005}]},{"osd":6,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.54500000000000004}]},{"osd":7,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.821,"5min":1.821,"15min":1.821},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.57299999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T01:42:04.343 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T01:42:04.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.488+0000 7fa75506a700 1 Processor -- start 2023-10-06T01:42:04.489 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.488+0000 7fa75506a700 1 -- start start 2023-10-06T01:42:04.491 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.489+0000 7fa75506a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa750150370 0x7fa7500c8b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:04.491 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.489+0000 7fa75506a700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fa75006cde0 0x7fa7500af560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:04.491 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.489+0000 7fa75506a700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa75006c950 con 0x7fa750150740 2023-10-06T01:42:04.491 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.489+0000 7fa75506a700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa750069b10 con 0x7fa75006cde0 2023-10-06T01:42:04.492 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.489+0000 7fa75506a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa750069830 con 0x7fa750150370 2023-10-06T01:42:04.492 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.489+0000 7fa74f59e700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fa75006cde0 0x7fa7500af560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:04.492 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.489+0000 7fa74f59e700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fa75006cde0 0x7fa7500af560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38042/0 (socket says 172.21.15.71:38042) 2023-10-06T01:42:04.492 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.489+0000 7fa74f59e700 1 -- 172.21.15.71:0/445957142 learned_addr learned my addr 172.21.15.71:0/445957142 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:04.492 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.489+0000 7fa74ed9d700 1 --2- 172.21.15.71:0/445957142 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa750150370 0x7fa7500c8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:04.492 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.490+0000 7fa74f59e700 1 -- 172.21.15.71:0/445957142 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa750150370 msgr2=0x7fa7500c8b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:04.492 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.490+0000 7fa74f59e700 1 --2- 172.21.15.71:0/445957142 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa750150370 0x7fa7500c8b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:04.492 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.490+0000 7fa74f59e700 1 -- 172.21.15.71:0/445957142 >> v1:172.21.15.72:6789/0 conn(0x7fa750150740 legacy=0x7fa750069040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:04.492 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.490+0000 7fa74f59e700 1 -- 172.21.15.71:0/445957142 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa75006c300 con 0x7fa75006cde0 2023-10-06T01:42:04.492 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.490+0000 7fa74f59e700 1 --2- 172.21.15.71:0/445957142 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa75006cde0 0x7fa7500af560 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fa748009f20 tx=0x7fa748009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8803e352ce754468 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:04.492 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.490+0000 7fa74e59c700 1 -- 172.21.15.71:0/445957142 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74800e070 con 0x7fa75006cde0 2023-10-06T01:42:04.493 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.490+0000 7fa74e59c700 1 -- 172.21.15.71:0/445957142 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa74800b9d0 con 0x7fa75006cde0 2023-10-06T01:42:04.493 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.490+0000 7fa74e59c700 1 -- 172.21.15.71:0/445957142 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7480092e0 con 0x7fa75006cde0 2023-10-06T01:42:04.493 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.490+0000 7fa75506a700 1 -- 172.21.15.71:0/445957142 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa75006cde0 msgr2=0x7fa7500af560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:04.493 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.490+0000 7fa75506a700 1 --2- 172.21.15.71:0/445957142 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa75006cde0 0x7fa7500af560 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fa748009f20 tx=0x7fa748009840 comp rx=0 tx=0).stop 2023-10-06T01:42:04.493 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.490+0000 7fa75506a700 1 -- 172.21.15.71:0/445957142 shutdown_connections 2023-10-06T01:42:04.493 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.490+0000 7fa75506a700 1 --2- 172.21.15.71:0/445957142 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa75006cde0 0x7fa7500af560 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:04.493 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.490+0000 7fa75506a700 1 --2- 172.21.15.71:0/445957142 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa750150370 0x7fa7500c8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:04.493 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.490+0000 7fa75506a700 1 -- 172.21.15.71:0/445957142 >> 172.21.15.71:0/445957142 conn(0x7fa75006b6e0 msgr2=0x7fa7500ae170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:04.493 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.490+0000 7fa75506a700 1 -- 172.21.15.71:0/445957142 shutdown_connections 2023-10-06T01:42:04.493 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.490+0000 7fa75506a700 1 -- 172.21.15.71:0/445957142 wait complete. 2023-10-06T01:42:04.496 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.492+0000 7fa75506a700 1 Processor -- start 2023-10-06T01:42:04.496 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.492+0000 7fa75506a700 1 -- start start 2023-10-06T01:42:04.496 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.492+0000 7fa75506a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa75006cde0 0x7fa75014b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:04.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.492+0000 7fa75506a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa750150370 0x7fa7500ad390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:04.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.492+0000 7fa75506a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7500ad8d0 0x7fa75015b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:04.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.492+0000 7fa75506a700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7500aa7d0 con 0x7fa750150370 2023-10-06T01:42:04.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.492+0000 7fa75506a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7500add50 con 0x7fa7500ad8d0 2023-10-06T01:42:04.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.492+0000 7fa75506a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa75014c070 con 0x7fa75006cde0 2023-10-06T01:42:04.497 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.493+0000 7fa74659c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa750150370 0x7fa7500ad390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:04.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.493+0000 7fa74659c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa750150370 0x7fa7500ad390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38044/0 (socket says 172.21.15.71:38044) 2023-10-06T01:42:04.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.493+0000 7fa74659c700 1 -- 172.21.15.71:0/3182639466 learned_addr learned my addr 172.21.15.71:0/3182639466 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:04.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.493+0000 7fa74ed9d700 1 --2- 172.21.15.71:0/3182639466 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa75006cde0 0x7fa75014b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:04.498 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.493+0000 7fa74f59e700 1 --2- 172.21.15.71:0/3182639466 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7500ad8d0 0x7fa75015b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:04.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.493+0000 7fa74659c700 1 -- 172.21.15.71:0/3182639466 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa75006cde0 msgr2=0x7fa75014b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:04.499 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.493+0000 7fa74659c700 1 --2- 172.21.15.71:0/3182639466 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa75006cde0 0x7fa75014b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:04.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.493+0000 7fa74659c700 1 -- 172.21.15.71:0/3182639466 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7500ad8d0 msgr2=0x7fa75015b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:04.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.493+0000 7fa74659c700 1 --2- 172.21.15.71:0/3182639466 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7500ad8d0 0x7fa75015b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:04.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.493+0000 7fa74659c700 1 -- 172.21.15.71:0/3182639466 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa748009ae0 con 0x7fa750150370 2023-10-06T01:42:04.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.493+0000 7fa74659c700 1 --2- 172.21.15.71:0/3182639466 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa750150370 0x7fa7500ad390 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fa73800c5c0 tx=0x7fa738007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:04.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.493+0000 7fa7477fe700 1 -- 172.21.15.71:0/3182639466 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa738011590 con 0x7fa750150370 2023-10-06T01:42:04.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.493+0000 7fa7477fe700 1 -- 172.21.15.71:0/3182639466 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7380116f0 con 0x7fa750150370 2023-10-06T01:42:04.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.493+0000 7fa75506a700 1 -- 172.21.15.71:0/3182639466 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa75014bcc0 con 0x7fa750150370 2023-10-06T01:42:04.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.493+0000 7fa7477fe700 1 -- 172.21.15.71:0/3182639466 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa738011ab0 con 0x7fa750150370 2023-10-06T01:42:04.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.493+0000 7fa75506a700 1 -- 172.21.15.71:0/3182639466 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa75015c490 con 0x7fa750150370 2023-10-06T01:42:04.500 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.494+0000 7fa75506a700 1 -- 172.21.15.71:0/3182639466 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa75014c1e0 con 0x7fa750150370 2023-10-06T01:42:04.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.495+0000 7fa7477fe700 1 -- 172.21.15.71:0/3182639466 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa73801b3b0 con 0x7fa750150370 2023-10-06T01:42:04.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.495+0000 7fa7477fe700 1 --2- 172.21.15.71:0/3182639466 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fa730066f60 0x7fa730069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:04.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.495+0000 7fa7477fe700 1 -- 172.21.15.71:0/3182639466 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fa738083b10 con 0x7fa750150370 2023-10-06T01:42:04.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.495+0000 7fa74ed9d700 1 --2- 172.21.15.71:0/3182639466 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fa730066f60 0x7fa730069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:04.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.495+0000 7fa74ed9d700 1 --2- 172.21.15.71:0/3182639466 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fa730066f60 0x7fa730069410 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa740009db0 tx=0x7fa7400091a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:04.501 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.499+0000 7fa7477fe700 1 -- 172.21.15.71:0/3182639466 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa738050ae0 con 0x7fa750150370 2023-10-06T01:42:04.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.678+0000 7fa75506a700 1 -- 172.21.15.71:0/3182639466 --> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa75006dbe0 con 0x7fa730066f60 2023-10-06T01:42:04.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.686+0000 7fa7477fe700 1 -- 172.21.15.71:0/3182639466 <== mgr.4107 v2:172.21.15.71:6832/90436 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310743 (secure 0 0 0) 0x7fa75006dbe0 con 0x7fa730066f60 2023-10-06T01:42:04.690 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:42:04.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.689+0000 7fa75506a700 1 -- 172.21.15.71:0/3182639466 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fa730066f60 msgr2=0x7fa730069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:04.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.689+0000 7fa75506a700 1 --2- 172.21.15.71:0/3182639466 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fa730066f60 0x7fa730069410 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa740009db0 tx=0x7fa7400091a0 comp rx=0 tx=0).stop 2023-10-06T01:42:04.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.689+0000 7fa75506a700 1 -- 172.21.15.71:0/3182639466 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa750150370 msgr2=0x7fa7500ad390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:04.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.689+0000 7fa75506a700 1 --2- 172.21.15.71:0/3182639466 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa750150370 0x7fa7500ad390 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fa73800c5c0 tx=0x7fa738007f30 comp rx=0 tx=0).stop 2023-10-06T01:42:04.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.689+0000 7fa75506a700 1 -- 172.21.15.71:0/3182639466 shutdown_connections 2023-10-06T01:42:04.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.689+0000 7fa75506a700 1 --2- 172.21.15.71:0/3182639466 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fa730066f60 0x7fa730069410 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:04.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.689+0000 7fa75506a700 1 --2- 172.21.15.71:0/3182639466 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7500ad8d0 0x7fa75015b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:04.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.689+0000 7fa75506a700 1 --2- 172.21.15.71:0/3182639466 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa75006cde0 0x7fa75014b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:04.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.689+0000 7fa75506a700 1 --2- 172.21.15.71:0/3182639466 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa750150370 0x7fa7500ad390 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:04.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.689+0000 7fa75506a700 1 -- 172.21.15.71:0/3182639466 >> 172.21.15.71:0/3182639466 conn(0x7fa75006b6e0 msgr2=0x7fa750157860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:04.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.689+0000 7fa75506a700 1 -- 172.21.15.71:0/3182639466 shutdown_connections 2023-10-06T01:42:04.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.689+0000 7fa75506a700 1 -- 172.21.15.71:0/3182639466 wait complete. 2023-10-06T01:42:04.694 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2023-10-06T01:42:04.702 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":105,"stamp":"2023-10-06T01:42:04.584964+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":203,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2384548,"kb_used_data":6244,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752590172,"statfs":{"total":773094113280,"available":770652336128,"internally_reserved":0,"allocated":6393856,"data_stored":3552155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000932"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.922447+0000","last_change":"2023-10-06T01:41:59.915540+0000","last_active":"2023-10-06T01:41:59.922447+0000","last_peered":"2023-10-06T01:41:59.922447+0000","last_clean":"2023-10-06T01:41:59.922447+0000","last_became_active":"2023-10-06T01:41:59.915284+0000","last_became_peered":"2023-10-06T01:41:59.915284+0000","last_unstale":"2023-10-06T01:41:59.922447+0000","last_undegraded":"2023-10-06T01:41:59.922447+0000","last_fullsized":"2023-10-06T01:41:59.922447+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:03:59.520161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.916533+0000","last_change":"2023-10-06T01:41:59.913058+0000","last_active":"2023-10-06T01:41:59.916533+0000","last_peered":"2023-10-06T01:41:59.916533+0000","last_clean":"2023-10-06T01:41:59.916533+0000","last_became_active":"2023-10-06T01:41:59.912781+0000","last_became_peered":"2023-10-06T01:41:59.912781+0000","last_unstale":"2023-10-06T01:41:59.916533+0000","last_undegraded":"2023-10-06T01:41:59.916533+0000","last_fullsized":"2023-10-06T01:41:59.916533+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:14:55.659015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.934081+0000","last_change":"2023-10-06T01:41:59.930725+0000","last_active":"2023-10-06T01:41:59.934081+0000","last_peered":"2023-10-06T01:41:59.934081+0000","last_clean":"2023-10-06T01:41:59.934081+0000","last_became_active":"2023-10-06T01:41:59.929740+0000","last_became_peered":"2023-10-06T01:41:59.929740+0000","last_unstale":"2023-10-06T01:41:59.934081+0000","last_undegraded":"2023-10-06T01:41:59.934081+0000","last_fullsized":"2023-10-06T01:41:59.934081+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:24:01.329759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.924994+0000","last_change":"2023-10-06T01:41:59.924145+0000","last_active":"2023-10-06T01:41:59.924994+0000","last_peered":"2023-10-06T01:41:59.924994+0000","last_clean":"2023-10-06T01:41:59.924994+0000","last_became_active":"2023-10-06T01:41:59.923836+0000","last_became_peered":"2023-10-06T01:41:59.923836+0000","last_unstale":"2023-10-06T01:41:59.924994+0000","last_undegraded":"2023-10-06T01:41:59.924994+0000","last_fullsized":"2023-10-06T01:41:59.924994+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:41:29.186282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.926529+0000","last_change":"2023-10-06T01:41:59.917118+0000","last_active":"2023-10-06T01:41:59.926529+0000","last_peered":"2023-10-06T01:41:59.926529+0000","last_clean":"2023-10-06T01:41:59.926529+0000","last_became_active":"2023-10-06T01:41:59.916859+0000","last_became_peered":"2023-10-06T01:41:59.916859+0000","last_unstale":"2023-10-06T01:41:59.926529+0000","last_undegraded":"2023-10-06T01:41:59.926529+0000","last_fullsized":"2023-10-06T01:41:59.926529+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:01:45.573351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.932977+0000","last_change":"2023-10-06T01:41:59.929806+0000","last_active":"2023-10-06T01:41:59.932977+0000","last_peered":"2023-10-06T01:41:59.932977+0000","last_clean":"2023-10-06T01:41:59.932977+0000","last_became_active":"2023-10-06T01:41:59.929565+0000","last_became_peered":"2023-10-06T01:41:59.929565+0000","last_unstale":"2023-10-06T01:41:59.932977+0000","last_undegraded":"2023-10-06T01:41:59.932977+0000","last_fullsized":"2023-10-06T01:41:59.932977+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:18:41.923790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.926648+0000","last_change":"2023-10-06T01:41:59.920798+0000","last_active":"2023-10-06T01:41:59.926648+0000","last_peered":"2023-10-06T01:41:59.926648+0000","last_clean":"2023-10-06T01:41:59.926648+0000","last_became_active":"2023-10-06T01:41:59.920550+0000","last_became_peered":"2023-10-06T01:41:59.920550+0000","last_unstale":"2023-10-06T01:41:59.926648+0000","last_undegraded":"2023-10-06T01:41:59.926648+0000","last_fullsized":"2023-10-06T01:41:59.926648+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:45:31.777277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.927775+0000","last_change":"2023-10-06T01:41:59.918442+0000","last_active":"2023-10-06T01:41:59.927775+0000","last_peered":"2023-10-06T01:41:59.927775+0000","last_clean":"2023-10-06T01:41:59.927775+0000","last_became_active":"2023-10-06T01:41:59.918193+0000","last_became_peered":"2023-10-06T01:41:59.918193+0000","last_unstale":"2023-10-06T01:41:59.927775+0000","last_undegraded":"2023-10-06T01:41:59.927775+0000","last_fullsized":"2023-10-06T01:41:59.927775+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:07:19.364309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.930948+0000","last_change":"2023-10-06T01:41:59.924857+0000","last_active":"2023-10-06T01:41:59.930948+0000","last_peered":"2023-10-06T01:41:59.930948+0000","last_clean":"2023-10-06T01:41:59.930948+0000","last_became_active":"2023-10-06T01:41:59.924587+0000","last_became_peered":"2023-10-06T01:41:59.924587+0000","last_unstale":"2023-10-06T01:41:59.930948+0000","last_undegraded":"2023-10-06T01:41:59.930948+0000","last_fullsized":"2023-10-06T01:41:59.930948+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:44:24.458680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.911532+0000","last_change":"2023-10-06T01:41:59.909443+0000","last_active":"2023-10-06T01:41:59.911532+0000","last_peered":"2023-10-06T01:41:59.911532+0000","last_clean":"2023-10-06T01:41:59.911532+0000","last_became_active":"2023-10-06T01:41:59.909189+0000","last_became_peered":"2023-10-06T01:41:59.909189+0000","last_unstale":"2023-10-06T01:41:59.911532+0000","last_undegraded":"2023-10-06T01:41:59.911532+0000","last_fullsized":"2023-10-06T01:41:59.911532+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:49:01.938924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.917054+0000","last_change":"2023-10-06T01:41:59.913473+0000","last_active":"2023-10-06T01:41:59.917054+0000","last_peered":"2023-10-06T01:41:59.917054+0000","last_clean":"2023-10-06T01:41:59.917054+0000","last_became_active":"2023-10-06T01:41:59.913213+0000","last_became_peered":"2023-10-06T01:41:59.913213+0000","last_unstale":"2023-10-06T01:41:59.917054+0000","last_undegraded":"2023-10-06T01:41:59.917054+0000","last_fullsized":"2023-10-06T01:41:59.917054+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:03:59.520161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.930999+0000","last_change":"2023-10-06T01:41:59.927393+0000","last_active":"2023-10-06T01:41:59.930999+0000","last_peered":"2023-10-06T01:41:59.930999+0000","last_clean":"2023-10-06T01:41:59.930999+0000","last_became_active":"2023-10-06T01:41:59.927137+0000","last_became_peered":"2023-10-06T01:41:59.927137+0000","last_unstale":"2023-10-06T01:41:59.930999+0000","last_undegraded":"2023-10-06T01:41:59.930999+0000","last_fullsized":"2023-10-06T01:41:59.930999+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:05:48.629746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.931762+0000","last_change":"2023-10-06T01:41:59.929256+0000","last_active":"2023-10-06T01:41:59.931762+0000","last_peered":"2023-10-06T01:41:59.931762+0000","last_clean":"2023-10-06T01:41:59.931762+0000","last_became_active":"2023-10-06T01:41:59.928778+0000","last_became_peered":"2023-10-06T01:41:59.928778+0000","last_unstale":"2023-10-06T01:41:59.931762+0000","last_undegraded":"2023-10-06T01:41:59.931762+0000","last_fullsized":"2023-10-06T01:41:59.931762+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:14:29.633116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.925731+0000","last_change":"2023-10-06T01:41:59.922250+0000","last_active":"2023-10-06T01:41:59.925731+0000","last_peered":"2023-10-06T01:41:59.925731+0000","last_clean":"2023-10-06T01:41:59.925731+0000","last_became_active":"2023-10-06T01:41:59.922001+0000","last_became_peered":"2023-10-06T01:41:59.922001+0000","last_unstale":"2023-10-06T01:41:59.925731+0000","last_undegraded":"2023-10-06T01:41:59.925731+0000","last_fullsized":"2023-10-06T01:41:59.925731+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:40:12.842857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.926668+0000","last_change":"2023-10-06T01:41:59.922713+0000","last_active":"2023-10-06T01:41:59.926668+0000","last_peered":"2023-10-06T01:41:59.926668+0000","last_clean":"2023-10-06T01:41:59.926668+0000","last_became_active":"2023-10-06T01:41:59.922462+0000","last_became_peered":"2023-10-06T01:41:59.922462+0000","last_unstale":"2023-10-06T01:41:59.926668+0000","last_undegraded":"2023-10-06T01:41:59.926668+0000","last_fullsized":"2023-10-06T01:41:59.926668+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:05:48.629746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.933111+0000","last_change":"2023-10-06T01:41:59.929705+0000","last_active":"2023-10-06T01:41:59.933111+0000","last_peered":"2023-10-06T01:41:59.933111+0000","last_clean":"2023-10-06T01:41:59.933111+0000","last_became_active":"2023-10-06T01:41:59.929457+0000","last_became_peered":"2023-10-06T01:41:59.929457+0000","last_unstale":"2023-10-06T01:41:59.933111+0000","last_undegraded":"2023-10-06T01:41:59.933111+0000","last_fullsized":"2023-10-06T01:41:59.933111+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:14:55.659015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.916801+0000","last_change":"2023-10-06T01:41:59.913085+0000","last_active":"2023-10-06T01:41:59.916801+0000","last_peered":"2023-10-06T01:41:59.916801+0000","last_clean":"2023-10-06T01:41:59.916801+0000","last_became_active":"2023-10-06T01:41:59.912867+0000","last_became_peered":"2023-10-06T01:41:59.912867+0000","last_unstale":"2023-10-06T01:41:59.916801+0000","last_undegraded":"2023-10-06T01:41:59.916801+0000","last_fullsized":"2023-10-06T01:41:59.916801+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:08.078701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.939122+0000","last_change":"2023-10-06T01:41:59.933685+0000","last_active":"2023-10-06T01:41:59.939122+0000","last_peered":"2023-10-06T01:41:59.939122+0000","last_clean":"2023-10-06T01:41:59.939122+0000","last_became_active":"2023-10-06T01:41:59.932319+0000","last_became_peered":"2023-10-06T01:41:59.932319+0000","last_unstale":"2023-10-06T01:41:59.939122+0000","last_undegraded":"2023-10-06T01:41:59.939122+0000","last_fullsized":"2023-10-06T01:41:59.939122+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:56:51.126033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.926574+0000","last_change":"2023-10-06T01:41:59.920145+0000","last_active":"2023-10-06T01:41:59.926574+0000","last_peered":"2023-10-06T01:41:59.926574+0000","last_clean":"2023-10-06T01:41:59.926574+0000","last_became_active":"2023-10-06T01:41:59.919889+0000","last_became_peered":"2023-10-06T01:41:59.919889+0000","last_unstale":"2023-10-06T01:41:59.926574+0000","last_undegraded":"2023-10-06T01:41:59.926574+0000","last_fullsized":"2023-10-06T01:41:59.926574+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:42:12.631213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.933860+0000","last_change":"2023-10-06T01:41:59.929655+0000","last_active":"2023-10-06T01:41:59.933860+0000","last_peered":"2023-10-06T01:41:59.933860+0000","last_clean":"2023-10-06T01:41:59.933860+0000","last_became_active":"2023-10-06T01:41:59.929408+0000","last_became_peered":"2023-10-06T01:41:59.929408+0000","last_unstale":"2023-10-06T01:41:59.933860+0000","last_undegraded":"2023-10-06T01:41:59.933860+0000","last_fullsized":"2023-10-06T01:41:59.933860+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:41:27.269324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.933840+0000","last_change":"2023-10-06T01:41:59.925142+0000","last_active":"2023-10-06T01:41:59.933840+0000","last_peered":"2023-10-06T01:41:59.933840+0000","last_clean":"2023-10-06T01:41:59.933840+0000","last_became_active":"2023-10-06T01:41:59.924872+0000","last_became_peered":"2023-10-06T01:41:59.924872+0000","last_unstale":"2023-10-06T01:41:59.933840+0000","last_undegraded":"2023-10-06T01:41:59.933840+0000","last_fullsized":"2023-10-06T01:41:59.933840+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:41:29.186282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.927819+0000","last_change":"2023-10-06T01:41:59.918563+0000","last_active":"2023-10-06T01:41:59.927819+0000","last_peered":"2023-10-06T01:41:59.927819+0000","last_clean":"2023-10-06T01:41:59.927819+0000","last_became_active":"2023-10-06T01:41:59.918068+0000","last_became_peered":"2023-10-06T01:41:59.918068+0000","last_unstale":"2023-10-06T01:41:59.927819+0000","last_undegraded":"2023-10-06T01:41:59.927819+0000","last_fullsized":"2023-10-06T01:41:59.927819+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:42:14.967630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.934327+0000","last_change":"2023-10-06T01:41:59.933157+0000","last_active":"2023-10-06T01:41:59.934327+0000","last_peered":"2023-10-06T01:41:59.934327+0000","last_clean":"2023-10-06T01:41:59.934327+0000","last_became_active":"2023-10-06T01:41:59.932454+0000","last_became_peered":"2023-10-06T01:41:59.932454+0000","last_unstale":"2023-10-06T01:41:59.934327+0000","last_undegraded":"2023-10-06T01:41:59.934327+0000","last_fullsized":"2023-10-06T01:41:59.934327+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:07:25.175365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.931787+0000","last_change":"2023-10-06T01:41:59.929430+0000","last_active":"2023-10-06T01:41:59.931787+0000","last_peered":"2023-10-06T01:41:59.931787+0000","last_clean":"2023-10-06T01:41:59.931787+0000","last_became_active":"2023-10-06T01:41:59.929162+0000","last_became_peered":"2023-10-06T01:41:59.929162+0000","last_unstale":"2023-10-06T01:41:59.931787+0000","last_undegraded":"2023-10-06T01:41:59.931787+0000","last_fullsized":"2023-10-06T01:41:59.931787+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:29:32.229410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.921742+0000","last_change":"2023-10-06T01:41:59.914263+0000","last_active":"2023-10-06T01:41:59.921742+0000","last_peered":"2023-10-06T01:41:59.921742+0000","last_clean":"2023-10-06T01:41:59.921742+0000","last_became_active":"2023-10-06T01:41:59.913986+0000","last_became_peered":"2023-10-06T01:41:59.913986+0000","last_unstale":"2023-10-06T01:41:59.921742+0000","last_undegraded":"2023-10-06T01:41:59.921742+0000","last_fullsized":"2023-10-06T01:41:59.921742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:24:21.805228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.929900+0000","last_change":"2023-10-06T01:41:59.927075+0000","last_active":"2023-10-06T01:41:59.929900+0000","last_peered":"2023-10-06T01:41:59.929900+0000","last_clean":"2023-10-06T01:41:59.929900+0000","last_became_active":"2023-10-06T01:41:59.926810+0000","last_became_peered":"2023-10-06T01:41:59.926810+0000","last_unstale":"2023-10-06T01:41:59.929900+0000","last_undegraded":"2023-10-06T01:41:59.929900+0000","last_fullsized":"2023-10-06T01:41:59.929900+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:43:48.006348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.930488+0000","last_change":"2023-10-06T01:41:59.927240+0000","last_active":"2023-10-06T01:41:59.930488+0000","last_peered":"2023-10-06T01:41:59.930488+0000","last_clean":"2023-10-06T01:41:59.930488+0000","last_became_active":"2023-10-06T01:41:59.926702+0000","last_became_peered":"2023-10-06T01:41:59.926702+0000","last_unstale":"2023-10-06T01:41:59.930488+0000","last_undegraded":"2023-10-06T01:41:59.930488+0000","last_fullsized":"2023-10-06T01:41:59.930488+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:42:14.967630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.926514+0000","last_change":"2023-10-06T01:41:59.916928+0000","last_active":"2023-10-06T01:41:59.926514+0000","last_peered":"2023-10-06T01:41:59.926514+0000","last_clean":"2023-10-06T01:41:59.926514+0000","last_became_active":"2023-10-06T01:41:59.916659+0000","last_became_peered":"2023-10-06T01:41:59.916659+0000","last_unstale":"2023-10-06T01:41:59.926514+0000","last_undegraded":"2023-10-06T01:41:59.926514+0000","last_fullsized":"2023-10-06T01:41:59.926514+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:49:01.938924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.928127+0000","last_change":"2023-10-06T01:41:59.920777+0000","last_active":"2023-10-06T01:41:59.928127+0000","last_peered":"2023-10-06T01:41:59.928127+0000","last_clean":"2023-10-06T01:41:59.928127+0000","last_became_active":"2023-10-06T01:41:59.920533+0000","last_became_peered":"2023-10-06T01:41:59.920533+0000","last_unstale":"2023-10-06T01:41:59.928127+0000","last_undegraded":"2023-10-06T01:41:59.928127+0000","last_fullsized":"2023-10-06T01:41:59.928127+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:03:33.302671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.934050+0000","last_change":"2023-10-06T01:41:59.927799+0000","last_active":"2023-10-06T01:41:59.934050+0000","last_peered":"2023-10-06T01:41:59.934050+0000","last_clean":"2023-10-06T01:41:59.934050+0000","last_became_active":"2023-10-06T01:41:59.927478+0000","last_became_peered":"2023-10-06T01:41:59.927478+0000","last_unstale":"2023-10-06T01:41:59.934050+0000","last_undegraded":"2023-10-06T01:41:59.934050+0000","last_fullsized":"2023-10-06T01:41:59.934050+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:49:48.083851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.926469+0000","last_change":"2023-10-06T01:41:59.919687+0000","last_active":"2023-10-06T01:41:59.926469+0000","last_peered":"2023-10-06T01:41:59.926469+0000","last_clean":"2023-10-06T01:41:59.926469+0000","last_became_active":"2023-10-06T01:41:59.919441+0000","last_became_peered":"2023-10-06T01:41:59.919441+0000","last_unstale":"2023-10-06T01:41:59.926469+0000","last_undegraded":"2023-10-06T01:41:59.926469+0000","last_fullsized":"2023-10-06T01:41:59.926469+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:58.335794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.923898+0000","last_change":"2023-10-06T01:41:59.918563+0000","last_active":"2023-10-06T01:41:59.923898+0000","last_peered":"2023-10-06T01:41:59.923898+0000","last_clean":"2023-10-06T01:41:59.923898+0000","last_became_active":"2023-10-06T01:41:59.918173+0000","last_became_peered":"2023-10-06T01:41:59.918173+0000","last_unstale":"2023-10-06T01:41:59.923898+0000","last_undegraded":"2023-10-06T01:41:59.923898+0000","last_fullsized":"2023-10-06T01:41:59.923898+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:16:49.114729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.930205+0000","last_change":"2023-10-06T01:41:59.927457+0000","last_active":"2023-10-06T01:41:59.930205+0000","last_peered":"2023-10-06T01:41:59.930205+0000","last_clean":"2023-10-06T01:41:59.930205+0000","last_became_active":"2023-10-06T01:41:59.927162+0000","last_became_peered":"2023-10-06T01:41:59.927162+0000","last_unstale":"2023-10-06T01:41:59.930205+0000","last_undegraded":"2023-10-06T01:41:59.930205+0000","last_fullsized":"2023-10-06T01:41:59.930205+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:33:27.039395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"53'4","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.927733+0000","last_change":"2023-10-06T01:41:58.922614+0000","last_active":"2023-10-06T01:41:59.927733+0000","last_peered":"2023-10-06T01:41:59.927733+0000","last_clean":"2023-10-06T01:41:59.927733+0000","last_became_active":"2023-10-06T01:41:58.922235+0000","last_became_peered":"2023-10-06T01:41:58.922235+0000","last_unstale":"2023-10-06T01:41:59.927733+0000","last_undegraded":"2023-10-06T01:41:59.927733+0000","last_fullsized":"2023-10-06T01:41:59.927733+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:02.086327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.929487+0000","last_change":"2023-10-06T01:41:59.924904+0000","last_active":"2023-10-06T01:41:59.929487+0000","last_peered":"2023-10-06T01:41:59.929487+0000","last_clean":"2023-10-06T01:41:59.929487+0000","last_became_active":"2023-10-06T01:41:59.924621+0000","last_became_peered":"2023-10-06T01:41:59.924621+0000","last_unstale":"2023-10-06T01:41:59.929487+0000","last_undegraded":"2023-10-06T01:41:59.929487+0000","last_fullsized":"2023-10-06T01:41:59.929487+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:47:17.831162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"53'1","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.924111+0000","last_change":"2023-10-06T01:41:58.924804+0000","last_active":"2023-10-06T01:41:59.924111+0000","last_peered":"2023-10-06T01:41:59.924111+0000","last_clean":"2023-10-06T01:41:59.924111+0000","last_became_active":"2023-10-06T01:41:58.924520+0000","last_became_peered":"2023-10-06T01:41:58.924520+0000","last_unstale":"2023-10-06T01:41:59.924111+0000","last_undegraded":"2023-10-06T01:41:59.924111+0000","last_fullsized":"2023-10-06T01:41:59.924111+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:45:24.296902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.935876+0000","last_change":"2023-10-06T01:41:59.931503+0000","last_active":"2023-10-06T01:41:59.935876+0000","last_peered":"2023-10-06T01:41:59.935876+0000","last_clean":"2023-10-06T01:41:59.935876+0000","last_became_active":"2023-10-06T01:41:59.931276+0000","last_became_peered":"2023-10-06T01:41:59.931276+0000","last_unstale":"2023-10-06T01:41:59.935876+0000","last_undegraded":"2023-10-06T01:41:59.935876+0000","last_fullsized":"2023-10-06T01:41:59.935876+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:08.078701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"53'2","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.927074+0000","last_change":"2023-10-06T01:41:58.923283+0000","last_active":"2023-10-06T01:41:59.927074+0000","last_peered":"2023-10-06T01:41:59.927074+0000","last_clean":"2023-10-06T01:41:59.927074+0000","last_became_active":"2023-10-06T01:41:58.921507+0000","last_became_peered":"2023-10-06T01:41:58.921507+0000","last_unstale":"2023-10-06T01:41:59.927074+0000","last_undegraded":"2023-10-06T01:41:59.927074+0000","last_fullsized":"2023-10-06T01:41:59.927074+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:18:08.744663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.930455+0000","last_change":"2023-10-06T01:41:59.922965+0000","last_active":"2023-10-06T01:41:59.930455+0000","last_peered":"2023-10-06T01:41:59.930455+0000","last_clean":"2023-10-06T01:41:59.930455+0000","last_became_active":"2023-10-06T01:41:59.922709+0000","last_became_peered":"2023-10-06T01:41:59.922709+0000","last_unstale":"2023-10-06T01:41:59.930455+0000","last_undegraded":"2023-10-06T01:41:59.930455+0000","last_fullsized":"2023-10-06T01:41:59.930455+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:07:19.364309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"53'2","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.926888+0000","last_change":"2023-10-06T01:41:58.927325+0000","last_active":"2023-10-06T01:41:59.926888+0000","last_peered":"2023-10-06T01:41:59.926888+0000","last_clean":"2023-10-06T01:41:59.926888+0000","last_became_active":"2023-10-06T01:41:58.927064+0000","last_became_peered":"2023-10-06T01:41:58.927064+0000","last_unstale":"2023-10-06T01:41:59.926888+0000","last_undegraded":"2023-10-06T01:41:59.926888+0000","last_fullsized":"2023-10-06T01:41:59.926888+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:10:11.010664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.927683+0000","last_change":"2023-10-06T01:41:59.917233+0000","last_active":"2023-10-06T01:41:59.927683+0000","last_peered":"2023-10-06T01:41:59.927683+0000","last_clean":"2023-10-06T01:41:59.927683+0000","last_became_active":"2023-10-06T01:41:59.916299+0000","last_became_peered":"2023-10-06T01:41:59.916299+0000","last_unstale":"2023-10-06T01:41:59.927683+0000","last_undegraded":"2023-10-06T01:41:59.927683+0000","last_fullsized":"2023-10-06T01:41:59.927683+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:33:27.039395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"53'1","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.923560+0000","last_change":"2023-10-06T01:41:58.923107+0000","last_active":"2023-10-06T01:41:59.923560+0000","last_peered":"2023-10-06T01:41:59.923560+0000","last_clean":"2023-10-06T01:41:59.923560+0000","last_became_active":"2023-10-06T01:41:58.922594+0000","last_became_peered":"2023-10-06T01:41:58.922594+0000","last_unstale":"2023-10-06T01:41:59.923560+0000","last_undegraded":"2023-10-06T01:41:59.923560+0000","last_fullsized":"2023-10-06T01:41:59.923560+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:45:24.296902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.929937+0000","last_change":"2023-10-06T01:41:59.927056+0000","last_active":"2023-10-06T01:41:59.929937+0000","last_peered":"2023-10-06T01:41:59.929937+0000","last_clean":"2023-10-06T01:41:59.929937+0000","last_became_active":"2023-10-06T01:41:59.926795+0000","last_became_peered":"2023-10-06T01:41:59.926795+0000","last_unstale":"2023-10-06T01:41:59.929937+0000","last_undegraded":"2023-10-06T01:41:59.929937+0000","last_fullsized":"2023-10-06T01:41:59.929937+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:28:23.967941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"53'1","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.931724+0000","last_change":"2023-10-06T01:41:58.925616+0000","last_active":"2023-10-06T01:41:59.931724+0000","last_peered":"2023-10-06T01:41:59.931724+0000","last_clean":"2023-10-06T01:41:59.931724+0000","last_became_active":"2023-10-06T01:41:58.921298+0000","last_became_peered":"2023-10-06T01:41:58.921298+0000","last_unstale":"2023-10-06T01:41:59.931724+0000","last_undegraded":"2023-10-06T01:41:59.931724+0000","last_fullsized":"2023-10-06T01:41:59.931724+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:24:38.810483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.929526+0000","last_change":"2023-10-06T01:41:59.920518+0000","last_active":"2023-10-06T01:41:59.929526+0000","last_peered":"2023-10-06T01:41:59.929526+0000","last_clean":"2023-10-06T01:41:59.929526+0000","last_became_active":"2023-10-06T01:41:59.920258+0000","last_became_peered":"2023-10-06T01:41:59.920258+0000","last_unstale":"2023-10-06T01:41:59.929526+0000","last_undegraded":"2023-10-06T01:41:59.929526+0000","last_fullsized":"2023-10-06T01:41:59.929526+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:40:42.553317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.911650+0000","last_change":"2023-10-06T01:41:58.918654+0000","last_active":"2023-10-06T01:41:59.911650+0000","last_peered":"2023-10-06T01:41:59.911650+0000","last_clean":"2023-10-06T01:41:59.911650+0000","last_became_active":"2023-10-06T01:41:58.916820+0000","last_became_peered":"2023-10-06T01:41:58.916820+0000","last_unstale":"2023-10-06T01:41:59.911650+0000","last_undegraded":"2023-10-06T01:41:59.911650+0000","last_fullsized":"2023-10-06T01:41:59.911650+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:29:10.311250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.927862+0000","last_change":"2023-10-06T01:41:59.920579+0000","last_active":"2023-10-06T01:41:59.927862+0000","last_peered":"2023-10-06T01:41:59.927862+0000","last_clean":"2023-10-06T01:41:59.927862+0000","last_became_active":"2023-10-06T01:41:59.919127+0000","last_became_peered":"2023-10-06T01:41:59.919127+0000","last_unstale":"2023-10-06T01:41:59.927862+0000","last_undegraded":"2023-10-06T01:41:59.927862+0000","last_fullsized":"2023-10-06T01:41:59.927862+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:24:57.562583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.912442+0000","last_change":"2023-10-06T01:41:58.922210+0000","last_active":"2023-10-06T01:41:59.912442+0000","last_peered":"2023-10-06T01:41:59.912442+0000","last_clean":"2023-10-06T01:41:59.912442+0000","last_became_active":"2023-10-06T01:41:58.921962+0000","last_became_peered":"2023-10-06T01:41:58.921962+0000","last_unstale":"2023-10-06T01:41:59.912442+0000","last_undegraded":"2023-10-06T01:41:59.912442+0000","last_fullsized":"2023-10-06T01:41:59.912442+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:24:38.810483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.929612+0000","last_change":"2023-10-06T01:41:59.923787+0000","last_active":"2023-10-06T01:41:59.929612+0000","last_peered":"2023-10-06T01:41:59.929612+0000","last_clean":"2023-10-06T01:41:59.929612+0000","last_became_active":"2023-10-06T01:41:59.923530+0000","last_became_peered":"2023-10-06T01:41:59.923530+0000","last_unstale":"2023-10-06T01:41:59.929612+0000","last_undegraded":"2023-10-06T01:41:59.929612+0000","last_fullsized":"2023-10-06T01:41:59.929612+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:56:51.126033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.912761+0000","last_change":"2023-10-06T01:41:58.928025+0000","last_active":"2023-10-06T01:41:59.912761+0000","last_peered":"2023-10-06T01:41:59.912761+0000","last_clean":"2023-10-06T01:41:59.912761+0000","last_became_active":"2023-10-06T01:41:58.927745+0000","last_became_peered":"2023-10-06T01:41:58.927745+0000","last_unstale":"2023-10-06T01:41:59.912761+0000","last_undegraded":"2023-10-06T01:41:59.912761+0000","last_fullsized":"2023-10-06T01:41:59.912761+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:04:52.797213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.934010+0000","last_change":"2023-10-06T01:41:59.927488+0000","last_active":"2023-10-06T01:41:59.934010+0000","last_peered":"2023-10-06T01:41:59.934010+0000","last_clean":"2023-10-06T01:41:59.934010+0000","last_became_active":"2023-10-06T01:41:59.927154+0000","last_became_peered":"2023-10-06T01:41:59.927154+0000","last_unstale":"2023-10-06T01:41:59.934010+0000","last_undegraded":"2023-10-06T01:41:59.934010+0000","last_fullsized":"2023-10-06T01:41:59.934010+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:03.091506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.908142+0000","last_change":"2023-10-06T01:41:58.923640+0000","last_active":"2023-10-06T01:41:59.908142+0000","last_peered":"2023-10-06T01:41:59.908142+0000","last_clean":"2023-10-06T01:41:59.908142+0000","last_became_active":"2023-10-06T01:41:58.923367+0000","last_became_peered":"2023-10-06T01:41:58.923367+0000","last_unstale":"2023-10-06T01:41:59.908142+0000","last_undegraded":"2023-10-06T01:41:59.908142+0000","last_fullsized":"2023-10-06T01:41:59.908142+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:33:28.414752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.929348+0000","last_change":"2023-10-06T01:41:59.926192+0000","last_active":"2023-10-06T01:41:59.929348+0000","last_peered":"2023-10-06T01:41:59.929348+0000","last_clean":"2023-10-06T01:41:59.929348+0000","last_became_active":"2023-10-06T01:41:59.925952+0000","last_became_peered":"2023-10-06T01:41:59.925952+0000","last_unstale":"2023-10-06T01:41:59.929348+0000","last_undegraded":"2023-10-06T01:41:59.929348+0000","last_fullsized":"2023-10-06T01:41:59.929348+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:29:32.229410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"53'3","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.932854+0000","last_change":"2023-10-06T01:41:58.926296+0000","last_active":"2023-10-06T01:41:59.932854+0000","last_peered":"2023-10-06T01:41:59.932854+0000","last_clean":"2023-10-06T01:41:59.932854+0000","last_became_active":"2023-10-06T01:41:58.926034+0000","last_became_peered":"2023-10-06T01:41:58.926034+0000","last_unstale":"2023-10-06T01:41:59.932854+0000","last_undegraded":"2023-10-06T01:41:59.932854+0000","last_fullsized":"2023-10-06T01:41:59.932854+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:47:16.825984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.934278+0000","last_change":"2023-10-06T01:41:59.930901+0000","last_active":"2023-10-06T01:41:59.934278+0000","last_peered":"2023-10-06T01:41:59.934278+0000","last_clean":"2023-10-06T01:41:59.934278+0000","last_became_active":"2023-10-06T01:41:59.930222+0000","last_became_peered":"2023-10-06T01:41:59.930222+0000","last_unstale":"2023-10-06T01:41:59.934278+0000","last_undegraded":"2023-10-06T01:41:59.934278+0000","last_fullsized":"2023-10-06T01:41:59.934278+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:05:48.629746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"53'6","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.936484+0000","last_change":"2023-10-06T01:41:58.921643+0000","last_active":"2023-10-06T01:41:59.936484+0000","last_peered":"2023-10-06T01:41:59.936484+0000","last_clean":"2023-10-06T01:41:59.936484+0000","last_became_active":"2023-10-06T01:41:58.921169+0000","last_became_peered":"2023-10-06T01:41:58.921169+0000","last_unstale":"2023-10-06T01:41:59.936484+0000","last_undegraded":"2023-10-06T01:41:59.936484+0000","last_fullsized":"2023-10-06T01:41:59.936484+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:02.086327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.921935+0000","last_change":"2023-10-06T01:41:59.918211+0000","last_active":"2023-10-06T01:41:59.921935+0000","last_peered":"2023-10-06T01:41:59.921935+0000","last_clean":"2023-10-06T01:41:59.921935+0000","last_became_active":"2023-10-06T01:41:59.917943+0000","last_became_peered":"2023-10-06T01:41:59.917943+0000","last_unstale":"2023-10-06T01:41:59.921935+0000","last_undegraded":"2023-10-06T01:41:59.921935+0000","last_fullsized":"2023-10-06T01:41:59.921935+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:07:25.175365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"53'2","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.928080+0000","last_change":"2023-10-06T01:41:58.923632+0000","last_active":"2023-10-06T01:41:59.928080+0000","last_peered":"2023-10-06T01:41:59.928080+0000","last_clean":"2023-10-06T01:41:59.928080+0000","last_became_active":"2023-10-06T01:41:58.923405+0000","last_became_peered":"2023-10-06T01:41:58.923405+0000","last_unstale":"2023-10-06T01:41:59.928080+0000","last_undegraded":"2023-10-06T01:41:59.928080+0000","last_fullsized":"2023-10-06T01:41:59.928080+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:07:24.731136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.932775+0000","last_change":"2023-10-06T01:41:59.923071+0000","last_active":"2023-10-06T01:41:59.932775+0000","last_peered":"2023-10-06T01:41:59.932775+0000","last_clean":"2023-10-06T01:41:59.932775+0000","last_became_active":"2023-10-06T01:41:59.922811+0000","last_became_peered":"2023-10-06T01:41:59.922811+0000","last_unstale":"2023-10-06T01:41:59.932775+0000","last_undegraded":"2023-10-06T01:41:59.932775+0000","last_fullsized":"2023-10-06T01:41:59.932775+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:24:39.815662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.908561+0000","last_change":"2023-10-06T01:41:58.924504+0000","last_active":"2023-10-06T01:41:59.908561+0000","last_peered":"2023-10-06T01:41:59.908561+0000","last_clean":"2023-10-06T01:41:59.908561+0000","last_became_active":"2023-10-06T01:41:58.924234+0000","last_became_peered":"2023-10-06T01:41:58.924234+0000","last_unstale":"2023-10-06T01:41:59.908561+0000","last_undegraded":"2023-10-06T01:41:59.908561+0000","last_fullsized":"2023-10-06T01:41:59.908561+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:01:44.568173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.930847+0000","last_change":"2023-10-06T01:41:59.927908+0000","last_active":"2023-10-06T01:41:59.930847+0000","last_peered":"2023-10-06T01:41:59.930847+0000","last_clean":"2023-10-06T01:41:59.930847+0000","last_became_active":"2023-10-06T01:41:59.927614+0000","last_became_peered":"2023-10-06T01:41:59.927614+0000","last_unstale":"2023-10-06T01:41:59.930847+0000","last_undegraded":"2023-10-06T01:41:59.930847+0000","last_fullsized":"2023-10-06T01:41:59.930847+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:38:19.366140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.911544+0000","last_change":"2023-10-06T01:41:58.927423+0000","last_active":"2023-10-06T01:41:59.911544+0000","last_peered":"2023-10-06T01:41:59.911544+0000","last_clean":"2023-10-06T01:41:59.911544+0000","last_became_active":"2023-10-06T01:41:58.927082+0000","last_became_peered":"2023-10-06T01:41:58.927082+0000","last_unstale":"2023-10-06T01:41:59.911544+0000","last_undegraded":"2023-10-06T01:41:59.911544+0000","last_fullsized":"2023-10-06T01:41:59.911544+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:04.780513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.934308+0000","last_change":"2023-10-06T01:41:59.932568+0000","last_active":"2023-10-06T01:41:59.934308+0000","last_peered":"2023-10-06T01:41:59.934308+0000","last_clean":"2023-10-06T01:41:59.934308+0000","last_became_active":"2023-10-06T01:41:59.932187+0000","last_became_peered":"2023-10-06T01:41:59.932187+0000","last_unstale":"2023-10-06T01:41:59.934308+0000","last_undegraded":"2023-10-06T01:41:59.934308+0000","last_fullsized":"2023-10-06T01:41:59.934308+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:43:48.006348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"53'8","reported_seq":18,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.926079+0000","last_change":"2023-10-06T01:41:58.925098+0000","last_active":"2023-10-06T01:41:59.926079+0000","last_peered":"2023-10-06T01:41:59.926079+0000","last_clean":"2023-10-06T01:41:59.926079+0000","last_became_active":"2023-10-06T01:41:58.924857+0000","last_became_peered":"2023-10-06T01:41:58.924857+0000","last_unstale":"2023-10-06T01:41:59.926079+0000","last_undegraded":"2023-10-06T01:41:59.926079+0000","last_fullsized":"2023-10-06T01:41:59.926079+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:33:57.280587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.919480+0000","last_change":"2023-10-06T01:41:59.917248+0000","last_active":"2023-10-06T01:41:59.919480+0000","last_peered":"2023-10-06T01:41:59.919480+0000","last_clean":"2023-10-06T01:41:59.919480+0000","last_became_active":"2023-10-06T01:41:59.916977+0000","last_became_peered":"2023-10-06T01:41:59.916977+0000","last_unstale":"2023-10-06T01:41:59.919480+0000","last_undegraded":"2023-10-06T01:41:59.919480+0000","last_fullsized":"2023-10-06T01:41:59.919480+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:41:15.451811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"53'2","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.917779+0000","last_change":"2023-10-06T01:41:58.919223+0000","last_active":"2023-10-06T01:41:59.917779+0000","last_peered":"2023-10-06T01:41:59.917779+0000","last_clean":"2023-10-06T01:41:59.917779+0000","last_became_active":"2023-10-06T01:41:58.918835+0000","last_became_peered":"2023-10-06T01:41:58.918835+0000","last_unstale":"2023-10-06T01:41:59.917779+0000","last_undegraded":"2023-10-06T01:41:59.917779+0000","last_fullsized":"2023-10-06T01:41:59.917779+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:21:25.598775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.929947+0000","last_change":"2023-10-06T01:41:59.926743+0000","last_active":"2023-10-06T01:41:59.929947+0000","last_peered":"2023-10-06T01:41:59.929947+0000","last_clean":"2023-10-06T01:41:59.929947+0000","last_became_active":"2023-10-06T01:41:59.926475+0000","last_became_peered":"2023-10-06T01:41:59.926475+0000","last_unstale":"2023-10-06T01:41:59.929947+0000","last_undegraded":"2023-10-06T01:41:59.929947+0000","last_fullsized":"2023-10-06T01:41:59.929947+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:49:48.083851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"54'1","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T01:42:01.294427+0000","last_change":"2023-10-06T01:41:58.922702+0000","last_active":"2023-10-06T01:42:01.294427+0000","last_peered":"2023-10-06T01:42:01.294427+0000","last_clean":"2023-10-06T01:42:01.294427+0000","last_became_active":"2023-10-06T01:41:58.922346+0000","last_became_peered":"2023-10-06T01:41:58.922346+0000","last_unstale":"2023-10-06T01:42:01.294427+0000","last_undegraded":"2023-10-06T01:42:01.294427+0000","last_fullsized":"2023-10-06T01:42:01.294427+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:45:24.296902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.929329+0000","last_change":"2023-10-06T01:41:59.926045+0000","last_active":"2023-10-06T01:41:59.929329+0000","last_peered":"2023-10-06T01:41:59.929329+0000","last_clean":"2023-10-06T01:41:59.929329+0000","last_became_active":"2023-10-06T01:41:59.925804+0000","last_became_peered":"2023-10-06T01:41:59.925804+0000","last_unstale":"2023-10-06T01:41:59.929329+0000","last_undegraded":"2023-10-06T01:41:59.929329+0000","last_fullsized":"2023-10-06T01:41:59.929329+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:14:29.633116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.906684+0000","last_change":"2023-10-06T01:41:58.912477+0000","last_active":"2023-10-06T01:41:59.906684+0000","last_peered":"2023-10-06T01:41:59.906684+0000","last_clean":"2023-10-06T01:41:59.906684+0000","last_became_active":"2023-10-06T01:41:58.912169+0000","last_became_peered":"2023-10-06T01:41:58.912169+0000","last_unstale":"2023-10-06T01:41:59.906684+0000","last_undegraded":"2023-10-06T01:41:59.906684+0000","last_fullsized":"2023-10-06T01:41:59.906684+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:05:03.593533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.930473+0000","last_change":"2023-10-06T01:41:59.923227+0000","last_active":"2023-10-06T01:41:59.930473+0000","last_peered":"2023-10-06T01:41:59.930473+0000","last_clean":"2023-10-06T01:41:59.930473+0000","last_became_active":"2023-10-06T01:41:59.922959+0000","last_became_peered":"2023-10-06T01:41:59.922959+0000","last_unstale":"2023-10-06T01:41:59.930473+0000","last_undegraded":"2023-10-06T01:41:59.930473+0000","last_fullsized":"2023-10-06T01:41:59.930473+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:45:31.777277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.913128+0000","last_change":"2023-10-06T01:41:58.922312+0000","last_active":"2023-10-06T01:41:59.913128+0000","last_peered":"2023-10-06T01:41:59.913128+0000","last_clean":"2023-10-06T01:41:59.913128+0000","last_became_active":"2023-10-06T01:41:58.922064+0000","last_became_peered":"2023-10-06T01:41:58.922064+0000","last_unstale":"2023-10-06T01:41:59.913128+0000","last_undegraded":"2023-10-06T01:41:59.913128+0000","last_fullsized":"2023-10-06T01:41:59.913128+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:51:27.641984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.922007+0000","last_change":"2023-10-06T01:41:59.914243+0000","last_active":"2023-10-06T01:41:59.922007+0000","last_peered":"2023-10-06T01:41:59.922007+0000","last_clean":"2023-10-06T01:41:59.922007+0000","last_became_active":"2023-10-06T01:41:59.914009+0000","last_became_peered":"2023-10-06T01:41:59.914009+0000","last_unstale":"2023-10-06T01:41:59.922007+0000","last_undegraded":"2023-10-06T01:41:59.922007+0000","last_fullsized":"2023-10-06T01:41:59.922007+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:16:49.114729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.904614+0000","last_change":"2023-10-06T01:41:58.917481+0000","last_active":"2023-10-06T01:41:59.904614+0000","last_peered":"2023-10-06T01:41:59.904614+0000","last_clean":"2023-10-06T01:41:59.904614+0000","last_became_active":"2023-10-06T01:41:58.917211+0000","last_became_peered":"2023-10-06T01:41:58.917211+0000","last_unstale":"2023-10-06T01:41:59.904614+0000","last_undegraded":"2023-10-06T01:41:59.904614+0000","last_fullsized":"2023-10-06T01:41:59.904614+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:21:12.405145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.934166+0000","last_change":"2023-10-06T01:41:59.932298+0000","last_active":"2023-10-06T01:41:59.934166+0000","last_peered":"2023-10-06T01:41:59.934166+0000","last_clean":"2023-10-06T01:41:59.934166+0000","last_became_active":"2023-10-06T01:41:59.932063+0000","last_became_peered":"2023-10-06T01:41:59.932063+0000","last_unstale":"2023-10-06T01:41:59.934166+0000","last_undegraded":"2023-10-06T01:41:59.934166+0000","last_fullsized":"2023-10-06T01:41:59.934166+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:18:09.749842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.913765+0000","last_change":"2023-10-06T01:41:58.920213+0000","last_active":"2023-10-06T01:41:59.913765+0000","last_peered":"2023-10-06T01:41:59.913765+0000","last_clean":"2023-10-06T01:41:59.913765+0000","last_became_active":"2023-10-06T01:41:58.919959+0000","last_became_peered":"2023-10-06T01:41:58.919959+0000","last_unstale":"2023-10-06T01:41:59.913765+0000","last_undegraded":"2023-10-06T01:41:59.913765+0000","last_fullsized":"2023-10-06T01:41:59.913765+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:03:29.295425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.911536+0000","last_change":"2023-10-06T01:41:59.909458+0000","last_active":"2023-10-06T01:41:59.911536+0000","last_peered":"2023-10-06T01:41:59.911536+0000","last_clean":"2023-10-06T01:41:59.911536+0000","last_became_active":"2023-10-06T01:41:59.909209+0000","last_became_peered":"2023-10-06T01:41:59.909209+0000","last_unstale":"2023-10-06T01:41:59.911536+0000","last_undegraded":"2023-10-06T01:41:59.911536+0000","last_fullsized":"2023-10-06T01:41:59.911536+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:40:42.553317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.904596+0000","last_change":"2023-10-06T01:41:58.922092+0000","last_active":"2023-10-06T01:41:59.904596+0000","last_peered":"2023-10-06T01:41:59.904596+0000","last_clean":"2023-10-06T01:41:59.904596+0000","last_became_active":"2023-10-06T01:41:58.921857+0000","last_became_peered":"2023-10-06T01:41:58.921857+0000","last_unstale":"2023-10-06T01:41:59.904596+0000","last_undegraded":"2023-10-06T01:41:59.904596+0000","last_fullsized":"2023-10-06T01:41:59.904596+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:25:35.328771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.929945+0000","last_change":"2023-10-06T01:41:59.920941+0000","last_active":"2023-10-06T01:41:59.929945+0000","last_peered":"2023-10-06T01:41:59.929945+0000","last_clean":"2023-10-06T01:41:59.929945+0000","last_became_active":"2023-10-06T01:41:59.920261+0000","last_became_peered":"2023-10-06T01:41:59.920261+0000","last_unstale":"2023-10-06T01:41:59.929945+0000","last_undegraded":"2023-10-06T01:41:59.929945+0000","last_fullsized":"2023-10-06T01:41:59.929945+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:46:55.042870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.907622+0000","last_change":"2023-10-06T01:41:58.917439+0000","last_active":"2023-10-06T01:41:59.907622+0000","last_peered":"2023-10-06T01:41:59.907622+0000","last_clean":"2023-10-06T01:41:59.907622+0000","last_became_active":"2023-10-06T01:41:58.917205+0000","last_became_peered":"2023-10-06T01:41:58.917205+0000","last_unstale":"2023-10-06T01:41:59.907622+0000","last_undegraded":"2023-10-06T01:41:59.907622+0000","last_fullsized":"2023-10-06T01:41:59.907622+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:24:38.810483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.929966+0000","last_change":"2023-10-06T01:41:59.926557+0000","last_active":"2023-10-06T01:41:59.929966+0000","last_peered":"2023-10-06T01:41:59.929966+0000","last_clean":"2023-10-06T01:41:59.929966+0000","last_became_active":"2023-10-06T01:41:59.926287+0000","last_became_peered":"2023-10-06T01:41:59.926287+0000","last_unstale":"2023-10-06T01:41:59.929966+0000","last_undegraded":"2023-10-06T01:41:59.929966+0000","last_fullsized":"2023-10-06T01:41:59.929966+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:24:01.329759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"53'2","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.929236+0000","last_change":"2023-10-06T01:41:58.925582+0000","last_active":"2023-10-06T01:41:59.929236+0000","last_peered":"2023-10-06T01:41:59.929236+0000","last_clean":"2023-10-06T01:41:59.929236+0000","last_became_active":"2023-10-06T01:41:58.923189+0000","last_became_peered":"2023-10-06T01:41:58.923189+0000","last_unstale":"2023-10-06T01:41:59.929236+0000","last_undegraded":"2023-10-06T01:41:59.929236+0000","last_fullsized":"2023-10-06T01:41:59.929236+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:03:29.295425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":40,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.905453+0000","last_change":"2023-10-06T01:40:16.930992+0000","last_active":"2023-10-06T01:41:59.905453+0000","last_peered":"2023-10-06T01:41:59.905453+0000","last_clean":"2023-10-06T01:41:59.905453+0000","last_became_active":"2023-10-06T01:40:16.930707+0000","last_became_peered":"2023-10-06T01:40:16.930707+0000","last_unstale":"2023-10-06T01:41:59.905453+0000","last_undegraded":"2023-10-06T01:41:59.905453+0000","last_fullsized":"2023-10-06T01:41:59.905453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:52:43.316071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.930150+0000","last_change":"2023-10-06T01:41:59.927285+0000","last_active":"2023-10-06T01:41:59.930150+0000","last_peered":"2023-10-06T01:41:59.930150+0000","last_clean":"2023-10-06T01:41:59.930150+0000","last_became_active":"2023-10-06T01:41:59.927007+0000","last_became_peered":"2023-10-06T01:41:59.927007+0000","last_unstale":"2023-10-06T01:41:59.930150+0000","last_undegraded":"2023-10-06T01:41:59.930150+0000","last_fullsized":"2023-10-06T01:41:59.930150+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:30:18.755143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.911795+0000","last_change":"2023-10-06T01:41:58.922335+0000","last_active":"2023-10-06T01:41:59.911795+0000","last_peered":"2023-10-06T01:41:59.911795+0000","last_clean":"2023-10-06T01:41:59.911795+0000","last_became_active":"2023-10-06T01:41:58.922038+0000","last_became_peered":"2023-10-06T01:41:58.922038+0000","last_unstale":"2023-10-06T01:41:59.911795+0000","last_undegraded":"2023-10-06T01:41:59.911795+0000","last_fullsized":"2023-10-06T01:41:59.911795+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:58:36.151365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":40,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.911754+0000","last_change":"2023-10-06T01:40:16.651019+0000","last_active":"2023-10-06T01:41:59.911754+0000","last_peered":"2023-10-06T01:41:59.911754+0000","last_clean":"2023-10-06T01:41:59.911754+0000","last_became_active":"2023-10-06T01:40:16.650628+0000","last_became_peered":"2023-10-06T01:40:16.650628+0000","last_unstale":"2023-10-06T01:41:59.911754+0000","last_undegraded":"2023-10-06T01:41:59.911754+0000","last_fullsized":"2023-10-06T01:41:59.911754+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:11:57.218984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.921909+0000","last_change":"2023-10-06T01:41:59.918092+0000","last_active":"2023-10-06T01:41:59.921909+0000","last_peered":"2023-10-06T01:41:59.921909+0000","last_clean":"2023-10-06T01:41:59.921909+0000","last_became_active":"2023-10-06T01:41:59.917798+0000","last_became_peered":"2023-10-06T01:41:59.917798+0000","last_unstale":"2023-10-06T01:41:59.921909+0000","last_undegraded":"2023-10-06T01:41:59.921909+0000","last_fullsized":"2023-10-06T01:41:59.921909+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:07:25.736314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"53'2","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.927936+0000","last_change":"2023-10-06T01:41:58.918081+0000","last_active":"2023-10-06T01:41:59.927936+0000","last_peered":"2023-10-06T01:41:59.927936+0000","last_clean":"2023-10-06T01:41:59.927936+0000","last_became_active":"2023-10-06T01:41:58.912873+0000","last_became_peered":"2023-10-06T01:41:58.912873+0000","last_unstale":"2023-10-06T01:41:59.927936+0000","last_undegraded":"2023-10-06T01:41:59.927936+0000","last_fullsized":"2023-10-06T01:41:59.927936+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:03:29.295425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":39,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.910695+0000","last_change":"2023-10-06T01:40:16.781596+0000","last_active":"2023-10-06T01:41:59.910695+0000","last_peered":"2023-10-06T01:41:59.910695+0000","last_clean":"2023-10-06T01:41:59.910695+0000","last_became_active":"2023-10-06T01:40:16.781352+0000","last_became_peered":"2023-10-06T01:40:16.781352+0000","last_unstale":"2023-10-06T01:41:59.910695+0000","last_undegraded":"2023-10-06T01:41:59.910695+0000","last_fullsized":"2023-10-06T01:41:59.910695+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:52:43.316071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.927383+0000","last_change":"2023-10-06T01:41:59.917119+0000","last_active":"2023-10-06T01:41:59.927383+0000","last_peered":"2023-10-06T01:41:59.927383+0000","last_clean":"2023-10-06T01:41:59.927383+0000","last_became_active":"2023-10-06T01:41:59.915854+0000","last_became_peered":"2023-10-06T01:41:59.915854+0000","last_unstale":"2023-10-06T01:41:59.927383+0000","last_undegraded":"2023-10-06T01:41:59.927383+0000","last_fullsized":"2023-10-06T01:41:59.927383+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:01:49.563771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.907271+0000","last_change":"2023-10-06T01:41:58.923132+0000","last_active":"2023-10-06T01:41:59.907271+0000","last_peered":"2023-10-06T01:41:59.907271+0000","last_clean":"2023-10-06T01:41:59.907271+0000","last_became_active":"2023-10-06T01:41:58.922860+0000","last_became_peered":"2023-10-06T01:41:58.922860+0000","last_unstale":"2023-10-06T01:41:59.907271+0000","last_undegraded":"2023-10-06T01:41:59.907271+0000","last_fullsized":"2023-10-06T01:41:59.907271+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:24:20.800050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":40,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.911629+0000","last_change":"2023-10-06T01:40:16.650826+0000","last_active":"2023-10-06T01:41:59.911629+0000","last_peered":"2023-10-06T01:41:59.911629+0000","last_clean":"2023-10-06T01:41:59.911629+0000","last_became_active":"2023-10-06T01:40:16.650469+0000","last_became_peered":"2023-10-06T01:40:16.650469+0000","last_unstale":"2023-10-06T01:41:59.911629+0000","last_undegraded":"2023-10-06T01:41:59.911629+0000","last_fullsized":"2023-10-06T01:41:59.911629+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:50:23.628212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":192,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.910822+0000","last_change":"2023-10-06T01:40:10.645512+0000","last_active":"2023-10-06T01:41:59.910822+0000","last_peered":"2023-10-06T01:41:59.910822+0000","last_clean":"2023-10-06T01:41:59.910822+0000","last_became_active":"2023-10-06T01:40:10.644601+0000","last_became_peered":"2023-10-06T01:40:10.644601+0000","last_unstale":"2023-10-06T01:41:59.910822+0000","last_undegraded":"2023-10-06T01:41:59.910822+0000","last_fullsized":"2023-10-06T01:41:59.910822+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:09.580865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:09.580865+0000","last_clean_scrub_stamp":"2023-10-06T01:40:09.580865+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:05:28.268591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.930194+0000","last_change":"2023-10-06T01:41:59.927385+0000","last_active":"2023-10-06T01:41:59.930194+0000","last_peered":"2023-10-06T01:41:59.930194+0000","last_clean":"2023-10-06T01:41:59.930194+0000","last_became_active":"2023-10-06T01:41:59.926980+0000","last_became_peered":"2023-10-06T01:41:59.926980+0000","last_unstale":"2023-10-06T01:41:59.930194+0000","last_undegraded":"2023-10-06T01:41:59.930194+0000","last_fullsized":"2023-10-06T01:41:59.930194+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:46:55.042870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.904596+0000","last_change":"2023-10-06T01:41:58.920513+0000","last_active":"2023-10-06T01:41:59.904596+0000","last_peered":"2023-10-06T01:41:59.904596+0000","last_clean":"2023-10-06T01:41:59.904596+0000","last_became_active":"2023-10-06T01:41:58.920202+0000","last_became_peered":"2023-10-06T01:41:58.920202+0000","last_unstale":"2023-10-06T01:41:59.904596+0000","last_undegraded":"2023-10-06T01:41:59.904596+0000","last_fullsized":"2023-10-06T01:41:59.904596+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:53:53.773734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":39,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.913027+0000","last_change":"2023-10-06T01:40:16.651332+0000","last_active":"2023-10-06T01:41:59.913027+0000","last_peered":"2023-10-06T01:41:59.913027+0000","last_clean":"2023-10-06T01:41:59.913027+0000","last_became_active":"2023-10-06T01:40:16.651049+0000","last_became_peered":"2023-10-06T01:40:16.651049+0000","last_unstale":"2023-10-06T01:41:59.913027+0000","last_undegraded":"2023-10-06T01:41:59.913027+0000","last_fullsized":"2023-10-06T01:41:59.913027+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:11:57.218984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.934094+0000","last_change":"2023-10-06T01:41:59.927274+0000","last_active":"2023-10-06T01:41:59.934094+0000","last_peered":"2023-10-06T01:41:59.934094+0000","last_clean":"2023-10-06T01:41:59.934094+0000","last_became_active":"2023-10-06T01:41:59.926995+0000","last_became_peered":"2023-10-06T01:41:59.926995+0000","last_unstale":"2023-10-06T01:41:59.934094+0000","last_undegraded":"2023-10-06T01:41:59.934094+0000","last_fullsized":"2023-10-06T01:41:59.934094+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:41:15.451811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"53'1","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.927945+0000","last_change":"2023-10-06T01:41:58.923811+0000","last_active":"2023-10-06T01:41:59.927945+0000","last_peered":"2023-10-06T01:41:59.927945+0000","last_clean":"2023-10-06T01:41:59.927945+0000","last_became_active":"2023-10-06T01:41:58.923398+0000","last_became_peered":"2023-10-06T01:41:58.923398+0000","last_unstale":"2023-10-06T01:41:59.927945+0000","last_undegraded":"2023-10-06T01:41:59.927945+0000","last_fullsized":"2023-10-06T01:41:59.927945+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:01:32.487705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":39,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.915576+0000","last_change":"2023-10-06T01:40:16.931106+0000","last_active":"2023-10-06T01:41:59.915576+0000","last_peered":"2023-10-06T01:41:59.915576+0000","last_clean":"2023-10-06T01:41:59.915576+0000","last_became_active":"2023-10-06T01:40:16.930830+0000","last_became_peered":"2023-10-06T01:40:16.930830+0000","last_unstale":"2023-10-06T01:41:59.915576+0000","last_undegraded":"2023-10-06T01:41:59.915576+0000","last_fullsized":"2023-10-06T01:41:59.915576+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:50:23.628212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.934292+0000","last_change":"2023-10-06T01:41:59.931026+0000","last_active":"2023-10-06T01:41:59.934292+0000","last_peered":"2023-10-06T01:41:59.934292+0000","last_clean":"2023-10-06T01:41:59.934292+0000","last_became_active":"2023-10-06T01:41:59.930478+0000","last_became_peered":"2023-10-06T01:41:59.930478+0000","last_unstale":"2023-10-06T01:41:59.934292+0000","last_undegraded":"2023-10-06T01:41:59.934292+0000","last_fullsized":"2023-10-06T01:41:59.934292+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:07:25.736314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.923186+0000","last_change":"2023-10-06T01:41:58.923417+0000","last_active":"2023-10-06T01:41:59.923186+0000","last_peered":"2023-10-06T01:41:59.923186+0000","last_clean":"2023-10-06T01:41:59.923186+0000","last_became_active":"2023-10-06T01:41:58.922483+0000","last_became_peered":"2023-10-06T01:41:58.922483+0000","last_unstale":"2023-10-06T01:41:59.923186+0000","last_undegraded":"2023-10-06T01:41:59.923186+0000","last_fullsized":"2023-10-06T01:41:59.923186+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:07:24.731136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":40,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.904999+0000","last_change":"2023-10-06T01:40:16.649379+0000","last_active":"2023-10-06T01:41:59.904999+0000","last_peered":"2023-10-06T01:41:59.904999+0000","last_clean":"2023-10-06T01:41:59.904999+0000","last_became_active":"2023-10-06T01:40:16.649147+0000","last_became_peered":"2023-10-06T01:40:16.649147+0000","last_unstale":"2023-10-06T01:41:59.904999+0000","last_undegraded":"2023-10-06T01:41:59.904999+0000","last_fullsized":"2023-10-06T01:41:59.904999+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:11:57.218984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.929827+0000","last_change":"2023-10-06T01:41:59.928829+0000","last_active":"2023-10-06T01:41:59.929827+0000","last_peered":"2023-10-06T01:41:59.929827+0000","last_clean":"2023-10-06T01:41:59.929827+0000","last_became_active":"2023-10-06T01:41:59.928576+0000","last_became_peered":"2023-10-06T01:41:59.928576+0000","last_unstale":"2023-10-06T01:41:59.929827+0000","last_undegraded":"2023-10-06T01:41:59.929827+0000","last_fullsized":"2023-10-06T01:41:59.929827+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:18:41.923790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"53'1","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.926239+0000","last_change":"2023-10-06T01:41:58.926962+0000","last_active":"2023-10-06T01:41:59.926239+0000","last_peered":"2023-10-06T01:41:59.926239+0000","last_clean":"2023-10-06T01:41:59.926239+0000","last_became_active":"2023-10-06T01:41:58.926758+0000","last_became_peered":"2023-10-06T01:41:58.926758+0000","last_unstale":"2023-10-06T01:41:59.926239+0000","last_undegraded":"2023-10-06T01:41:59.926239+0000","last_fullsized":"2023-10-06T01:41:59.926239+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:58:35.816250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":41,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.907510+0000","last_change":"2023-10-06T01:40:16.651477+0000","last_active":"2023-10-06T01:41:59.907510+0000","last_peered":"2023-10-06T01:41:59.907510+0000","last_clean":"2023-10-06T01:41:59.907510+0000","last_became_active":"2023-10-06T01:40:16.651190+0000","last_became_peered":"2023-10-06T01:40:16.651190+0000","last_unstale":"2023-10-06T01:41:59.907510+0000","last_undegraded":"2023-10-06T01:41:59.907510+0000","last_fullsized":"2023-10-06T01:41:59.907510+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:45:47.422876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574875,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298504,"kb_used_data":1216,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073336,"statfs":{"total":96636764160,"available":96331096064,"internally_reserved":0,"allocated":1245184,"data_stored":886499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:41:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":3.6920000000000002,"5min":3.6920000000000002,"15min":3.6920000000000002},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":3.629,"5min":3.629,"15min":3.629},"last":0.40400000000000003}]},{"osd":1,"last update":"Fri Oct 6 01:41:11 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":10.029999999999999,"5min":10.029999999999999,"15min":10.029999999999999},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.544,"5min":1.544,"15min":1.544},"last":0.53400000000000003}]},{"osd":2,"last update":"Fri Oct 6 01:41:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.54900000000000004},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":10.710000000000001,"5min":10.710000000000001,"15min":10.710000000000001},"last":0.46700000000000003}]},{"osd":3,"last update":"Fri Oct 6 01:41:11 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.437},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":3.6509999999999998,"5min":3.6509999999999998,"15min":3.6509999999999998},"last":0.51900000000000002}]},{"osd":4,"last update":"Fri Oct 6 01:41:11 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.49299999999999999}]},{"osd":5,"last update":"Fri Oct 6 01:41:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.7509999999999999,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":0.47899999999999998}]},{"osd":6,"last update":"Fri Oct 6 01:41:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.9370000000000001,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.57699999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574875,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297916,"kb_used_data":628,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073924,"statfs":{"total":96636764160,"available":96331698176,"internally_reserved":0,"allocated":643072,"data_stored":295971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.621}]},{"osd":1,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.48599999999999999}]},{"osd":2,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.441},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.65300000000000002}]},{"osd":3,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.51100000000000001}]},{"osd":4,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.67500000000000004}]},{"osd":5,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.57399999999999995}]},{"osd":7,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.56399999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574875,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297920,"kb_used_data":632,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073920,"statfs":{"total":96636764160,"available":96331694080,"internally_reserved":0,"allocated":647168,"data_stored":296061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.997,"15min":0.997},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":11.957000000000001,"5min":11.957000000000001,"15min":11.957000000000001},"last":0.253},{"interface":"front","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":11.917,"5min":11.917,"15min":11.917},"last":0.28999999999999998}]},{"osd":2,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.33200000000000002}]},{"osd":3,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":6.2450000000000001,"5min":6.2450000000000001,"15min":6.2450000000000001},"last":0.308},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":6.2939999999999996,"5min":6.2939999999999996,"15min":6.2939999999999996},"last":0.32200000000000001}]},{"osd":4,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":6.1669999999999998,"5min":6.1669999999999998,"15min":6.1669999999999998},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.45000000000000001}]},{"osd":5,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":6.2619999999999996,"5min":6.2619999999999996,"15min":6.2619999999999996},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":6.2350000000000003,"5min":6.2350000000000003,"15min":6.2350000000000003},"last":0.48999999999999999}]},{"osd":6,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":6.141,"5min":6.141,"15min":6.141},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":6.2069999999999999,"5min":6.2069999999999999,"15min":6.2069999999999999},"last":0.50700000000000001}]},{"osd":7,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":6.1040000000000001,"5min":6.1040000000000001,"15min":6.1040000000000001},"last":0.497}]}]},{"osd":0,"up_from":13,"seq":55834574875,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298508,"kb_used_data":1220,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073332,"statfs":{"total":96636764160,"available":96331091968,"internally_reserved":0,"allocated":1249280,"data_stored":887468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":3.9129999999999998,"5min":3.9129999999999998,"15min":3.9129999999999998},"last":0.36499999999999999}]},{"osd":2,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":15.237,"5min":15.237,"15min":15.237},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":3.7959999999999998,"5min":3.7959999999999998,"15min":3.7959999999999998},"last":0.441}]},{"osd":3,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":5.2850000000000001,"5min":5.2850000000000001,"15min":5.2850000000000001},"last":0.34899999999999998},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":15.263,"5min":15.263,"15min":15.263},"last":0.51200000000000001}]},{"osd":4,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":5.2590000000000003,"5min":5.2590000000000003,"15min":5.2590000000000003},"last":0.57099999999999995},{"interface":"front","average":{"1min":1.242,"5min":1.242,"15min":1.242},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":15.211,"5min":15.211,"15min":15.211},"last":0.54700000000000004}]},{"osd":5,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":3.8839999999999999,"5min":3.8839999999999999,"15min":3.8839999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":5.2309999999999999,"5min":5.2309999999999999,"15min":5.2309999999999999},"last":0.53200000000000003}]},{"osd":6,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.212,"15min":1.212},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":15.175000000000001,"5min":15.175000000000001,"15min":15.175000000000001},"last":0.628},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":3.859,"5min":3.859,"15min":3.859},"last":0.58199999999999996}]},{"osd":7,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":3.831,"5min":3.831,"15min":3.831},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":5.1959999999999997,"5min":5.1959999999999997,"15min":5.1959999999999997},"last":0.59199999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574875,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297924,"kb_used_data":636,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073916,"statfs":{"total":96636764160,"available":96331689984,"internally_reserved":0,"allocated":651264,"data_stored":296027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"last":0.46200000000000002}]},{"osd":1,"last update":"Fri Oct 6 01:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.311,"15min":0.311},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"last":0.374},{"interface":"front","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.49199999999999999}]},{"osd":3,"last update":"Fri Oct 6 01:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.432}]},{"osd":4,"last update":"Fri Oct 6 01:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.60499999999999998}]},{"osd":5,"last update":"Fri Oct 6 01:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.55400000000000005}]},{"osd":6,"last update":"Fri Oct 6 01:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.54300000000000004}]},{"osd":7,"last update":"Fri Oct 6 01:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.63600000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574875,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297924,"kb_used_data":636,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073916,"statfs":{"total":96636764160,"available":96331689984,"internally_reserved":0,"allocated":651264,"data_stored":296027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.29799999999999999}]},{"osd":1,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.23599999999999999},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.35999999999999999}]},{"osd":2,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.316},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.38700000000000001}]},{"osd":4,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.48099999999999998}]},{"osd":5,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.49099999999999999}]},{"osd":6,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.46700000000000003}]},{"osd":7,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.437},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.503}]}]},{"osd":4,"up_from":13,"seq":55834574875,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297928,"kb_used_data":640,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073912,"statfs":{"total":96636764160,"available":96331685888,"internally_reserved":0,"allocated":655360,"data_stored":297507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.54900000000000004}]},{"osd":1,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":4.0780000000000003,"5min":4.0780000000000003,"15min":4.0780000000000003},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":4.1050000000000004,"5min":4.1050000000000004,"15min":4.1050000000000004},"last":0.57999999999999996}]},{"osd":2,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.52700000000000002}]},{"osd":3,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.64400000000000002}]},{"osd":5,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.437,"15min":0.437},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.621},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.63200000000000001}]},{"osd":6,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.65800000000000003}]},{"osd":7,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.67600000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574875,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297924,"kb_used_data":636,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073916,"statfs":{"total":96636764160,"available":96331689984,"internally_reserved":0,"allocated":651264,"data_stored":296595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.52200000000000002}]},{"osd":1,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.622},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.59899999999999998}]},{"osd":2,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.6970000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.54700000000000004}]},{"osd":3,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.58699999999999997}]},{"osd":4,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.41799999999999998}]},{"osd":6,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.437},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.45700000000000002}]},{"osd":7,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.821,"5min":1.821,"15min":1.821},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.50600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T01:42:04.710 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-06T01:42:04.856 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.855+0000 7f7813e5c700 1 Processor -- start 2023-10-06T01:42:04.856 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.855+0000 7f7813e5c700 1 -- start start 2023-10-06T01:42:04.865 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.856+0000 7f7813e5c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f780c1596d0 0x7f780c159aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:04.865 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.856+0000 7f7813e5c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f780c0c5540 0x7f780c0cb530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:04.866 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.856+0000 7f7813e5c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f780c0cba70 0x7f780c15d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:04.866 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.856+0000 7f7813e5c700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f780c15d490 con 0x7f780c0c5540 2023-10-06T01:42:04.866 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.856+0000 7f7813e5c700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f780c15a390 con 0x7f780c1596d0 2023-10-06T01:42:04.866 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.856+0000 7f7813e5c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f780c15a670 con 0x7f780c0cba70 2023-10-06T01:42:04.866 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.856+0000 7f78113f7700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f780c0c5540 0x7f780c0cb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:04.867 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.856+0000 7f78113f7700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f780c0c5540 0x7f780c0cb530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38048/0 (socket says 172.21.15.71:38048) 2023-10-06T01:42:04.867 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.856+0000 7f78113f7700 1 -- 172.21.15.71:0/85808338 learned_addr learned my addr 172.21.15.71:0/85808338 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:04.867 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.856+0000 7f7811bf8700 1 --2- 172.21.15.71:0/85808338 >> v2:172.21.15.72:3300/0 conn(0x7f780c1596d0 0x7f780c159aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:04.867 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.856+0000 7f78123f9700 1 --2- 172.21.15.71:0/85808338 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f780c0cba70 0x7f780c15d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:04.867 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.857+0000 7f78113f7700 1 -- 172.21.15.71:0/85808338 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f780c0cba70 msgr2=0x7f780c15d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:04.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.857+0000 7f78113f7700 1 --2- 172.21.15.71:0/85808338 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f780c0cba70 0x7f780c15d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:04.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.857+0000 7f78113f7700 1 -- 172.21.15.71:0/85808338 >> v2:172.21.15.72:3300/0 conn(0x7f780c1596d0 msgr2=0x7f780c159aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:04.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.857+0000 7f78113f7700 1 --2- 172.21.15.71:0/85808338 >> v2:172.21.15.72:3300/0 conn(0x7f780c1596d0 0x7f780c159aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:04.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.857+0000 7f78113f7700 1 -- 172.21.15.71:0/85808338 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f780c15a950 con 0x7f780c0c5540 2023-10-06T01:42:04.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.857+0000 7f7811bf8700 1 --2- 172.21.15.71:0/85808338 >> v2:172.21.15.72:3300/0 conn(0x7f780c1596d0 0x7f780c159aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:42:04.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.857+0000 7f78113f7700 1 --2- 172.21.15.71:0/85808338 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f780c0c5540 0x7f780c0cb530 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f780c089270 tx=0x7f77fc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e4ef38ce9755790 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:04.869 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.857+0000 7f7810bf6700 1 -- 172.21.15.71:0/85808338 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77fc00b640 con 0x7f780c0c5540 2023-10-06T01:42:04.869 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.857+0000 7f7810bf6700 1 -- 172.21.15.71:0/85808338 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77fc00b7a0 con 0x7f780c0c5540 2023-10-06T01:42:04.869 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.857+0000 7f7810bf6700 1 -- 172.21.15.71:0/85808338 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77fc00bb60 con 0x7f780c0c5540 2023-10-06T01:42:04.869 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.857+0000 7f7813e5c700 1 -- 172.21.15.71:0/85808338 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f780c0c5540 msgr2=0x7f780c0cb530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:04.869 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.857+0000 7f7813e5c700 1 --2- 172.21.15.71:0/85808338 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f780c0c5540 0x7f780c0cb530 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f780c089270 tx=0x7f77fc009250 comp rx=0 tx=0).stop 2023-10-06T01:42:04.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.857+0000 7f7813e5c700 1 -- 172.21.15.71:0/85808338 shutdown_connections 2023-10-06T01:42:04.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.857+0000 7f7813e5c700 1 --2- 172.21.15.71:0/85808338 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f780c0cba70 0x7f780c15d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:04.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.857+0000 7f7813e5c700 1 --2- 172.21.15.71:0/85808338 >> v2:172.21.15.72:3300/0 conn(0x7f780c1596d0 0x7f780c159aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:04.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.857+0000 7f7813e5c700 1 --2- 172.21.15.71:0/85808338 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f780c0c5540 0x7f780c0cb530 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:04.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.857+0000 7f7813e5c700 1 -- 172.21.15.71:0/85808338 >> 172.21.15.71:0/85808338 conn(0x7f780c068680 msgr2=0x7f780c068a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:04.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.858+0000 7f7813e5c700 1 -- 172.21.15.71:0/85808338 shutdown_connections 2023-10-06T01:42:04.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.858+0000 7f7813e5c700 1 -- 172.21.15.71:0/85808338 wait complete. 2023-10-06T01:42:04.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.859+0000 7f7813e5c700 1 Processor -- start 2023-10-06T01:42:04.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.859+0000 7f7813e5c700 1 -- start start 2023-10-06T01:42:04.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.859+0000 7f7813e5c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f780c0c5540 0x7f780c0b47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:04.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.859+0000 7f7813e5c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f780c0cba70 0x7f780c154280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:04.872 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.859+0000 7f7813e5c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f780c1596d0 0x7f780c1547c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:04.872 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.859+0000 7f7813e5c700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f780c0c9cc0 con 0x7f780c0c5540 2023-10-06T01:42:04.872 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.859+0000 7f7813e5c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f780c0c90b0 con 0x7f780c1596d0 2023-10-06T01:42:04.872 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.859+0000 7f7813e5c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f780c0c9390 con 0x7f780c0cba70 2023-10-06T01:42:04.872 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.859+0000 7f7811bf8700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f780c0c5540 0x7f780c0b47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:04.872 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.859+0000 7f7811bf8700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f780c0c5540 0x7f780c0b47c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38062/0 (socket says 172.21.15.71:38062) 2023-10-06T01:42:04.873 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.859+0000 7f7811bf8700 1 -- 172.21.15.71:0/125930858 learned_addr learned my addr 172.21.15.71:0/125930858 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:04.873 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.860+0000 7f7811bf8700 1 -- 172.21.15.71:0/125930858 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f780c0cba70 msgr2=0x7f780c154280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:04.873 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.860+0000 7f78113f7700 1 --2- 172.21.15.71:0/125930858 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f780c0cba70 0x7f780c154280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:04.873 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.860+0000 7f78123f9700 1 --2- 172.21.15.71:0/125930858 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f780c1596d0 0x7f780c1547c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:04.873 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.860+0000 7f7811bf8700 1 --2- 172.21.15.71:0/125930858 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f780c0cba70 0x7f780c154280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:04.873 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.860+0000 7f7811bf8700 1 -- 172.21.15.71:0/125930858 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f780c1596d0 msgr2=0x7f780c1547c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:04.874 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.860+0000 7f7811bf8700 1 --2- 172.21.15.71:0/125930858 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f780c1596d0 0x7f780c1547c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:04.874 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.860+0000 7f7811bf8700 1 -- 172.21.15.71:0/125930858 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7808009420 con 0x7f780c0c5540 2023-10-06T01:42:04.874 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.860+0000 7f7811bf8700 1 --2- 172.21.15.71:0/125930858 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f780c0c5540 0x7f780c0b47c0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f780800ec80 tx=0x7f78080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:04.874 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.860+0000 7f7801ffb700 1 -- 172.21.15.71:0/125930858 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780800c9d0 con 0x7f780c0c5540 2023-10-06T01:42:04.874 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.860+0000 7f7801ffb700 1 -- 172.21.15.71:0/125930858 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f780800cb30 con 0x7f780c0c5540 2023-10-06T01:42:04.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.860+0000 7f7813e5c700 1 -- 172.21.15.71:0/125930858 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77fc0094f0 con 0x7f780c0c5540 2023-10-06T01:42:04.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.860+0000 7f7801ffb700 1 -- 172.21.15.71:0/125930858 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780800ceb0 con 0x7f780c0c5540 2023-10-06T01:42:04.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.860+0000 7f7813e5c700 1 -- 172.21.15.71:0/125930858 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f780c0c9950 con 0x7f780c0c5540 2023-10-06T01:42:04.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.861+0000 7f7813e5c700 1 -- 172.21.15.71:0/125930858 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f780c088aa0 con 0x7f780c0c5540 2023-10-06T01:42:04.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.862+0000 7f7801ffb700 1 -- 172.21.15.71:0/125930858 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7808013680 con 0x7f780c0c5540 2023-10-06T01:42:04.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.862+0000 7f7801ffb700 1 --2- 172.21.15.71:0/125930858 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f77f0066f30 0x7f77f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:04.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.862+0000 7f7801ffb700 1 -- 172.21.15.71:0/125930858 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f7808084b70 con 0x7f780c0c5540 2023-10-06T01:42:04.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.862+0000 7f78113f7700 1 --2- 172.21.15.71:0/125930858 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f77f0066f30 0x7f77f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:04.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.862+0000 7f78113f7700 1 --2- 172.21.15.71:0/125930858 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f77f0066f30 0x7f77f00693e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f780c089270 tx=0x7f77fc017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:04.877 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:04.866+0000 7f7801ffb700 1 -- 172.21.15.71:0/125930858 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7808051b40 con 0x7f780c0c5540 2023-10-06T01:42:05.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:05.130+0000 7f7813e5c700 1 -- 172.21.15.71:0/125930858 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f780c15ac30 con 0x7f780c0c5540 2023-10-06T01:42:05.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:05.130+0000 7f7801ffb700 1 -- 172.21.15.71:0/125930858 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1436 (secure 0 0 0) 0x7f7808055160 con 0x7f780c0c5540 2023-10-06T01:42:05.132 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:42:05.133 INFO:teuthology.orchestra.run.smithi071.stdout:{"fsid":"1fbf1bd2-f9b4-4599-bea2-f4aa920e9a56","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":128,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":54,"num_osds":8,"num_up_osds":8,"osd_up_since":1696556408,"num_in_osds":8,"osd_in_since":1696556399,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":24,"data_bytes":592674,"bytes_used":2441777152,"bytes_avail":770652336128,"bytes_total":773094113280,"write_bytes_sec":2218,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":31,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"b","status":"up:active","gid":5586}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2023-10-06T01:41:48.582554+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-06T01:42:05.134 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:05.132+0000 7f7813e5c700 1 -- 172.21.15.71:0/125930858 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f77f0066f30 msgr2=0x7f77f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:05.134 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:05.132+0000 7f7813e5c700 1 --2- 172.21.15.71:0/125930858 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f77f0066f30 0x7f77f00693e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f780c089270 tx=0x7f77fc017000 comp rx=0 tx=0).stop 2023-10-06T01:42:05.134 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:05.132+0000 7f7813e5c700 1 -- 172.21.15.71:0/125930858 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f780c0c5540 msgr2=0x7f780c0b47c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:05.134 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:05.132+0000 7f7813e5c700 1 --2- 172.21.15.71:0/125930858 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f780c0c5540 0x7f780c0b47c0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f780800ec80 tx=0x7f78080091a0 comp rx=0 tx=0).stop 2023-10-06T01:42:05.134 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:05.132+0000 7f7813e5c700 1 -- 172.21.15.71:0/125930858 shutdown_connections 2023-10-06T01:42:05.134 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:05.132+0000 7f7813e5c700 1 --2- 172.21.15.71:0/125930858 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f77f0066f30 0x7f77f00693e0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:05.134 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:05.132+0000 7f7813e5c700 1 --2- 172.21.15.71:0/125930858 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f780c1596d0 0x7f780c1547c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:05.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:05.132+0000 7f7813e5c700 1 --2- 172.21.15.71:0/125930858 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f780c0c5540 0x7f780c0b47c0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:05.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:05.132+0000 7f7813e5c700 1 --2- 172.21.15.71:0/125930858 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f780c0cba70 0x7f780c154280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:05.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:05.132+0000 7f7813e5c700 1 -- 172.21.15.71:0/125930858 >> 172.21.15.71:0/125930858 conn(0x7f780c068680 msgr2=0x7f780c1588e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:05.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:05.132+0000 7f7813e5c700 1 -- 172.21.15.71:0/125930858 shutdown_connections 2023-10-06T01:42:05.135 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:05.132+0000 7f7813e5c700 1 -- 172.21.15.71:0/125930858 wait complete. 2023-10-06T01:42:05.145 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-06T01:42:05.145 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T01:42:05.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:05.259+0000 7eff4315c700 1 Processor -- start 2023-10-06T01:42:05.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:05.259+0000 7eff4315c700 1 -- start start 2023-10-06T01:42:05.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:05.260+0000 7eff4315c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7eff3c0af4e0 0x7eff3c0b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:05.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:05.260+0000 7eff4315c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7eff3c0af8b0 0x7eff3c0b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:05.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:05.260+0000 7eff4315c700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff3c15e190 con 0x7eff3c15d460 2023-10-06T01:42:05.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:05.260+0000 7eff4315c700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff3c0b1910 con 0x7eff3c0af8b0 2023-10-06T01:42:05.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:05.260+0000 7eff4315c700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff3c15dfa0 con 0x7eff3c0af4e0 2023-10-06T01:42:05.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:05.260+0000 7eff3bfff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7eff3c0af8b0 0x7eff3c0b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:05.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:05.260+0000 7eff3bfff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7eff3c0af8b0 0x7eff3c0b2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38070/0 (socket says 172.21.15.71:38070) 2023-10-06T01:42:05.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:05.260+0000 7eff3bfff700 1 -- 172.21.15.71:0/3777305270 learned_addr learned my addr 172.21.15.71:0/3777305270 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:05.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:05.260+0000 7eff3bfff700 1 -- 172.21.15.71:0/3777305270 >> v2:172.21.15.72:3300/0 conn(0x7eff3c0af4e0 msgr2=0x7eff3c0b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:05.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:05.260+0000 7eff40ef8700 1 --2- 172.21.15.71:0/3777305270 >> v2:172.21.15.72:3300/0 conn(0x7eff3c0af4e0 0x7eff3c0b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:05.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:05.260+0000 7eff3bfff700 1 --2- 172.21.15.71:0/3777305270 >> v2:172.21.15.72:3300/0 conn(0x7eff3c0af4e0 0x7eff3c0b20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:05.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:05.260+0000 7eff3bfff700 1 -- 172.21.15.71:0/3777305270 >> v1:172.21.15.72:6789/0 conn(0x7eff3c15d460 legacy=0x7eff3c15d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:05.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:05.260+0000 7eff3bfff700 1 -- 172.21.15.71:0/3777305270 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff3c0cb650 con 0x7eff3c0af8b0 2023-10-06T01:42:05.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:05.260+0000 7eff40ef8700 1 --2- 172.21.15.71:0/3777305270 >> v2:172.21.15.72:3300/0 conn(0x7eff3c0af4e0 0x7eff3c0b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:42:05.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:05.260+0000 7eff3bfff700 1 --2- 172.21.15.71:0/3777305270 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff3c0af8b0 0x7eff3c0b2620 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7eff3c0d1360 tx=0x7eff28009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b116bf8ad49a4205 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:05.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:05.260+0000 7eff3b7fe700 1 -- 172.21.15.71:0/3777305270 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff2800b820 con 0x7eff3c0af8b0 2023-10-06T01:42:05.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:05.260+0000 7eff3b7fe700 1 -- 172.21.15.71:0/3777305270 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff2800b980 con 0x7eff3c0af8b0 2023-10-06T01:42:05.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:05.260+0000 7eff3b7fe700 1 -- 172.21.15.71:0/3777305270 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff2800bd20 con 0x7eff3c0af8b0 2023-10-06T01:42:05.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:05.261+0000 7eff4315c700 1 -- 172.21.15.71:0/3777305270 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff3c0af8b0 msgr2=0x7eff3c0b2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:05.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:05.261+0000 7eff4315c700 1 --2- 172.21.15.71:0/3777305270 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff3c0af8b0 0x7eff3c0b2620 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7eff3c0d1360 tx=0x7eff28009250 comp rx=0 tx=0).stop 2023-10-06T01:42:05.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:05.261+0000 7eff4315c700 1 -- 172.21.15.71:0/3777305270 shutdown_connections 2023-10-06T01:42:05.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:05.261+0000 7eff4315c700 1 --2- 172.21.15.71:0/3777305270 >> v2:172.21.15.72:3300/0 conn(0x7eff3c0af4e0 0x7eff3c0b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:05.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:05.261+0000 7eff4315c700 1 --2- 172.21.15.71:0/3777305270 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff3c0af8b0 0x7eff3c0b2620 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:05.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:05.261+0000 7eff4315c700 1 -- 172.21.15.71:0/3777305270 >> 172.21.15.71:0/3777305270 conn(0x7eff3c068680 msgr2=0x7eff3c068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:05.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:05.261+0000 7eff4315c700 1 -- 172.21.15.71:0/3777305270 shutdown_connections 2023-10-06T01:42:05.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:05.261+0000 7eff4315c700 1 -- 172.21.15.71:0/3777305270 wait complete. 2023-10-06T01:42:05.268 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:05.262+0000 7eff4315c700 1 Processor -- start 2023-10-06T01:42:05.268 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:05.262+0000 7eff4315c700 1 -- start start 2023-10-06T01:42:05.268 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:05.263+0000 7eff4315c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7eff3c0af4e0 0x7eff3c16acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:05.268 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:05.263+0000 7eff4315c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff3c0af8b0 0x7eff3c157450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:05.268 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:05.263+0000 7eff4315c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff3c15d460 0x7eff3c0d0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:05.268 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:05.263+0000 7eff4315c700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff3c157e60 con 0x7eff3c0af8b0 2023-10-06T01:42:05.268 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:05.263+0000 7eff4315c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff3c16b210 con 0x7eff3c15d460 2023-10-06T01:42:05.268 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:05.263+0000 7eff4315c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff3c157990 con 0x7eff3c0af4e0 2023-10-06T01:42:05.268 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:05.263+0000 7eff3bfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff3c0af8b0 0x7eff3c157450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:05.268 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:05.263+0000 7eff3bfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff3c0af8b0 0x7eff3c157450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38086/0 (socket says 172.21.15.71:38086) 2023-10-06T01:42:05.269 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:05.263+0000 7eff3bfff700 1 -- 172.21.15.71:0/2792869084 learned_addr learned my addr 172.21.15.71:0/2792869084 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:05.269 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:05.263+0000 7eff40ef8700 1 --2- 172.21.15.71:0/2792869084 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7eff3c0af4e0 0x7eff3c16acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:05.269 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:05.263+0000 7eff3bfff700 1 -- 172.21.15.71:0/2792869084 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7eff3c0af4e0 msgr2=0x7eff3c16acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:05.269 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:05.263+0000 7eff416f9700 1 --2- 172.21.15.71:0/2792869084 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff3c15d460 0x7eff3c0d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:05.269 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:05.263+0000 7eff3bfff700 1 --2- 172.21.15.71:0/2792869084 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7eff3c0af4e0 0x7eff3c16acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:05.269 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:05.263+0000 7eff3bfff700 1 -- 172.21.15.71:0/2792869084 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff3c15d460 msgr2=0x7eff3c0d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:05.269 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:05.263+0000 7eff3bfff700 1 --2- 172.21.15.71:0/2792869084 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff3c15d460 0x7eff3c0d0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:05.269 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:05.263+0000 7eff3bfff700 1 -- 172.21.15.71:0/2792869084 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff280094f0 con 0x7eff3c0af8b0 2023-10-06T01:42:05.269 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:05.264+0000 7eff3bfff700 1 --2- 172.21.15.71:0/2792869084 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff3c0af8b0 0x7eff3c157450 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7eff28009290 tx=0x7eff28016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:05.269 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:05.264+0000 7eff38ff9700 1 -- 172.21.15.71:0/2792869084 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff28006bc0 con 0x7eff3c0af8b0 2023-10-06T01:42:05.269 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:05.264+0000 7eff38ff9700 1 -- 172.21.15.71:0/2792869084 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff28020070 con 0x7eff3c0af8b0 2023-10-06T01:42:05.269 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:05.264+0000 7eff4315c700 1 -- 172.21.15.71:0/2792869084 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff3c0c8360 con 0x7eff3c0af8b0 2023-10-06T01:42:05.269 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:05.264+0000 7eff38ff9700 1 -- 172.21.15.71:0/2792869084 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff2801b6a0 con 0x7eff3c0af8b0 2023-10-06T01:42:05.270 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:05.264+0000 7eff4315c700 1 -- 172.21.15.71:0/2792869084 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff3c0c7d10 con 0x7eff3c0af8b0 2023-10-06T01:42:05.270 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:05.265+0000 7eff4315c700 1 -- 172.21.15.71:0/2792869084 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff3c0c7b70 con 0x7eff3c0af8b0 2023-10-06T01:42:05.270 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:05.265+0000 7eff38ff9700 1 -- 172.21.15.71:0/2792869084 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7eff28022030 con 0x7eff3c0af8b0 2023-10-06T01:42:05.270 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:05.266+0000 7eff38ff9700 1 --2- 172.21.15.71:0/2792869084 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7eff20066f30 0x7eff200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:05.270 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:05.266+0000 7eff40ef8700 1 --2- 172.21.15.71:0/2792869084 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7eff20066f30 0x7eff200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:05.270 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:05.266+0000 7eff38ff9700 1 -- 172.21.15.71:0/2792869084 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6378+0+0 (secure 0 0 0) 0x7eff28086830 con 0x7eff3c0af8b0 2023-10-06T01:42:05.270 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:05.266+0000 7eff40ef8700 1 --2- 172.21.15.71:0/2792869084 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7eff20066f30 0x7eff200693e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7eff30006fd0 tx=0x7eff30008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:05.270 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:05.270+0000 7eff38ff9700 1 -- 172.21.15.71:0/2792869084 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7eff3c0c7b70 con 0x7eff3c0af8b0 2023-10-06T01:42:05.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:05.451+0000 7eff4315c700 1 -- 172.21.15.71:0/2792869084 --> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7eff3c0c7b70 con 0x7eff20066f30 2023-10-06T01:42:05.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:05.459+0000 7eff38ff9700 1 -- 172.21.15.71:0/2792869084 <== mgr.4107 v2:172.21.15.71:6832/90436 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310743 (secure 0 0 0) 0x7eff3c0c7b70 con 0x7eff20066f30 2023-10-06T01:42:05.463 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:42:05.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:05.462+0000 7eff4315c700 1 -- 172.21.15.71:0/2792869084 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7eff20066f30 msgr2=0x7eff200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:05.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:05.462+0000 7eff4315c700 1 --2- 172.21.15.71:0/2792869084 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7eff20066f30 0x7eff200693e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7eff30006fd0 tx=0x7eff30008040 comp rx=0 tx=0).stop 2023-10-06T01:42:05.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:05.462+0000 7eff4315c700 1 -- 172.21.15.71:0/2792869084 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff3c0af8b0 msgr2=0x7eff3c157450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:05.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:05.462+0000 7eff4315c700 1 --2- 172.21.15.71:0/2792869084 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff3c0af8b0 0x7eff3c157450 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7eff28009290 tx=0x7eff28016000 comp rx=0 tx=0).stop 2023-10-06T01:42:05.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:05.462+0000 7eff4315c700 1 -- 172.21.15.71:0/2792869084 shutdown_connections 2023-10-06T01:42:05.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:05.462+0000 7eff4315c700 1 --2- 172.21.15.71:0/2792869084 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7eff20066f30 0x7eff200693e0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:05.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:05.462+0000 7eff4315c700 1 --2- 172.21.15.71:0/2792869084 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff3c15d460 0x7eff3c0d0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:05.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:05.462+0000 7eff4315c700 1 --2- 172.21.15.71:0/2792869084 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7eff3c0af4e0 0x7eff3c16acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:05.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:05.462+0000 7eff4315c700 1 --2- 172.21.15.71:0/2792869084 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff3c0af8b0 0x7eff3c157450 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:05.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:05.462+0000 7eff4315c700 1 -- 172.21.15.71:0/2792869084 >> 172.21.15.71:0/2792869084 conn(0x7eff3c068680 msgr2=0x7eff3c0b5350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:05.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:05.463+0000 7eff4315c700 1 -- 172.21.15.71:0/2792869084 shutdown_connections 2023-10-06T01:42:05.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:05.463+0000 7eff4315c700 1 -- 172.21.15.71:0/2792869084 wait complete. 2023-10-06T01:42:05.467 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2023-10-06T01:42:05.475 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":105,"stamp":"2023-10-06T01:42:04.584964+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":203,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2384548,"kb_used_data":6244,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752590172,"statfs":{"total":773094113280,"available":770652336128,"internally_reserved":0,"allocated":6393856,"data_stored":3552155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000932"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.922447+0000","last_change":"2023-10-06T01:41:59.915540+0000","last_active":"2023-10-06T01:41:59.922447+0000","last_peered":"2023-10-06T01:41:59.922447+0000","last_clean":"2023-10-06T01:41:59.922447+0000","last_became_active":"2023-10-06T01:41:59.915284+0000","last_became_peered":"2023-10-06T01:41:59.915284+0000","last_unstale":"2023-10-06T01:41:59.922447+0000","last_undegraded":"2023-10-06T01:41:59.922447+0000","last_fullsized":"2023-10-06T01:41:59.922447+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:03:59.520161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.916533+0000","last_change":"2023-10-06T01:41:59.913058+0000","last_active":"2023-10-06T01:41:59.916533+0000","last_peered":"2023-10-06T01:41:59.916533+0000","last_clean":"2023-10-06T01:41:59.916533+0000","last_became_active":"2023-10-06T01:41:59.912781+0000","last_became_peered":"2023-10-06T01:41:59.912781+0000","last_unstale":"2023-10-06T01:41:59.916533+0000","last_undegraded":"2023-10-06T01:41:59.916533+0000","last_fullsized":"2023-10-06T01:41:59.916533+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:14:55.659015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.934081+0000","last_change":"2023-10-06T01:41:59.930725+0000","last_active":"2023-10-06T01:41:59.934081+0000","last_peered":"2023-10-06T01:41:59.934081+0000","last_clean":"2023-10-06T01:41:59.934081+0000","last_became_active":"2023-10-06T01:41:59.929740+0000","last_became_peered":"2023-10-06T01:41:59.929740+0000","last_unstale":"2023-10-06T01:41:59.934081+0000","last_undegraded":"2023-10-06T01:41:59.934081+0000","last_fullsized":"2023-10-06T01:41:59.934081+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:24:01.329759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.924994+0000","last_change":"2023-10-06T01:41:59.924145+0000","last_active":"2023-10-06T01:41:59.924994+0000","last_peered":"2023-10-06T01:41:59.924994+0000","last_clean":"2023-10-06T01:41:59.924994+0000","last_became_active":"2023-10-06T01:41:59.923836+0000","last_became_peered":"2023-10-06T01:41:59.923836+0000","last_unstale":"2023-10-06T01:41:59.924994+0000","last_undegraded":"2023-10-06T01:41:59.924994+0000","last_fullsized":"2023-10-06T01:41:59.924994+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:41:29.186282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.926529+0000","last_change":"2023-10-06T01:41:59.917118+0000","last_active":"2023-10-06T01:41:59.926529+0000","last_peered":"2023-10-06T01:41:59.926529+0000","last_clean":"2023-10-06T01:41:59.926529+0000","last_became_active":"2023-10-06T01:41:59.916859+0000","last_became_peered":"2023-10-06T01:41:59.916859+0000","last_unstale":"2023-10-06T01:41:59.926529+0000","last_undegraded":"2023-10-06T01:41:59.926529+0000","last_fullsized":"2023-10-06T01:41:59.926529+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:01:45.573351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.932977+0000","last_change":"2023-10-06T01:41:59.929806+0000","last_active":"2023-10-06T01:41:59.932977+0000","last_peered":"2023-10-06T01:41:59.932977+0000","last_clean":"2023-10-06T01:41:59.932977+0000","last_became_active":"2023-10-06T01:41:59.929565+0000","last_became_peered":"2023-10-06T01:41:59.929565+0000","last_unstale":"2023-10-06T01:41:59.932977+0000","last_undegraded":"2023-10-06T01:41:59.932977+0000","last_fullsized":"2023-10-06T01:41:59.932977+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:18:41.923790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.926648+0000","last_change":"2023-10-06T01:41:59.920798+0000","last_active":"2023-10-06T01:41:59.926648+0000","last_peered":"2023-10-06T01:41:59.926648+0000","last_clean":"2023-10-06T01:41:59.926648+0000","last_became_active":"2023-10-06T01:41:59.920550+0000","last_became_peered":"2023-10-06T01:41:59.920550+0000","last_unstale":"2023-10-06T01:41:59.926648+0000","last_undegraded":"2023-10-06T01:41:59.926648+0000","last_fullsized":"2023-10-06T01:41:59.926648+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:45:31.777277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.927775+0000","last_change":"2023-10-06T01:41:59.918442+0000","last_active":"2023-10-06T01:41:59.927775+0000","last_peered":"2023-10-06T01:41:59.927775+0000","last_clean":"2023-10-06T01:41:59.927775+0000","last_became_active":"2023-10-06T01:41:59.918193+0000","last_became_peered":"2023-10-06T01:41:59.918193+0000","last_unstale":"2023-10-06T01:41:59.927775+0000","last_undegraded":"2023-10-06T01:41:59.927775+0000","last_fullsized":"2023-10-06T01:41:59.927775+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:07:19.364309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.930948+0000","last_change":"2023-10-06T01:41:59.924857+0000","last_active":"2023-10-06T01:41:59.930948+0000","last_peered":"2023-10-06T01:41:59.930948+0000","last_clean":"2023-10-06T01:41:59.930948+0000","last_became_active":"2023-10-06T01:41:59.924587+0000","last_became_peered":"2023-10-06T01:41:59.924587+0000","last_unstale":"2023-10-06T01:41:59.930948+0000","last_undegraded":"2023-10-06T01:41:59.930948+0000","last_fullsized":"2023-10-06T01:41:59.930948+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:44:24.458680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.911532+0000","last_change":"2023-10-06T01:41:59.909443+0000","last_active":"2023-10-06T01:41:59.911532+0000","last_peered":"2023-10-06T01:41:59.911532+0000","last_clean":"2023-10-06T01:41:59.911532+0000","last_became_active":"2023-10-06T01:41:59.909189+0000","last_became_peered":"2023-10-06T01:41:59.909189+0000","last_unstale":"2023-10-06T01:41:59.911532+0000","last_undegraded":"2023-10-06T01:41:59.911532+0000","last_fullsized":"2023-10-06T01:41:59.911532+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:49:01.938924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.917054+0000","last_change":"2023-10-06T01:41:59.913473+0000","last_active":"2023-10-06T01:41:59.917054+0000","last_peered":"2023-10-06T01:41:59.917054+0000","last_clean":"2023-10-06T01:41:59.917054+0000","last_became_active":"2023-10-06T01:41:59.913213+0000","last_became_peered":"2023-10-06T01:41:59.913213+0000","last_unstale":"2023-10-06T01:41:59.917054+0000","last_undegraded":"2023-10-06T01:41:59.917054+0000","last_fullsized":"2023-10-06T01:41:59.917054+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:03:59.520161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.930999+0000","last_change":"2023-10-06T01:41:59.927393+0000","last_active":"2023-10-06T01:41:59.930999+0000","last_peered":"2023-10-06T01:41:59.930999+0000","last_clean":"2023-10-06T01:41:59.930999+0000","last_became_active":"2023-10-06T01:41:59.927137+0000","last_became_peered":"2023-10-06T01:41:59.927137+0000","last_unstale":"2023-10-06T01:41:59.930999+0000","last_undegraded":"2023-10-06T01:41:59.930999+0000","last_fullsized":"2023-10-06T01:41:59.930999+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:05:48.629746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.931762+0000","last_change":"2023-10-06T01:41:59.929256+0000","last_active":"2023-10-06T01:41:59.931762+0000","last_peered":"2023-10-06T01:41:59.931762+0000","last_clean":"2023-10-06T01:41:59.931762+0000","last_became_active":"2023-10-06T01:41:59.928778+0000","last_became_peered":"2023-10-06T01:41:59.928778+0000","last_unstale":"2023-10-06T01:41:59.931762+0000","last_undegraded":"2023-10-06T01:41:59.931762+0000","last_fullsized":"2023-10-06T01:41:59.931762+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:14:29.633116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.925731+0000","last_change":"2023-10-06T01:41:59.922250+0000","last_active":"2023-10-06T01:41:59.925731+0000","last_peered":"2023-10-06T01:41:59.925731+0000","last_clean":"2023-10-06T01:41:59.925731+0000","last_became_active":"2023-10-06T01:41:59.922001+0000","last_became_peered":"2023-10-06T01:41:59.922001+0000","last_unstale":"2023-10-06T01:41:59.925731+0000","last_undegraded":"2023-10-06T01:41:59.925731+0000","last_fullsized":"2023-10-06T01:41:59.925731+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:40:12.842857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.926668+0000","last_change":"2023-10-06T01:41:59.922713+0000","last_active":"2023-10-06T01:41:59.926668+0000","last_peered":"2023-10-06T01:41:59.926668+0000","last_clean":"2023-10-06T01:41:59.926668+0000","last_became_active":"2023-10-06T01:41:59.922462+0000","last_became_peered":"2023-10-06T01:41:59.922462+0000","last_unstale":"2023-10-06T01:41:59.926668+0000","last_undegraded":"2023-10-06T01:41:59.926668+0000","last_fullsized":"2023-10-06T01:41:59.926668+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:05:48.629746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.933111+0000","last_change":"2023-10-06T01:41:59.929705+0000","last_active":"2023-10-06T01:41:59.933111+0000","last_peered":"2023-10-06T01:41:59.933111+0000","last_clean":"2023-10-06T01:41:59.933111+0000","last_became_active":"2023-10-06T01:41:59.929457+0000","last_became_peered":"2023-10-06T01:41:59.929457+0000","last_unstale":"2023-10-06T01:41:59.933111+0000","last_undegraded":"2023-10-06T01:41:59.933111+0000","last_fullsized":"2023-10-06T01:41:59.933111+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:14:55.659015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.916801+0000","last_change":"2023-10-06T01:41:59.913085+0000","last_active":"2023-10-06T01:41:59.916801+0000","last_peered":"2023-10-06T01:41:59.916801+0000","last_clean":"2023-10-06T01:41:59.916801+0000","last_became_active":"2023-10-06T01:41:59.912867+0000","last_became_peered":"2023-10-06T01:41:59.912867+0000","last_unstale":"2023-10-06T01:41:59.916801+0000","last_undegraded":"2023-10-06T01:41:59.916801+0000","last_fullsized":"2023-10-06T01:41:59.916801+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:08.078701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.939122+0000","last_change":"2023-10-06T01:41:59.933685+0000","last_active":"2023-10-06T01:41:59.939122+0000","last_peered":"2023-10-06T01:41:59.939122+0000","last_clean":"2023-10-06T01:41:59.939122+0000","last_became_active":"2023-10-06T01:41:59.932319+0000","last_became_peered":"2023-10-06T01:41:59.932319+0000","last_unstale":"2023-10-06T01:41:59.939122+0000","last_undegraded":"2023-10-06T01:41:59.939122+0000","last_fullsized":"2023-10-06T01:41:59.939122+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:56:51.126033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.926574+0000","last_change":"2023-10-06T01:41:59.920145+0000","last_active":"2023-10-06T01:41:59.926574+0000","last_peered":"2023-10-06T01:41:59.926574+0000","last_clean":"2023-10-06T01:41:59.926574+0000","last_became_active":"2023-10-06T01:41:59.919889+0000","last_became_peered":"2023-10-06T01:41:59.919889+0000","last_unstale":"2023-10-06T01:41:59.926574+0000","last_undegraded":"2023-10-06T01:41:59.926574+0000","last_fullsized":"2023-10-06T01:41:59.926574+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:42:12.631213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.933860+0000","last_change":"2023-10-06T01:41:59.929655+0000","last_active":"2023-10-06T01:41:59.933860+0000","last_peered":"2023-10-06T01:41:59.933860+0000","last_clean":"2023-10-06T01:41:59.933860+0000","last_became_active":"2023-10-06T01:41:59.929408+0000","last_became_peered":"2023-10-06T01:41:59.929408+0000","last_unstale":"2023-10-06T01:41:59.933860+0000","last_undegraded":"2023-10-06T01:41:59.933860+0000","last_fullsized":"2023-10-06T01:41:59.933860+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:41:27.269324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.933840+0000","last_change":"2023-10-06T01:41:59.925142+0000","last_active":"2023-10-06T01:41:59.933840+0000","last_peered":"2023-10-06T01:41:59.933840+0000","last_clean":"2023-10-06T01:41:59.933840+0000","last_became_active":"2023-10-06T01:41:59.924872+0000","last_became_peered":"2023-10-06T01:41:59.924872+0000","last_unstale":"2023-10-06T01:41:59.933840+0000","last_undegraded":"2023-10-06T01:41:59.933840+0000","last_fullsized":"2023-10-06T01:41:59.933840+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:41:29.186282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.927819+0000","last_change":"2023-10-06T01:41:59.918563+0000","last_active":"2023-10-06T01:41:59.927819+0000","last_peered":"2023-10-06T01:41:59.927819+0000","last_clean":"2023-10-06T01:41:59.927819+0000","last_became_active":"2023-10-06T01:41:59.918068+0000","last_became_peered":"2023-10-06T01:41:59.918068+0000","last_unstale":"2023-10-06T01:41:59.927819+0000","last_undegraded":"2023-10-06T01:41:59.927819+0000","last_fullsized":"2023-10-06T01:41:59.927819+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:42:14.967630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.934327+0000","last_change":"2023-10-06T01:41:59.933157+0000","last_active":"2023-10-06T01:41:59.934327+0000","last_peered":"2023-10-06T01:41:59.934327+0000","last_clean":"2023-10-06T01:41:59.934327+0000","last_became_active":"2023-10-06T01:41:59.932454+0000","last_became_peered":"2023-10-06T01:41:59.932454+0000","last_unstale":"2023-10-06T01:41:59.934327+0000","last_undegraded":"2023-10-06T01:41:59.934327+0000","last_fullsized":"2023-10-06T01:41:59.934327+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:07:25.175365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.931787+0000","last_change":"2023-10-06T01:41:59.929430+0000","last_active":"2023-10-06T01:41:59.931787+0000","last_peered":"2023-10-06T01:41:59.931787+0000","last_clean":"2023-10-06T01:41:59.931787+0000","last_became_active":"2023-10-06T01:41:59.929162+0000","last_became_peered":"2023-10-06T01:41:59.929162+0000","last_unstale":"2023-10-06T01:41:59.931787+0000","last_undegraded":"2023-10-06T01:41:59.931787+0000","last_fullsized":"2023-10-06T01:41:59.931787+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:29:32.229410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.921742+0000","last_change":"2023-10-06T01:41:59.914263+0000","last_active":"2023-10-06T01:41:59.921742+0000","last_peered":"2023-10-06T01:41:59.921742+0000","last_clean":"2023-10-06T01:41:59.921742+0000","last_became_active":"2023-10-06T01:41:59.913986+0000","last_became_peered":"2023-10-06T01:41:59.913986+0000","last_unstale":"2023-10-06T01:41:59.921742+0000","last_undegraded":"2023-10-06T01:41:59.921742+0000","last_fullsized":"2023-10-06T01:41:59.921742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:24:21.805228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.929900+0000","last_change":"2023-10-06T01:41:59.927075+0000","last_active":"2023-10-06T01:41:59.929900+0000","last_peered":"2023-10-06T01:41:59.929900+0000","last_clean":"2023-10-06T01:41:59.929900+0000","last_became_active":"2023-10-06T01:41:59.926810+0000","last_became_peered":"2023-10-06T01:41:59.926810+0000","last_unstale":"2023-10-06T01:41:59.929900+0000","last_undegraded":"2023-10-06T01:41:59.929900+0000","last_fullsized":"2023-10-06T01:41:59.929900+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:43:48.006348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.930488+0000","last_change":"2023-10-06T01:41:59.927240+0000","last_active":"2023-10-06T01:41:59.930488+0000","last_peered":"2023-10-06T01:41:59.930488+0000","last_clean":"2023-10-06T01:41:59.930488+0000","last_became_active":"2023-10-06T01:41:59.926702+0000","last_became_peered":"2023-10-06T01:41:59.926702+0000","last_unstale":"2023-10-06T01:41:59.930488+0000","last_undegraded":"2023-10-06T01:41:59.930488+0000","last_fullsized":"2023-10-06T01:41:59.930488+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:42:14.967630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.926514+0000","last_change":"2023-10-06T01:41:59.916928+0000","last_active":"2023-10-06T01:41:59.926514+0000","last_peered":"2023-10-06T01:41:59.926514+0000","last_clean":"2023-10-06T01:41:59.926514+0000","last_became_active":"2023-10-06T01:41:59.916659+0000","last_became_peered":"2023-10-06T01:41:59.916659+0000","last_unstale":"2023-10-06T01:41:59.926514+0000","last_undegraded":"2023-10-06T01:41:59.926514+0000","last_fullsized":"2023-10-06T01:41:59.926514+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:49:01.938924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.928127+0000","last_change":"2023-10-06T01:41:59.920777+0000","last_active":"2023-10-06T01:41:59.928127+0000","last_peered":"2023-10-06T01:41:59.928127+0000","last_clean":"2023-10-06T01:41:59.928127+0000","last_became_active":"2023-10-06T01:41:59.920533+0000","last_became_peered":"2023-10-06T01:41:59.920533+0000","last_unstale":"2023-10-06T01:41:59.928127+0000","last_undegraded":"2023-10-06T01:41:59.928127+0000","last_fullsized":"2023-10-06T01:41:59.928127+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:03:33.302671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.934050+0000","last_change":"2023-10-06T01:41:59.927799+0000","last_active":"2023-10-06T01:41:59.934050+0000","last_peered":"2023-10-06T01:41:59.934050+0000","last_clean":"2023-10-06T01:41:59.934050+0000","last_became_active":"2023-10-06T01:41:59.927478+0000","last_became_peered":"2023-10-06T01:41:59.927478+0000","last_unstale":"2023-10-06T01:41:59.934050+0000","last_undegraded":"2023-10-06T01:41:59.934050+0000","last_fullsized":"2023-10-06T01:41:59.934050+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:49:48.083851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.926469+0000","last_change":"2023-10-06T01:41:59.919687+0000","last_active":"2023-10-06T01:41:59.926469+0000","last_peered":"2023-10-06T01:41:59.926469+0000","last_clean":"2023-10-06T01:41:59.926469+0000","last_became_active":"2023-10-06T01:41:59.919441+0000","last_became_peered":"2023-10-06T01:41:59.919441+0000","last_unstale":"2023-10-06T01:41:59.926469+0000","last_undegraded":"2023-10-06T01:41:59.926469+0000","last_fullsized":"2023-10-06T01:41:59.926469+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:58.335794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.923898+0000","last_change":"2023-10-06T01:41:59.918563+0000","last_active":"2023-10-06T01:41:59.923898+0000","last_peered":"2023-10-06T01:41:59.923898+0000","last_clean":"2023-10-06T01:41:59.923898+0000","last_became_active":"2023-10-06T01:41:59.918173+0000","last_became_peered":"2023-10-06T01:41:59.918173+0000","last_unstale":"2023-10-06T01:41:59.923898+0000","last_undegraded":"2023-10-06T01:41:59.923898+0000","last_fullsized":"2023-10-06T01:41:59.923898+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:16:49.114729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.930205+0000","last_change":"2023-10-06T01:41:59.927457+0000","last_active":"2023-10-06T01:41:59.930205+0000","last_peered":"2023-10-06T01:41:59.930205+0000","last_clean":"2023-10-06T01:41:59.930205+0000","last_became_active":"2023-10-06T01:41:59.927162+0000","last_became_peered":"2023-10-06T01:41:59.927162+0000","last_unstale":"2023-10-06T01:41:59.930205+0000","last_undegraded":"2023-10-06T01:41:59.930205+0000","last_fullsized":"2023-10-06T01:41:59.930205+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:33:27.039395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"53'4","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.927733+0000","last_change":"2023-10-06T01:41:58.922614+0000","last_active":"2023-10-06T01:41:59.927733+0000","last_peered":"2023-10-06T01:41:59.927733+0000","last_clean":"2023-10-06T01:41:59.927733+0000","last_became_active":"2023-10-06T01:41:58.922235+0000","last_became_peered":"2023-10-06T01:41:58.922235+0000","last_unstale":"2023-10-06T01:41:59.927733+0000","last_undegraded":"2023-10-06T01:41:59.927733+0000","last_fullsized":"2023-10-06T01:41:59.927733+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:02.086327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.929487+0000","last_change":"2023-10-06T01:41:59.924904+0000","last_active":"2023-10-06T01:41:59.929487+0000","last_peered":"2023-10-06T01:41:59.929487+0000","last_clean":"2023-10-06T01:41:59.929487+0000","last_became_active":"2023-10-06T01:41:59.924621+0000","last_became_peered":"2023-10-06T01:41:59.924621+0000","last_unstale":"2023-10-06T01:41:59.929487+0000","last_undegraded":"2023-10-06T01:41:59.929487+0000","last_fullsized":"2023-10-06T01:41:59.929487+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:47:17.831162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"53'1","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.924111+0000","last_change":"2023-10-06T01:41:58.924804+0000","last_active":"2023-10-06T01:41:59.924111+0000","last_peered":"2023-10-06T01:41:59.924111+0000","last_clean":"2023-10-06T01:41:59.924111+0000","last_became_active":"2023-10-06T01:41:58.924520+0000","last_became_peered":"2023-10-06T01:41:58.924520+0000","last_unstale":"2023-10-06T01:41:59.924111+0000","last_undegraded":"2023-10-06T01:41:59.924111+0000","last_fullsized":"2023-10-06T01:41:59.924111+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:45:24.296902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.935876+0000","last_change":"2023-10-06T01:41:59.931503+0000","last_active":"2023-10-06T01:41:59.935876+0000","last_peered":"2023-10-06T01:41:59.935876+0000","last_clean":"2023-10-06T01:41:59.935876+0000","last_became_active":"2023-10-06T01:41:59.931276+0000","last_became_peered":"2023-10-06T01:41:59.931276+0000","last_unstale":"2023-10-06T01:41:59.935876+0000","last_undegraded":"2023-10-06T01:41:59.935876+0000","last_fullsized":"2023-10-06T01:41:59.935876+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:08.078701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"53'2","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.927074+0000","last_change":"2023-10-06T01:41:58.923283+0000","last_active":"2023-10-06T01:41:59.927074+0000","last_peered":"2023-10-06T01:41:59.927074+0000","last_clean":"2023-10-06T01:41:59.927074+0000","last_became_active":"2023-10-06T01:41:58.921507+0000","last_became_peered":"2023-10-06T01:41:58.921507+0000","last_unstale":"2023-10-06T01:41:59.927074+0000","last_undegraded":"2023-10-06T01:41:59.927074+0000","last_fullsized":"2023-10-06T01:41:59.927074+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:18:08.744663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.930455+0000","last_change":"2023-10-06T01:41:59.922965+0000","last_active":"2023-10-06T01:41:59.930455+0000","last_peered":"2023-10-06T01:41:59.930455+0000","last_clean":"2023-10-06T01:41:59.930455+0000","last_became_active":"2023-10-06T01:41:59.922709+0000","last_became_peered":"2023-10-06T01:41:59.922709+0000","last_unstale":"2023-10-06T01:41:59.930455+0000","last_undegraded":"2023-10-06T01:41:59.930455+0000","last_fullsized":"2023-10-06T01:41:59.930455+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:07:19.364309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"53'2","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.926888+0000","last_change":"2023-10-06T01:41:58.927325+0000","last_active":"2023-10-06T01:41:59.926888+0000","last_peered":"2023-10-06T01:41:59.926888+0000","last_clean":"2023-10-06T01:41:59.926888+0000","last_became_active":"2023-10-06T01:41:58.927064+0000","last_became_peered":"2023-10-06T01:41:58.927064+0000","last_unstale":"2023-10-06T01:41:59.926888+0000","last_undegraded":"2023-10-06T01:41:59.926888+0000","last_fullsized":"2023-10-06T01:41:59.926888+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:10:11.010664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.927683+0000","last_change":"2023-10-06T01:41:59.917233+0000","last_active":"2023-10-06T01:41:59.927683+0000","last_peered":"2023-10-06T01:41:59.927683+0000","last_clean":"2023-10-06T01:41:59.927683+0000","last_became_active":"2023-10-06T01:41:59.916299+0000","last_became_peered":"2023-10-06T01:41:59.916299+0000","last_unstale":"2023-10-06T01:41:59.927683+0000","last_undegraded":"2023-10-06T01:41:59.927683+0000","last_fullsized":"2023-10-06T01:41:59.927683+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:33:27.039395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"53'1","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.923560+0000","last_change":"2023-10-06T01:41:58.923107+0000","last_active":"2023-10-06T01:41:59.923560+0000","last_peered":"2023-10-06T01:41:59.923560+0000","last_clean":"2023-10-06T01:41:59.923560+0000","last_became_active":"2023-10-06T01:41:58.922594+0000","last_became_peered":"2023-10-06T01:41:58.922594+0000","last_unstale":"2023-10-06T01:41:59.923560+0000","last_undegraded":"2023-10-06T01:41:59.923560+0000","last_fullsized":"2023-10-06T01:41:59.923560+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:45:24.296902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.929937+0000","last_change":"2023-10-06T01:41:59.927056+0000","last_active":"2023-10-06T01:41:59.929937+0000","last_peered":"2023-10-06T01:41:59.929937+0000","last_clean":"2023-10-06T01:41:59.929937+0000","last_became_active":"2023-10-06T01:41:59.926795+0000","last_became_peered":"2023-10-06T01:41:59.926795+0000","last_unstale":"2023-10-06T01:41:59.929937+0000","last_undegraded":"2023-10-06T01:41:59.929937+0000","last_fullsized":"2023-10-06T01:41:59.929937+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:28:23.967941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"53'1","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.931724+0000","last_change":"2023-10-06T01:41:58.925616+0000","last_active":"2023-10-06T01:41:59.931724+0000","last_peered":"2023-10-06T01:41:59.931724+0000","last_clean":"2023-10-06T01:41:59.931724+0000","last_became_active":"2023-10-06T01:41:58.921298+0000","last_became_peered":"2023-10-06T01:41:58.921298+0000","last_unstale":"2023-10-06T01:41:59.931724+0000","last_undegraded":"2023-10-06T01:41:59.931724+0000","last_fullsized":"2023-10-06T01:41:59.931724+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:24:38.810483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.929526+0000","last_change":"2023-10-06T01:41:59.920518+0000","last_active":"2023-10-06T01:41:59.929526+0000","last_peered":"2023-10-06T01:41:59.929526+0000","last_clean":"2023-10-06T01:41:59.929526+0000","last_became_active":"2023-10-06T01:41:59.920258+0000","last_became_peered":"2023-10-06T01:41:59.920258+0000","last_unstale":"2023-10-06T01:41:59.929526+0000","last_undegraded":"2023-10-06T01:41:59.929526+0000","last_fullsized":"2023-10-06T01:41:59.929526+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:40:42.553317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.911650+0000","last_change":"2023-10-06T01:41:58.918654+0000","last_active":"2023-10-06T01:41:59.911650+0000","last_peered":"2023-10-06T01:41:59.911650+0000","last_clean":"2023-10-06T01:41:59.911650+0000","last_became_active":"2023-10-06T01:41:58.916820+0000","last_became_peered":"2023-10-06T01:41:58.916820+0000","last_unstale":"2023-10-06T01:41:59.911650+0000","last_undegraded":"2023-10-06T01:41:59.911650+0000","last_fullsized":"2023-10-06T01:41:59.911650+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:29:10.311250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.927862+0000","last_change":"2023-10-06T01:41:59.920579+0000","last_active":"2023-10-06T01:41:59.927862+0000","last_peered":"2023-10-06T01:41:59.927862+0000","last_clean":"2023-10-06T01:41:59.927862+0000","last_became_active":"2023-10-06T01:41:59.919127+0000","last_became_peered":"2023-10-06T01:41:59.919127+0000","last_unstale":"2023-10-06T01:41:59.927862+0000","last_undegraded":"2023-10-06T01:41:59.927862+0000","last_fullsized":"2023-10-06T01:41:59.927862+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:24:57.562583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.912442+0000","last_change":"2023-10-06T01:41:58.922210+0000","last_active":"2023-10-06T01:41:59.912442+0000","last_peered":"2023-10-06T01:41:59.912442+0000","last_clean":"2023-10-06T01:41:59.912442+0000","last_became_active":"2023-10-06T01:41:58.921962+0000","last_became_peered":"2023-10-06T01:41:58.921962+0000","last_unstale":"2023-10-06T01:41:59.912442+0000","last_undegraded":"2023-10-06T01:41:59.912442+0000","last_fullsized":"2023-10-06T01:41:59.912442+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:24:38.810483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.929612+0000","last_change":"2023-10-06T01:41:59.923787+0000","last_active":"2023-10-06T01:41:59.929612+0000","last_peered":"2023-10-06T01:41:59.929612+0000","last_clean":"2023-10-06T01:41:59.929612+0000","last_became_active":"2023-10-06T01:41:59.923530+0000","last_became_peered":"2023-10-06T01:41:59.923530+0000","last_unstale":"2023-10-06T01:41:59.929612+0000","last_undegraded":"2023-10-06T01:41:59.929612+0000","last_fullsized":"2023-10-06T01:41:59.929612+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:56:51.126033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.912761+0000","last_change":"2023-10-06T01:41:58.928025+0000","last_active":"2023-10-06T01:41:59.912761+0000","last_peered":"2023-10-06T01:41:59.912761+0000","last_clean":"2023-10-06T01:41:59.912761+0000","last_became_active":"2023-10-06T01:41:58.927745+0000","last_became_peered":"2023-10-06T01:41:58.927745+0000","last_unstale":"2023-10-06T01:41:59.912761+0000","last_undegraded":"2023-10-06T01:41:59.912761+0000","last_fullsized":"2023-10-06T01:41:59.912761+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:04:52.797213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.934010+0000","last_change":"2023-10-06T01:41:59.927488+0000","last_active":"2023-10-06T01:41:59.934010+0000","last_peered":"2023-10-06T01:41:59.934010+0000","last_clean":"2023-10-06T01:41:59.934010+0000","last_became_active":"2023-10-06T01:41:59.927154+0000","last_became_peered":"2023-10-06T01:41:59.927154+0000","last_unstale":"2023-10-06T01:41:59.934010+0000","last_undegraded":"2023-10-06T01:41:59.934010+0000","last_fullsized":"2023-10-06T01:41:59.934010+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:03.091506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.908142+0000","last_change":"2023-10-06T01:41:58.923640+0000","last_active":"2023-10-06T01:41:59.908142+0000","last_peered":"2023-10-06T01:41:59.908142+0000","last_clean":"2023-10-06T01:41:59.908142+0000","last_became_active":"2023-10-06T01:41:58.923367+0000","last_became_peered":"2023-10-06T01:41:58.923367+0000","last_unstale":"2023-10-06T01:41:59.908142+0000","last_undegraded":"2023-10-06T01:41:59.908142+0000","last_fullsized":"2023-10-06T01:41:59.908142+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:33:28.414752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.929348+0000","last_change":"2023-10-06T01:41:59.926192+0000","last_active":"2023-10-06T01:41:59.929348+0000","last_peered":"2023-10-06T01:41:59.929348+0000","last_clean":"2023-10-06T01:41:59.929348+0000","last_became_active":"2023-10-06T01:41:59.925952+0000","last_became_peered":"2023-10-06T01:41:59.925952+0000","last_unstale":"2023-10-06T01:41:59.929348+0000","last_undegraded":"2023-10-06T01:41:59.929348+0000","last_fullsized":"2023-10-06T01:41:59.929348+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:29:32.229410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"53'3","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.932854+0000","last_change":"2023-10-06T01:41:58.926296+0000","last_active":"2023-10-06T01:41:59.932854+0000","last_peered":"2023-10-06T01:41:59.932854+0000","last_clean":"2023-10-06T01:41:59.932854+0000","last_became_active":"2023-10-06T01:41:58.926034+0000","last_became_peered":"2023-10-06T01:41:58.926034+0000","last_unstale":"2023-10-06T01:41:59.932854+0000","last_undegraded":"2023-10-06T01:41:59.932854+0000","last_fullsized":"2023-10-06T01:41:59.932854+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:47:16.825984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.934278+0000","last_change":"2023-10-06T01:41:59.930901+0000","last_active":"2023-10-06T01:41:59.934278+0000","last_peered":"2023-10-06T01:41:59.934278+0000","last_clean":"2023-10-06T01:41:59.934278+0000","last_became_active":"2023-10-06T01:41:59.930222+0000","last_became_peered":"2023-10-06T01:41:59.930222+0000","last_unstale":"2023-10-06T01:41:59.934278+0000","last_undegraded":"2023-10-06T01:41:59.934278+0000","last_fullsized":"2023-10-06T01:41:59.934278+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:05:48.629746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"53'6","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.936484+0000","last_change":"2023-10-06T01:41:58.921643+0000","last_active":"2023-10-06T01:41:59.936484+0000","last_peered":"2023-10-06T01:41:59.936484+0000","last_clean":"2023-10-06T01:41:59.936484+0000","last_became_active":"2023-10-06T01:41:58.921169+0000","last_became_peered":"2023-10-06T01:41:58.921169+0000","last_unstale":"2023-10-06T01:41:59.936484+0000","last_undegraded":"2023-10-06T01:41:59.936484+0000","last_fullsized":"2023-10-06T01:41:59.936484+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:02.086327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.921935+0000","last_change":"2023-10-06T01:41:59.918211+0000","last_active":"2023-10-06T01:41:59.921935+0000","last_peered":"2023-10-06T01:41:59.921935+0000","last_clean":"2023-10-06T01:41:59.921935+0000","last_became_active":"2023-10-06T01:41:59.917943+0000","last_became_peered":"2023-10-06T01:41:59.917943+0000","last_unstale":"2023-10-06T01:41:59.921935+0000","last_undegraded":"2023-10-06T01:41:59.921935+0000","last_fullsized":"2023-10-06T01:41:59.921935+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:07:25.175365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"53'2","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.928080+0000","last_change":"2023-10-06T01:41:58.923632+0000","last_active":"2023-10-06T01:41:59.928080+0000","last_peered":"2023-10-06T01:41:59.928080+0000","last_clean":"2023-10-06T01:41:59.928080+0000","last_became_active":"2023-10-06T01:41:58.923405+0000","last_became_peered":"2023-10-06T01:41:58.923405+0000","last_unstale":"2023-10-06T01:41:59.928080+0000","last_undegraded":"2023-10-06T01:41:59.928080+0000","last_fullsized":"2023-10-06T01:41:59.928080+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:07:24.731136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.932775+0000","last_change":"2023-10-06T01:41:59.923071+0000","last_active":"2023-10-06T01:41:59.932775+0000","last_peered":"2023-10-06T01:41:59.932775+0000","last_clean":"2023-10-06T01:41:59.932775+0000","last_became_active":"2023-10-06T01:41:59.922811+0000","last_became_peered":"2023-10-06T01:41:59.922811+0000","last_unstale":"2023-10-06T01:41:59.932775+0000","last_undegraded":"2023-10-06T01:41:59.932775+0000","last_fullsized":"2023-10-06T01:41:59.932775+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:24:39.815662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.908561+0000","last_change":"2023-10-06T01:41:58.924504+0000","last_active":"2023-10-06T01:41:59.908561+0000","last_peered":"2023-10-06T01:41:59.908561+0000","last_clean":"2023-10-06T01:41:59.908561+0000","last_became_active":"2023-10-06T01:41:58.924234+0000","last_became_peered":"2023-10-06T01:41:58.924234+0000","last_unstale":"2023-10-06T01:41:59.908561+0000","last_undegraded":"2023-10-06T01:41:59.908561+0000","last_fullsized":"2023-10-06T01:41:59.908561+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:01:44.568173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.930847+0000","last_change":"2023-10-06T01:41:59.927908+0000","last_active":"2023-10-06T01:41:59.930847+0000","last_peered":"2023-10-06T01:41:59.930847+0000","last_clean":"2023-10-06T01:41:59.930847+0000","last_became_active":"2023-10-06T01:41:59.927614+0000","last_became_peered":"2023-10-06T01:41:59.927614+0000","last_unstale":"2023-10-06T01:41:59.930847+0000","last_undegraded":"2023-10-06T01:41:59.930847+0000","last_fullsized":"2023-10-06T01:41:59.930847+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:38:19.366140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.911544+0000","last_change":"2023-10-06T01:41:58.927423+0000","last_active":"2023-10-06T01:41:59.911544+0000","last_peered":"2023-10-06T01:41:59.911544+0000","last_clean":"2023-10-06T01:41:59.911544+0000","last_became_active":"2023-10-06T01:41:58.927082+0000","last_became_peered":"2023-10-06T01:41:58.927082+0000","last_unstale":"2023-10-06T01:41:59.911544+0000","last_undegraded":"2023-10-06T01:41:59.911544+0000","last_fullsized":"2023-10-06T01:41:59.911544+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:04.780513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.934308+0000","last_change":"2023-10-06T01:41:59.932568+0000","last_active":"2023-10-06T01:41:59.934308+0000","last_peered":"2023-10-06T01:41:59.934308+0000","last_clean":"2023-10-06T01:41:59.934308+0000","last_became_active":"2023-10-06T01:41:59.932187+0000","last_became_peered":"2023-10-06T01:41:59.932187+0000","last_unstale":"2023-10-06T01:41:59.934308+0000","last_undegraded":"2023-10-06T01:41:59.934308+0000","last_fullsized":"2023-10-06T01:41:59.934308+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:43:48.006348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"53'8","reported_seq":18,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.926079+0000","last_change":"2023-10-06T01:41:58.925098+0000","last_active":"2023-10-06T01:41:59.926079+0000","last_peered":"2023-10-06T01:41:59.926079+0000","last_clean":"2023-10-06T01:41:59.926079+0000","last_became_active":"2023-10-06T01:41:58.924857+0000","last_became_peered":"2023-10-06T01:41:58.924857+0000","last_unstale":"2023-10-06T01:41:59.926079+0000","last_undegraded":"2023-10-06T01:41:59.926079+0000","last_fullsized":"2023-10-06T01:41:59.926079+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:33:57.280587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.919480+0000","last_change":"2023-10-06T01:41:59.917248+0000","last_active":"2023-10-06T01:41:59.919480+0000","last_peered":"2023-10-06T01:41:59.919480+0000","last_clean":"2023-10-06T01:41:59.919480+0000","last_became_active":"2023-10-06T01:41:59.916977+0000","last_became_peered":"2023-10-06T01:41:59.916977+0000","last_unstale":"2023-10-06T01:41:59.919480+0000","last_undegraded":"2023-10-06T01:41:59.919480+0000","last_fullsized":"2023-10-06T01:41:59.919480+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:41:15.451811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"53'2","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.917779+0000","last_change":"2023-10-06T01:41:58.919223+0000","last_active":"2023-10-06T01:41:59.917779+0000","last_peered":"2023-10-06T01:41:59.917779+0000","last_clean":"2023-10-06T01:41:59.917779+0000","last_became_active":"2023-10-06T01:41:58.918835+0000","last_became_peered":"2023-10-06T01:41:58.918835+0000","last_unstale":"2023-10-06T01:41:59.917779+0000","last_undegraded":"2023-10-06T01:41:59.917779+0000","last_fullsized":"2023-10-06T01:41:59.917779+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:21:25.598775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.929947+0000","last_change":"2023-10-06T01:41:59.926743+0000","last_active":"2023-10-06T01:41:59.929947+0000","last_peered":"2023-10-06T01:41:59.929947+0000","last_clean":"2023-10-06T01:41:59.929947+0000","last_became_active":"2023-10-06T01:41:59.926475+0000","last_became_peered":"2023-10-06T01:41:59.926475+0000","last_unstale":"2023-10-06T01:41:59.929947+0000","last_undegraded":"2023-10-06T01:41:59.929947+0000","last_fullsized":"2023-10-06T01:41:59.929947+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:49:48.083851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"54'1","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T01:42:01.294427+0000","last_change":"2023-10-06T01:41:58.922702+0000","last_active":"2023-10-06T01:42:01.294427+0000","last_peered":"2023-10-06T01:42:01.294427+0000","last_clean":"2023-10-06T01:42:01.294427+0000","last_became_active":"2023-10-06T01:41:58.922346+0000","last_became_peered":"2023-10-06T01:41:58.922346+0000","last_unstale":"2023-10-06T01:42:01.294427+0000","last_undegraded":"2023-10-06T01:42:01.294427+0000","last_fullsized":"2023-10-06T01:42:01.294427+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:45:24.296902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.929329+0000","last_change":"2023-10-06T01:41:59.926045+0000","last_active":"2023-10-06T01:41:59.929329+0000","last_peered":"2023-10-06T01:41:59.929329+0000","last_clean":"2023-10-06T01:41:59.929329+0000","last_became_active":"2023-10-06T01:41:59.925804+0000","last_became_peered":"2023-10-06T01:41:59.925804+0000","last_unstale":"2023-10-06T01:41:59.929329+0000","last_undegraded":"2023-10-06T01:41:59.929329+0000","last_fullsized":"2023-10-06T01:41:59.929329+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:14:29.633116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.906684+0000","last_change":"2023-10-06T01:41:58.912477+0000","last_active":"2023-10-06T01:41:59.906684+0000","last_peered":"2023-10-06T01:41:59.906684+0000","last_clean":"2023-10-06T01:41:59.906684+0000","last_became_active":"2023-10-06T01:41:58.912169+0000","last_became_peered":"2023-10-06T01:41:58.912169+0000","last_unstale":"2023-10-06T01:41:59.906684+0000","last_undegraded":"2023-10-06T01:41:59.906684+0000","last_fullsized":"2023-10-06T01:41:59.906684+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:05:03.593533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.930473+0000","last_change":"2023-10-06T01:41:59.923227+0000","last_active":"2023-10-06T01:41:59.930473+0000","last_peered":"2023-10-06T01:41:59.930473+0000","last_clean":"2023-10-06T01:41:59.930473+0000","last_became_active":"2023-10-06T01:41:59.922959+0000","last_became_peered":"2023-10-06T01:41:59.922959+0000","last_unstale":"2023-10-06T01:41:59.930473+0000","last_undegraded":"2023-10-06T01:41:59.930473+0000","last_fullsized":"2023-10-06T01:41:59.930473+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:45:31.777277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.913128+0000","last_change":"2023-10-06T01:41:58.922312+0000","last_active":"2023-10-06T01:41:59.913128+0000","last_peered":"2023-10-06T01:41:59.913128+0000","last_clean":"2023-10-06T01:41:59.913128+0000","last_became_active":"2023-10-06T01:41:58.922064+0000","last_became_peered":"2023-10-06T01:41:58.922064+0000","last_unstale":"2023-10-06T01:41:59.913128+0000","last_undegraded":"2023-10-06T01:41:59.913128+0000","last_fullsized":"2023-10-06T01:41:59.913128+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:51:27.641984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.922007+0000","last_change":"2023-10-06T01:41:59.914243+0000","last_active":"2023-10-06T01:41:59.922007+0000","last_peered":"2023-10-06T01:41:59.922007+0000","last_clean":"2023-10-06T01:41:59.922007+0000","last_became_active":"2023-10-06T01:41:59.914009+0000","last_became_peered":"2023-10-06T01:41:59.914009+0000","last_unstale":"2023-10-06T01:41:59.922007+0000","last_undegraded":"2023-10-06T01:41:59.922007+0000","last_fullsized":"2023-10-06T01:41:59.922007+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:16:49.114729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.904614+0000","last_change":"2023-10-06T01:41:58.917481+0000","last_active":"2023-10-06T01:41:59.904614+0000","last_peered":"2023-10-06T01:41:59.904614+0000","last_clean":"2023-10-06T01:41:59.904614+0000","last_became_active":"2023-10-06T01:41:58.917211+0000","last_became_peered":"2023-10-06T01:41:58.917211+0000","last_unstale":"2023-10-06T01:41:59.904614+0000","last_undegraded":"2023-10-06T01:41:59.904614+0000","last_fullsized":"2023-10-06T01:41:59.904614+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:21:12.405145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.934166+0000","last_change":"2023-10-06T01:41:59.932298+0000","last_active":"2023-10-06T01:41:59.934166+0000","last_peered":"2023-10-06T01:41:59.934166+0000","last_clean":"2023-10-06T01:41:59.934166+0000","last_became_active":"2023-10-06T01:41:59.932063+0000","last_became_peered":"2023-10-06T01:41:59.932063+0000","last_unstale":"2023-10-06T01:41:59.934166+0000","last_undegraded":"2023-10-06T01:41:59.934166+0000","last_fullsized":"2023-10-06T01:41:59.934166+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:18:09.749842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.913765+0000","last_change":"2023-10-06T01:41:58.920213+0000","last_active":"2023-10-06T01:41:59.913765+0000","last_peered":"2023-10-06T01:41:59.913765+0000","last_clean":"2023-10-06T01:41:59.913765+0000","last_became_active":"2023-10-06T01:41:58.919959+0000","last_became_peered":"2023-10-06T01:41:58.919959+0000","last_unstale":"2023-10-06T01:41:59.913765+0000","last_undegraded":"2023-10-06T01:41:59.913765+0000","last_fullsized":"2023-10-06T01:41:59.913765+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:03:29.295425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.911536+0000","last_change":"2023-10-06T01:41:59.909458+0000","last_active":"2023-10-06T01:41:59.911536+0000","last_peered":"2023-10-06T01:41:59.911536+0000","last_clean":"2023-10-06T01:41:59.911536+0000","last_became_active":"2023-10-06T01:41:59.909209+0000","last_became_peered":"2023-10-06T01:41:59.909209+0000","last_unstale":"2023-10-06T01:41:59.911536+0000","last_undegraded":"2023-10-06T01:41:59.911536+0000","last_fullsized":"2023-10-06T01:41:59.911536+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:40:42.553317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.904596+0000","last_change":"2023-10-06T01:41:58.922092+0000","last_active":"2023-10-06T01:41:59.904596+0000","last_peered":"2023-10-06T01:41:59.904596+0000","last_clean":"2023-10-06T01:41:59.904596+0000","last_became_active":"2023-10-06T01:41:58.921857+0000","last_became_peered":"2023-10-06T01:41:58.921857+0000","last_unstale":"2023-10-06T01:41:59.904596+0000","last_undegraded":"2023-10-06T01:41:59.904596+0000","last_fullsized":"2023-10-06T01:41:59.904596+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:25:35.328771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.929945+0000","last_change":"2023-10-06T01:41:59.920941+0000","last_active":"2023-10-06T01:41:59.929945+0000","last_peered":"2023-10-06T01:41:59.929945+0000","last_clean":"2023-10-06T01:41:59.929945+0000","last_became_active":"2023-10-06T01:41:59.920261+0000","last_became_peered":"2023-10-06T01:41:59.920261+0000","last_unstale":"2023-10-06T01:41:59.929945+0000","last_undegraded":"2023-10-06T01:41:59.929945+0000","last_fullsized":"2023-10-06T01:41:59.929945+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:46:55.042870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.907622+0000","last_change":"2023-10-06T01:41:58.917439+0000","last_active":"2023-10-06T01:41:59.907622+0000","last_peered":"2023-10-06T01:41:59.907622+0000","last_clean":"2023-10-06T01:41:59.907622+0000","last_became_active":"2023-10-06T01:41:58.917205+0000","last_became_peered":"2023-10-06T01:41:58.917205+0000","last_unstale":"2023-10-06T01:41:59.907622+0000","last_undegraded":"2023-10-06T01:41:59.907622+0000","last_fullsized":"2023-10-06T01:41:59.907622+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:24:38.810483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.929966+0000","last_change":"2023-10-06T01:41:59.926557+0000","last_active":"2023-10-06T01:41:59.929966+0000","last_peered":"2023-10-06T01:41:59.929966+0000","last_clean":"2023-10-06T01:41:59.929966+0000","last_became_active":"2023-10-06T01:41:59.926287+0000","last_became_peered":"2023-10-06T01:41:59.926287+0000","last_unstale":"2023-10-06T01:41:59.929966+0000","last_undegraded":"2023-10-06T01:41:59.929966+0000","last_fullsized":"2023-10-06T01:41:59.929966+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:24:01.329759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"53'2","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.929236+0000","last_change":"2023-10-06T01:41:58.925582+0000","last_active":"2023-10-06T01:41:59.929236+0000","last_peered":"2023-10-06T01:41:59.929236+0000","last_clean":"2023-10-06T01:41:59.929236+0000","last_became_active":"2023-10-06T01:41:58.923189+0000","last_became_peered":"2023-10-06T01:41:58.923189+0000","last_unstale":"2023-10-06T01:41:59.929236+0000","last_undegraded":"2023-10-06T01:41:59.929236+0000","last_fullsized":"2023-10-06T01:41:59.929236+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:03:29.295425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":40,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.905453+0000","last_change":"2023-10-06T01:40:16.930992+0000","last_active":"2023-10-06T01:41:59.905453+0000","last_peered":"2023-10-06T01:41:59.905453+0000","last_clean":"2023-10-06T01:41:59.905453+0000","last_became_active":"2023-10-06T01:40:16.930707+0000","last_became_peered":"2023-10-06T01:40:16.930707+0000","last_unstale":"2023-10-06T01:41:59.905453+0000","last_undegraded":"2023-10-06T01:41:59.905453+0000","last_fullsized":"2023-10-06T01:41:59.905453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:52:43.316071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.930150+0000","last_change":"2023-10-06T01:41:59.927285+0000","last_active":"2023-10-06T01:41:59.930150+0000","last_peered":"2023-10-06T01:41:59.930150+0000","last_clean":"2023-10-06T01:41:59.930150+0000","last_became_active":"2023-10-06T01:41:59.927007+0000","last_became_peered":"2023-10-06T01:41:59.927007+0000","last_unstale":"2023-10-06T01:41:59.930150+0000","last_undegraded":"2023-10-06T01:41:59.930150+0000","last_fullsized":"2023-10-06T01:41:59.930150+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:30:18.755143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.911795+0000","last_change":"2023-10-06T01:41:58.922335+0000","last_active":"2023-10-06T01:41:59.911795+0000","last_peered":"2023-10-06T01:41:59.911795+0000","last_clean":"2023-10-06T01:41:59.911795+0000","last_became_active":"2023-10-06T01:41:58.922038+0000","last_became_peered":"2023-10-06T01:41:58.922038+0000","last_unstale":"2023-10-06T01:41:59.911795+0000","last_undegraded":"2023-10-06T01:41:59.911795+0000","last_fullsized":"2023-10-06T01:41:59.911795+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:58:36.151365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":40,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.911754+0000","last_change":"2023-10-06T01:40:16.651019+0000","last_active":"2023-10-06T01:41:59.911754+0000","last_peered":"2023-10-06T01:41:59.911754+0000","last_clean":"2023-10-06T01:41:59.911754+0000","last_became_active":"2023-10-06T01:40:16.650628+0000","last_became_peered":"2023-10-06T01:40:16.650628+0000","last_unstale":"2023-10-06T01:41:59.911754+0000","last_undegraded":"2023-10-06T01:41:59.911754+0000","last_fullsized":"2023-10-06T01:41:59.911754+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:11:57.218984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.921909+0000","last_change":"2023-10-06T01:41:59.918092+0000","last_active":"2023-10-06T01:41:59.921909+0000","last_peered":"2023-10-06T01:41:59.921909+0000","last_clean":"2023-10-06T01:41:59.921909+0000","last_became_active":"2023-10-06T01:41:59.917798+0000","last_became_peered":"2023-10-06T01:41:59.917798+0000","last_unstale":"2023-10-06T01:41:59.921909+0000","last_undegraded":"2023-10-06T01:41:59.921909+0000","last_fullsized":"2023-10-06T01:41:59.921909+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:07:25.736314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"53'2","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.927936+0000","last_change":"2023-10-06T01:41:58.918081+0000","last_active":"2023-10-06T01:41:59.927936+0000","last_peered":"2023-10-06T01:41:59.927936+0000","last_clean":"2023-10-06T01:41:59.927936+0000","last_became_active":"2023-10-06T01:41:58.912873+0000","last_became_peered":"2023-10-06T01:41:58.912873+0000","last_unstale":"2023-10-06T01:41:59.927936+0000","last_undegraded":"2023-10-06T01:41:59.927936+0000","last_fullsized":"2023-10-06T01:41:59.927936+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:03:29.295425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":39,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.910695+0000","last_change":"2023-10-06T01:40:16.781596+0000","last_active":"2023-10-06T01:41:59.910695+0000","last_peered":"2023-10-06T01:41:59.910695+0000","last_clean":"2023-10-06T01:41:59.910695+0000","last_became_active":"2023-10-06T01:40:16.781352+0000","last_became_peered":"2023-10-06T01:40:16.781352+0000","last_unstale":"2023-10-06T01:41:59.910695+0000","last_undegraded":"2023-10-06T01:41:59.910695+0000","last_fullsized":"2023-10-06T01:41:59.910695+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:52:43.316071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.927383+0000","last_change":"2023-10-06T01:41:59.917119+0000","last_active":"2023-10-06T01:41:59.927383+0000","last_peered":"2023-10-06T01:41:59.927383+0000","last_clean":"2023-10-06T01:41:59.927383+0000","last_became_active":"2023-10-06T01:41:59.915854+0000","last_became_peered":"2023-10-06T01:41:59.915854+0000","last_unstale":"2023-10-06T01:41:59.927383+0000","last_undegraded":"2023-10-06T01:41:59.927383+0000","last_fullsized":"2023-10-06T01:41:59.927383+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:01:49.563771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.907271+0000","last_change":"2023-10-06T01:41:58.923132+0000","last_active":"2023-10-06T01:41:59.907271+0000","last_peered":"2023-10-06T01:41:59.907271+0000","last_clean":"2023-10-06T01:41:59.907271+0000","last_became_active":"2023-10-06T01:41:58.922860+0000","last_became_peered":"2023-10-06T01:41:58.922860+0000","last_unstale":"2023-10-06T01:41:59.907271+0000","last_undegraded":"2023-10-06T01:41:59.907271+0000","last_fullsized":"2023-10-06T01:41:59.907271+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:24:20.800050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":40,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.911629+0000","last_change":"2023-10-06T01:40:16.650826+0000","last_active":"2023-10-06T01:41:59.911629+0000","last_peered":"2023-10-06T01:41:59.911629+0000","last_clean":"2023-10-06T01:41:59.911629+0000","last_became_active":"2023-10-06T01:40:16.650469+0000","last_became_peered":"2023-10-06T01:40:16.650469+0000","last_unstale":"2023-10-06T01:41:59.911629+0000","last_undegraded":"2023-10-06T01:41:59.911629+0000","last_fullsized":"2023-10-06T01:41:59.911629+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:50:23.628212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":192,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.910822+0000","last_change":"2023-10-06T01:40:10.645512+0000","last_active":"2023-10-06T01:41:59.910822+0000","last_peered":"2023-10-06T01:41:59.910822+0000","last_clean":"2023-10-06T01:41:59.910822+0000","last_became_active":"2023-10-06T01:40:10.644601+0000","last_became_peered":"2023-10-06T01:40:10.644601+0000","last_unstale":"2023-10-06T01:41:59.910822+0000","last_undegraded":"2023-10-06T01:41:59.910822+0000","last_fullsized":"2023-10-06T01:41:59.910822+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:09.580865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:09.580865+0000","last_clean_scrub_stamp":"2023-10-06T01:40:09.580865+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:05:28.268591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.930194+0000","last_change":"2023-10-06T01:41:59.927385+0000","last_active":"2023-10-06T01:41:59.930194+0000","last_peered":"2023-10-06T01:41:59.930194+0000","last_clean":"2023-10-06T01:41:59.930194+0000","last_became_active":"2023-10-06T01:41:59.926980+0000","last_became_peered":"2023-10-06T01:41:59.926980+0000","last_unstale":"2023-10-06T01:41:59.930194+0000","last_undegraded":"2023-10-06T01:41:59.930194+0000","last_fullsized":"2023-10-06T01:41:59.930194+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:46:55.042870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.904596+0000","last_change":"2023-10-06T01:41:58.920513+0000","last_active":"2023-10-06T01:41:59.904596+0000","last_peered":"2023-10-06T01:41:59.904596+0000","last_clean":"2023-10-06T01:41:59.904596+0000","last_became_active":"2023-10-06T01:41:58.920202+0000","last_became_peered":"2023-10-06T01:41:58.920202+0000","last_unstale":"2023-10-06T01:41:59.904596+0000","last_undegraded":"2023-10-06T01:41:59.904596+0000","last_fullsized":"2023-10-06T01:41:59.904596+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:53:53.773734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":39,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.913027+0000","last_change":"2023-10-06T01:40:16.651332+0000","last_active":"2023-10-06T01:41:59.913027+0000","last_peered":"2023-10-06T01:41:59.913027+0000","last_clean":"2023-10-06T01:41:59.913027+0000","last_became_active":"2023-10-06T01:40:16.651049+0000","last_became_peered":"2023-10-06T01:40:16.651049+0000","last_unstale":"2023-10-06T01:41:59.913027+0000","last_undegraded":"2023-10-06T01:41:59.913027+0000","last_fullsized":"2023-10-06T01:41:59.913027+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:11:57.218984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.934094+0000","last_change":"2023-10-06T01:41:59.927274+0000","last_active":"2023-10-06T01:41:59.934094+0000","last_peered":"2023-10-06T01:41:59.934094+0000","last_clean":"2023-10-06T01:41:59.934094+0000","last_became_active":"2023-10-06T01:41:59.926995+0000","last_became_peered":"2023-10-06T01:41:59.926995+0000","last_unstale":"2023-10-06T01:41:59.934094+0000","last_undegraded":"2023-10-06T01:41:59.934094+0000","last_fullsized":"2023-10-06T01:41:59.934094+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:41:15.451811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"53'1","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.927945+0000","last_change":"2023-10-06T01:41:58.923811+0000","last_active":"2023-10-06T01:41:59.927945+0000","last_peered":"2023-10-06T01:41:59.927945+0000","last_clean":"2023-10-06T01:41:59.927945+0000","last_became_active":"2023-10-06T01:41:58.923398+0000","last_became_peered":"2023-10-06T01:41:58.923398+0000","last_unstale":"2023-10-06T01:41:59.927945+0000","last_undegraded":"2023-10-06T01:41:59.927945+0000","last_fullsized":"2023-10-06T01:41:59.927945+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:01:32.487705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":39,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.915576+0000","last_change":"2023-10-06T01:40:16.931106+0000","last_active":"2023-10-06T01:41:59.915576+0000","last_peered":"2023-10-06T01:41:59.915576+0000","last_clean":"2023-10-06T01:41:59.915576+0000","last_became_active":"2023-10-06T01:40:16.930830+0000","last_became_peered":"2023-10-06T01:40:16.930830+0000","last_unstale":"2023-10-06T01:41:59.915576+0000","last_undegraded":"2023-10-06T01:41:59.915576+0000","last_fullsized":"2023-10-06T01:41:59.915576+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:50:23.628212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.934292+0000","last_change":"2023-10-06T01:41:59.931026+0000","last_active":"2023-10-06T01:41:59.934292+0000","last_peered":"2023-10-06T01:41:59.934292+0000","last_clean":"2023-10-06T01:41:59.934292+0000","last_became_active":"2023-10-06T01:41:59.930478+0000","last_became_peered":"2023-10-06T01:41:59.930478+0000","last_unstale":"2023-10-06T01:41:59.934292+0000","last_undegraded":"2023-10-06T01:41:59.934292+0000","last_fullsized":"2023-10-06T01:41:59.934292+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:07:25.736314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.923186+0000","last_change":"2023-10-06T01:41:58.923417+0000","last_active":"2023-10-06T01:41:59.923186+0000","last_peered":"2023-10-06T01:41:59.923186+0000","last_clean":"2023-10-06T01:41:59.923186+0000","last_became_active":"2023-10-06T01:41:58.922483+0000","last_became_peered":"2023-10-06T01:41:58.922483+0000","last_unstale":"2023-10-06T01:41:59.923186+0000","last_undegraded":"2023-10-06T01:41:59.923186+0000","last_fullsized":"2023-10-06T01:41:59.923186+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:07:24.731136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":40,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.904999+0000","last_change":"2023-10-06T01:40:16.649379+0000","last_active":"2023-10-06T01:41:59.904999+0000","last_peered":"2023-10-06T01:41:59.904999+0000","last_clean":"2023-10-06T01:41:59.904999+0000","last_became_active":"2023-10-06T01:40:16.649147+0000","last_became_peered":"2023-10-06T01:40:16.649147+0000","last_unstale":"2023-10-06T01:41:59.904999+0000","last_undegraded":"2023-10-06T01:41:59.904999+0000","last_fullsized":"2023-10-06T01:41:59.904999+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:11:57.218984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.929827+0000","last_change":"2023-10-06T01:41:59.928829+0000","last_active":"2023-10-06T01:41:59.929827+0000","last_peered":"2023-10-06T01:41:59.929827+0000","last_clean":"2023-10-06T01:41:59.929827+0000","last_became_active":"2023-10-06T01:41:59.928576+0000","last_became_peered":"2023-10-06T01:41:59.928576+0000","last_unstale":"2023-10-06T01:41:59.929827+0000","last_undegraded":"2023-10-06T01:41:59.929827+0000","last_fullsized":"2023-10-06T01:41:59.929827+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:18:41.923790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"53'1","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.926239+0000","last_change":"2023-10-06T01:41:58.926962+0000","last_active":"2023-10-06T01:41:59.926239+0000","last_peered":"2023-10-06T01:41:59.926239+0000","last_clean":"2023-10-06T01:41:59.926239+0000","last_became_active":"2023-10-06T01:41:58.926758+0000","last_became_peered":"2023-10-06T01:41:58.926758+0000","last_unstale":"2023-10-06T01:41:59.926239+0000","last_undegraded":"2023-10-06T01:41:59.926239+0000","last_fullsized":"2023-10-06T01:41:59.926239+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:58:35.816250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":41,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.907510+0000","last_change":"2023-10-06T01:40:16.651477+0000","last_active":"2023-10-06T01:41:59.907510+0000","last_peered":"2023-10-06T01:41:59.907510+0000","last_clean":"2023-10-06T01:41:59.907510+0000","last_became_active":"2023-10-06T01:40:16.651190+0000","last_became_peered":"2023-10-06T01:40:16.651190+0000","last_unstale":"2023-10-06T01:41:59.907510+0000","last_undegraded":"2023-10-06T01:41:59.907510+0000","last_fullsized":"2023-10-06T01:41:59.907510+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:45:47.422876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574875,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298504,"kb_used_data":1216,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073336,"statfs":{"total":96636764160,"available":96331096064,"internally_reserved":0,"allocated":1245184,"data_stored":886499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:41:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":3.6920000000000002,"5min":3.6920000000000002,"15min":3.6920000000000002},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":3.629,"5min":3.629,"15min":3.629},"last":0.40400000000000003}]},{"osd":1,"last update":"Fri Oct 6 01:41:11 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":10.029999999999999,"5min":10.029999999999999,"15min":10.029999999999999},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.544,"5min":1.544,"15min":1.544},"last":0.53400000000000003}]},{"osd":2,"last update":"Fri Oct 6 01:41:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.54900000000000004},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":10.710000000000001,"5min":10.710000000000001,"15min":10.710000000000001},"last":0.46700000000000003}]},{"osd":3,"last update":"Fri Oct 6 01:41:11 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.437},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":3.6509999999999998,"5min":3.6509999999999998,"15min":3.6509999999999998},"last":0.51900000000000002}]},{"osd":4,"last update":"Fri Oct 6 01:41:11 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.49299999999999999}]},{"osd":5,"last update":"Fri Oct 6 01:41:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.7509999999999999,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":0.47899999999999998}]},{"osd":6,"last update":"Fri Oct 6 01:41:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.9370000000000001,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.57699999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574875,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297916,"kb_used_data":628,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073924,"statfs":{"total":96636764160,"available":96331698176,"internally_reserved":0,"allocated":643072,"data_stored":295971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.621}]},{"osd":1,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.48599999999999999}]},{"osd":2,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.441},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.65300000000000002}]},{"osd":3,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.51100000000000001}]},{"osd":4,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.67500000000000004}]},{"osd":5,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.57399999999999995}]},{"osd":7,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.56399999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574875,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297920,"kb_used_data":632,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073920,"statfs":{"total":96636764160,"available":96331694080,"internally_reserved":0,"allocated":647168,"data_stored":296061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.997,"15min":0.997},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":11.957000000000001,"5min":11.957000000000001,"15min":11.957000000000001},"last":0.253},{"interface":"front","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":11.917,"5min":11.917,"15min":11.917},"last":0.28999999999999998}]},{"osd":2,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.33200000000000002}]},{"osd":3,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":6.2450000000000001,"5min":6.2450000000000001,"15min":6.2450000000000001},"last":0.308},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":6.2939999999999996,"5min":6.2939999999999996,"15min":6.2939999999999996},"last":0.32200000000000001}]},{"osd":4,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":6.1669999999999998,"5min":6.1669999999999998,"15min":6.1669999999999998},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.45000000000000001}]},{"osd":5,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":6.2619999999999996,"5min":6.2619999999999996,"15min":6.2619999999999996},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":6.2350000000000003,"5min":6.2350000000000003,"15min":6.2350000000000003},"last":0.48999999999999999}]},{"osd":6,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":6.141,"5min":6.141,"15min":6.141},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":6.2069999999999999,"5min":6.2069999999999999,"15min":6.2069999999999999},"last":0.50700000000000001}]},{"osd":7,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":6.1040000000000001,"5min":6.1040000000000001,"15min":6.1040000000000001},"last":0.497}]}]},{"osd":0,"up_from":13,"seq":55834574875,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298508,"kb_used_data":1220,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073332,"statfs":{"total":96636764160,"available":96331091968,"internally_reserved":0,"allocated":1249280,"data_stored":887468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":3.9129999999999998,"5min":3.9129999999999998,"15min":3.9129999999999998},"last":0.36499999999999999}]},{"osd":2,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":15.237,"5min":15.237,"15min":15.237},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":3.7959999999999998,"5min":3.7959999999999998,"15min":3.7959999999999998},"last":0.441}]},{"osd":3,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":5.2850000000000001,"5min":5.2850000000000001,"15min":5.2850000000000001},"last":0.34899999999999998},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":15.263,"5min":15.263,"15min":15.263},"last":0.51200000000000001}]},{"osd":4,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":5.2590000000000003,"5min":5.2590000000000003,"15min":5.2590000000000003},"last":0.57099999999999995},{"interface":"front","average":{"1min":1.242,"5min":1.242,"15min":1.242},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":15.211,"5min":15.211,"15min":15.211},"last":0.54700000000000004}]},{"osd":5,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":3.8839999999999999,"5min":3.8839999999999999,"15min":3.8839999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":5.2309999999999999,"5min":5.2309999999999999,"15min":5.2309999999999999},"last":0.53200000000000003}]},{"osd":6,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.212,"15min":1.212},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":15.175000000000001,"5min":15.175000000000001,"15min":15.175000000000001},"last":0.628},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":3.859,"5min":3.859,"15min":3.859},"last":0.58199999999999996}]},{"osd":7,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":3.831,"5min":3.831,"15min":3.831},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":5.1959999999999997,"5min":5.1959999999999997,"15min":5.1959999999999997},"last":0.59199999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574875,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297924,"kb_used_data":636,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073916,"statfs":{"total":96636764160,"available":96331689984,"internally_reserved":0,"allocated":651264,"data_stored":296027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"last":0.46200000000000002}]},{"osd":1,"last update":"Fri Oct 6 01:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.311,"15min":0.311},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"last":0.374},{"interface":"front","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.49199999999999999}]},{"osd":3,"last update":"Fri Oct 6 01:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.432}]},{"osd":4,"last update":"Fri Oct 6 01:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.60499999999999998}]},{"osd":5,"last update":"Fri Oct 6 01:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.55400000000000005}]},{"osd":6,"last update":"Fri Oct 6 01:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.54300000000000004}]},{"osd":7,"last update":"Fri Oct 6 01:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.63600000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574875,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297924,"kb_used_data":636,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073916,"statfs":{"total":96636764160,"available":96331689984,"internally_reserved":0,"allocated":651264,"data_stored":296027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.29799999999999999}]},{"osd":1,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.23599999999999999},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.35999999999999999}]},{"osd":2,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.316},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.38700000000000001}]},{"osd":4,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.48099999999999998}]},{"osd":5,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.49099999999999999}]},{"osd":6,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.46700000000000003}]},{"osd":7,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.437},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.503}]}]},{"osd":4,"up_from":13,"seq":55834574875,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297928,"kb_used_data":640,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073912,"statfs":{"total":96636764160,"available":96331685888,"internally_reserved":0,"allocated":655360,"data_stored":297507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.54900000000000004}]},{"osd":1,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":4.0780000000000003,"5min":4.0780000000000003,"15min":4.0780000000000003},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":4.1050000000000004,"5min":4.1050000000000004,"15min":4.1050000000000004},"last":0.57999999999999996}]},{"osd":2,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.52700000000000002}]},{"osd":3,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.64400000000000002}]},{"osd":5,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.437,"15min":0.437},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.621},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.63200000000000001}]},{"osd":6,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.65800000000000003}]},{"osd":7,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.67600000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574875,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297924,"kb_used_data":636,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073916,"statfs":{"total":96636764160,"available":96331689984,"internally_reserved":0,"allocated":651264,"data_stored":296595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.52200000000000002}]},{"osd":1,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.622},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.59899999999999998}]},{"osd":2,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.6970000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.54700000000000004}]},{"osd":3,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.58699999999999997}]},{"osd":4,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.41799999999999998}]},{"osd":6,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.437},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.45700000000000002}]},{"osd":7,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.821,"5min":1.821,"15min":1.821},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.50600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T01:42:08.483 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T01:42:08.610 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.609+0000 7f50bdb86700 1 Processor -- start 2023-10-06T01:42:08.610 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.609+0000 7f50bdb86700 1 -- start start 2023-10-06T01:42:08.612 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.610+0000 7f50bdb86700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f50b815a5d0 0x7f50b80b1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:08.612 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.610+0000 7f50bdb86700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f50b806efc0 0x7f50b80c8e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:08.612 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.610+0000 7f50bdb86700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50b806eb30 con 0x7f50b815a9a0 2023-10-06T01:42:08.612 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.610+0000 7f50bdb86700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50b80c9760 con 0x7f50b815a5d0 2023-10-06T01:42:08.612 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.610+0000 7f50bdb86700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50b80c9480 con 0x7f50b806efc0 2023-10-06T01:42:08.612 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.610+0000 7f50b77fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f50b815a5d0 0x7f50b80b1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:08.613 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.610+0000 7f50b77fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f50b815a5d0 0x7f50b80b1040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38102/0 (socket says 172.21.15.71:38102) 2023-10-06T01:42:08.613 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.610+0000 7f50b77fe700 1 -- 172.21.15.71:0/1890126579 learned_addr learned my addr 172.21.15.71:0/1890126579 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:08.613 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.610+0000 7f50b7fff700 1 --2- 172.21.15.71:0/1890126579 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f50b806efc0 0x7f50b80c8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:08.613 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.610+0000 7f50b77fe700 1 -- 172.21.15.71:0/1890126579 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f50b806efc0 msgr2=0x7f50b80c8e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:08.613 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.610+0000 7f50b77fe700 1 --2- 172.21.15.71:0/1890126579 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f50b806efc0 0x7f50b80c8e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:08.613 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.610+0000 7f50b77fe700 1 -- 172.21.15.71:0/1890126579 >> v1:172.21.15.72:6789/0 conn(0x7f50b815a9a0 legacy=0x7f50b80c8770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:08.613 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.610+0000 7f50b77fe700 1 -- 172.21.15.71:0/1890126579 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50b806e4e0 con 0x7f50b815a5d0 2023-10-06T01:42:08.613 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.610+0000 7f50b77fe700 1 --2- 172.21.15.71:0/1890126579 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f50b815a5d0 0x7f50b80b1040 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f50a80099b0 tx=0x7f50a8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6282a241d2cc18b9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:08.613 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.610+0000 7f50b67fc700 1 -- 172.21.15.71:0/1890126579 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a800b820 con 0x7f50b815a5d0 2023-10-06T01:42:08.613 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.610+0000 7f50b67fc700 1 -- 172.21.15.71:0/1890126579 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50a800b980 con 0x7f50b815a5d0 2023-10-06T01:42:08.613 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.610+0000 7f50b67fc700 1 -- 172.21.15.71:0/1890126579 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a800bd20 con 0x7f50b815a5d0 2023-10-06T01:42:08.613 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.611+0000 7f50bdb86700 1 -- 172.21.15.71:0/1890126579 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f50b815a5d0 msgr2=0x7f50b80b1040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:08.614 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.611+0000 7f50bdb86700 1 --2- 172.21.15.71:0/1890126579 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f50b815a5d0 0x7f50b80b1040 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f50a80099b0 tx=0x7f50a8009250 comp rx=0 tx=0).stop 2023-10-06T01:42:08.614 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.611+0000 7f50bdb86700 1 -- 172.21.15.71:0/1890126579 shutdown_connections 2023-10-06T01:42:08.614 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.611+0000 7f50bdb86700 1 --2- 172.21.15.71:0/1890126579 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f50b806efc0 0x7f50b80c8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:08.614 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.611+0000 7f50bdb86700 1 --2- 172.21.15.71:0/1890126579 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f50b815a5d0 0x7f50b80b1040 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:08.614 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.611+0000 7f50bdb86700 1 -- 172.21.15.71:0/1890126579 >> 172.21.15.71:0/1890126579 conn(0x7f50b8069100 msgr2=0x7f50b80ad9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:08.614 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.611+0000 7f50bdb86700 1 -- 172.21.15.71:0/1890126579 shutdown_connections 2023-10-06T01:42:08.614 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.611+0000 7f50bdb86700 1 -- 172.21.15.71:0/1890126579 wait complete. 2023-10-06T01:42:08.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.612+0000 7f50bdb86700 1 Processor -- start 2023-10-06T01:42:08.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.612+0000 7f50bdb86700 1 -- start start 2023-10-06T01:42:08.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.613+0000 7f50bdb86700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f50b806efc0 0x7f50b814f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:08.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.613+0000 7f50bdb86700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50b815a5d0 0x7f50b8168970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:08.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.613+0000 7f50bdb86700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f50b815a9a0 0x7f50b813e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:08.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.613+0000 7f50bdb86700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50b813eae0 con 0x7f50b815a9a0 2023-10-06T01:42:08.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.613+0000 7f50bdb86700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50b8167eb0 con 0x7f50b815a5d0 2023-10-06T01:42:08.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.613+0000 7f50bdb86700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50b814f920 con 0x7f50b806efc0 2023-10-06T01:42:08.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.613+0000 7f50b7fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f50b815a9a0 0x7f50b813e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:08.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.613+0000 7f50b7fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f50b815a9a0 0x7f50b813e5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38108/0 (socket says 172.21.15.71:38108) 2023-10-06T01:42:08.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.613+0000 7f50b7fff700 1 -- 172.21.15.71:0/2488155526 learned_addr learned my addr 172.21.15.71:0/2488155526 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:08.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.613+0000 7f50b77fe700 1 --2- 172.21.15.71:0/2488155526 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f50b806efc0 0x7f50b814f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:08.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.613+0000 7f50b6ffd700 1 --2- 172.21.15.71:0/2488155526 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50b815a5d0 0x7f50b8168970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:08.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.613+0000 7f50b7fff700 1 -- 172.21.15.71:0/2488155526 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f50b806efc0 msgr2=0x7f50b814f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:08.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.614+0000 7f50b7fff700 1 --2- 172.21.15.71:0/2488155526 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f50b806efc0 0x7f50b814f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:08.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.614+0000 7f50b7fff700 1 -- 172.21.15.71:0/2488155526 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50b815a5d0 msgr2=0x7f50b8168970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:08.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.614+0000 7f50b7fff700 1 --2- 172.21.15.71:0/2488155526 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50b815a5d0 0x7f50b8168970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:08.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.614+0000 7f50b7fff700 1 -- 172.21.15.71:0/2488155526 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50a80094f0 con 0x7f50b815a9a0 2023-10-06T01:42:08.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.614+0000 7f50b7fff700 1 --2- 172.21.15.71:0/2488155526 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f50b815a9a0 0x7f50b813e5a0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f50b0009fa0 tx=0x7f50b0009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:08.618 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.614+0000 7f509f7fe700 1 -- 172.21.15.71:0/2488155526 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b000ebc0 con 0x7f50b815a9a0 2023-10-06T01:42:08.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.614+0000 7f509f7fe700 1 -- 172.21.15.71:0/2488155526 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50b000ed20 con 0x7f50b815a9a0 2023-10-06T01:42:08.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.614+0000 7f50bdb86700 1 -- 172.21.15.71:0/2488155526 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50b814fc00 con 0x7f50b815a9a0 2023-10-06T01:42:08.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.614+0000 7f509f7fe700 1 -- 172.21.15.71:0/2488155526 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b0014670 con 0x7f50b815a9a0 2023-10-06T01:42:08.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.614+0000 7f50bdb86700 1 -- 172.21.15.71:0/2488155526 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50b8168450 con 0x7f50b815a9a0 2023-10-06T01:42:08.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.615+0000 7f50bdb86700 1 -- 172.21.15.71:0/2488155526 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50b8157c40 con 0x7f50b815a9a0 2023-10-06T01:42:08.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.615+0000 7f509f7fe700 1 -- 172.21.15.71:0/2488155526 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f50b0014a20 con 0x7f50b815a9a0 2023-10-06T01:42:08.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.616+0000 7f509f7fe700 1 --2- 172.21.15.71:0/2488155526 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f50a4066f60 0x7f50a4069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:08.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.616+0000 7f509f7fe700 1 -- 172.21.15.71:0/2488155526 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f50b0084d90 con 0x7f50b815a9a0 2023-10-06T01:42:08.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.616+0000 7f50b77fe700 1 --2- 172.21.15.71:0/2488155526 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f50a4066f60 0x7f50a4069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:08.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.616+0000 7f50b77fe700 1 --2- 172.21.15.71:0/2488155526 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f50a4066f60 0x7f50a4069410 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f50a80099b0 tx=0x7f50a8016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:08.620 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.620+0000 7f509f7fe700 1 -- 172.21.15.71:0/2488155526 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f50b0051d60 con 0x7f50b815a9a0 2023-10-06T01:42:08.800 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.800+0000 7f50bdb86700 1 -- 172.21.15.71:0/2488155526 --> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f50b8168640 con 0x7f50a4066f60 2023-10-06T01:42:08.808 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.808+0000 7f509f7fe700 1 -- 172.21.15.71:0/2488155526 <== mgr.4107 v2:172.21.15.71:6832/90436 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310743 (secure 0 0 0) 0x7f50b8168640 con 0x7f50a4066f60 2023-10-06T01:42:08.812 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:42:08.815 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.812+0000 7f50bdb86700 1 -- 172.21.15.71:0/2488155526 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f50a4066f60 msgr2=0x7f50a4069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:08.815 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.812+0000 7f50bdb86700 1 --2- 172.21.15.71:0/2488155526 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f50a4066f60 0x7f50a4069410 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f50a80099b0 tx=0x7f50a8016000 comp rx=0 tx=0).stop 2023-10-06T01:42:08.815 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.812+0000 7f50bdb86700 1 -- 172.21.15.71:0/2488155526 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f50b815a9a0 msgr2=0x7f50b813e5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:08.815 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.812+0000 7f50bdb86700 1 --2- 172.21.15.71:0/2488155526 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f50b815a9a0 0x7f50b813e5a0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f50b0009fa0 tx=0x7f50b0009900 comp rx=0 tx=0).stop 2023-10-06T01:42:08.815 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.812+0000 7f50bdb86700 1 -- 172.21.15.71:0/2488155526 shutdown_connections 2023-10-06T01:42:08.815 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.812+0000 7f50bdb86700 1 --2- 172.21.15.71:0/2488155526 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f50b815a9a0 0x7f50b813e5a0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:08.816 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.812+0000 7f50bdb86700 1 --2- 172.21.15.71:0/2488155526 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f50b806efc0 0x7f50b814f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:08.816 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.812+0000 7f50bdb86700 1 --2- 172.21.15.71:0/2488155526 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f50a4066f60 0x7f50a4069410 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:08.816 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.812+0000 7f50bdb86700 1 --2- 172.21.15.71:0/2488155526 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50b815a5d0 0x7f50b8168970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:08.816 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.812+0000 7f50bdb86700 1 -- 172.21.15.71:0/2488155526 >> 172.21.15.71:0/2488155526 conn(0x7f50b8069100 msgr2=0x7f50b80c8be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:08.816 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.812+0000 7f50bdb86700 1 -- 172.21.15.71:0/2488155526 shutdown_connections 2023-10-06T01:42:08.816 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.812+0000 7f50bdb86700 1 -- 172.21.15.71:0/2488155526 wait complete. 2023-10-06T01:42:08.816 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2023-10-06T01:42:08.824 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":107,"stamp":"2023-10-06T01:42:08.586159+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":203,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2384548,"kb_used_data":6244,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752590172,"statfs":{"total":773094113280,"available":770652336128,"internally_reserved":0,"allocated":6393856,"data_stored":3552155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.682149"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.922447+0000","last_change":"2023-10-06T01:41:59.915540+0000","last_active":"2023-10-06T01:41:59.922447+0000","last_peered":"2023-10-06T01:41:59.922447+0000","last_clean":"2023-10-06T01:41:59.922447+0000","last_became_active":"2023-10-06T01:41:59.915284+0000","last_became_peered":"2023-10-06T01:41:59.915284+0000","last_unstale":"2023-10-06T01:41:59.922447+0000","last_undegraded":"2023-10-06T01:41:59.922447+0000","last_fullsized":"2023-10-06T01:41:59.922447+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:03:59.520161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.916533+0000","last_change":"2023-10-06T01:41:59.913058+0000","last_active":"2023-10-06T01:41:59.916533+0000","last_peered":"2023-10-06T01:41:59.916533+0000","last_clean":"2023-10-06T01:41:59.916533+0000","last_became_active":"2023-10-06T01:41:59.912781+0000","last_became_peered":"2023-10-06T01:41:59.912781+0000","last_unstale":"2023-10-06T01:41:59.916533+0000","last_undegraded":"2023-10-06T01:41:59.916533+0000","last_fullsized":"2023-10-06T01:41:59.916533+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:14:55.659015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.934081+0000","last_change":"2023-10-06T01:41:59.930725+0000","last_active":"2023-10-06T01:41:59.934081+0000","last_peered":"2023-10-06T01:41:59.934081+0000","last_clean":"2023-10-06T01:41:59.934081+0000","last_became_active":"2023-10-06T01:41:59.929740+0000","last_became_peered":"2023-10-06T01:41:59.929740+0000","last_unstale":"2023-10-06T01:41:59.934081+0000","last_undegraded":"2023-10-06T01:41:59.934081+0000","last_fullsized":"2023-10-06T01:41:59.934081+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:24:01.329759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.924994+0000","last_change":"2023-10-06T01:41:59.924145+0000","last_active":"2023-10-06T01:41:59.924994+0000","last_peered":"2023-10-06T01:41:59.924994+0000","last_clean":"2023-10-06T01:41:59.924994+0000","last_became_active":"2023-10-06T01:41:59.923836+0000","last_became_peered":"2023-10-06T01:41:59.923836+0000","last_unstale":"2023-10-06T01:41:59.924994+0000","last_undegraded":"2023-10-06T01:41:59.924994+0000","last_fullsized":"2023-10-06T01:41:59.924994+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:41:29.186282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.926529+0000","last_change":"2023-10-06T01:41:59.917118+0000","last_active":"2023-10-06T01:41:59.926529+0000","last_peered":"2023-10-06T01:41:59.926529+0000","last_clean":"2023-10-06T01:41:59.926529+0000","last_became_active":"2023-10-06T01:41:59.916859+0000","last_became_peered":"2023-10-06T01:41:59.916859+0000","last_unstale":"2023-10-06T01:41:59.926529+0000","last_undegraded":"2023-10-06T01:41:59.926529+0000","last_fullsized":"2023-10-06T01:41:59.926529+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:01:45.573351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.932977+0000","last_change":"2023-10-06T01:41:59.929806+0000","last_active":"2023-10-06T01:41:59.932977+0000","last_peered":"2023-10-06T01:41:59.932977+0000","last_clean":"2023-10-06T01:41:59.932977+0000","last_became_active":"2023-10-06T01:41:59.929565+0000","last_became_peered":"2023-10-06T01:41:59.929565+0000","last_unstale":"2023-10-06T01:41:59.932977+0000","last_undegraded":"2023-10-06T01:41:59.932977+0000","last_fullsized":"2023-10-06T01:41:59.932977+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:18:41.923790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.926648+0000","last_change":"2023-10-06T01:41:59.920798+0000","last_active":"2023-10-06T01:41:59.926648+0000","last_peered":"2023-10-06T01:41:59.926648+0000","last_clean":"2023-10-06T01:41:59.926648+0000","last_became_active":"2023-10-06T01:41:59.920550+0000","last_became_peered":"2023-10-06T01:41:59.920550+0000","last_unstale":"2023-10-06T01:41:59.926648+0000","last_undegraded":"2023-10-06T01:41:59.926648+0000","last_fullsized":"2023-10-06T01:41:59.926648+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:45:31.777277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.927775+0000","last_change":"2023-10-06T01:41:59.918442+0000","last_active":"2023-10-06T01:41:59.927775+0000","last_peered":"2023-10-06T01:41:59.927775+0000","last_clean":"2023-10-06T01:41:59.927775+0000","last_became_active":"2023-10-06T01:41:59.918193+0000","last_became_peered":"2023-10-06T01:41:59.918193+0000","last_unstale":"2023-10-06T01:41:59.927775+0000","last_undegraded":"2023-10-06T01:41:59.927775+0000","last_fullsized":"2023-10-06T01:41:59.927775+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:07:19.364309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.930948+0000","last_change":"2023-10-06T01:41:59.924857+0000","last_active":"2023-10-06T01:41:59.930948+0000","last_peered":"2023-10-06T01:41:59.930948+0000","last_clean":"2023-10-06T01:41:59.930948+0000","last_became_active":"2023-10-06T01:41:59.924587+0000","last_became_peered":"2023-10-06T01:41:59.924587+0000","last_unstale":"2023-10-06T01:41:59.930948+0000","last_undegraded":"2023-10-06T01:41:59.930948+0000","last_fullsized":"2023-10-06T01:41:59.930948+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:44:24.458680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.911532+0000","last_change":"2023-10-06T01:41:59.909443+0000","last_active":"2023-10-06T01:41:59.911532+0000","last_peered":"2023-10-06T01:41:59.911532+0000","last_clean":"2023-10-06T01:41:59.911532+0000","last_became_active":"2023-10-06T01:41:59.909189+0000","last_became_peered":"2023-10-06T01:41:59.909189+0000","last_unstale":"2023-10-06T01:41:59.911532+0000","last_undegraded":"2023-10-06T01:41:59.911532+0000","last_fullsized":"2023-10-06T01:41:59.911532+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:49:01.938924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.917054+0000","last_change":"2023-10-06T01:41:59.913473+0000","last_active":"2023-10-06T01:41:59.917054+0000","last_peered":"2023-10-06T01:41:59.917054+0000","last_clean":"2023-10-06T01:41:59.917054+0000","last_became_active":"2023-10-06T01:41:59.913213+0000","last_became_peered":"2023-10-06T01:41:59.913213+0000","last_unstale":"2023-10-06T01:41:59.917054+0000","last_undegraded":"2023-10-06T01:41:59.917054+0000","last_fullsized":"2023-10-06T01:41:59.917054+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:03:59.520161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.930999+0000","last_change":"2023-10-06T01:41:59.927393+0000","last_active":"2023-10-06T01:41:59.930999+0000","last_peered":"2023-10-06T01:41:59.930999+0000","last_clean":"2023-10-06T01:41:59.930999+0000","last_became_active":"2023-10-06T01:41:59.927137+0000","last_became_peered":"2023-10-06T01:41:59.927137+0000","last_unstale":"2023-10-06T01:41:59.930999+0000","last_undegraded":"2023-10-06T01:41:59.930999+0000","last_fullsized":"2023-10-06T01:41:59.930999+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:05:48.629746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.931762+0000","last_change":"2023-10-06T01:41:59.929256+0000","last_active":"2023-10-06T01:41:59.931762+0000","last_peered":"2023-10-06T01:41:59.931762+0000","last_clean":"2023-10-06T01:41:59.931762+0000","last_became_active":"2023-10-06T01:41:59.928778+0000","last_became_peered":"2023-10-06T01:41:59.928778+0000","last_unstale":"2023-10-06T01:41:59.931762+0000","last_undegraded":"2023-10-06T01:41:59.931762+0000","last_fullsized":"2023-10-06T01:41:59.931762+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:14:29.633116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.925731+0000","last_change":"2023-10-06T01:41:59.922250+0000","last_active":"2023-10-06T01:41:59.925731+0000","last_peered":"2023-10-06T01:41:59.925731+0000","last_clean":"2023-10-06T01:41:59.925731+0000","last_became_active":"2023-10-06T01:41:59.922001+0000","last_became_peered":"2023-10-06T01:41:59.922001+0000","last_unstale":"2023-10-06T01:41:59.925731+0000","last_undegraded":"2023-10-06T01:41:59.925731+0000","last_fullsized":"2023-10-06T01:41:59.925731+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:40:12.842857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.926668+0000","last_change":"2023-10-06T01:41:59.922713+0000","last_active":"2023-10-06T01:41:59.926668+0000","last_peered":"2023-10-06T01:41:59.926668+0000","last_clean":"2023-10-06T01:41:59.926668+0000","last_became_active":"2023-10-06T01:41:59.922462+0000","last_became_peered":"2023-10-06T01:41:59.922462+0000","last_unstale":"2023-10-06T01:41:59.926668+0000","last_undegraded":"2023-10-06T01:41:59.926668+0000","last_fullsized":"2023-10-06T01:41:59.926668+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:05:48.629746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.933111+0000","last_change":"2023-10-06T01:41:59.929705+0000","last_active":"2023-10-06T01:41:59.933111+0000","last_peered":"2023-10-06T01:41:59.933111+0000","last_clean":"2023-10-06T01:41:59.933111+0000","last_became_active":"2023-10-06T01:41:59.929457+0000","last_became_peered":"2023-10-06T01:41:59.929457+0000","last_unstale":"2023-10-06T01:41:59.933111+0000","last_undegraded":"2023-10-06T01:41:59.933111+0000","last_fullsized":"2023-10-06T01:41:59.933111+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:14:55.659015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.916801+0000","last_change":"2023-10-06T01:41:59.913085+0000","last_active":"2023-10-06T01:41:59.916801+0000","last_peered":"2023-10-06T01:41:59.916801+0000","last_clean":"2023-10-06T01:41:59.916801+0000","last_became_active":"2023-10-06T01:41:59.912867+0000","last_became_peered":"2023-10-06T01:41:59.912867+0000","last_unstale":"2023-10-06T01:41:59.916801+0000","last_undegraded":"2023-10-06T01:41:59.916801+0000","last_fullsized":"2023-10-06T01:41:59.916801+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:08.078701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.939122+0000","last_change":"2023-10-06T01:41:59.933685+0000","last_active":"2023-10-06T01:41:59.939122+0000","last_peered":"2023-10-06T01:41:59.939122+0000","last_clean":"2023-10-06T01:41:59.939122+0000","last_became_active":"2023-10-06T01:41:59.932319+0000","last_became_peered":"2023-10-06T01:41:59.932319+0000","last_unstale":"2023-10-06T01:41:59.939122+0000","last_undegraded":"2023-10-06T01:41:59.939122+0000","last_fullsized":"2023-10-06T01:41:59.939122+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:56:51.126033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.926574+0000","last_change":"2023-10-06T01:41:59.920145+0000","last_active":"2023-10-06T01:41:59.926574+0000","last_peered":"2023-10-06T01:41:59.926574+0000","last_clean":"2023-10-06T01:41:59.926574+0000","last_became_active":"2023-10-06T01:41:59.919889+0000","last_became_peered":"2023-10-06T01:41:59.919889+0000","last_unstale":"2023-10-06T01:41:59.926574+0000","last_undegraded":"2023-10-06T01:41:59.926574+0000","last_fullsized":"2023-10-06T01:41:59.926574+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:42:12.631213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.933860+0000","last_change":"2023-10-06T01:41:59.929655+0000","last_active":"2023-10-06T01:41:59.933860+0000","last_peered":"2023-10-06T01:41:59.933860+0000","last_clean":"2023-10-06T01:41:59.933860+0000","last_became_active":"2023-10-06T01:41:59.929408+0000","last_became_peered":"2023-10-06T01:41:59.929408+0000","last_unstale":"2023-10-06T01:41:59.933860+0000","last_undegraded":"2023-10-06T01:41:59.933860+0000","last_fullsized":"2023-10-06T01:41:59.933860+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:41:27.269324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.933840+0000","last_change":"2023-10-06T01:41:59.925142+0000","last_active":"2023-10-06T01:41:59.933840+0000","last_peered":"2023-10-06T01:41:59.933840+0000","last_clean":"2023-10-06T01:41:59.933840+0000","last_became_active":"2023-10-06T01:41:59.924872+0000","last_became_peered":"2023-10-06T01:41:59.924872+0000","last_unstale":"2023-10-06T01:41:59.933840+0000","last_undegraded":"2023-10-06T01:41:59.933840+0000","last_fullsized":"2023-10-06T01:41:59.933840+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:41:29.186282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.927819+0000","last_change":"2023-10-06T01:41:59.918563+0000","last_active":"2023-10-06T01:41:59.927819+0000","last_peered":"2023-10-06T01:41:59.927819+0000","last_clean":"2023-10-06T01:41:59.927819+0000","last_became_active":"2023-10-06T01:41:59.918068+0000","last_became_peered":"2023-10-06T01:41:59.918068+0000","last_unstale":"2023-10-06T01:41:59.927819+0000","last_undegraded":"2023-10-06T01:41:59.927819+0000","last_fullsized":"2023-10-06T01:41:59.927819+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:42:14.967630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.934327+0000","last_change":"2023-10-06T01:41:59.933157+0000","last_active":"2023-10-06T01:41:59.934327+0000","last_peered":"2023-10-06T01:41:59.934327+0000","last_clean":"2023-10-06T01:41:59.934327+0000","last_became_active":"2023-10-06T01:41:59.932454+0000","last_became_peered":"2023-10-06T01:41:59.932454+0000","last_unstale":"2023-10-06T01:41:59.934327+0000","last_undegraded":"2023-10-06T01:41:59.934327+0000","last_fullsized":"2023-10-06T01:41:59.934327+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:07:25.175365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.931787+0000","last_change":"2023-10-06T01:41:59.929430+0000","last_active":"2023-10-06T01:41:59.931787+0000","last_peered":"2023-10-06T01:41:59.931787+0000","last_clean":"2023-10-06T01:41:59.931787+0000","last_became_active":"2023-10-06T01:41:59.929162+0000","last_became_peered":"2023-10-06T01:41:59.929162+0000","last_unstale":"2023-10-06T01:41:59.931787+0000","last_undegraded":"2023-10-06T01:41:59.931787+0000","last_fullsized":"2023-10-06T01:41:59.931787+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:29:32.229410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.921742+0000","last_change":"2023-10-06T01:41:59.914263+0000","last_active":"2023-10-06T01:41:59.921742+0000","last_peered":"2023-10-06T01:41:59.921742+0000","last_clean":"2023-10-06T01:41:59.921742+0000","last_became_active":"2023-10-06T01:41:59.913986+0000","last_became_peered":"2023-10-06T01:41:59.913986+0000","last_unstale":"2023-10-06T01:41:59.921742+0000","last_undegraded":"2023-10-06T01:41:59.921742+0000","last_fullsized":"2023-10-06T01:41:59.921742+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:24:21.805228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.929900+0000","last_change":"2023-10-06T01:41:59.927075+0000","last_active":"2023-10-06T01:41:59.929900+0000","last_peered":"2023-10-06T01:41:59.929900+0000","last_clean":"2023-10-06T01:41:59.929900+0000","last_became_active":"2023-10-06T01:41:59.926810+0000","last_became_peered":"2023-10-06T01:41:59.926810+0000","last_unstale":"2023-10-06T01:41:59.929900+0000","last_undegraded":"2023-10-06T01:41:59.929900+0000","last_fullsized":"2023-10-06T01:41:59.929900+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:43:48.006348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.930488+0000","last_change":"2023-10-06T01:41:59.927240+0000","last_active":"2023-10-06T01:41:59.930488+0000","last_peered":"2023-10-06T01:41:59.930488+0000","last_clean":"2023-10-06T01:41:59.930488+0000","last_became_active":"2023-10-06T01:41:59.926702+0000","last_became_peered":"2023-10-06T01:41:59.926702+0000","last_unstale":"2023-10-06T01:41:59.930488+0000","last_undegraded":"2023-10-06T01:41:59.930488+0000","last_fullsized":"2023-10-06T01:41:59.930488+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:42:14.967630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.926514+0000","last_change":"2023-10-06T01:41:59.916928+0000","last_active":"2023-10-06T01:41:59.926514+0000","last_peered":"2023-10-06T01:41:59.926514+0000","last_clean":"2023-10-06T01:41:59.926514+0000","last_became_active":"2023-10-06T01:41:59.916659+0000","last_became_peered":"2023-10-06T01:41:59.916659+0000","last_unstale":"2023-10-06T01:41:59.926514+0000","last_undegraded":"2023-10-06T01:41:59.926514+0000","last_fullsized":"2023-10-06T01:41:59.926514+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:49:01.938924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.928127+0000","last_change":"2023-10-06T01:41:59.920777+0000","last_active":"2023-10-06T01:41:59.928127+0000","last_peered":"2023-10-06T01:41:59.928127+0000","last_clean":"2023-10-06T01:41:59.928127+0000","last_became_active":"2023-10-06T01:41:59.920533+0000","last_became_peered":"2023-10-06T01:41:59.920533+0000","last_unstale":"2023-10-06T01:41:59.928127+0000","last_undegraded":"2023-10-06T01:41:59.928127+0000","last_fullsized":"2023-10-06T01:41:59.928127+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:03:33.302671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.934050+0000","last_change":"2023-10-06T01:41:59.927799+0000","last_active":"2023-10-06T01:41:59.934050+0000","last_peered":"2023-10-06T01:41:59.934050+0000","last_clean":"2023-10-06T01:41:59.934050+0000","last_became_active":"2023-10-06T01:41:59.927478+0000","last_became_peered":"2023-10-06T01:41:59.927478+0000","last_unstale":"2023-10-06T01:41:59.934050+0000","last_undegraded":"2023-10-06T01:41:59.934050+0000","last_fullsized":"2023-10-06T01:41:59.934050+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:49:48.083851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.926469+0000","last_change":"2023-10-06T01:41:59.919687+0000","last_active":"2023-10-06T01:41:59.926469+0000","last_peered":"2023-10-06T01:41:59.926469+0000","last_clean":"2023-10-06T01:41:59.926469+0000","last_became_active":"2023-10-06T01:41:59.919441+0000","last_became_peered":"2023-10-06T01:41:59.919441+0000","last_unstale":"2023-10-06T01:41:59.926469+0000","last_undegraded":"2023-10-06T01:41:59.926469+0000","last_fullsized":"2023-10-06T01:41:59.926469+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:58.335794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.923898+0000","last_change":"2023-10-06T01:41:59.918563+0000","last_active":"2023-10-06T01:41:59.923898+0000","last_peered":"2023-10-06T01:41:59.923898+0000","last_clean":"2023-10-06T01:41:59.923898+0000","last_became_active":"2023-10-06T01:41:59.918173+0000","last_became_peered":"2023-10-06T01:41:59.918173+0000","last_unstale":"2023-10-06T01:41:59.923898+0000","last_undegraded":"2023-10-06T01:41:59.923898+0000","last_fullsized":"2023-10-06T01:41:59.923898+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:16:49.114729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.930205+0000","last_change":"2023-10-06T01:41:59.927457+0000","last_active":"2023-10-06T01:41:59.930205+0000","last_peered":"2023-10-06T01:41:59.930205+0000","last_clean":"2023-10-06T01:41:59.930205+0000","last_became_active":"2023-10-06T01:41:59.927162+0000","last_became_peered":"2023-10-06T01:41:59.927162+0000","last_unstale":"2023-10-06T01:41:59.930205+0000","last_undegraded":"2023-10-06T01:41:59.930205+0000","last_fullsized":"2023-10-06T01:41:59.930205+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:33:27.039395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"53'4","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.927733+0000","last_change":"2023-10-06T01:41:58.922614+0000","last_active":"2023-10-06T01:41:59.927733+0000","last_peered":"2023-10-06T01:41:59.927733+0000","last_clean":"2023-10-06T01:41:59.927733+0000","last_became_active":"2023-10-06T01:41:58.922235+0000","last_became_peered":"2023-10-06T01:41:58.922235+0000","last_unstale":"2023-10-06T01:41:59.927733+0000","last_undegraded":"2023-10-06T01:41:59.927733+0000","last_fullsized":"2023-10-06T01:41:59.927733+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:02.086327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.929487+0000","last_change":"2023-10-06T01:41:59.924904+0000","last_active":"2023-10-06T01:41:59.929487+0000","last_peered":"2023-10-06T01:41:59.929487+0000","last_clean":"2023-10-06T01:41:59.929487+0000","last_became_active":"2023-10-06T01:41:59.924621+0000","last_became_peered":"2023-10-06T01:41:59.924621+0000","last_unstale":"2023-10-06T01:41:59.929487+0000","last_undegraded":"2023-10-06T01:41:59.929487+0000","last_fullsized":"2023-10-06T01:41:59.929487+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:47:17.831162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"53'1","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.924111+0000","last_change":"2023-10-06T01:41:58.924804+0000","last_active":"2023-10-06T01:41:59.924111+0000","last_peered":"2023-10-06T01:41:59.924111+0000","last_clean":"2023-10-06T01:41:59.924111+0000","last_became_active":"2023-10-06T01:41:58.924520+0000","last_became_peered":"2023-10-06T01:41:58.924520+0000","last_unstale":"2023-10-06T01:41:59.924111+0000","last_undegraded":"2023-10-06T01:41:59.924111+0000","last_fullsized":"2023-10-06T01:41:59.924111+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:45:24.296902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.935876+0000","last_change":"2023-10-06T01:41:59.931503+0000","last_active":"2023-10-06T01:41:59.935876+0000","last_peered":"2023-10-06T01:41:59.935876+0000","last_clean":"2023-10-06T01:41:59.935876+0000","last_became_active":"2023-10-06T01:41:59.931276+0000","last_became_peered":"2023-10-06T01:41:59.931276+0000","last_unstale":"2023-10-06T01:41:59.935876+0000","last_undegraded":"2023-10-06T01:41:59.935876+0000","last_fullsized":"2023-10-06T01:41:59.935876+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:08.078701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"53'2","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.927074+0000","last_change":"2023-10-06T01:41:58.923283+0000","last_active":"2023-10-06T01:41:59.927074+0000","last_peered":"2023-10-06T01:41:59.927074+0000","last_clean":"2023-10-06T01:41:59.927074+0000","last_became_active":"2023-10-06T01:41:58.921507+0000","last_became_peered":"2023-10-06T01:41:58.921507+0000","last_unstale":"2023-10-06T01:41:59.927074+0000","last_undegraded":"2023-10-06T01:41:59.927074+0000","last_fullsized":"2023-10-06T01:41:59.927074+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:18:08.744663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.930455+0000","last_change":"2023-10-06T01:41:59.922965+0000","last_active":"2023-10-06T01:41:59.930455+0000","last_peered":"2023-10-06T01:41:59.930455+0000","last_clean":"2023-10-06T01:41:59.930455+0000","last_became_active":"2023-10-06T01:41:59.922709+0000","last_became_peered":"2023-10-06T01:41:59.922709+0000","last_unstale":"2023-10-06T01:41:59.930455+0000","last_undegraded":"2023-10-06T01:41:59.930455+0000","last_fullsized":"2023-10-06T01:41:59.930455+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:07:19.364309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"53'2","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.926888+0000","last_change":"2023-10-06T01:41:58.927325+0000","last_active":"2023-10-06T01:41:59.926888+0000","last_peered":"2023-10-06T01:41:59.926888+0000","last_clean":"2023-10-06T01:41:59.926888+0000","last_became_active":"2023-10-06T01:41:58.927064+0000","last_became_peered":"2023-10-06T01:41:58.927064+0000","last_unstale":"2023-10-06T01:41:59.926888+0000","last_undegraded":"2023-10-06T01:41:59.926888+0000","last_fullsized":"2023-10-06T01:41:59.926888+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:10:11.010664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.927683+0000","last_change":"2023-10-06T01:41:59.917233+0000","last_active":"2023-10-06T01:41:59.927683+0000","last_peered":"2023-10-06T01:41:59.927683+0000","last_clean":"2023-10-06T01:41:59.927683+0000","last_became_active":"2023-10-06T01:41:59.916299+0000","last_became_peered":"2023-10-06T01:41:59.916299+0000","last_unstale":"2023-10-06T01:41:59.927683+0000","last_undegraded":"2023-10-06T01:41:59.927683+0000","last_fullsized":"2023-10-06T01:41:59.927683+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:33:27.039395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"53'1","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.923560+0000","last_change":"2023-10-06T01:41:58.923107+0000","last_active":"2023-10-06T01:41:59.923560+0000","last_peered":"2023-10-06T01:41:59.923560+0000","last_clean":"2023-10-06T01:41:59.923560+0000","last_became_active":"2023-10-06T01:41:58.922594+0000","last_became_peered":"2023-10-06T01:41:58.922594+0000","last_unstale":"2023-10-06T01:41:59.923560+0000","last_undegraded":"2023-10-06T01:41:59.923560+0000","last_fullsized":"2023-10-06T01:41:59.923560+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:45:24.296902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.929937+0000","last_change":"2023-10-06T01:41:59.927056+0000","last_active":"2023-10-06T01:41:59.929937+0000","last_peered":"2023-10-06T01:41:59.929937+0000","last_clean":"2023-10-06T01:41:59.929937+0000","last_became_active":"2023-10-06T01:41:59.926795+0000","last_became_peered":"2023-10-06T01:41:59.926795+0000","last_unstale":"2023-10-06T01:41:59.929937+0000","last_undegraded":"2023-10-06T01:41:59.929937+0000","last_fullsized":"2023-10-06T01:41:59.929937+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:28:23.967941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"53'1","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.931724+0000","last_change":"2023-10-06T01:41:58.925616+0000","last_active":"2023-10-06T01:41:59.931724+0000","last_peered":"2023-10-06T01:41:59.931724+0000","last_clean":"2023-10-06T01:41:59.931724+0000","last_became_active":"2023-10-06T01:41:58.921298+0000","last_became_peered":"2023-10-06T01:41:58.921298+0000","last_unstale":"2023-10-06T01:41:59.931724+0000","last_undegraded":"2023-10-06T01:41:59.931724+0000","last_fullsized":"2023-10-06T01:41:59.931724+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:24:38.810483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.929526+0000","last_change":"2023-10-06T01:41:59.920518+0000","last_active":"2023-10-06T01:41:59.929526+0000","last_peered":"2023-10-06T01:41:59.929526+0000","last_clean":"2023-10-06T01:41:59.929526+0000","last_became_active":"2023-10-06T01:41:59.920258+0000","last_became_peered":"2023-10-06T01:41:59.920258+0000","last_unstale":"2023-10-06T01:41:59.929526+0000","last_undegraded":"2023-10-06T01:41:59.929526+0000","last_fullsized":"2023-10-06T01:41:59.929526+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:40:42.553317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.911650+0000","last_change":"2023-10-06T01:41:58.918654+0000","last_active":"2023-10-06T01:41:59.911650+0000","last_peered":"2023-10-06T01:41:59.911650+0000","last_clean":"2023-10-06T01:41:59.911650+0000","last_became_active":"2023-10-06T01:41:58.916820+0000","last_became_peered":"2023-10-06T01:41:58.916820+0000","last_unstale":"2023-10-06T01:41:59.911650+0000","last_undegraded":"2023-10-06T01:41:59.911650+0000","last_fullsized":"2023-10-06T01:41:59.911650+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:29:10.311250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.927862+0000","last_change":"2023-10-06T01:41:59.920579+0000","last_active":"2023-10-06T01:41:59.927862+0000","last_peered":"2023-10-06T01:41:59.927862+0000","last_clean":"2023-10-06T01:41:59.927862+0000","last_became_active":"2023-10-06T01:41:59.919127+0000","last_became_peered":"2023-10-06T01:41:59.919127+0000","last_unstale":"2023-10-06T01:41:59.927862+0000","last_undegraded":"2023-10-06T01:41:59.927862+0000","last_fullsized":"2023-10-06T01:41:59.927862+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:24:57.562583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.912442+0000","last_change":"2023-10-06T01:41:58.922210+0000","last_active":"2023-10-06T01:41:59.912442+0000","last_peered":"2023-10-06T01:41:59.912442+0000","last_clean":"2023-10-06T01:41:59.912442+0000","last_became_active":"2023-10-06T01:41:58.921962+0000","last_became_peered":"2023-10-06T01:41:58.921962+0000","last_unstale":"2023-10-06T01:41:59.912442+0000","last_undegraded":"2023-10-06T01:41:59.912442+0000","last_fullsized":"2023-10-06T01:41:59.912442+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:24:38.810483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.929612+0000","last_change":"2023-10-06T01:41:59.923787+0000","last_active":"2023-10-06T01:41:59.929612+0000","last_peered":"2023-10-06T01:41:59.929612+0000","last_clean":"2023-10-06T01:41:59.929612+0000","last_became_active":"2023-10-06T01:41:59.923530+0000","last_became_peered":"2023-10-06T01:41:59.923530+0000","last_unstale":"2023-10-06T01:41:59.929612+0000","last_undegraded":"2023-10-06T01:41:59.929612+0000","last_fullsized":"2023-10-06T01:41:59.929612+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:56:51.126033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.912761+0000","last_change":"2023-10-06T01:41:58.928025+0000","last_active":"2023-10-06T01:41:59.912761+0000","last_peered":"2023-10-06T01:41:59.912761+0000","last_clean":"2023-10-06T01:41:59.912761+0000","last_became_active":"2023-10-06T01:41:58.927745+0000","last_became_peered":"2023-10-06T01:41:58.927745+0000","last_unstale":"2023-10-06T01:41:59.912761+0000","last_undegraded":"2023-10-06T01:41:59.912761+0000","last_fullsized":"2023-10-06T01:41:59.912761+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:04:52.797213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.934010+0000","last_change":"2023-10-06T01:41:59.927488+0000","last_active":"2023-10-06T01:41:59.934010+0000","last_peered":"2023-10-06T01:41:59.934010+0000","last_clean":"2023-10-06T01:41:59.934010+0000","last_became_active":"2023-10-06T01:41:59.927154+0000","last_became_peered":"2023-10-06T01:41:59.927154+0000","last_unstale":"2023-10-06T01:41:59.934010+0000","last_undegraded":"2023-10-06T01:41:59.934010+0000","last_fullsized":"2023-10-06T01:41:59.934010+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:03.091506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.908142+0000","last_change":"2023-10-06T01:41:58.923640+0000","last_active":"2023-10-06T01:41:59.908142+0000","last_peered":"2023-10-06T01:41:59.908142+0000","last_clean":"2023-10-06T01:41:59.908142+0000","last_became_active":"2023-10-06T01:41:58.923367+0000","last_became_peered":"2023-10-06T01:41:58.923367+0000","last_unstale":"2023-10-06T01:41:59.908142+0000","last_undegraded":"2023-10-06T01:41:59.908142+0000","last_fullsized":"2023-10-06T01:41:59.908142+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:33:28.414752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.929348+0000","last_change":"2023-10-06T01:41:59.926192+0000","last_active":"2023-10-06T01:41:59.929348+0000","last_peered":"2023-10-06T01:41:59.929348+0000","last_clean":"2023-10-06T01:41:59.929348+0000","last_became_active":"2023-10-06T01:41:59.925952+0000","last_became_peered":"2023-10-06T01:41:59.925952+0000","last_unstale":"2023-10-06T01:41:59.929348+0000","last_undegraded":"2023-10-06T01:41:59.929348+0000","last_fullsized":"2023-10-06T01:41:59.929348+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:29:32.229410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"53'3","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.932854+0000","last_change":"2023-10-06T01:41:58.926296+0000","last_active":"2023-10-06T01:41:59.932854+0000","last_peered":"2023-10-06T01:41:59.932854+0000","last_clean":"2023-10-06T01:41:59.932854+0000","last_became_active":"2023-10-06T01:41:58.926034+0000","last_became_peered":"2023-10-06T01:41:58.926034+0000","last_unstale":"2023-10-06T01:41:59.932854+0000","last_undegraded":"2023-10-06T01:41:59.932854+0000","last_fullsized":"2023-10-06T01:41:59.932854+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:47:16.825984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.934278+0000","last_change":"2023-10-06T01:41:59.930901+0000","last_active":"2023-10-06T01:41:59.934278+0000","last_peered":"2023-10-06T01:41:59.934278+0000","last_clean":"2023-10-06T01:41:59.934278+0000","last_became_active":"2023-10-06T01:41:59.930222+0000","last_became_peered":"2023-10-06T01:41:59.930222+0000","last_unstale":"2023-10-06T01:41:59.934278+0000","last_undegraded":"2023-10-06T01:41:59.934278+0000","last_fullsized":"2023-10-06T01:41:59.934278+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:05:48.629746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"53'6","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.936484+0000","last_change":"2023-10-06T01:41:58.921643+0000","last_active":"2023-10-06T01:41:59.936484+0000","last_peered":"2023-10-06T01:41:59.936484+0000","last_clean":"2023-10-06T01:41:59.936484+0000","last_became_active":"2023-10-06T01:41:58.921169+0000","last_became_peered":"2023-10-06T01:41:58.921169+0000","last_unstale":"2023-10-06T01:41:59.936484+0000","last_undegraded":"2023-10-06T01:41:59.936484+0000","last_fullsized":"2023-10-06T01:41:59.936484+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:02.086327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.921935+0000","last_change":"2023-10-06T01:41:59.918211+0000","last_active":"2023-10-06T01:41:59.921935+0000","last_peered":"2023-10-06T01:41:59.921935+0000","last_clean":"2023-10-06T01:41:59.921935+0000","last_became_active":"2023-10-06T01:41:59.917943+0000","last_became_peered":"2023-10-06T01:41:59.917943+0000","last_unstale":"2023-10-06T01:41:59.921935+0000","last_undegraded":"2023-10-06T01:41:59.921935+0000","last_fullsized":"2023-10-06T01:41:59.921935+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:07:25.175365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"53'2","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.928080+0000","last_change":"2023-10-06T01:41:58.923632+0000","last_active":"2023-10-06T01:41:59.928080+0000","last_peered":"2023-10-06T01:41:59.928080+0000","last_clean":"2023-10-06T01:41:59.928080+0000","last_became_active":"2023-10-06T01:41:58.923405+0000","last_became_peered":"2023-10-06T01:41:58.923405+0000","last_unstale":"2023-10-06T01:41:59.928080+0000","last_undegraded":"2023-10-06T01:41:59.928080+0000","last_fullsized":"2023-10-06T01:41:59.928080+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:07:24.731136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.932775+0000","last_change":"2023-10-06T01:41:59.923071+0000","last_active":"2023-10-06T01:41:59.932775+0000","last_peered":"2023-10-06T01:41:59.932775+0000","last_clean":"2023-10-06T01:41:59.932775+0000","last_became_active":"2023-10-06T01:41:59.922811+0000","last_became_peered":"2023-10-06T01:41:59.922811+0000","last_unstale":"2023-10-06T01:41:59.932775+0000","last_undegraded":"2023-10-06T01:41:59.932775+0000","last_fullsized":"2023-10-06T01:41:59.932775+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:24:39.815662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.908561+0000","last_change":"2023-10-06T01:41:58.924504+0000","last_active":"2023-10-06T01:41:59.908561+0000","last_peered":"2023-10-06T01:41:59.908561+0000","last_clean":"2023-10-06T01:41:59.908561+0000","last_became_active":"2023-10-06T01:41:58.924234+0000","last_became_peered":"2023-10-06T01:41:58.924234+0000","last_unstale":"2023-10-06T01:41:59.908561+0000","last_undegraded":"2023-10-06T01:41:59.908561+0000","last_fullsized":"2023-10-06T01:41:59.908561+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:01:44.568173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.930847+0000","last_change":"2023-10-06T01:41:59.927908+0000","last_active":"2023-10-06T01:41:59.930847+0000","last_peered":"2023-10-06T01:41:59.930847+0000","last_clean":"2023-10-06T01:41:59.930847+0000","last_became_active":"2023-10-06T01:41:59.927614+0000","last_became_peered":"2023-10-06T01:41:59.927614+0000","last_unstale":"2023-10-06T01:41:59.930847+0000","last_undegraded":"2023-10-06T01:41:59.930847+0000","last_fullsized":"2023-10-06T01:41:59.930847+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:38:19.366140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.911544+0000","last_change":"2023-10-06T01:41:58.927423+0000","last_active":"2023-10-06T01:41:59.911544+0000","last_peered":"2023-10-06T01:41:59.911544+0000","last_clean":"2023-10-06T01:41:59.911544+0000","last_became_active":"2023-10-06T01:41:58.927082+0000","last_became_peered":"2023-10-06T01:41:58.927082+0000","last_unstale":"2023-10-06T01:41:59.911544+0000","last_undegraded":"2023-10-06T01:41:59.911544+0000","last_fullsized":"2023-10-06T01:41:59.911544+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:04.780513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.934308+0000","last_change":"2023-10-06T01:41:59.932568+0000","last_active":"2023-10-06T01:41:59.934308+0000","last_peered":"2023-10-06T01:41:59.934308+0000","last_clean":"2023-10-06T01:41:59.934308+0000","last_became_active":"2023-10-06T01:41:59.932187+0000","last_became_peered":"2023-10-06T01:41:59.932187+0000","last_unstale":"2023-10-06T01:41:59.934308+0000","last_undegraded":"2023-10-06T01:41:59.934308+0000","last_fullsized":"2023-10-06T01:41:59.934308+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:43:48.006348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"53'8","reported_seq":18,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.926079+0000","last_change":"2023-10-06T01:41:58.925098+0000","last_active":"2023-10-06T01:41:59.926079+0000","last_peered":"2023-10-06T01:41:59.926079+0000","last_clean":"2023-10-06T01:41:59.926079+0000","last_became_active":"2023-10-06T01:41:58.924857+0000","last_became_peered":"2023-10-06T01:41:58.924857+0000","last_unstale":"2023-10-06T01:41:59.926079+0000","last_undegraded":"2023-10-06T01:41:59.926079+0000","last_fullsized":"2023-10-06T01:41:59.926079+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:33:57.280587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.919480+0000","last_change":"2023-10-06T01:41:59.917248+0000","last_active":"2023-10-06T01:41:59.919480+0000","last_peered":"2023-10-06T01:41:59.919480+0000","last_clean":"2023-10-06T01:41:59.919480+0000","last_became_active":"2023-10-06T01:41:59.916977+0000","last_became_peered":"2023-10-06T01:41:59.916977+0000","last_unstale":"2023-10-06T01:41:59.919480+0000","last_undegraded":"2023-10-06T01:41:59.919480+0000","last_fullsized":"2023-10-06T01:41:59.919480+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:41:15.451811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"53'2","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.917779+0000","last_change":"2023-10-06T01:41:58.919223+0000","last_active":"2023-10-06T01:41:59.917779+0000","last_peered":"2023-10-06T01:41:59.917779+0000","last_clean":"2023-10-06T01:41:59.917779+0000","last_became_active":"2023-10-06T01:41:58.918835+0000","last_became_peered":"2023-10-06T01:41:58.918835+0000","last_unstale":"2023-10-06T01:41:59.917779+0000","last_undegraded":"2023-10-06T01:41:59.917779+0000","last_fullsized":"2023-10-06T01:41:59.917779+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:21:25.598775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.929947+0000","last_change":"2023-10-06T01:41:59.926743+0000","last_active":"2023-10-06T01:41:59.929947+0000","last_peered":"2023-10-06T01:41:59.929947+0000","last_clean":"2023-10-06T01:41:59.929947+0000","last_became_active":"2023-10-06T01:41:59.926475+0000","last_became_peered":"2023-10-06T01:41:59.926475+0000","last_unstale":"2023-10-06T01:41:59.929947+0000","last_undegraded":"2023-10-06T01:41:59.929947+0000","last_fullsized":"2023-10-06T01:41:59.929947+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:49:48.083851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"54'1","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T01:42:01.294427+0000","last_change":"2023-10-06T01:41:58.922702+0000","last_active":"2023-10-06T01:42:01.294427+0000","last_peered":"2023-10-06T01:42:01.294427+0000","last_clean":"2023-10-06T01:42:01.294427+0000","last_became_active":"2023-10-06T01:41:58.922346+0000","last_became_peered":"2023-10-06T01:41:58.922346+0000","last_unstale":"2023-10-06T01:42:01.294427+0000","last_undegraded":"2023-10-06T01:42:01.294427+0000","last_fullsized":"2023-10-06T01:42:01.294427+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:45:24.296902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.929329+0000","last_change":"2023-10-06T01:41:59.926045+0000","last_active":"2023-10-06T01:41:59.929329+0000","last_peered":"2023-10-06T01:41:59.929329+0000","last_clean":"2023-10-06T01:41:59.929329+0000","last_became_active":"2023-10-06T01:41:59.925804+0000","last_became_peered":"2023-10-06T01:41:59.925804+0000","last_unstale":"2023-10-06T01:41:59.929329+0000","last_undegraded":"2023-10-06T01:41:59.929329+0000","last_fullsized":"2023-10-06T01:41:59.929329+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:14:29.633116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.906684+0000","last_change":"2023-10-06T01:41:58.912477+0000","last_active":"2023-10-06T01:41:59.906684+0000","last_peered":"2023-10-06T01:41:59.906684+0000","last_clean":"2023-10-06T01:41:59.906684+0000","last_became_active":"2023-10-06T01:41:58.912169+0000","last_became_peered":"2023-10-06T01:41:58.912169+0000","last_unstale":"2023-10-06T01:41:59.906684+0000","last_undegraded":"2023-10-06T01:41:59.906684+0000","last_fullsized":"2023-10-06T01:41:59.906684+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:05:03.593533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.930473+0000","last_change":"2023-10-06T01:41:59.923227+0000","last_active":"2023-10-06T01:41:59.930473+0000","last_peered":"2023-10-06T01:41:59.930473+0000","last_clean":"2023-10-06T01:41:59.930473+0000","last_became_active":"2023-10-06T01:41:59.922959+0000","last_became_peered":"2023-10-06T01:41:59.922959+0000","last_unstale":"2023-10-06T01:41:59.930473+0000","last_undegraded":"2023-10-06T01:41:59.930473+0000","last_fullsized":"2023-10-06T01:41:59.930473+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:45:31.777277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.913128+0000","last_change":"2023-10-06T01:41:58.922312+0000","last_active":"2023-10-06T01:41:59.913128+0000","last_peered":"2023-10-06T01:41:59.913128+0000","last_clean":"2023-10-06T01:41:59.913128+0000","last_became_active":"2023-10-06T01:41:58.922064+0000","last_became_peered":"2023-10-06T01:41:58.922064+0000","last_unstale":"2023-10-06T01:41:59.913128+0000","last_undegraded":"2023-10-06T01:41:59.913128+0000","last_fullsized":"2023-10-06T01:41:59.913128+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:51:27.641984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.922007+0000","last_change":"2023-10-06T01:41:59.914243+0000","last_active":"2023-10-06T01:41:59.922007+0000","last_peered":"2023-10-06T01:41:59.922007+0000","last_clean":"2023-10-06T01:41:59.922007+0000","last_became_active":"2023-10-06T01:41:59.914009+0000","last_became_peered":"2023-10-06T01:41:59.914009+0000","last_unstale":"2023-10-06T01:41:59.922007+0000","last_undegraded":"2023-10-06T01:41:59.922007+0000","last_fullsized":"2023-10-06T01:41:59.922007+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:16:49.114729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.904614+0000","last_change":"2023-10-06T01:41:58.917481+0000","last_active":"2023-10-06T01:41:59.904614+0000","last_peered":"2023-10-06T01:41:59.904614+0000","last_clean":"2023-10-06T01:41:59.904614+0000","last_became_active":"2023-10-06T01:41:58.917211+0000","last_became_peered":"2023-10-06T01:41:58.917211+0000","last_unstale":"2023-10-06T01:41:59.904614+0000","last_undegraded":"2023-10-06T01:41:59.904614+0000","last_fullsized":"2023-10-06T01:41:59.904614+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:21:12.405145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.934166+0000","last_change":"2023-10-06T01:41:59.932298+0000","last_active":"2023-10-06T01:41:59.934166+0000","last_peered":"2023-10-06T01:41:59.934166+0000","last_clean":"2023-10-06T01:41:59.934166+0000","last_became_active":"2023-10-06T01:41:59.932063+0000","last_became_peered":"2023-10-06T01:41:59.932063+0000","last_unstale":"2023-10-06T01:41:59.934166+0000","last_undegraded":"2023-10-06T01:41:59.934166+0000","last_fullsized":"2023-10-06T01:41:59.934166+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:18:09.749842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.913765+0000","last_change":"2023-10-06T01:41:58.920213+0000","last_active":"2023-10-06T01:41:59.913765+0000","last_peered":"2023-10-06T01:41:59.913765+0000","last_clean":"2023-10-06T01:41:59.913765+0000","last_became_active":"2023-10-06T01:41:58.919959+0000","last_became_peered":"2023-10-06T01:41:58.919959+0000","last_unstale":"2023-10-06T01:41:59.913765+0000","last_undegraded":"2023-10-06T01:41:59.913765+0000","last_fullsized":"2023-10-06T01:41:59.913765+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:03:29.295425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.911536+0000","last_change":"2023-10-06T01:41:59.909458+0000","last_active":"2023-10-06T01:41:59.911536+0000","last_peered":"2023-10-06T01:41:59.911536+0000","last_clean":"2023-10-06T01:41:59.911536+0000","last_became_active":"2023-10-06T01:41:59.909209+0000","last_became_peered":"2023-10-06T01:41:59.909209+0000","last_unstale":"2023-10-06T01:41:59.911536+0000","last_undegraded":"2023-10-06T01:41:59.911536+0000","last_fullsized":"2023-10-06T01:41:59.911536+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:40:42.553317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.904596+0000","last_change":"2023-10-06T01:41:58.922092+0000","last_active":"2023-10-06T01:41:59.904596+0000","last_peered":"2023-10-06T01:41:59.904596+0000","last_clean":"2023-10-06T01:41:59.904596+0000","last_became_active":"2023-10-06T01:41:58.921857+0000","last_became_peered":"2023-10-06T01:41:58.921857+0000","last_unstale":"2023-10-06T01:41:59.904596+0000","last_undegraded":"2023-10-06T01:41:59.904596+0000","last_fullsized":"2023-10-06T01:41:59.904596+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:25:35.328771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.929945+0000","last_change":"2023-10-06T01:41:59.920941+0000","last_active":"2023-10-06T01:41:59.929945+0000","last_peered":"2023-10-06T01:41:59.929945+0000","last_clean":"2023-10-06T01:41:59.929945+0000","last_became_active":"2023-10-06T01:41:59.920261+0000","last_became_peered":"2023-10-06T01:41:59.920261+0000","last_unstale":"2023-10-06T01:41:59.929945+0000","last_undegraded":"2023-10-06T01:41:59.929945+0000","last_fullsized":"2023-10-06T01:41:59.929945+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:46:55.042870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.907622+0000","last_change":"2023-10-06T01:41:58.917439+0000","last_active":"2023-10-06T01:41:59.907622+0000","last_peered":"2023-10-06T01:41:59.907622+0000","last_clean":"2023-10-06T01:41:59.907622+0000","last_became_active":"2023-10-06T01:41:58.917205+0000","last_became_peered":"2023-10-06T01:41:58.917205+0000","last_unstale":"2023-10-06T01:41:59.907622+0000","last_undegraded":"2023-10-06T01:41:59.907622+0000","last_fullsized":"2023-10-06T01:41:59.907622+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:24:38.810483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.929966+0000","last_change":"2023-10-06T01:41:59.926557+0000","last_active":"2023-10-06T01:41:59.929966+0000","last_peered":"2023-10-06T01:41:59.929966+0000","last_clean":"2023-10-06T01:41:59.929966+0000","last_became_active":"2023-10-06T01:41:59.926287+0000","last_became_peered":"2023-10-06T01:41:59.926287+0000","last_unstale":"2023-10-06T01:41:59.929966+0000","last_undegraded":"2023-10-06T01:41:59.929966+0000","last_fullsized":"2023-10-06T01:41:59.929966+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:24:01.329759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"53'2","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.929236+0000","last_change":"2023-10-06T01:41:58.925582+0000","last_active":"2023-10-06T01:41:59.929236+0000","last_peered":"2023-10-06T01:41:59.929236+0000","last_clean":"2023-10-06T01:41:59.929236+0000","last_became_active":"2023-10-06T01:41:58.923189+0000","last_became_peered":"2023-10-06T01:41:58.923189+0000","last_unstale":"2023-10-06T01:41:59.929236+0000","last_undegraded":"2023-10-06T01:41:59.929236+0000","last_fullsized":"2023-10-06T01:41:59.929236+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:03:29.295425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":40,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.905453+0000","last_change":"2023-10-06T01:40:16.930992+0000","last_active":"2023-10-06T01:41:59.905453+0000","last_peered":"2023-10-06T01:41:59.905453+0000","last_clean":"2023-10-06T01:41:59.905453+0000","last_became_active":"2023-10-06T01:40:16.930707+0000","last_became_peered":"2023-10-06T01:40:16.930707+0000","last_unstale":"2023-10-06T01:41:59.905453+0000","last_undegraded":"2023-10-06T01:41:59.905453+0000","last_fullsized":"2023-10-06T01:41:59.905453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:52:43.316071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.930150+0000","last_change":"2023-10-06T01:41:59.927285+0000","last_active":"2023-10-06T01:41:59.930150+0000","last_peered":"2023-10-06T01:41:59.930150+0000","last_clean":"2023-10-06T01:41:59.930150+0000","last_became_active":"2023-10-06T01:41:59.927007+0000","last_became_peered":"2023-10-06T01:41:59.927007+0000","last_unstale":"2023-10-06T01:41:59.930150+0000","last_undegraded":"2023-10-06T01:41:59.930150+0000","last_fullsized":"2023-10-06T01:41:59.930150+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:30:18.755143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.911795+0000","last_change":"2023-10-06T01:41:58.922335+0000","last_active":"2023-10-06T01:41:59.911795+0000","last_peered":"2023-10-06T01:41:59.911795+0000","last_clean":"2023-10-06T01:41:59.911795+0000","last_became_active":"2023-10-06T01:41:58.922038+0000","last_became_peered":"2023-10-06T01:41:58.922038+0000","last_unstale":"2023-10-06T01:41:59.911795+0000","last_undegraded":"2023-10-06T01:41:59.911795+0000","last_fullsized":"2023-10-06T01:41:59.911795+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:58:36.151365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":40,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.911754+0000","last_change":"2023-10-06T01:40:16.651019+0000","last_active":"2023-10-06T01:41:59.911754+0000","last_peered":"2023-10-06T01:41:59.911754+0000","last_clean":"2023-10-06T01:41:59.911754+0000","last_became_active":"2023-10-06T01:40:16.650628+0000","last_became_peered":"2023-10-06T01:40:16.650628+0000","last_unstale":"2023-10-06T01:41:59.911754+0000","last_undegraded":"2023-10-06T01:41:59.911754+0000","last_fullsized":"2023-10-06T01:41:59.911754+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:11:57.218984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.921909+0000","last_change":"2023-10-06T01:41:59.918092+0000","last_active":"2023-10-06T01:41:59.921909+0000","last_peered":"2023-10-06T01:41:59.921909+0000","last_clean":"2023-10-06T01:41:59.921909+0000","last_became_active":"2023-10-06T01:41:59.917798+0000","last_became_peered":"2023-10-06T01:41:59.917798+0000","last_unstale":"2023-10-06T01:41:59.921909+0000","last_undegraded":"2023-10-06T01:41:59.921909+0000","last_fullsized":"2023-10-06T01:41:59.921909+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:07:25.736314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"53'2","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.927936+0000","last_change":"2023-10-06T01:41:58.918081+0000","last_active":"2023-10-06T01:41:59.927936+0000","last_peered":"2023-10-06T01:41:59.927936+0000","last_clean":"2023-10-06T01:41:59.927936+0000","last_became_active":"2023-10-06T01:41:58.912873+0000","last_became_peered":"2023-10-06T01:41:58.912873+0000","last_unstale":"2023-10-06T01:41:59.927936+0000","last_undegraded":"2023-10-06T01:41:59.927936+0000","last_fullsized":"2023-10-06T01:41:59.927936+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:03:29.295425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":39,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.910695+0000","last_change":"2023-10-06T01:40:16.781596+0000","last_active":"2023-10-06T01:41:59.910695+0000","last_peered":"2023-10-06T01:41:59.910695+0000","last_clean":"2023-10-06T01:41:59.910695+0000","last_became_active":"2023-10-06T01:40:16.781352+0000","last_became_peered":"2023-10-06T01:40:16.781352+0000","last_unstale":"2023-10-06T01:41:59.910695+0000","last_undegraded":"2023-10-06T01:41:59.910695+0000","last_fullsized":"2023-10-06T01:41:59.910695+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:52:43.316071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.927383+0000","last_change":"2023-10-06T01:41:59.917119+0000","last_active":"2023-10-06T01:41:59.927383+0000","last_peered":"2023-10-06T01:41:59.927383+0000","last_clean":"2023-10-06T01:41:59.927383+0000","last_became_active":"2023-10-06T01:41:59.915854+0000","last_became_peered":"2023-10-06T01:41:59.915854+0000","last_unstale":"2023-10-06T01:41:59.927383+0000","last_undegraded":"2023-10-06T01:41:59.927383+0000","last_fullsized":"2023-10-06T01:41:59.927383+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:01:49.563771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.907271+0000","last_change":"2023-10-06T01:41:58.923132+0000","last_active":"2023-10-06T01:41:59.907271+0000","last_peered":"2023-10-06T01:41:59.907271+0000","last_clean":"2023-10-06T01:41:59.907271+0000","last_became_active":"2023-10-06T01:41:58.922860+0000","last_became_peered":"2023-10-06T01:41:58.922860+0000","last_unstale":"2023-10-06T01:41:59.907271+0000","last_undegraded":"2023-10-06T01:41:59.907271+0000","last_fullsized":"2023-10-06T01:41:59.907271+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:24:20.800050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":40,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.911629+0000","last_change":"2023-10-06T01:40:16.650826+0000","last_active":"2023-10-06T01:41:59.911629+0000","last_peered":"2023-10-06T01:41:59.911629+0000","last_clean":"2023-10-06T01:41:59.911629+0000","last_became_active":"2023-10-06T01:40:16.650469+0000","last_became_peered":"2023-10-06T01:40:16.650469+0000","last_unstale":"2023-10-06T01:41:59.911629+0000","last_undegraded":"2023-10-06T01:41:59.911629+0000","last_fullsized":"2023-10-06T01:41:59.911629+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:50:23.628212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":192,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.910822+0000","last_change":"2023-10-06T01:40:10.645512+0000","last_active":"2023-10-06T01:41:59.910822+0000","last_peered":"2023-10-06T01:41:59.910822+0000","last_clean":"2023-10-06T01:41:59.910822+0000","last_became_active":"2023-10-06T01:40:10.644601+0000","last_became_peered":"2023-10-06T01:40:10.644601+0000","last_unstale":"2023-10-06T01:41:59.910822+0000","last_undegraded":"2023-10-06T01:41:59.910822+0000","last_fullsized":"2023-10-06T01:41:59.910822+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:09.580865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:09.580865+0000","last_clean_scrub_stamp":"2023-10-06T01:40:09.580865+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:05:28.268591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.930194+0000","last_change":"2023-10-06T01:41:59.927385+0000","last_active":"2023-10-06T01:41:59.930194+0000","last_peered":"2023-10-06T01:41:59.930194+0000","last_clean":"2023-10-06T01:41:59.930194+0000","last_became_active":"2023-10-06T01:41:59.926980+0000","last_became_peered":"2023-10-06T01:41:59.926980+0000","last_unstale":"2023-10-06T01:41:59.930194+0000","last_undegraded":"2023-10-06T01:41:59.930194+0000","last_fullsized":"2023-10-06T01:41:59.930194+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:46:55.042870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.904596+0000","last_change":"2023-10-06T01:41:58.920513+0000","last_active":"2023-10-06T01:41:59.904596+0000","last_peered":"2023-10-06T01:41:59.904596+0000","last_clean":"2023-10-06T01:41:59.904596+0000","last_became_active":"2023-10-06T01:41:58.920202+0000","last_became_peered":"2023-10-06T01:41:58.920202+0000","last_unstale":"2023-10-06T01:41:59.904596+0000","last_undegraded":"2023-10-06T01:41:59.904596+0000","last_fullsized":"2023-10-06T01:41:59.904596+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:53:53.773734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":39,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.913027+0000","last_change":"2023-10-06T01:40:16.651332+0000","last_active":"2023-10-06T01:41:59.913027+0000","last_peered":"2023-10-06T01:41:59.913027+0000","last_clean":"2023-10-06T01:41:59.913027+0000","last_became_active":"2023-10-06T01:40:16.651049+0000","last_became_peered":"2023-10-06T01:40:16.651049+0000","last_unstale":"2023-10-06T01:41:59.913027+0000","last_undegraded":"2023-10-06T01:41:59.913027+0000","last_fullsized":"2023-10-06T01:41:59.913027+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:11:57.218984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.934094+0000","last_change":"2023-10-06T01:41:59.927274+0000","last_active":"2023-10-06T01:41:59.934094+0000","last_peered":"2023-10-06T01:41:59.934094+0000","last_clean":"2023-10-06T01:41:59.934094+0000","last_became_active":"2023-10-06T01:41:59.926995+0000","last_became_peered":"2023-10-06T01:41:59.926995+0000","last_unstale":"2023-10-06T01:41:59.934094+0000","last_undegraded":"2023-10-06T01:41:59.934094+0000","last_fullsized":"2023-10-06T01:41:59.934094+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:41:15.451811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"53'1","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.927945+0000","last_change":"2023-10-06T01:41:58.923811+0000","last_active":"2023-10-06T01:41:59.927945+0000","last_peered":"2023-10-06T01:41:59.927945+0000","last_clean":"2023-10-06T01:41:59.927945+0000","last_became_active":"2023-10-06T01:41:58.923398+0000","last_became_peered":"2023-10-06T01:41:58.923398+0000","last_unstale":"2023-10-06T01:41:59.927945+0000","last_undegraded":"2023-10-06T01:41:59.927945+0000","last_fullsized":"2023-10-06T01:41:59.927945+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:01:32.487705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":39,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.915576+0000","last_change":"2023-10-06T01:40:16.931106+0000","last_active":"2023-10-06T01:41:59.915576+0000","last_peered":"2023-10-06T01:41:59.915576+0000","last_clean":"2023-10-06T01:41:59.915576+0000","last_became_active":"2023-10-06T01:40:16.930830+0000","last_became_peered":"2023-10-06T01:40:16.930830+0000","last_unstale":"2023-10-06T01:41:59.915576+0000","last_undegraded":"2023-10-06T01:41:59.915576+0000","last_fullsized":"2023-10-06T01:41:59.915576+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:50:23.628212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.934292+0000","last_change":"2023-10-06T01:41:59.931026+0000","last_active":"2023-10-06T01:41:59.934292+0000","last_peered":"2023-10-06T01:41:59.934292+0000","last_clean":"2023-10-06T01:41:59.934292+0000","last_became_active":"2023-10-06T01:41:59.930478+0000","last_became_peered":"2023-10-06T01:41:59.930478+0000","last_unstale":"2023-10-06T01:41:59.934292+0000","last_undegraded":"2023-10-06T01:41:59.934292+0000","last_fullsized":"2023-10-06T01:41:59.934292+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:07:25.736314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.923186+0000","last_change":"2023-10-06T01:41:58.923417+0000","last_active":"2023-10-06T01:41:59.923186+0000","last_peered":"2023-10-06T01:41:59.923186+0000","last_clean":"2023-10-06T01:41:59.923186+0000","last_became_active":"2023-10-06T01:41:58.922483+0000","last_became_peered":"2023-10-06T01:41:58.922483+0000","last_unstale":"2023-10-06T01:41:59.923186+0000","last_undegraded":"2023-10-06T01:41:59.923186+0000","last_fullsized":"2023-10-06T01:41:59.923186+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:07:24.731136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":40,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.904999+0000","last_change":"2023-10-06T01:40:16.649379+0000","last_active":"2023-10-06T01:41:59.904999+0000","last_peered":"2023-10-06T01:41:59.904999+0000","last_clean":"2023-10-06T01:41:59.904999+0000","last_became_active":"2023-10-06T01:40:16.649147+0000","last_became_peered":"2023-10-06T01:40:16.649147+0000","last_unstale":"2023-10-06T01:41:59.904999+0000","last_undegraded":"2023-10-06T01:41:59.904999+0000","last_fullsized":"2023-10-06T01:41:59.904999+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:11:57.218984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.929827+0000","last_change":"2023-10-06T01:41:59.928829+0000","last_active":"2023-10-06T01:41:59.929827+0000","last_peered":"2023-10-06T01:41:59.929827+0000","last_clean":"2023-10-06T01:41:59.929827+0000","last_became_active":"2023-10-06T01:41:59.928576+0000","last_became_peered":"2023-10-06T01:41:59.928576+0000","last_unstale":"2023-10-06T01:41:59.929827+0000","last_undegraded":"2023-10-06T01:41:59.929827+0000","last_fullsized":"2023-10-06T01:41:59.929827+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:58.896742+0000","last_clean_scrub_stamp":"2023-10-06T01:41:58.896742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:18:41.923790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"53'1","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.926239+0000","last_change":"2023-10-06T01:41:58.926962+0000","last_active":"2023-10-06T01:41:59.926239+0000","last_peered":"2023-10-06T01:41:59.926239+0000","last_clean":"2023-10-06T01:41:59.926239+0000","last_became_active":"2023-10-06T01:41:58.926758+0000","last_became_peered":"2023-10-06T01:41:58.926758+0000","last_unstale":"2023-10-06T01:41:59.926239+0000","last_undegraded":"2023-10-06T01:41:59.926239+0000","last_fullsized":"2023-10-06T01:41:59.926239+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:41:57.891564+0000","last_clean_scrub_stamp":"2023-10-06T01:41:57.891564+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:58:35.816250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":41,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-10-06T01:41:59.907510+0000","last_change":"2023-10-06T01:40:16.651477+0000","last_active":"2023-10-06T01:41:59.907510+0000","last_peered":"2023-10-06T01:41:59.907510+0000","last_clean":"2023-10-06T01:41:59.907510+0000","last_became_active":"2023-10-06T01:40:16.651190+0000","last_became_peered":"2023-10-06T01:40:16.651190+0000","last_unstale":"2023-10-06T01:41:59.907510+0000","last_undegraded":"2023-10-06T01:41:59.907510+0000","last_fullsized":"2023-10-06T01:41:59.907510+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:45:47.422876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574875,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298504,"kb_used_data":1216,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073336,"statfs":{"total":96636764160,"available":96331096064,"internally_reserved":0,"allocated":1245184,"data_stored":886499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:41:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":3.6920000000000002,"5min":3.6920000000000002,"15min":3.6920000000000002},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":3.629,"5min":3.629,"15min":3.629},"last":0.40400000000000003}]},{"osd":1,"last update":"Fri Oct 6 01:41:11 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":10.029999999999999,"5min":10.029999999999999,"15min":10.029999999999999},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.544,"5min":1.544,"15min":1.544},"last":0.53400000000000003}]},{"osd":2,"last update":"Fri Oct 6 01:41:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.54900000000000004},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":10.710000000000001,"5min":10.710000000000001,"15min":10.710000000000001},"last":0.46700000000000003}]},{"osd":3,"last update":"Fri Oct 6 01:41:11 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.437},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":3.6509999999999998,"5min":3.6509999999999998,"15min":3.6509999999999998},"last":0.51900000000000002}]},{"osd":4,"last update":"Fri Oct 6 01:41:11 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.49299999999999999}]},{"osd":5,"last update":"Fri Oct 6 01:41:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.7509999999999999,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":0.47899999999999998}]},{"osd":6,"last update":"Fri Oct 6 01:41:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.9370000000000001,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.57699999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574875,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297916,"kb_used_data":628,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073924,"statfs":{"total":96636764160,"available":96331698176,"internally_reserved":0,"allocated":643072,"data_stored":295971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.621}]},{"osd":1,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.48599999999999999}]},{"osd":2,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.441},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.65300000000000002}]},{"osd":3,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.51100000000000001}]},{"osd":4,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.67500000000000004}]},{"osd":5,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.57399999999999995}]},{"osd":7,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.56399999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574875,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297920,"kb_used_data":632,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073920,"statfs":{"total":96636764160,"available":96331694080,"internally_reserved":0,"allocated":647168,"data_stored":296061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.997,"15min":0.997},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":11.957000000000001,"5min":11.957000000000001,"15min":11.957000000000001},"last":0.253},{"interface":"front","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":11.917,"5min":11.917,"15min":11.917},"last":0.28999999999999998}]},{"osd":2,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.33200000000000002}]},{"osd":3,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":6.2450000000000001,"5min":6.2450000000000001,"15min":6.2450000000000001},"last":0.308},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":6.2939999999999996,"5min":6.2939999999999996,"15min":6.2939999999999996},"last":0.32200000000000001}]},{"osd":4,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":6.1669999999999998,"5min":6.1669999999999998,"15min":6.1669999999999998},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.45000000000000001}]},{"osd":5,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":6.2619999999999996,"5min":6.2619999999999996,"15min":6.2619999999999996},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":6.2350000000000003,"5min":6.2350000000000003,"15min":6.2350000000000003},"last":0.48999999999999999}]},{"osd":6,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":6.141,"5min":6.141,"15min":6.141},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":6.2069999999999999,"5min":6.2069999999999999,"15min":6.2069999999999999},"last":0.50700000000000001}]},{"osd":7,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":6.1040000000000001,"5min":6.1040000000000001,"15min":6.1040000000000001},"last":0.497}]}]},{"osd":0,"up_from":13,"seq":55834574875,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298508,"kb_used_data":1220,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073332,"statfs":{"total":96636764160,"available":96331091968,"internally_reserved":0,"allocated":1249280,"data_stored":887468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":3.9129999999999998,"5min":3.9129999999999998,"15min":3.9129999999999998},"last":0.36499999999999999}]},{"osd":2,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":15.237,"5min":15.237,"15min":15.237},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":3.7959999999999998,"5min":3.7959999999999998,"15min":3.7959999999999998},"last":0.441}]},{"osd":3,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":5.2850000000000001,"5min":5.2850000000000001,"15min":5.2850000000000001},"last":0.34899999999999998},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":15.263,"5min":15.263,"15min":15.263},"last":0.51200000000000001}]},{"osd":4,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":5.2590000000000003,"5min":5.2590000000000003,"15min":5.2590000000000003},"last":0.57099999999999995},{"interface":"front","average":{"1min":1.242,"5min":1.242,"15min":1.242},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":15.211,"5min":15.211,"15min":15.211},"last":0.54700000000000004}]},{"osd":5,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":3.8839999999999999,"5min":3.8839999999999999,"15min":3.8839999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":5.2309999999999999,"5min":5.2309999999999999,"15min":5.2309999999999999},"last":0.53200000000000003}]},{"osd":6,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.212,"15min":1.212},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":15.175000000000001,"5min":15.175000000000001,"15min":15.175000000000001},"last":0.628},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":3.859,"5min":3.859,"15min":3.859},"last":0.58199999999999996}]},{"osd":7,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":3.831,"5min":3.831,"15min":3.831},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":5.1959999999999997,"5min":5.1959999999999997,"15min":5.1959999999999997},"last":0.59199999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574875,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297924,"kb_used_data":636,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073916,"statfs":{"total":96636764160,"available":96331689984,"internally_reserved":0,"allocated":651264,"data_stored":296027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"last":0.46200000000000002}]},{"osd":1,"last update":"Fri Oct 6 01:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.311,"15min":0.311},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"last":0.374},{"interface":"front","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.49199999999999999}]},{"osd":3,"last update":"Fri Oct 6 01:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.432}]},{"osd":4,"last update":"Fri Oct 6 01:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.60499999999999998}]},{"osd":5,"last update":"Fri Oct 6 01:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.55400000000000005}]},{"osd":6,"last update":"Fri Oct 6 01:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.54300000000000004}]},{"osd":7,"last update":"Fri Oct 6 01:41:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.63600000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574875,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297924,"kb_used_data":636,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073916,"statfs":{"total":96636764160,"available":96331689984,"internally_reserved":0,"allocated":651264,"data_stored":296027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.29799999999999999}]},{"osd":1,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.23599999999999999},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.35999999999999999}]},{"osd":2,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.316},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.38700000000000001}]},{"osd":4,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.48099999999999998}]},{"osd":5,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.49099999999999999}]},{"osd":6,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.46700000000000003}]},{"osd":7,"last update":"Fri Oct 6 01:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.437},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.503}]}]},{"osd":4,"up_from":13,"seq":55834574875,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297928,"kb_used_data":640,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073912,"statfs":{"total":96636764160,"available":96331685888,"internally_reserved":0,"allocated":655360,"data_stored":297507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.54900000000000004}]},{"osd":1,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":4.0780000000000003,"5min":4.0780000000000003,"15min":4.0780000000000003},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":4.1050000000000004,"5min":4.1050000000000004,"15min":4.1050000000000004},"last":0.57999999999999996}]},{"osd":2,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.52700000000000002}]},{"osd":3,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.64400000000000002}]},{"osd":5,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.437,"15min":0.437},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.621},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.63200000000000001}]},{"osd":6,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.65800000000000003}]},{"osd":7,"last update":"Fri Oct 6 01:41:09 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.67600000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574875,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297924,"kb_used_data":636,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073916,"statfs":{"total":96636764160,"available":96331689984,"internally_reserved":0,"allocated":651264,"data_stored":296595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.52200000000000002}]},{"osd":1,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.622},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.59899999999999998}]},{"osd":2,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.6970000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.54700000000000004}]},{"osd":3,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.58699999999999997}]},{"osd":4,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.41799999999999998}]},{"osd":6,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.437},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.45700000000000002}]},{"osd":7,"last update":"Fri Oct 6 01:41:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.821,"5min":1.821,"15min":1.821},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.50600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T01:42:08.831 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T01:42:08.832 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-06T01:42:08.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.986+0000 7f65f99bd700 1 Processor -- start 2023-10-06T01:42:08.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.986+0000 7f65f99bd700 1 -- start start 2023-10-06T01:42:08.989 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.987+0000 7f65f99bd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f65f40af360 0x7f65f415a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:08.989 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.987+0000 7f65f99bd700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f65f40af730 0x7f65f40ccb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:08.989 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.987+0000 7f65f99bd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f65f415d120 0x7f65f40cd050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:08.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.987+0000 7f65f99bd700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65f40ce6e0 con 0x7f65f40af730 2023-10-06T01:42:08.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.987+0000 7f65f99bd700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65f4159a30 con 0x7f65f40af360 2023-10-06T01:42:08.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.987+0000 7f65f99bd700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65f415aab0 con 0x7f65f415d120 2023-10-06T01:42:08.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.987+0000 7f65ebfff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f65f40af730 0x7f65f40ccb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:08.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.987+0000 7f65ebfff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f65f40af730 0x7f65f40ccb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38110/0 (socket says 172.21.15.71:38110) 2023-10-06T01:42:08.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.987+0000 7f65ebfff700 1 -- 172.21.15.71:0/3353734781 learned_addr learned my addr 172.21.15.71:0/3353734781 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:08.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.987+0000 7f65f91bc700 1 --2- 172.21.15.71:0/3353734781 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f65f415d120 0x7f65f40cd050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:08.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.987+0000 7f65f89bb700 1 --2- 172.21.15.71:0/3353734781 >> v2:172.21.15.72:3300/0 conn(0x7f65f40af360 0x7f65f415a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:08.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.987+0000 7f65ebfff700 1 -- 172.21.15.71:0/3353734781 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f65f415d120 msgr2=0x7f65f40cd050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:08.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.987+0000 7f65ebfff700 1 --2- 172.21.15.71:0/3353734781 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f65f415d120 0x7f65f40cd050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:08.990 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.987+0000 7f65ebfff700 1 -- 172.21.15.71:0/3353734781 >> v2:172.21.15.72:3300/0 conn(0x7f65f40af360 msgr2=0x7f65f415a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:08.991 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.987+0000 7f65ebfff700 1 --2- 172.21.15.71:0/3353734781 >> v2:172.21.15.72:3300/0 conn(0x7f65f40af360 0x7f65f415a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:08.991 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.987+0000 7f65ebfff700 1 -- 172.21.15.71:0/3353734781 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65f415d6c0 con 0x7f65f40af730 2023-10-06T01:42:08.991 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.987+0000 7f65ebfff700 1 --2- 172.21.15.71:0/3353734781 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65f40af730 0x7f65f40ccb10 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f65f40cdcf0 tx=0x7f65e4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9d404c895bfbd71 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:08.991 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.988+0000 7f65eb7fe700 1 -- 172.21.15.71:0/3353734781 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e400b860 con 0x7f65f40af730 2023-10-06T01:42:08.991 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.988+0000 7f65eb7fe700 1 -- 172.21.15.71:0/3353734781 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65e400b9c0 con 0x7f65f40af730 2023-10-06T01:42:08.991 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.988+0000 7f65eb7fe700 1 -- 172.21.15.71:0/3353734781 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e400bd60 con 0x7f65f40af730 2023-10-06T01:42:08.991 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.988+0000 7f65f99bd700 1 -- 172.21.15.71:0/3353734781 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65f40af730 msgr2=0x7f65f40ccb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:08.991 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.988+0000 7f65f99bd700 1 --2- 172.21.15.71:0/3353734781 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65f40af730 0x7f65f40ccb10 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f65f40cdcf0 tx=0x7f65e4009250 comp rx=0 tx=0).stop 2023-10-06T01:42:08.991 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.988+0000 7f65f99bd700 1 -- 172.21.15.71:0/3353734781 shutdown_connections 2023-10-06T01:42:08.991 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.988+0000 7f65f99bd700 1 --2- 172.21.15.71:0/3353734781 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f65f415d120 0x7f65f40cd050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:08.991 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.988+0000 7f65f99bd700 1 --2- 172.21.15.71:0/3353734781 >> v2:172.21.15.72:3300/0 conn(0x7f65f40af360 0x7f65f415a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:08.991 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.988+0000 7f65f99bd700 1 --2- 172.21.15.71:0/3353734781 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65f40af730 0x7f65f40ccb10 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:08.992 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.988+0000 7f65f99bd700 1 -- 172.21.15.71:0/3353734781 >> 172.21.15.71:0/3353734781 conn(0x7f65f4068680 msgr2=0x7f65f4068a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:08.992 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.988+0000 7f65f99bd700 1 -- 172.21.15.71:0/3353734781 shutdown_connections 2023-10-06T01:42:08.992 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.988+0000 7f65f99bd700 1 -- 172.21.15.71:0/3353734781 wait complete. 2023-10-06T01:42:08.994 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.989+0000 7f65f99bd700 1 Processor -- start 2023-10-06T01:42:08.994 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.989+0000 7f65f99bd700 1 -- start start 2023-10-06T01:42:08.994 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.990+0000 7f65f99bd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f65f40af360 0x7f65f414be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:08.995 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.990+0000 7f65f99bd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f65f40af730 0x7f65f40c7220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:08.995 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.990+0000 7f65f99bd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65f415d120 0x7f65f40b1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:08.995 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.990+0000 7f65f99bd700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f416a280 con 0x7f65f415d120 2023-10-06T01:42:08.995 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.990+0000 7f65f99bd700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f4169670 con 0x7f65f40af360 2023-10-06T01:42:08.995 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.990+0000 7f65f99bd700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65f4169950 con 0x7f65f40af730 2023-10-06T01:42:08.995 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.990+0000 7f65f91bc700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65f415d120 0x7f65f40b1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:08.995 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.990+0000 7f65f91bc700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65f415d120 0x7f65f40b1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:38120/0 (socket says 172.21.15.71:38120) 2023-10-06T01:42:08.995 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.990+0000 7f65f91bc700 1 -- 172.21.15.71:0/425504511 learned_addr learned my addr 172.21.15.71:0/425504511 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:08.995 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.990+0000 7f65f89bb700 1 --2- 172.21.15.71:0/425504511 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f65f40af360 0x7f65f414be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:08.995 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.990+0000 7f65ebfff700 1 --2- 172.21.15.71:0/425504511 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f65f40af730 0x7f65f40c7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:08.995 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.991+0000 7f65f91bc700 1 -- 172.21.15.71:0/425504511 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f65f40af730 msgr2=0x7f65f40c7220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:08.996 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.991+0000 7f65f91bc700 1 --2- 172.21.15.71:0/425504511 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f65f40af730 0x7f65f40c7220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:08.996 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.991+0000 7f65f91bc700 1 -- 172.21.15.71:0/425504511 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f65f40af360 msgr2=0x7f65f414be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:08.996 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.991+0000 7f65f91bc700 1 --2- 172.21.15.71:0/425504511 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f65f40af360 0x7f65f414be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:08.996 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.991+0000 7f65f91bc700 1 -- 172.21.15.71:0/425504511 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65e40094f0 con 0x7f65f415d120 2023-10-06T01:42:08.996 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.991+0000 7f65f89bb700 1 --2- 172.21.15.71:0/425504511 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f65f40af360 0x7f65f414be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:42:08.996 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.991+0000 7f65ebfff700 1 --2- 172.21.15.71:0/425504511 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f65f40af730 0x7f65f40c7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:42:08.996 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.991+0000 7f65f91bc700 1 --2- 172.21.15.71:0/425504511 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65f415d120 0x7f65f40b1da0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f65ec009fa0 tx=0x7f65ec009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:08.996 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.991+0000 7f65e8ff9700 1 -- 172.21.15.71:0/425504511 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65ec00ed20 con 0x7f65f415d120 2023-10-06T01:42:08.996 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.991+0000 7f65e8ff9700 1 -- 172.21.15.71:0/425504511 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65ec00ee80 con 0x7f65f415d120 2023-10-06T01:42:08.996 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.991+0000 7f65f99bd700 1 -- 172.21.15.71:0/425504511 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65f4169c30 con 0x7f65f415d120 2023-10-06T01:42:08.996 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.991+0000 7f65e8ff9700 1 -- 172.21.15.71:0/425504511 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65ec014670 con 0x7f65f415d120 2023-10-06T01:42:08.997 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.991+0000 7f65f99bd700 1 -- 172.21.15.71:0/425504511 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65f414c340 con 0x7f65f415d120 2023-10-06T01:42:08.997 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.992+0000 7f65f99bd700 1 -- 172.21.15.71:0/425504511 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65f4064aa0 con 0x7f65f415d120 2023-10-06T01:42:08.997 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.992+0000 7f65e8ff9700 1 -- 172.21.15.71:0/425504511 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f65ec0149e0 con 0x7f65f415d120 2023-10-06T01:42:08.997 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.993+0000 7f65e8ff9700 1 --2- 172.21.15.71:0/425504511 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f65e0066f30 0x7f65e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:08.997 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.993+0000 7f65f89bb700 1 --2- 172.21.15.71:0/425504511 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f65e0066f30 0x7f65e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:08.997 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.993+0000 7f65e8ff9700 1 -- 172.21.15.71:0/425504511 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f65ec084fc0 con 0x7f65f415d120 2023-10-06T01:42:08.997 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.993+0000 7f65f89bb700 1 --2- 172.21.15.71:0/425504511 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f65e0066f30 0x7f65e00693e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f65f0006fd0 tx=0x7f65f0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:08.997 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:08.997+0000 7f65e8ff9700 1 -- 172.21.15.71:0/425504511 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f65ec051f90 con 0x7f65f415d120 2023-10-06T01:42:09.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:09.254+0000 7f65f99bd700 1 -- 172.21.15.71:0/425504511 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f65f4068420 con 0x7f65f415d120 2023-10-06T01:42:09.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:09.257+0000 7f65e8ff9700 1 -- 172.21.15.71:0/425504511 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) v1 ==== 190+0+0 (secure 0 0 0) 0x7f65ec0555b0 con 0x7f65f415d120 2023-10-06T01:42:09.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:09.259+0000 7f65f99bd700 1 -- 172.21.15.71:0/425504511 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f65e0066f30 msgr2=0x7f65e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:09.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:09.259+0000 7f65f99bd700 1 --2- 172.21.15.71:0/425504511 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f65e0066f30 0x7f65e00693e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f65f0006fd0 tx=0x7f65f0008040 comp rx=0 tx=0).stop 2023-10-06T01:42:09.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:09.259+0000 7f65f99bd700 1 -- 172.21.15.71:0/425504511 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65f415d120 msgr2=0x7f65f40b1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:09.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:09.259+0000 7f65f99bd700 1 --2- 172.21.15.71:0/425504511 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65f415d120 0x7f65f40b1da0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f65ec009fa0 tx=0x7f65ec009900 comp rx=0 tx=0).stop 2023-10-06T01:42:09.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:09.259+0000 7f65f99bd700 1 -- 172.21.15.71:0/425504511 shutdown_connections 2023-10-06T01:42:09.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:09.260+0000 7f65f99bd700 1 --2- 172.21.15.71:0/425504511 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f65f415d120 0x7f65f40b1da0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:09.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:09.260+0000 7f65f99bd700 1 --2- 172.21.15.71:0/425504511 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f65e0066f30 0x7f65e00693e0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:09.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:09.260+0000 7f65f99bd700 1 --2- 172.21.15.71:0/425504511 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f65f40af360 0x7f65f414be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:09.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:09.260+0000 7f65f99bd700 1 --2- 172.21.15.71:0/425504511 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f65f40af730 0x7f65f40c7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:09.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:09.260+0000 7f65f99bd700 1 -- 172.21.15.71:0/425504511 >> 172.21.15.71:0/425504511 conn(0x7f65f4068680 msgr2=0x7f65f4158090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:09.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:09.260+0000 7f65f99bd700 1 -- 172.21.15.71:0/425504511 shutdown_connections 2023-10-06T01:42:09.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:09.260+0000 7f65f99bd700 1 -- 172.21.15.71:0/425504511 wait complete. 2023-10-06T01:42:09.262 INFO:teuthology.orchestra.run.smithi071.stderr:updated caps for client.0 2023-10-06T01:42:09.272 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T01:42:09.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:09.386+0000 7fec4b9e2700 1 Processor -- start 2023-10-06T01:42:09.387 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:09.386+0000 7fec4b9e2700 1 -- start start 2023-10-06T01:42:09.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:09.387+0000 7fec4b9e2700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fec440af4e0 0x7fec440b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:09.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:09.387+0000 7fec4b9e2700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fec440af8b0 0x7fec440b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:09.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:09.387+0000 7fec4b9e2700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec4415e190 con 0x7fec4415d460 2023-10-06T01:42:09.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:09.387+0000 7fec4b9e2700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec440b1910 con 0x7fec440af4e0 2023-10-06T01:42:09.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:09.387+0000 7fec4b9e2700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec4415dfa0 con 0x7fec440af8b0 2023-10-06T01:42:09.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:09.387+0000 7fec4977e700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fec440af4e0 0x7fec440b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:09.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:09.387+0000 7fec49f7f700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fec4415d460 0x7fec4415d890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:48980/0 (socket says 172.21.15.71:48980) 2023-10-06T01:42:09.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:09.387+0000 7fec49f7f700 1 -- 172.21.15.71:0/4202349916 learned_addr learned my addr 172.21.15.71:0/4202349916 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:42:09.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:09.387+0000 7fec48f7d700 1 --2- 172.21.15.71:0/4202349916 >> v2:172.21.15.72:3300/0 conn(0x7fec440af8b0 0x7fec440b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:09.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:09.387+0000 7fec4977e700 1 -- 172.21.15.71:0/4202349916 >> v2:172.21.15.72:3300/0 conn(0x7fec440af8b0 msgr2=0x7fec440b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:09.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:09.387+0000 7fec4977e700 1 --2- 172.21.15.71:0/4202349916 >> v2:172.21.15.72:3300/0 conn(0x7fec440af8b0 0x7fec440b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:09.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:09.387+0000 7fec4977e700 1 -- 172.21.15.71:0/4202349916 >> v1:172.21.15.71:6789/0 conn(0x7fec4415d460 legacy=0x7fec4415d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:09.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:09.387+0000 7fec4977e700 1 -- 172.21.15.71:0/4202349916 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec440cb650 con 0x7fec440af4e0 2023-10-06T01:42:09.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:09.387+0000 7fec48f7d700 1 --2- 172.21.15.71:0/4202349916 >> v2:172.21.15.72:3300/0 conn(0x7fec440af8b0 0x7fec440b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:42:09.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:09.387+0000 7fec4977e700 1 --2- 172.21.15.71:0/4202349916 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec440af4e0 0x7fec440b20e0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fec440cdd50 tx=0x7fec400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=292e013071e8d70f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:09.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:09.387+0000 7fec3bfff700 1 -- 172.21.15.71:0/4202349916 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec4000b6b0 con 0x7fec440af4e0 2023-10-06T01:42:09.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:09.387+0000 7fec3bfff700 1 -- 172.21.15.71:0/4202349916 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec4000b810 con 0x7fec440af4e0 2023-10-06T01:42:09.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:09.387+0000 7fec3bfff700 1 -- 172.21.15.71:0/4202349916 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec4000bbb0 con 0x7fec440af4e0 2023-10-06T01:42:09.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:09.388+0000 7fec4b9e2700 1 -- 172.21.15.71:0/4202349916 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec440af4e0 msgr2=0x7fec440b20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:09.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:09.388+0000 7fec4b9e2700 1 --2- 172.21.15.71:0/4202349916 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec440af4e0 0x7fec440b20e0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fec440cdd50 tx=0x7fec400091a0 comp rx=0 tx=0).stop 2023-10-06T01:42:09.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:09.388+0000 7fec4b9e2700 1 -- 172.21.15.71:0/4202349916 shutdown_connections 2023-10-06T01:42:09.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:09.388+0000 7fec4b9e2700 1 --2- 172.21.15.71:0/4202349916 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec440af4e0 0x7fec440b20e0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:09.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:09.388+0000 7fec4b9e2700 1 --2- 172.21.15.71:0/4202349916 >> v2:172.21.15.72:3300/0 conn(0x7fec440af8b0 0x7fec440b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:09.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:09.388+0000 7fec4b9e2700 1 -- 172.21.15.71:0/4202349916 >> 172.21.15.71:0/4202349916 conn(0x7fec44068680 msgr2=0x7fec44068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:09.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:09.388+0000 7fec4b9e2700 1 -- 172.21.15.71:0/4202349916 shutdown_connections 2023-10-06T01:42:09.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:09.388+0000 7fec4b9e2700 1 -- 172.21.15.71:0/4202349916 wait complete. 2023-10-06T01:42:09.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:09.389+0000 7fec4b9e2700 1 Processor -- start 2023-10-06T01:42:09.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:09.389+0000 7fec4b9e2700 1 -- start start 2023-10-06T01:42:09.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:09.390+0000 7fec4b9e2700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec440af4e0 0x7fec440d0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:09.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:09.390+0000 7fec4b9e2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec440af8b0 0x7fec440c78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:09.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:09.390+0000 7fec4b9e2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fec4415d460 0x7fec4416d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:09.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:09.390+0000 7fec4b9e2700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec440c68d0 con 0x7fec440af4e0 2023-10-06T01:42:09.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:09.390+0000 7fec4b9e2700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec440c8f70 con 0x7fec440af8b0 2023-10-06T01:42:09.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:09.390+0000 7fec4b9e2700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec440c8360 con 0x7fec4415d460 2023-10-06T01:42:09.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:09.390+0000 7fec4977e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec440af4e0 0x7fec440d0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:09.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:09.390+0000 7fec4977e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec440af4e0 0x7fec440d0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:33760/0 (socket says 172.21.15.71:33760) 2023-10-06T01:42:09.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:09.390+0000 7fec4977e700 1 -- 172.21.15.71:0/4174262132 learned_addr learned my addr 172.21.15.71:0/4174262132 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:09.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:09.390+0000 7fec48f7d700 1 --2- 172.21.15.71:0/4174262132 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec440af8b0 0x7fec440c78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:09.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:09.390+0000 7fec4977e700 1 -- 172.21.15.71:0/4174262132 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fec4415d460 msgr2=0x7fec4416d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:09.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:09.390+0000 7fec49f7f700 1 --2- 172.21.15.71:0/4174262132 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fec4415d460 0x7fec4416d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:09.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:09.390+0000 7fec4977e700 1 --2- 172.21.15.71:0/4174262132 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fec4415d460 0x7fec4416d2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:09.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:09.390+0000 7fec4977e700 1 -- 172.21.15.71:0/4174262132 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec440af8b0 msgr2=0x7fec440c78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:09.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:09.390+0000 7fec4977e700 1 --2- 172.21.15.71:0/4174262132 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec440af8b0 0x7fec440c78a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:09.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:09.390+0000 7fec4977e700 1 -- 172.21.15.71:0/4174262132 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec40009420 con 0x7fec440af4e0 2023-10-06T01:42:09.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:09.390+0000 7fec48f7d700 1 --2- 172.21.15.71:0/4174262132 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec440af8b0 0x7fec440c78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:42:09.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:09.391+0000 7fec4977e700 1 --2- 172.21.15.71:0/4174262132 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec440af4e0 0x7fec440d0ff0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fec4000b0e0 tx=0x7fec40017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:09.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:09.391+0000 7fec397fa700 1 -- 172.21.15.71:0/4174262132 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec40011420 con 0x7fec440af4e0 2023-10-06T01:42:09.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:09.391+0000 7fec397fa700 1 -- 172.21.15.71:0/4174262132 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec40011580 con 0x7fec440af4e0 2023-10-06T01:42:09.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:09.391+0000 7fec397fa700 1 -- 172.21.15.71:0/4174262132 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec40011920 con 0x7fec440af4e0 2023-10-06T01:42:09.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:09.391+0000 7fec4b9e2700 1 -- 172.21.15.71:0/4174262132 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec440c8640 con 0x7fec440af4e0 2023-10-06T01:42:09.396 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:09.391+0000 7fec4b9e2700 1 -- 172.21.15.71:0/4174262132 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec440c8c00 con 0x7fec440af4e0 2023-10-06T01:42:09.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:09.392+0000 7fec4b9e2700 1 -- 172.21.15.71:0/4174262132 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec44088aa0 con 0x7fec440af4e0 2023-10-06T01:42:09.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:09.392+0000 7fec397fa700 1 -- 172.21.15.71:0/4174262132 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fec40011d10 con 0x7fec440af4e0 2023-10-06T01:42:09.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:09.392+0000 7fec397fa700 1 --2- 172.21.15.71:0/4174262132 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fec28066f30 0x7fec280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:09.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:09.393+0000 7fec397fa700 1 -- 172.21.15.71:0/4174262132 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fec400862f0 con 0x7fec440af4e0 2023-10-06T01:42:09.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:09.393+0000 7fec48f7d700 1 --2- 172.21.15.71:0/4174262132 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fec28066f30 0x7fec280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:09.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:09.393+0000 7fec48f7d700 1 --2- 172.21.15.71:0/4174262132 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fec28066f30 0x7fec280693e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fec34006fd0 tx=0x7fec34008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:09.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:09.397+0000 7fec397fa700 1 -- 172.21.15.71:0/4174262132 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fec400532a0 con 0x7fec440af4e0 2023-10-06T01:42:09.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:09.623+0000 7fec4b9e2700 1 -- 172.21.15.71:0/4174262132 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fec44069360 con 0x7fec440af4e0 2023-10-06T01:42:09.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:09.624+0000 7fec397fa700 1 -- 172.21.15.71:0/4174262132 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4591 (secure 0 0 0) 0x7fec400568c0 con 0x7fec440af4e0 2023-10-06T01:42:09.625 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:42:09.625 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":31,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5021,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6834/924027954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":924027954},{"type":"v1","addr":"172.21.15.72:6834","nonce":924027954}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5574,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6836/2482160960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":2482160960},{"type":"v1","addr":"172.21.15.71:6836","nonce":2482160960}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5577,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/2163703913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6835","nonce":2163703913},{"type":"v1","addr":"172.21.15.71:6837","nonce":2163703913}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T01:41:59.290125+0000","modified":"2023-10-06T01:42:02.927924+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5586},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5586":{"gid":5586,"name":"b","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6835/627948818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6833","nonce":627948818},{"type":"v1","addr":"172.21.15.72:6835","nonce":627948818}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T01:42:09.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:09.626+0000 7fec4b9e2700 1 -- 172.21.15.71:0/4174262132 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fec28066f30 msgr2=0x7fec280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:09.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:09.626+0000 7fec4b9e2700 1 --2- 172.21.15.71:0/4174262132 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fec28066f30 0x7fec280693e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fec34006fd0 tx=0x7fec34008040 comp rx=0 tx=0).stop 2023-10-06T01:42:09.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:09.626+0000 7fec4b9e2700 1 -- 172.21.15.71:0/4174262132 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec440af4e0 msgr2=0x7fec440d0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:09.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:09.626+0000 7fec4b9e2700 1 --2- 172.21.15.71:0/4174262132 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec440af4e0 0x7fec440d0ff0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fec4000b0e0 tx=0x7fec40017000 comp rx=0 tx=0).stop 2023-10-06T01:42:09.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:09.626+0000 7fec4b9e2700 1 -- 172.21.15.71:0/4174262132 shutdown_connections 2023-10-06T01:42:09.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:09.626+0000 7fec4b9e2700 1 --2- 172.21.15.71:0/4174262132 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fec4415d460 0x7fec4416d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:09.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:09.626+0000 7fec4b9e2700 1 --2- 172.21.15.71:0/4174262132 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fec440af4e0 0x7fec440d0ff0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:09.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:09.626+0000 7fec4b9e2700 1 --2- 172.21.15.71:0/4174262132 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fec28066f30 0x7fec280693e0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:09.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:09.626+0000 7fec4b9e2700 1 --2- 172.21.15.71:0/4174262132 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec440af8b0 0x7fec440c78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:09.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:09.626+0000 7fec4b9e2700 1 -- 172.21.15.71:0/4174262132 >> 172.21.15.71:0/4174262132 conn(0x7fec44068680 msgr2=0x7fec440b5630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:09.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:09.626+0000 7fec4b9e2700 1 -- 172.21.15.71:0/4174262132 shutdown_connections 2023-10-06T01:42:09.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:09.626+0000 7fec4b9e2700 1 -- 172.21.15.71:0/4174262132 wait complete. 2023-10-06T01:42:09.628 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 31 2023-10-06T01:42:10.041 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 31, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T01:41:59.290125+0000', 'modified': '2023-10-06T01:42:02.927924+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5586}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5586': {'gid': 5586, 'name': 'b', 'rank': 0, 'incarnation': 27, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.72:6835/627948818', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.72:6833', 'nonce': 627948818}, {'type': 'v1', 'addr': '172.21.15.72:6835', 'nonce': 627948818}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T01:42:10.041 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T01:42:10.041 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-06T01:42:10.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.156+0000 7f9794ae1700 1 Processor -- start 2023-10-06T01:42:10.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.156+0000 7f9794ae1700 1 -- start start 2023-10-06T01:42:10.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.157+0000 7f9794ae1700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f97900c3fd0 0x7f97900c4440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:10.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.157+0000 7f9794ae1700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f97900cbcc0 0x7f97900cc100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:10.159 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.157+0000 7f9794ae1700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97900c3b40 con 0x7f97901574b0 2023-10-06T01:42:10.160 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.157+0000 7f9794ae1700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97900c4980 con 0x7f97900c3fd0 2023-10-06T01:42:10.160 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.157+0000 7f9794ae1700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97900cc640 con 0x7f97900cbcc0 2023-10-06T01:42:10.160 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.157+0000 7f9785d9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f97900c3fd0 0x7f97900c4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:10.160 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.157+0000 7f9785d9b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f97900c3fd0 0x7f97900c4440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:33772/0 (socket says 172.21.15.71:33772) 2023-10-06T01:42:10.160 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.157+0000 7f9785d9b700 1 -- 172.21.15.71:0/148087358 learned_addr learned my addr 172.21.15.71:0/148087358 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:10.160 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.157+0000 7f978ed9d700 1 --2- 172.21.15.71:0/148087358 >> v2:172.21.15.72:3300/0 conn(0x7f97900cbcc0 0x7f97900cc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:10.160 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.158+0000 7f9785d9b700 1 -- 172.21.15.71:0/148087358 >> v2:172.21.15.72:3300/0 conn(0x7f97900cbcc0 msgr2=0x7f97900cc100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:10.160 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.158+0000 7f9785d9b700 1 --2- 172.21.15.71:0/148087358 >> v2:172.21.15.72:3300/0 conn(0x7f97900cbcc0 0x7f97900cc100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:10.160 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.158+0000 7f9785d9b700 1 -- 172.21.15.71:0/148087358 >> v1:172.21.15.72:6789/0 conn(0x7f97901574b0 legacy=0x7f97900b0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:10.160 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.158+0000 7f9785d9b700 1 -- 172.21.15.71:0/148087358 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97900c2f30 con 0x7f97900c3fd0 2023-10-06T01:42:10.160 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.158+0000 7f9785d9b700 1 --2- 172.21.15.71:0/148087358 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f97900c3fd0 0x7f97900c4440 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f9790087570 tx=0x7f9778009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0dc586fc0f65784 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:10.160 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.158+0000 7f978dd9b700 1 -- 172.21.15.71:0/148087358 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f977800b860 con 0x7f97900c3fd0 2023-10-06T01:42:10.161 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.158+0000 7f978dd9b700 1 -- 172.21.15.71:0/148087358 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f977800b9c0 con 0x7f97900c3fd0 2023-10-06T01:42:10.161 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.158+0000 7f978dd9b700 1 -- 172.21.15.71:0/148087358 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f977800bd60 con 0x7f97900c3fd0 2023-10-06T01:42:10.161 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.158+0000 7f9794ae1700 1 -- 172.21.15.71:0/148087358 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f97900c3fd0 msgr2=0x7f97900c4440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:10.161 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.158+0000 7f9794ae1700 1 --2- 172.21.15.71:0/148087358 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f97900c3fd0 0x7f97900c4440 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f9790087570 tx=0x7f9778009250 comp rx=0 tx=0).stop 2023-10-06T01:42:10.161 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.158+0000 7f9794ae1700 1 -- 172.21.15.71:0/148087358 shutdown_connections 2023-10-06T01:42:10.161 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.158+0000 7f9794ae1700 1 --2- 172.21.15.71:0/148087358 >> v2:172.21.15.72:3300/0 conn(0x7f97900cbcc0 0x7f97900cc100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:10.161 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.158+0000 7f9794ae1700 1 --2- 172.21.15.71:0/148087358 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f97900c3fd0 0x7f97900c4440 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:10.161 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.158+0000 7f9794ae1700 1 -- 172.21.15.71:0/148087358 >> 172.21.15.71:0/148087358 conn(0x7f9790067910 msgr2=0x7f97900ce0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:10.161 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.158+0000 7f9794ae1700 1 -- 172.21.15.71:0/148087358 shutdown_connections 2023-10-06T01:42:10.161 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.158+0000 7f9794ae1700 1 -- 172.21.15.71:0/148087358 wait complete. 2023-10-06T01:42:10.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.160+0000 7f9794ae1700 1 Processor -- start 2023-10-06T01:42:10.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.160+0000 7f9794ae1700 1 -- start start 2023-10-06T01:42:10.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.160+0000 7f9794ae1700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f97900c3fd0 0x7f97901526f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:10.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.160+0000 7f9794ae1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97900cbcc0 0x7f9790146c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:10.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.160+0000 7f9794ae1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f97901574b0 0x7f97900ca480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:10.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.160+0000 7f9794ae1700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97901599b0 con 0x7f97900c3fd0 2023-10-06T01:42:10.164 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.160+0000 7f9794ae1700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9790158b00 con 0x7f97900cbcc0 2023-10-06T01:42:10.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.160+0000 7f9794ae1700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9790159e40 con 0x7f97901574b0 2023-10-06T01:42:10.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.160+0000 7f978e59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f97900c3fd0 0x7f97901526f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:10.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.160+0000 7f978e59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f97900c3fd0 0x7f97901526f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:33788/0 (socket says 172.21.15.71:33788) 2023-10-06T01:42:10.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.161+0000 7f978e59c700 1 -- 172.21.15.71:0/592977630 learned_addr learned my addr 172.21.15.71:0/592977630 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:10.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.161+0000 7f978ed9d700 1 --2- 172.21.15.71:0/592977630 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f97901574b0 0x7f97900ca480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:10.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.161+0000 7f9785d9b700 1 --2- 172.21.15.71:0/592977630 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97900cbcc0 0x7f9790146c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:10.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.161+0000 7f978e59c700 1 -- 172.21.15.71:0/592977630 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f97901574b0 msgr2=0x7f97900ca480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:10.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.161+0000 7f978e59c700 1 --2- 172.21.15.71:0/592977630 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f97901574b0 0x7f97900ca480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:10.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.161+0000 7f978e59c700 1 -- 172.21.15.71:0/592977630 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97900cbcc0 msgr2=0x7f9790146c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:10.165 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.161+0000 7f978e59c700 1 --2- 172.21.15.71:0/592977630 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97900cbcc0 0x7f9790146c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:10.166 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.161+0000 7f978e59c700 1 -- 172.21.15.71:0/592977630 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97780094f0 con 0x7f97900c3fd0 2023-10-06T01:42:10.166 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.161+0000 7f978e59c700 1 --2- 172.21.15.71:0/592977630 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f97900c3fd0 0x7f97901526f0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f978000c540 tx=0x7f9780001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:10.166 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.161+0000 7f9786ffd700 1 -- 172.21.15.71:0/592977630 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9780011590 con 0x7f97900c3fd0 2023-10-06T01:42:10.166 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.161+0000 7f9786ffd700 1 -- 172.21.15.71:0/592977630 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97800116f0 con 0x7f97900c3fd0 2023-10-06T01:42:10.166 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.161+0000 7f9794ae1700 1 -- 172.21.15.71:0/592977630 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9790158da0 con 0x7f97900c3fd0 2023-10-06T01:42:10.166 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.161+0000 7f9786ffd700 1 -- 172.21.15.71:0/592977630 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9780011ab0 con 0x7f97900c3fd0 2023-10-06T01:42:10.166 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.161+0000 7f9794ae1700 1 -- 172.21.15.71:0/592977630 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9790159360 con 0x7f97900c3fd0 2023-10-06T01:42:10.166 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.162+0000 7f9786ffd700 1 -- 172.21.15.71:0/592977630 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f978001b3b0 con 0x7f97900c3fd0 2023-10-06T01:42:10.166 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.163+0000 7f9786ffd700 1 --2- 172.21.15.71:0/592977630 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f9770066f30 0x7f97700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:10.166 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.163+0000 7f9786ffd700 1 -- 172.21.15.71:0/592977630 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f9780083bf0 con 0x7f97900c3fd0 2023-10-06T01:42:10.166 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.163+0000 7f9785d9b700 1 --2- 172.21.15.71:0/592977630 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f9770066f30 0x7f97700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:10.166 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.163+0000 7f9785d9b700 1 --2- 172.21.15.71:0/592977630 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f9770066f30 0x7f97700693e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f9790087570 tx=0x7f9778017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:10.173 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.165+0000 7f979ddd9b80 1 Processor -- start 2023-10-06T01:42:10.173 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.165+0000 7f979ddd9b80 1 -- start start 2023-10-06T01:42:10.173 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.165+0000 7f979ddd9b80 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x560a319a6840 0x560a319a6c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:10.173 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.165+0000 7f979ddd9b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560a319a7cc0 0x560a319f66c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:10.173 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.165+0000 7f979ddd9b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560a319f6c00 0x560a319f7050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:10.173 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.165+0000 7f979ddd9b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a318fda70 con 0x560a319f6c00 2023-10-06T01:42:10.173 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.165+0000 7f979ddd9b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a318fb270 con 0x560a319a7cc0 2023-10-06T01:42:10.173 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.165+0000 7f979ddd9b80 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x560a318f7060 con 0x560a319a6840 2023-10-06T01:42:10.173 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.166+0000 7f978ed9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560a319f6c00 0x560a319f7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:10.174 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.166+0000 7f978ed9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560a319f6c00 0x560a319f7050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:33804/0 (socket says 172.21.15.71:33804) 2023-10-06T01:42:10.174 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.166+0000 7f978ed9d700 1 -- 172.21.15.71:0/1670253885 learned_addr learned my addr 172.21.15.71:0/1670253885 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:10.174 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.166+0000 7f978e59c700 1 --2- 172.21.15.71:0/1670253885 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x560a319a6840 0x560a319a6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:10.174 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.166+0000 7f9785d9b700 1 --2- 172.21.15.71:0/1670253885 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560a319a7cc0 0x560a319f66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:10.174 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.166+0000 7f978ed9d700 1 -- 172.21.15.71:0/1670253885 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x560a319a6840 msgr2=0x560a319a6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:10.174 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.166+0000 7f978ed9d700 1 --2- 172.21.15.71:0/1670253885 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x560a319a6840 0x560a319a6c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:10.174 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.166+0000 7f978ed9d700 1 -- 172.21.15.71:0/1670253885 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560a319a7cc0 msgr2=0x560a319f66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:10.174 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.166+0000 7f978ed9d700 1 --2- 172.21.15.71:0/1670253885 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560a319a7cc0 0x560a319f66c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:10.174 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.166+0000 7f978ed9d700 1 -- 172.21.15.71:0/1670253885 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560a31791270 con 0x560a319f6c00 2023-10-06T01:42:10.174 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.166+0000 7f9785d9b700 1 --2- 172.21.15.71:0/1670253885 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560a319a7cc0 0x560a319f66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:42:10.175 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.166+0000 7f978ed9d700 1 --2- 172.21.15.71:0/1670253885 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560a319f6c00 0x560a319f7050 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f9788007420 tx=0x7f978800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=370906ba870e1d29 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:10.175 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.166+0000 7f976f7fe700 1 -- 172.21.15.71:0/1670253885 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9788007da0 con 0x560a319f6c00 2023-10-06T01:42:10.175 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.166+0000 7f976f7fe700 1 -- 172.21.15.71:0/1670253885 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9788018070 con 0x560a319f6c00 2023-10-06T01:42:10.175 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.166+0000 7f976f7fe700 1 -- 172.21.15.71:0/1670253885 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97880147e0 con 0x560a319f6c00 2023-10-06T01:42:10.175 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.167+0000 7f979ddd9b80 1 -- 172.21.15.71:0/1670253885 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560a319f6c00 msgr2=0x560a319f7050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:10.175 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.167+0000 7f979ddd9b80 1 --2- 172.21.15.71:0/1670253885 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560a319f6c00 0x560a319f7050 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f9788007420 tx=0x7f978800b040 comp rx=0 tx=0).stop 2023-10-06T01:42:10.175 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.167+0000 7f979ddd9b80 1 -- 172.21.15.71:0/1670253885 shutdown_connections 2023-10-06T01:42:10.175 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.167+0000 7f979ddd9b80 1 --2- 172.21.15.71:0/1670253885 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560a319f6c00 0x560a319f7050 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:10.175 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.167+0000 7f979ddd9b80 1 --2- 172.21.15.71:0/1670253885 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x560a319a6840 0x560a319a6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:10.175 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.167+0000 7f979ddd9b80 1 --2- 172.21.15.71:0/1670253885 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560a319a7cc0 0x560a319f66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:10.175 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.167+0000 7f979ddd9b80 1 -- 172.21.15.71:0/1670253885 >> 172.21.15.71:0/1670253885 conn(0x560a319a8160 msgr2=0x560a319a8530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:10.176 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.167+0000 7f979ddd9b80 1 -- 172.21.15.71:0/1670253885 shutdown_connections 2023-10-06T01:42:10.176 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.167+0000 7f979ddd9b80 1 -- 172.21.15.71:0/1670253885 wait complete. 2023-10-06T01:42:10.176 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.167+0000 7f979ddd9b80 1 -- start start 2023-10-06T01:42:10.176 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.168+0000 7f979ddd9b80 1 Processor -- start 2023-10-06T01:42:10.176 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.168+0000 7f979ddd9b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560a319a6840 0x560a319d0810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:10.176 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.168+0000 7f979ddd9b80 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x560a319a7cc0 0x560a319e7690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:10.176 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.168+0000 7f979ddd9b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560a319f6c00 0x560a319e6570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:10.176 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.168+0000 7f979ddd9b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a318a2890 con 0x560a319a6840 2023-10-06T01:42:10.176 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.168+0000 7f979ddd9b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a318bdea0 con 0x560a319f6c00 2023-10-06T01:42:10.176 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.168+0000 7f979ddd9b80 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x560a31779e30 con 0x560a319a7cc0 2023-10-06T01:42:10.176 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.169+0000 7f979ddd9b80 10 client.0 _ll_register_callbacks cb 0x560a31969e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T01:42:10.176 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.169+0000 7f978e59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560a319a6840 0x560a319d0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:10.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.169+0000 7f978e59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560a319a6840 0x560a319d0810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:33808/0 (socket says 172.21.15.71:33808) 2023-10-06T01:42:10.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.169+0000 7f978e59c700 1 -- 172.21.15.71:0/2887198282 learned_addr learned my addr 172.21.15.71:0/2887198282 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:10.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.169+0000 7f9785d9b700 1 --2- 172.21.15.71:0/2887198282 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x560a319a7cc0 0x560a319e7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:10.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.169+0000 7f978ed9d700 1 --2- 172.21.15.71:0/2887198282 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560a319f6c00 0x560a319e6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:10.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.169+0000 7f978e59c700 1 -- 172.21.15.71:0/2887198282 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x560a319a7cc0 msgr2=0x560a319e7690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:10.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.169+0000 7f978e59c700 1 --2- 172.21.15.71:0/2887198282 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x560a319a7cc0 0x560a319e7690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:10.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.169+0000 7f978e59c700 1 -- 172.21.15.71:0/2887198282 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560a319f6c00 msgr2=0x560a319e6570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:10.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.169+0000 7f978e59c700 1 --2- 172.21.15.71:0/2887198282 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560a319f6c00 0x560a319e6570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:10.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.169+0000 7f978e59c700 1 -- 172.21.15.71:0/2887198282 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9788009d60 con 0x560a319a6840 2023-10-06T01:42:10.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.169+0000 7f978e59c700 1 --2- 172.21.15.71:0/2887198282 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560a319a6840 0x560a319d0810 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f9780007fd0 tx=0x7f978001e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=863525ea7dc64a7e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:10.177 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.169+0000 7f976cff9700 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2023-10-06T01:42:10.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.169+0000 7f976cff9700 1 -- 172.21.15.71:0/2887198282 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f978006aea0 con 0x560a319a6840 2023-10-06T01:42:10.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.169+0000 7f976cff9700 1 -- 172.21.15.71:0/2887198282 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(54..54 src has 1..54) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f9780052a70 con 0x560a319a6840 2023-10-06T01:42:10.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.169+0000 7f979ddd9b80 1 -- 172.21.15.71:0/2887198282 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560a3199b940 con 0x560a319a6840 2023-10-06T01:42:10.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.169+0000 7f976cff9700 1 -- 172.21.15.71:0/2887198282 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9780053e20 con 0x560a319a6840 2023-10-06T01:42:10.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.169+0000 7f979ddd9b80 10 client.5745 fetch_fsmap learned FSMap version 31 2023-10-06T01:42:10.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.169+0000 7f979ddd9b80 1 -- 172.21.15.71:0/2887198282 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) v3 -- 0x560a31733fe0 con 0x560a319a6840 2023-10-06T01:42:10.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.169+0000 7f976cff9700 1 -- 172.21.15.71:0/2887198282 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560a3199b940 con 0x560a319a6840 2023-10-06T01:42:10.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.170+0000 7f976cff9700 1 -- 172.21.15.71:0/2887198282 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 31) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f9780070250 con 0x560a319a6840 2023-10-06T01:42:10.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.170+0000 7f979ddd9b80 10 client.5745 fetch_fsmap finished waiting for FSMap version 31 2023-10-06T01:42:10.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.170+0000 7f979ddd9b80 10 client.5745 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-06T01:42:10.178 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.170+0000 7f979ddd9b80 20 client.5745 populate_metadata read hostname 'smithi071' 2023-10-06T01:42:10.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.170+0000 7f979ddd9b80 1 --2- 172.21.15.71:0/2887198282 >> [v2:172.21.15.72:6833/627948818,v1:172.21.15.72:6835/627948818] conn(0x560a319cbe00 0x560a319cc1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:10.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.170+0000 7f979ddd9b80 4 client.5745 mds_command: new command op to 5586 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T01:42:10.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.170+0000 7f979ddd9b80 1 -- 172.21.15.71:0/2887198282 --> [v2:172.21.15.72:6833/627948818,v1:172.21.15.72:6835/627948818] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560a31978870 con 0x560a319cbe00 2023-10-06T01:42:10.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.170+0000 7f9785d9b700 1 --2- 172.21.15.71:0/2887198282 >> [v2:172.21.15.72:6833/627948818,v1:172.21.15.72:6835/627948818] conn(0x560a319cbe00 0x560a319cc1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:10.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.170+0000 7f976cff9700 10 client.5745 ms_handle_connect on v2:172.21.15.72:6833/627948818 2023-10-06T01:42:10.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.170+0000 7f9785d9b700 1 --2- 172.21.15.71:0/2887198282 >> [v2:172.21.15.72:6833/627948818,v1:172.21.15.72:6835/627948818] conn(0x560a319cbe00 0x560a319cc1d0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f3c96b478a22655e server_cookie=3c15b4c4f9c7d0e0 in_seq=0 out_seq=0 2023-10-06T01:42:10.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.171+0000 7f976cff9700 1 -- 172.21.15.71:0/2887198282 <== mds.0 v2:172.21.15.72:6833/627948818 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x560a31978870 con 0x560a319cbe00 2023-10-06T01:42:10.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.171+0000 7f976cff9700 10 client.5745 handle_command_reply: tid=0 2023-10-06T01:42:10.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.171+0000 7f979ddd9b80 1 client.5745 shutdown 2023-10-06T01:42:10.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.171+0000 7f979ddd9b80 1 -- 172.21.15.71:0/2887198282 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560a319a6840 msgr2=0x560a319d0810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:10.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.171+0000 7f979ddd9b80 1 --2- 172.21.15.71:0/2887198282 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560a319a6840 0x560a319d0810 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f9780007fd0 tx=0x7f978001e040 comp rx=0 tx=0).stop 2023-10-06T01:42:10.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.171+0000 7f979ddd9b80 1 -- 172.21.15.71:0/2887198282 shutdown_connections 2023-10-06T01:42:10.179 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.171+0000 7f979ddd9b80 1 --2- 172.21.15.71:0/2887198282 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560a319f6c00 0x560a319e6570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:10.180 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.171+0000 7f979ddd9b80 1 --2- 172.21.15.71:0/2887198282 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560a319a6840 0x560a319d0810 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:10.180 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.171+0000 7f979ddd9b80 1 --2- 172.21.15.71:0/2887198282 >> [v2:172.21.15.72:6833/627948818,v1:172.21.15.72:6835/627948818] conn(0x560a319cbe00 0x560a319cc1d0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:10.180 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.171+0000 7f979ddd9b80 1 --2- 172.21.15.71:0/2887198282 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x560a319a7cc0 0x560a319e7690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:10.180 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.171+0000 7f976cff9700 0 client.5745 ms_handle_reset on v2:172.21.15.72:6833/627948818 2023-10-06T01:42:10.180 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.171+0000 7f979ddd9b80 1 -- 172.21.15.71:0/2887198282 >> 172.21.15.71:0/2887198282 conn(0x560a319a8160 msgr2=0x560a319cfb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:10.180 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.171+0000 7f979ddd9b80 1 -- 172.21.15.71:0/2887198282 shutdown_connections 2023-10-06T01:42:10.180 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.171+0000 7f979ddd9b80 1 -- 172.21.15.71:0/2887198282 wait complete. 2023-10-06T01:42:10.180 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.171+0000 7f979ddd9b80 20 client.5745 trim_cache size 0 max 16384 2023-10-06T01:42:10.188 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.188+0000 7f979ddd9b80 1 Processor -- start 2023-10-06T01:42:10.189 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.188+0000 7f979ddd9b80 1 -- start start 2023-10-06T01:42:10.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.189+0000 7f979ddd9b80 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x560a319a6840 0x560a319ea590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:10.191 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.189+0000 7f979ddd9b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560a319a7cc0 0x560a319a3b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:10.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.189+0000 7f979ddd9b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560a319f6c00 0x560a319e9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:10.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.189+0000 7f979ddd9b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a319e7000 con 0x560a319f6c00 2023-10-06T01:42:10.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.189+0000 7f979ddd9b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a319862e0 con 0x560a319a7cc0 2023-10-06T01:42:10.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.189+0000 7f979ddd9b80 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x560a319a4d20 con 0x560a319a6840 2023-10-06T01:42:10.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.189+0000 7f978ed9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560a319f6c00 0x560a319e9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:10.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.189+0000 7f978ed9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560a319f6c00 0x560a319e9d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:33816/0 (socket says 172.21.15.71:33816) 2023-10-06T01:42:10.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.189+0000 7f978ed9d700 1 -- 172.21.15.71:0/1192933998 learned_addr learned my addr 172.21.15.71:0/1192933998 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:10.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.189+0000 7f978e59c700 1 --2- 172.21.15.71:0/1192933998 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x560a319a6840 0x560a319ea590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:10.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.189+0000 7f9785d9b700 1 --2- 172.21.15.71:0/1192933998 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560a319a7cc0 0x560a319a3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:10.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.189+0000 7f978ed9d700 1 -- 172.21.15.71:0/1192933998 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x560a319a6840 msgr2=0x560a319ea590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:10.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.189+0000 7f978ed9d700 1 --2- 172.21.15.71:0/1192933998 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x560a319a6840 0x560a319ea590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:10.192 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.189+0000 7f978ed9d700 1 -- 172.21.15.71:0/1192933998 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560a319a7cc0 msgr2=0x560a319a3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:10.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.189+0000 7f978ed9d700 1 --2- 172.21.15.71:0/1192933998 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560a319a7cc0 0x560a319a3b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:10.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.189+0000 7f978ed9d700 1 -- 172.21.15.71:0/1192933998 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560a318c5780 con 0x560a319f6c00 2023-10-06T01:42:10.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.189+0000 7f978ed9d700 1 --2- 172.21.15.71:0/1192933998 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560a319f6c00 0x560a319e9d10 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f9788007ac0 tx=0x7f978801e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be41dba0326f6e3e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:10.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.189+0000 7f976ffff700 1 -- 172.21.15.71:0/1192933998 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9788007da0 con 0x560a319f6c00 2023-10-06T01:42:10.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.190+0000 7f976ffff700 1 -- 172.21.15.71:0/1192933998 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f978800f050 con 0x560a319f6c00 2023-10-06T01:42:10.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.190+0000 7f976ffff700 1 -- 172.21.15.71:0/1192933998 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97880145d0 con 0x560a319f6c00 2023-10-06T01:42:10.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.190+0000 7f979ddd9b80 1 -- 172.21.15.71:0/1192933998 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560a319f6c00 msgr2=0x560a319e9d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:10.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.190+0000 7f979ddd9b80 1 --2- 172.21.15.71:0/1192933998 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560a319f6c00 0x560a319e9d10 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f9788007ac0 tx=0x7f978801e000 comp rx=0 tx=0).stop 2023-10-06T01:42:10.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.190+0000 7f979ddd9b80 1 -- 172.21.15.71:0/1192933998 shutdown_connections 2023-10-06T01:42:10.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.190+0000 7f979ddd9b80 1 --2- 172.21.15.71:0/1192933998 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560a319f6c00 0x560a319e9d10 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:10.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.190+0000 7f979ddd9b80 1 --2- 172.21.15.71:0/1192933998 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x560a319a6840 0x560a319ea590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:10.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.190+0000 7f979ddd9b80 1 --2- 172.21.15.71:0/1192933998 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560a319a7cc0 0x560a319a3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:10.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.190+0000 7f979ddd9b80 1 -- 172.21.15.71:0/1192933998 >> 172.21.15.71:0/1192933998 conn(0x560a319a8160 msgr2=0x560a319a9d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:10.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.190+0000 7f979ddd9b80 1 -- 172.21.15.71:0/1192933998 shutdown_connections 2023-10-06T01:42:10.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.190+0000 7f979ddd9b80 1 -- 172.21.15.71:0/1192933998 wait complete. 2023-10-06T01:42:10.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.191+0000 7f979ddd9b80 1 -- start start 2023-10-06T01:42:10.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.191+0000 7f979ddd9b80 1 Processor -- start 2023-10-06T01:42:10.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.192+0000 7f979ddd9b80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560a319a6840 0x560a319e60e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:10.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.192+0000 7f979ddd9b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560a319a7cc0 0x560a319e3350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:10.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.192+0000 7f979ddd9b80 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x560a319f6c00 0x560a319e3890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:10.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.192+0000 7f979ddd9b80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a31a06040 con 0x560a319a6840 2023-10-06T01:42:10.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.192+0000 7f979ddd9b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a319ee9a0 con 0x560a319a7cc0 2023-10-06T01:42:10.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.192+0000 7f979ddd9b80 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x560a319d6c00 con 0x560a319f6c00 2023-10-06T01:42:10.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.192+0000 7f979ddd9b80 10 client.0 _ll_register_callbacks cb 0x560a31969e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T01:42:10.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.192+0000 7f978e59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560a319a6840 0x560a319e60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:10.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.192+0000 7f978e59c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560a319a6840 0x560a319e60e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:33828/0 (socket says 172.21.15.71:33828) 2023-10-06T01:42:10.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.192+0000 7f978e59c700 1 -- 172.21.15.71:0/869706143 learned_addr learned my addr 172.21.15.71:0/869706143 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:10.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.192+0000 7f9785d9b700 1 --2- 172.21.15.71:0/869706143 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560a319a7cc0 0x560a319e3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:10.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.192+0000 7f978ed9d700 1 --2- 172.21.15.71:0/869706143 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x560a319f6c00 0x560a319e3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:10.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.192+0000 7f978e59c700 1 -- 172.21.15.71:0/869706143 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x560a319f6c00 msgr2=0x560a319e3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:10.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.192+0000 7f978e59c700 1 --2- 172.21.15.71:0/869706143 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x560a319f6c00 0x560a319e3890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:10.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.192+0000 7f978e59c700 1 -- 172.21.15.71:0/869706143 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560a319a7cc0 msgr2=0x560a319e3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:10.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.192+0000 7f978e59c700 1 --2- 172.21.15.71:0/869706143 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560a319a7cc0 0x560a319e3350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:10.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.192+0000 7f978e59c700 1 -- 172.21.15.71:0/869706143 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9788021040 con 0x560a319a6840 2023-10-06T01:42:10.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.192+0000 7f9785d9b700 1 --2- 172.21.15.71:0/869706143 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560a319a7cc0 0x560a319e3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:42:10.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.192+0000 7f978e59c700 1 --2- 172.21.15.71:0/869706143 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560a319a6840 0x560a319e60e0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f9780054490 tx=0x7f9780003000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31f44f38f529c804 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:10.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.192+0000 7f976cff9700 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2023-10-06T01:42:10.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.192+0000 7f976cff9700 1 -- 172.21.15.71:0/869706143 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f978006aea0 con 0x560a319a6840 2023-10-06T01:42:10.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.192+0000 7f976cff9700 1 -- 172.21.15.71:0/869706143 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(54..54 src has 1..54) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f9780013d80 con 0x560a319a6840 2023-10-06T01:42:10.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.192+0000 7f979ddd9b80 1 -- 172.21.15.71:0/869706143 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9788018070 con 0x560a319a6840 2023-10-06T01:42:10.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.192+0000 7f976cff9700 1 -- 172.21.15.71:0/869706143 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f978000e040 con 0x560a319a6840 2023-10-06T01:42:10.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.192+0000 7f979ddd9b80 10 client.5751 fetch_fsmap learned FSMap version 31 2023-10-06T01:42:10.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.192+0000 7f979ddd9b80 1 -- 172.21.15.71:0/869706143 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) v3 -- 0x560a318ac470 con 0x560a319a6840 2023-10-06T01:42:10.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.192+0000 7f976cff9700 1 -- 172.21.15.71:0/869706143 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9788018070 con 0x560a319a6840 2023-10-06T01:42:10.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.193+0000 7f976cff9700 1 -- 172.21.15.71:0/869706143 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 31) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f9780011c10 con 0x560a319a6840 2023-10-06T01:42:10.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.193+0000 7f979ddd9b80 10 client.5751 fetch_fsmap finished waiting for FSMap version 31 2023-10-06T01:42:10.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.193+0000 7f979ddd9b80 10 client.5751 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-06T01:42:10.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.193+0000 7f979ddd9b80 20 client.5751 populate_metadata read hostname 'smithi071' 2023-10-06T01:42:10.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.193+0000 7f979ddd9b80 1 --2- 172.21.15.71:0/869706143 >> [v2:172.21.15.72:6833/627948818,v1:172.21.15.72:6835/627948818] conn(0x560a319ea350 0x560a319f0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:10.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.193+0000 7f979ddd9b80 4 client.5751 mds_command: new command op to 5586 tid=0[{"prefix": "status"}] 2023-10-06T01:42:10.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.193+0000 7f979ddd9b80 1 -- 172.21.15.71:0/869706143 --> [v2:172.21.15.72:6833/627948818,v1:172.21.15.72:6835/627948818] -- command(tid 0: {"prefix": "status"}) v1 -- 0x560a31899e00 con 0x560a319ea350 2023-10-06T01:42:10.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.193+0000 7f9785d9b700 1 --2- 172.21.15.71:0/869706143 >> [v2:172.21.15.72:6833/627948818,v1:172.21.15.72:6835/627948818] conn(0x560a319ea350 0x560a319f0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:10.200 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.193+0000 7f976cff9700 10 client.5751 ms_handle_connect on v2:172.21.15.72:6833/627948818 2023-10-06T01:42:10.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.193+0000 7f9785d9b700 1 --2- 172.21.15.71:0/869706143 >> [v2:172.21.15.72:6833/627948818,v1:172.21.15.72:6835/627948818] conn(0x560a319ea350 0x560a319f0f10 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1fea83c13b367cd3 server_cookie=2acbc39523fc7744 in_seq=0 out_seq=0 2023-10-06T01:42:10.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.193+0000 7f976cff9700 1 -- 172.21.15.71:0/869706143 <== mds.0 v2:172.21.15.72:6833/627948818 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+323 (crc 0 0 0) 0x560a31899e00 con 0x560a319ea350 2023-10-06T01:42:10.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.193+0000 7f976cff9700 10 client.5751 handle_command_reply: tid=0 2023-10-06T01:42:10.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.193+0000 7f979ddd9b80 1 client.5751 shutdown 2023-10-06T01:42:10.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.193+0000 7f979ddd9b80 1 -- 172.21.15.71:0/869706143 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560a319a6840 msgr2=0x560a319e60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:10.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.193+0000 7f979ddd9b80 1 --2- 172.21.15.71:0/869706143 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560a319a6840 0x560a319e60e0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f9780054490 tx=0x7f9780003000 comp rx=0 tx=0).stop 2023-10-06T01:42:10.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.193+0000 7f979ddd9b80 1 -- 172.21.15.71:0/869706143 shutdown_connections 2023-10-06T01:42:10.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.193+0000 7f979ddd9b80 1 --2- 172.21.15.71:0/869706143 >> [v2:172.21.15.72:6833/627948818,v1:172.21.15.72:6835/627948818] conn(0x560a319ea350 0x560a319f0f10 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:10.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.193+0000 7f979ddd9b80 1 --2- 172.21.15.71:0/869706143 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x560a319f6c00 0x560a319e3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:10.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.193+0000 7f979ddd9b80 1 --2- 172.21.15.71:0/869706143 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560a319a6840 0x560a319e60e0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:10.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.193+0000 7f979ddd9b80 1 --2- 172.21.15.71:0/869706143 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x560a319a7cc0 0x560a319e3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:10.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.193+0000 7f976cff9700 0 client.5751 ms_handle_reset on v2:172.21.15.72:6833/627948818 2023-10-06T01:42:10.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.193+0000 7f979ddd9b80 1 -- 172.21.15.71:0/869706143 >> 172.21.15.71:0/869706143 conn(0x560a319a8160 msgr2=0x560a319a9ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:10.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.194+0000 7f979ddd9b80 1 -- 172.21.15.71:0/869706143 shutdown_connections 2023-10-06T01:42:10.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.194+0000 7f979ddd9b80 1 -- 172.21.15.71:0/869706143 wait complete. 2023-10-06T01:42:10.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.194+0000 7f979ddd9b80 20 client.5751 trim_cache size 0 max 16384 2023-10-06T01:42:10.202 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2023-10-06T01:42:10.202 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster_fsid": "1fbf1bd2-f9b4-4599-bea2-f4aa920e9a56", 2023-10-06T01:42:10.202 INFO:teuthology.orchestra.run.smithi071.stdout: "whoami": 0, 2023-10-06T01:42:10.203 INFO:teuthology.orchestra.run.smithi071.stdout: "id": 5586, 2023-10-06T01:42:10.203 INFO:teuthology.orchestra.run.smithi071.stdout: "want_state": "up:active", 2023-10-06T01:42:10.203 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "up:active", 2023-10-06T01:42:10.203 INFO:teuthology.orchestra.run.smithi071.stdout: "fs_name": "cephfs", 2023-10-06T01:42:10.203 INFO:teuthology.orchestra.run.smithi071.stdout: "rank_uptime": 10.2913415, 2023-10-06T01:42:10.203 INFO:teuthology.orchestra.run.smithi071.stdout: "mdsmap_epoch": 31, 2023-10-06T01:42:10.203 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_epoch": 54, 2023-10-06T01:42:10.203 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_epoch_barrier": 54, 2023-10-06T01:42:10.203 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 16.401648431000002 2023-10-06T01:42:10.203 INFO:teuthology.orchestra.run.smithi071.stdout:} 2023-10-06T01:42:10.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.194+0000 7f9794ae1700 1 -- 172.21.15.71:0/592977630 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f9770066f30 msgr2=0x7f97700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:10.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.194+0000 7f9794ae1700 1 --2- 172.21.15.71:0/592977630 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f9770066f30 0x7f97700693e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f9790087570 tx=0x7f9778017000 comp rx=0 tx=0).stop 2023-10-06T01:42:10.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.194+0000 7f9794ae1700 1 -- 172.21.15.71:0/592977630 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f97900c3fd0 msgr2=0x7f97901526f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:10.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.194+0000 7f9794ae1700 1 --2- 172.21.15.71:0/592977630 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f97900c3fd0 0x7f97901526f0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f978000c540 tx=0x7f9780001070 comp rx=0 tx=0).stop 2023-10-06T01:42:10.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.194+0000 7f9794ae1700 1 -- 172.21.15.71:0/592977630 shutdown_connections 2023-10-06T01:42:10.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.194+0000 7f9794ae1700 1 --2- 172.21.15.71:0/592977630 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f97901574b0 0x7f97900ca480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:10.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.194+0000 7f9794ae1700 1 --2- 172.21.15.71:0/592977630 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f97900c3fd0 0x7f97901526f0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:10.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.194+0000 7f9794ae1700 1 --2- 172.21.15.71:0/592977630 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f9770066f30 0x7f97700693e0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:10.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.194+0000 7f9794ae1700 1 --2- 172.21.15.71:0/592977630 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97900cbcc0 0x7f9790146c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:10.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.194+0000 7f9794ae1700 1 -- 172.21.15.71:0/592977630 >> 172.21.15.71:0/592977630 conn(0x7f9790067910 msgr2=0x7f97900c9210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:10.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.194+0000 7f9794ae1700 1 -- 172.21.15.71:0/592977630 shutdown_connections 2023-10-06T01:42:10.205 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.194+0000 7f9794ae1700 1 -- 172.21.15.71:0/592977630 wait complete. 2023-10-06T01:42:10.207 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T01:42:10.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.319+0000 7f9628b42700 1 Processor -- start 2023-10-06T01:42:10.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.319+0000 7f9628b42700 1 -- start start 2023-10-06T01:42:10.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.320+0000 7f9628b42700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f96240af4e0 0x7f96240b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:10.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.320+0000 7f9628b42700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f962415db70 0x7f96240b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:10.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.320+0000 7f9628b42700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f962415e190 con 0x7f96240af8b0 2023-10-06T01:42:10.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.320+0000 7f9628b42700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96240b1910 con 0x7f96240af4e0 2023-10-06T01:42:10.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.320+0000 7f9628b42700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f962415dfa0 con 0x7f962415db70 2023-10-06T01:42:10.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.320+0000 7f962259c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f96240af4e0 0x7f96240b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:10.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.320+0000 7f962259c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f96240af4e0 0x7f96240b20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:33842/0 (socket says 172.21.15.71:33842) 2023-10-06T01:42:10.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.320+0000 7f962259c700 1 -- 172.21.15.71:0/2610428734 learned_addr learned my addr 172.21.15.71:0/2610428734 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:10.322 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.320+0000 7f9622d9d700 1 --2- 172.21.15.71:0/2610428734 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f962415db70 0x7f96240b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:10.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.320+0000 7f962259c700 1 -- 172.21.15.71:0/2610428734 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f962415db70 msgr2=0x7f96240b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:10.325 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.320+0000 7f962259c700 1 --2- 172.21.15.71:0/2610428734 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f962415db70 0x7f96240b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:10.325 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.320+0000 7f962259c700 1 -- 172.21.15.71:0/2610428734 >> v1:172.21.15.72:6789/0 conn(0x7f96240af8b0 legacy=0x7f962415d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:10.325 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.320+0000 7f962259c700 1 -- 172.21.15.71:0/2610428734 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96240cb650 con 0x7f96240af4e0 2023-10-06T01:42:10.325 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.320+0000 7f962259c700 1 --2- 172.21.15.71:0/2610428734 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f96240af4e0 0x7f96240b20e0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f9614009f20 tx=0x7f9614009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47f75e3862b97640 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:10.325 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.321+0000 7f9621d9b700 1 -- 172.21.15.71:0/2610428734 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f961400e070 con 0x7f96240af4e0 2023-10-06T01:42:10.325 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.321+0000 7f9621d9b700 1 -- 172.21.15.71:0/2610428734 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f961400b9d0 con 0x7f96240af4e0 2023-10-06T01:42:10.325 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.321+0000 7f9621d9b700 1 -- 172.21.15.71:0/2610428734 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96140092e0 con 0x7f96240af4e0 2023-10-06T01:42:10.325 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.321+0000 7f9628b42700 1 -- 172.21.15.71:0/2610428734 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f96240af4e0 msgr2=0x7f96240b20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:10.325 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.321+0000 7f9628b42700 1 --2- 172.21.15.71:0/2610428734 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f96240af4e0 0x7f96240b20e0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f9614009f20 tx=0x7f9614009840 comp rx=0 tx=0).stop 2023-10-06T01:42:10.325 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.321+0000 7f9628b42700 1 -- 172.21.15.71:0/2610428734 shutdown_connections 2023-10-06T01:42:10.325 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.321+0000 7f9628b42700 1 --2- 172.21.15.71:0/2610428734 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f962415db70 0x7f96240b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:10.326 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.321+0000 7f9628b42700 1 --2- 172.21.15.71:0/2610428734 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f96240af4e0 0x7f96240b20e0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:10.326 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.321+0000 7f9628b42700 1 -- 172.21.15.71:0/2610428734 >> 172.21.15.71:0/2610428734 conn(0x7f9624068680 msgr2=0x7f9624068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:10.326 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.321+0000 7f9628b42700 1 -- 172.21.15.71:0/2610428734 shutdown_connections 2023-10-06T01:42:10.326 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.321+0000 7f9628b42700 1 -- 172.21.15.71:0/2610428734 wait complete. 2023-10-06T01:42:10.328 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.322+0000 7f9628b42700 1 Processor -- start 2023-10-06T01:42:10.329 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.322+0000 7f9628b42700 1 -- start start 2023-10-06T01:42:10.329 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.323+0000 7f9628b42700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f96240af4e0 0x7f96240c8b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:10.329 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.323+0000 7f9628b42700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96240af8b0 0x7f96240a7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:10.329 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.323+0000 7f9628b42700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f962415db70 0x7f96240a7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:10.329 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.323+0000 7f9628b42700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96240c9080 con 0x7f962415db70 2023-10-06T01:42:10.329 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.323+0000 7f9628b42700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96240c86b0 con 0x7f96240af8b0 2023-10-06T01:42:10.329 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.323+0000 7f9628b42700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96240c7aa0 con 0x7f96240af4e0 2023-10-06T01:42:10.329 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.323+0000 7f9622d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f962415db70 0x7f96240a7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:10.329 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.323+0000 7f9622d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f962415db70 0x7f96240a7cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:33850/0 (socket says 172.21.15.71:33850) 2023-10-06T01:42:10.329 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.323+0000 7f9622d9d700 1 -- 172.21.15.71:0/2383775665 learned_addr learned my addr 172.21.15.71:0/2383775665 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:10.329 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.323+0000 7f9619d9b700 1 --2- 172.21.15.71:0/2383775665 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96240af8b0 0x7f96240a7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:10.329 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.323+0000 7f962259c700 1 --2- 172.21.15.71:0/2383775665 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f96240af4e0 0x7f96240c8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:10.330 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.323+0000 7f9622d9d700 1 -- 172.21.15.71:0/2383775665 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f96240af4e0 msgr2=0x7f96240c8b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:10.330 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.323+0000 7f9622d9d700 1 --2- 172.21.15.71:0/2383775665 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f96240af4e0 0x7f96240c8b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:10.330 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.323+0000 7f9622d9d700 1 -- 172.21.15.71:0/2383775665 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96240af8b0 msgr2=0x7f96240a7790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:10.330 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.323+0000 7f9622d9d700 1 --2- 172.21.15.71:0/2383775665 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96240af8b0 0x7f96240a7790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:10.330 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.323+0000 7f9622d9d700 1 -- 172.21.15.71:0/2383775665 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9614009ae0 con 0x7f962415db70 2023-10-06T01:42:10.330 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.323+0000 7f9619d9b700 1 --2- 172.21.15.71:0/2383775665 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96240af8b0 0x7f96240a7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:42:10.330 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.324+0000 7f9622d9d700 1 --2- 172.21.15.71:0/2383775665 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f962415db70 0x7f96240a7cd0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f961c00ea50 tx=0x7f961c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:10.330 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.324+0000 7f961affd700 1 -- 172.21.15.71:0/2383775665 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f961c00c920 con 0x7f962415db70 2023-10-06T01:42:10.330 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.324+0000 7f961affd700 1 -- 172.21.15.71:0/2383775665 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f961c00caa0 con 0x7f962415db70 2023-10-06T01:42:10.330 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.324+0000 7f9628b42700 1 -- 172.21.15.71:0/2383775665 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96240c7d80 con 0x7f962415db70 2023-10-06T01:42:10.330 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.324+0000 7f961affd700 1 -- 172.21.15.71:0/2383775665 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f961c00ce60 con 0x7f962415db70 2023-10-06T01:42:10.331 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.324+0000 7f9628b42700 1 -- 172.21.15.71:0/2383775665 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96240c8340 con 0x7f962415db70 2023-10-06T01:42:10.331 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.325+0000 7f9628b42700 1 -- 172.21.15.71:0/2383775665 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9624088aa0 con 0x7f962415db70 2023-10-06T01:42:10.331 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.325+0000 7f961affd700 1 -- 172.21.15.71:0/2383775665 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f961c013680 con 0x7f962415db70 2023-10-06T01:42:10.331 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.326+0000 7f961affd700 1 --2- 172.21.15.71:0/2383775665 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f9604066f30 0x7f96040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:10.331 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.326+0000 7f961affd700 1 -- 172.21.15.71:0/2383775665 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f961c084c90 con 0x7f962415db70 2023-10-06T01:42:10.331 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.326+0000 7f962259c700 1 --2- 172.21.15.71:0/2383775665 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f9604066f30 0x7f96040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:10.331 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.326+0000 7f962259c700 1 --2- 172.21.15.71:0/2383775665 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f9604066f30 0x7f96040693e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f9614009880 tx=0x7f9614018000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:10.331 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.330+0000 7f961affd700 1 -- 172.21.15.71:0/2383775665 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f961c051bc0 con 0x7f962415db70 2023-10-06T01:42:10.556 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.555+0000 7f9628b42700 1 -- 172.21.15.71:0/2383775665 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f96240b0910 con 0x7f962415db70 2023-10-06T01:42:10.556 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.555+0000 7f961affd700 1 -- 172.21.15.71:0/2383775665 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v31) v1 ==== 53+0+73 (secure 0 0 0) 0x7f961c0551e0 con 0x7f962415db70 2023-10-06T01:42:10.556 INFO:teuthology.orchestra.run.smithi071.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T01:42:10.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.557+0000 7f9628b42700 1 -- 172.21.15.71:0/2383775665 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f9604066f30 msgr2=0x7f96040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:10.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.557+0000 7f9628b42700 1 --2- 172.21.15.71:0/2383775665 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f9604066f30 0x7f96040693e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f9614009880 tx=0x7f9614018000 comp rx=0 tx=0).stop 2023-10-06T01:42:10.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.557+0000 7f9628b42700 1 -- 172.21.15.71:0/2383775665 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f962415db70 msgr2=0x7f96240a7cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:10.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.557+0000 7f9628b42700 1 --2- 172.21.15.71:0/2383775665 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f962415db70 0x7f96240a7cd0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f961c00ea50 tx=0x7f961c0091a0 comp rx=0 tx=0).stop 2023-10-06T01:42:10.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.557+0000 7f9628b42700 1 -- 172.21.15.71:0/2383775665 shutdown_connections 2023-10-06T01:42:10.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.557+0000 7f9628b42700 1 --2- 172.21.15.71:0/2383775665 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f962415db70 0x7f96240a7cd0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:10.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.557+0000 7f9628b42700 1 --2- 172.21.15.71:0/2383775665 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f96240af4e0 0x7f96240c8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:10.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.557+0000 7f9628b42700 1 --2- 172.21.15.71:0/2383775665 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f9604066f30 0x7f96040693e0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:10.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.557+0000 7f9628b42700 1 --2- 172.21.15.71:0/2383775665 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96240af8b0 0x7f96240a7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:10.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.557+0000 7f9628b42700 1 -- 172.21.15.71:0/2383775665 >> 172.21.15.71:0/2383775665 conn(0x7f9624068680 msgr2=0x7f96240cd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:10.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.557+0000 7f9628b42700 1 -- 172.21.15.71:0/2383775665 shutdown_connections 2023-10-06T01:42:10.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:10.557+0000 7f9628b42700 1 -- 172.21.15.71:0/2383775665 wait complete. 2023-10-06T01:42:10.570 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T01:42:10.570 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T01:42:10.570 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi071.front.sepia.ceph.com 2023-10-06T01:42:10.570 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T01:42:10.570 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T01:42:10.571 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T01:42:10.571 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T01:42:10.571 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T01:42:10.571 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T01:42:10.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:42:10.571 DEBUG:teuthology.orchestra.run.smithi071:> ip addr 2023-10-06T01:42:10.586 INFO:teuthology.orchestra.run.smithi071.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T01:42:10.587 INFO:teuthology.orchestra.run.smithi071.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T01:42:10.587 INFO:teuthology.orchestra.run.smithi071.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T01:42:10.587 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:42:10.587 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 ::1/128 scope host 2023-10-06T01:42:10.587 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:42:10.587 INFO:teuthology.orchestra.run.smithi071.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T01:42:10.587 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:d8:aa:4a brd ff:ff:ff:ff:ff:ff 2023-10-06T01:42:10.587 INFO:teuthology.orchestra.run.smithi071.stdout: altname enp7s0f0 2023-10-06T01:42:10.587 INFO:teuthology.orchestra.run.smithi071.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T01:42:10.588 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:d8:aa:4b brd ff:ff:ff:ff:ff:ff 2023-10-06T01:42:10.588 INFO:teuthology.orchestra.run.smithi071.stdout: altname enp7s0f1 2023-10-06T01:42:10.588 INFO:teuthology.orchestra.run.smithi071.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T01:42:10.588 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:8f:d7:64 brd ff:ff:ff:ff:ff:ff 2023-10-06T01:42:10.588 INFO:teuthology.orchestra.run.smithi071.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T01:42:10.588 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:8f:d7:65 brd ff:ff:ff:ff:ff:ff 2023-10-06T01:42:10.588 INFO:teuthology.orchestra.run.smithi071.stdout: inet 172.21.15.71/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T01:42:10.588 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft 42245sec preferred_lft 42245sec 2023-10-06T01:42:10.588 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::ec4:7aff:fe8f:d765/64 scope link 2023-10-06T01:42:10.588 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:42:10.588 INFO:teuthology.orchestra.run.smithi071.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T01:42:10.588 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 26:9a:64:34:3b:3a brd ff:ff:ff:ff:ff:ff 2023-10-06T01:42:10.589 INFO:teuthology.orchestra.run.smithi071.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T01:42:10.589 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:42:10.589 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::44c7:acff:febb:6c0/64 scope link 2023-10-06T01:42:10.589 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:42:10.589 INFO:teuthology.orchestra.run.smithi071.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T01:42:10.589 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 26:9a:64:34:3b:3a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T01:42:10.589 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::249a:64ff:fe34:3b3a/64 scope link 2023-10-06T01:42:10.589 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:42:10.589 INFO:teuthology.orchestra.run.smithi071.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T01:42:10.589 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 8a:01:60:14:cf:f7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T01:42:10.589 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::8801:60ff:fe14:cff7/64 scope link 2023-10-06T01:42:10.589 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:42:10.590 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:42:10.590 DEBUG:teuthology.orchestra.run.smithi071:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T01:42:10.649 INFO:teuthology.orchestra.run.smithi071.stdout:1 2023-10-06T01:42:10.650 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:42:10.650 DEBUG:teuthology.orchestra.run.smithi071:> route 2023-10-06T01:42:10.706 INFO:teuthology.orchestra.run.smithi071.stdout:Kernel IP routing table 2023-10-06T01:42:10.706 INFO:teuthology.orchestra.run.smithi071.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T01:42:10.706 INFO:teuthology.orchestra.run.smithi071.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T01:42:10.706 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T01:42:10.707 INFO:teuthology.orchestra.run.smithi071.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T01:42:10.707 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:42:10.707 DEBUG:teuthology.orchestra.run.smithi071:> (cd / && exec bash -c ' 2023-10-06T01:42:10.707 DEBUG:teuthology.orchestra.run.smithi071:> set -e 2023-10-06T01:42:10.707 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T01:42:10.707 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T01:42:10.708 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T01:42:10.708 DEBUG:teuthology.orchestra.run.smithi071:> ') 2023-10-06T01:42:10.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:42:10.805 DEBUG:teuthology.orchestra.run.smithi071:> ip netns list 2023-10-06T01:42:10.820 INFO:teuthology.orchestra.run.smithi071.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T01:42:10.820 INFO:teuthology.orchestra.run.smithi071.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T01:42:10.820 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T01:42:10.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:42:10.820 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link set brx.0 up 2023-10-06T01:42:10.884 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-06T01:42:10.885 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T01:42:10.885 DEBUG:teuthology.orchestra.run.smithi071:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T01:42:10.939 INFO:teuthology.orchestra.run.smithi071.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T01:42:10.939 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T01:42:10.939 DEBUG:teuthology.orchestra.run.smithi071:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T01:42:10.994 DEBUG:teuthology.orchestra.run.smithi071:> sudo modprobe fuse 2023-10-06T01:42:11.059 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T01:42:11.059 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T01:42:11.123 INFO:teuthology.orchestra.run.smithi071.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T01:42:11.123 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T01:42:11.124 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T01:42:11.124 DEBUG:teuthology.orchestra.run.smithi071:> ls /sys/fs/fuse/connections 2023-10-06T01:42:11.179 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T01:42:11.179 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-06T01:42:11.221 DEBUG:teuthology.orchestra.run.smithi071:> sudo modprobe fuse 2023-10-06T01:42:11.245 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T01:42:11.245 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T01:42:11.301 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi071.stderr:2023-10-06T01:42:11.301+0000 7f3e90177540 -1 init, newargv = 0x5595eea10950 newargc=15 2023-10-06T01:42:11.301 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi071.stderr:ceph-fuse[108766]: starting ceph client 2023-10-06T01:42:11.306 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi071.stderr:ceph-fuse[108766]: starting fuse 2023-10-06T01:42:11.310 INFO:teuthology.orchestra.run.smithi071.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T01:42:11.311 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T01:42:11.311 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T01:42:11.311 DEBUG:teuthology.orchestra.run.smithi071:> ls /sys/fs/fuse/connections 2023-10-06T01:42:11.367 INFO:teuthology.orchestra.run.smithi071.stdout:46 2023-10-06T01:42:11.368 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-10-06T01:42:11.368 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T01:42:11.368 DEBUG:teuthology.orchestra.run.smithi071:> import glob 2023-10-06T01:42:11.368 DEBUG:teuthology.orchestra.run.smithi071:> import re 2023-10-06T01:42:11.368 DEBUG:teuthology.orchestra.run.smithi071:> import os 2023-10-06T01:42:11.368 DEBUG:teuthology.orchestra.run.smithi071:> import subprocess 2023-10-06T01:42:11.368 DEBUG:teuthology.orchestra.run.smithi071:> 2023-10-06T01:42:11.368 DEBUG:teuthology.orchestra.run.smithi071:> def _find_admin_socket(client_name): 2023-10-06T01:42:11.368 DEBUG:teuthology.orchestra.run.smithi071:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-06T01:42:11.369 DEBUG:teuthology.orchestra.run.smithi071:> files = glob.glob(asok_path) 2023-10-06T01:42:11.369 DEBUG:teuthology.orchestra.run.smithi071:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-06T01:42:11.369 DEBUG:teuthology.orchestra.run.smithi071:> 2023-10-06T01:42:11.369 DEBUG:teuthology.orchestra.run.smithi071:> # Given a non-glob path, it better be there 2023-10-06T01:42:11.369 DEBUG:teuthology.orchestra.run.smithi071:> if "*" not in asok_path: 2023-10-06T01:42:11.369 DEBUG:teuthology.orchestra.run.smithi071:> assert(len(files) == 1) 2023-10-06T01:42:11.369 DEBUG:teuthology.orchestra.run.smithi071:> return files[0] 2023-10-06T01:42:11.369 DEBUG:teuthology.orchestra.run.smithi071:> 2023-10-06T01:42:11.369 DEBUG:teuthology.orchestra.run.smithi071:> for f in files: 2023-10-06T01:42:11.369 DEBUG:teuthology.orchestra.run.smithi071:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T01:42:11.369 DEBUG:teuthology.orchestra.run.smithi071:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T01:42:11.369 DEBUG:teuthology.orchestra.run.smithi071:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T01:42:11.370 DEBUG:teuthology.orchestra.run.smithi071:> contents = proc_f.read() 2023-10-06T01:42:11.370 DEBUG:teuthology.orchestra.run.smithi071:> if mountpoint in contents: 2023-10-06T01:42:11.370 DEBUG:teuthology.orchestra.run.smithi071:> return f 2023-10-06T01:42:11.370 DEBUG:teuthology.orchestra.run.smithi071:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T01:42:11.370 DEBUG:teuthology.orchestra.run.smithi071:> 2023-10-06T01:42:11.370 DEBUG:teuthology.orchestra.run.smithi071:> print(_find_admin_socket("client.0")) 2023-10-06T01:42:11.370 DEBUG:teuthology.orchestra.run.smithi071:> ' 2023-10-06T01:42:11.488 INFO:teuthology.orchestra.run.smithi071.stdout:/var/run/ceph/ceph-client.0.108766.asok 2023-10-06T01:42:11.671 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.108766.asok 2023-10-06T01:42:11.671 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T01:42:11.671 DEBUG:teuthology.orchestra.run.smithi071:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.108766.asok status 2023-10-06T01:42:11.821 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2023-10-06T01:42:11.821 INFO:teuthology.orchestra.run.smithi071.stdout: "metadata": { 2023-10-06T01:42:11.822 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_sha1": "736ac5ba72cb47af7d6f6666b1e100f7e20a20e2", 2023-10-06T01:42:11.822 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_version": "ceph version 17.2.6-1296-g736ac5ba (736ac5ba72cb47af7d6f6666b1e100f7e20a20e2) quincy (stable)", 2023-10-06T01:42:11.822 INFO:teuthology.orchestra.run.smithi071.stdout: "entity_id": "0", 2023-10-06T01:42:11.822 INFO:teuthology.orchestra.run.smithi071.stdout: "hostname": "smithi071", 2023-10-06T01:42:11.822 INFO:teuthology.orchestra.run.smithi071.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-06T01:42:11.822 INFO:teuthology.orchestra.run.smithi071.stdout: "pid": "108766", 2023-10-06T01:42:11.822 INFO:teuthology.orchestra.run.smithi071.stdout: "root": "/" 2023-10-06T01:42:11.822 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-06T01:42:11.822 INFO:teuthology.orchestra.run.smithi071.stdout: "dentry_count": 0, 2023-10-06T01:42:11.822 INFO:teuthology.orchestra.run.smithi071.stdout: "dentry_pinned_count": 0, 2023-10-06T01:42:11.822 INFO:teuthology.orchestra.run.smithi071.stdout: "id": 5766, 2023-10-06T01:42:11.822 INFO:teuthology.orchestra.run.smithi071.stdout: "inst": { 2023-10-06T01:42:11.823 INFO:teuthology.orchestra.run.smithi071.stdout: "name": { 2023-10-06T01:42:11.823 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "client", 2023-10-06T01:42:11.823 INFO:teuthology.orchestra.run.smithi071.stdout: "num": 5766 2023-10-06T01:42:11.823 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-06T01:42:11.823 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": { 2023-10-06T01:42:11.823 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2023-10-06T01:42:11.823 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "192.168.0.1:0", 2023-10-06T01:42:11.823 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 1233844464 2023-10-06T01:42:11.823 INFO:teuthology.orchestra.run.smithi071.stdout: } 2023-10-06T01:42:11.823 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-06T01:42:11.823 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": { 2023-10-06T01:42:11.823 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2023-10-06T01:42:11.824 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "192.168.0.1:0", 2023-10-06T01:42:11.824 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 1233844464 2023-10-06T01:42:11.824 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2023-10-06T01:42:11.824 INFO:teuthology.orchestra.run.smithi071.stdout: "inst_str": "client.5766 192.168.0.1:0/1233844464", 2023-10-06T01:42:11.824 INFO:teuthology.orchestra.run.smithi071.stdout: "addr_str": "192.168.0.1:0/1233844464", 2023-10-06T01:42:11.824 INFO:teuthology.orchestra.run.smithi071.stdout: "inode_count": 1, 2023-10-06T01:42:11.824 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_epoch": 31, 2023-10-06T01:42:11.824 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_epoch": 54, 2023-10-06T01:42:11.824 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_epoch_barrier": 0, 2023-10-06T01:42:11.824 INFO:teuthology.orchestra.run.smithi071.stdout: "blocklisted": false, 2023-10-06T01:42:11.824 INFO:teuthology.orchestra.run.smithi071.stdout: "fs_name": "cephfs" 2023-10-06T01:42:11.824 INFO:teuthology.orchestra.run.smithi071.stdout:} 2023-10-06T01:42:11.831 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T01:42:11.831 DEBUG:teuthology.orchestra.run.smithi071:> stat --file-system '--printf=%T 2023-10-06T01:42:11.831 DEBUG:teuthology.orchestra.run.smithi071:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-06T01:42:11.846 INFO:teuthology.orchestra.run.smithi071.stdout:fuseblk 2023-10-06T01:42:11.847 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-06T01:42:11.847 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T01:42:11.847 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T01:42:11.911 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T01:42:11.911 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch test_file1) 2023-10-06T01:42:11.973 DEBUG:teuthology.orchestra.run.smithi071:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T01:42:11.973 DEBUG:teuthology.orchestra.run.smithi071:> import os 2023-10-06T01:42:11.973 DEBUG:teuthology.orchestra.run.smithi071:> import time 2023-10-06T01:42:11.973 DEBUG:teuthology.orchestra.run.smithi071:> 2023-10-06T01:42:11.973 DEBUG:teuthology.orchestra.run.smithi071:> fd = os.open("/home/ubuntu/cephtest/mnt.0/background_file", os.O_RDWR | os.O_CREAT, 0o644) 2023-10-06T01:42:11.973 DEBUG:teuthology.orchestra.run.smithi071:> try: 2023-10-06T01:42:11.973 DEBUG:teuthology.orchestra.run.smithi071:> while True: 2023-10-06T01:42:11.973 DEBUG:teuthology.orchestra.run.smithi071:> os.write(fd, b'"'"'content'"'"') 2023-10-06T01:42:11.973 DEBUG:teuthology.orchestra.run.smithi071:> time.sleep(1) 2023-10-06T01:42:11.974 DEBUG:teuthology.orchestra.run.smithi071:> if not True: 2023-10-06T01:42:11.974 DEBUG:teuthology.orchestra.run.smithi071:> break 2023-10-06T01:42:11.974 DEBUG:teuthology.orchestra.run.smithi071:> except IOError as e: 2023-10-06T01:42:11.974 DEBUG:teuthology.orchestra.run.smithi071:> pass 2023-10-06T01:42:11.974 DEBUG:teuthology.orchestra.run.smithi071:> os.close(fd) 2023-10-06T01:42:11.974 DEBUG:teuthology.orchestra.run.smithi071:> ' 2023-10-06T01:42:21.580 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T01:42:21.585 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T01:42:22.118 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T01:42:22.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:22.243+0000 7ff9b62fc700 1 Processor -- start 2023-10-06T01:42:22.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:22.244+0000 7ff9b62fc700 1 -- start start 2023-10-06T01:42:22.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:22.244+0000 7ff9b62fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff9b01597c0 0x7ff9b006a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:22.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:22.244+0000 7ff9b62fc700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9b0069950 con 0x7ff9b01593f0 2023-10-06T01:42:22.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:22.244+0000 7ff9b62fc700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9b00b1fb0 con 0x7ff9b006e520 2023-10-06T01:42:22.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:22.244+0000 7ff9b62fc700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9b00b2850 con 0x7ff9b01597c0 2023-10-06T01:42:22.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:22.245+0000 7ff9affff700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7ff9b01593f0 0x7ff9b006de10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:44256/0 (socket says 172.21.15.71:44256) 2023-10-06T01:42:22.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:22.245+0000 7ff9affff700 1 -- 172.21.15.71:0/1750894643 learned_addr learned my addr 172.21.15.71:0/1750894643 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:42:22.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:22.245+0000 7ff9b4899700 1 --2- 172.21.15.71:0/1750894643 >> v2:172.21.15.72:3300/0 conn(0x7ff9b01597c0 0x7ff9b006a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:22.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:22.245+0000 7ff9aeffd700 1 -- 172.21.15.71:0/1750894643 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4089096550 0 0) 0x7ff9b0069950 con 0x7ff9b01593f0 2023-10-06T01:42:22.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:22.245+0000 7ff9aeffd700 1 -- 172.21.15.71:0/1750894643 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff998003570 con 0x7ff9b01593f0 2023-10-06T01:42:22.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:22.245+0000 7ff9b4899700 1 -- 172.21.15.71:0/1750894643 >> v1:172.21.15.72:6789/0 conn(0x7ff9b006e520 legacy=0x7ff9b0069de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:22.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:22.245+0000 7ff9b4899700 1 -- 172.21.15.71:0/1750894643 >> v1:172.21.15.71:6789/0 conn(0x7ff9b01593f0 legacy=0x7ff9b006de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:22.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:22.245+0000 7ff9b4899700 1 -- 172.21.15.71:0/1750894643 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9b00b2290 con 0x7ff9b01597c0 2023-10-06T01:42:22.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:22.245+0000 7ff9b4899700 1 --2- 172.21.15.71:0/1750894643 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9b01597c0 0x7ff9b006a4f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff9a8009e60 tx=0x7ff9a8009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db859570d0197754 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:22.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:22.245+0000 7ff9aeffd700 1 -- 172.21.15.71:0/1750894643 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a800e070 con 0x7ff9b01597c0 2023-10-06T01:42:22.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:22.245+0000 7ff9aeffd700 1 -- 172.21.15.71:0/1750894643 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9a800bb60 con 0x7ff9b01597c0 2023-10-06T01:42:22.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:22.245+0000 7ff9aeffd700 1 -- 172.21.15.71:0/1750894643 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a8012430 con 0x7ff9b01597c0 2023-10-06T01:42:22.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:22.246+0000 7ff9b62fc700 1 -- 172.21.15.71:0/1750894643 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9b01597c0 msgr2=0x7ff9b006a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:22.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:22.246+0000 7ff9b62fc700 1 --2- 172.21.15.71:0/1750894643 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9b01597c0 0x7ff9b006a4f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff9a8009e60 tx=0x7ff9a8009780 comp rx=0 tx=0).stop 2023-10-06T01:42:22.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:22.246+0000 7ff9b62fc700 1 -- 172.21.15.71:0/1750894643 shutdown_connections 2023-10-06T01:42:22.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:22.246+0000 7ff9b62fc700 1 --2- 172.21.15.71:0/1750894643 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9b01597c0 0x7ff9b006a4f0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:22.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:22.246+0000 7ff9b62fc700 1 -- 172.21.15.71:0/1750894643 >> 172.21.15.71:0/1750894643 conn(0x7ff9b006cff0 msgr2=0x7ff9b00afaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:22.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:22.246+0000 7ff9b62fc700 1 -- 172.21.15.71:0/1750894643 shutdown_connections 2023-10-06T01:42:22.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:22.246+0000 7ff9b62fc700 1 -- 172.21.15.71:0/1750894643 wait complete. 2023-10-06T01:42:22.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:22.247+0000 7ff9b62fc700 1 Processor -- start 2023-10-06T01:42:22.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:22.247+0000 7ff9b62fc700 1 -- start start 2023-10-06T01:42:22.251 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:22.248+0000 7ff9b62fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff9b006e520 0x7ff9b00ca6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:22.251 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:22.248+0000 7ff9b62fc700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9b01593f0 0x7ff9b0142680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:22.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:22.248+0000 7ff9b62fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9b01597c0 0x7ff9b0142bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:22.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:22.248+0000 7ff9b62fc700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b0143100 con 0x7ff9b01593f0 2023-10-06T01:42:22.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:22.248+0000 7ff9b62fc700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b01573e0 con 0x7ff9b01597c0 2023-10-06T01:42:22.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:22.248+0000 7ff9b62fc700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b00cd350 con 0x7ff9b006e520 2023-10-06T01:42:22.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:22.248+0000 7ff9af7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9b01593f0 0x7ff9b0142680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:22.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:22.248+0000 7ff9af7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9b01593f0 0x7ff9b0142680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:59420/0 (socket says 172.21.15.71:59420) 2023-10-06T01:42:22.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:22.248+0000 7ff9af7fe700 1 -- 172.21.15.71:0/590768820 learned_addr learned my addr 172.21.15.71:0/590768820 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:22.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:22.248+0000 7ff9affff700 1 --2- 172.21.15.71:0/590768820 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff9b006e520 0x7ff9b00ca6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:22.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:22.248+0000 7ff9b4899700 1 --2- 172.21.15.71:0/590768820 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9b01597c0 0x7ff9b0142bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:22.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:22.248+0000 7ff9af7fe700 1 -- 172.21.15.71:0/590768820 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff9b006e520 msgr2=0x7ff9b00ca6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:22.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:22.248+0000 7ff9af7fe700 1 --2- 172.21.15.71:0/590768820 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff9b006e520 0x7ff9b00ca6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:22.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:22.248+0000 7ff9af7fe700 1 -- 172.21.15.71:0/590768820 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9b01597c0 msgr2=0x7ff9b0142bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:22.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:22.248+0000 7ff9af7fe700 1 --2- 172.21.15.71:0/590768820 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9b01597c0 0x7ff9b0142bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:22.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:22.248+0000 7ff9af7fe700 1 -- 172.21.15.71:0/590768820 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9a8009a20 con 0x7ff9b01593f0 2023-10-06T01:42:22.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:22.249+0000 7ff9af7fe700 1 --2- 172.21.15.71:0/590768820 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9b01593f0 0x7ff9b0142680 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7ff9a400c790 tx=0x7ff9a4007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:22.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:22.249+0000 7ff997fff700 1 -- 172.21.15.71:0/590768820 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a4011590 con 0x7ff9b01593f0 2023-10-06T01:42:22.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:22.249+0000 7ff997fff700 1 -- 172.21.15.71:0/590768820 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9a40116f0 con 0x7ff9b01593f0 2023-10-06T01:42:22.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:22.249+0000 7ff9b62fc700 1 -- 172.21.15.71:0/590768820 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9b00cd630 con 0x7ff9b01593f0 2023-10-06T01:42:22.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:22.249+0000 7ff997fff700 1 -- 172.21.15.71:0/590768820 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a4011ab0 con 0x7ff9b01593f0 2023-10-06T01:42:22.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:22.249+0000 7ff9b62fc700 1 -- 172.21.15.71:0/590768820 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9b00cac20 con 0x7ff9b01593f0 2023-10-06T01:42:22.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:22.250+0000 7ff9b62fc700 1 -- 172.21.15.71:0/590768820 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9b00cdb50 con 0x7ff9b01593f0 2023-10-06T01:42:22.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:22.250+0000 7ff997fff700 1 -- 172.21.15.71:0/590768820 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff9a401b3b0 con 0x7ff9b01593f0 2023-10-06T01:42:22.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:22.251+0000 7ff997fff700 1 --2- 172.21.15.71:0/590768820 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7ff99c066f30 0x7ff99c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:22.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:22.251+0000 7ff997fff700 1 -- 172.21.15.71:0/590768820 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6378+0+0 (secure 0 0 0) 0x7ff9a4083b40 con 0x7ff9b01593f0 2023-10-06T01:42:22.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:22.251+0000 7ff9affff700 1 --2- 172.21.15.71:0/590768820 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7ff99c066f30 0x7ff99c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:22.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:22.251+0000 7ff9affff700 1 --2- 172.21.15.71:0/590768820 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7ff99c066f30 0x7ff99c0693e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff9a0007fd0 tx=0x7ff9a0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:22.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:22.255+0000 7ff997fff700 1 -- 172.21.15.71:0/590768820 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff9a4050bc0 con 0x7ff9b01593f0 2023-10-06T01:42:22.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:22.480+0000 7ff9b62fc700 1 -- 172.21.15.71:0/590768820 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff9b006d3f0 con 0x7ff9b01593f0 2023-10-06T01:42:22.481 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:22.481+0000 7ff997fff700 1 -- 172.21.15.71:0/590768820 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4591 (secure 0 0 0) 0x7ff9a4017070 con 0x7ff9b01593f0 2023-10-06T01:42:22.482 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:42:22.482 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":31,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5021,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6834/924027954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":924027954},{"type":"v1","addr":"172.21.15.72:6834","nonce":924027954}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5574,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6836/2482160960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":2482160960},{"type":"v1","addr":"172.21.15.71:6836","nonce":2482160960}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5577,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/2163703913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6835","nonce":2163703913},{"type":"v1","addr":"172.21.15.71:6837","nonce":2163703913}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T01:41:59.290125+0000","modified":"2023-10-06T01:42:02.927924+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5586},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5586":{"gid":5586,"name":"b","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6835/627948818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6833","nonce":627948818},{"type":"v1","addr":"172.21.15.72:6835","nonce":627948818}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T01:42:22.484 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:22.483+0000 7ff9b62fc700 1 -- 172.21.15.71:0/590768820 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7ff99c066f30 msgr2=0x7ff99c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:22.484 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:22.483+0000 7ff9b62fc700 1 --2- 172.21.15.71:0/590768820 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7ff99c066f30 0x7ff99c0693e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff9a0007fd0 tx=0x7ff9a0009040 comp rx=0 tx=0).stop 2023-10-06T01:42:22.484 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:22.483+0000 7ff9b62fc700 1 -- 172.21.15.71:0/590768820 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9b01593f0 msgr2=0x7ff9b0142680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:22.484 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:22.483+0000 7ff9b62fc700 1 --2- 172.21.15.71:0/590768820 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9b01593f0 0x7ff9b0142680 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7ff9a400c790 tx=0x7ff9a4007f40 comp rx=0 tx=0).stop 2023-10-06T01:42:22.484 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:22.483+0000 7ff9b62fc700 1 -- 172.21.15.71:0/590768820 shutdown_connections 2023-10-06T01:42:22.484 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:22.483+0000 7ff9b62fc700 1 --2- 172.21.15.71:0/590768820 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7ff99c066f30 0x7ff99c0693e0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:22.484 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:22.483+0000 7ff9b62fc700 1 --2- 172.21.15.71:0/590768820 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9b01597c0 0x7ff9b0142bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:22.484 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:22.483+0000 7ff9b62fc700 1 --2- 172.21.15.71:0/590768820 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff9b006e520 0x7ff9b00ca6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:22.484 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:22.483+0000 7ff9b62fc700 1 --2- 172.21.15.71:0/590768820 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff9b01593f0 0x7ff9b0142680 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:22.485 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:22.483+0000 7ff9b62fc700 1 -- 172.21.15.71:0/590768820 >> 172.21.15.71:0/590768820 conn(0x7ff9b006cff0 msgr2=0x7ff9b0153d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:22.485 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:22.483+0000 7ff9b62fc700 1 -- 172.21.15.71:0/590768820 shutdown_connections 2023-10-06T01:42:22.485 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:22.483+0000 7ff9b62fc700 1 -- 172.21.15.71:0/590768820 wait complete. 2023-10-06T01:42:22.485 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 31 2023-10-06T01:42:22.496 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json force_readonly 2023-10-06T01:42:22.636 DEBUG:tasks.cephfs.filesystem:_json_asok output empty 2023-10-06T01:42:32.637 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T01:42:32.637 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch test_file1) 2023-10-06T01:42:32.658 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T01:42:32.659 INFO:teuthology.orchestra.run.smithi071.stderr:touch: cannot touch 'test_file1': Read-only file system 2023-10-06T01:42:32.659 INFO:tasks.ceph_test_case:waiting 30s for health warning matching MDS_READ_ONLY 2023-10-06T01:42:32.659 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-06T01:42:32.822 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:32.821+0000 7f2a69485700 1 Processor -- start 2023-10-06T01:42:32.822 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:32.821+0000 7f2a69485700 1 -- start start 2023-10-06T01:42:32.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:32.822+0000 7f2a69485700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f2a640c5540 0x7f2a640cb530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:32.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:32.822+0000 7f2a69485700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a6415d490 con 0x7f2a640cba70 2023-10-06T01:42:32.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:32.822+0000 7f2a69485700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a6415a390 con 0x7f2a641596d0 2023-10-06T01:42:32.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:32.822+0000 7f2a69485700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a6415a1b0 con 0x7f2a640c5540 2023-10-06T01:42:32.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:32.822+0000 7f2a627fc700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f2a640c5540 0x7f2a640cb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:32.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:32.822+0000 7f2a637fe700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f2a640cba70 0x7f2a6415d920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:33902/0 (socket says 172.21.15.71:33902) 2023-10-06T01:42:32.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:32.822+0000 7f2a637fe700 1 -- 172.21.15.71:0/3234015159 learned_addr learned my addr 172.21.15.71:0/3234015159 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:42:32.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:32.822+0000 7f2a627fc700 1 -- 172.21.15.71:0/3234015159 >> v1:172.21.15.72:6789/0 conn(0x7f2a641596d0 legacy=0x7f2a64159aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:32.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:32.822+0000 7f2a627fc700 1 -- 172.21.15.71:0/3234015159 >> v1:172.21.15.71:6789/0 conn(0x7f2a640cba70 legacy=0x7f2a6415d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:32.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:32.822+0000 7f2a627fc700 1 -- 172.21.15.71:0/3234015159 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a6415a670 con 0x7f2a640c5540 2023-10-06T01:42:32.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:32.822+0000 7f2a61ffb700 1 -- 172.21.15.71:0/3234015159 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2226730052 0 0) 0x7f2a6415d490 con 0x7f2a640cba70 2023-10-06T01:42:32.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:32.822+0000 7f2a627fc700 1 --2- 172.21.15.71:0/3234015159 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2a640c5540 0x7f2a640cb530 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c0098e0 tx=0x7f2a4c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25786ffaf61e794a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:32.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:32.823+0000 7f2a61ffb700 1 -- 172.21.15.71:0/3234015159 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4c009e80 con 0x7f2a640c5540 2023-10-06T01:42:32.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:32.823+0000 7f2a61ffb700 1 -- 172.21.15.71:0/3234015159 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a4c00b860 con 0x7f2a640c5540 2023-10-06T01:42:32.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:32.823+0000 7f2a61ffb700 1 -- 172.21.15.71:0/3234015159 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4c00bbe0 con 0x7f2a640c5540 2023-10-06T01:42:32.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:32.823+0000 7f2a69485700 1 -- 172.21.15.71:0/3234015159 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2a640c5540 msgr2=0x7f2a640cb530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:32.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:32.823+0000 7f2a69485700 1 --2- 172.21.15.71:0/3234015159 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2a640c5540 0x7f2a640cb530 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c0098e0 tx=0x7f2a4c0091a0 comp rx=0 tx=0).stop 2023-10-06T01:42:32.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:32.823+0000 7f2a69485700 1 -- 172.21.15.71:0/3234015159 shutdown_connections 2023-10-06T01:42:32.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:32.823+0000 7f2a69485700 1 --2- 172.21.15.71:0/3234015159 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2a640c5540 0x7f2a640cb530 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:32.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:32.823+0000 7f2a69485700 1 -- 172.21.15.71:0/3234015159 >> 172.21.15.71:0/3234015159 conn(0x7f2a64068680 msgr2=0x7f2a64068a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:32.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:32.823+0000 7f2a69485700 1 -- 172.21.15.71:0/3234015159 shutdown_connections 2023-10-06T01:42:32.826 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:32.823+0000 7f2a69485700 1 -- 172.21.15.71:0/3234015159 wait complete. 2023-10-06T01:42:32.828 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:32.824+0000 7f2a69485700 1 Processor -- start 2023-10-06T01:42:32.828 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:32.824+0000 7f2a69485700 1 -- start start 2023-10-06T01:42:32.828 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:32.825+0000 7f2a69485700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a640c5540 0x7f2a64153700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:32.828 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:32.825+0000 7f2a69485700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a640cba70 0x7f2a640b21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:32.828 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:32.825+0000 7f2a69485700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2a641596d0 0x7f2a640b2730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:32.829 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:32.825+0000 7f2a69485700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a64153c40 con 0x7f2a641596d0 2023-10-06T01:42:32.829 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:32.825+0000 7f2a69485700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a640c9170 con 0x7f2a640c5540 2023-10-06T01:42:32.829 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:32.825+0000 7f2a69485700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a640c8560 con 0x7f2a640cba70 2023-10-06T01:42:32.829 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:32.825+0000 7f2a637fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2a641596d0 0x7f2a640b2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:32.829 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:32.825+0000 7f2a637fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2a641596d0 0x7f2a640b2730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40926/0 (socket says 172.21.15.71:40926) 2023-10-06T01:42:32.829 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:32.825+0000 7f2a637fe700 1 -- 172.21.15.71:0/3529955005 learned_addr learned my addr 172.21.15.71:0/3529955005 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:32.829 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:32.825+0000 7f2a627fc700 1 --2- 172.21.15.71:0/3529955005 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a640cba70 0x7f2a640b21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:32.829 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:32.825+0000 7f2a62ffd700 1 --2- 172.21.15.71:0/3529955005 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a640c5540 0x7f2a64153700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:32.829 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:32.826+0000 7f2a637fe700 1 -- 172.21.15.71:0/3529955005 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a640cba70 msgr2=0x7f2a640b21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:32.829 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:32.826+0000 7f2a637fe700 1 --2- 172.21.15.71:0/3529955005 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a640cba70 0x7f2a640b21f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:32.829 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:32.826+0000 7f2a637fe700 1 -- 172.21.15.71:0/3529955005 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a640c5540 msgr2=0x7f2a64153700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:32.829 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:32.826+0000 7f2a637fe700 1 --2- 172.21.15.71:0/3529955005 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a640c5540 0x7f2a64153700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:32.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:32.826+0000 7f2a637fe700 1 -- 172.21.15.71:0/3529955005 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a4c009420 con 0x7f2a641596d0 2023-10-06T01:42:32.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:32.826+0000 7f2a627fc700 1 --2- 172.21.15.71:0/3529955005 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a640cba70 0x7f2a640b21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:42:32.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:32.826+0000 7f2a62ffd700 1 --2- 172.21.15.71:0/3529955005 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a640c5540 0x7f2a64153700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:42:32.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:32.826+0000 7f2a637fe700 1 --2- 172.21.15.71:0/3529955005 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2a641596d0 0x7f2a640b2730 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f2a5400cc90 tx=0x7f2a54001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:32.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:32.826+0000 7f2a5affd700 1 -- 172.21.15.71:0/3529955005 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a5400cea0 con 0x7f2a641596d0 2023-10-06T01:42:32.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:32.826+0000 7f2a5affd700 1 -- 172.21.15.71:0/3529955005 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a5400ab10 con 0x7f2a641596d0 2023-10-06T01:42:32.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:32.826+0000 7f2a5affd700 1 -- 172.21.15.71:0/3529955005 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a540070f0 con 0x7f2a641596d0 2023-10-06T01:42:32.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:32.826+0000 7f2a69485700 1 -- 172.21.15.71:0/3529955005 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a640c8840 con 0x7f2a641596d0 2023-10-06T01:42:32.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:32.826+0000 7f2a69485700 1 -- 172.21.15.71:0/3529955005 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a640c8e00 con 0x7f2a641596d0 2023-10-06T01:42:32.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:32.827+0000 7f2a69485700 1 -- 172.21.15.71:0/3529955005 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a640c9300 con 0x7f2a641596d0 2023-10-06T01:42:32.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:32.827+0000 7f2a5affd700 1 -- 172.21.15.71:0/3529955005 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2a540074e0 con 0x7f2a641596d0 2023-10-06T01:42:32.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:32.828+0000 7f2a5affd700 1 --2- 172.21.15.71:0/3529955005 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f2a44066f30 0x7f2a440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:32.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:32.828+0000 7f2a5affd700 1 -- 172.21.15.71:0/3529955005 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f2a54084be0 con 0x7f2a641596d0 2023-10-06T01:42:32.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:32.828+0000 7f2a62ffd700 1 --2- 172.21.15.71:0/3529955005 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f2a44066f30 0x7f2a440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:32.833 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:32.828+0000 7f2a62ffd700 1 --2- 172.21.15.71:0/3529955005 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f2a44066f30 0x7f2a440693e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c0017a0 tx=0x7f2a5c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:32.833 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:32.832+0000 7f2a5affd700 1 -- 172.21.15.71:0/3529955005 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2a54051c30 con 0x7f2a641596d0 2023-10-06T01:42:33.056 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.055+0000 7f2a69485700 1 -- 172.21.15.71:0/3529955005 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f2a6415a950 con 0x7f2a641596d0 2023-10-06T01:42:33.056 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.055+0000 7f2a5affd700 1 -- 172.21.15.71:0/3529955005 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+159 (secure 0 0 0) 0x7f2a54055250 con 0x7f2a641596d0 2023-10-06T01:42:33.056 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:42:33.056 INFO:teuthology.orchestra.run.smithi071.stdout:{"status":"HEALTH_WARN","checks":{"MDS_READ_ONLY":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs are read only","count":1},"muted":false}},"mutes":[]} 2023-10-06T01:42:33.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.057+0000 7f2a69485700 1 -- 172.21.15.71:0/3529955005 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f2a44066f30 msgr2=0x7f2a440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:33.058 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.057+0000 7f2a69485700 1 --2- 172.21.15.71:0/3529955005 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f2a44066f30 0x7f2a440693e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c0017a0 tx=0x7f2a5c009040 comp rx=0 tx=0).stop 2023-10-06T01:42:33.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.057+0000 7f2a69485700 1 -- 172.21.15.71:0/3529955005 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2a641596d0 msgr2=0x7f2a640b2730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:33.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.057+0000 7f2a69485700 1 --2- 172.21.15.71:0/3529955005 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2a641596d0 0x7f2a640b2730 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f2a5400cc90 tx=0x7f2a54001a00 comp rx=0 tx=0).stop 2023-10-06T01:42:33.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.057+0000 7f2a69485700 1 -- 172.21.15.71:0/3529955005 shutdown_connections 2023-10-06T01:42:33.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.057+0000 7f2a69485700 1 --2- 172.21.15.71:0/3529955005 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2a641596d0 0x7f2a640b2730 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:33.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.057+0000 7f2a69485700 1 --2- 172.21.15.71:0/3529955005 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f2a44066f30 0x7f2a440693e0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:33.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.057+0000 7f2a69485700 1 --2- 172.21.15.71:0/3529955005 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a640c5540 0x7f2a64153700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:33.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.057+0000 7f2a69485700 1 --2- 172.21.15.71:0/3529955005 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2a640cba70 0x7f2a640b21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:33.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.057+0000 7f2a69485700 1 -- 172.21.15.71:0/3529955005 >> 172.21.15.71:0/3529955005 conn(0x7f2a64068680 msgr2=0x7f2a640cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:33.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.057+0000 7f2a69485700 1 -- 172.21.15.71:0/3529955005 shutdown_connections 2023-10-06T01:42:33.059 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.058+0000 7f2a69485700 1 -- 172.21.15.71:0/3529955005 wait complete. 2023-10-06T01:42:33.070 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-06T01:42:33.070 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T01:42:33.070 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T01:42:33.071 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T01:42:33.071 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T01:42:33.071 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T01:42:33.071 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T01:42:33.071 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T01:42:33.072 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T01:42:33.079 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T01:42:33.079 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail a 2023-10-06T01:42:33.080 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T01:42:33.080 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail c 2023-10-06T01:42:33.083 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T01:42:33.083 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail b 2023-10-06T01:42:33.084 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T01:42:33.084 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail d 2023-10-06T01:42:33.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.242+0000 7f5f09093700 1 Processor -- start 2023-10-06T01:42:33.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.242+0000 7f5f09093700 1 -- start start 2023-10-06T01:42:33.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.242+0000 7ff45d987700 1 Processor -- start 2023-10-06T01:42:33.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.242+0000 7f292a8b2700 1 Processor -- start 2023-10-06T01:42:33.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.242+0000 7f071ad38700 1 Processor -- start 2023-10-06T01:42:33.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.242+0000 7f292a8b2700 1 -- start start 2023-10-06T01:42:33.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.242+0000 7f071ad38700 1 -- start start 2023-10-06T01:42:33.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.242+0000 7ff45d987700 1 -- start start 2023-10-06T01:42:33.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.243+0000 7f5f09093700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5f040a89c0 0x7f5f040aeaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:33.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.243+0000 7f5f09093700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f5f040a8d90 0x7f5f040af030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:33.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.243+0000 7f5f09093700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f0406b030 con 0x7f5f040af570 2023-10-06T01:42:33.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.243+0000 7f5f09093700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f040af9b0 con 0x7f5f040a8d90 2023-10-06T01:42:33.245 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.243+0000 7f5f09093700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f040b1ab0 con 0x7f5f040a89c0 2023-10-06T01:42:33.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.243+0000 7f292a8b2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f29240add80 0x7f2924157dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:33.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.243+0000 7f292a8b2700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29240c88f0 con 0x7f29240ae150 2023-10-06T01:42:33.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.243+0000 7f292a8b2700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29240cce90 con 0x7f29240cc820 2023-10-06T01:42:33.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.243+0000 7f292a8b2700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29240af760 con 0x7f29240add80 2023-10-06T01:42:33.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.243+0000 7ff45d987700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff45806c460 0x7ff45815da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:33.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.243+0000 7ff45d987700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff45806c830 0x7ff458159670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:33.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.243+0000 7ff45d987700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4580c7cb0 con 0x7ff4580c7840 2023-10-06T01:42:33.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.243+0000 7ff45d987700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff45815dfc0 con 0x7ff45806c460 2023-10-06T01:42:33.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.243+0000 7ff45d987700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4580c7f90 con 0x7ff45806c830 2023-10-06T01:42:33.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.243+0000 7f5f0359e700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f5f040af570 0x7f5f040b2810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:33906/0 (socket says 172.21.15.71:33906) 2023-10-06T01:42:33.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.243+0000 7f5f0359e700 1 -- 172.21.15.71:0/3232798406 learned_addr learned my addr 172.21.15.71:0/3232798406 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:42:33.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.243+0000 7f5f0259c700 1 --2- 172.21.15.71:0/3232798406 >> v2:172.21.15.71:3300/0 conn(0x7f5f040a8d90 0x7f5f040af030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:33.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.243+0000 7f071ad38700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0714156350 0x7f071415ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:33.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.243+0000 7f071ad38700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0714156720 0x7f07140adb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:33.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.243+0000 7f071ad38700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07140b00e0 con 0x7f07140c7f20 2023-10-06T01:42:33.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.243+0000 7f071ad38700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07140c87c0 con 0x7f0714156350 2023-10-06T01:42:33.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.243+0000 7f071ad38700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07140b0960 con 0x7f0714156720 2023-10-06T01:42:33.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.243+0000 7f07192d5700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f07140c7f20 0x7f071406e2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:33918/0 (socket says 172.21.15.71:33918) 2023-10-06T01:42:33.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.243+0000 7f07192d5700 1 -- 172.21.15.71:0/3230603577 learned_addr learned my addr 172.21.15.71:0/3230603577 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:42:33.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.243+0000 7f2928e4f700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f29240ae150 0x7f292406e2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:33908/0 (socket says 172.21.15.71:33908) 2023-10-06T01:42:33.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.243+0000 7f2928e4f700 1 -- 172.21.15.71:0/3882142943 learned_addr learned my addr 172.21.15.71:0/3882142943 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:42:33.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.243+0000 7f0713fff700 1 --2- 172.21.15.71:0/3230603577 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0714156720 0x7f07140adb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:33.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.243+0000 7f2923fff700 1 --2- 172.21.15.71:0/3882142943 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f29240add80 0x7f2924157dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:33.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.243+0000 7f0718ad4700 1 --2- 172.21.15.71:0/3230603577 >> v2:172.21.15.72:3300/0 conn(0x7f0714156350 0x7f071415ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:33.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.243+0000 7f5f02d9d700 1 --2- 172.21.15.71:0/3232798406 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5f040a89c0 0x7f5f040aeaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:33.251 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.243+0000 7ff4567fc700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7ff4580c7840 0x7ff458158f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:33920/0 (socket says 172.21.15.71:33920) 2023-10-06T01:42:33.251 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.243+0000 7ff4567fc700 1 -- 172.21.15.71:0/60298326 learned_addr learned my addr 172.21.15.71:0/60298326 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:42:33.251 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.243+0000 7ff4577fe700 1 --2- 172.21.15.71:0/60298326 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff45806c830 0x7ff458159670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:33.251 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.244+0000 7f2922ffd700 1 -- 172.21.15.71:0/3882142943 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1838939694 0 0) 0x7f29240c88f0 con 0x7f29240ae150 2023-10-06T01:42:33.251 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.244+0000 7f2922ffd700 1 -- 172.21.15.71:0/3882142943 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2910003570 con 0x7f29240ae150 2023-10-06T01:42:33.251 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.244+0000 7f2923fff700 1 -- 172.21.15.71:0/3882142943 >> v1:172.21.15.72:6789/0 conn(0x7f29240cc820 legacy=0x7f29240c8d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:33.251 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.244+0000 7f2923fff700 1 -- 172.21.15.71:0/3882142943 >> v1:172.21.15.71:6789/0 conn(0x7f29240ae150 legacy=0x7f292406e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:33.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.244+0000 7f2923fff700 1 -- 172.21.15.71:0/3882142943 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29240afa00 con 0x7f29240add80 2023-10-06T01:42:33.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.244+0000 7f07137fe700 1 -- 172.21.15.71:0/3230603577 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3625786438 0 0) 0x7f07140b00e0 con 0x7f07140c7f20 2023-10-06T01:42:33.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.244+0000 7f0713fff700 1 -- 172.21.15.71:0/3230603577 >> v2:172.21.15.72:3300/0 conn(0x7f0714156350 msgr2=0x7f071415ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:33.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.244+0000 7f0713fff700 1 --2- 172.21.15.71:0/3230603577 >> v2:172.21.15.72:3300/0 conn(0x7f0714156350 0x7f071415ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:33.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.244+0000 7f0713fff700 1 -- 172.21.15.71:0/3230603577 >> v1:172.21.15.71:6789/0 conn(0x7f07140c7f20 legacy=0x7f071406e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:33.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.244+0000 7f0713fff700 1 -- 172.21.15.71:0/3230603577 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f071415b090 con 0x7f0714156720 2023-10-06T01:42:33.252 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.243+0000 7ff456ffd700 1 --2- 172.21.15.71:0/60298326 >> v2:172.21.15.72:3300/0 conn(0x7ff45806c460 0x7ff45815da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:33.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.244+0000 7ff455ffb700 1 -- 172.21.15.71:0/60298326 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3453869983 0 0) 0x7ff4580c7cb0 con 0x7ff4580c7840 2023-10-06T01:42:33.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.244+0000 7ff455ffb700 1 -- 172.21.15.71:0/60298326 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff440003570 con 0x7ff4580c7840 2023-10-06T01:42:33.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.243+0000 7f5f0259c700 1 -- 172.21.15.71:0/3232798406 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5f040a89c0 msgr2=0x7f5f040aeaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:33.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.243+0000 7f5f0259c700 1 --2- 172.21.15.71:0/3232798406 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5f040a89c0 0x7f5f040aeaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:33.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.243+0000 7f5f0259c700 1 -- 172.21.15.71:0/3232798406 >> v1:172.21.15.71:6789/0 conn(0x7f5f040af570 legacy=0x7f5f040b2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:33.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.243+0000 7f5f0259c700 1 -- 172.21.15.71:0/3232798406 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f0406ad50 con 0x7f5f040a8d90 2023-10-06T01:42:33.253 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.244+0000 7f5f0259c700 1 --2- 172.21.15.71:0/3232798406 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f040a8d90 0x7f5f040af030 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f5ef80098e0 tx=0x7f5ef80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd3675a10ff37b0e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:33.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.244+0000 7f0713fff700 1 --2- 172.21.15.71:0/3230603577 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0714156720 0x7f07140adb50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f07000098e0 tx=0x7f07000091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f2d72d444e6508f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:33.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.244+0000 7ff4577fe700 1 -- 172.21.15.71:0/60298326 >> v2:172.21.15.72:3300/0 conn(0x7ff45806c460 msgr2=0x7ff45815da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:33.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.244+0000 7ff4577fe700 1 --2- 172.21.15.71:0/60298326 >> v2:172.21.15.72:3300/0 conn(0x7ff45806c460 0x7ff45815da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:33.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.244+0000 7ff455ffb700 1 -- 172.21.15.71:0/60298326 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 556058063 0 0) 0x7ff440003570 con 0x7ff4580c7840 2023-10-06T01:42:33.254 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.244+0000 7ff4577fe700 1 -- 172.21.15.71:0/60298326 >> v1:172.21.15.71:6789/0 conn(0x7ff4580c7840 legacy=0x7ff458158f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:33.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.244+0000 7ff4577fe700 1 -- 172.21.15.71:0/60298326 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4580c8270 con 0x7ff45806c830 2023-10-06T01:42:33.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.244+0000 7f5f01d9b700 1 -- 172.21.15.71:0/3232798406 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef8009e80 con 0x7f5f040a8d90 2023-10-06T01:42:33.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.244+0000 7f2923fff700 1 --2- 172.21.15.71:0/3882142943 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f29240add80 0x7f2924157dd0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f290c009910 tx=0x7f290c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=adf931584e4b4cba server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:33.255 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.244+0000 7f07137fe700 1 -- 172.21.15.71:0/3230603577 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f070000b640 con 0x7f0714156720 2023-10-06T01:42:33.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.244+0000 7f5f01d9b700 1 -- 172.21.15.71:0/3232798406 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ef800b860 con 0x7f5f040a8d90 2023-10-06T01:42:33.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.244+0000 7f5f01d9b700 1 -- 172.21.15.71:0/3232798406 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef800bbe0 con 0x7f5f040a8d90 2023-10-06T01:42:33.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.244+0000 7f07137fe700 1 -- 172.21.15.71:0/3230603577 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f070000b7a0 con 0x7f0714156720 2023-10-06T01:42:33.257 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.244+0000 7f07137fe700 1 -- 172.21.15.71:0/3230603577 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f070000bb40 con 0x7f0714156720 2023-10-06T01:42:33.257 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.244+0000 7ff4577fe700 1 --2- 172.21.15.71:0/60298326 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff45806c830 0x7ff458159670 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff450009e90 tx=0x7ff450009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=115572aabc60f9dd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:33.257 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.244+0000 7f2922ffd700 1 -- 172.21.15.71:0/3882142943 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f290c00b710 con 0x7f29240add80 2023-10-06T01:42:33.257 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.244+0000 7f2922ffd700 1 -- 172.21.15.71:0/3882142943 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f290c00b870 con 0x7f29240add80 2023-10-06T01:42:33.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.244+0000 7f2922ffd700 1 -- 172.21.15.71:0/3882142943 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f290c00bc30 con 0x7f29240add80 2023-10-06T01:42:33.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.244+0000 7ff455ffb700 1 -- 172.21.15.71:0/60298326 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff45000e070 con 0x7ff45806c830 2023-10-06T01:42:33.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.244+0000 7ff455ffb700 1 -- 172.21.15.71:0/60298326 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff45000bb40 con 0x7ff45806c830 2023-10-06T01:42:33.258 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.244+0000 7ff455ffb700 1 -- 172.21.15.71:0/60298326 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff450012430 con 0x7ff45806c830 2023-10-06T01:42:33.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.245+0000 7f292a8b2700 1 -- 172.21.15.71:0/3882142943 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f29240add80 msgr2=0x7f2924157dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:33.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.245+0000 7f292a8b2700 1 --2- 172.21.15.71:0/3882142943 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f29240add80 0x7f2924157dd0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f290c009910 tx=0x7f290c0091a0 comp rx=0 tx=0).stop 2023-10-06T01:42:33.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.245+0000 7f292a8b2700 1 -- 172.21.15.71:0/3882142943 shutdown_connections 2023-10-06T01:42:33.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.245+0000 7f292a8b2700 1 --2- 172.21.15.71:0/3882142943 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f29240add80 0x7f2924157dd0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:33.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.245+0000 7f292a8b2700 1 -- 172.21.15.71:0/3882142943 >> 172.21.15.71:0/3882142943 conn(0x7f2924069110 msgr2=0x7f29240cbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:33.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.245+0000 7f071ad38700 1 -- 172.21.15.71:0/3230603577 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0714156720 msgr2=0x7f07140adb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:33.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.245+0000 7f5f09093700 1 -- 172.21.15.71:0/3232798406 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f040a8d90 msgr2=0x7f5f040af030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:33.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.245+0000 7f5f09093700 1 --2- 172.21.15.71:0/3232798406 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f040a8d90 0x7f5f040af030 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f5ef80098e0 tx=0x7f5ef80091a0 comp rx=0 tx=0).stop 2023-10-06T01:42:33.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.245+0000 7f071ad38700 1 --2- 172.21.15.71:0/3230603577 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0714156720 0x7f07140adb50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f07000098e0 tx=0x7f07000091a0 comp rx=0 tx=0).stop 2023-10-06T01:42:33.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.245+0000 7f292a8b2700 1 -- 172.21.15.71:0/3882142943 shutdown_connections 2023-10-06T01:42:33.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.245+0000 7ff45d987700 1 -- 172.21.15.71:0/60298326 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff45806c830 msgr2=0x7ff458159670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:33.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.245+0000 7ff45d987700 1 --2- 172.21.15.71:0/60298326 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff45806c830 0x7ff458159670 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff450009e90 tx=0x7ff450009780 comp rx=0 tx=0).stop 2023-10-06T01:42:33.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.245+0000 7f071ad38700 1 -- 172.21.15.71:0/3230603577 shutdown_connections 2023-10-06T01:42:33.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.245+0000 7f071ad38700 1 --2- 172.21.15.71:0/3230603577 >> v2:172.21.15.72:3300/0 conn(0x7f0714156350 0x7f071415ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:33.261 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.245+0000 7f071ad38700 1 --2- 172.21.15.71:0/3230603577 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0714156720 0x7f07140adb50 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:33.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.245+0000 7f5f09093700 1 -- 172.21.15.71:0/3232798406 shutdown_connections 2023-10-06T01:42:33.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.245+0000 7f5f09093700 1 --2- 172.21.15.71:0/3232798406 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5f040a89c0 0x7f5f040aeaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:33.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.245+0000 7f5f09093700 1 --2- 172.21.15.71:0/3232798406 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f040a8d90 0x7f5f040af030 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:33.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.245+0000 7f292a8b2700 1 -- 172.21.15.71:0/3882142943 wait complete. 2023-10-06T01:42:33.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.245+0000 7f071ad38700 1 -- 172.21.15.71:0/3230603577 >> 172.21.15.71:0/3230603577 conn(0x7f0714069110 msgr2=0x7f07140cbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:33.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.245+0000 7f5f09093700 1 -- 172.21.15.71:0/3232798406 >> 172.21.15.71:0/3232798406 conn(0x7f5f04067910 msgr2=0x7f5f040ce120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:33.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.245+0000 7ff45d987700 1 -- 172.21.15.71:0/60298326 shutdown_connections 2023-10-06T01:42:33.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.245+0000 7ff45d987700 1 --2- 172.21.15.71:0/60298326 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff45806c830 0x7ff458159670 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:33.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.245+0000 7ff45d987700 1 --2- 172.21.15.71:0/60298326 >> v2:172.21.15.72:3300/0 conn(0x7ff45806c460 0x7ff45815da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:33.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.245+0000 7ff45d987700 1 -- 172.21.15.71:0/60298326 >> 172.21.15.71:0/60298326 conn(0x7ff4580c9cc0 msgr2=0x7ff45806acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:33.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.245+0000 7f071ad38700 1 -- 172.21.15.71:0/3230603577 shutdown_connections 2023-10-06T01:42:33.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.245+0000 7f071ad38700 1 -- 172.21.15.71:0/3230603577 wait complete. 2023-10-06T01:42:33.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.245+0000 7ff45d987700 1 -- 172.21.15.71:0/60298326 shutdown_connections 2023-10-06T01:42:33.264 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.245+0000 7f5f09093700 1 -- 172.21.15.71:0/3232798406 shutdown_connections 2023-10-06T01:42:33.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.246+0000 7f292a8b2700 1 Processor -- start 2023-10-06T01:42:33.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.246+0000 7f5f09093700 1 -- 172.21.15.71:0/3232798406 wait complete. 2023-10-06T01:42:33.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.246+0000 7f071ad38700 1 Processor -- start 2023-10-06T01:42:33.265 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.246+0000 7ff45d987700 1 -- 172.21.15.71:0/60298326 wait complete. 2023-10-06T01:42:33.267 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.246+0000 7f292a8b2700 1 -- start start 2023-10-06T01:42:33.267 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.247+0000 7f292a8b2700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f29240add80 0x7f2924141b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:33.267 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.247+0000 7f292a8b2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f29240ae150 0x7f29240c9e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:33.267 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.247+0000 7f292a8b2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29240cc820 0x7f29240ca340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:33.267 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.247+0000 7f292a8b2700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2924142060 con 0x7f29240add80 2023-10-06T01:42:33.267 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.247+0000 7f292a8b2700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2924158190 con 0x7f29240cc820 2023-10-06T01:42:33.267 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.247+0000 7f292a8b2700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2924169100 con 0x7f29240ae150 2023-10-06T01:42:33.267 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.247+0000 7f2923fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f29240add80 0x7f2924141b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:33.267 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.247+0000 7f2923fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f29240add80 0x7f2924141b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40954/0 (socket says 172.21.15.71:40954) 2023-10-06T01:42:33.267 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.247+0000 7f2923fff700 1 -- 172.21.15.71:0/4216481617 learned_addr learned my addr 172.21.15.71:0/4216481617 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:33.267 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.247+0000 7f29237fe700 1 --2- 172.21.15.71:0/4216481617 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f29240ae150 0x7f29240c9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:33.267 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.247+0000 7f2928e4f700 1 --2- 172.21.15.71:0/4216481617 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29240cc820 0x7f29240ca340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:33.268 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.248+0000 7f2923fff700 1 -- 172.21.15.71:0/4216481617 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f29240ae150 msgr2=0x7f29240c9e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:33.268 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.248+0000 7f2923fff700 1 --2- 172.21.15.71:0/4216481617 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f29240ae150 0x7f29240c9e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:33.268 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.248+0000 7f2923fff700 1 -- 172.21.15.71:0/4216481617 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29240cc820 msgr2=0x7f29240ca340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:33.268 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.248+0000 7f2923fff700 1 --2- 172.21.15.71:0/4216481617 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29240cc820 0x7f29240ca340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:33.268 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.248+0000 7f2923fff700 1 -- 172.21.15.71:0/4216481617 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f290c009420 con 0x7f29240add80 2023-10-06T01:42:33.268 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.248+0000 7f2923fff700 1 --2- 172.21.15.71:0/4216481617 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f29240add80 0x7f2924141b20 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f290c0093f0 tx=0x7f290c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:33.268 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.248+0000 7f291bfff700 1 -- 172.21.15.71:0/4216481617 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f290c01a430 con 0x7f29240add80 2023-10-06T01:42:33.268 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.248+0000 7f292a8b2700 1 -- 172.21.15.71:0/4216481617 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2924157860 con 0x7f29240add80 2023-10-06T01:42:33.268 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.248+0000 7f292a8b2700 1 -- 172.21.15.71:0/4216481617 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2924157e20 con 0x7f29240add80 2023-10-06T01:42:33.268 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.248+0000 7f291bfff700 1 -- 172.21.15.71:0/4216481617 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f290c01a7a0 con 0x7f29240add80 2023-10-06T01:42:33.268 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.248+0000 7f291bfff700 1 -- 172.21.15.71:0/4216481617 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f290c01a910 con 0x7f29240add80 2023-10-06T01:42:33.269 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.248+0000 7f071ad38700 1 -- start start 2023-10-06T01:42:33.269 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.248+0000 7ff45d987700 1 Processor -- start 2023-10-06T01:42:33.269 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.248+0000 7ff45d987700 1 -- start start 2023-10-06T01:42:33.270 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.248+0000 7f5f09093700 1 Processor -- start 2023-10-06T01:42:33.270 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.248+0000 7f5f09093700 1 -- start start 2023-10-06T01:42:33.270 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.248+0000 7f5f09093700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f040a89c0 0x7f5f040c75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:33.270 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.248+0000 7f5f09093700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f040a8d90 0x7f5f040c7b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:33.270 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.248+0000 7f5f09093700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5f040af570 0x7f5f040c3160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:33.270 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.248+0000 7f5f09093700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f0416ac40 con 0x7f5f040a89c0 2023-10-06T01:42:33.270 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.249+0000 7f5f09093700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f0414b260 con 0x7f5f040a8d90 2023-10-06T01:42:33.270 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.249+0000 7f5f09093700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f040c3e90 con 0x7f5f040af570 2023-10-06T01:42:33.270 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.249+0000 7f5f02d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f040a89c0 0x7f5f040c75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:33.270 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.249+0000 7f5f02d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f040a89c0 0x7f5f040c75e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40956/0 (socket says 172.21.15.71:40956) 2023-10-06T01:42:33.270 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.249+0000 7f5f02d9d700 1 -- 172.21.15.71:0/4059611404 learned_addr learned my addr 172.21.15.71:0/4059611404 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:33.271 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.249+0000 7f5f0259c700 1 --2- 172.21.15.71:0/4059611404 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f040a8d90 0x7f5f040c7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:33.271 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.249+0000 7ff45d987700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff45806c460 0x7ff45815c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:33.271 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.249+0000 7ff45d987700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff45806c830 0x7ff45815a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:33.271 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.249+0000 7ff45d987700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4580c7840 0x7ff45814a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:33.271 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.249+0000 7ff45d987700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff45815acb0 con 0x7ff45806c830 2023-10-06T01:42:33.271 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.249+0000 7ff45d987700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff45816da00 con 0x7ff4580c7840 2023-10-06T01:42:33.271 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.249+0000 7ff45d987700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff45815a9d0 con 0x7ff45806c460 2023-10-06T01:42:33.272 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.249+0000 7f5f0359e700 1 --2- 172.21.15.71:0/4059611404 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5f040af570 0x7f5f040c3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:33.272 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.249+0000 7f071ad38700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f07140c7f20 0x7f07141519d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:33.272 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.249+0000 7f071ad38700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0714156350 0x7f071414df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:33.272 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.249+0000 7f071ad38700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0714156720 0x7f0714169b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:33.272 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.249+0000 7f071ad38700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07140ab3c0 con 0x7f07140c7f20 2023-10-06T01:42:33.272 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.249+0000 7f071ad38700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07141582f0 con 0x7f0714156720 2023-10-06T01:42:33.272 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.249+0000 7f071ad38700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f071414e450 con 0x7f0714156350 2023-10-06T01:42:33.272 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.249+0000 7ff4577fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4580c7840 0x7ff45814a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:33.273 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.249+0000 7ff4577fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4580c7840 0x7ff45814a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:38064/0 (socket says 172.21.15.71:38064) 2023-10-06T01:42:33.273 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.249+0000 7ff4577fe700 1 -- 172.21.15.71:0/1146413769 learned_addr learned my addr 172.21.15.71:0/1146413769 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:33.273 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.249+0000 7f5f02d9d700 1 -- 172.21.15.71:0/4059611404 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5f040af570 msgr2=0x7f5f040c3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:33.273 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.249+0000 7f5f02d9d700 1 --2- 172.21.15.71:0/4059611404 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5f040af570 0x7f5f040c3160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:33.273 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.249+0000 7f5f02d9d700 1 -- 172.21.15.71:0/4059611404 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f040a8d90 msgr2=0x7f5f040c7b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:33.273 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.249+0000 7f5f02d9d700 1 --2- 172.21.15.71:0/4059611404 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f040a8d90 0x7f5f040c7b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:33.274 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.249+0000 7f5f02d9d700 1 -- 172.21.15.71:0/4059611404 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ef8009420 con 0x7f5f040a89c0 2023-10-06T01:42:33.274 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.249+0000 7f07192d5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0714156720 0x7f0714169b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:33.274 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.249+0000 7f07192d5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0714156720 0x7f0714169b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:38076/0 (socket says 172.21.15.71:38076) 2023-10-06T01:42:33.274 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.249+0000 7f07192d5700 1 -- 172.21.15.71:0/894847579 learned_addr learned my addr 172.21.15.71:0/894847579 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:33.274 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.249+0000 7f0713fff700 1 --2- 172.21.15.71:0/894847579 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0714156350 0x7f071414df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:33.275 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.249+0000 7f5f02d9d700 1 --2- 172.21.15.71:0/4059611404 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f040a89c0 0x7f5f040c75e0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f5ef400d890 tx=0x7f5ef4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:33.275 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.249+0000 7ff4567fc700 1 --2- 172.21.15.71:0/1146413769 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff45806c830 0x7ff45815a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:33.275 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.249+0000 7f07192d5700 1 -- 172.21.15.71:0/894847579 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0714156350 msgr2=0x7f071414df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:33.275 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.249+0000 7f07192d5700 1 --2- 172.21.15.71:0/894847579 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0714156350 0x7f071414df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:33.276 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.249+0000 7f07192d5700 1 -- 172.21.15.71:0/894847579 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f07140c7f20 msgr2=0x7f07141519d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T01:42:33.276 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.250+0000 7f07192d5700 1 --2- 172.21.15.71:0/894847579 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f07140c7f20 0x7f07141519d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:33.276 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.250+0000 7f07192d5700 1 -- 172.21.15.71:0/894847579 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0700009420 con 0x7f0714156720 2023-10-06T01:42:33.276 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.250+0000 7f5eeaffd700 1 -- 172.21.15.71:0/4059611404 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef4018070 con 0x7f5f040a89c0 2023-10-06T01:42:33.276 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.250+0000 7f5eeaffd700 1 -- 172.21.15.71:0/4059611404 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ef4005a00 con 0x7f5f040a89c0 2023-10-06T01:42:33.276 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.250+0000 7f5eeaffd700 1 -- 172.21.15.71:0/4059611404 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef4005dc0 con 0x7f5f040a89c0 2023-10-06T01:42:33.277 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.250+0000 7f07192d5700 1 --2- 172.21.15.71:0/894847579 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0714156720 0x7f0714169b90 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f070c00cc90 tx=0x7f070c001a80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:33.277 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.250+0000 7ff4567fc700 1 -- 172.21.15.71:0/1146413769 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff45806c460 msgr2=0x7ff45815c720 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T01:42:33.277 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.250+0000 7ff4567fc700 1 --2- 172.21.15.71:0/1146413769 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff45806c460 0x7ff45815c720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:33.277 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.250+0000 7ff4567fc700 1 -- 172.21.15.71:0/1146413769 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4580c7840 msgr2=0x7ff45814a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:33.277 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.250+0000 7ff4567fc700 1 --2- 172.21.15.71:0/1146413769 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4580c7840 0x7ff45814a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:33.277 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.250+0000 7ff4567fc700 1 -- 172.21.15.71:0/1146413769 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff450009a20 con 0x7ff45806c830 2023-10-06T01:42:33.278 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.250+0000 7f5f09093700 1 -- 172.21.15.71:0/4059611404 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f040c4170 con 0x7f5f040a89c0 2023-10-06T01:42:33.278 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.250+0000 7ff4567fc700 1 --2- 172.21.15.71:0/1146413769 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff45806c830 0x7ff45815a170 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7ff44c00c500 tx=0x7ff44c007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:33.278 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.250+0000 7f0710ff9700 1 -- 172.21.15.71:0/894847579 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f070c00a960 con 0x7f0714156720 2023-10-06T01:42:33.278 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.250+0000 7f5f09093700 1 -- 172.21.15.71:0/4059611404 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f040c4730 con 0x7f5f040a89c0 2023-10-06T01:42:33.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.250+0000 7f0710ff9700 1 -- 172.21.15.71:0/894847579 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f070c00aac0 con 0x7f0714156720 2023-10-06T01:42:33.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.250+0000 7f0710ff9700 1 -- 172.21.15.71:0/894847579 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f070c00ae80 con 0x7f0714156720 2023-10-06T01:42:33.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.250+0000 7f291bfff700 1 -- 172.21.15.71:0/4216481617 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f290c01acc0 con 0x7f29240add80 2023-10-06T01:42:33.280 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.250+0000 7f071ad38700 1 -- 172.21.15.71:0/894847579 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f071416a0d0 con 0x7f0714156720 2023-10-06T01:42:33.280 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.250+0000 7f071ad38700 1 -- 172.21.15.71:0/894847579 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0714157ca0 con 0x7f0714156720 2023-10-06T01:42:33.280 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.250+0000 7f291bfff700 1 --2- 172.21.15.71:0/4216481617 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f2904066f30 0x7f29040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:33.280 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.250+0000 7ff43effd700 1 -- 172.21.15.71:0/1146413769 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff44c007430 con 0x7ff45806c830 2023-10-06T01:42:33.281 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.251+0000 7ff43effd700 1 -- 172.21.15.71:0/1146413769 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff44c007590 con 0x7ff45806c830 2023-10-06T01:42:33.281 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.251+0000 7ff43effd700 1 -- 172.21.15.71:0/1146413769 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff44c004a40 con 0x7ff45806c830 2023-10-06T01:42:33.281 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.251+0000 7ff45d987700 1 -- 172.21.15.71:0/1146413769 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff45816d3b0 con 0x7ff45806c830 2023-10-06T01:42:33.281 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.251+0000 7ff45d987700 1 -- 172.21.15.71:0/1146413769 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff45815a6b0 con 0x7ff45806c830 2023-10-06T01:42:33.281 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.251+0000 7f5f09093700 1 -- 172.21.15.71:0/4059611404 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f04087170 con 0x7f5f040a89c0 2023-10-06T01:42:33.282 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.251+0000 7f291bfff700 1 -- 172.21.15.71:0/4216481617 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f290c086690 con 0x7f29240add80 2023-10-06T01:42:33.282 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.251+0000 7f29237fe700 1 --2- 172.21.15.71:0/4216481617 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f2904066f30 0x7f29040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:33.282 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.251+0000 7f292a8b2700 1 -- 172.21.15.71:0/4216481617 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29080052b0 con 0x7f29240add80 2023-10-06T01:42:33.282 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.251+0000 7f29237fe700 1 --2- 172.21.15.71:0/4216481617 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f2904066f30 0x7f29040693e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2924155b10 tx=0x7f2914007ec0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:33.282 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.252+0000 7ff45d987700 1 -- 172.21.15.71:0/1146413769 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4380052b0 con 0x7ff45806c830 2023-10-06T01:42:33.282 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.252+0000 7f5eeaffd700 1 -- 172.21.15.71:0/4059611404 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5ef4012800 con 0x7f5f040a89c0 2023-10-06T01:42:33.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.252+0000 7f071ad38700 1 -- 172.21.15.71:0/894847579 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0714157b00 con 0x7f0714156720 2023-10-06T01:42:33.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.252+0000 7f0710ff9700 1 -- 172.21.15.71:0/894847579 <== mon.1 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f070c007300 con 0x7f0714156720 2023-10-06T01:42:33.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.252+0000 7f5eeaffd700 1 --2- 172.21.15.71:0/4059611404 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f5ef0067000 0x7f5ef00694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:33.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.252+0000 7f5f0259c700 1 --2- 172.21.15.71:0/4059611404 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f5ef0067000 0x7f5ef00694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:33.284 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.252+0000 7f0710ff9700 1 --2- 172.21.15.71:0/894847579 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f06f8067000 0x7f06f80694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:33.284 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.253+0000 7f0710ff9700 1 -- 172.21.15.71:0/894847579 <== mon.1 v2:172.21.15.72:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f070c084ad0 con 0x7f0714156720 2023-10-06T01:42:33.284 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.253+0000 7f0718ad4700 1 --2- 172.21.15.71:0/894847579 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f06f8067000 0x7f06f80694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:33.284 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.253+0000 7f5f0259c700 1 --2- 172.21.15.71:0/4059611404 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f5ef0067000 0x7f5ef00694b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f5ef80091e0 tx=0x7f5ef8017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:33.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.253+0000 7f0718ad4700 1 --2- 172.21.15.71:0/894847579 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f06f8067000 0x7f06f80694b0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f0708009bb0 tx=0x7f07080091a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:33.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.255+0000 7ff43effd700 1 -- 172.21.15.71:0/1146413769 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff44c014420 con 0x7ff45806c830 2023-10-06T01:42:33.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.255+0000 7ff43effd700 1 --2- 172.21.15.71:0/1146413769 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7ff444067000 0x7ff4440694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:33.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.255+0000 7ff456ffd700 1 --2- 172.21.15.71:0/1146413769 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7ff444067000 0x7ff4440694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:33.286 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.255+0000 7ff43effd700 1 -- 172.21.15.71:0/1146413769 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6378+0+0 (secure 0 0 0) 0x7ff44c084420 con 0x7ff45806c830 2023-10-06T01:42:33.286 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.255+0000 7ff456ffd700 1 --2- 172.21.15.71:0/1146413769 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7ff444067000 0x7ff4440694b0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ff448009bb0 tx=0x7ff4480091a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:33.286 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.257+0000 7f5eeaffd700 1 -- 172.21.15.71:0/4059611404 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f5ef40554c0 con 0x7f5f040a89c0 2023-10-06T01:42:33.286 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.257+0000 7f291bfff700 1 -- 172.21.15.71:0/4216481617 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f290c015080 con 0x7f29240add80 2023-10-06T01:42:33.286 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.257+0000 7f0710ff9700 1 -- 172.21.15.71:0/894847579 <== mon.1 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0714157b00 con 0x7f0714156720 2023-10-06T01:42:33.287 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.262+0000 7ff43effd700 1 -- 172.21.15.71:0/1146413769 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff44c0514c0 con 0x7ff45806c830 2023-10-06T01:42:33.287 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.266+0000 7f5eeaffd700 1 -- 172.21.15.71:0/4059611404 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5ef4089060 con 0x7f5f040a89c0 2023-10-06T01:42:33.530 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.529+0000 7f292a8b2700 1 -- 172.21.15.71:0/4216481617 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) v1 -- 0x7f2908005830 con 0x7f29240add80 2023-10-06T01:42:33.531 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.531+0000 7f071ad38700 1 -- 172.21.15.71:0/894847579 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "c"} v 0) v1 -- 0x7f0714157b00 con 0x7f0714156720 2023-10-06T01:42:33.536 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.536+0000 7ff45d987700 1 -- 172.21.15.71:0/1146413769 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) v1 -- 0x7ff438005830 con 0x7ff45806c830 2023-10-06T01:42:33.541 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:33.541+0000 7f5f09093700 1 -- 172.21.15.71:0/4059611404 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "d"} v 0) v1 -- 0x7f5f0406e5d0 con 0x7f5f040a89c0 2023-10-06T01:42:34.007 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:34.007+0000 7f291bfff700 1 -- 172.21.15.71:0/4216481617 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 5577 v33) v1 ==== 95+0+0 (secure 0 0 0) 0x7f290c053680 con 0x7f29240add80 2023-10-06T01:42:34.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:34.009+0000 7f292a8b2700 1 -- 172.21.15.71:0/4216481617 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f2904066f30 msgr2=0x7f29040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:34.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:34.009+0000 7f292a8b2700 1 --2- 172.21.15.71:0/4216481617 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f2904066f30 0x7f29040693e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2924155b10 tx=0x7f2914007ec0 comp rx=0 tx=0).stop 2023-10-06T01:42:34.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:34.009+0000 7f292a8b2700 1 -- 172.21.15.71:0/4216481617 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f29240add80 msgr2=0x7f2924141b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:34.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:34.009+0000 7f292a8b2700 1 --2- 172.21.15.71:0/4216481617 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f29240add80 0x7f2924141b20 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f290c0093f0 tx=0x7f290c017000 comp rx=0 tx=0).stop 2023-10-06T01:42:34.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:34.009+0000 7f292a8b2700 1 -- 172.21.15.71:0/4216481617 shutdown_connections 2023-10-06T01:42:34.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:34.009+0000 7f292a8b2700 1 --2- 172.21.15.71:0/4216481617 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f2904066f30 0x7f29040693e0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:34.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:34.009+0000 7f292a8b2700 1 --2- 172.21.15.71:0/4216481617 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29240cc820 0x7f29240ca340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:34.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:34.009+0000 7f292a8b2700 1 --2- 172.21.15.71:0/4216481617 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f29240add80 0x7f2924141b20 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:34.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:34.009+0000 7f292a8b2700 1 --2- 172.21.15.71:0/4216481617 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f29240ae150 0x7f29240c9e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:34.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:34.009+0000 7f292a8b2700 1 -- 172.21.15.71:0/4216481617 >> 172.21.15.71:0/4216481617 conn(0x7f2924069110 msgr2=0x7f29240aa930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:34.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:34.009+0000 7f292a8b2700 1 -- 172.21.15.71:0/4216481617 shutdown_connections 2023-10-06T01:42:34.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:34.009+0000 7f292a8b2700 1 -- 172.21.15.71:0/4216481617 wait complete. 2023-10-06T01:42:34.011 INFO:teuthology.orchestra.run.smithi071.stderr:failed mds gid 5577 2023-10-06T01:42:34.014 INFO:tasks.ceph.mon.a.smithi071.stderr:2023-10-06T01:42:34.014+0000 7fec87717700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T01:42:34.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:34.020+0000 7ff43effd700 1 -- 172.21.15.71:0/1146413769 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 5586 v34) v1 ==== 95+0+0 (secure 0 0 0) 0x7ff44c007700 con 0x7ff45806c830 2023-10-06T01:42:34.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:34.022+0000 7ff45d987700 1 -- 172.21.15.71:0/1146413769 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7ff444067000 msgr2=0x7ff4440694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:34.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:34.022+0000 7ff45d987700 1 --2- 172.21.15.71:0/1146413769 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7ff444067000 0x7ff4440694b0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ff448009bb0 tx=0x7ff4480091a0 comp rx=0 tx=0).stop 2023-10-06T01:42:34.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:34.022+0000 7ff45d987700 1 -- 172.21.15.71:0/1146413769 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff45806c830 msgr2=0x7ff45815a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:34.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:34.022+0000 7ff45d987700 1 --2- 172.21.15.71:0/1146413769 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff45806c830 0x7ff45815a170 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7ff44c00c500 tx=0x7ff44c007d30 comp rx=0 tx=0).stop 2023-10-06T01:42:34.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:34.022+0000 7ff45d987700 1 -- 172.21.15.71:0/1146413769 shutdown_connections 2023-10-06T01:42:34.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:34.022+0000 7ff45d987700 1 --2- 172.21.15.71:0/1146413769 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7ff444067000 0x7ff4440694b0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:34.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:34.022+0000 7ff45d987700 1 --2- 172.21.15.71:0/1146413769 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4580c7840 0x7ff45814a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:34.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:34.023+0000 7ff45d987700 1 --2- 172.21.15.71:0/1146413769 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff45806c460 0x7ff45815c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:34.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:34.023+0000 7ff45d987700 1 --2- 172.21.15.71:0/1146413769 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff45806c830 0x7ff45815a170 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:34.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:34.023+0000 7ff45d987700 1 -- 172.21.15.71:0/1146413769 >> 172.21.15.71:0/1146413769 conn(0x7ff4580c9cc0 msgr2=0x7ff458155ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:34.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:34.023+0000 7ff45d987700 1 -- 172.21.15.71:0/1146413769 shutdown_connections 2023-10-06T01:42:34.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:34.023+0000 7ff45d987700 1 -- 172.21.15.71:0/1146413769 wait complete. 2023-10-06T01:42:34.025 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T01:42:34.025 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T01:42:34.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:34.023+0000 7f0710ff9700 1 -- 172.21.15.71:0/894847579 <== mon.1 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "c"}]=0 failed mds gid 5574 v34) v1 ==== 95+0+0 (secure 0 0 0) 0x7f0714157b00 con 0x7f0714156720 2023-10-06T01:42:34.026 INFO:teuthology.orchestra.run.smithi071.stderr:failed mds gid 5586 2023-10-06T01:42:34.027 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:34.026+0000 7f071ad38700 1 -- 172.21.15.71:0/894847579 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f06f8067000 msgr2=0x7f06f80694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:34.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:34.026+0000 7f071ad38700 1 --2- 172.21.15.71:0/894847579 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f06f8067000 0x7f06f80694b0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f0708009bb0 tx=0x7f07080091a0 comp rx=0 tx=0).stop 2023-10-06T01:42:34.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:34.026+0000 7f071ad38700 1 -- 172.21.15.71:0/894847579 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0714156720 msgr2=0x7f0714169b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:34.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:34.026+0000 7f071ad38700 1 --2- 172.21.15.71:0/894847579 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0714156720 0x7f0714169b90 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f070c00cc90 tx=0x7f070c001a80 comp rx=0 tx=0).stop 2023-10-06T01:42:34.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:34.026+0000 7f071ad38700 1 -- 172.21.15.71:0/894847579 shutdown_connections 2023-10-06T01:42:34.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:34.026+0000 7f071ad38700 1 --2- 172.21.15.71:0/894847579 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f06f8067000 0x7f06f80694b0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:34.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:34.026+0000 7f071ad38700 1 --2- 172.21.15.71:0/894847579 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0714156720 0x7f0714169b90 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:34.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:34.026+0000 7f071ad38700 1 --2- 172.21.15.71:0/894847579 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f07140c7f20 0x7f07141519d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:34.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:34.026+0000 7f071ad38700 1 --2- 172.21.15.71:0/894847579 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0714156350 0x7f071414df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:34.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:34.026+0000 7f071ad38700 1 -- 172.21.15.71:0/894847579 >> 172.21.15.71:0/894847579 conn(0x7f0714069110 msgr2=0x7f071414e960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:34.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:34.026+0000 7f071ad38700 1 -- 172.21.15.71:0/894847579 shutdown_connections 2023-10-06T01:42:34.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:34.026+0000 7f071ad38700 1 -- 172.21.15.71:0/894847579 wait complete. 2023-10-06T01:42:34.029 INFO:teuthology.orchestra.run.smithi071.stderr:failed mds gid 5574 2023-10-06T01:42:34.029 INFO:tasks.ceph.mds.a:Started 2023-10-06T01:42:34.029 DEBUG:teuthology.parallel:result is None 2023-10-06T01:42:34.039 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T01:42:34.040 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T01:42:34.042 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T01:42:34.042 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T01:42:34.042 INFO:tasks.ceph.mds.b:Started 2023-10-06T01:42:34.043 DEBUG:teuthology.parallel:result is None 2023-10-06T01:42:34.084 INFO:tasks.ceph.mds.c:Started 2023-10-06T01:42:34.084 DEBUG:teuthology.parallel:result is None 2023-10-06T01:42:34.100 INFO:tasks.ceph.mds.a.smithi071.stdout:starting mds.a at 2023-10-06T01:42:34.119 INFO:tasks.ceph.mds.b.smithi072.stdout:starting mds.b at 2023-10-06T01:42:34.156 INFO:tasks.ceph.mds.c.smithi071.stdout:starting mds.c at 2023-10-06T01:42:35.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:35.020+0000 7f5eeaffd700 1 -- 172.21.15.71:0/4059611404 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "d"}]=0 failed mds gid 5021 v35) v1 ==== 95+0+0 (secure 0 0 0) 0x7f5ef4089020 con 0x7f5f040a89c0 2023-10-06T01:42:35.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:35.025+0000 7f5f09093700 1 -- 172.21.15.71:0/4059611404 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f5ef0067000 msgr2=0x7f5ef00694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:35.025 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:35.025+0000 7f5f09093700 1 --2- 172.21.15.71:0/4059611404 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f5ef0067000 0x7f5ef00694b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f5ef80091e0 tx=0x7f5ef8017000 comp rx=0 tx=0).stop 2023-10-06T01:42:35.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:35.025+0000 7f5f09093700 1 -- 172.21.15.71:0/4059611404 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f040a89c0 msgr2=0x7f5f040c75e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:35.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:35.025+0000 7f5f09093700 1 --2- 172.21.15.71:0/4059611404 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f040a89c0 0x7f5f040c75e0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f5ef400d890 tx=0x7f5ef4008040 comp rx=0 tx=0).stop 2023-10-06T01:42:35.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:35.025+0000 7f5f09093700 1 -- 172.21.15.71:0/4059611404 shutdown_connections 2023-10-06T01:42:35.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:35.025+0000 7f5f09093700 1 --2- 172.21.15.71:0/4059611404 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5f040af570 0x7f5f040c3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:35.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:35.025+0000 7f5f09093700 1 --2- 172.21.15.71:0/4059611404 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f040a89c0 0x7f5f040c75e0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:35.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:35.025+0000 7f5f09093700 1 --2- 172.21.15.71:0/4059611404 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f5ef0067000 0x7f5ef00694b0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:35.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:35.025+0000 7f5f09093700 1 --2- 172.21.15.71:0/4059611404 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f040a8d90 0x7f5f040c7b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:35.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:35.025+0000 7f5f09093700 1 -- 172.21.15.71:0/4059611404 >> 172.21.15.71:0/4059611404 conn(0x7f5f04067910 msgr2=0x7f5f0406d7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:35.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:35.025+0000 7f5f09093700 1 -- 172.21.15.71:0/4059611404 shutdown_connections 2023-10-06T01:42:35.026 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:35.025+0000 7f5f09093700 1 -- 172.21.15.71:0/4059611404 wait complete. 2023-10-06T01:42:35.027 INFO:teuthology.orchestra.run.smithi071.stderr:failed mds gid 5021 2023-10-06T01:42:35.043 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T01:42:35.043 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T01:42:35.046 INFO:tasks.ceph.mds.d:Started 2023-10-06T01:42:35.046 DEBUG:teuthology.parallel:result is None 2023-10-06T01:42:35.046 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T01:42:35.126 INFO:tasks.ceph.mds.d.smithi072.stdout:starting mds.d at 2023-10-06T01:42:35.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:35.197+0000 7f2c4bfff700 1 Processor -- start 2023-10-06T01:42:35.199 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:35.197+0000 7f2c4bfff700 1 -- start start 2023-10-06T01:42:35.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:35.198+0000 7f2c4bfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2c4c159400 0x7f2c4c0ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:35.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:35.198+0000 7f2c4bfff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f2c4c0cd030 0x7f2c4c0cfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:35.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:35.198+0000 7f2c4bfff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c4c0b3560 con 0x7f2c4c0cf1a0 2023-10-06T01:42:35.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:35.198+0000 7f2c4bfff700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c4c0cf6f0 con 0x7f2c4c0cd030 2023-10-06T01:42:35.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:35.198+0000 7f2c4bfff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c4c0cf9d0 con 0x7f2c4c159400 2023-10-06T01:42:35.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:35.198+0000 7f2c4a7fc700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f2c4c0cd030 0x7f2c4c0cfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:35.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:35.198+0000 7f2c4a7fc700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f2c4c0cd030 0x7f2c4c0cfec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41000/0 (socket says 172.21.15.71:41000) 2023-10-06T01:42:35.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:35.198+0000 7f2c4a7fc700 1 -- 172.21.15.71:0/2488200520 learned_addr learned my addr 172.21.15.71:0/2488200520 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:35.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:35.198+0000 7f2c4b7fe700 1 --1- 172.21.15.71:0/2488200520 >> v1:172.21.15.71:6789/0 conn(0x7f2c4c0cf1a0 0x7f2c4c0b5240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:33936/0 (socket says 172.21.15.71:33936) 2023-10-06T01:42:35.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:35.198+0000 7f2c4affd700 1 --2- 172.21.15.71:0/2488200520 >> v2:172.21.15.72:3300/0 conn(0x7f2c4c159400 0x7f2c4c0ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:35.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:35.198+0000 7f2c4a7fc700 1 -- 172.21.15.71:0/2488200520 >> v2:172.21.15.72:3300/0 conn(0x7f2c4c159400 msgr2=0x7f2c4c0ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:35.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:35.198+0000 7f2c4a7fc700 1 --2- 172.21.15.71:0/2488200520 >> v2:172.21.15.72:3300/0 conn(0x7f2c4c159400 0x7f2c4c0ccaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:35.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:35.198+0000 7f2c4a7fc700 1 -- 172.21.15.71:0/2488200520 >> v1:172.21.15.71:6789/0 conn(0x7f2c4c0cf1a0 legacy=0x7f2c4c0b5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:35.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:35.198+0000 7f2c4a7fc700 1 -- 172.21.15.71:0/2488200520 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c4c0b2f10 con 0x7f2c4c0cd030 2023-10-06T01:42:35.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:35.198+0000 7f2c4a7fc700 1 --2- 172.21.15.71:0/2488200520 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2c4c0cd030 0x7f2c4c0cfec0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c067fc0 tx=0x7f2c34009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ffcc9a63a42f081 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:35.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:35.198+0000 7f2c49ffb700 1 -- 172.21.15.71:0/2488200520 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c34009e70 con 0x7f2c4c0cd030 2023-10-06T01:42:35.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:35.199+0000 7f2c49ffb700 1 -- 172.21.15.71:0/2488200520 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c3400b860 con 0x7f2c4c0cd030 2023-10-06T01:42:35.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:35.199+0000 7f2c49ffb700 1 -- 172.21.15.71:0/2488200520 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c3400bc00 con 0x7f2c4c0cd030 2023-10-06T01:42:35.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:35.199+0000 7f2c4bfff700 1 -- 172.21.15.71:0/2488200520 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2c4c0cd030 msgr2=0x7f2c4c0cfec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:35.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:35.199+0000 7f2c4bfff700 1 --2- 172.21.15.71:0/2488200520 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2c4c0cd030 0x7f2c4c0cfec0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c067fc0 tx=0x7f2c34009250 comp rx=0 tx=0).stop 2023-10-06T01:42:35.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:35.199+0000 7f2c4bfff700 1 -- 172.21.15.71:0/2488200520 shutdown_connections 2023-10-06T01:42:35.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:35.199+0000 7f2c4bfff700 1 --2- 172.21.15.71:0/2488200520 >> v2:172.21.15.72:3300/0 conn(0x7f2c4c159400 0x7f2c4c0ccaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:35.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:35.199+0000 7f2c4bfff700 1 --2- 172.21.15.71:0/2488200520 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2c4c0cd030 0x7f2c4c0cfec0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:35.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:35.199+0000 7f2c4bfff700 1 -- 172.21.15.71:0/2488200520 >> 172.21.15.71:0/2488200520 conn(0x7f2c4c06ac10 msgr2=0x7f2c4c068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:35.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:35.199+0000 7f2c4bfff700 1 -- 172.21.15.71:0/2488200520 shutdown_connections 2023-10-06T01:42:35.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:35.199+0000 7f2c4bfff700 1 -- 172.21.15.71:0/2488200520 wait complete. 2023-10-06T01:42:35.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:35.200+0000 7f2c4bfff700 1 Processor -- start 2023-10-06T01:42:35.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:35.200+0000 7f2c4bfff700 1 -- start start 2023-10-06T01:42:35.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:35.201+0000 7f2c4bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c4c0cd030 0x7f2c4c0a7890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:35.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:35.201+0000 7f2c4bfff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2c4c0cf1a0 0x7f2c4c0c9b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:35.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:35.201+0000 7f2c4bfff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2c4c159400 0x7f2c4c0ca6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:35.206 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:35.201+0000 7f2c4bfff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4c0a7dd0 con 0x7f2c4c159400 2023-10-06T01:42:35.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:35.201+0000 7f2c4bfff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4c0ca040 con 0x7f2c4c0cd030 2023-10-06T01:42:35.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:35.201+0000 7f2c4bfff700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4c0cb9a0 con 0x7f2c4c0cf1a0 2023-10-06T01:42:35.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:35.201+0000 7f2c4b7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2c4c159400 0x7f2c4c0ca6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:35.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:35.201+0000 7f2c4b7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2c4c159400 0x7f2c4c0ca6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41008/0 (socket says 172.21.15.71:41008) 2023-10-06T01:42:35.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:35.201+0000 7f2c4b7fe700 1 -- 172.21.15.71:0/2339122034 learned_addr learned my addr 172.21.15.71:0/2339122034 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:35.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:35.201+0000 7f2c4a7fc700 1 --2- 172.21.15.71:0/2339122034 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2c4c0cf1a0 0x7f2c4c0c9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:35.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:35.201+0000 7f2c4affd700 1 --2- 172.21.15.71:0/2339122034 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c4c0cd030 0x7f2c4c0a7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:35.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:35.201+0000 7f2c4b7fe700 1 -- 172.21.15.71:0/2339122034 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2c4c0cf1a0 msgr2=0x7f2c4c0c9b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:35.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:35.201+0000 7f2c4b7fe700 1 --2- 172.21.15.71:0/2339122034 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2c4c0cf1a0 0x7f2c4c0c9b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:35.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:35.201+0000 7f2c4b7fe700 1 -- 172.21.15.71:0/2339122034 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c4c0cd030 msgr2=0x7f2c4c0a7890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:35.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:35.201+0000 7f2c4b7fe700 1 --2- 172.21.15.71:0/2339122034 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c4c0cd030 0x7f2c4c0a7890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:35.207 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:35.201+0000 7f2c4b7fe700 1 -- 172.21.15.71:0/2339122034 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c340094f0 con 0x7f2c4c159400 2023-10-06T01:42:35.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:35.202+0000 7f2c4b7fe700 1 --2- 172.21.15.71:0/2339122034 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2c4c159400 0x7f2c4c0ca6e0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c00cd00 tx=0x7f2c3c001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:35.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:35.202+0000 7f2c42ffd700 1 -- 172.21.15.71:0/2339122034 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c3c005df0 con 0x7f2c4c159400 2023-10-06T01:42:35.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:35.202+0000 7f2c42ffd700 1 -- 172.21.15.71:0/2339122034 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c3c00a960 con 0x7f2c4c159400 2023-10-06T01:42:35.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:35.202+0000 7f2c4bfff700 1 -- 172.21.15.71:0/2339122034 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c4c0ca270 con 0x7f2c4c159400 2023-10-06T01:42:35.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:35.202+0000 7f2c42ffd700 1 -- 172.21.15.71:0/2339122034 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c3c00ad00 con 0x7f2c4c159400 2023-10-06T01:42:35.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:35.202+0000 7f2c4bfff700 1 -- 172.21.15.71:0/2339122034 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c4c0cb3d0 con 0x7f2c4c159400 2023-10-06T01:42:35.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:35.203+0000 7f2c4bfff700 1 -- 172.21.15.71:0/2339122034 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c4c159850 con 0x7f2c4c159400 2023-10-06T01:42:35.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:35.203+0000 7f2c42ffd700 1 -- 172.21.15.71:0/2339122034 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2c3c007300 con 0x7f2c4c159400 2023-10-06T01:42:35.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:35.203+0000 7f2c42ffd700 1 --2- 172.21.15.71:0/2339122034 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f2c2c066f30 0x7f2c2c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:35.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:35.203+0000 7f2c42ffd700 1 -- 172.21.15.71:0/2339122034 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f2c3c084960 con 0x7f2c4c159400 2023-10-06T01:42:35.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:35.203+0000 7f2c4affd700 1 --2- 172.21.15.71:0/2339122034 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f2c2c066f30 0x7f2c2c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:35.208 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:35.204+0000 7f2c4affd700 1 --2- 172.21.15.71:0/2339122034 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f2c2c066f30 0x7f2c2c0693e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f2c44009390 tx=0x7f2c44008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:35.209 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:35.208+0000 7f2c42ffd700 1 -- 172.21.15.71:0/2339122034 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2c3c051960 con 0x7f2c4c159400 2023-10-06T01:42:35.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:35.434+0000 7f2c4bfff700 1 -- 172.21.15.71:0/2339122034 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2c4c0cb780 con 0x7f2c4c159400 2023-10-06T01:42:35.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:35.435+0000 7f2c42ffd700 1 -- 172.21.15.71:0/2339122034 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+3838 (secure 0 0 0) 0x7f2c3c00ae60 con 0x7f2c4c159400 2023-10-06T01:42:35.437 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:42:35.437 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":36,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5572,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6833/698854056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":698854056},{"type":"v1","addr":"172.21.15.72:6833","nonce":698854056}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":5811,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/2808450062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":2808450062},{"type":"v1","addr":"172.21.15.71:6835","nonce":2808450062}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T01:41:59.290125+0000","modified":"2023-10-06T01:42:35.021882+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":57,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5823},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5823":{"gid":5823,"name":"c","rank":0,"incarnation":36,"state":"up:replay","state_seq":1,"addr":"172.21.15.71:6837/2318258263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":2318258263},{"type":"v1","addr":"172.21.15.71:6837","nonce":2318258263}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T01:42:35.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:35.436+0000 7f2c4bfff700 1 -- 172.21.15.71:0/2339122034 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f2c2c066f30 msgr2=0x7f2c2c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:35.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:35.436+0000 7f2c4bfff700 1 --2- 172.21.15.71:0/2339122034 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f2c2c066f30 0x7f2c2c0693e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f2c44009390 tx=0x7f2c44008040 comp rx=0 tx=0).stop 2023-10-06T01:42:35.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:35.437+0000 7f2c4bfff700 1 -- 172.21.15.71:0/2339122034 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2c4c159400 msgr2=0x7f2c4c0ca6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:35.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:35.437+0000 7f2c4bfff700 1 --2- 172.21.15.71:0/2339122034 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2c4c159400 0x7f2c4c0ca6e0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c00cd00 tx=0x7f2c3c001b10 comp rx=0 tx=0).stop 2023-10-06T01:42:35.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:35.437+0000 7f2c4bfff700 1 -- 172.21.15.71:0/2339122034 shutdown_connections 2023-10-06T01:42:35.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:35.437+0000 7f2c4bfff700 1 --2- 172.21.15.71:0/2339122034 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2c4c159400 0x7f2c4c0ca6e0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:35.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:35.437+0000 7f2c4bfff700 1 --2- 172.21.15.71:0/2339122034 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f2c2c066f30 0x7f2c2c0693e0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:35.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:35.437+0000 7f2c4bfff700 1 --2- 172.21.15.71:0/2339122034 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2c4c0cd030 0x7f2c4c0a7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:35.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:35.437+0000 7f2c4bfff700 1 --2- 172.21.15.71:0/2339122034 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2c4c0cf1a0 0x7f2c4c0c9b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:35.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:35.437+0000 7f2c4bfff700 1 -- 172.21.15.71:0/2339122034 >> 172.21.15.71:0/2339122034 conn(0x7f2c4c06ac10 msgr2=0x7f2c4c157bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:35.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:35.437+0000 7f2c4bfff700 1 -- 172.21.15.71:0/2339122034 shutdown_connections 2023-10-06T01:42:35.440 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:35.437+0000 7f2c4bfff700 1 -- 172.21.15.71:0/2339122034 wait complete. 2023-10-06T01:42:35.440 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 36 2023-10-06T01:42:35.853 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 36, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T01:41:59.290125+0000', 'modified': '2023-10-06T01:42:35.021882+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 57, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5823}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5823': {'gid': 5823, 'name': 'c', 'rank': 0, 'incarnation': 36, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.71:6837/2318258263', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6836', 'nonce': 2318258263}, {'type': 'v1', 'addr': '172.21.15.71:6837', 'nonce': 2318258263}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T01:42:35.854 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5823:up:replay 2023-10-06T01:42:36.854 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T01:42:36.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:36.971+0000 7f34244ce700 1 Processor -- start 2023-10-06T01:42:36.973 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:36.971+0000 7f34244ce700 1 -- start start 2023-10-06T01:42:36.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:36.972+0000 7f34244ce700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f341c0af4e0 0x7f341c0b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:36.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:36.972+0000 7f34244ce700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f341c0af8b0 0x7f341c0b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:36.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:36.972+0000 7f34244ce700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f341c15d460 0x7f341c15d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:36.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:36.972+0000 7f34244ce700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f341c0b1910 con 0x7f341c15d460 2023-10-06T01:42:36.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:36.972+0000 7f34244ce700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f341c15e190 con 0x7f341c0af8b0 2023-10-06T01:42:36.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:36.972+0000 7f34244ce700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f341c0cb650 con 0x7f341c0af4e0 2023-10-06T01:42:36.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:36.972+0000 7f3422a6b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f341c15d460 0x7f341c15d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:36.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:36.972+0000 7f3422a6b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f341c15d460 0x7f341c15d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41024/0 (socket says 172.21.15.71:41024) 2023-10-06T01:42:36.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:36.972+0000 7f3422a6b700 1 -- 172.21.15.71:0/1204443941 learned_addr learned my addr 172.21.15.71:0/1204443941 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:36.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:36.972+0000 7f342226a700 1 --2- 172.21.15.71:0/1204443941 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f341c0af4e0 0x7f341c0b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:36.980 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:36.972+0000 7f3421a69700 1 --2- 172.21.15.71:0/1204443941 >> v2:172.21.15.72:3300/0 conn(0x7f341c0af8b0 0x7f341c0b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:36.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:36.973+0000 7f3422a6b700 1 -- 172.21.15.71:0/1204443941 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f341c0af4e0 msgr2=0x7f341c0b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:36.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:36.973+0000 7f3422a6b700 1 --2- 172.21.15.71:0/1204443941 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f341c0af4e0 0x7f341c0b20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:36.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:36.973+0000 7f3422a6b700 1 -- 172.21.15.71:0/1204443941 >> v2:172.21.15.72:3300/0 conn(0x7f341c0af8b0 msgr2=0x7f341c0b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:36.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:36.973+0000 7f3422a6b700 1 --2- 172.21.15.71:0/1204443941 >> v2:172.21.15.72:3300/0 conn(0x7f341c0af8b0 0x7f341c0b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:36.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:36.973+0000 7f3422a6b700 1 -- 172.21.15.71:0/1204443941 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f341c0b2b60 con 0x7f341c15d460 2023-10-06T01:42:36.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:36.973+0000 7f3421a69700 1 --2- 172.21.15.71:0/1204443941 >> v2:172.21.15.72:3300/0 conn(0x7f341c0af8b0 0x7f341c0b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:42:36.981 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:36.973+0000 7f3422a6b700 1 --2- 172.21.15.71:0/1204443941 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f341c15d460 0x7f341c15d8a0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f341c06b140 tx=0x7f3414009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4db41da7213e5d93 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:36.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:36.973+0000 7f3421268700 1 -- 172.21.15.71:0/1204443941 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f341400e070 con 0x7f341c15d460 2023-10-06T01:42:36.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:36.973+0000 7f3421268700 1 -- 172.21.15.71:0/1204443941 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f341400ba50 con 0x7f341c15d460 2023-10-06T01:42:36.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:36.973+0000 7f3421268700 1 -- 172.21.15.71:0/1204443941 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34140092e0 con 0x7f341c15d460 2023-10-06T01:42:36.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:36.973+0000 7f34244ce700 1 -- 172.21.15.71:0/1204443941 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f341c15d460 msgr2=0x7f341c15d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:36.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:36.973+0000 7f34244ce700 1 --2- 172.21.15.71:0/1204443941 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f341c15d460 0x7f341c15d8a0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f341c06b140 tx=0x7f3414009840 comp rx=0 tx=0).stop 2023-10-06T01:42:36.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:36.973+0000 7f34244ce700 1 -- 172.21.15.71:0/1204443941 shutdown_connections 2023-10-06T01:42:36.982 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:36.973+0000 7f34244ce700 1 --2- 172.21.15.71:0/1204443941 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f341c15d460 0x7f341c15d8a0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:36.983 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:36.973+0000 7f34244ce700 1 --2- 172.21.15.71:0/1204443941 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f341c0af4e0 0x7f341c0b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:36.983 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:36.973+0000 7f34244ce700 1 --2- 172.21.15.71:0/1204443941 >> v2:172.21.15.72:3300/0 conn(0x7f341c0af8b0 0x7f341c0b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:36.983 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:36.973+0000 7f34244ce700 1 -- 172.21.15.71:0/1204443941 >> 172.21.15.71:0/1204443941 conn(0x7f341c068680 msgr2=0x7f341c068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:36.983 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:36.973+0000 7f34244ce700 1 -- 172.21.15.71:0/1204443941 shutdown_connections 2023-10-06T01:42:36.983 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:36.973+0000 7f34244ce700 1 -- 172.21.15.71:0/1204443941 wait complete. 2023-10-06T01:42:36.983 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:36.975+0000 7f34244ce700 1 Processor -- start 2023-10-06T01:42:36.983 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:36.975+0000 7f34244ce700 1 -- start start 2023-10-06T01:42:36.983 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:36.975+0000 7f34244ce700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f341c0af4e0 0x7f341c0c7300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:36.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:36.975+0000 7f34244ce700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f341c0af8b0 0x7f341c153d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:36.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:36.975+0000 7f34244ce700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f341c15d460 0x7f341c0cded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:36.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:36.975+0000 7f34244ce700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f341c157a70 con 0x7f341c0af8b0 2023-10-06T01:42:36.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:36.975+0000 7f34244ce700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f341c156e60 con 0x7f341c15d460 2023-10-06T01:42:36.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:36.975+0000 7f34244ce700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f341c157140 con 0x7f341c0af4e0 2023-10-06T01:42:36.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:36.975+0000 7f3421a69700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f341c0af8b0 0x7f341c153d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:36.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:36.975+0000 7f3421a69700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f341c0af8b0 0x7f341c153d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41028/0 (socket says 172.21.15.71:41028) 2023-10-06T01:42:36.984 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:36.975+0000 7f3421a69700 1 -- 172.21.15.71:0/1775044631 learned_addr learned my addr 172.21.15.71:0/1775044631 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:36.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:36.975+0000 7f3422a6b700 1 --2- 172.21.15.71:0/1775044631 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f341c15d460 0x7f341c0cded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:36.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:36.975+0000 7f342226a700 1 --2- 172.21.15.71:0/1775044631 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f341c0af4e0 0x7f341c0c7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:36.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:36.976+0000 7f3421a69700 1 -- 172.21.15.71:0/1775044631 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f341c0af4e0 msgr2=0x7f341c0c7300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:36.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:36.976+0000 7f3421a69700 1 --2- 172.21.15.71:0/1775044631 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f341c0af4e0 0x7f341c0c7300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:36.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:36.976+0000 7f3421a69700 1 -- 172.21.15.71:0/1775044631 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f341c15d460 msgr2=0x7f341c0cded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:36.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:36.976+0000 7f3421a69700 1 --2- 172.21.15.71:0/1775044631 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f341c15d460 0x7f341c0cded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:36.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:36.976+0000 7f3421a69700 1 -- 172.21.15.71:0/1775044631 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3414009ae0 con 0x7f341c0af8b0 2023-10-06T01:42:36.985 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:36.976+0000 7f3421a69700 1 --2- 172.21.15.71:0/1775044631 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f341c0af8b0 0x7f341c153d90 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f340c00c830 tx=0x7f340c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:36.986 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:36.976+0000 7f34127fc700 1 -- 172.21.15.71:0/1775044631 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f340c011600 con 0x7f341c0af8b0 2023-10-06T01:42:36.986 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:36.976+0000 7f34127fc700 1 -- 172.21.15.71:0/1775044631 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f340c011760 con 0x7f341c0af8b0 2023-10-06T01:42:36.986 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:36.976+0000 7f34244ce700 1 -- 172.21.15.71:0/1775044631 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f341c157420 con 0x7f341c0af8b0 2023-10-06T01:42:36.986 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:36.976+0000 7f34127fc700 1 -- 172.21.15.71:0/1775044631 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f340c011b20 con 0x7f341c0af8b0 2023-10-06T01:42:36.986 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:36.976+0000 7f34244ce700 1 -- 172.21.15.71:0/1775044631 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f341c0c7840 con 0x7f341c0af8b0 2023-10-06T01:42:36.986 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:36.977+0000 7f34244ce700 1 -- 172.21.15.71:0/1775044631 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f341c088aa0 con 0x7f341c0af8b0 2023-10-06T01:42:36.986 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:36.977+0000 7f34127fc700 1 -- 172.21.15.71:0/1775044631 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f340c018360 con 0x7f341c0af8b0 2023-10-06T01:42:36.986 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:36.978+0000 7f34127fc700 1 --2- 172.21.15.71:0/1775044631 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f3400066f30 0x7f34000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:36.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:36.978+0000 7f34127fc700 1 -- 172.21.15.71:0/1775044631 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f340c084820 con 0x7f341c0af8b0 2023-10-06T01:42:36.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:36.978+0000 7f342226a700 1 --2- 172.21.15.71:0/1775044631 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f3400066f30 0x7f34000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:36.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:36.978+0000 7f342226a700 1 --2- 172.21.15.71:0/1775044631 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f3400066f30 0x7f34000693e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f341c16d480 tx=0x7f3418008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:36.987 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:36.982+0000 7f34127fc700 1 -- 172.21.15.71:0/1775044631 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f340c0517a0 con 0x7f341c0af8b0 2023-10-06T01:42:37.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:37.212+0000 7f34244ce700 1 -- 172.21.15.71:0/1775044631 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f341c157bb0 con 0x7f341c0af8b0 2023-10-06T01:42:37.214 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:37.213+0000 7f34127fc700 1 -- 172.21.15.71:0/1775044631 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4595 (secure 0 0 0) 0x7f340c054dc0 con 0x7f341c0af8b0 2023-10-06T01:42:37.214 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:42:37.215 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":38,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5171,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/3015768753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":3015768753},{"type":"v1","addr":"172.21.15.72:6835","nonce":3015768753}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5572,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6833/698854056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":698854056},{"type":"v1","addr":"172.21.15.72:6833","nonce":698854056}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":5811,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/2808450062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":2808450062},{"type":"v1","addr":"172.21.15.71:6835","nonce":2808450062}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T01:41:59.290125+0000","modified":"2023-10-06T01:42:37.028730+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":57,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5823},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5823":{"gid":5823,"name":"c","rank":0,"incarnation":36,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.71:6837/2318258263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":2318258263},{"type":"v1","addr":"172.21.15.71:6837","nonce":2318258263}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T01:42:37.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:37.215+0000 7f34244ce700 1 -- 172.21.15.71:0/1775044631 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f3400066f30 msgr2=0x7f34000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:37.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:37.215+0000 7f34244ce700 1 --2- 172.21.15.71:0/1775044631 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f3400066f30 0x7f34000693e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f341c16d480 tx=0x7f3418008040 comp rx=0 tx=0).stop 2023-10-06T01:42:37.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:37.215+0000 7f34244ce700 1 -- 172.21.15.71:0/1775044631 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f341c0af8b0 msgr2=0x7f341c153d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:37.218 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:37.215+0000 7f34244ce700 1 --2- 172.21.15.71:0/1775044631 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f341c0af8b0 0x7f341c153d90 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f340c00c830 tx=0x7f340c008040 comp rx=0 tx=0).stop 2023-10-06T01:42:37.218 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:37.215+0000 7f34244ce700 1 -- 172.21.15.71:0/1775044631 shutdown_connections 2023-10-06T01:42:37.218 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:37.215+0000 7f34244ce700 1 --2- 172.21.15.71:0/1775044631 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f3400066f30 0x7f34000693e0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:37.218 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:37.215+0000 7f34244ce700 1 --2- 172.21.15.71:0/1775044631 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f341c15d460 0x7f341c0cded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:37.218 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:37.215+0000 7f34244ce700 1 --2- 172.21.15.71:0/1775044631 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f341c0af4e0 0x7f341c0c7300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:37.218 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:37.215+0000 7f34244ce700 1 --2- 172.21.15.71:0/1775044631 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f341c0af8b0 0x7f341c153d90 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:37.218 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:37.215+0000 7f34244ce700 1 -- 172.21.15.71:0/1775044631 >> 172.21.15.71:0/1775044631 conn(0x7f341c068680 msgr2=0x7f341c0b30a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:37.218 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:37.215+0000 7f34244ce700 1 -- 172.21.15.71:0/1775044631 shutdown_connections 2023-10-06T01:42:37.218 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:37.215+0000 7f34244ce700 1 -- 172.21.15.71:0/1775044631 wait complete. 2023-10-06T01:42:37.218 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 38 2023-10-06T01:42:37.631 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 38, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T01:41:59.290125+0000', 'modified': '2023-10-06T01:42:37.028730+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 57, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5823}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5823': {'gid': 5823, 'name': 'c', 'rank': 0, 'incarnation': 36, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.71:6837/2318258263', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6836', 'nonce': 2318258263}, {'type': 'v1', 'addr': '172.21.15.71:6837', 'nonce': 2318258263}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T01:42:37.631 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5823:up:rejoin 2023-10-06T01:42:38.632 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T01:42:38.759 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:38.757+0000 7f25ff6ff700 1 Processor -- start 2023-10-06T01:42:38.759 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:38.758+0000 7f25ff6ff700 1 -- start start 2023-10-06T01:42:38.762 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:38.759+0000 7f25ff6ff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f25f815b3c0 0x7f25f8097d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:38.762 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:38.759+0000 7f25ff6ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f25f815a590 0x7f25f815a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:38.762 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:38.759+0000 7f25ff6ff700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25f80afb90 con 0x7f25f80b3c50 2023-10-06T01:42:38.762 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:38.759+0000 7f25ff6ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25f815aef0 con 0x7f25f815a590 2023-10-06T01:42:38.762 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:38.759+0000 7f25ff6ff700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25f80b2310 con 0x7f25f815b3c0 2023-10-06T01:42:38.762 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:38.759+0000 7f25fcc9a700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f25f80b3c50 0x7f25f815b790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:33950/0 (socket says 172.21.15.71:33950) 2023-10-06T01:42:38.762 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:38.759+0000 7f25fcc9a700 1 -- 172.21.15.71:0/4091701611 learned_addr learned my addr 172.21.15.71:0/4091701611 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:42:38.762 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:38.759+0000 7f25fdc9c700 1 --2- 172.21.15.71:0/4091701611 >> v2:172.21.15.72:3300/0 conn(0x7f25f815a590 0x7f25f815a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:38.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:38.759+0000 7f25fd49b700 1 --2- 172.21.15.71:0/4091701611 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f25f815b3c0 0x7f25f8097d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:38.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:38.759+0000 7f25effff700 1 -- 172.21.15.71:0/4091701611 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1784409480 0 0) 0x7f25f80afb90 con 0x7f25f80b3c50 2023-10-06T01:42:38.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:38.759+0000 7f25effff700 1 -- 172.21.15.71:0/4091701611 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25e4003570 con 0x7f25f80b3c50 2023-10-06T01:42:38.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:38.759+0000 7f25fdc9c700 1 -- 172.21.15.71:0/4091701611 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f25f815b3c0 msgr2=0x7f25f8097d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:38.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:38.759+0000 7f25fdc9c700 1 --2- 172.21.15.71:0/4091701611 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f25f815b3c0 0x7f25f8097d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:38.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:38.759+0000 7f25fdc9c700 1 -- 172.21.15.71:0/4091701611 >> v1:172.21.15.71:6789/0 conn(0x7f25f80b3c50 legacy=0x7f25f815b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:38.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:38.759+0000 7f25fdc9c700 1 -- 172.21.15.71:0/4091701611 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25f80b25f0 con 0x7f25f815a590 2023-10-06T01:42:38.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:38.759+0000 7f25fd49b700 1 --2- 172.21.15.71:0/4091701611 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f25f815b3c0 0x7f25f8097d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:42:38.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:38.759+0000 7f25fdc9c700 1 --2- 172.21.15.71:0/4091701611 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25f815a590 0x7f25f815a9b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f25f0009e60 tx=0x7f25f0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c0c329b396d4668 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:38.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:38.760+0000 7f25effff700 1 -- 172.21.15.71:0/4091701611 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f000e070 con 0x7f25f815a590 2023-10-06T01:42:38.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:38.760+0000 7f25effff700 1 -- 172.21.15.71:0/4091701611 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25f000bab0 con 0x7f25f815a590 2023-10-06T01:42:38.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:38.760+0000 7f25effff700 1 -- 172.21.15.71:0/4091701611 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f000be70 con 0x7f25f815a590 2023-10-06T01:42:38.764 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:38.760+0000 7f25ff6ff700 1 -- 172.21.15.71:0/4091701611 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25f815a590 msgr2=0x7f25f815a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:38.764 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:38.760+0000 7f25ff6ff700 1 --2- 172.21.15.71:0/4091701611 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25f815a590 0x7f25f815a9b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f25f0009e60 tx=0x7f25f0009780 comp rx=0 tx=0).stop 2023-10-06T01:42:38.764 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:38.760+0000 7f25ff6ff700 1 -- 172.21.15.71:0/4091701611 shutdown_connections 2023-10-06T01:42:38.764 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:38.760+0000 7f25ff6ff700 1 --2- 172.21.15.71:0/4091701611 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25f815a590 0x7f25f815a9b0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:38.764 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:38.760+0000 7f25ff6ff700 1 --2- 172.21.15.71:0/4091701611 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f25f815b3c0 0x7f25f8097d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:38.764 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:38.760+0000 7f25ff6ff700 1 -- 172.21.15.71:0/4091701611 >> 172.21.15.71:0/4091701611 conn(0x7f25f8067910 msgr2=0x7f25f80ce160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:38.764 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:38.760+0000 7f25ff6ff700 1 -- 172.21.15.71:0/4091701611 shutdown_connections 2023-10-06T01:42:38.764 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:38.760+0000 7f25ff6ff700 1 -- 172.21.15.71:0/4091701611 wait complete. 2023-10-06T01:42:38.767 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:38.761+0000 7f25ff6ff700 1 Processor -- start 2023-10-06T01:42:38.767 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:38.761+0000 7f25ff6ff700 1 -- start start 2023-10-06T01:42:38.767 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:38.762+0000 7f25ff6ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25f80b3c50 0x7f25f80ab380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:38.767 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:38.762+0000 7f25ff6ff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f25f815a590 0x7f25f8099600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:38.767 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:38.762+0000 7f25ff6ff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f25f815b3c0 0x7f25f8146170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:38.768 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:38.762+0000 7f25ff6ff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25f809a580 con 0x7f25f815b3c0 2023-10-06T01:42:38.768 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:38.762+0000 7f25ff6ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25f8099fc0 con 0x7f25f80b3c50 2023-10-06T01:42:38.768 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:38.762+0000 7f25ff6ff700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25f809a2a0 con 0x7f25f815a590 2023-10-06T01:42:38.768 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:38.762+0000 7f25fdc9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f25f815b3c0 0x7f25f8146170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:38.768 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:38.762+0000 7f25fdc9c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f25f815b3c0 0x7f25f8146170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41042/0 (socket says 172.21.15.71:41042) 2023-10-06T01:42:38.768 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:38.762+0000 7f25fdc9c700 1 -- 172.21.15.71:0/3327608141 learned_addr learned my addr 172.21.15.71:0/3327608141 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:38.768 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:38.763+0000 7f25fd49b700 1 --2- 172.21.15.71:0/3327608141 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25f80b3c50 0x7f25f80ab380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:38.768 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:38.763+0000 7f25fcc9a700 1 --2- 172.21.15.71:0/3327608141 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f25f815a590 0x7f25f8099600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:38.768 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:38.763+0000 7f25fdc9c700 1 -- 172.21.15.71:0/3327608141 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f25f815a590 msgr2=0x7f25f8099600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:38.768 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:38.763+0000 7f25fdc9c700 1 --2- 172.21.15.71:0/3327608141 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f25f815a590 0x7f25f8099600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:38.768 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:38.763+0000 7f25fdc9c700 1 -- 172.21.15.71:0/3327608141 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25f80b3c50 msgr2=0x7f25f80ab380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:38.769 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:38.763+0000 7f25fdc9c700 1 --2- 172.21.15.71:0/3327608141 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25f80b3c50 0x7f25f80ab380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:38.769 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:38.763+0000 7f25fdc9c700 1 -- 172.21.15.71:0/3327608141 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25f40093c0 con 0x7f25f815b3c0 2023-10-06T01:42:38.769 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:38.763+0000 7f25fcc9a700 1 --2- 172.21.15.71:0/3327608141 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f25f815a590 0x7f25f8099600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:42:38.769 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:38.763+0000 7f25fdc9c700 1 --2- 172.21.15.71:0/3327608141 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f25f815b3c0 0x7f25f8146170 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f25f806f4d0 tx=0x7f25f0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:38.769 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:38.763+0000 7f25ed7fa700 1 -- 172.21.15.71:0/3327608141 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f0027470 con 0x7f25f815b3c0 2023-10-06T01:42:38.769 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:38.763+0000 7f25ed7fa700 1 -- 172.21.15.71:0/3327608141 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25f00275f0 con 0x7f25f815b3c0 2023-10-06T01:42:38.769 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:38.763+0000 7f25ff6ff700 1 -- 172.21.15.71:0/3327608141 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25f0009a20 con 0x7f25f815b3c0 2023-10-06T01:42:38.769 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:38.763+0000 7f25ed7fa700 1 -- 172.21.15.71:0/3327608141 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f00279b0 con 0x7f25f815b3c0 2023-10-06T01:42:38.769 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:38.763+0000 7f25ff6ff700 1 -- 172.21.15.71:0/3327608141 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25f80a9350 con 0x7f25f815b3c0 2023-10-06T01:42:38.769 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:38.764+0000 7f25ff6ff700 1 -- 172.21.15.71:0/3327608141 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25f806e8d0 con 0x7f25f815b3c0 2023-10-06T01:42:38.769 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:38.764+0000 7f25ed7fa700 1 -- 172.21.15.71:0/3327608141 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f25f0024070 con 0x7f25f815b3c0 2023-10-06T01:42:38.769 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:38.765+0000 7f25ed7fa700 1 --2- 172.21.15.71:0/3327608141 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f25dc066f30 0x7f25dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:38.770 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:38.765+0000 7f25ed7fa700 1 -- 172.21.15.71:0/3327608141 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f25f00870f0 con 0x7f25f815b3c0 2023-10-06T01:42:38.770 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:38.765+0000 7f25fd49b700 1 --2- 172.21.15.71:0/3327608141 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f25dc066f30 0x7f25dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:38.770 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:38.765+0000 7f25fd49b700 1 --2- 172.21.15.71:0/3327608141 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f25dc066f30 0x7f25dc0693e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f25f4009390 tx=0x7f25f4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:38.770 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:38.769+0000 7f25ed7fa700 1 -- 172.21.15.71:0/3327608141 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f25f0054070 con 0x7f25f815b3c0 2023-10-06T01:42:38.997 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:38.995+0000 7f25ff6ff700 1 -- 172.21.15.71:0/3327608141 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f25f80af820 con 0x7f25f815b3c0 2023-10-06T01:42:38.997 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:38.996+0000 7f25ed7fa700 1 -- 172.21.15.71:0/3327608141 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4595 (secure 0 0 0) 0x7f25f0057690 con 0x7f25f815b3c0 2023-10-06T01:42:38.998 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:42:38.998 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":39,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5171,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/3015768753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":3015768753},{"type":"v1","addr":"172.21.15.72:6835","nonce":3015768753}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5572,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6833/698854056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":698854056},{"type":"v1","addr":"172.21.15.72:6833","nonce":698854056}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":5811,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/2808450062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":2808450062},{"type":"v1","addr":"172.21.15.71:6835","nonce":2808450062}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T01:41:59.290125+0000","modified":"2023-10-06T01:42:38.037440+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":57,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5823},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5823":{"gid":5823,"name":"c","rank":0,"incarnation":36,"state":"up:active","state_seq":4,"addr":"172.21.15.71:6837/2318258263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":2318258263},{"type":"v1","addr":"172.21.15.71:6837","nonce":2318258263}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T01:42:39.000 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:38.998+0000 7f25ff6ff700 1 -- 172.21.15.71:0/3327608141 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f25dc066f30 msgr2=0x7f25dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:39.000 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:38.998+0000 7f25ff6ff700 1 --2- 172.21.15.71:0/3327608141 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f25dc066f30 0x7f25dc0693e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f25f4009390 tx=0x7f25f4008040 comp rx=0 tx=0).stop 2023-10-06T01:42:39.000 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:38.998+0000 7f25ff6ff700 1 -- 172.21.15.71:0/3327608141 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f25f815b3c0 msgr2=0x7f25f8146170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:39.000 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:38.998+0000 7f25ff6ff700 1 --2- 172.21.15.71:0/3327608141 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f25f815b3c0 0x7f25f8146170 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f25f806f4d0 tx=0x7f25f0019000 comp rx=0 tx=0).stop 2023-10-06T01:42:39.000 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:38.998+0000 7f25ff6ff700 1 -- 172.21.15.71:0/3327608141 shutdown_connections 2023-10-06T01:42:39.000 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:38.998+0000 7f25ff6ff700 1 --2- 172.21.15.71:0/3327608141 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f25f815b3c0 0x7f25f8146170 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:39.000 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:38.998+0000 7f25ff6ff700 1 --2- 172.21.15.71:0/3327608141 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f25dc066f30 0x7f25dc0693e0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:39.000 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:38.998+0000 7f25ff6ff700 1 --2- 172.21.15.71:0/3327608141 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f25f80b3c50 0x7f25f80ab380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:39.000 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:38.998+0000 7f25ff6ff700 1 --2- 172.21.15.71:0/3327608141 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f25f815a590 0x7f25f8099600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:39.001 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:38.998+0000 7f25ff6ff700 1 -- 172.21.15.71:0/3327608141 >> 172.21.15.71:0/3327608141 conn(0x7f25f8067910 msgr2=0x7f25f8155b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:39.001 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:38.998+0000 7f25ff6ff700 1 -- 172.21.15.71:0/3327608141 shutdown_connections 2023-10-06T01:42:39.001 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:38.998+0000 7f25ff6ff700 1 -- 172.21.15.71:0/3327608141 wait complete. 2023-10-06T01:42:39.001 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 39 2023-10-06T01:42:39.413 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 39, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T01:41:59.290125+0000', 'modified': '2023-10-06T01:42:38.037440+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 57, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5823}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5823': {'gid': 5823, 'name': 'c', 'rank': 0, 'incarnation': 36, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.71:6837/2318258263', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6836', 'nonce': 2318258263}, {'type': 'v1', 'addr': '172.21.15.71:6837', 'nonce': 2318258263}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T01:42:39.414 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T01:42:39.414 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-06T01:42:39.530 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.528+0000 7f880e5c2700 1 Processor -- start 2023-10-06T01:42:39.530 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.528+0000 7f880e5c2700 1 -- start start 2023-10-06T01:42:39.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.529+0000 7f880e5c2700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f880815a030 0x7f880815a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:39.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.529+0000 7f880e5c2700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f880815a940 0x7f8808086ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:39.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.529+0000 7f880e5c2700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88080afc50 con 0x7f8808087530 2023-10-06T01:42:39.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.529+0000 7f880e5c2700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88080879d0 con 0x7f880815a940 2023-10-06T01:42:39.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.529+0000 7f880e5c2700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88080b0cf0 con 0x7f880815a030 2023-10-06T01:42:39.533 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.529+0000 7f88077fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f880815a940 0x7f8808086ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:39.534 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.529+0000 7f88077fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f880815a940 0x7f8808086ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:42790/0 (socket says 172.21.15.71:42790) 2023-10-06T01:42:39.534 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.529+0000 7f88077fe700 1 -- 172.21.15.71:0/2090240280 learned_addr learned my addr 172.21.15.71:0/2090240280 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:39.534 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.529+0000 7f8807fff700 1 --2- 172.21.15.71:0/2090240280 >> v2:172.21.15.72:3300/0 conn(0x7f880815a030 0x7f880815a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:39.534 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.529+0000 7f88077fe700 1 -- 172.21.15.71:0/2090240280 >> v2:172.21.15.72:3300/0 conn(0x7f880815a030 msgr2=0x7f880815a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:39.534 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.530+0000 7f88077fe700 1 --2- 172.21.15.71:0/2090240280 >> v2:172.21.15.72:3300/0 conn(0x7f880815a030 0x7f880815a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:39.534 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.530+0000 7f88077fe700 1 -- 172.21.15.71:0/2090240280 >> v1:172.21.15.72:6789/0 conn(0x7f8808087530 legacy=0x7f88080b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:39.534 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.530+0000 7f88077fe700 1 -- 172.21.15.71:0/2090240280 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88080aff30 con 0x7f880815a940 2023-10-06T01:42:39.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.530+0000 7f8807fff700 1 --2- 172.21.15.71:0/2090240280 >> v2:172.21.15.72:3300/0 conn(0x7f880815a030 0x7f880815a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:42:39.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.530+0000 7f88077fe700 1 --2- 172.21.15.71:0/2090240280 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f880815a940 0x7f8808086ff0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f88080cddc0 tx=0x7f87fc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db0c93c5c1447a6a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:39.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.530+0000 7f8806ffd700 1 -- 172.21.15.71:0/2090240280 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87fc00b820 con 0x7f880815a940 2023-10-06T01:42:39.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.530+0000 7f8806ffd700 1 -- 172.21.15.71:0/2090240280 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87fc00b980 con 0x7f880815a940 2023-10-06T01:42:39.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.530+0000 7f8806ffd700 1 -- 172.21.15.71:0/2090240280 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87fc00bd20 con 0x7f880815a940 2023-10-06T01:42:39.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.530+0000 7f880e5c2700 1 -- 172.21.15.71:0/2090240280 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f880815a940 msgr2=0x7f8808086ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:39.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.530+0000 7f880e5c2700 1 --2- 172.21.15.71:0/2090240280 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f880815a940 0x7f8808086ff0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f88080cddc0 tx=0x7f87fc009250 comp rx=0 tx=0).stop 2023-10-06T01:42:39.535 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.530+0000 7f880e5c2700 1 -- 172.21.15.71:0/2090240280 shutdown_connections 2023-10-06T01:42:39.536 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.530+0000 7f880e5c2700 1 --2- 172.21.15.71:0/2090240280 >> v2:172.21.15.72:3300/0 conn(0x7f880815a030 0x7f880815a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:39.536 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.530+0000 7f880e5c2700 1 --2- 172.21.15.71:0/2090240280 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f880815a940 0x7f8808086ff0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:39.536 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.530+0000 7f880e5c2700 1 -- 172.21.15.71:0/2090240280 >> 172.21.15.71:0/2090240280 conn(0x7f8808068680 msgr2=0x7f8808068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:39.536 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.530+0000 7f880e5c2700 1 -- 172.21.15.71:0/2090240280 shutdown_connections 2023-10-06T01:42:39.536 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.530+0000 7f880e5c2700 1 -- 172.21.15.71:0/2090240280 wait complete. 2023-10-06T01:42:39.536 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.531+0000 7f880e5c2700 1 Processor -- start 2023-10-06T01:42:39.536 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.532+0000 7f880e5c2700 1 -- start start 2023-10-06T01:42:39.541 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.532+0000 7f880e5c2700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8808087530 0x7f880815d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:39.541 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.532+0000 7f880e5c2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f880815a030 0x7f88080c67d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:39.541 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.532+0000 7f880e5c2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f880815a940 0x7f880816a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:39.541 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.532+0000 7f880e5c2700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88080c83f0 con 0x7f8808087530 2023-10-06T01:42:39.542 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.532+0000 7f880e5c2700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88080c6d10 con 0x7f880815a030 2023-10-06T01:42:39.542 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.532+0000 7f880e5c2700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f880815d790 con 0x7f880815a940 2023-10-06T01:42:39.542 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.532+0000 7f8807fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8808087530 0x7f880815d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:39.542 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.532+0000 7f8807fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8808087530 0x7f880815d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:42792/0 (socket says 172.21.15.71:42792) 2023-10-06T01:42:39.542 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.532+0000 7f8807fff700 1 -- 172.21.15.71:0/1408667582 learned_addr learned my addr 172.21.15.71:0/1408667582 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:39.542 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.533+0000 7f88077fe700 1 --2- 172.21.15.71:0/1408667582 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f880815a030 0x7f88080c67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:39.542 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.533+0000 7f880cb5f700 1 --2- 172.21.15.71:0/1408667582 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f880815a940 0x7f880816a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:39.543 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.533+0000 7f8807fff700 1 -- 172.21.15.71:0/1408667582 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f880815a940 msgr2=0x7f880816a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:39.543 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.533+0000 7f8807fff700 1 --2- 172.21.15.71:0/1408667582 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f880815a940 0x7f880816a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:39.543 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.533+0000 7f8807fff700 1 -- 172.21.15.71:0/1408667582 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f880815a030 msgr2=0x7f88080c67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:39.543 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.533+0000 7f8807fff700 1 --2- 172.21.15.71:0/1408667582 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f880815a030 0x7f88080c67d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:39.543 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.533+0000 7f8807fff700 1 -- 172.21.15.71:0/1408667582 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87fc0094f0 con 0x7f8808087530 2023-10-06T01:42:39.543 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.533+0000 7f8807fff700 1 --2- 172.21.15.71:0/1408667582 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8808087530 0x7f880815d1b0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f87f800e900 tx=0x7f87f8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:39.543 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.533+0000 7f87effff700 1 -- 172.21.15.71:0/1408667582 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f8013410 con 0x7f8808087530 2023-10-06T01:42:39.543 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.533+0000 7f87effff700 1 -- 172.21.15.71:0/1408667582 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87f8013570 con 0x7f8808087530 2023-10-06T01:42:39.544 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.533+0000 7f880e5c2700 1 -- 172.21.15.71:0/1408667582 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f880815da70 con 0x7f8808087530 2023-10-06T01:42:39.544 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.533+0000 7f87effff700 1 -- 172.21.15.71:0/1408667582 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f8013910 con 0x7f8808087530 2023-10-06T01:42:39.544 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.533+0000 7f880e5c2700 1 -- 172.21.15.71:0/1408667582 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f880815e030 con 0x7f8808087530 2023-10-06T01:42:39.544 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.534+0000 7f87effff700 1 -- 172.21.15.71:0/1408667582 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f87f8013cc0 con 0x7f8808087530 2023-10-06T01:42:39.544 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.535+0000 7f87effff700 1 --2- 172.21.15.71:0/1408667582 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f87f4066f30 0x7f87f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:39.544 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.535+0000 7f87effff700 1 -- 172.21.15.71:0/1408667582 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f87f8084540 con 0x7f8808087530 2023-10-06T01:42:39.545 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.535+0000 7f88077fe700 1 --2- 172.21.15.71:0/1408667582 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f87f4066f30 0x7f87f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:39.545 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.535+0000 7f88077fe700 1 --2- 172.21.15.71:0/1408667582 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f87f4066f30 0x7f87f40693e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f880815ad30 tx=0x7f87fc017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:39.545 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.537+0000 7f88178bab80 1 Processor -- start 2023-10-06T01:42:39.545 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.537+0000 7f88178bab80 1 -- start start 2023-10-06T01:42:39.545 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.538+0000 7f88178bab80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a2e21f5840 0x55a2e21f5c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:39.545 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.538+0000 7f88178bab80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a2e21f6cc0 0x55a2e22456c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:39.545 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.538+0000 7f88178bab80 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a2e2245c00 0x55a2e2246050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:39.545 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.538+0000 7f88178bab80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2e214ca70 con 0x55a2e21f6cc0 2023-10-06T01:42:39.546 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.538+0000 7f88178bab80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2e214a270 con 0x55a2e21f5840 2023-10-06T01:42:39.546 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.538+0000 7f88178bab80 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a2e2146060 con 0x55a2e2245c00 2023-10-06T01:42:39.546 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.538+0000 7f88077fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a2e21f6cc0 0x55a2e22456c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:39.546 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.538+0000 7f88077fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a2e21f6cc0 0x55a2e22456c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:42804/0 (socket says 172.21.15.71:42804) 2023-10-06T01:42:39.546 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.538+0000 7f88077fe700 1 -- 172.21.15.71:0/309395617 learned_addr learned my addr 172.21.15.71:0/309395617 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:39.546 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.538+0000 7f880cb5f700 1 --2- 172.21.15.71:0/309395617 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a2e2245c00 0x55a2e2246050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:39.547 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.538+0000 7f8807fff700 1 --2- 172.21.15.71:0/309395617 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a2e21f5840 0x55a2e21f5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:39.547 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.538+0000 7f88077fe700 1 -- 172.21.15.71:0/309395617 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a2e2245c00 msgr2=0x55a2e2246050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:39.547 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.538+0000 7f88077fe700 1 --2- 172.21.15.71:0/309395617 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a2e2245c00 0x55a2e2246050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:39.547 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.538+0000 7f88077fe700 1 -- 172.21.15.71:0/309395617 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a2e21f5840 msgr2=0x55a2e21f5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:39.547 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.538+0000 7f88077fe700 1 --2- 172.21.15.71:0/309395617 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a2e21f5840 0x55a2e21f5c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:39.547 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.538+0000 7f88077fe700 1 -- 172.21.15.71:0/309395617 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a2e1fe0270 con 0x55a2e21f6cc0 2023-10-06T01:42:39.547 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.538+0000 7f88077fe700 1 --2- 172.21.15.71:0/309395617 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a2e21f6cc0 0x55a2e22456c0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f87fc0090b0 tx=0x7f87fc020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33ea912f0a19bd23 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:39.547 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.538+0000 7f87ed7fa700 1 -- 172.21.15.71:0/309395617 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87fc02c070 con 0x55a2e21f6cc0 2023-10-06T01:42:39.548 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.538+0000 7f87ed7fa700 1 -- 172.21.15.71:0/309395617 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87fc011c10 con 0x55a2e21f6cc0 2023-10-06T01:42:39.548 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.538+0000 7f87ed7fa700 1 -- 172.21.15.71:0/309395617 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87fc020070 con 0x55a2e21f6cc0 2023-10-06T01:42:39.548 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.539+0000 7f88178bab80 1 -- 172.21.15.71:0/309395617 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a2e21f6cc0 msgr2=0x55a2e22456c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:39.548 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.539+0000 7f88178bab80 1 --2- 172.21.15.71:0/309395617 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a2e21f6cc0 0x55a2e22456c0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f87fc0090b0 tx=0x7f87fc020000 comp rx=0 tx=0).stop 2023-10-06T01:42:39.548 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.539+0000 7f88178bab80 1 -- 172.21.15.71:0/309395617 shutdown_connections 2023-10-06T01:42:39.548 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.539+0000 7f88178bab80 1 --2- 172.21.15.71:0/309395617 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a2e2245c00 0x55a2e2246050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:39.548 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.539+0000 7f88178bab80 1 --2- 172.21.15.71:0/309395617 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a2e21f5840 0x55a2e21f5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:39.549 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.539+0000 7f88178bab80 1 --2- 172.21.15.71:0/309395617 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a2e21f6cc0 0x55a2e22456c0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:39.549 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.539+0000 7f88178bab80 1 -- 172.21.15.71:0/309395617 >> 172.21.15.71:0/309395617 conn(0x55a2e21f7160 msgr2=0x55a2e21f7530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:39.549 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.539+0000 7f88178bab80 1 -- 172.21.15.71:0/309395617 shutdown_connections 2023-10-06T01:42:39.549 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.539+0000 7f88178bab80 1 -- 172.21.15.71:0/309395617 wait complete. 2023-10-06T01:42:39.549 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.540+0000 7f88178bab80 1 -- start start 2023-10-06T01:42:39.549 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.540+0000 7f88178bab80 1 Processor -- start 2023-10-06T01:42:39.553 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.540+0000 7f88178bab80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a2e21f5840 0x55a2e221ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:39.554 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.540+0000 7f88178bab80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a2e21f6cc0 0x55a2e2243060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:39.554 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.540+0000 7f88178bab80 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a2e2245c00 0x55a2e2239440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:39.554 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.540+0000 7f88178bab80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2e20f1890 con 0x55a2e21f6cc0 2023-10-06T01:42:39.554 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.540+0000 7f88178bab80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2e210cea0 con 0x55a2e21f5840 2023-10-06T01:42:39.554 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.540+0000 7f88178bab80 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a2e1fc8e30 con 0x55a2e2245c00 2023-10-06T01:42:39.554 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.540+0000 7f88178bab80 10 client.0 _ll_register_callbacks cb 0x55a2e21b8e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T01:42:39.554 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.540+0000 7f88077fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a2e21f6cc0 0x55a2e2243060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:39.554 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.541+0000 7f88077fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a2e21f6cc0 0x55a2e2243060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:42818/0 (socket says 172.21.15.71:42818) 2023-10-06T01:42:39.555 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.541+0000 7f88077fe700 1 -- 172.21.15.71:0/623933320 learned_addr learned my addr 172.21.15.71:0/623933320 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:39.555 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.541+0000 7f8807fff700 1 --2- 172.21.15.71:0/623933320 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a2e21f5840 0x55a2e221ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:39.555 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.541+0000 7f880cb5f700 1 --2- 172.21.15.71:0/623933320 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a2e2245c00 0x55a2e2239440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:39.555 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.541+0000 7f88077fe700 1 -- 172.21.15.71:0/623933320 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a2e2245c00 msgr2=0x55a2e2239440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:39.555 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.541+0000 7f88077fe700 1 --2- 172.21.15.71:0/623933320 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a2e2245c00 0x55a2e2239440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:39.555 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.541+0000 7f88077fe700 1 -- 172.21.15.71:0/623933320 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a2e21f5840 msgr2=0x55a2e221ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:39.555 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.541+0000 7f88077fe700 1 --2- 172.21.15.71:0/623933320 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a2e21f5840 0x55a2e221ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:39.555 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.541+0000 7f88077fe700 1 -- 172.21.15.71:0/623933320 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88080aff30 con 0x55a2e21f6cc0 2023-10-06T01:42:39.556 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.541+0000 7f880cb5f700 1 --2- 172.21.15.71:0/623933320 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a2e2245c00 0x55a2e2239440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:42:39.556 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.541+0000 7f88077fe700 1 --2- 172.21.15.71:0/623933320 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a2e21f6cc0 0x55a2e2243060 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f87fc011fd0 tx=0x7f87fc029070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c16264f7c01f2ce5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:39.556 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.541+0000 7f87e67fc700 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2023-10-06T01:42:39.556 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.541+0000 7f87e67fc700 1 -- 172.21.15.71:0/623933320 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87fc02c050 con 0x55a2e21f6cc0 2023-10-06T01:42:39.556 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.541+0000 7f87e67fc700 1 -- 172.21.15.71:0/623933320 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(58..58 src has 1..58) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f87fc031be0 con 0x55a2e21f6cc0 2023-10-06T01:42:39.556 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.541+0000 7f88178bab80 1 -- 172.21.15.71:0/623933320 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a2e21ea940 con 0x55a2e21f6cc0 2023-10-06T01:42:39.556 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.541+0000 7f87e67fc700 1 -- 172.21.15.71:0/623933320 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f87fc020040 con 0x55a2e21f6cc0 2023-10-06T01:42:39.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.541+0000 7f88178bab80 10 client.5862 fetch_fsmap learned FSMap version 39 2023-10-06T01:42:39.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.541+0000 7f88178bab80 1 -- 172.21.15.71:0/623933320 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) v3 -- 0x55a2e1f82fe0 con 0x55a2e21f6cc0 2023-10-06T01:42:39.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.541+0000 7f87e67fc700 1 -- 172.21.15.71:0/623933320 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87fc046030 con 0x55a2e21f6cc0 2023-10-06T01:42:39.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.541+0000 7f87e67fc700 1 -- 172.21.15.71:0/623933320 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 39) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f87fc038030 con 0x55a2e21f6cc0 2023-10-06T01:42:39.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.541+0000 7f88178bab80 10 client.5862 fetch_fsmap finished waiting for FSMap version 39 2023-10-06T01:42:39.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.541+0000 7f88178bab80 10 client.5862 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T01:42:39.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.542+0000 7f88178bab80 20 client.5862 populate_metadata read hostname 'smithi071' 2023-10-06T01:42:39.557 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.542+0000 7f88178bab80 1 --2- 172.21.15.71:0/623933320 >> [v2:172.21.15.71:6836/2318258263,v1:172.21.15.71:6837/2318258263] conn(0x55a2e223d6b0 0x55a2e223da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:39.558 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.542+0000 7f88178bab80 4 client.5862 mds_command: new command op to 5823 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T01:42:39.558 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.542+0000 7f88178bab80 1 -- 172.21.15.71:0/623933320 --> [v2:172.21.15.71:6836/2318258263,v1:172.21.15.71:6837/2318258263] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a2e21c7870 con 0x55a2e223d6b0 2023-10-06T01:42:39.558 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.542+0000 7f8807fff700 1 --2- 172.21.15.71:0/623933320 >> [v2:172.21.15.71:6836/2318258263,v1:172.21.15.71:6837/2318258263] conn(0x55a2e223d6b0 0x55a2e223da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:39.558 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.542+0000 7f87e67fc700 10 client.5862 ms_handle_connect on v2:172.21.15.71:6836/2318258263 2023-10-06T01:42:39.558 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.542+0000 7f8807fff700 1 --2- 172.21.15.71:0/623933320 >> [v2:172.21.15.71:6836/2318258263,v1:172.21.15.71:6837/2318258263] conn(0x55a2e223d6b0 0x55a2e223da80 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1fe2b4fc3a5dd04 server_cookie=ba791299db86fafb in_seq=0 out_seq=0 2023-10-06T01:42:39.558 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.542+0000 7f87e67fc700 1 -- 172.21.15.71:0/623933320 <== mds.0 v2:172.21.15.71:6836/2318258263 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55a2e21c7870 con 0x55a2e223d6b0 2023-10-06T01:42:39.558 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.542+0000 7f87e67fc700 10 client.5862 handle_command_reply: tid=0 2023-10-06T01:42:39.558 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.543+0000 7f88178bab80 1 client.5862 shutdown 2023-10-06T01:42:39.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.543+0000 7f88178bab80 1 -- 172.21.15.71:0/623933320 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a2e21f6cc0 msgr2=0x55a2e2243060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:39.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.543+0000 7f88178bab80 1 --2- 172.21.15.71:0/623933320 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a2e21f6cc0 0x55a2e2243060 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f87fc011fd0 tx=0x7f87fc029070 comp rx=0 tx=0).stop 2023-10-06T01:42:39.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.543+0000 7f88178bab80 1 -- 172.21.15.71:0/623933320 shutdown_connections 2023-10-06T01:42:39.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.543+0000 7f88178bab80 1 --2- 172.21.15.71:0/623933320 >> [v2:172.21.15.71:6836/2318258263,v1:172.21.15.71:6837/2318258263] conn(0x55a2e223d6b0 0x55a2e223da80 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:39.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.543+0000 7f88178bab80 1 --2- 172.21.15.71:0/623933320 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a2e2245c00 0x55a2e2239440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:39.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.543+0000 7f88178bab80 1 --2- 172.21.15.71:0/623933320 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a2e21f5840 0x55a2e221ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:39.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.543+0000 7f87e67fc700 0 client.5862 ms_handle_reset on v2:172.21.15.71:6836/2318258263 2023-10-06T01:42:39.559 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.543+0000 7f88178bab80 1 --2- 172.21.15.71:0/623933320 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a2e21f6cc0 0x55a2e2243060 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:39.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.543+0000 7f88178bab80 1 -- 172.21.15.71:0/623933320 >> 172.21.15.71:0/623933320 conn(0x55a2e21f7160 msgr2=0x55a2e21f61b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:39.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.543+0000 7f88178bab80 1 -- 172.21.15.71:0/623933320 shutdown_connections 2023-10-06T01:42:39.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.543+0000 7f88178bab80 1 -- 172.21.15.71:0/623933320 wait complete. 2023-10-06T01:42:39.560 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.543+0000 7f88178bab80 20 client.5862 trim_cache size 0 max 16384 2023-10-06T01:42:39.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.559+0000 7f88178bab80 1 Processor -- start 2023-10-06T01:42:39.561 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.559+0000 7f88178bab80 1 -- start start 2023-10-06T01:42:39.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.560+0000 7f88178bab80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a2e21f5840 0x55a2e22250f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:39.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.560+0000 7f88178bab80 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a2e21f6cc0 0x55a2e2245070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:39.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.560+0000 7f88178bab80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a2e2245c00 0x55a2e22455b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:39.570 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.560+0000 7f88178bab80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2e21f5f90 con 0x55a2e2245c00 2023-10-06T01:42:39.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.560+0000 7f88178bab80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2e2243d30 con 0x55a2e21f5840 2023-10-06T01:42:39.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.560+0000 7f88178bab80 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a2e2243670 con 0x55a2e21f6cc0 2023-10-06T01:42:39.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.560+0000 7f880cb5f700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a2e2245c00 0x55a2e22455b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:39.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.560+0000 7f880cb5f700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a2e2245c00 0x55a2e22455b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:42832/0 (socket says 172.21.15.71:42832) 2023-10-06T01:42:39.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.560+0000 7f880cb5f700 1 -- 172.21.15.71:0/1044469198 learned_addr learned my addr 172.21.15.71:0/1044469198 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:39.571 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.561+0000 7f880cb5f700 1 -- 172.21.15.71:0/1044469198 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a2e21f6cc0 msgr2=0x55a2e2245070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:39.572 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.561+0000 7f8807fff700 1 --2- 172.21.15.71:0/1044469198 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a2e21f5840 0x55a2e22250f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:39.572 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.561+0000 7f88077fe700 1 --2- 172.21.15.71:0/1044469198 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a2e21f6cc0 0x55a2e2245070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:39.572 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.561+0000 7f880cb5f700 1 --2- 172.21.15.71:0/1044469198 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a2e21f6cc0 0x55a2e2245070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:39.572 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.561+0000 7f880cb5f700 1 -- 172.21.15.71:0/1044469198 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a2e21f5840 msgr2=0x55a2e22250f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:39.572 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.561+0000 7f880cb5f700 1 --2- 172.21.15.71:0/1044469198 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a2e21f5840 0x55a2e22250f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:39.572 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.561+0000 7f880cb5f700 1 -- 172.21.15.71:0/1044469198 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a2e2114780 con 0x55a2e2245c00 2023-10-06T01:42:39.572 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.561+0000 7f8807fff700 1 --2- 172.21.15.71:0/1044469198 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a2e21f5840 0x55a2e22250f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:42:39.572 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.561+0000 7f88077fe700 1 --2- 172.21.15.71:0/1044469198 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a2e21f6cc0 0x55a2e2245070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:42:39.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.561+0000 7f880cb5f700 1 --2- 172.21.15.71:0/1044469198 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a2e2245c00 0x55a2e22455b0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f8800007fa0 tx=0x7f8800001690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=265093c9ceeb7f58 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:39.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.561+0000 7f87edffb700 1 -- 172.21.15.71:0/1044469198 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88000128b0 con 0x55a2e2245c00 2023-10-06T01:42:39.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.561+0000 7f87edffb700 1 -- 172.21.15.71:0/1044469198 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8800012a10 con 0x55a2e2245c00 2023-10-06T01:42:39.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.561+0000 7f87edffb700 1 -- 172.21.15.71:0/1044469198 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8800012d90 con 0x55a2e2245c00 2023-10-06T01:42:39.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.562+0000 7f88178bab80 1 -- 172.21.15.71:0/1044469198 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a2e2245c00 msgr2=0x55a2e22455b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:39.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.562+0000 7f88178bab80 1 --2- 172.21.15.71:0/1044469198 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a2e2245c00 0x55a2e22455b0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f8800007fa0 tx=0x7f8800001690 comp rx=0 tx=0).stop 2023-10-06T01:42:39.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.562+0000 7f88178bab80 1 -- 172.21.15.71:0/1044469198 shutdown_connections 2023-10-06T01:42:39.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.562+0000 7f88178bab80 1 --2- 172.21.15.71:0/1044469198 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a2e2245c00 0x55a2e22455b0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:39.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.562+0000 7f88178bab80 1 --2- 172.21.15.71:0/1044469198 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a2e21f5840 0x55a2e22250f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:39.573 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.562+0000 7f88178bab80 1 --2- 172.21.15.71:0/1044469198 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a2e21f6cc0 0x55a2e2245070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:39.574 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.562+0000 7f88178bab80 1 -- 172.21.15.71:0/1044469198 >> 172.21.15.71:0/1044469198 conn(0x55a2e21f7160 msgr2=0x55a2e21ee280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:39.574 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.562+0000 7f88178bab80 1 -- 172.21.15.71:0/1044469198 shutdown_connections 2023-10-06T01:42:39.574 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.562+0000 7f88178bab80 1 -- 172.21.15.71:0/1044469198 wait complete. 2023-10-06T01:42:39.574 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.562+0000 7f88178bab80 1 -- start start 2023-10-06T01:42:39.574 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.562+0000 7f88178bab80 1 Processor -- start 2023-10-06T01:42:39.574 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.563+0000 7f88178bab80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a2e21f5840 0x55a2e221e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:39.574 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.563+0000 7f88178bab80 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a2e21f6cc0 0x55a2e22a1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:39.574 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.563+0000 7f88178bab80 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a2e2245c00 0x55a2e2245010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:39.574 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.563+0000 7f88178bab80 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2e21f0aa0 con 0x55a2e2245c00 2023-10-06T01:42:39.574 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.563+0000 7f88178bab80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2e21f0cf0 con 0x55a2e21f5840 2023-10-06T01:42:39.574 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.563+0000 7f88178bab80 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a2e221dcc0 con 0x55a2e21f6cc0 2023-10-06T01:42:39.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.563+0000 7f88178bab80 10 client.0 _ll_register_callbacks cb 0x55a2e21b8e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T01:42:39.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.563+0000 7f880cb5f700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a2e2245c00 0x55a2e2245010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:39.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.563+0000 7f880cb5f700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a2e2245c00 0x55a2e2245010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:42846/0 (socket says 172.21.15.71:42846) 2023-10-06T01:42:39.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.563+0000 7f880cb5f700 1 -- 172.21.15.71:0/1109664502 learned_addr learned my addr 172.21.15.71:0/1109664502 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:39.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.563+0000 7f8807fff700 1 --2- 172.21.15.71:0/1109664502 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a2e21f5840 0x55a2e221e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:39.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.563+0000 7f88077fe700 1 --2- 172.21.15.71:0/1109664502 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a2e21f6cc0 0x55a2e22a1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:39.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.563+0000 7f880cb5f700 1 -- 172.21.15.71:0/1109664502 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a2e21f6cc0 msgr2=0x55a2e22a1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:39.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.563+0000 7f880cb5f700 1 --2- 172.21.15.71:0/1109664502 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a2e21f6cc0 0x55a2e22a1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:39.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.563+0000 7f880cb5f700 1 -- 172.21.15.71:0/1109664502 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a2e21f5840 msgr2=0x55a2e221e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:39.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.563+0000 7f880cb5f700 1 --2- 172.21.15.71:0/1109664502 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a2e21f5840 0x55a2e221e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:39.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.563+0000 7f880cb5f700 1 -- 172.21.15.71:0/1109664502 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f880000f040 con 0x55a2e2245c00 2023-10-06T01:42:39.575 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.564+0000 7f880cb5f700 1 --2- 172.21.15.71:0/1109664502 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a2e2245c00 0x55a2e2245010 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x55a2e2234b80 tx=0x7f880001d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee4bf3d63fbec46d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:39.576 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.564+0000 7f87e67fc700 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2023-10-06T01:42:39.576 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.564+0000 7f87e67fc700 1 -- 172.21.15.71:0/1109664502 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8800025070 con 0x55a2e2245c00 2023-10-06T01:42:39.576 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.564+0000 7f87e67fc700 1 -- 172.21.15.71:0/1109664502 <== mon.0 v2:172.21.15.71:3300/0 2 ==== osd_map(58..58 src has 1..58) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f8800012e10 con 0x55a2e2245c00 2023-10-06T01:42:39.576 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.564+0000 7f88178bab80 1 -- 172.21.15.71:0/1109664502 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f87fc011c10 con 0x55a2e2245c00 2023-10-06T01:42:39.576 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.564+0000 7f87e67fc700 1 -- 172.21.15.71:0/1109664502 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8800016860 con 0x55a2e2245c00 2023-10-06T01:42:39.576 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.564+0000 7f88178bab80 10 client.5868 fetch_fsmap learned FSMap version 39 2023-10-06T01:42:39.576 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.564+0000 7f88178bab80 1 -- 172.21.15.71:0/1109664502 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) v3 -- 0x55a2e20fb470 con 0x55a2e2245c00 2023-10-06T01:42:39.576 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.564+0000 7f87e67fc700 1 -- 172.21.15.71:0/1109664502 <== mon.0 v2:172.21.15.71:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87fc011c10 con 0x55a2e2245c00 2023-10-06T01:42:39.576 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.564+0000 7f87e67fc700 1 -- 172.21.15.71:0/1109664502 <== mon.0 v2:172.21.15.71:3300/0 5 ==== fsmap(e 39) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f88000169c0 con 0x55a2e2245c00 2023-10-06T01:42:39.576 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.564+0000 7f88178bab80 10 client.5868 fetch_fsmap finished waiting for FSMap version 39 2023-10-06T01:42:39.576 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.564+0000 7f88178bab80 10 client.5868 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T01:42:39.576 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.564+0000 7f88178bab80 20 client.5868 populate_metadata read hostname 'smithi071' 2023-10-06T01:42:39.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.564+0000 7f88178bab80 1 --2- 172.21.15.71:0/1109664502 >> [v2:172.21.15.71:6836/2318258263,v1:172.21.15.71:6837/2318258263] conn(0x55a2e22a5460 0x55a2e22a5830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:39.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.564+0000 7f88178bab80 4 client.5868 mds_command: new command op to 5823 tid=0[{"prefix": "status"}] 2023-10-06T01:42:39.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.564+0000 7f88178bab80 1 -- 172.21.15.71:0/1109664502 --> [v2:172.21.15.71:6836/2318258263,v1:172.21.15.71:6837/2318258263] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55a2e20e8e00 con 0x55a2e22a5460 2023-10-06T01:42:39.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.564+0000 7f8807fff700 1 --2- 172.21.15.71:0/1109664502 >> [v2:172.21.15.71:6836/2318258263,v1:172.21.15.71:6837/2318258263] conn(0x55a2e22a5460 0x55a2e22a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:39.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.565+0000 7f87e67fc700 10 client.5868 ms_handle_connect on v2:172.21.15.71:6836/2318258263 2023-10-06T01:42:39.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.565+0000 7f8807fff700 1 --2- 172.21.15.71:0/1109664502 >> [v2:172.21.15.71:6836/2318258263,v1:172.21.15.71:6837/2318258263] conn(0x55a2e22a5460 0x55a2e22a5830 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd7114b4204b2930 server_cookie=4fb52cc8c04db60 in_seq=0 out_seq=0 2023-10-06T01:42:39.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.565+0000 7f87e67fc700 1 -- 172.21.15.71:0/1109664502 <== mds.0 v2:172.21.15.71:6836/2318258263 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55a2e20e8e00 con 0x55a2e22a5460 2023-10-06T01:42:39.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.565+0000 7f87e67fc700 10 client.5868 handle_command_reply: tid=0 2023-10-06T01:42:39.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.565+0000 7f88178bab80 1 client.5868 shutdown 2023-10-06T01:42:39.578 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.565+0000 7f88178bab80 1 -- 172.21.15.71:0/1109664502 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a2e2245c00 msgr2=0x55a2e2245010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:39.578 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.565+0000 7f88178bab80 1 --2- 172.21.15.71:0/1109664502 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a2e2245c00 0x55a2e2245010 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x55a2e2234b80 tx=0x7f880001d000 comp rx=0 tx=0).stop 2023-10-06T01:42:39.578 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.565+0000 7f88178bab80 1 -- 172.21.15.71:0/1109664502 shutdown_connections 2023-10-06T01:42:39.578 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.565+0000 7f88178bab80 1 --2- 172.21.15.71:0/1109664502 >> [v2:172.21.15.71:6836/2318258263,v1:172.21.15.71:6837/2318258263] conn(0x55a2e22a5460 0x55a2e22a5830 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:39.578 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.565+0000 7f88178bab80 1 --2- 172.21.15.71:0/1109664502 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a2e2245c00 0x55a2e2245010 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:39.578 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.565+0000 7f88178bab80 1 --2- 172.21.15.71:0/1109664502 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55a2e21f5840 0x55a2e221e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:39.578 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.565+0000 7f87e67fc700 0 client.5868 ms_handle_reset on v2:172.21.15.71:6836/2318258263 2023-10-06T01:42:39.578 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.565+0000 7f88178bab80 1 --2- 172.21.15.71:0/1109664502 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x55a2e21f6cc0 0x55a2e22a1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:39.578 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.565+0000 7f88178bab80 1 -- 172.21.15.71:0/1109664502 >> 172.21.15.71:0/1109664502 conn(0x55a2e21f7160 msgr2=0x55a2e2242460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:39.578 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.565+0000 7f88178bab80 1 -- 172.21.15.71:0/1109664502 shutdown_connections 2023-10-06T01:42:39.578 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.565+0000 7f88178bab80 1 -- 172.21.15.71:0/1109664502 wait complete. 2023-10-06T01:42:39.579 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.565+0000 7f88178bab80 20 client.5868 trim_cache size 0 max 16384 2023-10-06T01:42:39.579 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2023-10-06T01:42:39.579 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster_fsid": "1fbf1bd2-f9b4-4599-bea2-f4aa920e9a56", 2023-10-06T01:42:39.579 INFO:teuthology.orchestra.run.smithi071.stdout: "whoami": 0, 2023-10-06T01:42:39.579 INFO:teuthology.orchestra.run.smithi071.stdout: "id": 5823, 2023-10-06T01:42:39.579 INFO:teuthology.orchestra.run.smithi071.stdout: "want_state": "up:active", 2023-10-06T01:42:39.579 INFO:teuthology.orchestra.run.smithi071.stdout: "state": "up:active", 2023-10-06T01:42:39.579 INFO:teuthology.orchestra.run.smithi071.stdout: "fs_name": "cephfs", 2023-10-06T01:42:39.579 INFO:teuthology.orchestra.run.smithi071.stdout: "rank_uptime": 4.5404201610000001, 2023-10-06T01:42:39.580 INFO:teuthology.orchestra.run.smithi071.stdout: "mdsmap_epoch": 39, 2023-10-06T01:42:39.580 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_epoch": 58, 2023-10-06T01:42:39.580 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_epoch_barrier": 58, 2023-10-06T01:42:39.580 INFO:teuthology.orchestra.run.smithi071.stdout: "uptime": 5.4094590910000004 2023-10-06T01:42:39.580 INFO:teuthology.orchestra.run.smithi071.stdout:} 2023-10-06T01:42:39.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.565+0000 7f880e5c2700 1 -- 172.21.15.71:0/1408667582 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f87f4066f30 msgr2=0x7f87f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:39.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.565+0000 7f880e5c2700 1 --2- 172.21.15.71:0/1408667582 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f87f4066f30 0x7f87f40693e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f880815ad30 tx=0x7f87fc017000 comp rx=0 tx=0).stop 2023-10-06T01:42:39.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.566+0000 7f880e5c2700 1 -- 172.21.15.71:0/1408667582 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8808087530 msgr2=0x7f880815d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:39.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.566+0000 7f880e5c2700 1 --2- 172.21.15.71:0/1408667582 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8808087530 0x7f880815d1b0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f87f800e900 tx=0x7f87f8008040 comp rx=0 tx=0).stop 2023-10-06T01:42:39.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.566+0000 7f880e5c2700 1 -- 172.21.15.71:0/1408667582 shutdown_connections 2023-10-06T01:42:39.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.566+0000 7f880e5c2700 1 --2- 172.21.15.71:0/1408667582 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f880815a940 0x7f880816a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:39.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.566+0000 7f880e5c2700 1 --2- 172.21.15.71:0/1408667582 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8808087530 0x7f880815d1b0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:39.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.566+0000 7f880e5c2700 1 --2- 172.21.15.71:0/1408667582 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f87f4066f30 0x7f87f40693e0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:39.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.566+0000 7f880e5c2700 1 --2- 172.21.15.71:0/1408667582 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f880815a030 0x7f88080c67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:39.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.566+0000 7f880e5c2700 1 -- 172.21.15.71:0/1408667582 >> 172.21.15.71:0/1408667582 conn(0x7f8808068680 msgr2=0x7f88080b50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:39.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.566+0000 7f880e5c2700 1 -- 172.21.15.71:0/1408667582 shutdown_connections 2023-10-06T01:42:39.582 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.566+0000 7f880e5c2700 1 -- 172.21.15.71:0/1408667582 wait complete. 2023-10-06T01:42:39.583 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-06T01:42:39.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.695+0000 7f6c0148d700 1 Processor -- start 2023-10-06T01:42:39.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.695+0000 7f6c0148d700 1 -- start start 2023-10-06T01:42:39.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.696+0000 7f6c0148d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6bfc0b3c50 0x7f6bfc15b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:39.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.696+0000 7f6c0148d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bfc0afb90 con 0x7f6bfc15b3c0 2023-10-06T01:42:39.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.696+0000 7f6c0148d700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bfc0b2310 con 0x7f6bfc15bcd0 2023-10-06T01:42:39.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.696+0000 7f6c0148d700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bfc0b25f0 con 0x7f6bfc0b3c50 2023-10-06T01:42:39.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.696+0000 7f6bfaffd700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f6bfc15b3c0 0x7f6bfc097d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:55354/0 (socket says 172.21.15.71:55354) 2023-10-06T01:42:39.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.696+0000 7f6bfaffd700 1 -- 172.21.15.71:0/3921005041 learned_addr learned my addr 172.21.15.71:0/3921005041 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:42:39.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.697+0000 7f6bfa7fc700 1 -- 172.21.15.71:0/3921005041 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2531509308 0 0) 0x7f6bfc0afb90 con 0x7f6bfc15b3c0 2023-10-06T01:42:39.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.697+0000 7f6bf27fc700 1 --2- 172.21.15.71:0/3921005041 >> v2:172.21.15.72:3300/0 conn(0x7f6bfc0b3c50 0x7f6bfc15b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:39.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.697+0000 7f6bfa7fc700 1 -- 172.21.15.71:0/3921005041 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6be8003570 con 0x7f6bfc15b3c0 2023-10-06T01:42:39.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.697+0000 7f6bfa7fc700 1 -- 172.21.15.71:0/3921005041 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 494572027 0 0) 0x7f6be8003570 con 0x7f6bfc15b3c0 2023-10-06T01:42:39.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.697+0000 7f6bfa7fc700 1 -- 172.21.15.71:0/3921005041 >> v2:172.21.15.72:3300/0 conn(0x7f6bfc0b3c50 msgr2=0x7f6bfc15b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:39.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.697+0000 7f6bfa7fc700 1 --2- 172.21.15.71:0/3921005041 >> v2:172.21.15.72:3300/0 conn(0x7f6bfc0b3c50 0x7f6bfc15b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:39.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.697+0000 7f6bfa7fc700 1 -- 172.21.15.71:0/3921005041 >> v1:172.21.15.72:6789/0 conn(0x7f6bfc15bcd0 legacy=0x7f6bfc15a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:39.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.697+0000 7f6bfa7fc700 1 -- 172.21.15.71:0/3921005041 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bfc0af820 con 0x7f6bfc15b3c0 2023-10-06T01:42:39.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.697+0000 7f6bfa7fc700 1 -- 172.21.15.71:0/3921005041 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1184243524 0 0) 0x7f6bec0015f0 con 0x7f6bfc15b3c0 2023-10-06T01:42:39.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.697+0000 7f6bfa7fc700 1 -- 172.21.15.71:0/3921005041 >> v1:172.21.15.71:6789/0 conn(0x7f6bfc15b3c0 legacy=0x7f6bfc097d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:39.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.697+0000 7f6bfa7fc700 1 --2- 172.21.15.71:0/3921005041 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6be8003a60 0x7f6be8003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:39.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.697+0000 7f6bfa7fc700 1 --2- 172.21.15.71:0/3921005041 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6be8004810 0x7f6be8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:39.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.697+0000 7f6bfa7fc700 1 --2- 172.21.15.71:0/3921005041 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6be80051c0 0x7f6be800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:39.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.697+0000 7f6bfa7fc700 1 -- 172.21.15.71:0/3921005041 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bfc0b25f0 con 0x7f6be8003a60 2023-10-06T01:42:39.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.697+0000 7f6bfa7fc700 1 -- 172.21.15.71:0/3921005041 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be800c1e0 con 0x7f6be80051c0 2023-10-06T01:42:39.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.697+0000 7f6bfa7fc700 1 -- 172.21.15.71:0/3921005041 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6be800c3a0 con 0x7f6be8004810 2023-10-06T01:42:39.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.697+0000 7f6bfaffd700 1 --2- 172.21.15.71:0/3921005041 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6be8003a60 0x7f6be8003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:39.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.697+0000 7f6bfb7fe700 1 --2- 172.21.15.71:0/3921005041 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6be80051c0 0x7f6be800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:39.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.697+0000 7f6bf27fc700 1 --2- 172.21.15.71:0/3921005041 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6be8004810 0x7f6be8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:39.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.697+0000 7f6bfaffd700 1 -- 172.21.15.71:0/3921005041 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6be8004810 msgr2=0x7f6be8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:39.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.697+0000 7f6bfaffd700 1 --2- 172.21.15.71:0/3921005041 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6be8004810 0x7f6be8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:39.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.697+0000 7f6bfaffd700 1 -- 172.21.15.71:0/3921005041 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6be80051c0 msgr2=0x7f6be800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:39.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.697+0000 7f6bfaffd700 1 --2- 172.21.15.71:0/3921005041 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6be80051c0 0x7f6be800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:39.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.697+0000 7f6bfb7fe700 1 -- 172.21.15.71:0/3921005041 reap_dead start 2023-10-06T01:42:39.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.697+0000 7f6bfaffd700 1 -- 172.21.15.71:0/3921005041 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6be8003570 con 0x7f6be8003a60 2023-10-06T01:42:39.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.697+0000 7f6bf27fc700 1 --2- 172.21.15.71:0/3921005041 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6be8004810 0x7f6be8004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:42:39.708 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.697+0000 7f6bfaffd700 1 --2- 172.21.15.71:0/3921005041 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6be8003a60 0x7f6be8003e30 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f6bec00c2d0 tx=0x7f6bec007920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81ea7e6e8c7d683f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:39.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.698+0000 7f6bfa7fc700 1 -- 172.21.15.71:0/3921005041 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bec00cc00 con 0x7f6be8003a60 2023-10-06T01:42:39.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.698+0000 7f6bfa7fc700 1 -- 172.21.15.71:0/3921005041 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bec00cd80 con 0x7f6be8003a60 2023-10-06T01:42:39.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.698+0000 7f6bfa7fc700 1 -- 172.21.15.71:0/3921005041 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bec001de0 con 0x7f6be8003a60 2023-10-06T01:42:39.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.698+0000 7f6c0148d700 1 -- 172.21.15.71:0/3921005041 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6be8003a60 msgr2=0x7f6be8003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:39.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.698+0000 7f6c0148d700 1 --2- 172.21.15.71:0/3921005041 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6be8003a60 0x7f6be8003e30 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f6bec00c2d0 tx=0x7f6bec007920 comp rx=0 tx=0).stop 2023-10-06T01:42:39.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.698+0000 7f6c0148d700 1 -- 172.21.15.71:0/3921005041 shutdown_connections 2023-10-06T01:42:39.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.698+0000 7f6c0148d700 1 --2- 172.21.15.71:0/3921005041 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6be8003a60 0x7f6be8003e30 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:39.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.698+0000 7f6c0148d700 1 -- 172.21.15.71:0/3921005041 >> 172.21.15.71:0/3921005041 conn(0x7f6bfc067910 msgr2=0x7f6bfc0ce160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:39.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.698+0000 7f6c0148d700 1 -- 172.21.15.71:0/3921005041 shutdown_connections 2023-10-06T01:42:39.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.698+0000 7f6c0148d700 1 -- 172.21.15.71:0/3921005041 wait complete. 2023-10-06T01:42:39.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.699+0000 7f6c0148d700 1 Processor -- start 2023-10-06T01:42:39.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.699+0000 7f6c0148d700 1 -- start start 2023-10-06T01:42:39.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.700+0000 7f6c0148d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6be8003a60 0x7f6bfc09a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:39.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.700+0000 7f6c0148d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6bfc097c70 0x7f6bfc0980e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:39.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.700+0000 7f6c0148d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6bfc1559c0 0x7f6bfc155e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:39.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.700+0000 7f6c0148d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bfc1563a0 con 0x7f6bfc097c70 2023-10-06T01:42:39.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.700+0000 7f6c0148d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bfc1532f0 con 0x7f6be8003a60 2023-10-06T01:42:39.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.700+0000 7f6c0148d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bfc1676c0 con 0x7f6bfc1559c0 2023-10-06T01:42:39.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.700+0000 7f6bf27fc700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6bfc097c70 0x7f6bfc0980e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:39.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.700+0000 7f6bf27fc700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6bfc097c70 0x7f6bfc0980e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:42856/0 (socket says 172.21.15.71:42856) 2023-10-06T01:42:39.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.700+0000 7f6bf27fc700 1 -- 172.21.15.71:0/3912594572 learned_addr learned my addr 172.21.15.71:0/3912594572 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:39.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.700+0000 7f6bfaffd700 1 --2- 172.21.15.71:0/3912594572 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6be8003a60 0x7f6bfc09a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:39.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.700+0000 7f6bfb7fe700 1 --2- 172.21.15.71:0/3912594572 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6bfc1559c0 0x7f6bfc155e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:39.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.701+0000 7f6bf27fc700 1 -- 172.21.15.71:0/3912594572 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6bfc1559c0 msgr2=0x7f6bfc155e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:39.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.701+0000 7f6bf27fc700 1 --2- 172.21.15.71:0/3912594572 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6bfc1559c0 0x7f6bfc155e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:39.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.701+0000 7f6bf27fc700 1 -- 172.21.15.71:0/3912594572 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6be8003a60 msgr2=0x7f6bfc09a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:39.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.701+0000 7f6bf27fc700 1 --2- 172.21.15.71:0/3912594572 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6be8003a60 0x7f6bfc09a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:39.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.701+0000 7f6bf27fc700 1 -- 172.21.15.71:0/3912594572 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bfc0987c0 con 0x7f6bfc097c70 2023-10-06T01:42:39.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.701+0000 7f6bfaffd700 1 --2- 172.21.15.71:0/3912594572 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6be8003a60 0x7f6bfc09a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:42:39.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.701+0000 7f6bf27fc700 1 --2- 172.21.15.71:0/3912594572 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6bfc097c70 0x7f6bfc0980e0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f6be4011700 tx=0x7f6be4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:39.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.701+0000 7f6bf37fe700 1 -- 172.21.15.71:0/3912594572 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be4015670 con 0x7f6bfc097c70 2023-10-06T01:42:39.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.701+0000 7f6bf37fe700 1 -- 172.21.15.71:0/3912594572 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6be40157d0 con 0x7f6bfc097c70 2023-10-06T01:42:39.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.701+0000 7f6bf37fe700 1 -- 172.21.15.71:0/3912594572 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be4015b90 con 0x7f6bfc097c70 2023-10-06T01:42:39.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.701+0000 7f6c0148d700 1 -- 172.21.15.71:0/3912594572 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bfc098aa0 con 0x7f6bfc097c70 2023-10-06T01:42:39.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.701+0000 7f6c0148d700 1 -- 172.21.15.71:0/3912594572 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bfc099060 con 0x7f6bfc097c70 2023-10-06T01:42:39.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.702+0000 7f6c0148d700 1 -- 172.21.15.71:0/3912594572 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bfc167910 con 0x7f6bfc097c70 2023-10-06T01:42:39.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.702+0000 7f6bf37fe700 1 -- 172.21.15.71:0/3912594572 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6be4013410 con 0x7f6bfc097c70 2023-10-06T01:42:39.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.703+0000 7f6bf37fe700 1 --2- 172.21.15.71:0/3912594572 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f6bdc066f60 0x7f6bdc069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:39.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.703+0000 7f6bfaffd700 1 --2- 172.21.15.71:0/3912594572 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f6bdc066f60 0x7f6bdc069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:39.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.703+0000 7f6bf37fe700 1 -- 172.21.15.71:0/3912594572 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f6be4084ed0 con 0x7f6bfc097c70 2023-10-06T01:42:39.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.703+0000 7f6bfaffd700 1 --2- 172.21.15.71:0/3912594572 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f6bdc066f60 0x7f6bdc069410 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6bec000ef0 tx=0x7f6bec015000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:39.713 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.707+0000 7f6bf37fe700 1 -- 172.21.15.71:0/3912594572 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6bfc167910 con 0x7f6bfc097c70 2023-10-06T01:42:39.935 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.933+0000 7f6c0148d700 1 -- 172.21.15.71:0/3912594572 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f6bfc167910 con 0x7f6bfc097c70 2023-10-06T01:42:39.935 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.934+0000 7f6bf37fe700 1 -- 172.21.15.71:0/3912594572 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f6be4022040 con 0x7f6bfc097c70 2023-10-06T01:42:39.936 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:42:39.936 INFO:teuthology.orchestra.run.smithi071.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-06T01:42:39.937 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.936+0000 7f6c0148d700 1 -- 172.21.15.71:0/3912594572 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f6bdc066f60 msgr2=0x7f6bdc069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:39.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.936+0000 7f6c0148d700 1 --2- 172.21.15.71:0/3912594572 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f6bdc066f60 0x7f6bdc069410 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6bec000ef0 tx=0x7f6bec015000 comp rx=0 tx=0).stop 2023-10-06T01:42:39.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.936+0000 7f6c0148d700 1 -- 172.21.15.71:0/3912594572 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6bfc097c70 msgr2=0x7f6bfc0980e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:39.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.936+0000 7f6c0148d700 1 --2- 172.21.15.71:0/3912594572 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6bfc097c70 0x7f6bfc0980e0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f6be4011700 tx=0x7f6be4008040 comp rx=0 tx=0).stop 2023-10-06T01:42:39.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.936+0000 7f6c0148d700 1 -- 172.21.15.71:0/3912594572 shutdown_connections 2023-10-06T01:42:39.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.936+0000 7f6c0148d700 1 --2- 172.21.15.71:0/3912594572 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6bfc1559c0 0x7f6bfc155e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:39.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.936+0000 7f6c0148d700 1 --2- 172.21.15.71:0/3912594572 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f6bdc066f60 0x7f6bdc069410 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:39.938 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.936+0000 7f6c0148d700 1 --2- 172.21.15.71:0/3912594572 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6be8003a60 0x7f6bfc09a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:39.939 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.936+0000 7f6c0148d700 1 --2- 172.21.15.71:0/3912594572 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6bfc097c70 0x7f6bfc0980e0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:39.939 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.936+0000 7f6c0148d700 1 -- 172.21.15.71:0/3912594572 >> 172.21.15.71:0/3912594572 conn(0x7f6bfc067910 msgr2=0x7f6bfc1580f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:39.939 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.936+0000 7f6c0148d700 1 -- 172.21.15.71:0/3912594572 shutdown_connections 2023-10-06T01:42:39.939 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:39.936+0000 7f6c0148d700 1 -- 172.21.15.71:0/3912594572 wait complete. 2023-10-06T01:42:39.949 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-10-06T01:42:39.949 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T01:42:39.950 DEBUG:teuthology.orchestra.run.smithi071:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T01:42:39.987 DEBUG:teuthology.orchestra.run.smithi072:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T01:42:40.033 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T01:42:40.034 INFO:tasks.cephfs.mount:Terminating background process 2023-10-06T01:42:40.034 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi071.front.sepia.ceph.com... 2023-10-06T01:42:40.034 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T01:42:40.034 DEBUG:teuthology.orchestra.run.smithi071:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-06T01:42:40.066 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi071.stderr:ceph-fuse[108766]: fuse finished with error 0 and tester_r 0 2023-10-06T01:42:40.068 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi071.front.sepia.ceph.com 2023-10-06T01:42:40.068 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:42:40.068 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T01:42:40.131 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi072.front.sepia.ceph.com 2023-10-06T01:42:40.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:42:40.132 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-06T01:42:40.149 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T01:42:40.149 INFO:teuthology.orchestra.run.smithi072.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-10-06T01:42:40.150 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi071.front.sepia.ceph.com 2023-10-06T01:42:40.150 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:42:40.150 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-06T01:42:40.186 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T01:42:40.186 INFO:teuthology.orchestra.run.smithi071.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-10-06T01:42:40.186 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi072.front.sepia.ceph.com 2023-10-06T01:42:40.187 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:42:40.187 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-06T01:42:40.205 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T01:42:40.206 INFO:teuthology.orchestra.run.smithi072.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-10-06T01:42:40.206 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T01:42:40.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.339+0000 7f6e758c1700 1 Processor -- start 2023-10-06T01:42:40.341 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.339+0000 7f6e758c1700 1 -- start start 2023-10-06T01:42:40.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.340+0000 7f6e758c1700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6e70069bf0 0x7f6e700b0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:40.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.340+0000 7f6e758c1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6e70069fc0 0x7f6e7006a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:40.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.340+0000 7f6e758c1700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e700b16c0 con 0x7f6e700ae930 2023-10-06T01:42:40.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.340+0000 7f6e758c1700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e700b1f40 con 0x7f6e70069bf0 2023-10-06T01:42:40.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.340+0000 7f6e758c1700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e700b08c0 con 0x7f6e70069fc0 2023-10-06T01:42:40.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.340+0000 7f6e748bf700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6e70069bf0 0x7f6e700b0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:40.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.340+0000 7f6e67fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6e70069fc0 0x7f6e7006a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:40.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.340+0000 7f6e750c0700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f6e700ae930 0x7f6e700aed50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.71:38626/0 (socket says 172.21.15.71:38626) 2023-10-06T01:42:40.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.340+0000 7f6e750c0700 1 -- 172.21.15.71:0/4042707401 learned_addr learned my addr 172.21.15.71:0/4042707401 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:42:40.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.341+0000 7f6e748bf700 1 -- 172.21.15.71:0/4042707401 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6e70069fc0 msgr2=0x7f6e7006a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:40.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.341+0000 7f6e748bf700 1 --2- 172.21.15.71:0/4042707401 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6e70069fc0 0x7f6e7006a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:40.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.341+0000 7f6e748bf700 1 -- 172.21.15.71:0/4042707401 >> v1:172.21.15.72:6789/0 conn(0x7f6e700ae930 legacy=0x7f6e700aed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:40.344 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.341+0000 7f6e748bf700 1 -- 172.21.15.71:0/4042707401 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e7006aac0 con 0x7f6e70069bf0 2023-10-06T01:42:40.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.341+0000 7f6e67fff700 1 --2- 172.21.15.71:0/4042707401 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6e70069fc0 0x7f6e7006a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:42:40.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.341+0000 7f6e748bf700 1 --2- 172.21.15.71:0/4042707401 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6e70069bf0 0x7f6e700b0380 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f6e6c009eb0 tx=0x7f6e6c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=703ce13f98e16a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:40.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.341+0000 7f6e677fe700 1 -- 172.21.15.71:0/4042707401 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e6c00e070 con 0x7f6e70069bf0 2023-10-06T01:42:40.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.341+0000 7f6e677fe700 1 -- 172.21.15.71:0/4042707401 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e6c00bc30 con 0x7f6e70069bf0 2023-10-06T01:42:40.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.341+0000 7f6e677fe700 1 -- 172.21.15.71:0/4042707401 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e6c012430 con 0x7f6e70069bf0 2023-10-06T01:42:40.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.342+0000 7f6e758c1700 1 -- 172.21.15.71:0/4042707401 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6e70069bf0 msgr2=0x7f6e700b0380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:40.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.342+0000 7f6e758c1700 1 --2- 172.21.15.71:0/4042707401 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6e70069bf0 0x7f6e700b0380 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f6e6c009eb0 tx=0x7f6e6c009780 comp rx=0 tx=0).stop 2023-10-06T01:42:40.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.342+0000 7f6e758c1700 1 -- 172.21.15.71:0/4042707401 shutdown_connections 2023-10-06T01:42:40.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.342+0000 7f6e758c1700 1 --2- 172.21.15.71:0/4042707401 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6e70069bf0 0x7f6e700b0380 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:40.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.342+0000 7f6e758c1700 1 --2- 172.21.15.71:0/4042707401 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6e70069fc0 0x7f6e7006a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:40.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.342+0000 7f6e758c1700 1 -- 172.21.15.71:0/4042707401 >> 172.21.15.71:0/4042707401 conn(0x7f6e70067910 msgr2=0x7f6e700cdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:40.345 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.342+0000 7f6e758c1700 1 -- 172.21.15.71:0/4042707401 shutdown_connections 2023-10-06T01:42:40.346 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.342+0000 7f6e758c1700 1 -- 172.21.15.71:0/4042707401 wait complete. 2023-10-06T01:42:40.348 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.343+0000 7f6e758c1700 1 Processor -- start 2023-10-06T01:42:40.349 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.343+0000 7f6e758c1700 1 -- start start 2023-10-06T01:42:40.349 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.344+0000 7f6e758c1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6e70069bf0 0x7f6e70157d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:40.349 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.344+0000 7f6e758c1700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e70069fc0 0x7f6e70158a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:40.349 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.344+0000 7f6e758c1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6e700ae930 0x7f6e7015b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:40.349 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.344+0000 7f6e758c1700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e700a9030 con 0x7f6e70069fc0 2023-10-06T01:42:40.349 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.344+0000 7f6e758c1700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e700cb6b0 con 0x7f6e700ae930 2023-10-06T01:42:40.349 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.344+0000 7f6e758c1700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e700cb950 con 0x7f6e70069bf0 2023-10-06T01:42:40.349 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.344+0000 7f6e67fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e70069fc0 0x7f6e70158a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:40.349 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.344+0000 7f6e67fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e70069fc0 0x7f6e70158a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:42872/0 (socket says 172.21.15.71:42872) 2023-10-06T01:42:40.349 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.344+0000 7f6e750c0700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6e700ae930 0x7f6e7015b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:40.349 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.344+0000 7f6e67fff700 1 -- 172.21.15.71:0/4211627435 learned_addr learned my addr 172.21.15.71:0/4211627435 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:40.350 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.344+0000 7f6e748bf700 1 --2- 172.21.15.71:0/4211627435 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6e70069bf0 0x7f6e70157d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:40.350 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.344+0000 7f6e67fff700 1 -- 172.21.15.71:0/4211627435 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6e70069bf0 msgr2=0x7f6e70157d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:40.350 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.344+0000 7f6e67fff700 1 --2- 172.21.15.71:0/4211627435 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6e70069bf0 0x7f6e70157d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:40.350 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.344+0000 7f6e67fff700 1 -- 172.21.15.71:0/4211627435 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6e700ae930 msgr2=0x7f6e7015b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:40.350 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.344+0000 7f6e67fff700 1 --2- 172.21.15.71:0/4211627435 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6e700ae930 0x7f6e7015b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:40.350 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.344+0000 7f6e67fff700 1 -- 172.21.15.71:0/4211627435 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e60009420 con 0x7f6e70069fc0 2023-10-06T01:42:40.350 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.344+0000 7f6e748bf700 1 --2- 172.21.15.71:0/4211627435 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6e70069bf0 0x7f6e70157d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:42:40.350 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.344+0000 7f6e750c0700 1 --2- 172.21.15.71:0/4211627435 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6e700ae930 0x7f6e7015b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:42:40.350 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.344+0000 7f6e67fff700 1 --2- 172.21.15.71:0/4211627435 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e70069fc0 0x7f6e70158a60 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f6e6000ec80 tx=0x7f6e600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:40.350 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.344+0000 7f6e64ff9700 1 -- 172.21.15.71:0/4211627435 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e6000c920 con 0x7f6e70069fc0 2023-10-06T01:42:40.350 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.344+0000 7f6e64ff9700 1 -- 172.21.15.71:0/4211627435 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e6000ca80 con 0x7f6e70069fc0 2023-10-06T01:42:40.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.344+0000 7f6e758c1700 1 -- 172.21.15.71:0/4211627435 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e6c009a20 con 0x7f6e70069fc0 2023-10-06T01:42:40.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.344+0000 7f6e64ff9700 1 -- 172.21.15.71:0/4211627435 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e6000ce00 con 0x7f6e70069fc0 2023-10-06T01:42:40.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.344+0000 7f6e758c1700 1 -- 172.21.15.71:0/4211627435 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e700cbf10 con 0x7f6e70069fc0 2023-10-06T01:42:40.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.345+0000 7f6e758c1700 1 -- 172.21.15.71:0/4211627435 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e700b18f0 con 0x7f6e70069fc0 2023-10-06T01:42:40.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.346+0000 7f6e64ff9700 1 -- 172.21.15.71:0/4211627435 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6e60013680 con 0x7f6e70069fc0 2023-10-06T01:42:40.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.346+0000 7f6e64ff9700 1 --2- 172.21.15.71:0/4211627435 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f6e5c066f30 0x7f6e5c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:40.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.346+0000 7f6e64ff9700 1 -- 172.21.15.71:0/4211627435 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f6e60084bd0 con 0x7f6e70069fc0 2023-10-06T01:42:40.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.346+0000 7f6e748bf700 1 --2- 172.21.15.71:0/4211627435 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f6e5c066f30 0x7f6e5c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:40.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.346+0000 7f6e748bf700 1 --2- 172.21.15.71:0/4211627435 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f6e5c066f30 0x7f6e5c0693e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6e6c009eb0 tx=0x7f6e6c019000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:40.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.350+0000 7f6e64ff9700 1 -- 172.21.15.71:0/4211627435 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6e60051b50 con 0x7f6e70069fc0 2023-10-06T01:42:40.577 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.575+0000 7f6e758c1700 1 -- 172.21.15.71:0/4211627435 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6e700cede0 con 0x7f6e70069fc0 2023-10-06T01:42:40.578 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.576+0000 7f6e64ff9700 1 -- 172.21.15.71:0/4211627435 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4595 (secure 0 0 0) 0x7f6e60055170 con 0x7f6e70069fc0 2023-10-06T01:42:40.578 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:42:40.578 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":39,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5171,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/3015768753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":3015768753},{"type":"v1","addr":"172.21.15.72:6835","nonce":3015768753}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5572,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6833/698854056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":698854056},{"type":"v1","addr":"172.21.15.72:6833","nonce":698854056}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":5811,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/2808450062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":2808450062},{"type":"v1","addr":"172.21.15.71:6835","nonce":2808450062}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T01:41:59.290125+0000","modified":"2023-10-06T01:42:38.037440+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":57,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5823},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5823":{"gid":5823,"name":"c","rank":0,"incarnation":36,"state":"up:active","state_seq":4,"addr":"172.21.15.71:6837/2318258263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":2318258263},{"type":"v1","addr":"172.21.15.71:6837","nonce":2318258263}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T01:42:40.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.578+0000 7f6e758c1700 1 -- 172.21.15.71:0/4211627435 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f6e5c066f30 msgr2=0x7f6e5c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:40.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.578+0000 7f6e758c1700 1 --2- 172.21.15.71:0/4211627435 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f6e5c066f30 0x7f6e5c0693e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6e6c009eb0 tx=0x7f6e6c019000 comp rx=0 tx=0).stop 2023-10-06T01:42:40.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.578+0000 7f6e758c1700 1 -- 172.21.15.71:0/4211627435 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e70069fc0 msgr2=0x7f6e70158a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:40.580 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.578+0000 7f6e758c1700 1 --2- 172.21.15.71:0/4211627435 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e70069fc0 0x7f6e70158a60 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f6e6000ec80 tx=0x7f6e600091a0 comp rx=0 tx=0).stop 2023-10-06T01:42:40.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.578+0000 7f6e758c1700 1 -- 172.21.15.71:0/4211627435 shutdown_connections 2023-10-06T01:42:40.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.578+0000 7f6e758c1700 1 --2- 172.21.15.71:0/4211627435 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f6e5c066f30 0x7f6e5c0693e0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:40.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.578+0000 7f6e758c1700 1 --2- 172.21.15.71:0/4211627435 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6e700ae930 0x7f6e7015b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:40.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.578+0000 7f6e758c1700 1 --2- 172.21.15.71:0/4211627435 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6e70069bf0 0x7f6e70157d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:40.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.578+0000 7f6e758c1700 1 --2- 172.21.15.71:0/4211627435 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e70069fc0 0x7f6e70158a60 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:40.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.578+0000 7f6e758c1700 1 -- 172.21.15.71:0/4211627435 >> 172.21.15.71:0/4211627435 conn(0x7f6e70067910 msgr2=0x7f6e701591d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:40.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.578+0000 7f6e758c1700 1 -- 172.21.15.71:0/4211627435 shutdown_connections 2023-10-06T01:42:40.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.578+0000 7f6e758c1700 1 -- 172.21.15.71:0/4211627435 wait complete. 2023-10-06T01:42:40.582 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 39 2023-10-06T01:42:40.592 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:42:40.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.705+0000 7fdd4a7d0700 1 Processor -- start 2023-10-06T01:42:40.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.705+0000 7fdd4a7d0700 1 -- start start 2023-10-06T01:42:40.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.706+0000 7fdd4a7d0700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fdd44159400 0x7fdd440ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:40.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.706+0000 7fdd4a7d0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd440cd030 0x7fdd440cfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:40.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.706+0000 7fdd4a7d0700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd440b3560 con 0x7fdd440cf1a0 2023-10-06T01:42:40.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.706+0000 7fdd4a7d0700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd440cf6f0 con 0x7fdd44159400 2023-10-06T01:42:40.709 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.706+0000 7fdd4a7d0700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd440cf9d0 con 0x7fdd440cd030 2023-10-06T01:42:40.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.706+0000 7fdd497ce700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fdd44159400 0x7fdd440ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:40.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.706+0000 7fdd497ce700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fdd44159400 0x7fdd440ccaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:42878/0 (socket says 172.21.15.71:42878) 2023-10-06T01:42:40.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.706+0000 7fdd497ce700 1 -- 172.21.15.71:0/1857572975 learned_addr learned my addr 172.21.15.71:0/1857572975 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:40.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.706+0000 7fdd48fcd700 1 --2- 172.21.15.71:0/1857572975 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd440cd030 0x7fdd440cfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:40.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.706+0000 7fdd497ce700 1 -- 172.21.15.71:0/1857572975 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd440cd030 msgr2=0x7fdd440cfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:40.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.706+0000 7fdd497ce700 1 --2- 172.21.15.71:0/1857572975 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd440cd030 0x7fdd440cfec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:40.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.706+0000 7fdd497ce700 1 -- 172.21.15.71:0/1857572975 >> v1:172.21.15.72:6789/0 conn(0x7fdd440cf1a0 legacy=0x7fdd440b5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:40.710 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.706+0000 7fdd497ce700 1 -- 172.21.15.71:0/1857572975 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd440b2f10 con 0x7fdd44159400 2023-10-06T01:42:40.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.706+0000 7fdd497ce700 1 --2- 172.21.15.71:0/1857572975 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd44159400 0x7fdd440ccaf0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fdd40009990 tx=0x7fdd40009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95712cd89cac24ea server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:40.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.707+0000 7fdd3bfff700 1 -- 172.21.15.71:0/1857572975 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd40005c10 con 0x7fdd44159400 2023-10-06T01:42:40.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.707+0000 7fdd3bfff700 1 -- 172.21.15.71:0/1857572975 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd40005d70 con 0x7fdd44159400 2023-10-06T01:42:40.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.707+0000 7fdd3bfff700 1 -- 172.21.15.71:0/1857572975 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4000b880 con 0x7fdd44159400 2023-10-06T01:42:40.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.707+0000 7fdd4a7d0700 1 -- 172.21.15.71:0/1857572975 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd44159400 msgr2=0x7fdd440ccaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:40.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.707+0000 7fdd4a7d0700 1 --2- 172.21.15.71:0/1857572975 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd44159400 0x7fdd440ccaf0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fdd40009990 tx=0x7fdd40009220 comp rx=0 tx=0).stop 2023-10-06T01:42:40.711 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.707+0000 7fdd4a7d0700 1 -- 172.21.15.71:0/1857572975 shutdown_connections 2023-10-06T01:42:40.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.707+0000 7fdd4a7d0700 1 --2- 172.21.15.71:0/1857572975 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd44159400 0x7fdd440ccaf0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:40.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.707+0000 7fdd4a7d0700 1 --2- 172.21.15.71:0/1857572975 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd440cd030 0x7fdd440cfec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:40.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.707+0000 7fdd4a7d0700 1 -- 172.21.15.71:0/1857572975 >> 172.21.15.71:0/1857572975 conn(0x7fdd4406ac10 msgr2=0x7fdd44068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:40.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.707+0000 7fdd4a7d0700 1 -- 172.21.15.71:0/1857572975 shutdown_connections 2023-10-06T01:42:40.712 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.707+0000 7fdd4a7d0700 1 -- 172.21.15.71:0/1857572975 wait complete. 2023-10-06T01:42:40.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.708+0000 7fdd4a7d0700 1 Processor -- start 2023-10-06T01:42:40.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.708+0000 7fdd4a7d0700 1 -- start start 2023-10-06T01:42:40.715 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.709+0000 7fdd4a7d0700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd440cd030 0x7fdd440cb730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:40.716 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.709+0000 7fdd4a7d0700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd440cf1a0 0x7fdd4414fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:40.716 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.709+0000 7fdd4a7d0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd44159400 0x7fdd440c59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:40.716 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.709+0000 7fdd4a7d0700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd4416bbd0 con 0x7fdd440cf1a0 2023-10-06T01:42:40.716 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.709+0000 7fdd4a7d0700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd4416afc0 con 0x7fdd440cd030 2023-10-06T01:42:40.716 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.709+0000 7fdd4a7d0700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd4416b2a0 con 0x7fdd44159400 2023-10-06T01:42:40.716 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.709+0000 7fdd48fcd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd440cf1a0 0x7fdd4414fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:40.716 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.709+0000 7fdd48fcd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd440cf1a0 0x7fdd4414fe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:42884/0 (socket says 172.21.15.71:42884) 2023-10-06T01:42:40.716 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.709+0000 7fdd48fcd700 1 -- 172.21.15.71:0/2070180387 learned_addr learned my addr 172.21.15.71:0/2070180387 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:40.717 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.709+0000 7fdd497ce700 1 --2- 172.21.15.71:0/2070180387 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd440cd030 0x7fdd440cb730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:40.717 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.709+0000 7fdd48fcd700 1 -- 172.21.15.71:0/2070180387 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd44159400 msgr2=0x7fdd440c59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:40.717 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.709+0000 7fdd48fcd700 1 --2- 172.21.15.71:0/2070180387 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd44159400 0x7fdd440c59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:40.717 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.709+0000 7fdd48fcd700 1 -- 172.21.15.71:0/2070180387 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd440cd030 msgr2=0x7fdd440cb730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:40.717 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.709+0000 7fdd48fcd700 1 --2- 172.21.15.71:0/2070180387 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd440cd030 0x7fdd440cb730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:40.717 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.709+0000 7fdd48fcd700 1 -- 172.21.15.71:0/2070180387 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd40009480 con 0x7fdd440cf1a0 2023-10-06T01:42:40.717 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.710+0000 7fdd48fcd700 1 --2- 172.21.15.71:0/2070180387 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd440cf1a0 0x7fdd4414fe30 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fdd3400d890 tx=0x7fdd34008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:40.718 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.710+0000 7fdd397fa700 1 -- 172.21.15.71:0/2070180387 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd3400b600 con 0x7fdd440cf1a0 2023-10-06T01:42:40.718 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.710+0000 7fdd397fa700 1 -- 172.21.15.71:0/2070180387 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd3400b760 con 0x7fdd440cf1a0 2023-10-06T01:42:40.718 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.710+0000 7fdd4a7d0700 1 -- 172.21.15.71:0/2070180387 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd4416b580 con 0x7fdd440cf1a0 2023-10-06T01:42:40.718 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.710+0000 7fdd397fa700 1 -- 172.21.15.71:0/2070180387 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd3400bae0 con 0x7fdd440cf1a0 2023-10-06T01:42:40.718 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.710+0000 7fdd4a7d0700 1 -- 172.21.15.71:0/2070180387 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd44150370 con 0x7fdd440cf1a0 2023-10-06T01:42:40.718 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.711+0000 7fdd4a7d0700 1 -- 172.21.15.71:0/2070180387 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd4416bd80 con 0x7fdd440cf1a0 2023-10-06T01:42:40.718 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.711+0000 7fdd397fa700 1 -- 172.21.15.71:0/2070180387 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdd3401e460 con 0x7fdd440cf1a0 2023-10-06T01:42:40.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.712+0000 7fdd397fa700 1 --2- 172.21.15.71:0/2070180387 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fdd28066f30 0x7fdd280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:40.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.712+0000 7fdd397fa700 1 -- 172.21.15.71:0/2070180387 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fdd34084f00 con 0x7fdd440cf1a0 2023-10-06T01:42:40.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.712+0000 7fdd497ce700 1 --2- 172.21.15.71:0/2070180387 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fdd28066f30 0x7fdd280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:40.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.712+0000 7fdd497ce700 1 --2- 172.21.15.71:0/2070180387 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fdd28066f30 0x7fdd280693e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fdd40009260 tx=0x7fdd40016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:40.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.716+0000 7fdd397fa700 1 -- 172.21.15.71:0/2070180387 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdd4416bd80 con 0x7fdd440cf1a0 2023-10-06T01:42:40.900 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.899+0000 7fdd4a7d0700 1 -- 172.21.15.71:0/2070180387 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdd44159860 con 0x7fdd440cf1a0 2023-10-06T01:42:40.901 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.900+0000 7fdd397fa700 1 -- 172.21.15.71:0/2070180387 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+17150 (secure 0 0 0) 0x7fdd34051e80 con 0x7fdd440cf1a0 2023-10-06T01:42:40.902 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:42:40.902 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":58,"fsid":"1fbf1bd2-f9b4-4599-bea2-f4aa920e9a56","created":"2023-10-06T01:39:57.016957+0000","modified":"2023-10-06T01:42:34.021528+0000","last_up_change":"2023-10-06T01:40:08.571643+0000","last_in_change":"2023-10-06T01:39:59.462741+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T01:40:08.610349+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T01:40:15.387434+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-06T01:41:56.925792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-06T01:41:58.259205+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cf059188-fb20-4dbf-95db-dcf57b213d03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":90670},{"type":"v1","addr":"172.21.15.71:6817","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":90670},{"type":"v1","addr":"172.21.15.71:6819","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":90670},{"type":"v1","addr":"172.21.15.71:6823","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":90670},{"type":"v1","addr":"172.21.15.71:6821","nonce":90670}]},"public_addr":"172.21.15.71:6817/90670","cluster_addr":"172.21.15.71:6819/90670","heartbeat_back_addr":"172.21.15.71:6823/90670","heartbeat_front_addr":"172.21.15.71:6821/90670","state":["exists","up"]},{"osd":1,"uuid":"0cff0aae-1799-4fe0-b610-54cf0813c0e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":90669},{"type":"v1","addr":"172.21.15.71:6809","nonce":90669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":90669},{"type":"v1","addr":"172.21.15.71:6811","nonce":90669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":90669},{"type":"v1","addr":"172.21.15.71:6815","nonce":90669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":90669},{"type":"v1","addr":"172.21.15.71:6813","nonce":90669}]},"public_addr":"172.21.15.71:6809/90669","cluster_addr":"172.21.15.71:6811/90669","heartbeat_back_addr":"172.21.15.71:6815/90669","heartbeat_front_addr":"172.21.15.71:6813/90669","state":["exists","up"]},{"osd":2,"uuid":"88d61ddc-9031-44e1-ba8c-546a41e7c8ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":90679},{"type":"v1","addr":"172.21.15.71:6825","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":90679},{"type":"v1","addr":"172.21.15.71:6827","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":90679},{"type":"v1","addr":"172.21.15.71:6831","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":90679},{"type":"v1","addr":"172.21.15.71:6829","nonce":90679}]},"public_addr":"172.21.15.71:6825/90679","cluster_addr":"172.21.15.71:6827/90679","heartbeat_back_addr":"172.21.15.71:6831/90679","heartbeat_front_addr":"172.21.15.71:6829/90679","state":["exists","up"]},{"osd":3,"uuid":"11ed92b7-960b-4a30-a889-a61d3eeb86f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":90668},{"type":"v1","addr":"172.21.15.71:6801","nonce":90668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":90668},{"type":"v1","addr":"172.21.15.71:6803","nonce":90668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":90668},{"type":"v1","addr":"172.21.15.71:6807","nonce":90668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":90668},{"type":"v1","addr":"172.21.15.71:6805","nonce":90668}]},"public_addr":"172.21.15.71:6801/90668","cluster_addr":"172.21.15.71:6803/90668","heartbeat_back_addr":"172.21.15.71:6807/90668","heartbeat_front_addr":"172.21.15.71:6805/90668","state":["exists","up"]},{"osd":4,"uuid":"ae4df784-abdf-4ddf-aefa-780f3ddafef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":90917},{"type":"v1","addr":"172.21.15.72:6801","nonce":90917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":90917},{"type":"v1","addr":"172.21.15.72:6803","nonce":90917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":90917},{"type":"v1","addr":"172.21.15.72:6807","nonce":90917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":90917},{"type":"v1","addr":"172.21.15.72:6805","nonce":90917}]},"public_addr":"172.21.15.72:6801/90917","cluster_addr":"172.21.15.72:6803/90917","heartbeat_back_addr":"172.21.15.72:6807/90917","heartbeat_front_addr":"172.21.15.72:6805/90917","state":["exists","up"]},{"osd":5,"uuid":"5ef0790f-001e-458f-a05b-efae216cf435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":90941},{"type":"v1","addr":"172.21.15.72:6817","nonce":90941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":90941},{"type":"v1","addr":"172.21.15.72:6819","nonce":90941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":90941},{"type":"v1","addr":"172.21.15.72:6827","nonce":90941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":90941},{"type":"v1","addr":"172.21.15.72:6823","nonce":90941}]},"public_addr":"172.21.15.72:6817/90941","cluster_addr":"172.21.15.72:6819/90941","heartbeat_back_addr":"172.21.15.72:6827/90941","heartbeat_front_addr":"172.21.15.72:6823/90941","state":["exists","up"]},{"osd":6,"uuid":"8705aef1-9ae8-4e54-a3c4-c2909fa0ceb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":90918},{"type":"v1","addr":"172.21.15.72:6809","nonce":90918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":90918},{"type":"v1","addr":"172.21.15.72:6811","nonce":90918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":90918},{"type":"v1","addr":"172.21.15.72:6815","nonce":90918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":90918},{"type":"v1","addr":"172.21.15.72:6813","nonce":90918}]},"public_addr":"172.21.15.72:6809/90918","cluster_addr":"172.21.15.72:6811/90918","heartbeat_back_addr":"172.21.15.72:6815/90918","heartbeat_front_addr":"172.21.15.72:6813/90918","state":["exists","up"]},{"osd":7,"uuid":"364c5119-6b13-4c75-b3f0-15e165eff86a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":90948},{"type":"v1","addr":"172.21.15.72:6822","nonce":90948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":90948},{"type":"v1","addr":"172.21.15.72:6826","nonce":90948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":90948},{"type":"v1","addr":"172.21.15.72:6831","nonce":90948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":90948},{"type":"v1","addr":"172.21.15.72:6829","nonce":90948}]},"public_addr":"172.21.15.72:6822/90948","cluster_addr":"172.21.15.72:6826/90948","heartbeat_back_addr":"172.21.15.72:6831/90948","heartbeat_front_addr":"172.21.15.72:6829/90948","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.642976+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.645372+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.619116+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.663042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.599163+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.646411+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.631545+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.669821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.72:6835/627948818":"2023-10-07T01:42:34.014707+0000","172.21.15.72:6833/627948818":"2023-10-07T01:42:34.014707+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:42:40.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.902+0000 7fdd4a7d0700 1 -- 172.21.15.71:0/2070180387 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fdd28066f30 msgr2=0x7fdd280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:40.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.902+0000 7fdd4a7d0700 1 --2- 172.21.15.71:0/2070180387 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fdd28066f30 0x7fdd280693e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fdd40009260 tx=0x7fdd40016000 comp rx=0 tx=0).stop 2023-10-06T01:42:40.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.902+0000 7fdd4a7d0700 1 -- 172.21.15.71:0/2070180387 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd440cf1a0 msgr2=0x7fdd4414fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:40.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.902+0000 7fdd4a7d0700 1 --2- 172.21.15.71:0/2070180387 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd440cf1a0 0x7fdd4414fe30 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fdd3400d890 tx=0x7fdd34008040 comp rx=0 tx=0).stop 2023-10-06T01:42:40.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.902+0000 7fdd4a7d0700 1 -- 172.21.15.71:0/2070180387 shutdown_connections 2023-10-06T01:42:40.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.902+0000 7fdd4a7d0700 1 --2- 172.21.15.71:0/2070180387 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd44159400 0x7fdd440c59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:40.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.902+0000 7fdd4a7d0700 1 --2- 172.21.15.71:0/2070180387 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fdd28066f30 0x7fdd280693e0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:40.904 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.902+0000 7fdd4a7d0700 1 --2- 172.21.15.71:0/2070180387 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd440cd030 0x7fdd440cb730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:40.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.902+0000 7fdd4a7d0700 1 --2- 172.21.15.71:0/2070180387 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdd440cf1a0 0x7fdd4414fe30 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:40.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.902+0000 7fdd4a7d0700 1 -- 172.21.15.71:0/2070180387 >> 172.21.15.71:0/2070180387 conn(0x7fdd4406ac10 msgr2=0x7fdd44156b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:40.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.902+0000 7fdd4a7d0700 1 -- 172.21.15.71:0/2070180387 shutdown_connections 2023-10-06T01:42:40.905 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:40.902+0000 7fdd4a7d0700 1 -- 172.21.15.71:0/2070180387 wait complete. 2023-10-06T01:42:40.916 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T01:40:08.610349+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T01:40:15.387434+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T01:41:56.925792+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T01:41:58.259205+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T01:42:40.917 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T01:42:41.025 INFO:tasks.ceph.mds.c.smithi071.stderr:2023-10-06T01:42:41.024+0000 7fd42fd80700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T01:42:41.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.032+0000 7fb73359e700 1 Processor -- start 2023-10-06T01:42:41.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.032+0000 7fb73359e700 1 -- start start 2023-10-06T01:42:41.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.033+0000 7fb73359e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb7340b0810 0x7fb734164160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:41.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.033+0000 7fb73359e700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7340af770 con 0x7fb7340cd400 2023-10-06T01:42:41.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.033+0000 7fb73359e700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7340afa50 con 0x7fb7340cd7d0 2023-10-06T01:42:41.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.033+0000 7fb73359e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7340afd30 con 0x7fb7340b0810 2023-10-06T01:42:41.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.033+0000 7fb73259c700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fb7340cd400 0x7fb7340b1f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:55364/0 (socket says 172.21.15.71:55364) 2023-10-06T01:42:41.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.033+0000 7fb73259c700 1 -- 172.21.15.71:0/103211996 learned_addr learned my addr 172.21.15.71:0/103211996 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:42:41.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.033+0000 7fb732d9d700 1 --2- 172.21.15.71:0/103211996 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb7340b0810 0x7fb734164160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:41.040 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.033+0000 7fb73159a700 1 -- 172.21.15.71:0/103211996 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3875555449 0 0) 0x7fb7340af770 con 0x7fb7340cd400 2023-10-06T01:42:41.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.033+0000 7fb73159a700 1 -- 172.21.15.71:0/103211996 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb720003570 con 0x7fb7340cd400 2023-10-06T01:42:41.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.033+0000 7fb73159a700 1 -- 172.21.15.71:0/103211996 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4094374413 0 0) 0x7fb7340afa50 con 0x7fb7340cd7d0 2023-10-06T01:42:41.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.033+0000 7fb73159a700 1 -- 172.21.15.71:0/103211996 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7340af770 con 0x7fb7340cd7d0 2023-10-06T01:42:41.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.033+0000 7fb73159a700 1 -- 172.21.15.71:0/103211996 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2668995518 0 0) 0x7fb720003570 con 0x7fb7340cd400 2023-10-06T01:42:41.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.033+0000 7fb73159a700 1 -- 172.21.15.71:0/103211996 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb7340b0810 msgr2=0x7fb734164160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:41.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.033+0000 7fb73159a700 1 --2- 172.21.15.71:0/103211996 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb7340b0810 0x7fb734164160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:41.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.033+0000 7fb73159a700 1 -- 172.21.15.71:0/103211996 >> v1:172.21.15.72:6789/0 conn(0x7fb7340cd7d0 legacy=0x7fb7340d01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:41.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.033+0000 7fb73159a700 1 -- 172.21.15.71:0/103211996 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7340b0010 con 0x7fb7340cd400 2023-10-06T01:42:41.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.033+0000 7fb73159a700 1 -- 172.21.15.71:0/103211996 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1184243524 0 0) 0x7fb72c0015f0 con 0x7fb7340cd400 2023-10-06T01:42:41.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.033+0000 7fb732d9d700 1 --2- 172.21.15.71:0/103211996 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb7340b0810 0x7fb734164160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:42:41.041 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.033+0000 7fb73159a700 1 -- 172.21.15.71:0/103211996 >> v1:172.21.15.71:6789/0 conn(0x7fb7340cd400 legacy=0x7fb7340b1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:41.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.033+0000 7fb73159a700 1 --2- 172.21.15.71:0/103211996 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb720003c20 0x7fb720004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:41.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.034+0000 7fb73159a700 1 --2- 172.21.15.71:0/103211996 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb7340b0810 0x7fb720004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:41.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.034+0000 7fb73159a700 1 --2- 172.21.15.71:0/103211996 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb720004d50 0x7fb7200051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:41.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.034+0000 7fb73159a700 1 -- 172.21.15.71:0/103211996 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7340afd30 con 0x7fb720003c20 2023-10-06T01:42:41.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.034+0000 7fb73159a700 1 -- 172.21.15.71:0/103211996 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb72000bbf0 con 0x7fb720004d50 2023-10-06T01:42:41.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.034+0000 7fb73159a700 1 -- 172.21.15.71:0/103211996 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb72000bd60 con 0x7fb7340b0810 2023-10-06T01:42:41.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.034+0000 7fb73259c700 1 --2- 172.21.15.71:0/103211996 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb720003c20 0x7fb720004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:41.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.034+0000 7fb731d9b700 1 --2- 172.21.15.71:0/103211996 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb7340b0810 0x7fb720004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:41.042 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.034+0000 7fb732d9d700 1 --2- 172.21.15.71:0/103211996 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb720004d50 0x7fb7200051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:41.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.034+0000 7fb73259c700 1 -- 172.21.15.71:0/103211996 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb7340b0810 msgr2=0x7fb720004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:41.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.034+0000 7fb73259c700 1 --2- 172.21.15.71:0/103211996 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb7340b0810 0x7fb720004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:41.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.034+0000 7fb73259c700 1 -- 172.21.15.71:0/103211996 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb720004d50 msgr2=0x7fb7200051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:41.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.034+0000 7fb73259c700 1 --2- 172.21.15.71:0/103211996 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb720004d50 0x7fb7200051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:41.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.034+0000 7fb73259c700 1 -- 172.21.15.71:0/103211996 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb724009a20 con 0x7fb720003c20 2023-10-06T01:42:41.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.034+0000 7fb732d9d700 1 --2- 172.21.15.71:0/103211996 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb720004d50 0x7fb7200051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:42:41.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.034+0000 7fb731d9b700 1 --2- 172.21.15.71:0/103211996 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb7340b0810 0x7fb720004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:42:41.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.034+0000 7fb73259c700 1 --2- 172.21.15.71:0/103211996 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb720003c20 0x7fb720004010 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fb72c00c2a0 tx=0x7fb72c0078a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9c425fcf2262d76 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:41.043 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.034+0000 7fb73159a700 1 -- 172.21.15.71:0/103211996 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72c00cb70 con 0x7fb720003c20 2023-10-06T01:42:41.044 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.034+0000 7fb73159a700 1 -- 172.21.15.71:0/103211996 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb72c00ccf0 con 0x7fb720003c20 2023-10-06T01:42:41.044 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.034+0000 7fb73159a700 1 -- 172.21.15.71:0/103211996 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72c007320 con 0x7fb720003c20 2023-10-06T01:42:41.044 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.035+0000 7fb73359e700 1 -- 172.21.15.71:0/103211996 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb720003c20 msgr2=0x7fb720004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:41.044 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.035+0000 7fb73359e700 1 --2- 172.21.15.71:0/103211996 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb720003c20 0x7fb720004010 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fb72c00c2a0 tx=0x7fb72c0078a0 comp rx=0 tx=0).stop 2023-10-06T01:42:41.044 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.035+0000 7fb732d9d700 1 -- 172.21.15.71:0/103211996 reap_dead start 2023-10-06T01:42:41.044 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.035+0000 7fb73359e700 1 -- 172.21.15.71:0/103211996 shutdown_connections 2023-10-06T01:42:41.044 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.035+0000 7fb73359e700 1 -- 172.21.15.71:0/103211996 >> 172.21.15.71:0/103211996 conn(0x7fb73406a110 msgr2=0x7fb73406a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:41.044 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.035+0000 7fb73359e700 1 -- 172.21.15.71:0/103211996 shutdown_connections 2023-10-06T01:42:41.044 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.035+0000 7fb73359e700 1 -- 172.21.15.71:0/103211996 wait complete. 2023-10-06T01:42:41.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.036+0000 7fb73359e700 1 Processor -- start 2023-10-06T01:42:41.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.036+0000 7fb73359e700 1 -- start start 2023-10-06T01:42:41.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.037+0000 7fb73359e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb720003c20 0x7fb7340b3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:41.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.037+0000 7fb73359e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb7340ced40 0x7fb734155070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:41.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.037+0000 7fb73359e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7341555b0 0x7fb734155a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:41.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.037+0000 7fb73359e700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb734153930 con 0x7fb7340ced40 2023-10-06T01:42:41.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.037+0000 7fb73359e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb734155f90 con 0x7fb7341555b0 2023-10-06T01:42:41.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.037+0000 7fb73359e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb734157320 con 0x7fb720003c20 2023-10-06T01:42:41.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.037+0000 7fb731d9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb7340ced40 0x7fb734155070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:41.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.037+0000 7fb731d9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb7340ced40 0x7fb734155070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:42890/0 (socket says 172.21.15.71:42890) 2023-10-06T01:42:41.045 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.037+0000 7fb731d9b700 1 -- 172.21.15.71:0/3680670742 learned_addr learned my addr 172.21.15.71:0/3680670742 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:41.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.037+0000 7fb73259c700 1 --2- 172.21.15.71:0/3680670742 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb720003c20 0x7fb7340b3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:41.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.037+0000 7fb732d9d700 1 --2- 172.21.15.71:0/3680670742 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7341555b0 0x7fb734155a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:41.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.037+0000 7fb731d9b700 1 -- 172.21.15.71:0/3680670742 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb720003c20 msgr2=0x7fb7340b3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:41.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.037+0000 7fb731d9b700 1 --2- 172.21.15.71:0/3680670742 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb720003c20 0x7fb7340b3f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:41.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.037+0000 7fb731d9b700 1 -- 172.21.15.71:0/3680670742 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7341555b0 msgr2=0x7fb734155a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:41.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.037+0000 7fb731d9b700 1 --2- 172.21.15.71:0/3680670742 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7341555b0 0x7fb734155a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:41.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.037+0000 7fb731d9b700 1 -- 172.21.15.71:0/3680670742 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7340b4590 con 0x7fb7340ced40 2023-10-06T01:42:41.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.037+0000 7fb731d9b700 1 --2- 172.21.15.71:0/3680670742 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb7340ced40 0x7fb734155070 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fb71c000c00 tx=0x7fb71c009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:41.046 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.037+0000 7fb72a7fc700 1 -- 172.21.15.71:0/3680670742 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb71c0026a0 con 0x7fb7340ced40 2023-10-06T01:42:41.047 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.037+0000 7fb72a7fc700 1 -- 172.21.15.71:0/3680670742 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb71c002800 con 0x7fb7340ced40 2023-10-06T01:42:41.047 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.037+0000 7fb73359e700 1 -- 172.21.15.71:0/3680670742 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7340b4870 con 0x7fb7340ced40 2023-10-06T01:42:41.047 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.037+0000 7fb72a7fc700 1 -- 172.21.15.71:0/3680670742 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb71c002bc0 con 0x7fb7340ced40 2023-10-06T01:42:41.047 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.037+0000 7fb73359e700 1 -- 172.21.15.71:0/3680670742 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7340b4e30 con 0x7fb7340ced40 2023-10-06T01:42:41.047 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.038+0000 7fb73359e700 1 -- 172.21.15.71:0/3680670742 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb734157540 con 0x7fb7340ced40 2023-10-06T01:42:41.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.039+0000 7fb72a7fc700 1 -- 172.21.15.71:0/3680670742 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb71c014480 con 0x7fb7340ced40 2023-10-06T01:42:41.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.039+0000 7fb72a7fc700 1 --2- 172.21.15.71:0/3680670742 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fb714066f30 0x7fb7140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:41.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.039+0000 7fb73259c700 1 --2- 172.21.15.71:0/3680670742 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fb714066f30 0x7fb7140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:41.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.039+0000 7fb72a7fc700 1 -- 172.21.15.71:0/3680670742 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fb71c0847e0 con 0x7fb7340ced40 2023-10-06T01:42:41.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.039+0000 7fb73259c700 1 --2- 172.21.15.71:0/3680670742 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fb714066f30 0x7fb7140693e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fb72c000ef0 tx=0x7fb72c015000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:41.048 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.043+0000 7fb72a7fc700 1 -- 172.21.15.71:0/3680670742 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb71c04d5a0 con 0x7fb7340ced40 2023-10-06T01:42:41.229 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.227+0000 7fb73359e700 1 -- 172.21.15.71:0/3680670742 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb734064aa0 con 0x7fb7340ced40 2023-10-06T01:42:41.230 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.228+0000 7fb72a7fc700 1 -- 172.21.15.71:0/3680670742 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v58) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb734157540 con 0x7fb7340ced40 2023-10-06T01:42:41.230 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 1 2023-10-06T01:42:41.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.230+0000 7fb73359e700 1 -- 172.21.15.71:0/3680670742 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fb714066f30 msgr2=0x7fb7140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:41.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.230+0000 7fb73359e700 1 --2- 172.21.15.71:0/3680670742 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fb714066f30 0x7fb7140693e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fb72c000ef0 tx=0x7fb72c015000 comp rx=0 tx=0).stop 2023-10-06T01:42:41.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.230+0000 7fb73359e700 1 -- 172.21.15.71:0/3680670742 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb7340ced40 msgr2=0x7fb734155070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:41.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.230+0000 7fb73359e700 1 --2- 172.21.15.71:0/3680670742 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb7340ced40 0x7fb734155070 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fb71c000c00 tx=0x7fb71c009040 comp rx=0 tx=0).stop 2023-10-06T01:42:41.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.230+0000 7fb73359e700 1 -- 172.21.15.71:0/3680670742 shutdown_connections 2023-10-06T01:42:41.232 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.230+0000 7fb73359e700 1 --2- 172.21.15.71:0/3680670742 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fb714066f30 0x7fb7140693e0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:41.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.230+0000 7fb73359e700 1 --2- 172.21.15.71:0/3680670742 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7341555b0 0x7fb734155a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:41.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.230+0000 7fb73359e700 1 --2- 172.21.15.71:0/3680670742 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb720003c20 0x7fb7340b3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:41.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.230+0000 7fb73359e700 1 --2- 172.21.15.71:0/3680670742 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb7340ced40 0x7fb734155070 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:41.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.230+0000 7fb73359e700 1 -- 172.21.15.71:0/3680670742 >> 172.21.15.71:0/3680670742 conn(0x7fb73406a110 msgr2=0x7fb73415f930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:41.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.230+0000 7fb73359e700 1 -- 172.21.15.71:0/3680670742 shutdown_connections 2023-10-06T01:42:41.233 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.230+0000 7fb73359e700 1 -- 172.21.15.71:0/3680670742 wait complete. 2023-10-06T01:42:41.244 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T01:42:41.361 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.359+0000 7fcf2ae32700 1 Processor -- start 2023-10-06T01:42:41.361 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.359+0000 7fcf2ae32700 1 -- start start 2023-10-06T01:42:41.363 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.359+0000 7fcf2ae32700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcf240d0400 0x7fcf240b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:41.363 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.359+0000 7fcf2ae32700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fcf240ccd40 0x7fcf240cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:41.363 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.359+0000 7fcf2ae32700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf240b6170 con 0x7fcf240cf7e0 2023-10-06T01:42:41.363 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.359+0000 7fcf2ae32700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf2415dd40 con 0x7fcf240ccd40 2023-10-06T01:42:41.363 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.360+0000 7fcf2ae32700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2415e020 con 0x7fcf240d0400 2023-10-06T01:42:41.363 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.360+0000 7fcf1bfff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fcf240ccd40 0x7fcf240cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:41.364 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.360+0000 7fcf1bfff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fcf240ccd40 0x7fcf240cf2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:42900/0 (socket says 172.21.15.71:42900) 2023-10-06T01:42:41.364 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.360+0000 7fcf1bfff700 1 -- 172.21.15.71:0/2760243843 learned_addr learned my addr 172.21.15.71:0/2760243843 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:41.364 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.360+0000 7fcf28bce700 1 --2- 172.21.15.71:0/2760243843 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcf240d0400 0x7fcf240b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:41.364 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.360+0000 7fcf1bfff700 1 -- 172.21.15.71:0/2760243843 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcf240d0400 msgr2=0x7fcf240b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:41.364 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.360+0000 7fcf1bfff700 1 --2- 172.21.15.71:0/2760243843 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcf240d0400 0x7fcf240b5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:41.364 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.360+0000 7fcf1bfff700 1 -- 172.21.15.71:0/2760243843 >> v1:172.21.15.72:6789/0 conn(0x7fcf240cf7e0 legacy=0x7fcf240b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:41.364 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.360+0000 7fcf1bfff700 1 -- 172.21.15.71:0/2760243843 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf240ceaa0 con 0x7fcf240ccd40 2023-10-06T01:42:41.364 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.360+0000 7fcf28bce700 1 --2- 172.21.15.71:0/2760243843 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcf240d0400 0x7fcf240b5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:42:41.364 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.360+0000 7fcf1bfff700 1 --2- 172.21.15.71:0/2760243843 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcf240ccd40 0x7fcf240cf2a0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fcf140099b0 tx=0x7fcf14009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d197f8495a05b5c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:41.364 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.360+0000 7fcf1b7fe700 1 -- 172.21.15.71:0/2760243843 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1400b860 con 0x7fcf240ccd40 2023-10-06T01:42:41.364 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.360+0000 7fcf1b7fe700 1 -- 172.21.15.71:0/2760243843 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf1400b9c0 con 0x7fcf240ccd40 2023-10-06T01:42:41.364 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.360+0000 7fcf1b7fe700 1 -- 172.21.15.71:0/2760243843 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1400bd60 con 0x7fcf240ccd40 2023-10-06T01:42:41.365 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.361+0000 7fcf2ae32700 1 -- 172.21.15.71:0/2760243843 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcf240ccd40 msgr2=0x7fcf240cf2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:41.365 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.361+0000 7fcf2ae32700 1 --2- 172.21.15.71:0/2760243843 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcf240ccd40 0x7fcf240cf2a0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fcf140099b0 tx=0x7fcf14009250 comp rx=0 tx=0).stop 2023-10-06T01:42:41.365 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.361+0000 7fcf2ae32700 1 -- 172.21.15.71:0/2760243843 shutdown_connections 2023-10-06T01:42:41.365 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.361+0000 7fcf2ae32700 1 --2- 172.21.15.71:0/2760243843 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcf240d0400 0x7fcf240b5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:41.365 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.361+0000 7fcf2ae32700 1 --2- 172.21.15.71:0/2760243843 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcf240ccd40 0x7fcf240cf2a0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:41.365 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.361+0000 7fcf2ae32700 1 -- 172.21.15.71:0/2760243843 >> 172.21.15.71:0/2760243843 conn(0x7fcf2406a220 msgr2=0x7fcf2406a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:41.365 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.361+0000 7fcf2ae32700 1 -- 172.21.15.71:0/2760243843 shutdown_connections 2023-10-06T01:42:41.365 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.361+0000 7fcf2ae32700 1 -- 172.21.15.71:0/2760243843 wait complete. 2023-10-06T01:42:41.368 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.362+0000 7fcf2ae32700 1 Processor -- start 2023-10-06T01:42:41.368 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.362+0000 7fcf2ae32700 1 -- start start 2023-10-06T01:42:41.368 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.363+0000 7fcf2ae32700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcf240ccd40 0x7fcf2416de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:41.368 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.363+0000 7fcf2ae32700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf240cf7e0 0x7fcf2414bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:41.368 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.363+0000 7fcf2ae32700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcf240d0400 0x7fcf2414dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:41.368 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.363+0000 7fcf2ae32700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2414d5c0 con 0x7fcf240ccd40 2023-10-06T01:42:41.368 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.363+0000 7fcf2ae32700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2416e3c0 con 0x7fcf240cf7e0 2023-10-06T01:42:41.368 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.363+0000 7fcf2ae32700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2414c520 con 0x7fcf240d0400 2023-10-06T01:42:41.368 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.363+0000 7fcf28bce700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcf240ccd40 0x7fcf2416de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:41.368 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.363+0000 7fcf28bce700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcf240ccd40 0x7fcf2416de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:42902/0 (socket says 172.21.15.71:42902) 2023-10-06T01:42:41.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.363+0000 7fcf28bce700 1 -- 172.21.15.71:0/2132004325 learned_addr learned my addr 172.21.15.71:0/2132004325 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:41.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.363+0000 7fcf1bfff700 1 --2- 172.21.15.71:0/2132004325 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf240cf7e0 0x7fcf2414bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:41.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.363+0000 7fcf293cf700 1 --2- 172.21.15.71:0/2132004325 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcf240d0400 0x7fcf2414dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:41.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.363+0000 7fcf28bce700 1 -- 172.21.15.71:0/2132004325 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcf240d0400 msgr2=0x7fcf2414dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:41.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.363+0000 7fcf28bce700 1 --2- 172.21.15.71:0/2132004325 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcf240d0400 0x7fcf2414dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:41.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.363+0000 7fcf28bce700 1 -- 172.21.15.71:0/2132004325 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf240cf7e0 msgr2=0x7fcf2414bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:41.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.363+0000 7fcf28bce700 1 --2- 172.21.15.71:0/2132004325 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf240cf7e0 0x7fcf2414bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:41.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.363+0000 7fcf28bce700 1 -- 172.21.15.71:0/2132004325 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf140094f0 con 0x7fcf240ccd40 2023-10-06T01:42:41.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.363+0000 7fcf1bfff700 1 --2- 172.21.15.71:0/2132004325 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf240cf7e0 0x7fcf2414bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:42:41.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.363+0000 7fcf28bce700 1 --2- 172.21.15.71:0/2132004325 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcf240ccd40 0x7fcf2416de80 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fcf2000a300 tx=0x7fcf200078c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:41.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.364+0000 7fcf18ff9700 1 -- 172.21.15.71:0/2132004325 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf20015440 con 0x7fcf240ccd40 2023-10-06T01:42:41.369 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.364+0000 7fcf18ff9700 1 -- 172.21.15.71:0/2132004325 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf200155a0 con 0x7fcf240ccd40 2023-10-06T01:42:41.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.364+0000 7fcf2ae32700 1 -- 172.21.15.71:0/2132004325 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf2414c800 con 0x7fcf240ccd40 2023-10-06T01:42:41.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.364+0000 7fcf18ff9700 1 -- 172.21.15.71:0/2132004325 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf20015940 con 0x7fcf240ccd40 2023-10-06T01:42:41.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.364+0000 7fcf2ae32700 1 -- 172.21.15.71:0/2132004325 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf2414cdc0 con 0x7fcf240ccd40 2023-10-06T01:42:41.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.365+0000 7fcf2ae32700 1 -- 172.21.15.71:0/2132004325 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf24088760 con 0x7fcf240ccd40 2023-10-06T01:42:41.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.365+0000 7fcf18ff9700 1 -- 172.21.15.71:0/2132004325 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcf20015cb0 con 0x7fcf240ccd40 2023-10-06T01:42:41.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.365+0000 7fcf18ff9700 1 --2- 172.21.15.71:0/2132004325 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fcf10066f30 0x7fcf100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:41.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.365+0000 7fcf18ff9700 1 -- 172.21.15.71:0/2132004325 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fcf20084eb0 con 0x7fcf240ccd40 2023-10-06T01:42:41.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.365+0000 7fcf1bfff700 1 --2- 172.21.15.71:0/2132004325 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fcf10066f30 0x7fcf100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:41.370 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.366+0000 7fcf1bfff700 1 --2- 172.21.15.71:0/2132004325 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fcf10066f30 0x7fcf100693e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fcf140099b0 tx=0x7fcf14017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:41.371 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.369+0000 7fcf18ff9700 1 -- 172.21.15.71:0/2132004325 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcf2004e5a0 con 0x7fcf240ccd40 2023-10-06T01:42:41.551 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.549+0000 7fcf2ae32700 1 -- 172.21.15.71:0/2132004325 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fcf24068420 con 0x7fcf240ccd40 2023-10-06T01:42:41.552 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.550+0000 7fcf18ff9700 1 -- 172.21.15.71:0/2132004325 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v58) v1 ==== 92+0+10 (secure 0 0 0) 0x7fcf2001a020 con 0x7fcf240ccd40 2023-10-06T01:42:41.552 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 8 2023-10-06T01:42:41.554 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.552+0000 7fcf2ae32700 1 -- 172.21.15.71:0/2132004325 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fcf10066f30 msgr2=0x7fcf100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:41.554 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.552+0000 7fcf2ae32700 1 --2- 172.21.15.71:0/2132004325 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fcf10066f30 0x7fcf100693e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fcf140099b0 tx=0x7fcf14017000 comp rx=0 tx=0).stop 2023-10-06T01:42:41.554 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.552+0000 7fcf2ae32700 1 -- 172.21.15.71:0/2132004325 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcf240ccd40 msgr2=0x7fcf2416de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:41.554 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.552+0000 7fcf2ae32700 1 --2- 172.21.15.71:0/2132004325 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcf240ccd40 0x7fcf2416de80 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fcf2000a300 tx=0x7fcf200078c0 comp rx=0 tx=0).stop 2023-10-06T01:42:41.554 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.552+0000 7fcf2ae32700 1 -- 172.21.15.71:0/2132004325 shutdown_connections 2023-10-06T01:42:41.554 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.552+0000 7fcf2ae32700 1 --2- 172.21.15.71:0/2132004325 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcf240d0400 0x7fcf2414dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:41.554 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.552+0000 7fcf2ae32700 1 --2- 172.21.15.71:0/2132004325 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcf240ccd40 0x7fcf2416de80 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:41.554 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.552+0000 7fcf2ae32700 1 --2- 172.21.15.71:0/2132004325 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fcf10066f30 0x7fcf100693e0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:41.555 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.552+0000 7fcf2ae32700 1 --2- 172.21.15.71:0/2132004325 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf240cf7e0 0x7fcf2414bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:41.555 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.552+0000 7fcf2ae32700 1 -- 172.21.15.71:0/2132004325 >> 172.21.15.71:0/2132004325 conn(0x7fcf2406a220 msgr2=0x7fcf24154780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:41.555 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.552+0000 7fcf2ae32700 1 -- 172.21.15.71:0/2132004325 shutdown_connections 2023-10-06T01:42:41.555 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.552+0000 7fcf2ae32700 1 -- 172.21.15.71:0/2132004325 wait complete. 2023-10-06T01:42:41.565 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T01:42:41.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.681+0000 7f4ffbdce700 1 Processor -- start 2023-10-06T01:42:41.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.681+0000 7f4ffbdce700 1 -- start start 2023-10-06T01:42:41.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.682+0000 7f4ffbdce700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4ff40d07d0 0x7f4ff40b3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:41.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.682+0000 7f4ffbdce700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ff415dd40 con 0x7f4ff40ccd40 2023-10-06T01:42:41.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.682+0000 7f4ffbdce700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ff415e020 con 0x7f4ff40d0400 2023-10-06T01:42:41.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.682+0000 7f4ffbdce700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ff40ceaa0 con 0x7f4ff40d07d0 2023-10-06T01:42:41.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.682+0000 7f4ffa36b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4ff40d07d0 0x7f4ff40b3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:41.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.682+0000 7f4ff9369700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f4ff40ccd40 0x7f4ff40cf2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:55368/0 (socket says 172.21.15.71:55368) 2023-10-06T01:42:41.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.682+0000 7f4ff9369700 1 -- 172.21.15.71:0/371384226 learned_addr learned my addr 172.21.15.71:0/371384226 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:42:41.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.683+0000 7f4ffa36b700 1 -- 172.21.15.71:0/371384226 >> v1:172.21.15.72:6789/0 conn(0x7f4ff40d0400 legacy=0x7f4ff40b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:41.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.683+0000 7f4ffa36b700 1 -- 172.21.15.71:0/371384226 >> v1:172.21.15.71:6789/0 conn(0x7f4ff40ccd40 legacy=0x7f4ff40cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:41.685 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.683+0000 7f4ffa36b700 1 -- 172.21.15.71:0/371384226 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ff40ced80 con 0x7f4ff40d07d0 2023-10-06T01:42:41.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.683+0000 7f4ff8b68700 1 -- 172.21.15.71:0/371384226 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3266001732 0 0) 0x7f4ff415dd40 con 0x7f4ff40ccd40 2023-10-06T01:42:41.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.683+0000 7f4ffa36b700 1 --2- 172.21.15.71:0/371384226 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4ff40d07d0 0x7f4ff40b3aa0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f4fec009e60 tx=0x7f4fec009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ede9b9665f72d14e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:41.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.683+0000 7f4ff8b68700 1 -- 172.21.15.71:0/371384226 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fec00e070 con 0x7f4ff40d07d0 2023-10-06T01:42:41.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.683+0000 7f4ff8b68700 1 -- 172.21.15.71:0/371384226 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fec00bc30 con 0x7f4ff40d07d0 2023-10-06T01:42:41.686 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.683+0000 7f4ff8b68700 1 -- 172.21.15.71:0/371384226 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fec012430 con 0x7f4ff40d07d0 2023-10-06T01:42:41.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.683+0000 7f4ffbdce700 1 -- 172.21.15.71:0/371384226 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4ff40d07d0 msgr2=0x7f4ff40b3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:41.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.683+0000 7f4ffbdce700 1 --2- 172.21.15.71:0/371384226 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4ff40d07d0 0x7f4ff40b3aa0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f4fec009e60 tx=0x7f4fec009780 comp rx=0 tx=0).stop 2023-10-06T01:42:41.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.683+0000 7f4ffbdce700 1 -- 172.21.15.71:0/371384226 shutdown_connections 2023-10-06T01:42:41.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.683+0000 7f4ffbdce700 1 --2- 172.21.15.71:0/371384226 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4ff40d07d0 0x7f4ff40b3aa0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:41.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.683+0000 7f4ffbdce700 1 -- 172.21.15.71:0/371384226 >> 172.21.15.71:0/371384226 conn(0x7f4ff406a220 msgr2=0x7f4ff406a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:41.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.684+0000 7f4ffbdce700 1 -- 172.21.15.71:0/371384226 shutdown_connections 2023-10-06T01:42:41.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.684+0000 7f4ffbdce700 1 -- 172.21.15.71:0/371384226 wait complete. 2023-10-06T01:42:41.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.685+0000 7f4ffbdce700 1 Processor -- start 2023-10-06T01:42:41.690 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.685+0000 7f4ffbdce700 1 -- start start 2023-10-06T01:42:41.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.685+0000 7f4ffbdce700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4ff40ccd40 0x7f4ff416cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:41.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.685+0000 7f4ffbdce700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ff40d0400 0x7f4ff40b1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:41.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.685+0000 7f4ffbdce700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4ff40d07d0 0x7f4ff40b1b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:41.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.685+0000 7f4ffbdce700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff416ada0 con 0x7f4ff40d07d0 2023-10-06T01:42:41.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.685+0000 7f4ffbdce700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff415b000 con 0x7f4ff40d0400 2023-10-06T01:42:41.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.685+0000 7f4ffbdce700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff415b2e0 con 0x7f4ff40ccd40 2023-10-06T01:42:41.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.685+0000 7f4ffa36b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4ff40d07d0 0x7f4ff40b1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:41.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.685+0000 7f4ffa36b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4ff40d07d0 0x7f4ff40b1b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:42912/0 (socket says 172.21.15.71:42912) 2023-10-06T01:42:41.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.686+0000 7f4ffa36b700 1 -- 172.21.15.71:0/2530815112 learned_addr learned my addr 172.21.15.71:0/2530815112 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:41.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.686+0000 7f4ff9b6a700 1 --2- 172.21.15.71:0/2530815112 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4ff40ccd40 0x7f4ff416cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:41.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.686+0000 7f4ff9369700 1 --2- 172.21.15.71:0/2530815112 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ff40d0400 0x7f4ff40b1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:41.691 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.686+0000 7f4ffa36b700 1 -- 172.21.15.71:0/2530815112 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4ff40ccd40 msgr2=0x7f4ff416cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:41.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.686+0000 7f4ffa36b700 1 --2- 172.21.15.71:0/2530815112 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4ff40ccd40 0x7f4ff416cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:41.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.686+0000 7f4ffa36b700 1 -- 172.21.15.71:0/2530815112 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ff40d0400 msgr2=0x7f4ff40b1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:41.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.686+0000 7f4ffa36b700 1 --2- 172.21.15.71:0/2530815112 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ff40d0400 0x7f4ff40b1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:41.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.686+0000 7f4ffa36b700 1 -- 172.21.15.71:0/2530815112 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fec009a20 con 0x7f4ff40d07d0 2023-10-06T01:42:41.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.686+0000 7f4ff9b6a700 1 --2- 172.21.15.71:0/2530815112 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4ff40ccd40 0x7f4ff416cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:42:41.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.686+0000 7f4ff9369700 1 --2- 172.21.15.71:0/2530815112 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ff40d0400 0x7f4ff40b1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:42:41.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.686+0000 7f4ffa36b700 1 --2- 172.21.15.71:0/2530815112 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4ff40d07d0 0x7f4ff40b1b90 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f4fec013000 tx=0x7f4fec019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:41.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.686+0000 7f4fe9ffb700 1 -- 172.21.15.71:0/2530815112 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fec01b630 con 0x7f4ff40d07d0 2023-10-06T01:42:41.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.686+0000 7f4fe9ffb700 1 -- 172.21.15.71:0/2530815112 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fec01b790 con 0x7f4ff40d07d0 2023-10-06T01:42:41.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.686+0000 7f4ffbdce700 1 -- 172.21.15.71:0/2530815112 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ff415b5c0 con 0x7f4ff40d07d0 2023-10-06T01:42:41.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.686+0000 7f4fe9ffb700 1 -- 172.21.15.71:0/2530815112 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fec01bb30 con 0x7f4ff40d07d0 2023-10-06T01:42:41.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.686+0000 7f4ffbdce700 1 -- 172.21.15.71:0/2530815112 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ff416d0b0 con 0x7f4ff40d07d0 2023-10-06T01:42:41.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.687+0000 7f4ffbdce700 1 -- 172.21.15.71:0/2530815112 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ff4088760 con 0x7f4ff40d07d0 2023-10-06T01:42:41.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.688+0000 7f4fe9ffb700 1 -- 172.21.15.71:0/2530815112 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4fec01c400 con 0x7f4ff40d07d0 2023-10-06T01:42:41.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.688+0000 7f4fe9ffb700 1 --2- 172.21.15.71:0/2530815112 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f4fd8066f30 0x7f4fd80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:41.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.688+0000 7f4fe9ffb700 1 -- 172.21.15.71:0/2530815112 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f4fec086760 con 0x7f4ff40d07d0 2023-10-06T01:42:41.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.688+0000 7f4ff9b6a700 1 --2- 172.21.15.71:0/2530815112 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f4fd8066f30 0x7f4fd80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:41.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.688+0000 7f4ff9b6a700 1 --2- 172.21.15.71:0/2530815112 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f4fd8066f30 0x7f4fd80693e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f4ff0001870 tx=0x7f4ff0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:41.693 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.692+0000 7f4fe9ffb700 1 -- 172.21.15.71:0/2530815112 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4fec0536e0 con 0x7f4ff40d07d0 2023-10-06T01:42:41.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.874+0000 7f4ffbdce700 1 -- 172.21.15.71:0/2530815112 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4ff40ce6c0 con 0x7f4ff40d07d0 2023-10-06T01:42:41.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.874+0000 7f4fe9ffb700 1 -- 172.21.15.71:0/2530815112 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v58) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4fec009880 con 0x7f4ff40d07d0 2023-10-06T01:42:41.876 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 32 2023-10-06T01:42:41.878 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.876+0000 7f4ffbdce700 1 -- 172.21.15.71:0/2530815112 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f4fd8066f30 msgr2=0x7f4fd80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:41.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.876+0000 7f4ffbdce700 1 --2- 172.21.15.71:0/2530815112 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f4fd8066f30 0x7f4fd80693e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f4ff0001870 tx=0x7f4ff0009040 comp rx=0 tx=0).stop 2023-10-06T01:42:41.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.876+0000 7f4ffbdce700 1 -- 172.21.15.71:0/2530815112 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4ff40d07d0 msgr2=0x7f4ff40b1b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:41.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.876+0000 7f4ffbdce700 1 --2- 172.21.15.71:0/2530815112 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4ff40d07d0 0x7f4ff40b1b90 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f4fec013000 tx=0x7f4fec019000 comp rx=0 tx=0).stop 2023-10-06T01:42:41.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.876+0000 7f4ffbdce700 1 -- 172.21.15.71:0/2530815112 shutdown_connections 2023-10-06T01:42:41.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.876+0000 7f4ffbdce700 1 --2- 172.21.15.71:0/2530815112 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4ff40d07d0 0x7f4ff40b1b90 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:41.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.876+0000 7f4ffbdce700 1 --2- 172.21.15.71:0/2530815112 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4ff40ccd40 0x7f4ff416cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:41.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.876+0000 7f4ffbdce700 1 --2- 172.21.15.71:0/2530815112 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f4fd8066f30 0x7f4fd80693e0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:41.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.876+0000 7f4ffbdce700 1 --2- 172.21.15.71:0/2530815112 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ff40d0400 0x7f4ff40b1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:41.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.876+0000 7f4ffbdce700 1 -- 172.21.15.71:0/2530815112 >> 172.21.15.71:0/2530815112 conn(0x7f4ff406a220 msgr2=0x7f4ff40b57f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:41.879 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.877+0000 7f4ffbdce700 1 -- 172.21.15.71:0/2530815112 shutdown_connections 2023-10-06T01:42:41.880 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:41.877+0000 7f4ffbdce700 1 -- 172.21.15.71:0/2530815112 wait complete. 2023-10-06T01:42:41.890 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T01:42:42.007 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.006+0000 7f776d1fc700 1 Processor -- start 2023-10-06T01:42:42.008 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.006+0000 7f776d1fc700 1 -- start start 2023-10-06T01:42:42.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.006+0000 7f776d1fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f77680afb20 0x7f77680aeed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:42.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.006+0000 7f776d1fc700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f77680afef0 0x7f776806ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:42.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.007+0000 7f776d1fc700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77680af410 con 0x7f7768156060 2023-10-06T01:42:42.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.007+0000 7f776d1fc700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7768150540 con 0x7f77680afef0 2023-10-06T01:42:42.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.007+0000 7f776d1fc700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7768157040 con 0x7f77680afb20 2023-10-06T01:42:42.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.007+0000 7f776759e700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f77680afef0 0x7f776806ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:42.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.007+0000 7f776759e700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f77680afef0 0x7f776806ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:42918/0 (socket says 172.21.15.71:42918) 2023-10-06T01:42:42.010 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.007+0000 7f776759e700 1 -- 172.21.15.71:0/1401809079 learned_addr learned my addr 172.21.15.71:0/1401809079 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:42.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.007+0000 7f7766d9d700 1 --2- 172.21.15.71:0/1401809079 >> v2:172.21.15.72:3300/0 conn(0x7f77680afb20 0x7f77680aeed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:42.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.007+0000 7f776759e700 1 -- 172.21.15.71:0/1401809079 >> v2:172.21.15.72:3300/0 conn(0x7f77680afb20 msgr2=0x7f77680aeed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:42.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.007+0000 7f776759e700 1 --2- 172.21.15.71:0/1401809079 >> v2:172.21.15.72:3300/0 conn(0x7f77680afb20 0x7f77680aeed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:42.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.007+0000 7f776759e700 1 -- 172.21.15.71:0/1401809079 >> v1:172.21.15.72:6789/0 conn(0x7f7768156060 legacy=0x7f776806bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:42.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.007+0000 7f776759e700 1 -- 172.21.15.71:0/1401809079 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f776806c270 con 0x7f77680afef0 2023-10-06T01:42:42.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.007+0000 7f776759e700 1 --2- 172.21.15.71:0/1401809079 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f77680afef0 0x7f776806ed60 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f7768069ee0 tx=0x7f776000b4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=523179139343550b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:42.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.007+0000 7f7765d9b700 1 -- 172.21.15.71:0/1401809079 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f776000dad0 con 0x7f77680afef0 2023-10-06T01:42:42.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.007+0000 7f7765d9b700 1 -- 172.21.15.71:0/1401809079 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f776000dc30 con 0x7f77680afef0 2023-10-06T01:42:42.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.007+0000 7f7765d9b700 1 -- 172.21.15.71:0/1401809079 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7760017410 con 0x7f77680afef0 2023-10-06T01:42:42.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.008+0000 7f776d1fc700 1 -- 172.21.15.71:0/1401809079 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f77680afef0 msgr2=0x7f776806ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:42.011 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.008+0000 7f776d1fc700 1 --2- 172.21.15.71:0/1401809079 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f77680afef0 0x7f776806ed60 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f7768069ee0 tx=0x7f776000b4e0 comp rx=0 tx=0).stop 2023-10-06T01:42:42.012 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.008+0000 7f776d1fc700 1 -- 172.21.15.71:0/1401809079 shutdown_connections 2023-10-06T01:42:42.012 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.008+0000 7f776d1fc700 1 --2- 172.21.15.71:0/1401809079 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f77680afef0 0x7f776806ed60 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:42.012 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.008+0000 7f776d1fc700 1 --2- 172.21.15.71:0/1401809079 >> v2:172.21.15.72:3300/0 conn(0x7f77680afb20 0x7f77680aeed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:42.012 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.008+0000 7f776d1fc700 1 -- 172.21.15.71:0/1401809079 >> 172.21.15.71:0/1401809079 conn(0x7f77680cc110 msgr2=0x7f77680cc510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:42.012 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.008+0000 7f776d1fc700 1 -- 172.21.15.71:0/1401809079 shutdown_connections 2023-10-06T01:42:42.012 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.008+0000 7f776d1fc700 1 -- 172.21.15.71:0/1401809079 wait complete. 2023-10-06T01:42:42.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.009+0000 7f776d1fc700 1 Processor -- start 2023-10-06T01:42:42.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.009+0000 7f776d1fc700 1 -- start start 2023-10-06T01:42:42.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.010+0000 7f776d1fc700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f77680afb20 0x7f77680cb560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:42.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.010+0000 7f776d1fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f77680afef0 0x7f776814e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:42.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.010+0000 7f776d1fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7768156060 0x7f77680acf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:42.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.010+0000 7f776d1fc700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f776814ed50 con 0x7f77680afb20 2023-10-06T01:42:42.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.010+0000 7f776d1fc700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77680a8b00 con 0x7f7768156060 2023-10-06T01:42:42.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.010+0000 7f776d1fc700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77680ad450 con 0x7f77680afef0 2023-10-06T01:42:42.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.010+0000 7f7766d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f77680afb20 0x7f77680cb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:42.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.010+0000 7f7766d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f77680afb20 0x7f77680cb560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:42934/0 (socket says 172.21.15.71:42934) 2023-10-06T01:42:42.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.010+0000 7f7766d9d700 1 -- 172.21.15.71:0/2609715066 learned_addr learned my addr 172.21.15.71:0/2609715066 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:42.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.010+0000 7f776759e700 1 --2- 172.21.15.71:0/2609715066 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7768156060 0x7f77680acf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:42.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.010+0000 7f7766d9d700 1 -- 172.21.15.71:0/2609715066 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f77680afef0 msgr2=0x7f776814e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:42.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.010+0000 7f776659c700 1 --2- 172.21.15.71:0/2609715066 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f77680afef0 0x7f776814e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:42.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.010+0000 7f7766d9d700 1 --2- 172.21.15.71:0/2609715066 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f77680afef0 0x7f776814e810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:42.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.010+0000 7f7766d9d700 1 -- 172.21.15.71:0/2609715066 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7768156060 msgr2=0x7f77680acf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:42.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.010+0000 7f7766d9d700 1 --2- 172.21.15.71:0/2609715066 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7768156060 0x7f77680acf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:42.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.010+0000 7f7766d9d700 1 -- 172.21.15.71:0/2609715066 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f776000b780 con 0x7f77680afb20 2023-10-06T01:42:42.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.010+0000 7f7766d9d700 1 --2- 172.21.15.71:0/2609715066 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f77680afb20 0x7f77680cb560 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f775800e190 tx=0x7f7758009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:42.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.011+0000 7f775effd700 1 -- 172.21.15.71:0/2609715066 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f775800ee30 con 0x7f77680afb20 2023-10-06T01:42:42.016 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.011+0000 7f775effd700 1 -- 172.21.15.71:0/2609715066 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7758014420 con 0x7f77680afb20 2023-10-06T01:42:42.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.011+0000 7f776d1fc700 1 -- 172.21.15.71:0/2609715066 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f776816a790 con 0x7f77680afb20 2023-10-06T01:42:42.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.011+0000 7f775effd700 1 -- 172.21.15.71:0/2609715066 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77580147e0 con 0x7f77680afb20 2023-10-06T01:42:42.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.011+0000 7f776d1fc700 1 -- 172.21.15.71:0/2609715066 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f776816ad50 con 0x7f77680afb20 2023-10-06T01:42:42.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.012+0000 7f776d1fc700 1 -- 172.21.15.71:0/2609715066 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77680a8de0 con 0x7f77680afb20 2023-10-06T01:42:42.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.012+0000 7f775effd700 1 -- 172.21.15.71:0/2609715066 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7758014b50 con 0x7f77680afb20 2023-10-06T01:42:42.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.012+0000 7f775effd700 1 --2- 172.21.15.71:0/2609715066 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7748066f30 0x7f77480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:42.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.012+0000 7f775effd700 1 -- 172.21.15.71:0/2609715066 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f7758085030 con 0x7f77680afb20 2023-10-06T01:42:42.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.012+0000 7f776659c700 1 --2- 172.21.15.71:0/2609715066 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7748066f30 0x7f77480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:42.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.013+0000 7f776659c700 1 --2- 172.21.15.71:0/2609715066 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7748066f30 0x7f77480693e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f776815c800 tx=0x7f7750008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:42.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.017+0000 7f775effd700 1 -- 172.21.15.71:0/2609715066 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7758051fb0 con 0x7f77680afb20 2023-10-06T01:42:42.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.199+0000 7f776d1fc700 1 -- 172.21.15.71:0/2609715066 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f77680a88d0 con 0x7f77680afb20 2023-10-06T01:42:42.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.199+0000 7f775effd700 1 -- 172.21.15.71:0/2609715066 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v58) v1 ==== 100+0+11 (secure 0 0 0) 0x7f77680a88d0 con 0x7f77680afb20 2023-10-06T01:42:42.201 INFO:teuthology.orchestra.run.smithi071.stdout:pg_num: 64 2023-10-06T01:42:42.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.201+0000 7f776d1fc700 1 -- 172.21.15.71:0/2609715066 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7748066f30 msgr2=0x7f77480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:42.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.201+0000 7f776d1fc700 1 --2- 172.21.15.71:0/2609715066 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7748066f30 0x7f77480693e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f776815c800 tx=0x7f7750008040 comp rx=0 tx=0).stop 2023-10-06T01:42:42.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.201+0000 7f776d1fc700 1 -- 172.21.15.71:0/2609715066 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f77680afb20 msgr2=0x7f77680cb560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:42.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.201+0000 7f776d1fc700 1 --2- 172.21.15.71:0/2609715066 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f77680afb20 0x7f77680cb560 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f775800e190 tx=0x7f7758009920 comp rx=0 tx=0).stop 2023-10-06T01:42:42.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.201+0000 7f776d1fc700 1 -- 172.21.15.71:0/2609715066 shutdown_connections 2023-10-06T01:42:42.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.201+0000 7f776d1fc700 1 --2- 172.21.15.71:0/2609715066 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f7748066f30 0x7f77480693e0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:42.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.201+0000 7f776d1fc700 1 --2- 172.21.15.71:0/2609715066 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7768156060 0x7f77680acf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:42.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.201+0000 7f776d1fc700 1 --2- 172.21.15.71:0/2609715066 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f77680afb20 0x7f77680cb560 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:42.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.201+0000 7f776d1fc700 1 --2- 172.21.15.71:0/2609715066 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f77680afef0 0x7f776814e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:42.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.201+0000 7f776d1fc700 1 -- 172.21.15.71:0/2609715066 >> 172.21.15.71:0/2609715066 conn(0x7f77680cc110 msgr2=0x7f77680b02c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:42.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.201+0000 7f776d1fc700 1 -- 172.21.15.71:0/2609715066 shutdown_connections 2023-10-06T01:42:42.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.202+0000 7f776d1fc700 1 -- 172.21.15.71:0/2609715066 wait complete. 2023-10-06T01:42:42.215 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T01:42:42.328 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.327+0000 7f98e63c5700 1 Processor -- start 2023-10-06T01:42:42.328 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.327+0000 7f98e63c5700 1 -- start start 2023-10-06T01:42:42.330 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.328+0000 7f98e63c5700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f98e00cf1a0 0x7f98e00cfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:42.330 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.328+0000 7f98e63c5700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f98e01597d0 0x7f98e00d0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:42.331 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.328+0000 7f98e63c5700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98e00b3560 con 0x7f98e0159400 2023-10-06T01:42:42.331 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.328+0000 7f98e63c5700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98e00cf6f0 con 0x7f98e01597d0 2023-10-06T01:42:42.331 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.328+0000 7f98e63c5700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98e00cf9d0 con 0x7f98e00cf1a0 2023-10-06T01:42:42.331 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.328+0000 7f98e4bc2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f98e00cf1a0 0x7f98e00cfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:42.331 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.328+0000 7f98e5bc4700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f98e01597d0 0x7f98e00d0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:42.331 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.328+0000 7f98e53c3700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f98e0159400 0x7f98e00ccaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.71:38692/0 (socket says 172.21.15.71:38692) 2023-10-06T01:42:42.331 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.328+0000 7f98e4bc2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f98e00cf1a0 0x7f98e00cfec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.71:37182/0 (socket says 172.21.15.71:37182) 2023-10-06T01:42:42.331 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.328+0000 7f98e53c3700 1 -- 172.21.15.71:0/2848343485 learned_addr learned my addr 172.21.15.71:0/2848343485 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:42:42.331 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.328+0000 7f98e5bc4700 1 --2- 172.21.15.71:0/2848343485 >> v2:172.21.15.72:3300/0 conn(0x7f98e01597d0 0x7f98e00d0400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:49282/0 (socket says 172.21.15.71:49282) 2023-10-06T01:42:42.331 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.328+0000 7f98e4bc2700 1 -- 172.21.15.71:0/2848343485 >> v2:172.21.15.72:3300/0 conn(0x7f98e01597d0 msgr2=0x7f98e00d0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:42.331 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.328+0000 7f98e4bc2700 1 --2- 172.21.15.71:0/2848343485 >> v2:172.21.15.72:3300/0 conn(0x7f98e01597d0 0x7f98e00d0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:42.332 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.328+0000 7f98e4bc2700 1 -- 172.21.15.71:0/2848343485 >> v1:172.21.15.72:6789/0 conn(0x7f98e0159400 legacy=0x7f98e00ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:42.332 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.328+0000 7f98e4bc2700 1 -- 172.21.15.71:0/2848343485 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98e00b2f10 con 0x7f98e00cf1a0 2023-10-06T01:42:42.332 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.328+0000 7f98e5bc4700 1 --2- 172.21.15.71:0/2848343485 >> v2:172.21.15.72:3300/0 conn(0x7f98e01597d0 0x7f98e00d0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:42:42.332 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.329+0000 7f98e4bc2700 1 --2- 172.21.15.71:0/2848343485 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f98e00cf1a0 0x7f98e00cfec0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f98d00098e0 tx=0x7f98d00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56bcbdd527b47fc9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:42.332 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.329+0000 7f98d7fff700 1 -- 172.21.15.71:0/2848343485 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d000b640 con 0x7f98e00cf1a0 2023-10-06T01:42:42.332 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.329+0000 7f98d7fff700 1 -- 172.21.15.71:0/2848343485 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98d000b7a0 con 0x7f98e00cf1a0 2023-10-06T01:42:42.332 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.329+0000 7f98d7fff700 1 -- 172.21.15.71:0/2848343485 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d000bb40 con 0x7f98e00cf1a0 2023-10-06T01:42:42.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.329+0000 7f98e63c5700 1 -- 172.21.15.71:0/2848343485 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f98e00cf1a0 msgr2=0x7f98e00cfec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:42.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.329+0000 7f98e63c5700 1 --2- 172.21.15.71:0/2848343485 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f98e00cf1a0 0x7f98e00cfec0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f98d00098e0 tx=0x7f98d00091a0 comp rx=0 tx=0).stop 2023-10-06T01:42:42.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.329+0000 7f98e63c5700 1 -- 172.21.15.71:0/2848343485 shutdown_connections 2023-10-06T01:42:42.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.329+0000 7f98e63c5700 1 --2- 172.21.15.71:0/2848343485 >> v2:172.21.15.72:3300/0 conn(0x7f98e01597d0 0x7f98e00d0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:42.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.329+0000 7f98e63c5700 1 --2- 172.21.15.71:0/2848343485 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f98e00cf1a0 0x7f98e00cfec0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:42.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.329+0000 7f98e63c5700 1 -- 172.21.15.71:0/2848343485 >> 172.21.15.71:0/2848343485 conn(0x7f98e006ac10 msgr2=0x7f98e0068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:42.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.329+0000 7f98e63c5700 1 -- 172.21.15.71:0/2848343485 shutdown_connections 2023-10-06T01:42:42.335 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.329+0000 7f98e63c5700 1 -- 172.21.15.71:0/2848343485 wait complete. 2023-10-06T01:42:42.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.330+0000 7f98e63c5700 1 Processor -- start 2023-10-06T01:42:42.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.330+0000 7f98e63c5700 1 -- start start 2023-10-06T01:42:42.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.331+0000 7f98e63c5700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f98e00cf1a0 0x7f98e0145a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:42.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.331+0000 7f98e63c5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98e0159400 0x7f98e0154ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:42.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.331+0000 7f98e63c5700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f98e01597d0 0x7f98e0155220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:42.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.331+0000 7f98e63c5700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e015bf20 con 0x7f98e01597d0 2023-10-06T01:42:42.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.331+0000 7f98e63c5700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e015b3a0 con 0x7f98e0159400 2023-10-06T01:42:42.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.331+0000 7f98e63c5700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98e015b680 con 0x7f98e00cf1a0 2023-10-06T01:42:42.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.332+0000 7f98e5bc4700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f98e01597d0 0x7f98e0155220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:42.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.332+0000 7f98e5bc4700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f98e01597d0 0x7f98e0155220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:42944/0 (socket says 172.21.15.71:42944) 2023-10-06T01:42:42.336 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.332+0000 7f98e5bc4700 1 -- 172.21.15.71:0/894022228 learned_addr learned my addr 172.21.15.71:0/894022228 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:42.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.332+0000 7f98e53c3700 1 --2- 172.21.15.71:0/894022228 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f98e00cf1a0 0x7f98e0145a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:42.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.332+0000 7f98e4bc2700 1 --2- 172.21.15.71:0/894022228 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98e0159400 0x7f98e0154ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:42.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.332+0000 7f98e5bc4700 1 -- 172.21.15.71:0/894022228 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f98e00cf1a0 msgr2=0x7f98e0145a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:42.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.332+0000 7f98e5bc4700 1 --2- 172.21.15.71:0/894022228 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f98e00cf1a0 0x7f98e0145a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:42.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.332+0000 7f98e5bc4700 1 -- 172.21.15.71:0/894022228 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98e0159400 msgr2=0x7f98e0154ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:42.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.332+0000 7f98e5bc4700 1 --2- 172.21.15.71:0/894022228 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98e0159400 0x7f98e0154ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:42.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.332+0000 7f98e5bc4700 1 -- 172.21.15.71:0/894022228 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98d8009a20 con 0x7f98e01597d0 2023-10-06T01:42:42.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.332+0000 7f98e5bc4700 1 --2- 172.21.15.71:0/894022228 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f98e01597d0 0x7f98e0155220 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f98d8009ef0 tx=0x7f98d800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:42.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.332+0000 7f98d57fa700 1 -- 172.21.15.71:0/894022228 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d800cc00 con 0x7f98e01597d0 2023-10-06T01:42:42.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.332+0000 7f98d57fa700 1 -- 172.21.15.71:0/894022228 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98d800f040 con 0x7f98e01597d0 2023-10-06T01:42:42.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.332+0000 7f98e63c5700 1 -- 172.21.15.71:0/894022228 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98d0009420 con 0x7f98e01597d0 2023-10-06T01:42:42.337 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.332+0000 7f98d57fa700 1 -- 172.21.15.71:0/894022228 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d8014480 con 0x7f98e01597d0 2023-10-06T01:42:42.338 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.332+0000 7f98e63c5700 1 -- 172.21.15.71:0/894022228 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98e015bc40 con 0x7f98e01597d0 2023-10-06T01:42:42.338 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.333+0000 7f98e63c5700 1 -- 172.21.15.71:0/894022228 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98e00ccaf0 con 0x7f98e01597d0 2023-10-06T01:42:42.338 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.334+0000 7f98d57fa700 1 -- 172.21.15.71:0/894022228 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f98d80147f0 con 0x7f98e01597d0 2023-10-06T01:42:42.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.334+0000 7f98d57fa700 1 --2- 172.21.15.71:0/894022228 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f98c4066f30 0x7f98c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:42.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.334+0000 7f98d57fa700 1 -- 172.21.15.71:0/894022228 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f98d8085580 con 0x7f98e01597d0 2023-10-06T01:42:42.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.334+0000 7f98e53c3700 1 --2- 172.21.15.71:0/894022228 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f98c4066f30 0x7f98c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:42.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.334+0000 7f98e53c3700 1 --2- 172.21.15.71:0/894022228 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f98c4066f30 0x7f98c40693e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f98dc005920 tx=0x7f98dc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:42.339 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.338+0000 7f98d57fa700 1 -- 172.21.15.71:0/894022228 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f98d8052500 con 0x7f98e01597d0 2023-10-06T01:42:42.565 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.563+0000 7f98e63c5700 1 -- 172.21.15.71:0/894022228 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f98e00b31f0 con 0x7f98e01597d0 2023-10-06T01:42:42.565 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.564+0000 7f98d57fa700 1 -- 172.21.15.71:0/894022228 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4595 (secure 0 0 0) 0x7f98d8055b20 con 0x7f98e01597d0 2023-10-06T01:42:42.566 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:42:42.566 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":39,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5171,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/3015768753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":3015768753},{"type":"v1","addr":"172.21.15.72:6835","nonce":3015768753}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5572,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6833/698854056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":698854056},{"type":"v1","addr":"172.21.15.72:6833","nonce":698854056}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":5811,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/2808450062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":2808450062},{"type":"v1","addr":"172.21.15.71:6835","nonce":2808450062}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T01:41:59.290125+0000","modified":"2023-10-06T01:42:38.037440+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":57,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5823},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5823":{"gid":5823,"name":"c","rank":0,"incarnation":36,"state":"up:active","state_seq":4,"addr":"172.21.15.71:6837/2318258263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":2318258263},{"type":"v1","addr":"172.21.15.71:6837","nonce":2318258263}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T01:42:42.567 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.566+0000 7f98e63c5700 1 -- 172.21.15.71:0/894022228 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f98c4066f30 msgr2=0x7f98c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:42.568 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.566+0000 7f98e63c5700 1 --2- 172.21.15.71:0/894022228 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f98c4066f30 0x7f98c40693e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f98dc005920 tx=0x7f98dc009040 comp rx=0 tx=0).stop 2023-10-06T01:42:42.568 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.566+0000 7f98e63c5700 1 -- 172.21.15.71:0/894022228 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f98e01597d0 msgr2=0x7f98e0155220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:42.568 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.566+0000 7f98e63c5700 1 --2- 172.21.15.71:0/894022228 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f98e01597d0 0x7f98e0155220 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f98d8009ef0 tx=0x7f98d800b040 comp rx=0 tx=0).stop 2023-10-06T01:42:42.568 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.566+0000 7f98e63c5700 1 -- 172.21.15.71:0/894022228 shutdown_connections 2023-10-06T01:42:42.568 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.566+0000 7f98e63c5700 1 --2- 172.21.15.71:0/894022228 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f98e01597d0 0x7f98e0155220 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:42.568 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.566+0000 7f98e63c5700 1 --2- 172.21.15.71:0/894022228 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f98e00cf1a0 0x7f98e0145a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:42.568 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.566+0000 7f98e63c5700 1 --2- 172.21.15.71:0/894022228 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f98c4066f30 0x7f98c40693e0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:42.568 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.566+0000 7f98e63c5700 1 --2- 172.21.15.71:0/894022228 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98e0159400 0x7f98e0154ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:42.568 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.566+0000 7f98e63c5700 1 -- 172.21.15.71:0/894022228 >> 172.21.15.71:0/894022228 conn(0x7f98e006ac10 msgr2=0x7f98e0155eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:42.568 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.566+0000 7f98e63c5700 1 -- 172.21.15.71:0/894022228 shutdown_connections 2023-10-06T01:42:42.569 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.566+0000 7f98e63c5700 1 -- 172.21.15.71:0/894022228 wait complete. 2023-10-06T01:42:42.569 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 39 2023-10-06T01:42:42.579 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:42:42.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.692+0000 7f40ee6ae700 1 Processor -- start 2023-10-06T01:42:42.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.692+0000 7f40ee6ae700 1 -- start start 2023-10-06T01:42:42.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.693+0000 7f40ee6ae700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f40e8157040 0x7f40e80cbfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:42.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.693+0000 7f40ee6ae700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f40e8157410 0x7f40e80cc4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:42.696 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.693+0000 7f40ee6ae700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40e80cd5b0 con 0x7f40e80cda40 2023-10-06T01:42:42.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.693+0000 7f40ee6ae700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40e80cca20 con 0x7f40e8157040 2023-10-06T01:42:42.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.693+0000 7f40ee6ae700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40e80ccc80 con 0x7f40e8157410 2023-10-06T01:42:42.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.693+0000 7f40ed6ac700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f40e8157040 0x7f40e80cbfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:42.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.693+0000 7f40ed6ac700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f40e8157040 0x7f40e80cbfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:42960/0 (socket says 172.21.15.71:42960) 2023-10-06T01:42:42.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.693+0000 7f40ed6ac700 1 -- 172.21.15.71:0/3117832858 learned_addr learned my addr 172.21.15.71:0/3117832858 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:42.697 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.693+0000 7f40ed6ac700 1 -- 172.21.15.71:0/3117832858 >> v2:172.21.15.72:3300/0 conn(0x7f40e8157410 msgr2=0x7f40e80cc4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:42.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.693+0000 7f40ed6ac700 1 --2- 172.21.15.71:0/3117832858 >> v2:172.21.15.72:3300/0 conn(0x7f40e8157410 0x7f40e80cc4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:42.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.693+0000 7f40ed6ac700 1 -- 172.21.15.71:0/3117832858 >> v1:172.21.15.72:6789/0 conn(0x7f40e80cda40 legacy=0x7f40e80ad830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:42.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.693+0000 7f40ed6ac700 1 -- 172.21.15.71:0/3117832858 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40e80ccf60 con 0x7f40e8157040 2023-10-06T01:42:42.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.693+0000 7f40ed6ac700 1 --2- 172.21.15.71:0/3117832858 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f40e8157040 0x7f40e80cbfa0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f40e80b2c30 tx=0x7f40e0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=485ac2e4dbf8945d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:42.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.694+0000 7f40e7fff700 1 -- 172.21.15.71:0/3117832858 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e000b820 con 0x7f40e8157040 2023-10-06T01:42:42.698 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.694+0000 7f40e7fff700 1 -- 172.21.15.71:0/3117832858 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40e000b980 con 0x7f40e8157040 2023-10-06T01:42:42.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.694+0000 7f40e7fff700 1 -- 172.21.15.71:0/3117832858 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e000bd20 con 0x7f40e8157040 2023-10-06T01:42:42.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.694+0000 7f40ee6ae700 1 -- 172.21.15.71:0/3117832858 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f40e8157040 msgr2=0x7f40e80cbfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:42.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.694+0000 7f40ee6ae700 1 --2- 172.21.15.71:0/3117832858 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f40e8157040 0x7f40e80cbfa0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f40e80b2c30 tx=0x7f40e0009250 comp rx=0 tx=0).stop 2023-10-06T01:42:42.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.694+0000 7f40ee6ae700 1 -- 172.21.15.71:0/3117832858 shutdown_connections 2023-10-06T01:42:42.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.694+0000 7f40ee6ae700 1 --2- 172.21.15.71:0/3117832858 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f40e8157040 0x7f40e80cbfa0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:42.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.694+0000 7f40ee6ae700 1 --2- 172.21.15.71:0/3117832858 >> v2:172.21.15.72:3300/0 conn(0x7f40e8157410 0x7f40e80cc4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:42.699 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.694+0000 7f40ee6ae700 1 -- 172.21.15.71:0/3117832858 >> 172.21.15.71:0/3117832858 conn(0x7f40e8067130 msgr2=0x7f40e8067530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:42.700 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.694+0000 7f40ee6ae700 1 -- 172.21.15.71:0/3117832858 shutdown_connections 2023-10-06T01:42:42.700 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.694+0000 7f40ee6ae700 1 -- 172.21.15.71:0/3117832858 wait complete. 2023-10-06T01:42:42.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.695+0000 7f40ee6ae700 1 Processor -- start 2023-10-06T01:42:42.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.695+0000 7f40ee6ae700 1 -- start start 2023-10-06T01:42:42.702 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.696+0000 7f40ee6ae700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f40e80cda40 0x7f40e80a9c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:42.703 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.696+0000 7f40ee6ae700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f40e8157040 0x7f40e8096400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:42.703 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.696+0000 7f40ee6ae700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f40e8157410 0x7f40e81442e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:42.703 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.696+0000 7f40ee6ae700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e8096940 con 0x7f40e8157040 2023-10-06T01:42:42.703 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.696+0000 7f40ee6ae700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e80aa630 con 0x7f40e80cda40 2023-10-06T01:42:42.703 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.696+0000 7f40ee6ae700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40e80aa910 con 0x7f40e8157410 2023-10-06T01:42:42.703 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.696+0000 7f40eceab700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f40e8157040 0x7f40e8096400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:42.704 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.696+0000 7f40eceab700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f40e8157040 0x7f40e8096400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:42976/0 (socket says 172.21.15.71:42976) 2023-10-06T01:42:42.704 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.696+0000 7f40eceab700 1 -- 172.21.15.71:0/3571905387 learned_addr learned my addr 172.21.15.71:0/3571905387 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:42.704 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.697+0000 7f40ed6ac700 1 --2- 172.21.15.71:0/3571905387 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f40e80cda40 0x7f40e80a9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:42.704 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.697+0000 7f40eceab700 1 -- 172.21.15.71:0/3571905387 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f40e8157410 msgr2=0x7f40e81442e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:42.704 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.697+0000 7f40eceab700 1 --2- 172.21.15.71:0/3571905387 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f40e8157410 0x7f40e81442e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:42.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.697+0000 7f40eceab700 1 -- 172.21.15.71:0/3571905387 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f40e80cda40 msgr2=0x7f40e80a9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:42.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.697+0000 7f40eceab700 1 --2- 172.21.15.71:0/3571905387 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f40e80cda40 0x7f40e80a9c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:42.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.697+0000 7f40eceab700 1 -- 172.21.15.71:0/3571905387 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40e00094f0 con 0x7f40e8157040 2023-10-06T01:42:42.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.697+0000 7f40eceab700 1 --2- 172.21.15.71:0/3571905387 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f40e8157040 0x7f40e8096400 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f40dc00b810 tx=0x7f40dc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:42.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.697+0000 7f40e57fa700 1 -- 172.21.15.71:0/3571905387 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40dc00f570 con 0x7f40e8157040 2023-10-06T01:42:42.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.697+0000 7f40e57fa700 1 -- 172.21.15.71:0/3571905387 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40dc00f6d0 con 0x7f40e8157040 2023-10-06T01:42:42.705 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.697+0000 7f40ee6ae700 1 -- 172.21.15.71:0/3571905387 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40e80aabf0 con 0x7f40e8157040 2023-10-06T01:42:42.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.697+0000 7f40e57fa700 1 -- 172.21.15.71:0/3571905387 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40dc00fa90 con 0x7f40e8157040 2023-10-06T01:42:42.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.697+0000 7f40ee6ae700 1 -- 172.21.15.71:0/3571905387 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40e80ab1b0 con 0x7f40e8157040 2023-10-06T01:42:42.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.698+0000 7f40ee6ae700 1 -- 172.21.15.71:0/3571905387 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40e806f3c0 con 0x7f40e8157040 2023-10-06T01:42:42.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.698+0000 7f40e57fa700 1 -- 172.21.15.71:0/3571905387 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f40dc01a460 con 0x7f40e8157040 2023-10-06T01:42:42.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.699+0000 7f40e57fa700 1 --2- 172.21.15.71:0/3571905387 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f40d4066f30 0x7f40d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:42.706 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.699+0000 7f40e57fa700 1 -- 172.21.15.71:0/3571905387 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f40dc0844a0 con 0x7f40e8157040 2023-10-06T01:42:42.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.699+0000 7f40ed6ac700 1 --2- 172.21.15.71:0/3571905387 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f40d4066f30 0x7f40d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:42.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.699+0000 7f40ed6ac700 1 --2- 172.21.15.71:0/3571905387 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f40d4066f30 0x7f40d40693e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f40e80b2c30 tx=0x7f40e0016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:42.707 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.703+0000 7f40e57fa700 1 -- 172.21.15.71:0/3571905387 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f40dc0514a0 con 0x7f40e8157040 2023-10-06T01:42:42.890 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.889+0000 7f40ee6ae700 1 -- 172.21.15.71:0/3571905387 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f40e80cd240 con 0x7f40e8157040 2023-10-06T01:42:42.891 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.889+0000 7f40e57fa700 1 -- 172.21.15.71:0/3571905387 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+17150 (secure 0 0 0) 0x7f40dc054ac0 con 0x7f40e8157040 2023-10-06T01:42:42.891 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:42:42.892 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":58,"fsid":"1fbf1bd2-f9b4-4599-bea2-f4aa920e9a56","created":"2023-10-06T01:39:57.016957+0000","modified":"2023-10-06T01:42:34.021528+0000","last_up_change":"2023-10-06T01:40:08.571643+0000","last_in_change":"2023-10-06T01:39:59.462741+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T01:40:08.610349+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T01:40:15.387434+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-06T01:41:56.925792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-06T01:41:58.259205+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cf059188-fb20-4dbf-95db-dcf57b213d03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":90670},{"type":"v1","addr":"172.21.15.71:6817","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":90670},{"type":"v1","addr":"172.21.15.71:6819","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":90670},{"type":"v1","addr":"172.21.15.71:6823","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":90670},{"type":"v1","addr":"172.21.15.71:6821","nonce":90670}]},"public_addr":"172.21.15.71:6817/90670","cluster_addr":"172.21.15.71:6819/90670","heartbeat_back_addr":"172.21.15.71:6823/90670","heartbeat_front_addr":"172.21.15.71:6821/90670","state":["exists","up"]},{"osd":1,"uuid":"0cff0aae-1799-4fe0-b610-54cf0813c0e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":90669},{"type":"v1","addr":"172.21.15.71:6809","nonce":90669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":90669},{"type":"v1","addr":"172.21.15.71:6811","nonce":90669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":90669},{"type":"v1","addr":"172.21.15.71:6815","nonce":90669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":90669},{"type":"v1","addr":"172.21.15.71:6813","nonce":90669}]},"public_addr":"172.21.15.71:6809/90669","cluster_addr":"172.21.15.71:6811/90669","heartbeat_back_addr":"172.21.15.71:6815/90669","heartbeat_front_addr":"172.21.15.71:6813/90669","state":["exists","up"]},{"osd":2,"uuid":"88d61ddc-9031-44e1-ba8c-546a41e7c8ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":90679},{"type":"v1","addr":"172.21.15.71:6825","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":90679},{"type":"v1","addr":"172.21.15.71:6827","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":90679},{"type":"v1","addr":"172.21.15.71:6831","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":90679},{"type":"v1","addr":"172.21.15.71:6829","nonce":90679}]},"public_addr":"172.21.15.71:6825/90679","cluster_addr":"172.21.15.71:6827/90679","heartbeat_back_addr":"172.21.15.71:6831/90679","heartbeat_front_addr":"172.21.15.71:6829/90679","state":["exists","up"]},{"osd":3,"uuid":"11ed92b7-960b-4a30-a889-a61d3eeb86f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":90668},{"type":"v1","addr":"172.21.15.71:6801","nonce":90668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":90668},{"type":"v1","addr":"172.21.15.71:6803","nonce":90668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":90668},{"type":"v1","addr":"172.21.15.71:6807","nonce":90668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":90668},{"type":"v1","addr":"172.21.15.71:6805","nonce":90668}]},"public_addr":"172.21.15.71:6801/90668","cluster_addr":"172.21.15.71:6803/90668","heartbeat_back_addr":"172.21.15.71:6807/90668","heartbeat_front_addr":"172.21.15.71:6805/90668","state":["exists","up"]},{"osd":4,"uuid":"ae4df784-abdf-4ddf-aefa-780f3ddafef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":90917},{"type":"v1","addr":"172.21.15.72:6801","nonce":90917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":90917},{"type":"v1","addr":"172.21.15.72:6803","nonce":90917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":90917},{"type":"v1","addr":"172.21.15.72:6807","nonce":90917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":90917},{"type":"v1","addr":"172.21.15.72:6805","nonce":90917}]},"public_addr":"172.21.15.72:6801/90917","cluster_addr":"172.21.15.72:6803/90917","heartbeat_back_addr":"172.21.15.72:6807/90917","heartbeat_front_addr":"172.21.15.72:6805/90917","state":["exists","up"]},{"osd":5,"uuid":"5ef0790f-001e-458f-a05b-efae216cf435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":90941},{"type":"v1","addr":"172.21.15.72:6817","nonce":90941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":90941},{"type":"v1","addr":"172.21.15.72:6819","nonce":90941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":90941},{"type":"v1","addr":"172.21.15.72:6827","nonce":90941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":90941},{"type":"v1","addr":"172.21.15.72:6823","nonce":90941}]},"public_addr":"172.21.15.72:6817/90941","cluster_addr":"172.21.15.72:6819/90941","heartbeat_back_addr":"172.21.15.72:6827/90941","heartbeat_front_addr":"172.21.15.72:6823/90941","state":["exists","up"]},{"osd":6,"uuid":"8705aef1-9ae8-4e54-a3c4-c2909fa0ceb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":90918},{"type":"v1","addr":"172.21.15.72:6809","nonce":90918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":90918},{"type":"v1","addr":"172.21.15.72:6811","nonce":90918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":90918},{"type":"v1","addr":"172.21.15.72:6815","nonce":90918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":90918},{"type":"v1","addr":"172.21.15.72:6813","nonce":90918}]},"public_addr":"172.21.15.72:6809/90918","cluster_addr":"172.21.15.72:6811/90918","heartbeat_back_addr":"172.21.15.72:6815/90918","heartbeat_front_addr":"172.21.15.72:6813/90918","state":["exists","up"]},{"osd":7,"uuid":"364c5119-6b13-4c75-b3f0-15e165eff86a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":90948},{"type":"v1","addr":"172.21.15.72:6822","nonce":90948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":90948},{"type":"v1","addr":"172.21.15.72:6826","nonce":90948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":90948},{"type":"v1","addr":"172.21.15.72:6831","nonce":90948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":90948},{"type":"v1","addr":"172.21.15.72:6829","nonce":90948}]},"public_addr":"172.21.15.72:6822/90948","cluster_addr":"172.21.15.72:6826/90948","heartbeat_back_addr":"172.21.15.72:6831/90948","heartbeat_front_addr":"172.21.15.72:6829/90948","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.642976+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.645372+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.619116+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.663042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.599163+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.646411+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.631545+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.669821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.72:6835/627948818":"2023-10-07T01:42:34.014707+0000","172.21.15.72:6833/627948818":"2023-10-07T01:42:34.014707+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:42:42.894 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.892+0000 7f40ee6ae700 1 -- 172.21.15.71:0/3571905387 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f40d4066f30 msgr2=0x7f40d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:42.894 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.892+0000 7f40ee6ae700 1 --2- 172.21.15.71:0/3571905387 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f40d4066f30 0x7f40d40693e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f40e80b2c30 tx=0x7f40e0016000 comp rx=0 tx=0).stop 2023-10-06T01:42:42.894 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.892+0000 7f40ee6ae700 1 -- 172.21.15.71:0/3571905387 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f40e8157040 msgr2=0x7f40e8096400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:42.894 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.892+0000 7f40ee6ae700 1 --2- 172.21.15.71:0/3571905387 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f40e8157040 0x7f40e8096400 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f40dc00b810 tx=0x7f40dc0091d0 comp rx=0 tx=0).stop 2023-10-06T01:42:42.894 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.892+0000 7f40ee6ae700 1 -- 172.21.15.71:0/3571905387 shutdown_connections 2023-10-06T01:42:42.894 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.892+0000 7f40ee6ae700 1 --2- 172.21.15.71:0/3571905387 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f40e8157410 0x7f40e81442e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:42.894 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.892+0000 7f40ee6ae700 1 --2- 172.21.15.71:0/3571905387 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f40d4066f30 0x7f40d40693e0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:42.895 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.892+0000 7f40ee6ae700 1 --2- 172.21.15.71:0/3571905387 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f40e80cda40 0x7f40e80a9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:42.895 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.892+0000 7f40ee6ae700 1 --2- 172.21.15.71:0/3571905387 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f40e8157040 0x7f40e8096400 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:42.895 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.892+0000 7f40ee6ae700 1 -- 172.21.15.71:0/3571905387 >> 172.21.15.71:0/3571905387 conn(0x7f40e8067130 msgr2=0x7f40e80a8300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:42.895 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.892+0000 7f40ee6ae700 1 -- 172.21.15.71:0/3571905387 shutdown_connections 2023-10-06T01:42:42.895 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:42.892+0000 7f40ee6ae700 1 -- 172.21.15.71:0/3571905387 wait complete. 2023-10-06T01:42:42.906 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T01:42:42.906 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T01:42:43.019 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.018+0000 7f9588c81700 1 Processor -- start 2023-10-06T01:42:43.020 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.018+0000 7f9588c81700 1 -- start start 2023-10-06T01:42:43.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.019+0000 7f9588c81700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f95840af8b0 0x7f958415d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:43.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.019+0000 7f9588c81700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f95840b27f0 0x7f958415d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:43.021 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.019+0000 7f9588c81700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f958415e190 con 0x7f95840af4e0 2023-10-06T01:42:43.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.019+0000 7f9588c81700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95840b1910 con 0x7f95840af8b0 2023-10-06T01:42:43.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.019+0000 7f9588c81700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95840cb650 con 0x7f95840b27f0 2023-10-06T01:42:43.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.019+0000 7f9581d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f95840af8b0 0x7f958415d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:43.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.019+0000 7f958259c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f95840af4e0 0x7f95840b20e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.71:38700/0 (socket says 172.21.15.71:38700) 2023-10-06T01:42:43.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.019+0000 7f9581d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f95840af8b0 0x7f958415d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:49326/0 (socket says 172.21.15.71:49326) 2023-10-06T01:42:43.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.019+0000 7f958259c700 1 -- 172.21.15.71:0/915774247 learned_addr learned my addr 172.21.15.71:0/915774247 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:42:43.022 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.019+0000 7f9582d9d700 1 --2- 172.21.15.71:0/915774247 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f95840b27f0 0x7f958415d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:43.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.019+0000 7f9581d9b700 1 -- 172.21.15.71:0/915774247 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f95840b27f0 msgr2=0x7f958415d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:43.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.019+0000 7f9581d9b700 1 --2- 172.21.15.71:0/915774247 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f95840b27f0 0x7f958415d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:43.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.019+0000 7f9581d9b700 1 -- 172.21.15.71:0/915774247 >> v1:172.21.15.72:6789/0 conn(0x7f95840af4e0 legacy=0x7f95840b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:43.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.019+0000 7f9581d9b700 1 -- 172.21.15.71:0/915774247 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95840ccaf0 con 0x7f95840af8b0 2023-10-06T01:42:43.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.019+0000 7f958159a700 1 -- 172.21.15.71:0/915774247 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1378550053 0 0) 0x7f958415e190 con 0x7f95840af4e0 2023-10-06T01:42:43.023 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.019+0000 7f9582d9d700 1 --2- 172.21.15.71:0/915774247 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f95840b27f0 0x7f958415d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:42:43.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.020+0000 7f9581d9b700 1 --2- 172.21.15.71:0/915774247 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95840af8b0 0x7f958415d460 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f95780098e0 tx=0x7f95780091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bfc818805463a88e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:43.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.020+0000 7f958159a700 1 -- 172.21.15.71:0/915774247 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f957800b640 con 0x7f95840af8b0 2023-10-06T01:42:43.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.020+0000 7f958159a700 1 -- 172.21.15.71:0/915774247 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f957800b7a0 con 0x7f95840af8b0 2023-10-06T01:42:43.024 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.020+0000 7f958159a700 1 -- 172.21.15.71:0/915774247 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f957800bb40 con 0x7f95840af8b0 2023-10-06T01:42:43.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.020+0000 7f9588c81700 1 -- 172.21.15.71:0/915774247 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95840af8b0 msgr2=0x7f958415d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:43.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.020+0000 7f9588c81700 1 --2- 172.21.15.71:0/915774247 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95840af8b0 0x7f958415d460 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f95780098e0 tx=0x7f95780091a0 comp rx=0 tx=0).stop 2023-10-06T01:42:43.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.020+0000 7f9588c81700 1 -- 172.21.15.71:0/915774247 shutdown_connections 2023-10-06T01:42:43.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.020+0000 7f9588c81700 1 --2- 172.21.15.71:0/915774247 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f95840b27f0 0x7f958415d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:43.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.020+0000 7f9588c81700 1 --2- 172.21.15.71:0/915774247 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95840af8b0 0x7f958415d460 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:43.028 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.020+0000 7f9588c81700 1 -- 172.21.15.71:0/915774247 >> 172.21.15.71:0/915774247 conn(0x7f9584068680 msgr2=0x7f9584068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:43.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.020+0000 7f9588c81700 1 -- 172.21.15.71:0/915774247 shutdown_connections 2023-10-06T01:42:43.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.020+0000 7f9588c81700 1 -- 172.21.15.71:0/915774247 wait complete. 2023-10-06T01:42:43.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.021+0000 7f9588c81700 1 Processor -- start 2023-10-06T01:42:43.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.021+0000 7f9588c81700 1 -- start start 2023-10-06T01:42:43.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.022+0000 7f9588c81700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f95840af4e0 0x7f958416ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:43.029 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.022+0000 7f9588c81700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f95840af8b0 0x7f958416a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:43.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.022+0000 7f9588c81700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95840b27f0 0x7f958416a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:43.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.022+0000 7f9588c81700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95840c8360 con 0x7f95840af8b0 2023-10-06T01:42:43.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.022+0000 7f9588c81700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9584155480 con 0x7f95840b27f0 2023-10-06T01:42:43.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.022+0000 7f9588c81700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95840c8570 con 0x7f95840af4e0 2023-10-06T01:42:43.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.022+0000 7f9581d9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f95840af8b0 0x7f958416a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:43.030 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.022+0000 7f9581d9b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f95840af8b0 0x7f958416a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:42984/0 (socket says 172.21.15.71:42984) 2023-10-06T01:42:43.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.022+0000 7f9581d9b700 1 -- 172.21.15.71:0/3439978950 learned_addr learned my addr 172.21.15.71:0/3439978950 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:43.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.022+0000 7f958259c700 1 --2- 172.21.15.71:0/3439978950 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f95840af4e0 0x7f958416ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:43.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.022+0000 7f9582d9d700 1 --2- 172.21.15.71:0/3439978950 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95840b27f0 0x7f958416a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:43.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.023+0000 7f9581d9b700 1 -- 172.21.15.71:0/3439978950 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f95840af4e0 msgr2=0x7f958416ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:43.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.023+0000 7f9581d9b700 1 --2- 172.21.15.71:0/3439978950 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f95840af4e0 0x7f958416ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:43.031 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.023+0000 7f9581d9b700 1 -- 172.21.15.71:0/3439978950 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95840b27f0 msgr2=0x7f958416a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:43.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.023+0000 7f9581d9b700 1 --2- 172.21.15.71:0/3439978950 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95840b27f0 0x7f958416a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:43.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.023+0000 7f9581d9b700 1 -- 172.21.15.71:0/3439978950 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f957c009a20 con 0x7f95840af8b0 2023-10-06T01:42:43.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.023+0000 7f9581d9b700 1 --2- 172.21.15.71:0/3439978950 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f95840af8b0 0x7f958416a1e0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f9578013000 tx=0x7f9578017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:43.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.023+0000 7f95727fc700 1 -- 172.21.15.71:0/3439978950 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9578000d10 con 0x7f95840af8b0 2023-10-06T01:42:43.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.023+0000 7f95727fc700 1 -- 172.21.15.71:0/3439978950 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f957800bb20 con 0x7f95840af8b0 2023-10-06T01:42:43.032 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.023+0000 7f9588c81700 1 -- 172.21.15.71:0/3439978950 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9578009420 con 0x7f95840af8b0 2023-10-06T01:42:43.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.023+0000 7f95727fc700 1 -- 172.21.15.71:0/3439978950 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9578011670 con 0x7f95840af8b0 2023-10-06T01:42:43.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.023+0000 7f9588c81700 1 -- 172.21.15.71:0/3439978950 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95840c8b30 con 0x7f95840af8b0 2023-10-06T01:42:43.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.024+0000 7f9588c81700 1 -- 172.21.15.71:0/3439978950 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95840c8d50 con 0x7f95840af8b0 2023-10-06T01:42:43.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.024+0000 7f95727fc700 1 -- 172.21.15.71:0/3439978950 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9578011a20 con 0x7f95840af8b0 2023-10-06T01:42:43.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.025+0000 7f95727fc700 1 --2- 172.21.15.71:0/3439978950 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f9564066f30 0x7f95640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:43.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.025+0000 7f95727fc700 1 -- 172.21.15.71:0/3439978950 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f9578085c80 con 0x7f95840af8b0 2023-10-06T01:42:43.033 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.025+0000 7f958259c700 1 --2- 172.21.15.71:0/3439978950 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f9564066f30 0x7f95640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:43.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.025+0000 7f958259c700 1 --2- 172.21.15.71:0/3439978950 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f9564066f30 0x7f95640693e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f9584151f20 tx=0x7f9574007f50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:43.034 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.029+0000 7f95727fc700 1 -- 172.21.15.71:0/3439978950 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9578052cc0 con 0x7f95840af8b0 2023-10-06T01:42:43.256 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.255+0000 7f9588c81700 1 -- 172.21.15.71:0/3439978950 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f95840b0910 con 0x7f95840af8b0 2023-10-06T01:42:43.257 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.255+0000 7f95727fc700 1 -- 172.21.15.71:0/3439978950 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4595 (secure 0 0 0) 0x7f95780562e0 con 0x7f95840af8b0 2023-10-06T01:42:43.257 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:42:43.257 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":39,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5171,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/3015768753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":3015768753},{"type":"v1","addr":"172.21.15.72:6835","nonce":3015768753}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5572,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6833/698854056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":698854056},{"type":"v1","addr":"172.21.15.72:6833","nonce":698854056}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":5811,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/2808450062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":2808450062},{"type":"v1","addr":"172.21.15.71:6835","nonce":2808450062}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T01:41:59.290125+0000","modified":"2023-10-06T01:42:38.037440+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":57,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5823},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5823":{"gid":5823,"name":"c","rank":0,"incarnation":36,"state":"up:active","state_seq":4,"addr":"172.21.15.71:6837/2318258263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":2318258263},{"type":"v1","addr":"172.21.15.71:6837","nonce":2318258263}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T01:42:43.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.257+0000 7f9588c81700 1 -- 172.21.15.71:0/3439978950 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f9564066f30 msgr2=0x7f95640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:43.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.257+0000 7f9588c81700 1 --2- 172.21.15.71:0/3439978950 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f9564066f30 0x7f95640693e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f9584151f20 tx=0x7f9574007f50 comp rx=0 tx=0).stop 2023-10-06T01:42:43.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.257+0000 7f9588c81700 1 -- 172.21.15.71:0/3439978950 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f95840af8b0 msgr2=0x7f958416a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:43.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.257+0000 7f9588c81700 1 --2- 172.21.15.71:0/3439978950 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f95840af8b0 0x7f958416a1e0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f9578013000 tx=0x7f9578017000 comp rx=0 tx=0).stop 2023-10-06T01:42:43.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.257+0000 7f9588c81700 1 -- 172.21.15.71:0/3439978950 shutdown_connections 2023-10-06T01:42:43.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.257+0000 7f9588c81700 1 --2- 172.21.15.71:0/3439978950 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f9564066f30 0x7f95640693e0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:43.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.257+0000 7f9588c81700 1 --2- 172.21.15.71:0/3439978950 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95840b27f0 0x7f958416a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:43.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.257+0000 7f9588c81700 1 --2- 172.21.15.71:0/3439978950 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f95840af4e0 0x7f958416ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:43.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.257+0000 7f9588c81700 1 --2- 172.21.15.71:0/3439978950 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f95840af8b0 0x7f958416a1e0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:43.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.257+0000 7f9588c81700 1 -- 172.21.15.71:0/3439978950 >> 172.21.15.71:0/3439978950 conn(0x7f9584068680 msgr2=0x7f95840b5160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:43.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.257+0000 7f9588c81700 1 -- 172.21.15.71:0/3439978950 shutdown_connections 2023-10-06T01:42:43.260 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.257+0000 7f9588c81700 1 -- 172.21.15.71:0/3439978950 wait complete. 2023-10-06T01:42:43.260 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 39 2023-10-06T01:42:43.271 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T01:42:43.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.383+0000 7f2ef7112700 1 Processor -- start 2023-10-06T01:42:43.385 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.383+0000 7f2ef7112700 1 -- start start 2023-10-06T01:42:43.387 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.384+0000 7f2ef7112700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f2ef00af8b0 0x7f2ef015d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:43.387 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.384+0000 7f2ef7112700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2ef00b27f0 0x7f2ef015d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:43.387 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.384+0000 7f2ef7112700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ef015e190 con 0x7f2ef00af4e0 2023-10-06T01:42:43.387 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.384+0000 7f2ef7112700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ef00b1910 con 0x7f2ef00af8b0 2023-10-06T01:42:43.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.384+0000 7f2ef7112700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ef00cb650 con 0x7f2ef00b27f0 2023-10-06T01:42:43.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.384+0000 7f2ee7fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f2ef00af8b0 0x7f2ef015d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:43.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.384+0000 7f2ef4eae700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f2ef00af4e0 0x7f2ef00b20e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:55374/0 (socket says 172.21.15.71:55374) 2023-10-06T01:42:43.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.384+0000 7f2ef4eae700 1 -- 172.21.15.71:0/3364853979 learned_addr learned my addr 172.21.15.71:0/3364853979 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:42:43.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.384+0000 7f2ee7fff700 1 -- 172.21.15.71:0/3364853979 >> v2:172.21.15.72:3300/0 conn(0x7f2ef00b27f0 msgr2=0x7f2ef015d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:43.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.384+0000 7f2ef56af700 1 --2- 172.21.15.71:0/3364853979 >> v2:172.21.15.72:3300/0 conn(0x7f2ef00b27f0 0x7f2ef015d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:43.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.384+0000 7f2ee77fe700 1 -- 172.21.15.71:0/3364853979 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 43815298 0 0) 0x7f2ef015e190 con 0x7f2ef00af4e0 2023-10-06T01:42:43.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.384+0000 7f2ee7fff700 1 --2- 172.21.15.71:0/3364853979 >> v2:172.21.15.72:3300/0 conn(0x7f2ef00b27f0 0x7f2ef015d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:43.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.384+0000 7f2ee7fff700 1 -- 172.21.15.71:0/3364853979 >> v1:172.21.15.71:6789/0 conn(0x7f2ef00af4e0 legacy=0x7f2ef00b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:43.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.384+0000 7f2ee7fff700 1 -- 172.21.15.71:0/3364853979 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ef00ccaf0 con 0x7f2ef00af8b0 2023-10-06T01:42:43.388 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.384+0000 7f2ef56af700 1 --2- 172.21.15.71:0/3364853979 >> v2:172.21.15.72:3300/0 conn(0x7f2ef00b27f0 0x7f2ef015d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:42:43.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.385+0000 7f2ee7fff700 1 --2- 172.21.15.71:0/3364853979 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ef00af8b0 0x7f2ef015d460 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f2ef00c7280 tx=0x7f2ee00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5c1e5aca2966094 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:43.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.385+0000 7f2ee77fe700 1 -- 172.21.15.71:0/3364853979 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee000b6b0 con 0x7f2ef00af8b0 2023-10-06T01:42:43.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.385+0000 7f2ee77fe700 1 -- 172.21.15.71:0/3364853979 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ee000b810 con 0x7f2ef00af8b0 2023-10-06T01:42:43.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.385+0000 7f2ee77fe700 1 -- 172.21.15.71:0/3364853979 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee000bbb0 con 0x7f2ef00af8b0 2023-10-06T01:42:43.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.385+0000 7f2ef7112700 1 -- 172.21.15.71:0/3364853979 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ef00af8b0 msgr2=0x7f2ef015d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:43.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.385+0000 7f2ef7112700 1 --2- 172.21.15.71:0/3364853979 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ef00af8b0 0x7f2ef015d460 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f2ef00c7280 tx=0x7f2ee00091a0 comp rx=0 tx=0).stop 2023-10-06T01:42:43.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.385+0000 7f2ef7112700 1 -- 172.21.15.71:0/3364853979 shutdown_connections 2023-10-06T01:42:43.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.385+0000 7f2ef7112700 1 --2- 172.21.15.71:0/3364853979 >> v2:172.21.15.72:3300/0 conn(0x7f2ef00b27f0 0x7f2ef015d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:43.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.385+0000 7f2ef7112700 1 --2- 172.21.15.71:0/3364853979 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ef00af8b0 0x7f2ef015d460 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:43.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.385+0000 7f2ef7112700 1 -- 172.21.15.71:0/3364853979 >> 172.21.15.71:0/3364853979 conn(0x7f2ef0068680 msgr2=0x7f2ef0068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:43.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.385+0000 7f2ef7112700 1 -- 172.21.15.71:0/3364853979 shutdown_connections 2023-10-06T01:42:43.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.385+0000 7f2ef7112700 1 -- 172.21.15.71:0/3364853979 wait complete. 2023-10-06T01:42:43.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.386+0000 7f2ef7112700 1 Processor -- start 2023-10-06T01:42:43.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.387+0000 7f2ef7112700 1 -- start start 2023-10-06T01:42:43.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.387+0000 7f2ef7112700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ef00af4e0 0x7f2ef016a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:43.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.387+0000 7f2ef7112700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2ef00af8b0 0x7f2ef0154340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:43.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.387+0000 7f2ef7112700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ef00b27f0 0x7f2ef0154880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:43.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.387+0000 7f2ef7112700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef00c8360 con 0x7f2ef00af4e0 2023-10-06T01:42:43.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.387+0000 7f2ef7112700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef00c8600 con 0x7f2ef00b27f0 2023-10-06T01:42:43.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.387+0000 7f2ef7112700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef0169ed0 con 0x7f2ef00af8b0 2023-10-06T01:42:43.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.387+0000 7f2ef4eae700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ef00af4e0 0x7f2ef016a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:43.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.387+0000 7f2ef4eae700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ef00af4e0 0x7f2ef016a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:42994/0 (socket says 172.21.15.71:42994) 2023-10-06T01:42:43.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.387+0000 7f2ef4eae700 1 -- 172.21.15.71:0/4073115049 learned_addr learned my addr 172.21.15.71:0/4073115049 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:43.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.388+0000 7f2ee7fff700 1 --2- 172.21.15.71:0/4073115049 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2ef00af8b0 0x7f2ef0154340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:43.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.388+0000 7f2ef56af700 1 --2- 172.21.15.71:0/4073115049 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ef00b27f0 0x7f2ef0154880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:43.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.388+0000 7f2ef4eae700 1 -- 172.21.15.71:0/4073115049 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2ef00af8b0 msgr2=0x7f2ef0154340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:43.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.388+0000 7f2ef4eae700 1 --2- 172.21.15.71:0/4073115049 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2ef00af8b0 0x7f2ef0154340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:43.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.388+0000 7f2ef4eae700 1 -- 172.21.15.71:0/4073115049 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ef00b27f0 msgr2=0x7f2ef0154880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:43.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.388+0000 7f2ef4eae700 1 --2- 172.21.15.71:0/4073115049 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ef00b27f0 0x7f2ef0154880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:43.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.388+0000 7f2ef4eae700 1 -- 172.21.15.71:0/4073115049 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ee0009420 con 0x7f2ef00af4e0 2023-10-06T01:42:43.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.388+0000 7f2ee7fff700 1 --2- 172.21.15.71:0/4073115049 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2ef00af8b0 0x7f2ef0154340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:42:43.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.388+0000 7f2ef56af700 1 --2- 172.21.15.71:0/4073115049 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ef00b27f0 0x7f2ef0154880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:42:43.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.388+0000 7f2ef4eae700 1 --2- 172.21.15.71:0/4073115049 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ef00af4e0 0x7f2ef016a5f0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f2eec00c5b0 tx=0x7f2eec001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:43.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.388+0000 7f2ee4ff9700 1 -- 172.21.15.71:0/4073115049 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eec005b30 con 0x7f2ef00af4e0 2023-10-06T01:42:43.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.388+0000 7f2ee4ff9700 1 -- 172.21.15.71:0/4073115049 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eec005c90 con 0x7f2ef00af4e0 2023-10-06T01:42:43.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.388+0000 7f2ef7112700 1 -- 172.21.15.71:0/4073115049 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ef0154ec0 con 0x7f2ef00af4e0 2023-10-06T01:42:43.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.388+0000 7f2ee4ff9700 1 -- 172.21.15.71:0/4073115049 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eec007300 con 0x7f2ef00af4e0 2023-10-06T01:42:43.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.388+0000 7f2ef7112700 1 -- 172.21.15.71:0/4073115049 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ef0155480 con 0x7f2ef00af4e0 2023-10-06T01:42:43.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.389+0000 7f2ef7112700 1 -- 172.21.15.71:0/4073115049 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ef0088aa0 con 0x7f2ef00af4e0 2023-10-06T01:42:43.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.389+0000 7f2ee4ff9700 1 -- 172.21.15.71:0/4073115049 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2eec01b3b0 con 0x7f2ef00af4e0 2023-10-06T01:42:43.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.390+0000 7f2ee4ff9700 1 --2- 172.21.15.71:0/4073115049 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f2edc066f30 0x7f2edc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:43.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.390+0000 7f2ee4ff9700 1 -- 172.21.15.71:0/4073115049 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f2eec083d70 con 0x7f2ef00af4e0 2023-10-06T01:42:43.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.390+0000 7f2ee7fff700 1 --2- 172.21.15.71:0/4073115049 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f2edc066f30 0x7f2edc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:43.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.390+0000 7f2ee7fff700 1 --2- 172.21.15.71:0/4073115049 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f2edc066f30 0x7f2edc0693e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f2ef00c7280 tx=0x7f2ee0017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:43.395 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.394+0000 7f2ee4ff9700 1 -- 172.21.15.71:0/4073115049 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2eec050cf0 con 0x7f2ef00af4e0 2023-10-06T01:42:43.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.618+0000 7f2ef7112700 1 -- 172.21.15.71:0/4073115049 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2ef015c4f0 con 0x7f2ef00af4e0 2023-10-06T01:42:43.620 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.618+0000 7f2ee4ff9700 1 -- 172.21.15.71:0/4073115049 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4595 (secure 0 0 0) 0x7f2eec017020 con 0x7f2ef00af4e0 2023-10-06T01:42:43.620 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:42:43.620 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":39,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5171,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/3015768753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":3015768753},{"type":"v1","addr":"172.21.15.72:6835","nonce":3015768753}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5572,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6833/698854056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":698854056},{"type":"v1","addr":"172.21.15.72:6833","nonce":698854056}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":5811,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/2808450062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":2808450062},{"type":"v1","addr":"172.21.15.71:6835","nonce":2808450062}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T01:41:59.290125+0000","modified":"2023-10-06T01:42:38.037440+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":57,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5823},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5823":{"gid":5823,"name":"c","rank":0,"incarnation":36,"state":"up:active","state_seq":4,"addr":"172.21.15.71:6837/2318258263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":2318258263},{"type":"v1","addr":"172.21.15.71:6837","nonce":2318258263}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T01:42:43.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.620+0000 7f2ef7112700 1 -- 172.21.15.71:0/4073115049 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f2edc066f30 msgr2=0x7f2edc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:43.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.620+0000 7f2ef7112700 1 --2- 172.21.15.71:0/4073115049 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f2edc066f30 0x7f2edc0693e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f2ef00c7280 tx=0x7f2ee0017000 comp rx=0 tx=0).stop 2023-10-06T01:42:43.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.620+0000 7f2ef7112700 1 -- 172.21.15.71:0/4073115049 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ef00af4e0 msgr2=0x7f2ef016a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:43.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.620+0000 7f2ef7112700 1 --2- 172.21.15.71:0/4073115049 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ef00af4e0 0x7f2ef016a5f0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f2eec00c5b0 tx=0x7f2eec001070 comp rx=0 tx=0).stop 2023-10-06T01:42:43.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.620+0000 7f2ef7112700 1 -- 172.21.15.71:0/4073115049 shutdown_connections 2023-10-06T01:42:43.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.620+0000 7f2ef7112700 1 --2- 172.21.15.71:0/4073115049 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f2edc066f30 0x7f2edc0693e0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:43.623 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.620+0000 7f2ef7112700 1 --2- 172.21.15.71:0/4073115049 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ef00b27f0 0x7f2ef0154880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:43.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.620+0000 7f2ef7112700 1 --2- 172.21.15.71:0/4073115049 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ef00af4e0 0x7f2ef016a5f0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:43.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.620+0000 7f2ef7112700 1 --2- 172.21.15.71:0/4073115049 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2ef00af8b0 0x7f2ef0154340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:43.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.620+0000 7f2ef7112700 1 -- 172.21.15.71:0/4073115049 >> 172.21.15.71:0/4073115049 conn(0x7f2ef0068680 msgr2=0x7f2ef00b5310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:43.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.620+0000 7f2ef7112700 1 -- 172.21.15.71:0/4073115049 shutdown_connections 2023-10-06T01:42:43.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.620+0000 7f2ef7112700 1 -- 172.21.15.71:0/4073115049 wait complete. 2023-10-06T01:42:43.624 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 39 2023-10-06T01:42:43.634 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:42:43.749 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.747+0000 7f4e4b9dc700 1 Processor -- start 2023-10-06T01:42:43.749 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.747+0000 7f4e4b9dc700 1 -- start start 2023-10-06T01:42:43.752 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.748+0000 7f4e4b9dc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4e440af8b0 0x7f4e4415d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:43.752 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.748+0000 7f4e4b9dc700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4e440b27f0 0x7f4e4415d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:43.752 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.748+0000 7f4e4b9dc700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e4415e190 con 0x7f4e440af4e0 2023-10-06T01:42:43.752 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.748+0000 7f4e4b9dc700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e440b1910 con 0x7f4e440b27f0 2023-10-06T01:42:43.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.748+0000 7f4e4b9dc700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e440cb650 con 0x7f4e440af8b0 2023-10-06T01:42:43.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.748+0000 7f4e49778700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f4e440af4e0 0x7f4e440b20e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:55388/0 (socket says 172.21.15.71:55388) 2023-10-06T01:42:43.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.748+0000 7f4e49778700 1 -- 172.21.15.71:0/943131330 learned_addr learned my addr 172.21.15.71:0/943131330 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:42:43.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.748+0000 7f4e49f79700 1 --2- 172.21.15.71:0/943131330 >> v2:172.21.15.71:3300/0 conn(0x7f4e440b27f0 0x7f4e4415d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:43.753 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.748+0000 7f4e3bfff700 1 -- 172.21.15.71:0/943131330 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 319790010 0 0) 0x7f4e4415e190 con 0x7f4e440af4e0 2023-10-06T01:42:43.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.748+0000 7f4e3bfff700 1 -- 172.21.15.71:0/943131330 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e30003570 con 0x7f4e440af4e0 2023-10-06T01:42:43.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.748+0000 7f4e48f77700 1 --2- 172.21.15.71:0/943131330 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4e440af8b0 0x7f4e4415d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:43.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.748+0000 7f4e49f79700 1 -- 172.21.15.71:0/943131330 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4e440af8b0 msgr2=0x7f4e4415d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:43.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.748+0000 7f4e49f79700 1 --2- 172.21.15.71:0/943131330 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4e440af8b0 0x7f4e4415d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:43.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.748+0000 7f4e49f79700 1 -- 172.21.15.71:0/943131330 >> v1:172.21.15.71:6789/0 conn(0x7f4e440af4e0 legacy=0x7f4e440b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:43.754 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.748+0000 7f4e49f79700 1 -- 172.21.15.71:0/943131330 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e440ccaf0 con 0x7f4e440b27f0 2023-10-06T01:42:43.755 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.749+0000 7f4e48f77700 1 --2- 172.21.15.71:0/943131330 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4e440af8b0 0x7f4e4415d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:42:43.755 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.749+0000 7f4e49f79700 1 --2- 172.21.15.71:0/943131330 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e440b27f0 0x7f4e4415d9a0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c0098e0 tx=0x7f4e3c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46a8d568d20378c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:43.755 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.749+0000 7f4e3bfff700 1 -- 172.21.15.71:0/943131330 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e3c00b640 con 0x7f4e440b27f0 2023-10-06T01:42:43.755 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.749+0000 7f4e3bfff700 1 -- 172.21.15.71:0/943131330 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e3c00b7a0 con 0x7f4e440b27f0 2023-10-06T01:42:43.755 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.749+0000 7f4e3bfff700 1 -- 172.21.15.71:0/943131330 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e3c00bb20 con 0x7f4e440b27f0 2023-10-06T01:42:43.755 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.749+0000 7f4e4b9dc700 1 -- 172.21.15.71:0/943131330 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e440b27f0 msgr2=0x7f4e4415d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:43.756 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.749+0000 7f4e4b9dc700 1 --2- 172.21.15.71:0/943131330 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e440b27f0 0x7f4e4415d9a0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c0098e0 tx=0x7f4e3c0091a0 comp rx=0 tx=0).stop 2023-10-06T01:42:43.756 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.749+0000 7f4e4b9dc700 1 -- 172.21.15.71:0/943131330 shutdown_connections 2023-10-06T01:42:43.756 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.749+0000 7f4e4b9dc700 1 --2- 172.21.15.71:0/943131330 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e440b27f0 0x7f4e4415d9a0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:43.756 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.749+0000 7f4e4b9dc700 1 --2- 172.21.15.71:0/943131330 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4e440af8b0 0x7f4e4415d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:43.756 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.749+0000 7f4e4b9dc700 1 -- 172.21.15.71:0/943131330 >> 172.21.15.71:0/943131330 conn(0x7f4e44068680 msgr2=0x7f4e44068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:43.756 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.749+0000 7f4e4b9dc700 1 -- 172.21.15.71:0/943131330 shutdown_connections 2023-10-06T01:42:43.757 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.749+0000 7f4e4b9dc700 1 -- 172.21.15.71:0/943131330 wait complete. 2023-10-06T01:42:43.757 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.750+0000 7f4e4b9dc700 1 Processor -- start 2023-10-06T01:42:43.757 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.751+0000 7f4e4b9dc700 1 -- start start 2023-10-06T01:42:43.759 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.751+0000 7f4e4b9dc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4e440af4e0 0x7f4e44150a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:43.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.751+0000 7f4e4b9dc700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e440af8b0 0x7f4e440ce210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:43.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.751+0000 7f4e4b9dc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e440b27f0 0x7f4e440c7b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:43.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.751+0000 7f4e4b9dc700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e44153780 con 0x7f4e440af8b0 2023-10-06T01:42:43.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.751+0000 7f4e4b9dc700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e440d1150 con 0x7f4e440b27f0 2023-10-06T01:42:43.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.751+0000 7f4e4b9dc700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e44150f70 con 0x7f4e440af4e0 2023-10-06T01:42:43.760 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.752+0000 7f4e48f77700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e440af8b0 0x7f4e440ce210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:43.761 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.752+0000 7f4e48f77700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e440af8b0 0x7f4e440ce210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:43008/0 (socket says 172.21.15.71:43008) 2023-10-06T01:42:43.761 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.752+0000 7f4e48f77700 1 -- 172.21.15.71:0/1452627319 learned_addr learned my addr 172.21.15.71:0/1452627319 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:43.761 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.752+0000 7f4e49f79700 1 --2- 172.21.15.71:0/1452627319 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e440b27f0 0x7f4e440c7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:43.761 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.752+0000 7f4e49778700 1 --2- 172.21.15.71:0/1452627319 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4e440af4e0 0x7f4e44150a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:43.761 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.752+0000 7f4e48f77700 1 -- 172.21.15.71:0/1452627319 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4e440af4e0 msgr2=0x7f4e44150a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:43.762 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.752+0000 7f4e48f77700 1 --2- 172.21.15.71:0/1452627319 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4e440af4e0 0x7f4e44150a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:43.762 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.752+0000 7f4e48f77700 1 -- 172.21.15.71:0/1452627319 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e440b27f0 msgr2=0x7f4e440c7b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:43.762 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.752+0000 7f4e48f77700 1 --2- 172.21.15.71:0/1452627319 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e440b27f0 0x7f4e440c7b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:43.762 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.752+0000 7f4e48f77700 1 -- 172.21.15.71:0/1452627319 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e3c009420 con 0x7f4e440af8b0 2023-10-06T01:42:43.762 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.752+0000 7f4e49f79700 1 --2- 172.21.15.71:0/1452627319 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e440b27f0 0x7f4e440c7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:42:43.762 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.752+0000 7f4e48f77700 1 --2- 172.21.15.71:0/1452627319 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e440af8b0 0x7f4e440ce210 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f4e3400c830 tx=0x7f4e34008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:43.762 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.752+0000 7f4e397fa700 1 -- 172.21.15.71:0/1452627319 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e34011600 con 0x7f4e440af8b0 2023-10-06T01:42:43.762 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.752+0000 7f4e397fa700 1 -- 172.21.15.71:0/1452627319 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e34011760 con 0x7f4e440af8b0 2023-10-06T01:42:43.762 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.752+0000 7f4e4b9dc700 1 -- 172.21.15.71:0/1452627319 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e440d0e70 con 0x7f4e440af8b0 2023-10-06T01:42:43.762 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.752+0000 7f4e397fa700 1 -- 172.21.15.71:0/1452627319 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e34011b20 con 0x7f4e440af8b0 2023-10-06T01:42:43.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.752+0000 7f4e4b9dc700 1 -- 172.21.15.71:0/1452627319 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e44153c90 con 0x7f4e440af8b0 2023-10-06T01:42:43.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.753+0000 7f4e4b9dc700 1 -- 172.21.15.71:0/1452627319 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e44088aa0 con 0x7f4e440af8b0 2023-10-06T01:42:43.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.754+0000 7f4e397fa700 1 -- 172.21.15.71:0/1452627319 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4e3400a3e0 con 0x7f4e440af8b0 2023-10-06T01:42:43.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.754+0000 7f4e397fa700 1 --2- 172.21.15.71:0/1452627319 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f4e28066f30 0x7f4e280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:43.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.754+0000 7f4e397fa700 1 -- 172.21.15.71:0/1452627319 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f4e34084ce0 con 0x7f4e440af8b0 2023-10-06T01:42:43.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.754+0000 7f4e49778700 1 --2- 172.21.15.71:0/1452627319 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f4e28066f30 0x7f4e280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:43.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.754+0000 7f4e49778700 1 --2- 172.21.15.71:0/1452627319 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f4e28066f30 0x7f4e280693e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f4e40005c50 tx=0x7f4e40009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:43.763 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.758+0000 7f4e397fa700 1 -- 172.21.15.71:0/1452627319 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4e34051c60 con 0x7f4e440af8b0 2023-10-06T01:42:43.941 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.940+0000 7f4e4b9dc700 1 -- 172.21.15.71:0/1452627319 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4e440b0910 con 0x7f4e440af8b0 2023-10-06T01:42:43.942 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.941+0000 7f4e397fa700 1 -- 172.21.15.71:0/1452627319 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+17150 (secure 0 0 0) 0x7f4e34015090 con 0x7f4e440af8b0 2023-10-06T01:42:43.943 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:42:43.943 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":58,"fsid":"1fbf1bd2-f9b4-4599-bea2-f4aa920e9a56","created":"2023-10-06T01:39:57.016957+0000","modified":"2023-10-06T01:42:34.021528+0000","last_up_change":"2023-10-06T01:40:08.571643+0000","last_in_change":"2023-10-06T01:39:59.462741+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T01:40:08.610349+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T01:40:15.387434+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-06T01:41:56.925792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-06T01:41:58.259205+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cf059188-fb20-4dbf-95db-dcf57b213d03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":90670},{"type":"v1","addr":"172.21.15.71:6817","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":90670},{"type":"v1","addr":"172.21.15.71:6819","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":90670},{"type":"v1","addr":"172.21.15.71:6823","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":90670},{"type":"v1","addr":"172.21.15.71:6821","nonce":90670}]},"public_addr":"172.21.15.71:6817/90670","cluster_addr":"172.21.15.71:6819/90670","heartbeat_back_addr":"172.21.15.71:6823/90670","heartbeat_front_addr":"172.21.15.71:6821/90670","state":["exists","up"]},{"osd":1,"uuid":"0cff0aae-1799-4fe0-b610-54cf0813c0e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":90669},{"type":"v1","addr":"172.21.15.71:6809","nonce":90669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":90669},{"type":"v1","addr":"172.21.15.71:6811","nonce":90669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":90669},{"type":"v1","addr":"172.21.15.71:6815","nonce":90669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":90669},{"type":"v1","addr":"172.21.15.71:6813","nonce":90669}]},"public_addr":"172.21.15.71:6809/90669","cluster_addr":"172.21.15.71:6811/90669","heartbeat_back_addr":"172.21.15.71:6815/90669","heartbeat_front_addr":"172.21.15.71:6813/90669","state":["exists","up"]},{"osd":2,"uuid":"88d61ddc-9031-44e1-ba8c-546a41e7c8ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":90679},{"type":"v1","addr":"172.21.15.71:6825","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":90679},{"type":"v1","addr":"172.21.15.71:6827","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":90679},{"type":"v1","addr":"172.21.15.71:6831","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":90679},{"type":"v1","addr":"172.21.15.71:6829","nonce":90679}]},"public_addr":"172.21.15.71:6825/90679","cluster_addr":"172.21.15.71:6827/90679","heartbeat_back_addr":"172.21.15.71:6831/90679","heartbeat_front_addr":"172.21.15.71:6829/90679","state":["exists","up"]},{"osd":3,"uuid":"11ed92b7-960b-4a30-a889-a61d3eeb86f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":90668},{"type":"v1","addr":"172.21.15.71:6801","nonce":90668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":90668},{"type":"v1","addr":"172.21.15.71:6803","nonce":90668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":90668},{"type":"v1","addr":"172.21.15.71:6807","nonce":90668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":90668},{"type":"v1","addr":"172.21.15.71:6805","nonce":90668}]},"public_addr":"172.21.15.71:6801/90668","cluster_addr":"172.21.15.71:6803/90668","heartbeat_back_addr":"172.21.15.71:6807/90668","heartbeat_front_addr":"172.21.15.71:6805/90668","state":["exists","up"]},{"osd":4,"uuid":"ae4df784-abdf-4ddf-aefa-780f3ddafef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":90917},{"type":"v1","addr":"172.21.15.72:6801","nonce":90917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":90917},{"type":"v1","addr":"172.21.15.72:6803","nonce":90917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":90917},{"type":"v1","addr":"172.21.15.72:6807","nonce":90917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":90917},{"type":"v1","addr":"172.21.15.72:6805","nonce":90917}]},"public_addr":"172.21.15.72:6801/90917","cluster_addr":"172.21.15.72:6803/90917","heartbeat_back_addr":"172.21.15.72:6807/90917","heartbeat_front_addr":"172.21.15.72:6805/90917","state":["exists","up"]},{"osd":5,"uuid":"5ef0790f-001e-458f-a05b-efae216cf435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":90941},{"type":"v1","addr":"172.21.15.72:6817","nonce":90941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":90941},{"type":"v1","addr":"172.21.15.72:6819","nonce":90941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":90941},{"type":"v1","addr":"172.21.15.72:6827","nonce":90941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":90941},{"type":"v1","addr":"172.21.15.72:6823","nonce":90941}]},"public_addr":"172.21.15.72:6817/90941","cluster_addr":"172.21.15.72:6819/90941","heartbeat_back_addr":"172.21.15.72:6827/90941","heartbeat_front_addr":"172.21.15.72:6823/90941","state":["exists","up"]},{"osd":6,"uuid":"8705aef1-9ae8-4e54-a3c4-c2909fa0ceb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":90918},{"type":"v1","addr":"172.21.15.72:6809","nonce":90918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":90918},{"type":"v1","addr":"172.21.15.72:6811","nonce":90918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":90918},{"type":"v1","addr":"172.21.15.72:6815","nonce":90918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":90918},{"type":"v1","addr":"172.21.15.72:6813","nonce":90918}]},"public_addr":"172.21.15.72:6809/90918","cluster_addr":"172.21.15.72:6811/90918","heartbeat_back_addr":"172.21.15.72:6815/90918","heartbeat_front_addr":"172.21.15.72:6813/90918","state":["exists","up"]},{"osd":7,"uuid":"364c5119-6b13-4c75-b3f0-15e165eff86a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":90948},{"type":"v1","addr":"172.21.15.72:6822","nonce":90948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":90948},{"type":"v1","addr":"172.21.15.72:6826","nonce":90948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":90948},{"type":"v1","addr":"172.21.15.72:6831","nonce":90948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":90948},{"type":"v1","addr":"172.21.15.72:6829","nonce":90948}]},"public_addr":"172.21.15.72:6822/90948","cluster_addr":"172.21.15.72:6826/90948","heartbeat_back_addr":"172.21.15.72:6831/90948","heartbeat_front_addr":"172.21.15.72:6829/90948","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.642976+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.645372+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.619116+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.663042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.599163+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.646411+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.631545+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.669821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.72:6835/627948818":"2023-10-07T01:42:34.014707+0000","172.21.15.72:6833/627948818":"2023-10-07T01:42:34.014707+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:42:43.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.943+0000 7f4e4b9dc700 1 -- 172.21.15.71:0/1452627319 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f4e28066f30 msgr2=0x7f4e280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:43.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.943+0000 7f4e4b9dc700 1 --2- 172.21.15.71:0/1452627319 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f4e28066f30 0x7f4e280693e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f4e40005c50 tx=0x7f4e40009040 comp rx=0 tx=0).stop 2023-10-06T01:42:43.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.943+0000 7f4e4b9dc700 1 -- 172.21.15.71:0/1452627319 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e440af8b0 msgr2=0x7f4e440ce210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:43.945 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.943+0000 7f4e4b9dc700 1 --2- 172.21.15.71:0/1452627319 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e440af8b0 0x7f4e440ce210 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f4e3400c830 tx=0x7f4e34008040 comp rx=0 tx=0).stop 2023-10-06T01:42:43.946 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.943+0000 7f4e4b9dc700 1 -- 172.21.15.71:0/1452627319 shutdown_connections 2023-10-06T01:42:43.946 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.943+0000 7f4e4b9dc700 1 --2- 172.21.15.71:0/1452627319 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f4e28066f30 0x7f4e280693e0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:43.946 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.943+0000 7f4e4b9dc700 1 --2- 172.21.15.71:0/1452627319 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e440b27f0 0x7f4e440c7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:43.946 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.943+0000 7f4e4b9dc700 1 --2- 172.21.15.71:0/1452627319 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4e440af4e0 0x7f4e44150a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:43.946 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.943+0000 7f4e4b9dc700 1 --2- 172.21.15.71:0/1452627319 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e440af8b0 0x7f4e440ce210 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:43.947 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.943+0000 7f4e4b9dc700 1 -- 172.21.15.71:0/1452627319 >> 172.21.15.71:0/1452627319 conn(0x7f4e44068680 msgr2=0x7f4e441517d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:43.947 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.943+0000 7f4e4b9dc700 1 -- 172.21.15.71:0/1452627319 shutdown_connections 2023-10-06T01:42:43.947 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:43.943+0000 7f4e4b9dc700 1 -- 172.21.15.71:0/1452627319 wait complete. 2023-10-06T01:42:43.957 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T01:42:44.073 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.071+0000 7ff1f905f700 1 Processor -- start 2023-10-06T01:42:44.073 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.072+0000 7ff1f905f700 1 -- start start 2023-10-06T01:42:44.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.072+0000 7ff1f905f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff1f40af3f0 0x7ff1f415a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:44.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.072+0000 7ff1f905f700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff1f40af7c0 0x7ff1f415d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:44.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.072+0000 7ff1f905f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff1f4159960 0x7ff1f415d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:44.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.072+0000 7ff1f905f700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1f415a170 con 0x7ff1f40af7c0 2023-10-06T01:42:44.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.072+0000 7ff1f905f700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1f40caeb0 con 0x7ff1f4159960 2023-10-06T01:42:44.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.072+0000 7ff1f905f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f415db80 con 0x7ff1f40af3f0 2023-10-06T01:42:44.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.072+0000 7ff1f259c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff1f40af7c0 0x7ff1f415d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:44.076 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.073+0000 7ff1f259c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff1f40af7c0 0x7ff1f415d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:43016/0 (socket says 172.21.15.71:43016) 2023-10-06T01:42:44.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.073+0000 7ff1f259c700 1 -- 172.21.15.71:0/1433420828 learned_addr learned my addr 172.21.15.71:0/1433420828 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:44.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.073+0000 7ff1f359e700 1 --2- 172.21.15.71:0/1433420828 >> v2:172.21.15.72:3300/0 conn(0x7ff1f4159960 0x7ff1f415d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:44.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.073+0000 7ff1f2d9d700 1 --2- 172.21.15.71:0/1433420828 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff1f40af3f0 0x7ff1f415a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:44.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.073+0000 7ff1f259c700 1 -- 172.21.15.71:0/1433420828 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff1f40af3f0 msgr2=0x7ff1f415a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:44.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.073+0000 7ff1f259c700 1 --2- 172.21.15.71:0/1433420828 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff1f40af3f0 0x7ff1f415a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:44.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.073+0000 7ff1f259c700 1 -- 172.21.15.71:0/1433420828 >> v2:172.21.15.72:3300/0 conn(0x7ff1f4159960 msgr2=0x7ff1f415d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:44.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.073+0000 7ff1f259c700 1 --2- 172.21.15.71:0/1433420828 >> v2:172.21.15.72:3300/0 conn(0x7ff1f4159960 0x7ff1f415d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:44.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.073+0000 7ff1f259c700 1 -- 172.21.15.71:0/1433420828 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1f415de60 con 0x7ff1f40af7c0 2023-10-06T01:42:44.077 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.073+0000 7ff1f359e700 1 --2- 172.21.15.71:0/1433420828 >> v2:172.21.15.72:3300/0 conn(0x7ff1f4159960 0x7ff1f415d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:42:44.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.073+0000 7ff1f259c700 1 --2- 172.21.15.71:0/1433420828 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1f40af7c0 0x7ff1f415d030 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7ff1f406e070 tx=0x7ff1e8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4927e92691d96a44 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:44.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.073+0000 7ff1f1d9b700 1 -- 172.21.15.71:0/1433420828 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e800b860 con 0x7ff1f40af7c0 2023-10-06T01:42:44.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.073+0000 7ff1f1d9b700 1 -- 172.21.15.71:0/1433420828 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1e800b9c0 con 0x7ff1f40af7c0 2023-10-06T01:42:44.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.073+0000 7ff1f1d9b700 1 -- 172.21.15.71:0/1433420828 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e800bd60 con 0x7ff1f40af7c0 2023-10-06T01:42:44.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.074+0000 7ff1f905f700 1 -- 172.21.15.71:0/1433420828 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1f40af7c0 msgr2=0x7ff1f415d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:44.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.074+0000 7ff1f905f700 1 --2- 172.21.15.71:0/1433420828 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1f40af7c0 0x7ff1f415d030 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7ff1f406e070 tx=0x7ff1e8009250 comp rx=0 tx=0).stop 2023-10-06T01:42:44.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.074+0000 7ff1f905f700 1 -- 172.21.15.71:0/1433420828 shutdown_connections 2023-10-06T01:42:44.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.074+0000 7ff1f905f700 1 --2- 172.21.15.71:0/1433420828 >> v2:172.21.15.72:3300/0 conn(0x7ff1f4159960 0x7ff1f415d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:44.078 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.074+0000 7ff1f905f700 1 --2- 172.21.15.71:0/1433420828 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff1f40af3f0 0x7ff1f415a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:44.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.074+0000 7ff1f905f700 1 --2- 172.21.15.71:0/1433420828 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1f40af7c0 0x7ff1f415d030 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:44.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.074+0000 7ff1f905f700 1 -- 172.21.15.71:0/1433420828 >> 172.21.15.71:0/1433420828 conn(0x7ff1f406a260 msgr2=0x7ff1f40cd030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:44.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.074+0000 7ff1f905f700 1 -- 172.21.15.71:0/1433420828 shutdown_connections 2023-10-06T01:42:44.079 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.074+0000 7ff1f905f700 1 -- 172.21.15.71:0/1433420828 wait complete. 2023-10-06T01:42:44.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.075+0000 7ff1f905f700 1 Processor -- start 2023-10-06T01:42:44.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.075+0000 7ff1f905f700 1 -- start start 2023-10-06T01:42:44.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.076+0000 7ff1f905f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff1f40af3f0 0x7ff1f40c6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:44.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.076+0000 7ff1f905f700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1f4159960 0x7ff1f414ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:44.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.076+0000 7ff1f905f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff1f40c40e0 0x7ff1f41586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:44.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.076+0000 7ff1f905f700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f414b150 con 0x7ff1f4159960 2023-10-06T01:42:44.082 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.076+0000 7ff1f905f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f416a760 con 0x7ff1f40c40e0 2023-10-06T01:42:44.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.076+0000 7ff1f905f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f4169e30 con 0x7ff1f40af3f0 2023-10-06T01:42:44.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.076+0000 7ff1f259c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1f4159960 0x7ff1f414ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:44.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.076+0000 7ff1f259c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1f4159960 0x7ff1f414ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:43032/0 (socket says 172.21.15.71:43032) 2023-10-06T01:42:44.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.076+0000 7ff1f259c700 1 -- 172.21.15.71:0/628727500 learned_addr learned my addr 172.21.15.71:0/628727500 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:44.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.076+0000 7ff1f359e700 1 --2- 172.21.15.71:0/628727500 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff1f40c40e0 0x7ff1f41586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:44.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.076+0000 7ff1f2d9d700 1 --2- 172.21.15.71:0/628727500 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff1f40af3f0 0x7ff1f40c6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:44.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.076+0000 7ff1f259c700 1 -- 172.21.15.71:0/628727500 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff1f40af3f0 msgr2=0x7ff1f40c6ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:44.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.076+0000 7ff1f259c700 1 --2- 172.21.15.71:0/628727500 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff1f40af3f0 0x7ff1f40c6ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:44.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.076+0000 7ff1f259c700 1 -- 172.21.15.71:0/628727500 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff1f40c40e0 msgr2=0x7ff1f41586a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:44.083 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.076+0000 7ff1f259c700 1 --2- 172.21.15.71:0/628727500 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff1f40c40e0 0x7ff1f41586a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:44.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.076+0000 7ff1f259c700 1 -- 172.21.15.71:0/628727500 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1e80094f0 con 0x7ff1f4159960 2023-10-06T01:42:44.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.076+0000 7ff1f259c700 1 --2- 172.21.15.71:0/628727500 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1f4159960 0x7ff1f414ac10 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7ff1e8009290 tx=0x7ff1e8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:44.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.076+0000 7ff1daffd700 1 -- 172.21.15.71:0/628727500 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e8011e40 con 0x7ff1f4159960 2023-10-06T01:42:44.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.076+0000 7ff1daffd700 1 -- 172.21.15.71:0/628727500 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1e801f070 con 0x7ff1f4159960 2023-10-06T01:42:44.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.076+0000 7ff1f905f700 1 -- 172.21.15.71:0/628727500 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1f416a110 con 0x7ff1f4159960 2023-10-06T01:42:44.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.076+0000 7ff1daffd700 1 -- 172.21.15.71:0/628727500 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e80266d0 con 0x7ff1f4159960 2023-10-06T01:42:44.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.076+0000 7ff1f905f700 1 -- 172.21.15.71:0/628727500 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1f4169aa0 con 0x7ff1f4159960 2023-10-06T01:42:44.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.077+0000 7ff1f905f700 1 -- 172.21.15.71:0/628727500 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1f416aaf0 con 0x7ff1f4159960 2023-10-06T01:42:44.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.078+0000 7ff1daffd700 1 -- 172.21.15.71:0/628727500 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff1e8026a40 con 0x7ff1f4159960 2023-10-06T01:42:44.084 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.078+0000 7ff1daffd700 1 --2- 172.21.15.71:0/628727500 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7ff1e0066f30 0x7ff1e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:44.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.078+0000 7ff1f2d9d700 1 --2- 172.21.15.71:0/628727500 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7ff1e0066f30 0x7ff1e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:44.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.078+0000 7ff1daffd700 1 -- 172.21.15.71:0/628727500 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6464+0+0 (secure 0 0 0) 0x7ff1e8021070 con 0x7ff1f4159960 2023-10-06T01:42:44.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.079+0000 7ff1f2d9d700 1 --2- 172.21.15.71:0/628727500 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7ff1e0066f30 0x7ff1e00693e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ff1e4006fd0 tx=0x7ff1e4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:44.085 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.083+0000 7ff1daffd700 1 -- 172.21.15.71:0/628727500 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff1f416aaf0 con 0x7ff1f4159960 2023-10-06T01:42:44.308 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.307+0000 7ff1f905f700 1 -- 172.21.15.71:0/628727500 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7ff1f416aaf0 con 0x7ff1f4159960 2023-10-06T01:42:44.309 INFO:tasks.ceph.mon.a.smithi071.stderr:2023-10-06T01:42:44.308+0000 7fec89f1c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T01:42:44.313 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.312+0000 7ff1daffd700 1 -- 172.21.15.71:0/628727500 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v40) v1 ==== 161+0+0 (secure 0 0 0) 0x7ff1f416aaf0 con 0x7ff1f4159960 2023-10-06T01:42:44.315 INFO:tasks.ceph.mds.c.smithi071.stderr: -182> 2023-10-06T01:42:41.024+0000 7fd42fd80700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T01:42:44.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.315+0000 7ff1f905f700 1 -- 172.21.15.71:0/628727500 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7ff1e0066f30 msgr2=0x7ff1e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:44.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.315+0000 7ff1f905f700 1 --2- 172.21.15.71:0/628727500 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7ff1e0066f30 0x7ff1e00693e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ff1e4006fd0 tx=0x7ff1e4008040 comp rx=0 tx=0).stop 2023-10-06T01:42:44.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.315+0000 7ff1f905f700 1 -- 172.21.15.71:0/628727500 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1f4159960 msgr2=0x7ff1f414ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:44.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.315+0000 7ff1f905f700 1 --2- 172.21.15.71:0/628727500 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1f4159960 0x7ff1f414ac10 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7ff1e8009290 tx=0x7ff1e8017000 comp rx=0 tx=0).stop 2023-10-06T01:42:44.318 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.315+0000 7ff1f905f700 1 -- 172.21.15.71:0/628727500 shutdown_connections 2023-10-06T01:42:44.318 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.315+0000 7ff1f905f700 1 --2- 172.21.15.71:0/628727500 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7ff1e0066f30 0x7ff1e00693e0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:44.318 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.315+0000 7ff1f905f700 1 --2- 172.21.15.71:0/628727500 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff1f40c40e0 0x7ff1f41586a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:44.318 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.315+0000 7ff1f905f700 1 --2- 172.21.15.71:0/628727500 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff1f40af3f0 0x7ff1f40c6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:44.318 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.315+0000 7ff1f905f700 1 --2- 172.21.15.71:0/628727500 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1f4159960 0x7ff1f414ac10 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:44.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.315+0000 7ff1f905f700 1 -- 172.21.15.71:0/628727500 >> 172.21.15.71:0/628727500 conn(0x7ff1f406a260 msgr2=0x7ff1f406d940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:44.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.315+0000 7ff1f905f700 1 -- 172.21.15.71:0/628727500 shutdown_connections 2023-10-06T01:42:44.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.315+0000 7ff1f905f700 1 -- 172.21.15.71:0/628727500 wait complete. 2023-10-06T01:42:44.320 INFO:teuthology.orchestra.run.smithi071.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T01:42:44.330 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T01:42:44.335 INFO:tasks.ceph.mds.c.smithi071.stdout:starting mds.c at 2023-10-06T01:42:44.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.444+0000 7f4e17989700 1 Processor -- start 2023-10-06T01:42:44.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.445+0000 7f4e17989700 1 -- start start 2023-10-06T01:42:44.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.445+0000 7f4e17989700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4e1015cae0 0x7f4e100c8730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:44.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.445+0000 7f4e17989700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4e1006a910 0x7f4e1006ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:44.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.445+0000 7f4e17989700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4e100c2e90 0x7f4e100c3310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:44.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.445+0000 7f4e17989700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e1006a1a0 con 0x7f4e1006a910 2023-10-06T01:42:44.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.445+0000 7f4e17989700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e1006a480 con 0x7f4e1015cae0 2023-10-06T01:42:44.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.445+0000 7f4e17989700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1006b2d0 con 0x7f4e100c2e90 2023-10-06T01:42:44.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.446+0000 7f4e14f24700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4e1006a910 0x7f4e1006ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:44.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.446+0000 7f4e14f24700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f4e1006a910 0x7f4e1006ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:43060/0 (socket says 172.21.15.71:43060) 2023-10-06T01:42:44.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.446+0000 7f4e14f24700 1 -- 172.21.15.71:0/186393627 learned_addr learned my addr 172.21.15.71:0/186393627 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:44.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.446+0000 7f4e15f26700 1 --2- 172.21.15.71:0/186393627 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4e100c2e90 0x7f4e100c3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:44.449 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.446+0000 7f4e15725700 1 --2- 172.21.15.71:0/186393627 >> v2:172.21.15.72:3300/0 conn(0x7f4e1015cae0 0x7f4e100c8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:44.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.446+0000 7f4e14f24700 1 -- 172.21.15.71:0/186393627 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4e100c2e90 msgr2=0x7f4e100c3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:44.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.446+0000 7f4e14f24700 1 --2- 172.21.15.71:0/186393627 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4e100c2e90 0x7f4e100c3310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:44.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.446+0000 7f4e14f24700 1 -- 172.21.15.71:0/186393627 >> v2:172.21.15.72:3300/0 conn(0x7f4e1015cae0 msgr2=0x7f4e100c8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:44.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.446+0000 7f4e14f24700 1 --2- 172.21.15.71:0/186393627 >> v2:172.21.15.72:3300/0 conn(0x7f4e1015cae0 0x7f4e100c8730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:44.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.446+0000 7f4e14f24700 1 -- 172.21.15.71:0/186393627 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e100c3f40 con 0x7f4e1006a910 2023-10-06T01:42:44.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.446+0000 7f4e14f24700 1 --2- 172.21.15.71:0/186393627 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e1006a910 0x7f4e1006ad90 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f4e100b41e0 tx=0x7f4e00009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57db0f7bfe404e8f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:44.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.446+0000 7f4e07fff700 1 -- 172.21.15.71:0/186393627 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0000b860 con 0x7f4e1006a910 2023-10-06T01:42:44.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.446+0000 7f4e07fff700 1 -- 172.21.15.71:0/186393627 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e0000b9c0 con 0x7f4e1006a910 2023-10-06T01:42:44.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.446+0000 7f4e07fff700 1 -- 172.21.15.71:0/186393627 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0000bd60 con 0x7f4e1006a910 2023-10-06T01:42:44.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.447+0000 7f4e17989700 1 -- 172.21.15.71:0/186393627 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e1006a910 msgr2=0x7f4e1006ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:44.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.447+0000 7f4e17989700 1 --2- 172.21.15.71:0/186393627 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e1006a910 0x7f4e1006ad90 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f4e100b41e0 tx=0x7f4e00009250 comp rx=0 tx=0).stop 2023-10-06T01:42:44.450 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.447+0000 7f4e17989700 1 -- 172.21.15.71:0/186393627 shutdown_connections 2023-10-06T01:42:44.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.447+0000 7f4e17989700 1 --2- 172.21.15.71:0/186393627 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4e100c2e90 0x7f4e100c3310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:44.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.447+0000 7f4e17989700 1 --2- 172.21.15.71:0/186393627 >> v2:172.21.15.72:3300/0 conn(0x7f4e1015cae0 0x7f4e100c8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:44.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.447+0000 7f4e17989700 1 --2- 172.21.15.71:0/186393627 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e1006a910 0x7f4e1006ad90 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:44.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.447+0000 7f4e17989700 1 -- 172.21.15.71:0/186393627 >> 172.21.15.71:0/186393627 conn(0x7f4e10067910 msgr2=0x7f4e100ce0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:44.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.447+0000 7f4e17989700 1 -- 172.21.15.71:0/186393627 shutdown_connections 2023-10-06T01:42:44.451 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.447+0000 7f4e17989700 1 -- 172.21.15.71:0/186393627 wait complete. 2023-10-06T01:42:44.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.448+0000 7f4e17989700 1 Processor -- start 2023-10-06T01:42:44.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.448+0000 7f4e17989700 1 -- start start 2023-10-06T01:42:44.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.449+0000 7f4e17989700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e1006a910 0x7f4e101696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:44.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.449+0000 7f4e17989700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e100c2e90 0x7f4e100c96e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:44.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.449+0000 7f4e17989700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4e1015cae0 0x7f4e100c9c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:44.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.449+0000 7f4e17989700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e100c7f00 con 0x7f4e1006a910 2023-10-06T01:42:44.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.449+0000 7f4e17989700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e100c8430 con 0x7f4e100c2e90 2023-10-06T01:42:44.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.449+0000 7f4e17989700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e100c5d80 con 0x7f4e1015cae0 2023-10-06T01:42:44.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.449+0000 7f4e15725700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e1006a910 0x7f4e101696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:44.454 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.449+0000 7f4e15725700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e1006a910 0x7f4e101696b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:43068/0 (socket says 172.21.15.71:43068) 2023-10-06T01:42:44.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.449+0000 7f4e15725700 1 -- 172.21.15.71:0/1683601293 learned_addr learned my addr 172.21.15.71:0/1683601293 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:44.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.449+0000 7f4e14f24700 1 --2- 172.21.15.71:0/1683601293 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e100c2e90 0x7f4e100c96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:44.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.449+0000 7f4e15f26700 1 --2- 172.21.15.71:0/1683601293 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4e1015cae0 0x7f4e100c9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:44.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.449+0000 7f4e15725700 1 -- 172.21.15.71:0/1683601293 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4e1015cae0 msgr2=0x7f4e100c9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:44.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.449+0000 7f4e15725700 1 --2- 172.21.15.71:0/1683601293 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4e1015cae0 0x7f4e100c9c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:44.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.449+0000 7f4e15725700 1 -- 172.21.15.71:0/1683601293 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e100c2e90 msgr2=0x7f4e100c96e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:44.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.449+0000 7f4e15725700 1 --2- 172.21.15.71:0/1683601293 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e100c2e90 0x7f4e100c96e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:44.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.449+0000 7f4e15725700 1 -- 172.21.15.71:0/1683601293 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e000094f0 con 0x7f4e1006a910 2023-10-06T01:42:44.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.449+0000 7f4e14f24700 1 --2- 172.21.15.71:0/1683601293 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e100c2e90 0x7f4e100c96e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:42:44.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.449+0000 7f4e15725700 1 --2- 172.21.15.71:0/1683601293 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e1006a910 0x7f4e101696b0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c00d840 tx=0x7f4e0c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:44.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.450+0000 7f4e057fa700 1 -- 172.21.15.71:0/1683601293 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0c00b600 con 0x7f4e1006a910 2023-10-06T01:42:44.455 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.450+0000 7f4e057fa700 1 -- 172.21.15.71:0/1683601293 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e0c00b760 con 0x7f4e1006a910 2023-10-06T01:42:44.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.450+0000 7f4e17989700 1 -- 172.21.15.71:0/1683601293 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e100c8150 con 0x7f4e1006a910 2023-10-06T01:42:44.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.450+0000 7f4e057fa700 1 -- 172.21.15.71:0/1683601293 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0c00bb20 con 0x7f4e1006a910 2023-10-06T01:42:44.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.450+0000 7f4e17989700 1 -- 172.21.15.71:0/1683601293 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e100c5a10 con 0x7f4e1006a910 2023-10-06T01:42:44.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.450+0000 7f4e17989700 1 -- 172.21.15.71:0/1683601293 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e1006e590 con 0x7f4e1006a910 2023-10-06T01:42:44.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.451+0000 7f4e057fa700 1 -- 172.21.15.71:0/1683601293 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4e0c01e460 con 0x7f4e1006a910 2023-10-06T01:42:44.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.451+0000 7f4e057fa700 1 --2- 172.21.15.71:0/1683601293 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f4df4066f30 0x7f4df40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:44.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.451+0000 7f4e057fa700 1 -- 172.21.15.71:0/1683601293 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6550+0+0 (secure 0 0 0) 0x7f4e0c084fe0 con 0x7f4e1006a910 2023-10-06T01:42:44.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.451+0000 7f4e14f24700 1 --2- 172.21.15.71:0/1683601293 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f4df4066f30 0x7f4df40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:44.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.452+0000 7f4e14f24700 1 --2- 172.21.15.71:0/1683601293 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f4df4066f30 0x7f4df40693e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f4e100b41e0 tx=0x7f4e00017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:44.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.455+0000 7f4e057fa700 1 -- 172.21.15.71:0/1683601293 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4e0c051f00 con 0x7f4e1006a910 2023-10-06T01:42:44.684 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:44.682+0000 7f4e17989700 1 -- 172.21.15.71:0/1683601293 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f4e10088710 con 0x7f4e1006a910 2023-10-06T01:42:45.317 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:45.315+0000 7f4e057fa700 1 -- 172.21.15.71:0/1683601293 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v41) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4e0c055520 con 0x7f4e1006a910 2023-10-06T01:42:45.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:45.317+0000 7f4e17989700 1 -- 172.21.15.71:0/1683601293 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f4df4066f30 msgr2=0x7f4df40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:45.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:45.317+0000 7f4e17989700 1 --2- 172.21.15.71:0/1683601293 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f4df4066f30 0x7f4df40693e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f4e100b41e0 tx=0x7f4e00017000 comp rx=0 tx=0).stop 2023-10-06T01:42:45.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:45.317+0000 7f4e17989700 1 -- 172.21.15.71:0/1683601293 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e1006a910 msgr2=0x7f4e101696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:45.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:45.317+0000 7f4e17989700 1 --2- 172.21.15.71:0/1683601293 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e1006a910 0x7f4e101696b0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c00d840 tx=0x7f4e0c008040 comp rx=0 tx=0).stop 2023-10-06T01:42:45.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:45.318+0000 7f4e17989700 1 -- 172.21.15.71:0/1683601293 shutdown_connections 2023-10-06T01:42:45.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:45.318+0000 7f4e17989700 1 --2- 172.21.15.71:0/1683601293 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4e1015cae0 0x7f4e100c9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:45.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:45.318+0000 7f4e17989700 1 --2- 172.21.15.71:0/1683601293 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e1006a910 0x7f4e101696b0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:45.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:45.318+0000 7f4e17989700 1 --2- 172.21.15.71:0/1683601293 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f4df4066f30 0x7f4df40693e0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:45.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:45.318+0000 7f4e17989700 1 --2- 172.21.15.71:0/1683601293 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e100c2e90 0x7f4e100c96e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:45.320 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:45.318+0000 7f4e17989700 1 -- 172.21.15.71:0/1683601293 >> 172.21.15.71:0/1683601293 conn(0x7f4e10067910 msgr2=0x7f4e10069710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:45.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:45.318+0000 7f4e17989700 1 -- 172.21.15.71:0/1683601293 shutdown_connections 2023-10-06T01:42:45.321 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:45.318+0000 7f4e17989700 1 -- 172.21.15.71:0/1683601293 wait complete. 2023-10-06T01:42:45.332 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T01:42:45.493 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:45.491+0000 7faa377f9700 1 Processor -- start 2023-10-06T01:42:45.494 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:45.492+0000 7faa377f9700 1 -- start start 2023-10-06T01:42:45.502 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:45.492+0000 7faa377f9700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7faa301598b0 0x7faa300afef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:45.502 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:45.492+0000 7faa377f9700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa300afa60 con 0x7faa3015b940 2023-10-06T01:42:45.502 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:45.492+0000 7faa377f9700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa300af440 con 0x7faa300b0430 2023-10-06T01:42:45.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:45.492+0000 7faa377f9700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa3015ab00 con 0x7faa301598b0 2023-10-06T01:42:45.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:45.493+0000 7faa35d96700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7faa3015b940 0x7faa30159c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:55406/0 (socket says 172.21.15.71:55406) 2023-10-06T01:42:45.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:45.493+0000 7faa35d96700 1 -- 172.21.15.71:0/60333954 learned_addr learned my addr 172.21.15.71:0/60333954 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:42:45.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:45.493+0000 7faa35595700 1 --2- 172.21.15.71:0/60333954 >> v2:172.21.15.72:3300/0 conn(0x7faa301598b0 0x7faa300afef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:45.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:45.493+0000 7faa27fff700 1 -- 172.21.15.71:0/60333954 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3730785462 0 0) 0x7faa300afa60 con 0x7faa3015b940 2023-10-06T01:42:45.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:45.493+0000 7faa27fff700 1 -- 172.21.15.71:0/60333954 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa1c003570 con 0x7faa3015b940 2023-10-06T01:42:45.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:45.493+0000 7faa27fff700 1 -- 172.21.15.71:0/60333954 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 389753050 0 0) 0x7faa1c003570 con 0x7faa3015b940 2023-10-06T01:42:45.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:45.493+0000 7faa27fff700 1 -- 172.21.15.71:0/60333954 >> v2:172.21.15.72:3300/0 conn(0x7faa301598b0 msgr2=0x7faa300afef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:45.503 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:45.493+0000 7faa27fff700 1 --2- 172.21.15.71:0/60333954 >> v2:172.21.15.72:3300/0 conn(0x7faa301598b0 0x7faa300afef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:45.504 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:45.493+0000 7faa27fff700 1 -- 172.21.15.71:0/60333954 >> v1:172.21.15.72:6789/0 conn(0x7faa300b0430 legacy=0x7faa3015b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:45.504 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:45.493+0000 7faa27fff700 1 -- 172.21.15.71:0/60333954 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa3015ade0 con 0x7faa3015b940 2023-10-06T01:42:45.504 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:45.493+0000 7faa27fff700 1 -- 172.21.15.71:0/60333954 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1184243524 0 0) 0x7faa280017f0 con 0x7faa3015b940 2023-10-06T01:42:45.504 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:45.493+0000 7faa27fff700 1 -- 172.21.15.71:0/60333954 >> v1:172.21.15.71:6789/0 conn(0x7faa3015b940 legacy=0x7faa30159c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:45.504 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:45.493+0000 7faa27fff700 1 --2- 172.21.15.71:0/60333954 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa1c003a60 0x7faa1c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:45.504 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:45.493+0000 7faa27fff700 1 --2- 172.21.15.71:0/60333954 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faa1c004810 0x7faa1c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:45.504 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:45.493+0000 7faa27fff700 1 --2- 172.21.15.71:0/60333954 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa1c0051c0 0x7faa1c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:45.504 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:45.493+0000 7faa27fff700 1 -- 172.21.15.71:0/60333954 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa3015ab00 con 0x7faa1c0051c0 2023-10-06T01:42:45.504 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:45.493+0000 7faa27fff700 1 -- 172.21.15.71:0/60333954 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa1c00c160 con 0x7faa1c003a60 2023-10-06T01:42:45.504 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:45.493+0000 7faa27fff700 1 -- 172.21.15.71:0/60333954 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa1c00c320 con 0x7faa1c004810 2023-10-06T01:42:45.504 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:45.493+0000 7faa35595700 1 --2- 172.21.15.71:0/60333954 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa1c003a60 0x7faa1c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:45.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:45.493+0000 7faa35d96700 1 --2- 172.21.15.71:0/60333954 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa1c0051c0 0x7faa1c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:45.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:45.493+0000 7faa34d94700 1 --2- 172.21.15.71:0/60333954 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faa1c004810 0x7faa1c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:45.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:45.494+0000 7faa35595700 1 -- 172.21.15.71:0/60333954 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faa1c004810 msgr2=0x7faa1c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:45.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:45.494+0000 7faa35595700 1 --2- 172.21.15.71:0/60333954 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faa1c004810 0x7faa1c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:45.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:45.494+0000 7faa35595700 1 -- 172.21.15.71:0/60333954 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa1c0051c0 msgr2=0x7faa1c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:45.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:45.494+0000 7faa35595700 1 --2- 172.21.15.71:0/60333954 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa1c0051c0 0x7faa1c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:45.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:45.494+0000 7faa35595700 1 -- 172.21.15.71:0/60333954 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa1c003570 con 0x7faa1c003a60 2023-10-06T01:42:45.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:45.494+0000 7faa35d96700 1 -- 172.21.15.71:0/60333954 reap_dead start 2023-10-06T01:42:45.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:45.494+0000 7faa35595700 1 --2- 172.21.15.71:0/60333954 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa1c003a60 0x7faa1c003e70 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7faa2c009bf0 tx=0x7faa2c009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=22c66359122fe9b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:45.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:45.494+0000 7faa27fff700 1 -- 172.21.15.71:0/60333954 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa2c005a00 con 0x7faa1c003a60 2023-10-06T01:42:45.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:45.494+0000 7faa27fff700 1 -- 172.21.15.71:0/60333954 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa2c005b60 con 0x7faa1c003a60 2023-10-06T01:42:45.505 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:45.494+0000 7faa27fff700 1 -- 172.21.15.71:0/60333954 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa2c00e710 con 0x7faa1c003a60 2023-10-06T01:42:45.506 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:45.494+0000 7faa377f9700 1 -- 172.21.15.71:0/60333954 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa1c003a60 msgr2=0x7faa1c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:45.506 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:45.494+0000 7faa377f9700 1 --2- 172.21.15.71:0/60333954 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa1c003a60 0x7faa1c003e70 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7faa2c009bf0 tx=0x7faa2c009120 comp rx=0 tx=0).stop 2023-10-06T01:42:45.506 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:45.494+0000 7faa377f9700 1 -- 172.21.15.71:0/60333954 shutdown_connections 2023-10-06T01:42:45.506 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:45.494+0000 7faa377f9700 1 --2- 172.21.15.71:0/60333954 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa1c003a60 0x7faa1c003e70 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:45.506 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:45.494+0000 7faa377f9700 1 -- 172.21.15.71:0/60333954 >> 172.21.15.71:0/60333954 conn(0x7faa30067910 msgr2=0x7faa300ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:45.506 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:45.495+0000 7faa377f9700 1 -- 172.21.15.71:0/60333954 shutdown_connections 2023-10-06T01:42:45.506 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:45.495+0000 7faa377f9700 1 -- 172.21.15.71:0/60333954 wait complete. 2023-10-06T01:42:45.506 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:45.496+0000 7faa377f9700 1 Processor -- start 2023-10-06T01:42:45.506 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:45.496+0000 7faa377f9700 1 -- start start 2023-10-06T01:42:45.506 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:45.496+0000 7faa377f9700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa1c003a60 0x7faa300985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:45.506 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:45.496+0000 7faa377f9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faa300c3590 0x7faa30169a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:45.507 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:45.496+0000 7faa377f9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa300c3a00 0x7faa301585e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:45.507 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:45.496+0000 7faa377f9700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa3016a4f0 con 0x7faa1c003a60 2023-10-06T01:42:45.507 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:45.496+0000 7faa377f9700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa3016a7d0 con 0x7faa300c3a00 2023-10-06T01:42:45.507 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:45.496+0000 7faa377f9700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa30097e00 con 0x7faa300c3590 2023-10-06T01:42:45.507 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:45.497+0000 7faa35595700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa1c003a60 0x7faa300985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:45.507 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:45.497+0000 7faa35595700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa1c003a60 0x7faa300985e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:43086/0 (socket says 172.21.15.71:43086) 2023-10-06T01:42:45.507 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:45.497+0000 7faa35595700 1 -- 172.21.15.71:0/2663437362 learned_addr learned my addr 172.21.15.71:0/2663437362 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:45.507 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:45.497+0000 7faa35d96700 1 --2- 172.21.15.71:0/2663437362 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa300c3a00 0x7faa301585e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:45.507 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:45.497+0000 7faa34d94700 1 --2- 172.21.15.71:0/2663437362 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faa300c3590 0x7faa30169a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:45.508 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:45.497+0000 7faa35595700 1 -- 172.21.15.71:0/2663437362 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faa300c3590 msgr2=0x7faa30169a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:45.508 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:45.497+0000 7faa35595700 1 --2- 172.21.15.71:0/2663437362 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faa300c3590 0x7faa30169a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:45.508 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:45.497+0000 7faa35595700 1 -- 172.21.15.71:0/2663437362 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa300c3a00 msgr2=0x7faa301585e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:45.508 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:45.497+0000 7faa35595700 1 --2- 172.21.15.71:0/2663437362 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa300c3a00 0x7faa301585e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:45.508 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:45.497+0000 7faa35595700 1 -- 172.21.15.71:0/2663437362 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa300980e0 con 0x7faa1c003a60 2023-10-06T01:42:45.508 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:45.497+0000 7faa35595700 1 --2- 172.21.15.71:0/2663437362 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa1c003a60 0x7faa300985e0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7faa2c009160 tx=0x7faa2c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:45.508 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:45.497+0000 7faa257fa700 1 -- 172.21.15.71:0/2663437362 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa2c022070 con 0x7faa1c003a60 2023-10-06T01:42:45.508 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:45.497+0000 7faa257fa700 1 -- 172.21.15.71:0/2663437362 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa2c006310 con 0x7faa1c003a60 2023-10-06T01:42:45.508 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:45.497+0000 7faa257fa700 1 -- 172.21.15.71:0/2663437362 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa2c0066d0 con 0x7faa1c003a60 2023-10-06T01:42:45.508 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:45.497+0000 7faa377f9700 1 -- 172.21.15.71:0/2663437362 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa3016a4f0 con 0x7faa1c003a60 2023-10-06T01:42:45.508 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:45.497+0000 7faa377f9700 1 -- 172.21.15.71:0/2663437362 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa3009bb30 con 0x7faa1c003a60 2023-10-06T01:42:45.508 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:45.498+0000 7faa377f9700 1 -- 172.21.15.71:0/2663437362 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa30097c60 con 0x7faa1c003a60 2023-10-06T01:42:45.509 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:45.498+0000 7faa257fa700 1 -- 172.21.15.71:0/2663437362 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faa2c013680 con 0x7faa1c003a60 2023-10-06T01:42:45.509 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:45.499+0000 7faa257fa700 1 --2- 172.21.15.71:0/2663437362 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7faa14066f30 0x7faa140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:45.509 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:45.499+0000 7faa257fa700 1 -- 172.21.15.71:0/2663437362 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6550+0+0 (secure 0 0 0) 0x7faa2c085c90 con 0x7faa1c003a60 2023-10-06T01:42:45.509 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:45.499+0000 7faa34d94700 1 --2- 172.21.15.71:0/2663437362 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7faa14066f30 0x7faa140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:45.509 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:45.499+0000 7faa34d94700 1 --2- 172.21.15.71:0/2663437362 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7faa14066f30 0x7faa140693e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7faa20000f60 tx=0x7faa20009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:45.510 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:45.504+0000 7faa257fa700 1 -- 172.21.15.71:0/2663437362 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faa2c0b75a0 con 0x7faa1c003a60 2023-10-06T01:42:45.688 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:45.686+0000 7faa377f9700 1 -- 172.21.15.71:0/2663437362 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7faa30098270 con 0x7faa1c003a60 2023-10-06T01:42:46.319 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:46.319+0000 7faa257fa700 1 -- 172.21.15.71:0/2663437362 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v60) v1 ==== 181+0+0 (secure 0 0 0) 0x7faa30097c60 con 0x7faa1c003a60 2023-10-06T01:42:46.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:46.322+0000 7faa377f9700 1 -- 172.21.15.71:0/2663437362 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7faa14066f30 msgr2=0x7faa140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:46.323 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:46.322+0000 7faa377f9700 1 --2- 172.21.15.71:0/2663437362 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7faa14066f30 0x7faa140693e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7faa20000f60 tx=0x7faa20009040 comp rx=0 tx=0).stop 2023-10-06T01:42:46.324 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:46.322+0000 7faa377f9700 1 -- 172.21.15.71:0/2663437362 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa1c003a60 msgr2=0x7faa300985e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:46.324 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:46.322+0000 7faa377f9700 1 --2- 172.21.15.71:0/2663437362 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa1c003a60 0x7faa300985e0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7faa2c009160 tx=0x7faa2c019000 comp rx=0 tx=0).stop 2023-10-06T01:42:46.324 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:46.322+0000 7faa377f9700 1 -- 172.21.15.71:0/2663437362 shutdown_connections 2023-10-06T01:42:46.324 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:46.322+0000 7faa377f9700 1 --2- 172.21.15.71:0/2663437362 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7faa14066f30 0x7faa140693e0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:46.324 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:46.322+0000 7faa377f9700 1 --2- 172.21.15.71:0/2663437362 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa300c3a00 0x7faa301585e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:46.324 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:46.322+0000 7faa377f9700 1 --2- 172.21.15.71:0/2663437362 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faa1c003a60 0x7faa300985e0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:46.324 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:46.322+0000 7faa377f9700 1 --2- 172.21.15.71:0/2663437362 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faa300c3590 0x7faa30169a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:46.324 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:46.322+0000 7faa377f9700 1 -- 172.21.15.71:0/2663437362 >> 172.21.15.71:0/2663437362 conn(0x7faa30067910 msgr2=0x7faa300ad910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:46.324 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:46.322+0000 7faa377f9700 1 -- 172.21.15.71:0/2663437362 shutdown_connections 2023-10-06T01:42:46.324 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:46.322+0000 7faa377f9700 1 -- 172.21.15.71:0/2663437362 wait complete. 2023-10-06T01:42:46.325 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'cephfs_metadata' removed 2023-10-06T01:42:46.336 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T01:42:46.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:46.456+0000 7f53c8ec8700 1 Processor -- start 2023-10-06T01:42:46.457 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:46.456+0000 7f53c8ec8700 1 -- start start 2023-10-06T01:42:46.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:46.457+0000 7f53c8ec8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f53c40688d0 0x7f53c40af4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:46.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:46.457+0000 7f53c8ec8700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f53c40afdf0 0x7f53c4159180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:46.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:46.457+0000 7f53c8ec8700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53c40adba0 con 0x7f53c4068ca0 2023-10-06T01:42:46.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:46.457+0000 7f53c8ec8700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53c40ad2b0 con 0x7f53c40afdf0 2023-10-06T01:42:46.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:46.457+0000 7f53c8ec8700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53c40b02d0 con 0x7f53c40688d0 2023-10-06T01:42:46.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:46.457+0000 7f53c2d9d700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f53c4068ca0 0x7f53c41596c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:55414/0 (socket says 172.21.15.71:55414) 2023-10-06T01:42:46.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:46.457+0000 7f53c2d9d700 1 -- 172.21.15.71:0/4055014394 learned_addr learned my addr 172.21.15.71:0/4055014394 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:42:46.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:46.458+0000 7f53c1d9b700 1 --2- 172.21.15.71:0/4055014394 >> v2:172.21.15.72:3300/0 conn(0x7f53c40afdf0 0x7f53c4159180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:46.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:46.458+0000 7f53c159a700 1 -- 172.21.15.71:0/4055014394 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 694294355 0 0) 0x7f53c40adba0 con 0x7f53c4068ca0 2023-10-06T01:42:46.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:46.458+0000 7f53c259c700 1 --2- 172.21.15.71:0/4055014394 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f53c40688d0 0x7f53c40af4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:46.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:46.458+0000 7f53c159a700 1 -- 172.21.15.71:0/4055014394 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53ac003570 con 0x7f53c4068ca0 2023-10-06T01:42:46.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:46.458+0000 7f53c159a700 1 -- 172.21.15.71:0/4055014394 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4192276260 0 0) 0x7f53ac003570 con 0x7f53c4068ca0 2023-10-06T01:42:46.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:46.458+0000 7f53c159a700 1 -- 172.21.15.71:0/4055014394 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f53c40688d0 msgr2=0x7f53c40af4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:46.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:46.458+0000 7f53c159a700 1 --2- 172.21.15.71:0/4055014394 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f53c40688d0 0x7f53c40af4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:46.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:46.458+0000 7f53c159a700 1 -- 172.21.15.71:0/4055014394 >> v2:172.21.15.72:3300/0 conn(0x7f53c40afdf0 msgr2=0x7f53c4159180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:46.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:46.458+0000 7f53c159a700 1 --2- 172.21.15.71:0/4055014394 >> v2:172.21.15.72:3300/0 conn(0x7f53c40afdf0 0x7f53c4159180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:46.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:46.458+0000 7f53c159a700 1 -- 172.21.15.71:0/4055014394 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53c40ad550 con 0x7f53c4068ca0 2023-10-06T01:42:46.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:46.458+0000 7f53c159a700 1 -- 172.21.15.71:0/4055014394 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1184243524 0 0) 0x7f53bc0017f0 con 0x7f53c4068ca0 2023-10-06T01:42:46.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:46.458+0000 7f53c159a700 1 -- 172.21.15.71:0/4055014394 >> v1:172.21.15.71:6789/0 conn(0x7f53c4068ca0 legacy=0x7f53c41596c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:46.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:46.458+0000 7f53c159a700 1 --2- 172.21.15.71:0/4055014394 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53ac003a60 0x7f53ac003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:46.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:46.458+0000 7f53c159a700 1 --2- 172.21.15.71:0/4055014394 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53ac004810 0x7f53ac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:46.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:46.458+0000 7f53c159a700 1 --2- 172.21.15.71:0/4055014394 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f53c40688d0 0x7f53ac0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:46.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:46.458+0000 7f53c159a700 1 -- 172.21.15.71:0/4055014394 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53c40ad2b0 con 0x7f53ac004810 2023-10-06T01:42:46.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:46.458+0000 7f53c159a700 1 -- 172.21.15.71:0/4055014394 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53c40b02d0 con 0x7f53ac003a60 2023-10-06T01:42:46.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:46.458+0000 7f53c159a700 1 -- 172.21.15.71:0/4055014394 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53ac00ba60 con 0x7f53c40688d0 2023-10-06T01:42:46.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:46.458+0000 7f53c1d9b700 1 --2- 172.21.15.71:0/4055014394 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53ac004810 0x7f53ac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:46.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:46.458+0000 7f53c259c700 1 --2- 172.21.15.71:0/4055014394 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53ac003a60 0x7f53ac003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:46.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:46.458+0000 7f53c2d9d700 1 --2- 172.21.15.71:0/4055014394 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f53c40688d0 0x7f53ac0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:46.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:46.458+0000 7f53c1d9b700 1 -- 172.21.15.71:0/4055014394 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f53c40688d0 msgr2=0x7f53ac0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:46.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:46.458+0000 7f53c1d9b700 1 --2- 172.21.15.71:0/4055014394 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f53c40688d0 0x7f53ac0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:46.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:46.458+0000 7f53c1d9b700 1 -- 172.21.15.71:0/4055014394 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53ac003a60 msgr2=0x7f53ac003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:46.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:46.458+0000 7f53c1d9b700 1 --2- 172.21.15.71:0/4055014394 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53ac003a60 0x7f53ac003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:46.463 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:46.458+0000 7f53c1d9b700 1 -- 172.21.15.71:0/4055014394 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53ac003570 con 0x7f53ac004810 2023-10-06T01:42:46.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:46.458+0000 7f53c1d9b700 1 --2- 172.21.15.71:0/4055014394 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53ac004810 0x7f53ac004c80 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f53b8009c00 tx=0x7f53b80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4b013b334fe0774 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:46.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:46.459+0000 7f53c159a700 1 -- 172.21.15.71:0/4055014394 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b800e710 con 0x7f53ac004810 2023-10-06T01:42:46.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:46.459+0000 7f53c159a700 1 -- 172.21.15.71:0/4055014394 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53b800e870 con 0x7f53ac004810 2023-10-06T01:42:46.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:46.459+0000 7f53c159a700 1 -- 172.21.15.71:0/4055014394 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b800ec30 con 0x7f53ac004810 2023-10-06T01:42:46.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:46.459+0000 7f53c8ec8700 1 -- 172.21.15.71:0/4055014394 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53ac004810 msgr2=0x7f53ac004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:46.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:46.459+0000 7f53c8ec8700 1 --2- 172.21.15.71:0/4055014394 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53ac004810 0x7f53ac004c80 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f53b8009c00 tx=0x7f53b80091a0 comp rx=0 tx=0).stop 2023-10-06T01:42:46.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:46.459+0000 7f53c2d9d700 1 -- 172.21.15.71:0/4055014394 reap_dead start 2023-10-06T01:42:46.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:46.459+0000 7f53c8ec8700 1 -- 172.21.15.71:0/4055014394 shutdown_connections 2023-10-06T01:42:46.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:46.459+0000 7f53c8ec8700 1 -- 172.21.15.71:0/4055014394 >> 172.21.15.71:0/4055014394 conn(0x7f53c40963e0 msgr2=0x7f53c4069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:46.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:46.459+0000 7f53c8ec8700 1 -- 172.21.15.71:0/4055014394 shutdown_connections 2023-10-06T01:42:46.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:46.459+0000 7f53c8ec8700 1 -- 172.21.15.71:0/4055014394 wait complete. 2023-10-06T01:42:46.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:46.460+0000 7f53c8ec8700 1 Processor -- start 2023-10-06T01:42:46.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:46.460+0000 7f53c8ec8700 1 -- start start 2023-10-06T01:42:46.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:46.461+0000 7f53c8ec8700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53ac004810 0x7f53c4169f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:46.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:46.461+0000 7f53c8ec8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f53c4154c70 0x7f53c40ccc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:46.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:46.461+0000 7f53c8ec8700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53c40cd190 0x7f53c40c9170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:46.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:46.461+0000 7f53c8ec8700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53c416a490 con 0x7f53ac004810 2023-10-06T01:42:46.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:46.461+0000 7f53c8ec8700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53c40cabb0 con 0x7f53c40cd190 2023-10-06T01:42:46.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:46.461+0000 7f53c8ec8700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53c40cae90 con 0x7f53c4154c70 2023-10-06T01:42:46.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:46.461+0000 7f53c259c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53ac004810 0x7f53c4169f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:46.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:46.461+0000 7f53c259c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53ac004810 0x7f53c4169f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:43098/0 (socket says 172.21.15.71:43098) 2023-10-06T01:42:46.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:46.461+0000 7f53c259c700 1 -- 172.21.15.71:0/3423480341 learned_addr learned my addr 172.21.15.71:0/3423480341 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:46.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:46.461+0000 7f53c259c700 1 -- 172.21.15.71:0/3423480341 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f53c4154c70 msgr2=0x7f53c40ccc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:46.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:46.461+0000 7f53c259c700 1 --2- 172.21.15.71:0/3423480341 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f53c4154c70 0x7f53c40ccc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:46.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:46.461+0000 7f53c259c700 1 -- 172.21.15.71:0/3423480341 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53c40cd190 msgr2=0x7f53c40c9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:46.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:46.461+0000 7f53c259c700 1 --2- 172.21.15.71:0/3423480341 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53c40cd190 0x7f53c40c9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:46.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:46.461+0000 7f53c259c700 1 -- 172.21.15.71:0/3423480341 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53c40cb170 con 0x7f53ac004810 2023-10-06T01:42:46.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:46.462+0000 7f53c259c700 1 --2- 172.21.15.71:0/3423480341 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53ac004810 0x7f53c4169f50 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f53b4011d40 tx=0x7f53b40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:46.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:46.462+0000 7f53b27fc700 1 -- 172.21.15.71:0/3423480341 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b400fac0 con 0x7f53ac004810 2023-10-06T01:42:46.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:46.462+0000 7f53b27fc700 1 -- 172.21.15.71:0/3423480341 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53b400fc20 con 0x7f53ac004810 2023-10-06T01:42:46.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:46.462+0000 7f53c8ec8700 1 -- 172.21.15.71:0/3423480341 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53c40cb450 con 0x7f53ac004810 2023-10-06T01:42:46.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:46.462+0000 7f53b27fc700 1 -- 172.21.15.71:0/3423480341 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b4014440 con 0x7f53ac004810 2023-10-06T01:42:46.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:46.462+0000 7f53c8ec8700 1 -- 172.21.15.71:0/3423480341 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53c4155690 con 0x7f53ac004810 2023-10-06T01:42:46.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:46.463+0000 7f53c8ec8700 1 -- 172.21.15.71:0/3423480341 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53c416a890 con 0x7f53ac004810 2023-10-06T01:42:46.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:46.463+0000 7f53b27fc700 1 -- 172.21.15.71:0/3423480341 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f53b4014a80 con 0x7f53ac004810 2023-10-06T01:42:46.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:46.463+0000 7f53b27fc700 1 --2- 172.21.15.71:0/3423480341 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f53a4066f30 0x7f53a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:46.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:46.463+0000 7f53b27fc700 1 -- 172.21.15.71:0/3423480341 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6112+0+0 (secure 0 0 0) 0x7f53b4018030 con 0x7f53ac004810 2023-10-06T01:42:46.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:46.463+0000 7f53c1d9b700 1 --2- 172.21.15.71:0/3423480341 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f53a4066f30 0x7f53a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:46.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:46.464+0000 7f53c1d9b700 1 --2- 172.21.15.71:0/3423480341 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f53a4066f30 0x7f53a40693e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f53c40b2e30 tx=0x7f53b801a000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:46.470 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:46.467+0000 7f53b27fc700 1 -- 172.21.15.71:0/3423480341 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f53b4052460 con 0x7f53ac004810 2023-10-06T01:42:46.651 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:46.650+0000 7f53c8ec8700 1 -- 172.21.15.71:0/3423480341 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f53c406d590 con 0x7f53ac004810 2023-10-06T01:42:47.324 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.323+0000 7f53b27fc700 1 -- 172.21.15.71:0/3423480341 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v61) v1 ==== 169+0+0 (secure 0 0 0) 0x7f53b4055a80 con 0x7f53ac004810 2023-10-06T01:42:47.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.326+0000 7f53c8ec8700 1 -- 172.21.15.71:0/3423480341 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f53a4066f30 msgr2=0x7f53a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:47.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.326+0000 7f53c8ec8700 1 --2- 172.21.15.71:0/3423480341 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f53a4066f30 0x7f53a40693e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f53c40b2e30 tx=0x7f53b801a000 comp rx=0 tx=0).stop 2023-10-06T01:42:47.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.326+0000 7f53c8ec8700 1 -- 172.21.15.71:0/3423480341 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53ac004810 msgr2=0x7f53c4169f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:47.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.326+0000 7f53c8ec8700 1 --2- 172.21.15.71:0/3423480341 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53ac004810 0x7f53c4169f50 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f53b4011d40 tx=0x7f53b40091a0 comp rx=0 tx=0).stop 2023-10-06T01:42:47.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.326+0000 7f53c8ec8700 1 -- 172.21.15.71:0/3423480341 shutdown_connections 2023-10-06T01:42:47.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.326+0000 7f53c8ec8700 1 --2- 172.21.15.71:0/3423480341 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f53a4066f30 0x7f53a40693e0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:47.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.326+0000 7f53c8ec8700 1 --2- 172.21.15.71:0/3423480341 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53c40cd190 0x7f53c40c9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:47.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.326+0000 7f53c8ec8700 1 --2- 172.21.15.71:0/3423480341 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53ac004810 0x7f53c4169f50 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:47.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.326+0000 7f53c8ec8700 1 --2- 172.21.15.71:0/3423480341 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f53c4154c70 0x7f53c40ccc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:47.328 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.326+0000 7f53c8ec8700 1 -- 172.21.15.71:0/3423480341 >> 172.21.15.71:0/3423480341 conn(0x7f53c40963e0 msgr2=0x7f53c406cbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:47.328 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.326+0000 7f53c8ec8700 1 -- 172.21.15.71:0/3423480341 shutdown_connections 2023-10-06T01:42:47.328 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.326+0000 7f53c8ec8700 1 -- 172.21.15.71:0/3423480341 wait complete. 2023-10-06T01:42:47.328 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'cephfs_data' removed 2023-10-06T01:42:47.341 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-06T01:42:47.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.457+0000 7fe0cf99d700 1 Processor -- start 2023-10-06T01:42:47.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.458+0000 7fe0cf99d700 1 -- start start 2023-10-06T01:42:47.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.458+0000 7fe0cf99d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe0c80d0400 0x7fe0c80b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:47.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.458+0000 7fe0cf99d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe0c80ccd40 0x7fe0c80cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:47.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.458+0000 7fe0cf99d700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0c80b6170 con 0x7fe0c80cf7e0 2023-10-06T01:42:47.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.458+0000 7fe0cf99d700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0c815dd40 con 0x7fe0c80ccd40 2023-10-06T01:42:47.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.458+0000 7fe0cf99d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c815e020 con 0x7fe0c80d0400 2023-10-06T01:42:47.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.459+0000 7fe0cdf3a700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fe0c80cf7e0 0x7fe0c80b3aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:55430/0 (socket says 172.21.15.71:55430) 2023-10-06T01:42:47.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.459+0000 7fe0cdf3a700 1 -- 172.21.15.71:0/520549392 learned_addr learned my addr 172.21.15.71:0/520549392 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:42:47.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.459+0000 7fe0cd739700 1 --2- 172.21.15.71:0/520549392 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe0c80d0400 0x7fe0c80b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:47.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.459+0000 7fe0ccf38700 1 --2- 172.21.15.71:0/520549392 >> v2:172.21.15.72:3300/0 conn(0x7fe0c80ccd40 0x7fe0c80cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:47.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.459+0000 7fe0bffff700 1 -- 172.21.15.71:0/520549392 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1025127117 0 0) 0x7fe0c80b6170 con 0x7fe0c80cf7e0 2023-10-06T01:42:47.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.459+0000 7fe0bffff700 1 -- 172.21.15.71:0/520549392 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0b4003570 con 0x7fe0c80cf7e0 2023-10-06T01:42:47.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.459+0000 7fe0ccf38700 1 -- 172.21.15.71:0/520549392 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe0c80d0400 msgr2=0x7fe0c80b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:47.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.459+0000 7fe0ccf38700 1 --2- 172.21.15.71:0/520549392 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe0c80d0400 0x7fe0c80b5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:47.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.459+0000 7fe0ccf38700 1 -- 172.21.15.71:0/520549392 >> v1:172.21.15.71:6789/0 conn(0x7fe0c80cf7e0 legacy=0x7fe0c80b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:47.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.459+0000 7fe0ccf38700 1 -- 172.21.15.71:0/520549392 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0c80ceaa0 con 0x7fe0c80ccd40 2023-10-06T01:42:47.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.459+0000 7fe0cd739700 1 --2- 172.21.15.71:0/520549392 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe0c80d0400 0x7fe0c80b5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:42:47.461 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.459+0000 7fe0ccf38700 1 --2- 172.21.15.71:0/520549392 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0c80ccd40 0x7fe0c80cf2a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fe0b80098e0 tx=0x7fe0b80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=81a4102aedb4bc4e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:47.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.459+0000 7fe0bffff700 1 -- 172.21.15.71:0/520549392 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b8011630 con 0x7fe0c80ccd40 2023-10-06T01:42:47.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.459+0000 7fe0bffff700 1 -- 172.21.15.71:0/520549392 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0b8011790 con 0x7fe0c80ccd40 2023-10-06T01:42:47.462 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.459+0000 7fe0bffff700 1 -- 172.21.15.71:0/520549392 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b8011b10 con 0x7fe0c80ccd40 2023-10-06T01:42:47.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.460+0000 7fe0cf99d700 1 -- 172.21.15.71:0/520549392 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0c80ccd40 msgr2=0x7fe0c80cf2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:47.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.460+0000 7fe0cf99d700 1 --2- 172.21.15.71:0/520549392 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0c80ccd40 0x7fe0c80cf2a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fe0b80098e0 tx=0x7fe0b80091a0 comp rx=0 tx=0).stop 2023-10-06T01:42:47.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.460+0000 7fe0cf99d700 1 -- 172.21.15.71:0/520549392 shutdown_connections 2023-10-06T01:42:47.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.460+0000 7fe0cf99d700 1 --2- 172.21.15.71:0/520549392 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe0c80d0400 0x7fe0c80b5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:47.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.460+0000 7fe0cf99d700 1 --2- 172.21.15.71:0/520549392 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0c80ccd40 0x7fe0c80cf2a0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:47.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.460+0000 7fe0cf99d700 1 -- 172.21.15.71:0/520549392 >> 172.21.15.71:0/520549392 conn(0x7fe0c806a220 msgr2=0x7fe0c806a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:47.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.460+0000 7fe0cf99d700 1 -- 172.21.15.71:0/520549392 shutdown_connections 2023-10-06T01:42:47.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.460+0000 7fe0cf99d700 1 -- 172.21.15.71:0/520549392 wait complete. 2023-10-06T01:42:47.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.461+0000 7fe0cf99d700 1 Processor -- start 2023-10-06T01:42:47.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.461+0000 7fe0cf99d700 1 -- start start 2023-10-06T01:42:47.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.462+0000 7fe0cf99d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe0c80ccd40 0x7fe0c815a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:47.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.462+0000 7fe0cf99d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0c80cf7e0 0x7fe0c814fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:47.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.462+0000 7fe0cf99d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0c80d0400 0x7fe0c814e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:47.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.462+0000 7fe0cf99d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c815a6a0 con 0x7fe0c80d0400 2023-10-06T01:42:47.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.462+0000 7fe0cf99d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c8150880 con 0x7fe0c80cf7e0 2023-10-06T01:42:47.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.462+0000 7fe0cf99d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c80b04b0 con 0x7fe0c80ccd40 2023-10-06T01:42:47.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.462+0000 7fe0cdf3a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0c80d0400 0x7fe0c814e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:47.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.462+0000 7fe0cdf3a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0c80d0400 0x7fe0c814e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:43100/0 (socket says 172.21.15.71:43100) 2023-10-06T01:42:47.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.462+0000 7fe0cdf3a700 1 -- 172.21.15.71:0/3182815883 learned_addr learned my addr 172.21.15.71:0/3182815883 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:47.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.462+0000 7fe0ccf38700 1 --2- 172.21.15.71:0/3182815883 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0c80cf7e0 0x7fe0c814fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:47.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.462+0000 7fe0cd739700 1 --2- 172.21.15.71:0/3182815883 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe0c80ccd40 0x7fe0c815a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:47.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.462+0000 7fe0cdf3a700 1 -- 172.21.15.71:0/3182815883 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe0c80ccd40 msgr2=0x7fe0c815a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:47.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.462+0000 7fe0cdf3a700 1 --2- 172.21.15.71:0/3182815883 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe0c80ccd40 0x7fe0c815a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:47.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.462+0000 7fe0cdf3a700 1 -- 172.21.15.71:0/3182815883 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0c80cf7e0 msgr2=0x7fe0c814fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:47.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.462+0000 7fe0cdf3a700 1 --2- 172.21.15.71:0/3182815883 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0c80cf7e0 0x7fe0c814fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:47.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.462+0000 7fe0cdf3a700 1 -- 172.21.15.71:0/3182815883 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0c40093c0 con 0x7fe0c80d0400 2023-10-06T01:42:47.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.462+0000 7fe0cd739700 1 --2- 172.21.15.71:0/3182815883 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe0c80ccd40 0x7fe0c815a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:42:47.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.463+0000 7fe0cdf3a700 1 --2- 172.21.15.71:0/3182815883 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0c80d0400 0x7fe0c814e010 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fe0c000cca0 tx=0x7fe0c0001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:47.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.463+0000 7fe0bd7fa700 1 -- 172.21.15.71:0/3182815883 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c000a980 con 0x7fe0c80d0400 2023-10-06T01:42:47.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.463+0000 7fe0bd7fa700 1 -- 172.21.15.71:0/3182815883 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0c000aae0 con 0x7fe0c80d0400 2023-10-06T01:42:47.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.463+0000 7fe0cf99d700 1 -- 172.21.15.71:0/3182815883 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0b8009420 con 0x7fe0c80d0400 2023-10-06T01:42:47.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.463+0000 7fe0bd7fa700 1 -- 172.21.15.71:0/3182815883 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c000ae60 con 0x7fe0c80d0400 2023-10-06T01:42:47.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.463+0000 7fe0cf99d700 1 -- 172.21.15.71:0/3182815883 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0c81505a0 con 0x7fe0c80d0400 2023-10-06T01:42:47.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.464+0000 7fe0cf99d700 1 -- 172.21.15.71:0/3182815883 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0c80b0620 con 0x7fe0c80d0400 2023-10-06T01:42:47.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.464+0000 7fe0bd7fa700 1 -- 172.21.15.71:0/3182815883 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe0c0007300 con 0x7fe0c80d0400 2023-10-06T01:42:47.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.465+0000 7fe0bd7fa700 1 --2- 172.21.15.71:0/3182815883 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fe0ac066f30 0x7fe0ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:47.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.465+0000 7fe0cd739700 1 --2- 172.21.15.71:0/3182815883 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fe0ac066f30 0x7fe0ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:47.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.465+0000 7fe0bd7fa700 1 -- 172.21.15.71:0/3182815883 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5698+0+0 (secure 0 0 0) 0x7fe0c0084a10 con 0x7fe0c80d0400 2023-10-06T01:42:47.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.465+0000 7fe0cd739700 1 --2- 172.21.15.71:0/3182815883 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fe0ac066f30 0x7fe0ac0693e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fe0c4009390 tx=0x7fe0c4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:47.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.469+0000 7fe0bd7fa700 1 -- 172.21.15.71:0/3182815883 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe0c0051bd0 con 0x7fe0c80d0400 2023-10-06T01:42:47.653 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.652+0000 7fe0cf99d700 1 -- 172.21.15.71:0/3182815883 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fe0c8088800 con 0x7fe0c80d0400 2023-10-06T01:42:47.656 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.656+0000 7fe0bd7fa700 1 -- 172.21.15.71:0/3182815883 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe0c8088800 con 0x7fe0c80d0400 2023-10-06T01:42:47.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.658+0000 7fe0cf99d700 1 -- 172.21.15.71:0/3182815883 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fe0ac066f30 msgr2=0x7fe0ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:47.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.658+0000 7fe0cf99d700 1 --2- 172.21.15.71:0/3182815883 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fe0ac066f30 0x7fe0ac0693e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fe0c4009390 tx=0x7fe0c4008040 comp rx=0 tx=0).stop 2023-10-06T01:42:47.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.658+0000 7fe0cf99d700 1 -- 172.21.15.71:0/3182815883 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0c80d0400 msgr2=0x7fe0c814e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:47.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.658+0000 7fe0cf99d700 1 --2- 172.21.15.71:0/3182815883 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0c80d0400 0x7fe0c814e010 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fe0c000cca0 tx=0x7fe0c0001ae0 comp rx=0 tx=0).stop 2023-10-06T01:42:47.659 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.658+0000 7fe0cf99d700 1 -- 172.21.15.71:0/3182815883 shutdown_connections 2023-10-06T01:42:47.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.658+0000 7fe0cf99d700 1 --2- 172.21.15.71:0/3182815883 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0c80d0400 0x7fe0c814e010 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:47.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.658+0000 7fe0cf99d700 1 --2- 172.21.15.71:0/3182815883 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe0c80ccd40 0x7fe0c815a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:47.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.658+0000 7fe0cf99d700 1 --2- 172.21.15.71:0/3182815883 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fe0ac066f30 0x7fe0ac0693e0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:47.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.658+0000 7fe0cf99d700 1 --2- 172.21.15.71:0/3182815883 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0c80cf7e0 0x7fe0c814fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:47.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.658+0000 7fe0cf99d700 1 -- 172.21.15.71:0/3182815883 >> 172.21.15.71:0/3182815883 conn(0x7fe0c806a220 msgr2=0x7fe0c80b2520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:47.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.658+0000 7fe0cf99d700 1 -- 172.21.15.71:0/3182815883 shutdown_connections 2023-10-06T01:42:47.660 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.658+0000 7fe0cf99d700 1 -- 172.21.15.71:0/3182815883 wait complete. 2023-10-06T01:42:47.671 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_auto_repair.TestMDSAutoRepair.test_mds_readonly' 2023-10-06T01:42:47.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.785+0000 7ff6a424c700 1 Processor -- start 2023-10-06T01:42:47.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.785+0000 7ff6a424c700 1 -- start start 2023-10-06T01:42:47.794 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.786+0000 7ff6a424c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff69c0af8b0 0x7ff69c15d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:47.794 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.786+0000 7ff6a424c700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff69c15e190 con 0x7ff69c0af4e0 2023-10-06T01:42:47.794 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.786+0000 7ff6a424c700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff69c0cb650 con 0x7ff69c0b27f0 2023-10-06T01:42:47.794 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.786+0000 7ff6a424c700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff69c0b1910 con 0x7ff69c0af8b0 2023-10-06T01:42:47.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.786+0000 7ff6a17e7700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ff69c0af8b0 0x7ff69c15d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:47.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.786+0000 7ff6a1fe8700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7ff69c0af4e0 0x7ff69c0b20e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:55438/0 (socket says 172.21.15.71:55438) 2023-10-06T01:42:47.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.786+0000 7ff6a1fe8700 1 -- 172.21.15.71:0/2297977604 learned_addr learned my addr 172.21.15.71:0/2297977604 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:42:47.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.786+0000 7ff6a17e7700 1 -- 172.21.15.71:0/2297977604 >> v1:172.21.15.72:6789/0 conn(0x7ff69c0b27f0 legacy=0x7ff69c15d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:47.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.786+0000 7ff6a17e7700 1 -- 172.21.15.71:0/2297977604 >> v1:172.21.15.71:6789/0 conn(0x7ff69c0af4e0 legacy=0x7ff69c0b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:47.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.786+0000 7ff6a17e7700 1 -- 172.21.15.71:0/2297977604 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff69c0ccaf0 con 0x7ff69c0af8b0 2023-10-06T01:42:47.796 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.786+0000 7ff6a0fe6700 1 -- 172.21.15.71:0/2297977604 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 471015249 0 0) 0x7ff69c15e190 con 0x7ff69c0af4e0 2023-10-06T01:42:47.796 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.787+0000 7ff6a17e7700 1 --2- 172.21.15.71:0/2297977604 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff69c0af8b0 0x7ff69c15d460 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7ff68c0098e0 tx=0x7ff68c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66941a247031ed84 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:47.796 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.787+0000 7ff6a0fe6700 1 -- 172.21.15.71:0/2297977604 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff68c009e80 con 0x7ff69c0af8b0 2023-10-06T01:42:47.796 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.787+0000 7ff6a0fe6700 1 -- 172.21.15.71:0/2297977604 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff68c00b820 con 0x7ff69c0af8b0 2023-10-06T01:42:47.796 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.787+0000 7ff6a0fe6700 1 -- 172.21.15.71:0/2297977604 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff68c00bba0 con 0x7ff69c0af8b0 2023-10-06T01:42:47.796 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.787+0000 7ff6a424c700 1 -- 172.21.15.71:0/2297977604 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff69c0af8b0 msgr2=0x7ff69c15d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:47.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.787+0000 7ff6a424c700 1 --2- 172.21.15.71:0/2297977604 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff69c0af8b0 0x7ff69c15d460 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7ff68c0098e0 tx=0x7ff68c0091a0 comp rx=0 tx=0).stop 2023-10-06T01:42:47.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.787+0000 7ff6a424c700 1 -- 172.21.15.71:0/2297977604 shutdown_connections 2023-10-06T01:42:47.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.787+0000 7ff6a424c700 1 --2- 172.21.15.71:0/2297977604 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff69c0af8b0 0x7ff69c15d460 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:47.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.787+0000 7ff6a424c700 1 -- 172.21.15.71:0/2297977604 >> 172.21.15.71:0/2297977604 conn(0x7ff69c068680 msgr2=0x7ff69c068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:47.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.787+0000 7ff6a424c700 1 -- 172.21.15.71:0/2297977604 shutdown_connections 2023-10-06T01:42:47.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.787+0000 7ff6a424c700 1 -- 172.21.15.71:0/2297977604 wait complete. 2023-10-06T01:42:47.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.788+0000 7ff6a424c700 1 Processor -- start 2023-10-06T01:42:47.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.788+0000 7ff6a424c700 1 -- start start 2023-10-06T01:42:47.797 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.789+0000 7ff6a424c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff69c0af4e0 0x7ff69c0a6d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:47.798 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.789+0000 7ff6a424c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff69c0af8b0 0x7ff69c0a9510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:47.798 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.789+0000 7ff6a424c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff69c0b27f0 0x7ff69c169ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:47.798 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.789+0000 7ff6a424c700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff69c0aac20 con 0x7ff69c0b27f0 2023-10-06T01:42:47.798 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.789+0000 7ff6a424c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff69c0a7ff0 con 0x7ff69c0af4e0 2023-10-06T01:42:47.798 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.789+0000 7ff6a424c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff69c0a73e0 con 0x7ff69c0af8b0 2023-10-06T01:42:47.798 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.789+0000 7ff6a27e9700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff69c0b27f0 0x7ff69c169ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:47.798 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.789+0000 7ff6a27e9700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff69c0b27f0 0x7ff69c169ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:43120/0 (socket says 172.21.15.71:43120) 2023-10-06T01:42:47.798 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.789+0000 7ff6a27e9700 1 -- 172.21.15.71:0/2001827576 learned_addr learned my addr 172.21.15.71:0/2001827576 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:47.798 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.790+0000 7ff6a17e7700 1 --2- 172.21.15.71:0/2001827576 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff69c0af8b0 0x7ff69c0a9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:47.798 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.790+0000 7ff6a1fe8700 1 --2- 172.21.15.71:0/2001827576 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff69c0af4e0 0x7ff69c0a6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:47.798 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.790+0000 7ff6a27e9700 1 -- 172.21.15.71:0/2001827576 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff69c0af8b0 msgr2=0x7ff69c0a9510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:47.799 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.790+0000 7ff6a27e9700 1 --2- 172.21.15.71:0/2001827576 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff69c0af8b0 0x7ff69c0a9510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:47.799 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.790+0000 7ff6a27e9700 1 -- 172.21.15.71:0/2001827576 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff69c0af4e0 msgr2=0x7ff69c0a6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:47.799 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.790+0000 7ff6a27e9700 1 --2- 172.21.15.71:0/2001827576 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff69c0af4e0 0x7ff69c0a6d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:47.799 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.790+0000 7ff6a27e9700 1 -- 172.21.15.71:0/2001827576 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff68c009420 con 0x7ff69c0b27f0 2023-10-06T01:42:47.799 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.790+0000 7ff6a27e9700 1 --2- 172.21.15.71:0/2001827576 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff69c0b27f0 0x7ff69c169ef0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7ff69400bc30 tx=0x7ff694009820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:47.799 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.790+0000 7ff691ffb700 1 -- 172.21.15.71:0/2001827576 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff69400c9b0 con 0x7ff69c0b27f0 2023-10-06T01:42:47.799 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.790+0000 7ff691ffb700 1 -- 172.21.15.71:0/2001827576 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff69400cb50 con 0x7ff69c0b27f0 2023-10-06T01:42:47.799 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.790+0000 7ff6a424c700 1 -- 172.21.15.71:0/2001827576 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff69c0a76c0 con 0x7ff69c0b27f0 2023-10-06T01:42:47.799 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.790+0000 7ff691ffb700 1 -- 172.21.15.71:0/2001827576 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff694014410 con 0x7ff69c0b27f0 2023-10-06T01:42:47.799 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.790+0000 7ff6a424c700 1 -- 172.21.15.71:0/2001827576 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff69c0a7c80 con 0x7ff69c0b27f0 2023-10-06T01:42:47.799 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.791+0000 7ff6a424c700 1 -- 172.21.15.71:0/2001827576 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff69c088aa0 con 0x7ff69c0b27f0 2023-10-06T01:42:47.799 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.791+0000 7ff691ffb700 1 -- 172.21.15.71:0/2001827576 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff694014800 con 0x7ff69c0b27f0 2023-10-06T01:42:47.800 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.791+0000 7ff691ffb700 1 --2- 172.21.15.71:0/2001827576 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7ff680066f30 0x7ff6800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:47.800 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.792+0000 7ff691ffb700 1 -- 172.21.15.71:0/2001827576 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5698+0+0 (secure 0 0 0) 0x7ff6940845e0 con 0x7ff69c0b27f0 2023-10-06T01:42:47.800 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.792+0000 7ff6a1fe8700 1 --2- 172.21.15.71:0/2001827576 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7ff680066f30 0x7ff6800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:47.800 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.792+0000 7ff6a1fe8700 1 --2- 172.21.15.71:0/2001827576 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7ff680066f30 0x7ff6800693e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff69c0c8e70 tx=0x7ff698009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:47.800 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:47.796+0000 7ff691ffb700 1 -- 172.21.15.71:0/2001827576 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff69404c5a0 con 0x7ff69c0b27f0 2023-10-06T01:42:48.064 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:48.063+0000 7ff6a424c700 1 -- 172.21.15.71:0/2001827576 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_auto_repair.TestMDSAutoRepair.test_mds_readonly"]} v 0) v1 -- 0x7ff69c0cad20 con 0x7ff69c0b27f0 2023-10-06T01:42:48.325 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:48.324+0000 7ff691ffb700 1 -- 172.21.15.71:0/2001827576 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_auto_repair.TestMDSAutoRepair.test_mds_readonly"]}]=0 v147) v1 ==== 144+0+0 (secure 0 0 0) 0x7ff694051850 con 0x7ff69c0b27f0 2023-10-06T01:42:48.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:48.326+0000 7ff6a424c700 1 -- 172.21.15.71:0/2001827576 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7ff680066f30 msgr2=0x7ff6800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:48.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:48.326+0000 7ff6a424c700 1 --2- 172.21.15.71:0/2001827576 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7ff680066f30 0x7ff6800693e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff69c0c8e70 tx=0x7ff698009040 comp rx=0 tx=0).stop 2023-10-06T01:42:48.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:48.326+0000 7ff6a424c700 1 -- 172.21.15.71:0/2001827576 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff69c0b27f0 msgr2=0x7ff69c169ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:48.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:48.326+0000 7ff6a424c700 1 --2- 172.21.15.71:0/2001827576 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff69c0b27f0 0x7ff69c169ef0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7ff69400bc30 tx=0x7ff694009820 comp rx=0 tx=0).stop 2023-10-06T01:42:48.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:48.326+0000 7ff6a424c700 1 -- 172.21.15.71:0/2001827576 shutdown_connections 2023-10-06T01:42:48.328 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:48.326+0000 7ff6a424c700 1 --2- 172.21.15.71:0/2001827576 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff69c0b27f0 0x7ff69c169ef0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:48.328 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:48.326+0000 7ff6a424c700 1 --2- 172.21.15.71:0/2001827576 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7ff680066f30 0x7ff6800693e0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:48.328 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:48.326+0000 7ff6a424c700 1 --2- 172.21.15.71:0/2001827576 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff69c0af4e0 0x7ff69c0a6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:48.328 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:48.326+0000 7ff6a424c700 1 --2- 172.21.15.71:0/2001827576 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff69c0af8b0 0x7ff69c0a9510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:48.328 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:48.326+0000 7ff6a424c700 1 -- 172.21.15.71:0/2001827576 >> 172.21.15.71:0/2001827576 conn(0x7ff69c068680 msgr2=0x7ff69c0cc3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:48.328 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:48.326+0000 7ff6a424c700 1 -- 172.21.15.71:0/2001827576 shutdown_connections 2023-10-06T01:42:48.328 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:48.326+0000 7ff6a424c700 1 -- 172.21.15.71:0/2001827576 wait complete. 2023-10-06T01:42:48.339 INFO:tasks.cephfs_test_runner:test if MDS behave correct when it's readonly ... ok 2023-10-06T01:42:48.339 INFO:tasks.cephfs_test_runner: 2023-10-06T01:42:48.340 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-06T01:42:48.340 INFO:tasks.cephfs_test_runner:Ran 2 tests in 99.151s 2023-10-06T01:42:48.340 INFO:tasks.cephfs_test_runner: 2023-10-06T01:42:48.340 INFO:tasks.cephfs_test_runner:OK 2023-10-06T01:42:48.340 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-10-06T01:42:48.349 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-10-06T01:42:48.427 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-10-06T01:42:48.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:42:48.427 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list 2023-10-06T01:42:48.445 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-06T01:42:48.445 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-06T01:42:48.446 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:42:48.446 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-06T01:42:48.521 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:42:48.521 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T01:42:48.598 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:42:48.598 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link delete ceph-brx 2023-10-06T01:42:48.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:42:48.711 DEBUG:teuthology.orchestra.run.smithi071:> ip netns list 2023-10-06T01:42:48.726 INFO:teuthology.orchestra.run.smithi071.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T01:42:48.726 INFO:teuthology.orchestra.run.smithi071.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T01:42:48.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:42:48.727 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T01:42:48.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:42:48.805 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T01:42:48.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:42:48.880 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link delete ceph-brx 2023-10-06T01:42:48.983 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-10-06T01:42:49.008 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2023-10-06T01:42:49.009 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:42:49.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.125+0000 7f761795b700 1 Processor -- start 2023-10-06T01:42:49.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.125+0000 7f761795b700 1 -- start start 2023-10-06T01:42:49.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.126+0000 7f761795b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f761015a9a0 0x7f76100c8e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:49.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.126+0000 7f761795b700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f761006eb30 con 0x7f761015a5d0 2023-10-06T01:42:49.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.126+0000 7f761795b700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76100c9760 con 0x7f76100b1750 2023-10-06T01:42:49.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.126+0000 7f761795b700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76100c9480 con 0x7f761015a9a0 2023-10-06T01:42:49.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.126+0000 7f76156f7700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f761015a5d0 0x7f76100b1040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:55442/0 (socket says 172.21.15.71:55442) 2023-10-06T01:42:49.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.126+0000 7f76156f7700 1 -- 172.21.15.71:0/2676787395 learned_addr learned my addr 172.21.15.71:0/2676787395 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:42:49.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.127+0000 7f7607fff700 1 -- 172.21.15.71:0/2676787395 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1181182715 0 0) 0x7f761006eb30 con 0x7f761015a5d0 2023-10-06T01:42:49.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.127+0000 7f7607fff700 1 -- 172.21.15.71:0/2676787395 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75fc003570 con 0x7f761015a5d0 2023-10-06T01:42:49.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.127+0000 7f7615ef8700 1 --2- 172.21.15.71:0/2676787395 >> v2:172.21.15.72:3300/0 conn(0x7f761015a9a0 0x7f76100c8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:49.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.127+0000 7f7607fff700 1 -- 172.21.15.71:0/2676787395 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3032707813 0 0) 0x7f75fc003570 con 0x7f761015a5d0 2023-10-06T01:42:49.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.127+0000 7f7607fff700 1 -- 172.21.15.71:0/2676787395 >> v2:172.21.15.72:3300/0 conn(0x7f761015a9a0 msgr2=0x7f76100c8e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:49.131 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.127+0000 7f7607fff700 1 --2- 172.21.15.71:0/2676787395 >> v2:172.21.15.72:3300/0 conn(0x7f761015a9a0 0x7f76100c8e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:49.131 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.127+0000 7f7607fff700 1 -- 172.21.15.71:0/2676787395 >> v1:172.21.15.72:6789/0 conn(0x7f76100b1750 legacy=0x7f76100c8770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:49.131 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.127+0000 7f7607fff700 1 -- 172.21.15.71:0/2676787395 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f761006e4e0 con 0x7f761015a5d0 2023-10-06T01:42:49.131 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.127+0000 7f7607fff700 1 -- 172.21.15.71:0/2676787395 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1184243524 0 0) 0x7f760c001470 con 0x7f761015a5d0 2023-10-06T01:42:49.131 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.127+0000 7f7615ef8700 1 --2- 172.21.15.71:0/2676787395 >> v2:172.21.15.72:3300/0 conn(0x7f761015a9a0 0x7f76100c8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:42:49.131 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.127+0000 7f7607fff700 1 -- 172.21.15.71:0/2676787395 >> v1:172.21.15.71:6789/0 conn(0x7f761015a5d0 legacy=0x7f76100b1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:49.131 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.127+0000 7f7607fff700 1 --2- 172.21.15.71:0/2676787395 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f75fc003a60 0x7f75fc003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:49.131 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.127+0000 7f7607fff700 1 --2- 172.21.15.71:0/2676787395 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75fc004810 0x7f75fc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:49.131 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.127+0000 7f7607fff700 1 --2- 172.21.15.71:0/2676787395 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f75fc0052e0 0x7f75fc00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:49.131 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.127+0000 7f7607fff700 1 -- 172.21.15.71:0/2676787395 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76100c9480 con 0x7f75fc0052e0 2023-10-06T01:42:49.131 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.127+0000 7f7607fff700 1 -- 172.21.15.71:0/2676787395 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75fc00c190 con 0x7f75fc004810 2023-10-06T01:42:49.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.127+0000 7f7607fff700 1 -- 172.21.15.71:0/2676787395 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75fc00c350 con 0x7f75fc003a60 2023-10-06T01:42:49.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.127+0000 7f7614ef6700 1 --2- 172.21.15.71:0/2676787395 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75fc004810 0x7f75fc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:49.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.127+0000 7f76156f7700 1 --2- 172.21.15.71:0/2676787395 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f75fc003a60 0x7f75fc003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:49.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.127+0000 7f7615ef8700 1 --2- 172.21.15.71:0/2676787395 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f75fc0052e0 0x7f75fc00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:49.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.127+0000 7f7614ef6700 1 -- 172.21.15.71:0/2676787395 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f75fc003a60 msgr2=0x7f75fc003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:49.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.127+0000 7f7614ef6700 1 --2- 172.21.15.71:0/2676787395 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f75fc003a60 0x7f75fc003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:49.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.127+0000 7f7614ef6700 1 -- 172.21.15.71:0/2676787395 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f75fc0052e0 msgr2=0x7f75fc00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:49.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.127+0000 7f7614ef6700 1 --2- 172.21.15.71:0/2676787395 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f75fc0052e0 0x7f75fc00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:49.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.127+0000 7f7614ef6700 1 -- 172.21.15.71:0/2676787395 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75fc003570 con 0x7f75fc004810 2023-10-06T01:42:49.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.127+0000 7f7615ef8700 1 --2- 172.21.15.71:0/2676787395 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f75fc0052e0 0x7f75fc00ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:42:49.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.127+0000 7f7615ef8700 1 -- 172.21.15.71:0/2676787395 reap_dead start 2023-10-06T01:42:49.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.127+0000 7f7614ef6700 1 --2- 172.21.15.71:0/2676787395 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75fc004810 0x7f75fc004c80 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7600001880 tx=0x7f7600007d30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f23f4f7eebfec255 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:49.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.128+0000 7f7607fff700 1 -- 172.21.15.71:0/2676787395 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7600012420 con 0x7f75fc004810 2023-10-06T01:42:49.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.128+0000 7f7607fff700 1 -- 172.21.15.71:0/2676787395 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76000125a0 con 0x7f75fc004810 2023-10-06T01:42:49.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.128+0000 7f7607fff700 1 -- 172.21.15.71:0/2676787395 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7600012960 con 0x7f75fc004810 2023-10-06T01:42:49.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.128+0000 7f761795b700 1 -- 172.21.15.71:0/2676787395 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75fc004810 msgr2=0x7f75fc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:49.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.128+0000 7f761795b700 1 --2- 172.21.15.71:0/2676787395 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75fc004810 0x7f75fc004c80 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7600001880 tx=0x7f7600007d30 comp rx=0 tx=0).stop 2023-10-06T01:42:49.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.128+0000 7f761795b700 1 -- 172.21.15.71:0/2676787395 shutdown_connections 2023-10-06T01:42:49.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.128+0000 7f761795b700 1 --2- 172.21.15.71:0/2676787395 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75fc004810 0x7f75fc004c80 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:49.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.128+0000 7f761795b700 1 -- 172.21.15.71:0/2676787395 >> 172.21.15.71:0/2676787395 conn(0x7f7610069100 msgr2=0x7f76100ad9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:49.133 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.128+0000 7f761795b700 1 -- 172.21.15.71:0/2676787395 shutdown_connections 2023-10-06T01:42:49.134 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.128+0000 7f761795b700 1 -- 172.21.15.71:0/2676787395 wait complete. 2023-10-06T01:42:49.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.129+0000 7f761795b700 1 Processor -- start 2023-10-06T01:42:49.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.129+0000 7f761795b700 1 -- start start 2023-10-06T01:42:49.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.130+0000 7f761795b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75fc004810 0x7f76100a7d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:49.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.130+0000 7f761795b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f76100a9ec0 0x7f7610167810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:49.136 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.130+0000 7f761795b700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f76100cbb40 0x7f76100cbfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:49.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.130+0000 7f761795b700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76100cc500 con 0x7f76100cbb40 2023-10-06T01:42:49.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.130+0000 7f761795b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7610142280 con 0x7f75fc004810 2023-10-06T01:42:49.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.130+0000 7f761795b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76101689d0 con 0x7f76100a9ec0 2023-10-06T01:42:49.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.130+0000 7f7615ef8700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f76100cbb40 0x7f76100cbfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:49.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.130+0000 7f7615ef8700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f76100cbb40 0x7f76100cbfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:43140/0 (socket says 172.21.15.71:43140) 2023-10-06T01:42:49.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.130+0000 7f7615ef8700 1 -- 172.21.15.71:0/1674527674 learned_addr learned my addr 172.21.15.71:0/1674527674 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:49.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.131+0000 7f76156f7700 1 --2- 172.21.15.71:0/1674527674 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75fc004810 0x7f76100a7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:49.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.131+0000 7f7614ef6700 1 --2- 172.21.15.71:0/1674527674 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f76100a9ec0 0x7f7610167810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:49.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.131+0000 7f7615ef8700 1 -- 172.21.15.71:0/1674527674 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f76100a9ec0 msgr2=0x7f7610167810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:49.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.131+0000 7f7615ef8700 1 --2- 172.21.15.71:0/1674527674 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f76100a9ec0 0x7f7610167810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:49.137 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.131+0000 7f7615ef8700 1 -- 172.21.15.71:0/1674527674 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75fc004810 msgr2=0x7f76100a7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:49.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.131+0000 7f7615ef8700 1 --2- 172.21.15.71:0/1674527674 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75fc004810 0x7f76100a7d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:49.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.131+0000 7f7615ef8700 1 -- 172.21.15.71:0/1674527674 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7610168cb0 con 0x7f76100cbb40 2023-10-06T01:42:49.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.131+0000 7f76156f7700 1 --2- 172.21.15.71:0/1674527674 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75fc004810 0x7f76100a7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:42:49.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.131+0000 7f7615ef8700 1 --2- 172.21.15.71:0/1674527674 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f76100cbb40 0x7f76100cbfc0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f76100b1f40 tx=0x7f76080097d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:49.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.131+0000 7f76057fa700 1 -- 172.21.15.71:0/1674527674 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7608015420 con 0x7f76100cbb40 2023-10-06T01:42:49.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.131+0000 7f76057fa700 1 -- 172.21.15.71:0/1674527674 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7608015580 con 0x7f76100cbb40 2023-10-06T01:42:49.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.131+0000 7f761795b700 1 -- 172.21.15.71:0/1674527674 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7610167d50 con 0x7f76100cbb40 2023-10-06T01:42:49.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.131+0000 7f76057fa700 1 -- 172.21.15.71:0/1674527674 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7608015900 con 0x7f76100cbb40 2023-10-06T01:42:49.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.131+0000 7f761795b700 1 -- 172.21.15.71:0/1674527674 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7610168300 con 0x7f76100cbb40 2023-10-06T01:42:49.138 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.132+0000 7f761795b700 1 -- 172.21.15.71:0/1674527674 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7610168e40 con 0x7f76100cbb40 2023-10-06T01:42:49.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.132+0000 7f76057fa700 1 -- 172.21.15.71:0/1674527674 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7608003040 con 0x7f76100cbb40 2023-10-06T01:42:49.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.133+0000 7f76057fa700 1 --2- 172.21.15.71:0/1674527674 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f75f4066f30 0x7f75f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:49.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.133+0000 7f76057fa700 1 -- 172.21.15.71:0/1674527674 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f7608084ee0 con 0x7f76100cbb40 2023-10-06T01:42:49.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.133+0000 7f76156f7700 1 --2- 172.21.15.71:0/1674527674 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f75f4066f30 0x7f75f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:49.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.133+0000 7f76156f7700 1 --2- 172.21.15.71:0/1674527674 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f75f4066f30 0x7f75f40693e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f760c001c00 tx=0x7f760c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:49.139 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.137+0000 7f76057fa700 1 -- 172.21.15.71:0/1674527674 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7608052150 con 0x7f76100cbb40 2023-10-06T01:42:49.327 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.326+0000 7f761795b700 1 -- 172.21.15.71:0/1674527674 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f761006e7c0 con 0x7f76100cbb40 2023-10-06T01:42:49.328 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.327+0000 7f76057fa700 1 -- 172.21.15.71:0/1674527674 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+14064 (secure 0 0 0) 0x7f7608055770 con 0x7f76100cbb40 2023-10-06T01:42:49.328 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:42:49.328 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":61,"fsid":"1fbf1bd2-f9b4-4599-bea2-f4aa920e9a56","created":"2023-10-06T01:39:57.016957+0000","modified":"2023-10-06T01:42:47.318013+0000","last_up_change":"2023-10-06T01:40:08.571643+0000","last_in_change":"2023-10-06T01:39:59.462741+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T01:40:08.610349+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T01:40:15.387434+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"cf059188-fb20-4dbf-95db-dcf57b213d03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":90670},{"type":"v1","addr":"172.21.15.71:6817","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":90670},{"type":"v1","addr":"172.21.15.71:6819","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":90670},{"type":"v1","addr":"172.21.15.71:6823","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":90670},{"type":"v1","addr":"172.21.15.71:6821","nonce":90670}]},"public_addr":"172.21.15.71:6817/90670","cluster_addr":"172.21.15.71:6819/90670","heartbeat_back_addr":"172.21.15.71:6823/90670","heartbeat_front_addr":"172.21.15.71:6821/90670","state":["exists","up"]},{"osd":1,"uuid":"0cff0aae-1799-4fe0-b610-54cf0813c0e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":90669},{"type":"v1","addr":"172.21.15.71:6809","nonce":90669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":90669},{"type":"v1","addr":"172.21.15.71:6811","nonce":90669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":90669},{"type":"v1","addr":"172.21.15.71:6815","nonce":90669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":90669},{"type":"v1","addr":"172.21.15.71:6813","nonce":90669}]},"public_addr":"172.21.15.71:6809/90669","cluster_addr":"172.21.15.71:6811/90669","heartbeat_back_addr":"172.21.15.71:6815/90669","heartbeat_front_addr":"172.21.15.71:6813/90669","state":["exists","up"]},{"osd":2,"uuid":"88d61ddc-9031-44e1-ba8c-546a41e7c8ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":90679},{"type":"v1","addr":"172.21.15.71:6825","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":90679},{"type":"v1","addr":"172.21.15.71:6827","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":90679},{"type":"v1","addr":"172.21.15.71:6831","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":90679},{"type":"v1","addr":"172.21.15.71:6829","nonce":90679}]},"public_addr":"172.21.15.71:6825/90679","cluster_addr":"172.21.15.71:6827/90679","heartbeat_back_addr":"172.21.15.71:6831/90679","heartbeat_front_addr":"172.21.15.71:6829/90679","state":["exists","up"]},{"osd":3,"uuid":"11ed92b7-960b-4a30-a889-a61d3eeb86f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":90668},{"type":"v1","addr":"172.21.15.71:6801","nonce":90668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":90668},{"type":"v1","addr":"172.21.15.71:6803","nonce":90668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":90668},{"type":"v1","addr":"172.21.15.71:6807","nonce":90668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":90668},{"type":"v1","addr":"172.21.15.71:6805","nonce":90668}]},"public_addr":"172.21.15.71:6801/90668","cluster_addr":"172.21.15.71:6803/90668","heartbeat_back_addr":"172.21.15.71:6807/90668","heartbeat_front_addr":"172.21.15.71:6805/90668","state":["exists","up"]},{"osd":4,"uuid":"ae4df784-abdf-4ddf-aefa-780f3ddafef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":90917},{"type":"v1","addr":"172.21.15.72:6801","nonce":90917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":90917},{"type":"v1","addr":"172.21.15.72:6803","nonce":90917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":90917},{"type":"v1","addr":"172.21.15.72:6807","nonce":90917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":90917},{"type":"v1","addr":"172.21.15.72:6805","nonce":90917}]},"public_addr":"172.21.15.72:6801/90917","cluster_addr":"172.21.15.72:6803/90917","heartbeat_back_addr":"172.21.15.72:6807/90917","heartbeat_front_addr":"172.21.15.72:6805/90917","state":["exists","up"]},{"osd":5,"uuid":"5ef0790f-001e-458f-a05b-efae216cf435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":90941},{"type":"v1","addr":"172.21.15.72:6817","nonce":90941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":90941},{"type":"v1","addr":"172.21.15.72:6819","nonce":90941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":90941},{"type":"v1","addr":"172.21.15.72:6827","nonce":90941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":90941},{"type":"v1","addr":"172.21.15.72:6823","nonce":90941}]},"public_addr":"172.21.15.72:6817/90941","cluster_addr":"172.21.15.72:6819/90941","heartbeat_back_addr":"172.21.15.72:6827/90941","heartbeat_front_addr":"172.21.15.72:6823/90941","state":["exists","up"]},{"osd":6,"uuid":"8705aef1-9ae8-4e54-a3c4-c2909fa0ceb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":90918},{"type":"v1","addr":"172.21.15.72:6809","nonce":90918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":90918},{"type":"v1","addr":"172.21.15.72:6811","nonce":90918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":90918},{"type":"v1","addr":"172.21.15.72:6815","nonce":90918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":90918},{"type":"v1","addr":"172.21.15.72:6813","nonce":90918}]},"public_addr":"172.21.15.72:6809/90918","cluster_addr":"172.21.15.72:6811/90918","heartbeat_back_addr":"172.21.15.72:6815/90918","heartbeat_front_addr":"172.21.15.72:6813/90918","state":["exists","up"]},{"osd":7,"uuid":"364c5119-6b13-4c75-b3f0-15e165eff86a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":90948},{"type":"v1","addr":"172.21.15.72:6822","nonce":90948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":90948},{"type":"v1","addr":"172.21.15.72:6826","nonce":90948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":90948},{"type":"v1","addr":"172.21.15.72:6831","nonce":90948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":90948},{"type":"v1","addr":"172.21.15.72:6829","nonce":90948}]},"public_addr":"172.21.15.72:6822/90948","cluster_addr":"172.21.15.72:6826/90948","heartbeat_back_addr":"172.21.15.72:6831/90948","heartbeat_front_addr":"172.21.15.72:6829/90948","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.642976+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.645372+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.619116+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.663042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.599163+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.646411+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.631545+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.669821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.71:6837/2318258263":"2023-10-07T01:42:44.309559+0000","172.21.15.71:6836/2318258263":"2023-10-07T01:42:44.309559+0000","172.21.15.72:6835/627948818":"2023-10-07T01:42:34.014707+0000","172.21.15.72:6833/627948818":"2023-10-07T01:42:34.014707+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:42:49.330 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.329+0000 7f761795b700 1 -- 172.21.15.71:0/1674527674 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f75f4066f30 msgr2=0x7f75f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:49.330 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.329+0000 7f761795b700 1 --2- 172.21.15.71:0/1674527674 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f75f4066f30 0x7f75f40693e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f760c001c00 tx=0x7f760c009040 comp rx=0 tx=0).stop 2023-10-06T01:42:49.331 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.329+0000 7f761795b700 1 -- 172.21.15.71:0/1674527674 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f76100cbb40 msgr2=0x7f76100cbfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:49.331 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.329+0000 7f761795b700 1 --2- 172.21.15.71:0/1674527674 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f76100cbb40 0x7f76100cbfc0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f76100b1f40 tx=0x7f76080097d0 comp rx=0 tx=0).stop 2023-10-06T01:42:49.331 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.329+0000 7f761795b700 1 -- 172.21.15.71:0/1674527674 shutdown_connections 2023-10-06T01:42:49.331 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.329+0000 7f761795b700 1 --2- 172.21.15.71:0/1674527674 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f76100cbb40 0x7f76100cbfc0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:49.331 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.329+0000 7f761795b700 1 --2- 172.21.15.71:0/1674527674 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f75f4066f30 0x7f75f40693e0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:49.331 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.329+0000 7f761795b700 1 --2- 172.21.15.71:0/1674527674 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75fc004810 0x7f76100a7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:49.331 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.329+0000 7f761795b700 1 --2- 172.21.15.71:0/1674527674 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f76100a9ec0 0x7f7610167810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:49.331 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.329+0000 7f761795b700 1 -- 172.21.15.71:0/1674527674 >> 172.21.15.71:0/1674527674 conn(0x7f7610069100 msgr2=0x7f76100cb0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:49.331 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.329+0000 7f761795b700 1 -- 172.21.15.71:0/1674527674 shutdown_connections 2023-10-06T01:42:49.331 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.329+0000 7f761795b700 1 -- 172.21.15.71:0/1674527674 wait complete. 2023-10-06T01:42:49.342 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-06T01:42:49.342 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T01:42:49.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.455+0000 7fb220451700 1 Processor -- start 2023-10-06T01:42:49.456 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.455+0000 7fb220451700 1 -- start start 2023-10-06T01:42:49.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.456+0000 7fb220451700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fb21815b3c0 0x7fb218097d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:49.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.456+0000 7fb220451700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2180afb90 con 0x7fb2180b3c50 2023-10-06T01:42:49.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.456+0000 7fb220451700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2180b2310 con 0x7fb21815a590 2023-10-06T01:42:49.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.456+0000 7fb220451700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2180b25f0 con 0x7fb21815b3c0 2023-10-06T01:42:49.458 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.457+0000 7fb21e1ed700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fb21815b3c0 0x7fb218097d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:49.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.457+0000 7fb21d9ec700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fb2180b3c50 0x7fb21815b790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:53426/0 (socket says 172.21.15.71:53426) 2023-10-06T01:42:49.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.457+0000 7fb21d9ec700 1 -- 172.21.15.71:0/3599866023 learned_addr learned my addr 172.21.15.71:0/3599866023 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:42:49.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.457+0000 7fb21e1ed700 1 -- 172.21.15.71:0/3599866023 >> v1:172.21.15.72:6789/0 conn(0x7fb21815a590 legacy=0x7fb21815a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:49.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.457+0000 7fb21e1ed700 1 -- 172.21.15.71:0/3599866023 >> v1:172.21.15.71:6789/0 conn(0x7fb2180b3c50 legacy=0x7fb21815b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:49.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.457+0000 7fb21e1ed700 1 -- 172.21.15.71:0/3599866023 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2180af820 con 0x7fb21815b3c0 2023-10-06T01:42:49.459 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.457+0000 7fb21d1eb700 1 -- 172.21.15.71:0/3599866023 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3179116680 0 0) 0x7fb2180afb90 con 0x7fb2180b3c50 2023-10-06T01:42:49.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.457+0000 7fb21e1ed700 1 --2- 172.21.15.71:0/3599866023 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb21815b3c0 0x7fb218097d70 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fb214009eb0 tx=0x7fb214009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7717270b45aef4e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:49.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.457+0000 7fb21d1eb700 1 -- 172.21.15.71:0/3599866023 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb21400e070 con 0x7fb21815b3c0 2023-10-06T01:42:49.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.457+0000 7fb21d1eb700 1 -- 172.21.15.71:0/3599866023 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb21400bbf0 con 0x7fb21815b3c0 2023-10-06T01:42:49.460 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.457+0000 7fb21d1eb700 1 -- 172.21.15.71:0/3599866023 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb214012430 con 0x7fb21815b3c0 2023-10-06T01:42:49.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.458+0000 7fb220451700 1 -- 172.21.15.71:0/3599866023 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb21815b3c0 msgr2=0x7fb218097d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:49.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.458+0000 7fb220451700 1 --2- 172.21.15.71:0/3599866023 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb21815b3c0 0x7fb218097d70 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fb214009eb0 tx=0x7fb214009780 comp rx=0 tx=0).stop 2023-10-06T01:42:49.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.458+0000 7fb220451700 1 -- 172.21.15.71:0/3599866023 shutdown_connections 2023-10-06T01:42:49.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.458+0000 7fb220451700 1 --2- 172.21.15.71:0/3599866023 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb21815b3c0 0x7fb218097d70 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:49.464 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.458+0000 7fb220451700 1 -- 172.21.15.71:0/3599866023 >> 172.21.15.71:0/3599866023 conn(0x7fb218067910 msgr2=0x7fb2180ce160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:49.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.458+0000 7fb220451700 1 -- 172.21.15.71:0/3599866023 shutdown_connections 2023-10-06T01:42:49.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.458+0000 7fb220451700 1 -- 172.21.15.71:0/3599866023 wait complete. 2023-10-06T01:42:49.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.459+0000 7fb220451700 1 Processor -- start 2023-10-06T01:42:49.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.459+0000 7fb220451700 1 -- start start 2023-10-06T01:42:49.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.460+0000 7fb220451700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb2180b3c50 0x7fb2181574d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:49.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.460+0000 7fb220451700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb21815a590 0x7fb2180a8f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:49.465 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.460+0000 7fb220451700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb21815b3c0 0x7fb2180ac3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:49.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.460+0000 7fb220451700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2180a98d0 con 0x7fb21815a590 2023-10-06T01:42:49.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.460+0000 7fb220451700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2180a9bb0 con 0x7fb21815b3c0 2023-10-06T01:42:49.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.460+0000 7fb220451700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2180a9e90 con 0x7fb2180b3c50 2023-10-06T01:42:49.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.460+0000 7fb21d9ec700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb21815a590 0x7fb2180a8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:49.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.460+0000 7fb21d9ec700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb21815a590 0x7fb2180a8f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41258/0 (socket says 172.21.15.71:41258) 2023-10-06T01:42:49.466 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.460+0000 7fb21d9ec700 1 -- 172.21.15.71:0/3509495012 learned_addr learned my addr 172.21.15.71:0/3509495012 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:49.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.460+0000 7fb21e1ed700 1 --2- 172.21.15.71:0/3509495012 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb2180b3c50 0x7fb2181574d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:49.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.460+0000 7fb21e9ee700 1 --2- 172.21.15.71:0/3509495012 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb21815b3c0 0x7fb2180ac3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:49.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.460+0000 7fb21d9ec700 1 -- 172.21.15.71:0/3509495012 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb2180b3c50 msgr2=0x7fb2181574d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:49.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.460+0000 7fb21d9ec700 1 --2- 172.21.15.71:0/3509495012 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb2180b3c50 0x7fb2181574d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:49.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.460+0000 7fb21d9ec700 1 -- 172.21.15.71:0/3509495012 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb21815b3c0 msgr2=0x7fb2180ac3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:49.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.460+0000 7fb21d9ec700 1 --2- 172.21.15.71:0/3509495012 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb21815b3c0 0x7fb2180ac3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:49.467 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.460+0000 7fb21d9ec700 1 -- 172.21.15.71:0/3509495012 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb214009a20 con 0x7fb21815a590 2023-10-06T01:42:49.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.460+0000 7fb21d9ec700 1 --2- 172.21.15.71:0/3509495012 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb21815a590 0x7fb2180a8f80 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fb20800c5b0 tx=0x7fb208001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:49.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.460+0000 7fb20e7fc700 1 -- 172.21.15.71:0/3509495012 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb208005b30 con 0x7fb21815a590 2023-10-06T01:42:49.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.460+0000 7fb20e7fc700 1 -- 172.21.15.71:0/3509495012 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb208005c90 con 0x7fb21815a590 2023-10-06T01:42:49.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.460+0000 7fb220451700 1 -- 172.21.15.71:0/3509495012 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2180aa170 con 0x7fb21815a590 2023-10-06T01:42:49.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.460+0000 7fb20e7fc700 1 -- 172.21.15.71:0/3509495012 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb208007300 con 0x7fb21815a590 2023-10-06T01:42:49.468 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.460+0000 7fb220451700 1 -- 172.21.15.71:0/3509495012 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb218157a10 con 0x7fb21815a590 2023-10-06T01:42:49.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.461+0000 7fb220451700 1 -- 172.21.15.71:0/3509495012 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2180ad1d0 con 0x7fb21815a590 2023-10-06T01:42:49.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.462+0000 7fb20e7fc700 1 -- 172.21.15.71:0/3509495012 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb20801b3b0 con 0x7fb21815a590 2023-10-06T01:42:49.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.462+0000 7fb20e7fc700 1 --2- 172.21.15.71:0/3509495012 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fb1fc066f30 0x7fb1fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:49.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.462+0000 7fb20e7fc700 1 -- 172.21.15.71:0/3509495012 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5698+0+0 (secure 0 0 0) 0x7fb208083a60 con 0x7fb21815a590 2023-10-06T01:42:49.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.462+0000 7fb21e1ed700 1 --2- 172.21.15.71:0/3509495012 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fb1fc066f30 0x7fb1fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:49.469 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.462+0000 7fb21e1ed700 1 --2- 172.21.15.71:0/3509495012 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fb1fc066f30 0x7fb1fc0693e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb2140099f0 tx=0x7fb214016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:49.470 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.466+0000 7fb20e7fc700 1 -- 172.21.15.71:0/3509495012 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb208050cd0 con 0x7fb21815a590 2023-10-06T01:42:49.647 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.646+0000 7fb220451700 1 -- 172.21.15.71:0/3509495012 --> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb21806e8d0 con 0x7fb1fc066f30 2023-10-06T01:42:49.649 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.649+0000 7fb20e7fc700 1 -- 172.21.15.71:0/3509495012 <== mgr.4107 v2:172.21.15.71:6832/90436 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+72841 (secure 0 0 0) 0x7fb21806e8d0 con 0x7fb1fc066f30 2023-10-06T01:42:49.650 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:42:49.651 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.651+0000 7fb220451700 1 -- 172.21.15.71:0/3509495012 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fb1fc066f30 msgr2=0x7fb1fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:49.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.651+0000 7fb220451700 1 --2- 172.21.15.71:0/3509495012 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fb1fc066f30 0x7fb1fc0693e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb2140099f0 tx=0x7fb214016000 comp rx=0 tx=0).stop 2023-10-06T01:42:49.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.651+0000 7fb220451700 1 -- 172.21.15.71:0/3509495012 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb21815a590 msgr2=0x7fb2180a8f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:49.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.651+0000 7fb220451700 1 --2- 172.21.15.71:0/3509495012 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb21815a590 0x7fb2180a8f80 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fb20800c5b0 tx=0x7fb208001070 comp rx=0 tx=0).stop 2023-10-06T01:42:49.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.651+0000 7fb220451700 1 -- 172.21.15.71:0/3509495012 shutdown_connections 2023-10-06T01:42:49.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.651+0000 7fb220451700 1 --2- 172.21.15.71:0/3509495012 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fb1fc066f30 0x7fb1fc0693e0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:49.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.651+0000 7fb220451700 1 --2- 172.21.15.71:0/3509495012 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb21815b3c0 0x7fb2180ac3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:49.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.651+0000 7fb220451700 1 --2- 172.21.15.71:0/3509495012 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb2180b3c50 0x7fb2181574d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:49.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.651+0000 7fb220451700 1 --2- 172.21.15.71:0/3509495012 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb21815a590 0x7fb2180a8f80 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:49.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.651+0000 7fb220451700 1 -- 172.21.15.71:0/3509495012 >> 172.21.15.71:0/3509495012 conn(0x7fb218067910 msgr2=0x7fb2180adb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:49.652 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.651+0000 7fb220451700 1 -- 172.21.15.71:0/3509495012 shutdown_connections 2023-10-06T01:42:49.653 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.651+0000 7fb220451700 1 -- 172.21.15.71:0/3509495012 wait complete. 2023-10-06T01:42:49.653 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2023-10-06T01:42:49.663 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":134,"stamp":"2023-10-06T01:42:48.595901+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2384956,"kb_used_data":6652,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752589764,"statfs":{"total":773094113280,"available":770651918336,"internally_reserved":0,"allocated":6811648,"data_stored":3782919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-11379,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-49,"num_read_kb":-60,"num_write":-62,"num_write_kb":-31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001017"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":44,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T01:42:35.032246+0000","last_change":"2023-10-06T01:40:16.930992+0000","last_active":"2023-10-06T01:42:35.032246+0000","last_peered":"2023-10-06T01:42:35.032246+0000","last_clean":"2023-10-06T01:42:35.032246+0000","last_became_active":"2023-10-06T01:40:16.930707+0000","last_became_peered":"2023-10-06T01:40:16.930707+0000","last_unstale":"2023-10-06T01:42:35.032246+0000","last_undegraded":"2023-10-06T01:42:35.032246+0000","last_fullsized":"2023-10-06T01:42:35.032246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:52:43.316071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":43,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T01:42:34.783844+0000","last_change":"2023-10-06T01:40:16.651019+0000","last_active":"2023-10-06T01:42:34.783844+0000","last_peered":"2023-10-06T01:42:34.783844+0000","last_clean":"2023-10-06T01:42:34.783844+0000","last_became_active":"2023-10-06T01:40:16.650628+0000","last_became_peered":"2023-10-06T01:40:16.650628+0000","last_unstale":"2023-10-06T01:42:34.783844+0000","last_undegraded":"2023-10-06T01:42:34.783844+0000","last_fullsized":"2023-10-06T01:42:34.783844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:11:57.218984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":40,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T01:42:01.656770+0000","last_change":"2023-10-06T01:40:16.781596+0000","last_active":"2023-10-06T01:42:01.656770+0000","last_peered":"2023-10-06T01:42:01.656770+0000","last_clean":"2023-10-06T01:42:01.656770+0000","last_became_active":"2023-10-06T01:40:16.781352+0000","last_became_peered":"2023-10-06T01:40:16.781352+0000","last_unstale":"2023-10-06T01:42:01.656770+0000","last_undegraded":"2023-10-06T01:42:01.656770+0000","last_fullsized":"2023-10-06T01:42:01.656770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:52:43.316071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":43,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T01:42:34.783978+0000","last_change":"2023-10-06T01:40:16.650826+0000","last_active":"2023-10-06T01:42:34.783978+0000","last_peered":"2023-10-06T01:42:34.783978+0000","last_clean":"2023-10-06T01:42:34.783978+0000","last_became_active":"2023-10-06T01:40:16.650469+0000","last_became_peered":"2023-10-06T01:40:16.650469+0000","last_unstale":"2023-10-06T01:42:34.783978+0000","last_undegraded":"2023-10-06T01:42:34.783978+0000","last_fullsized":"2023-10-06T01:42:34.783978+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:50:23.628212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":195,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T01:42:34.186634+0000","last_change":"2023-10-06T01:40:10.645512+0000","last_active":"2023-10-06T01:42:34.186634+0000","last_peered":"2023-10-06T01:42:34.186634+0000","last_clean":"2023-10-06T01:42:34.186634+0000","last_became_active":"2023-10-06T01:40:10.644601+0000","last_became_peered":"2023-10-06T01:40:10.644601+0000","last_unstale":"2023-10-06T01:42:34.186634+0000","last_undegraded":"2023-10-06T01:42:34.186634+0000","last_fullsized":"2023-10-06T01:42:34.186634+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:09.580865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:09.580865+0000","last_clean_scrub_stamp":"2023-10-06T01:40:09.580865+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:05:28.268591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":42,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T01:42:34.186708+0000","last_change":"2023-10-06T01:40:16.651332+0000","last_active":"2023-10-06T01:42:34.186708+0000","last_peered":"2023-10-06T01:42:34.186708+0000","last_clean":"2023-10-06T01:42:34.186708+0000","last_became_active":"2023-10-06T01:40:16.651049+0000","last_became_peered":"2023-10-06T01:40:16.651049+0000","last_unstale":"2023-10-06T01:42:34.186708+0000","last_undegraded":"2023-10-06T01:42:34.186708+0000","last_fullsized":"2023-10-06T01:42:34.186708+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:11:57.218984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":42,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T01:42:34.187121+0000","last_change":"2023-10-06T01:40:16.931106+0000","last_active":"2023-10-06T01:42:34.187121+0000","last_peered":"2023-10-06T01:42:34.187121+0000","last_clean":"2023-10-06T01:42:34.187121+0000","last_became_active":"2023-10-06T01:40:16.930830+0000","last_became_peered":"2023-10-06T01:40:16.930830+0000","last_unstale":"2023-10-06T01:42:34.187121+0000","last_undegraded":"2023-10-06T01:42:34.187121+0000","last_fullsized":"2023-10-06T01:42:34.187121+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:50:23.628212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":44,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T01:42:35.032529+0000","last_change":"2023-10-06T01:40:16.649379+0000","last_active":"2023-10-06T01:42:35.032529+0000","last_peered":"2023-10-06T01:42:35.032529+0000","last_clean":"2023-10-06T01:42:35.032529+0000","last_became_active":"2023-10-06T01:40:16.649147+0000","last_became_peered":"2023-10-06T01:40:16.649147+0000","last_unstale":"2023-10-06T01:42:35.032529+0000","last_undegraded":"2023-10-06T01:42:35.032529+0000","last_fullsized":"2023-10-06T01:42:35.032529+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:11:57.218984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":44,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T01:42:34.029893+0000","last_change":"2023-10-06T01:40:16.651477+0000","last_active":"2023-10-06T01:42:34.029893+0000","last_peered":"2023-10-06T01:42:34.029893+0000","last_clean":"2023-10-06T01:42:34.029893+0000","last_became_active":"2023-10-06T01:40:16.651190+0000","last_became_peered":"2023-10-06T01:40:16.651190+0000","last_unstale":"2023-10-06T01:42:34.029893+0000","last_undegraded":"2023-10-06T01:42:34.029893+0000","last_fullsized":"2023-10-06T01:42:34.029893+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:45:47.422876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574883,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298556,"kb_used_data":1268,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073284,"statfs":{"total":96636764160,"available":96331042816,"internally_reserved":0,"allocated":1298432,"data_stored":913114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.64400000000000002,"15min":0.66600000000000004},"min":{"1min":0.32800000000000001,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.72799999999999998,"5min":3.6920000000000002,"15min":3.6920000000000002},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.64800000000000002,"15min":0.67000000000000004},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.69199999999999995,"5min":3.629,"15min":3.629},"last":0.48799999999999999}]},{"osd":1,"last update":"Fri Oct 6 01:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.83899999999999997,"15min":0.89500000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.70499999999999996,"5min":10.029999999999999,"15min":10.029999999999999},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.56699999999999995,"15min":0.57299999999999995},"min":{"1min":0.378,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.68799999999999994,"5min":1.544,"15min":1.544},"last":0.435}]},{"osd":2,"last update":"Fri Oct 6 01:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.53800000000000003,"15min":0.54400000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.746,"5min":1.091,"15min":1.091},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.92000000000000004,"15min":0.97799999999999998},"min":{"1min":0.45300000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.71099999999999997,"5min":10.710000000000001,"15min":10.710000000000001},"last":0.58199999999999996}]},{"osd":3,"last update":"Fri Oct 6 01:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.54700000000000004,"15min":0.55300000000000005},"min":{"1min":0.32600000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.64500000000000002,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.70399999999999996,"15min":0.72499999999999998},"min":{"1min":0.441,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.73999999999999999,"5min":3.6509999999999998,"15min":3.6509999999999998},"last":0.53300000000000003}]},{"osd":4,"last update":"Fri Oct 6 01:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.48899999999999999,"15min":0.48799999999999999},"min":{"1min":0.33900000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.77400000000000002,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.53400000000000003,"15min":0.52800000000000002},"min":{"1min":0.42499999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.64000000000000001}]},{"osd":5,"last update":"Fri Oct 6 01:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.59199999999999997,"15min":0.59799999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.86899999999999999,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.629,"15min":0.63600000000000001},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.79800000000000004,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":0.66000000000000003}]},{"osd":6,"last update":"Fri Oct 6 01:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.58999999999999997,"15min":0.59499999999999997},"min":{"1min":0.40799999999999997,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.77700000000000002,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":0.623},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.56599999999999995,"15min":0.56999999999999995},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.69999999999999996,"5min":0.878,"15min":0.878},"last":0.69499999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574883,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297964,"kb_used_data":676,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073876,"statfs":{"total":96636764160,"available":96331649024,"internally_reserved":0,"allocated":692224,"data_stored":322509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.49399999999999999,"15min":0.496},"min":{"1min":0.34999999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.495,"5min":0.48399999999999999,"15min":0.48199999999999998},"min":{"1min":0.35599999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.46100000000000002}]},{"osd":1,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.40799999999999997,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.55700000000000005,"15min":0.55900000000000005},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.68400000000000005,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.56999999999999995}]},{"osd":2,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.54200000000000004,"15min":0.54600000000000004},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.70899999999999996,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.56000000000000005,"15min":0.56200000000000006},"min":{"1min":0.40200000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.69399999999999995,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.38400000000000001}]},{"osd":3,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.55400000000000005,"15min":0.55700000000000005},"min":{"1min":0.36899999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.72199999999999998,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.432},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.56000000000000005,"15min":0.56200000000000006},"min":{"1min":0.432,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.79000000000000004,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.54400000000000004}]},{"osd":4,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.51300000000000001,"15min":0.52000000000000002},"min":{"1min":0.312,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.61099999999999999,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.5,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.74299999999999999,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.51700000000000002}]},{"osd":5,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.53300000000000003,"15min":0.53100000000000003},"min":{"1min":0.38900000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.66900000000000004,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.36099999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.72999999999999998,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.63900000000000001}]},{"osd":7,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.56699999999999995,"15min":0.56299999999999994},"min":{"1min":0.47499999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.69399999999999995,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.438,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.67200000000000004,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.625}]}]},{"osd":1,"up_from":13,"seq":55834574883,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297968,"kb_used_data":680,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073872,"statfs":{"total":96636764160,"available":96331644928,"internally_reserved":0,"allocated":696320,"data_stored":322599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.86099999999999999,"15min":0.95099999999999996},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.56100000000000005,"5min":11.957000000000001,"15min":11.957000000000001},"last":0.217},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.877,"15min":0.96399999999999997},"min":{"1min":0.28999999999999998,"5min":0.252,"15min":0.252},"max":{"1min":0.47899999999999998,"5min":11.917,"15min":11.917},"last":0.28599999999999998}]},{"osd":2,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.36399999999999999,"15min":0.372},"min":{"1min":0.253,"5min":0.251,"15min":0.251},"max":{"1min":0.441,"5min":1.125,"15min":1.125},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.32900000000000001,"5min":0.375,"15min":0.38300000000000001},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.45100000000000001,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.253}]},{"osd":3,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.67200000000000004,"15min":0.71999999999999997},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.53000000000000003,"5min":6.2450000000000001,"15min":6.2450000000000001},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.64800000000000002,"15min":0.69799999999999995},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.52300000000000002,"5min":6.2939999999999996,"15min":6.2939999999999996},"last":0.32700000000000001}]},{"osd":4,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.86299999999999999,"15min":0.90700000000000003},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.84599999999999997,"5min":6.1669999999999998,"15min":6.1669999999999998},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.61099999999999999,"15min":0.61499999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.875,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.41999999999999998}]},{"osd":5,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.83899999999999997,"15min":0.877},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.91900000000000004,"5min":6.2619999999999996,"15min":6.2619999999999996},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.625,"5min":0.873,"15min":0.91400000000000003},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.86799999999999999,"5min":6.2350000000000003,"15min":6.2350000000000003},"last":0.33900000000000002}]},{"osd":6,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.80700000000000005,"15min":0.84899999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.83599999999999997,"5min":6.141,"15min":6.141},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.84599999999999997,"15min":0.89100000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.74299999999999999,"5min":6.2069999999999999,"15min":6.2069999999999999},"last":0.36299999999999999}]},{"osd":7,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.64200000000000002,"15min":0.64900000000000002},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.90700000000000003,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.85699999999999998,"15min":0.90000000000000002},"min":{"1min":0.442,"5min":0.44,"15min":0.44},"max":{"1min":0.72399999999999998,"5min":6.1040000000000001,"15min":6.1040000000000001},"last":0.434}]}]},{"osd":0,"up_from":13,"seq":55834574883,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298564,"kb_used_data":1276,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073276,"statfs":{"total":96636764160,"available":96331034624,"internally_reserved":0,"allocated":1306624,"data_stored":923159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 01:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.36899999999999999,"15min":0.374},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.46500000000000002,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.308},{"interface":"front","average":{"1min":0.318,"5min":0.46100000000000002,"15min":0.48499999999999999},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.38600000000000001,"5min":3.9129999999999998,"15min":3.9129999999999998},"last":0.36499999999999999}]},{"osd":2,"last update":"Fri Oct 6 01:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.86199999999999999,"15min":0.94799999999999995},"min":{"1min":0.23699999999999999,"5min":0.216,"15min":0.216},"max":{"1min":0.47199999999999998,"5min":15.237,"15min":15.237},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.48899999999999999,"15min":0.50900000000000001},"min":{"1min":0.28399999999999997,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.49199999999999999,"5min":3.7959999999999998,"15min":3.7959999999999998},"last":0.28399999999999997}]},{"osd":3,"last update":"Fri Oct 6 01:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.51900000000000002,"15min":0.54600000000000004},"min":{"1min":0.29999999999999999,"5min":0.252,"15min":0.252},"max":{"1min":0.48799999999999999,"5min":5.2850000000000001,"15min":5.2850000000000001},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.90500000000000003,"15min":0.99099999999999999},"min":{"1min":0.29399999999999998,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.51200000000000001,"5min":15.263,"15min":15.263},"last":0.34699999999999998}]},{"osd":4,"last update":"Fri Oct 6 01:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.77300000000000002,"15min":0.80100000000000005},"min":{"1min":0.46500000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.73299999999999998,"5min":5.2590000000000003,"15min":5.2590000000000003},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":1.115,"15min":1.1990000000000001},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.84799999999999998,"5min":15.211,"15min":15.211},"last":0.63300000000000001}]},{"osd":5,"last update":"Fri Oct 6 01:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.69099999999999995,"15min":0.71099999999999997},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.81100000000000005,"5min":3.8839999999999999,"15min":3.8839999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.748,"15min":0.78000000000000003},"min":{"1min":0.438,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.63200000000000001,"5min":5.2309999999999999,"15min":5.2309999999999999},"last":0.64600000000000002}]},{"osd":6,"last update":"Fri Oct 6 01:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":1.091,"15min":1.171},"min":{"1min":0.43099999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.82799999999999996,"5min":15.175000000000001,"15min":15.175000000000001},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.71599999999999997,"15min":0.73899999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.75,"5min":3.859,"15min":3.859},"last":0.60299999999999998}]},{"osd":7,"last update":"Fri Oct 6 01:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.71799999999999997,"15min":0.73999999999999999},"min":{"1min":0.434,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.71599999999999997,"5min":3.831,"15min":3.831},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.748,"15min":0.77400000000000002},"min":{"1min":0.46500000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.76300000000000001,"5min":5.1959999999999997,"15min":5.1959999999999997},"last":0.624}]}]},{"osd":2,"up_from":13,"seq":55834574883,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297972,"kb_used_data":684,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073868,"statfs":{"total":96636764160,"available":96331640832,"internally_reserved":0,"allocated":700416,"data_stored":322565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:42:10 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.33700000000000002,"15min":0.33600000000000002},"min":{"1min":0.22800000000000001,"5min":0.216,"15min":0.216},"max":{"1min":0.46500000000000002,"5min":0.48199999999999998,"15min":0.48199999999999998},"last":0.314},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.34999999999999998,"15min":0.35399999999999998},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.46200000000000002,"5min":0.51400000000000001,"15min":0.51400000000000001},"last":0.28100000000000003}]},{"osd":1,"last update":"Fri Oct 6 01:42:10 2023","interfaces":[{"interface":"back","average":{"1min":0.314,"5min":0.311,"15min":0.311},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.441,"5min":0.47299999999999998,"15min":0.47299999999999998},"last":0.23999999999999999},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.36899999999999999,"15min":0.371},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.52400000000000002,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.36099999999999999}]},{"osd":3,"last update":"Fri Oct 6 01:42:10 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35799999999999998,"15min":0.35899999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.47899999999999998,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.374,"5min":0.38,"15min":0.38100000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.48899999999999999,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.39700000000000002}]},{"osd":4,"last update":"Fri Oct 6 01:42:10 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.53300000000000003,"15min":0.53400000000000003},"min":{"1min":0.39900000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.68400000000000005,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.55600000000000005,"15min":0.55400000000000005},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.79800000000000004,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.54400000000000004}]},{"osd":5,"last update":"Fri Oct 6 01:42:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.75600000000000001,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.57899999999999996,"15min":0.58099999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.77900000000000003,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.51900000000000002}]},{"osd":6,"last update":"Fri Oct 6 01:42:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55700000000000005,"15min":0.55800000000000005},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.81799999999999995,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.495},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57599999999999996,"15min":0.57699999999999996},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.84499999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.48599999999999999}]},{"osd":7,"last update":"Fri Oct 6 01:42:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56200000000000006,"15min":0.56299999999999994},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.82599999999999996,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.58299999999999996,"15min":0.58499999999999996},"min":{"1min":0.42699999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.72099999999999997,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.50900000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574883,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297972,"kb_used_data":684,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073868,"statfs":{"total":96636764160,"available":96331640832,"internally_reserved":0,"allocated":700416,"data_stored":322565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":0.34399999999999997,"15min":0.35199999999999998},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.41599999999999998,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.36299999999999999,"15min":0.36699999999999999},"min":{"1min":0.249,"5min":0.246,"15min":0.246},"max":{"1min":0.52500000000000002,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.34999999999999998}]},{"osd":1,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.34899999999999998,"15min":0.35199999999999998},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.45500000000000002,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.39100000000000001,"15min":0.39900000000000002},"min":{"1min":0.26700000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.49399999999999999,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.316}]},{"osd":2,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.40200000000000002,"15min":0.40999999999999998},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.51100000000000001,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.41599999999999998,"15min":0.42499999999999999},"min":{"1min":0.29899999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.54000000000000004,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.36399999999999999}]},{"osd":4,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54400000000000004,"15min":0.54600000000000004},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.57599999999999996,"15min":0.57899999999999996},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.752,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.63900000000000001}]},{"osd":5,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.56100000000000005,"15min":0.56499999999999995},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.55900000000000005,"15min":0.56299999999999994},"min":{"1min":0.377,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.72599999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.66200000000000003}]},{"osd":6,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.57799999999999996,"15min":0.58699999999999997},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.73799999999999999,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.56699999999999995,"15min":0.56899999999999995},"min":{"1min":0.38400000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.55000000000000004}]},{"osd":7,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.57899999999999996,"15min":0.58299999999999996},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.61699999999999999,"15min":0.62},"min":{"1min":0.45300000000000001,"5min":0.442,"15min":0.442},"max":{"1min":0.76700000000000002,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.70099999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574883,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297984,"kb_used_data":696,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073856,"statfs":{"total":96636764160,"available":96331628544,"internally_reserved":0,"allocated":712704,"data_stored":333198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.54500000000000004,"15min":0.54000000000000004},"min":{"1min":0.33400000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.046,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.434},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.55400000000000005,"15min":0.54800000000000004},"min":{"1min":0.39500000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.90000000000000002,"5min":1.016,"15min":1.016},"last":0.53800000000000003}]},{"osd":1,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.66200000000000003,"15min":0.67700000000000005},"min":{"1min":0.42699999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.92000000000000004,"5min":4.0780000000000003,"15min":4.0780000000000003},"last":0.502},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.68200000000000005,"15min":0.70399999999999996},"min":{"1min":0.36299999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.0129999999999999,"5min":4.1050000000000004,"15min":4.1050000000000004},"last":0.49299999999999999}]},{"osd":2,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.55500000000000005,"15min":0.55300000000000005},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.57499999999999996,"15min":0.57099999999999995},"min":{"1min":0.41099999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.93799999999999994,"5min":1.022,"15min":1.022},"last":0.39000000000000001}]},{"osd":3,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.56100000000000005,"15min":0.55600000000000005},"min":{"1min":0.40600000000000003,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.94799999999999995,"5min":1.149,"15min":1.149},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.443,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.95999999999999996,"5min":1.159,"15min":1.159},"last":0.46300000000000002}]},{"osd":5,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.45400000000000001,"15min":0.442},"min":{"1min":0.316,"5min":0.307,"15min":0.307},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.624,"5min":0.54900000000000004,"15min":0.53700000000000003},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.58699999999999997}]},{"osd":6,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.47199999999999998,"15min":0.46200000000000002},"min":{"1min":0.39100000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.53300000000000003,"15min":0.52200000000000002},"min":{"1min":0.39600000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.52400000000000002}]},{"osd":7,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.54400000000000004,"15min":0.53600000000000003},"min":{"1min":0.36899999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.995,"5min":1.014,"15min":1.014},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.54600000000000004,"15min":0.53800000000000003},"min":{"1min":0.44700000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.55100000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574883,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297976,"kb_used_data":688,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073864,"statfs":{"total":96636764160,"available":96331636736,"internally_reserved":0,"allocated":704512,"data_stored":323210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.55100000000000005,"15min":0.51700000000000002},"min":{"1min":0.314,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":5.867,"5min":5.867,"15min":5.867},"last":0.307},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.501,"15min":0.499},"min":{"1min":0.34000000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.42599999999999999}]},{"osd":1,"last update":"Fri Oct 6 01:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.52300000000000002,"15min":0.51900000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.497},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.754,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.39100000000000001}]},{"osd":2,"last update":"Fri Oct 6 01:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.56399999999999995,"15min":0.57099999999999995},"min":{"1min":0.36799999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.72499999999999998,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.53900000000000003,"15min":0.54200000000000004},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.81599999999999995,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.45200000000000001}]},{"osd":3,"last update":"Fri Oct 6 01:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.56699999999999995,"15min":0.56100000000000005},"min":{"1min":0.36899999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.9199999999999999,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.58899999999999997,"15min":0.58099999999999996},"min":{"1min":0.39100000000000001,"5min":0.37,"15min":0.37},"max":{"1min":1.9370000000000001,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":0.54600000000000004}]},{"osd":4,"last update":"Fri Oct 6 01:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48299999999999998,"15min":0.48199999999999998},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.55300000000000005,"15min":0.55400000000000005},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.80300000000000005,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.55500000000000005}]},{"osd":6,"last update":"Fri Oct 6 01:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.52800000000000002,"15min":0.51400000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.978,"5min":1.978,"15min":1.978},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.55500000000000005,"15min":0.54900000000000004},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.51000000000000001}]},{"osd":7,"last update":"Fri Oct 6 01:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.58999999999999997,"15min":0.59399999999999997},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.873,"5min":1.821,"15min":1.821},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.56699999999999995,"15min":0.56299999999999994},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.56899999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T01:42:49.667 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T01:42:49.781 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.780+0000 7f919cd0c700 1 Processor -- start 2023-10-06T01:42:49.781 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.780+0000 7f919cd0c700 1 -- start start 2023-10-06T01:42:49.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.781+0000 7f919cd0c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9198159400 0x7f91980ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:49.783 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.781+0000 7f919cd0c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f91980cd030 0x7f91980cfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:49.784 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.781+0000 7f919cd0c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f91980cf1a0 0x7f91980d0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:49.784 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.781+0000 7f919cd0c700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91980b3560 con 0x7f9198159400 2023-10-06T01:42:49.784 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.781+0000 7f919cd0c700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91980cf6f0 con 0x7f91980cd030 2023-10-06T01:42:49.784 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.781+0000 7f919cd0c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91980cf9d0 con 0x7f91980cf1a0 2023-10-06T01:42:49.784 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.781+0000 7f91977fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9198159400 0x7f91980ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:49.784 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.781+0000 7f91977fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9198159400 0x7f91980ccaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41270/0 (socket says 172.21.15.71:41270) 2023-10-06T01:42:49.784 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.781+0000 7f91977fe700 1 -- 172.21.15.71:0/1565150281 learned_addr learned my addr 172.21.15.71:0/1565150281 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:49.785 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.781+0000 7f9196ffd700 1 --2- 172.21.15.71:0/1565150281 >> v2:172.21.15.72:3300/0 conn(0x7f91980cd030 0x7f91980cfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:49.785 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.781+0000 7f9197fff700 1 --2- 172.21.15.71:0/1565150281 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f91980cf1a0 0x7f91980d0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:49.785 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.781+0000 7f91977fe700 1 -- 172.21.15.71:0/1565150281 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f91980cf1a0 msgr2=0x7f91980d0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:49.785 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.781+0000 7f91977fe700 1 --2- 172.21.15.71:0/1565150281 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f91980cf1a0 0x7f91980d0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:49.785 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.781+0000 7f91977fe700 1 -- 172.21.15.71:0/1565150281 >> v2:172.21.15.72:3300/0 conn(0x7f91980cd030 msgr2=0x7f91980cfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:49.785 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.781+0000 7f91977fe700 1 --2- 172.21.15.71:0/1565150281 >> v2:172.21.15.72:3300/0 conn(0x7f91980cd030 0x7f91980cfec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:49.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.781+0000 7f91977fe700 1 -- 172.21.15.71:0/1565150281 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91980b2f10 con 0x7f9198159400 2023-10-06T01:42:49.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.781+0000 7f9196ffd700 1 --2- 172.21.15.71:0/1565150281 >> v2:172.21.15.72:3300/0 conn(0x7f91980cd030 0x7f91980cfec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:42:49.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.782+0000 7f91977fe700 1 --2- 172.21.15.71:0/1565150281 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9198159400 0x7f91980ccaf0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f919815d0f0 tx=0x7f9188009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=551c750baa2015b9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:49.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.782+0000 7f91967fc700 1 -- 172.21.15.71:0/1565150281 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f918800e070 con 0x7f9198159400 2023-10-06T01:42:49.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.782+0000 7f91967fc700 1 -- 172.21.15.71:0/1565150281 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f918800bad0 con 0x7f9198159400 2023-10-06T01:42:49.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.782+0000 7f91967fc700 1 -- 172.21.15.71:0/1565150281 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91880092e0 con 0x7f9198159400 2023-10-06T01:42:49.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.782+0000 7f919cd0c700 1 -- 172.21.15.71:0/1565150281 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9198159400 msgr2=0x7f91980ccaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:49.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.782+0000 7f919cd0c700 1 --2- 172.21.15.71:0/1565150281 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9198159400 0x7f91980ccaf0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f919815d0f0 tx=0x7f9188009840 comp rx=0 tx=0).stop 2023-10-06T01:42:49.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.782+0000 7f919cd0c700 1 -- 172.21.15.71:0/1565150281 shutdown_connections 2023-10-06T01:42:49.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.782+0000 7f919cd0c700 1 --2- 172.21.15.71:0/1565150281 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9198159400 0x7f91980ccaf0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:49.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.782+0000 7f919cd0c700 1 --2- 172.21.15.71:0/1565150281 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f91980cf1a0 0x7f91980d0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:49.787 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.782+0000 7f919cd0c700 1 --2- 172.21.15.71:0/1565150281 >> v2:172.21.15.72:3300/0 conn(0x7f91980cd030 0x7f91980cfec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:49.788 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.782+0000 7f919cd0c700 1 -- 172.21.15.71:0/1565150281 >> 172.21.15.71:0/1565150281 conn(0x7f919806ac10 msgr2=0x7f9198068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:49.788 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.782+0000 7f919cd0c700 1 -- 172.21.15.71:0/1565150281 shutdown_connections 2023-10-06T01:42:49.788 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.782+0000 7f919cd0c700 1 -- 172.21.15.71:0/1565150281 wait complete. 2023-10-06T01:42:49.790 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.783+0000 7f919cd0c700 1 Processor -- start 2023-10-06T01:42:49.791 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.784+0000 7f919cd0c700 1 -- start start 2023-10-06T01:42:49.791 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.784+0000 7f919cd0c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f91980cd030 0x7f919814c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:49.791 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.784+0000 7f919cd0c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f91980cf1a0 0x7f919814cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:49.791 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.784+0000 7f919cd0c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9198159400 0x7f919814d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:49.791 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.784+0000 7f919cd0c700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9198151930 con 0x7f91980cd030 2023-10-06T01:42:49.791 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.784+0000 7f919cd0c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f919814c5a0 con 0x7f9198159400 2023-10-06T01:42:49.792 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.784+0000 7f919cd0c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9198152730 con 0x7f91980cf1a0 2023-10-06T01:42:49.792 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.784+0000 7f91977fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f91980cd030 0x7f919814c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:49.792 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.784+0000 7f91977fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f91980cd030 0x7f919814c060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41282/0 (socket says 172.21.15.71:41282) 2023-10-06T01:42:49.792 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.784+0000 7f91977fe700 1 -- 172.21.15.71:0/3298068035 learned_addr learned my addr 172.21.15.71:0/3298068035 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:49.792 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.784+0000 7f9197fff700 1 --2- 172.21.15.71:0/3298068035 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9198159400 0x7f919814d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:49.792 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.784+0000 7f9196ffd700 1 --2- 172.21.15.71:0/3298068035 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f91980cf1a0 0x7f919814cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:49.793 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.785+0000 7f91977fe700 1 -- 172.21.15.71:0/3298068035 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f91980cf1a0 msgr2=0x7f919814cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:49.793 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.785+0000 7f91977fe700 1 --2- 172.21.15.71:0/3298068035 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f91980cf1a0 0x7f919814cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:49.793 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.785+0000 7f91977fe700 1 -- 172.21.15.71:0/3298068035 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9198159400 msgr2=0x7f919814d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:49.793 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.785+0000 7f91977fe700 1 --2- 172.21.15.71:0/3298068035 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9198159400 0x7f919814d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:49.793 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.785+0000 7f91977fe700 1 -- 172.21.15.71:0/3298068035 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9188009ae0 con 0x7f91980cd030 2023-10-06T01:42:49.793 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.785+0000 7f9196ffd700 1 --2- 172.21.15.71:0/3298068035 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f91980cf1a0 0x7f919814cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:42:49.794 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.785+0000 7f91977fe700 1 --2- 172.21.15.71:0/3298068035 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f91980cd030 0x7f919814c060 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f91980b2b80 tx=0x7f9188018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:49.794 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.785+0000 7f917f7fe700 1 -- 172.21.15.71:0/3298068035 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9188008a00 con 0x7f91980cd030 2023-10-06T01:42:49.794 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.785+0000 7f917f7fe700 1 -- 172.21.15.71:0/3298068035 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9188008ba0 con 0x7f91980cd030 2023-10-06T01:42:49.794 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.785+0000 7f919cd0c700 1 -- 172.21.15.71:0/3298068035 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9198151b20 con 0x7f91980cd030 2023-10-06T01:42:49.794 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.785+0000 7f917f7fe700 1 -- 172.21.15.71:0/3298068035 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f918801c410 con 0x7f91980cd030 2023-10-06T01:42:49.794 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.785+0000 7f919cd0c700 1 -- 172.21.15.71:0/3298068035 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91981520e0 con 0x7f91980cd030 2023-10-06T01:42:49.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.786+0000 7f919cd0c700 1 -- 172.21.15.71:0/3298068035 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91981597d0 con 0x7f91980cd030 2023-10-06T01:42:49.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.786+0000 7f917f7fe700 1 -- 172.21.15.71:0/3298068035 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9188003040 con 0x7f91980cd030 2023-10-06T01:42:49.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.786+0000 7f917f7fe700 1 --2- 172.21.15.71:0/3298068035 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f9184066f30 0x7f91840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:49.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.787+0000 7f917f7fe700 1 -- 172.21.15.71:0/3298068035 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f9188085b30 con 0x7f91980cd030 2023-10-06T01:42:49.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.787+0000 7f9196ffd700 1 --2- 172.21.15.71:0/3298068035 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f9184066f30 0x7f91840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:49.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.787+0000 7f9196ffd700 1 --2- 172.21.15.71:0/3298068035 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f9184066f30 0x7f91840693e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f918c006f00 tx=0x7f918c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:49.796 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.791+0000 7f917f7fe700 1 -- 172.21.15.71:0/3298068035 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9188052da0 con 0x7f91980cd030 2023-10-06T01:42:49.972 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.971+0000 7f919cd0c700 1 -- 172.21.15.71:0/3298068035 --> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f91980b31f0 con 0x7f9184066f30 2023-10-06T01:42:49.974 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.974+0000 7f917f7fe700 1 -- 172.21.15.71:0/3298068035 <== mgr.4107 v2:172.21.15.71:6832/90436 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+72841 (secure 0 0 0) 0x7f91980b31f0 con 0x7f9184066f30 2023-10-06T01:42:49.975 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:42:49.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.976+0000 7f919cd0c700 1 -- 172.21.15.71:0/3298068035 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f9184066f30 msgr2=0x7f91840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:49.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.976+0000 7f919cd0c700 1 --2- 172.21.15.71:0/3298068035 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f9184066f30 0x7f91840693e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f918c006f00 tx=0x7f918c008040 comp rx=0 tx=0).stop 2023-10-06T01:42:49.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.976+0000 7f919cd0c700 1 -- 172.21.15.71:0/3298068035 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f91980cd030 msgr2=0x7f919814c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:49.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.976+0000 7f919cd0c700 1 --2- 172.21.15.71:0/3298068035 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f91980cd030 0x7f919814c060 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f91980b2b80 tx=0x7f9188018000 comp rx=0 tx=0).stop 2023-10-06T01:42:49.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.976+0000 7f919cd0c700 1 -- 172.21.15.71:0/3298068035 shutdown_connections 2023-10-06T01:42:49.977 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.976+0000 7f919cd0c700 1 --2- 172.21.15.71:0/3298068035 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f9184066f30 0x7f91840693e0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:49.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.976+0000 7f919cd0c700 1 --2- 172.21.15.71:0/3298068035 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9198159400 0x7f919814d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:49.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.976+0000 7f919cd0c700 1 --2- 172.21.15.71:0/3298068035 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f91980cd030 0x7f919814c060 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:49.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.976+0000 7f919cd0c700 1 --2- 172.21.15.71:0/3298068035 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f91980cf1a0 0x7f919814cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:49.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.976+0000 7f919cd0c700 1 -- 172.21.15.71:0/3298068035 >> 172.21.15.71:0/3298068035 conn(0x7f919806ac10 msgr2=0x7f91980d0200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:49.978 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.976+0000 7f919cd0c700 1 -- 172.21.15.71:0/3298068035 shutdown_connections 2023-10-06T01:42:49.979 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:49.976+0000 7f919cd0c700 1 -- 172.21.15.71:0/3298068035 wait complete. 2023-10-06T01:42:49.979 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2023-10-06T01:42:49.988 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":134,"stamp":"2023-10-06T01:42:48.595901+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2384956,"kb_used_data":6652,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752589764,"statfs":{"total":773094113280,"available":770651918336,"internally_reserved":0,"allocated":6811648,"data_stored":3782919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-11379,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-49,"num_read_kb":-60,"num_write":-62,"num_write_kb":-31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001017"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":44,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T01:42:35.032246+0000","last_change":"2023-10-06T01:40:16.930992+0000","last_active":"2023-10-06T01:42:35.032246+0000","last_peered":"2023-10-06T01:42:35.032246+0000","last_clean":"2023-10-06T01:42:35.032246+0000","last_became_active":"2023-10-06T01:40:16.930707+0000","last_became_peered":"2023-10-06T01:40:16.930707+0000","last_unstale":"2023-10-06T01:42:35.032246+0000","last_undegraded":"2023-10-06T01:42:35.032246+0000","last_fullsized":"2023-10-06T01:42:35.032246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:52:43.316071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":43,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T01:42:34.783844+0000","last_change":"2023-10-06T01:40:16.651019+0000","last_active":"2023-10-06T01:42:34.783844+0000","last_peered":"2023-10-06T01:42:34.783844+0000","last_clean":"2023-10-06T01:42:34.783844+0000","last_became_active":"2023-10-06T01:40:16.650628+0000","last_became_peered":"2023-10-06T01:40:16.650628+0000","last_unstale":"2023-10-06T01:42:34.783844+0000","last_undegraded":"2023-10-06T01:42:34.783844+0000","last_fullsized":"2023-10-06T01:42:34.783844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:11:57.218984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":40,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T01:42:01.656770+0000","last_change":"2023-10-06T01:40:16.781596+0000","last_active":"2023-10-06T01:42:01.656770+0000","last_peered":"2023-10-06T01:42:01.656770+0000","last_clean":"2023-10-06T01:42:01.656770+0000","last_became_active":"2023-10-06T01:40:16.781352+0000","last_became_peered":"2023-10-06T01:40:16.781352+0000","last_unstale":"2023-10-06T01:42:01.656770+0000","last_undegraded":"2023-10-06T01:42:01.656770+0000","last_fullsized":"2023-10-06T01:42:01.656770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:52:43.316071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":43,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T01:42:34.783978+0000","last_change":"2023-10-06T01:40:16.650826+0000","last_active":"2023-10-06T01:42:34.783978+0000","last_peered":"2023-10-06T01:42:34.783978+0000","last_clean":"2023-10-06T01:42:34.783978+0000","last_became_active":"2023-10-06T01:40:16.650469+0000","last_became_peered":"2023-10-06T01:40:16.650469+0000","last_unstale":"2023-10-06T01:42:34.783978+0000","last_undegraded":"2023-10-06T01:42:34.783978+0000","last_fullsized":"2023-10-06T01:42:34.783978+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:50:23.628212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":195,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T01:42:34.186634+0000","last_change":"2023-10-06T01:40:10.645512+0000","last_active":"2023-10-06T01:42:34.186634+0000","last_peered":"2023-10-06T01:42:34.186634+0000","last_clean":"2023-10-06T01:42:34.186634+0000","last_became_active":"2023-10-06T01:40:10.644601+0000","last_became_peered":"2023-10-06T01:40:10.644601+0000","last_unstale":"2023-10-06T01:42:34.186634+0000","last_undegraded":"2023-10-06T01:42:34.186634+0000","last_fullsized":"2023-10-06T01:42:34.186634+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:09.580865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:09.580865+0000","last_clean_scrub_stamp":"2023-10-06T01:40:09.580865+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:05:28.268591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":42,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T01:42:34.186708+0000","last_change":"2023-10-06T01:40:16.651332+0000","last_active":"2023-10-06T01:42:34.186708+0000","last_peered":"2023-10-06T01:42:34.186708+0000","last_clean":"2023-10-06T01:42:34.186708+0000","last_became_active":"2023-10-06T01:40:16.651049+0000","last_became_peered":"2023-10-06T01:40:16.651049+0000","last_unstale":"2023-10-06T01:42:34.186708+0000","last_undegraded":"2023-10-06T01:42:34.186708+0000","last_fullsized":"2023-10-06T01:42:34.186708+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:11:57.218984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":42,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T01:42:34.187121+0000","last_change":"2023-10-06T01:40:16.931106+0000","last_active":"2023-10-06T01:42:34.187121+0000","last_peered":"2023-10-06T01:42:34.187121+0000","last_clean":"2023-10-06T01:42:34.187121+0000","last_became_active":"2023-10-06T01:40:16.930830+0000","last_became_peered":"2023-10-06T01:40:16.930830+0000","last_unstale":"2023-10-06T01:42:34.187121+0000","last_undegraded":"2023-10-06T01:42:34.187121+0000","last_fullsized":"2023-10-06T01:42:34.187121+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:50:23.628212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":44,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T01:42:35.032529+0000","last_change":"2023-10-06T01:40:16.649379+0000","last_active":"2023-10-06T01:42:35.032529+0000","last_peered":"2023-10-06T01:42:35.032529+0000","last_clean":"2023-10-06T01:42:35.032529+0000","last_became_active":"2023-10-06T01:40:16.649147+0000","last_became_peered":"2023-10-06T01:40:16.649147+0000","last_unstale":"2023-10-06T01:42:35.032529+0000","last_undegraded":"2023-10-06T01:42:35.032529+0000","last_fullsized":"2023-10-06T01:42:35.032529+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:11:57.218984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":44,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T01:42:34.029893+0000","last_change":"2023-10-06T01:40:16.651477+0000","last_active":"2023-10-06T01:42:34.029893+0000","last_peered":"2023-10-06T01:42:34.029893+0000","last_clean":"2023-10-06T01:42:34.029893+0000","last_became_active":"2023-10-06T01:40:16.651190+0000","last_became_peered":"2023-10-06T01:40:16.651190+0000","last_unstale":"2023-10-06T01:42:34.029893+0000","last_undegraded":"2023-10-06T01:42:34.029893+0000","last_fullsized":"2023-10-06T01:42:34.029893+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:45:47.422876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574883,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298556,"kb_used_data":1268,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073284,"statfs":{"total":96636764160,"available":96331042816,"internally_reserved":0,"allocated":1298432,"data_stored":913114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.64400000000000002,"15min":0.66600000000000004},"min":{"1min":0.32800000000000001,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.72799999999999998,"5min":3.6920000000000002,"15min":3.6920000000000002},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.64800000000000002,"15min":0.67000000000000004},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.69199999999999995,"5min":3.629,"15min":3.629},"last":0.48799999999999999}]},{"osd":1,"last update":"Fri Oct 6 01:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.83899999999999997,"15min":0.89500000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.70499999999999996,"5min":10.029999999999999,"15min":10.029999999999999},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.56699999999999995,"15min":0.57299999999999995},"min":{"1min":0.378,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.68799999999999994,"5min":1.544,"15min":1.544},"last":0.435}]},{"osd":2,"last update":"Fri Oct 6 01:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.53800000000000003,"15min":0.54400000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.746,"5min":1.091,"15min":1.091},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.92000000000000004,"15min":0.97799999999999998},"min":{"1min":0.45300000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.71099999999999997,"5min":10.710000000000001,"15min":10.710000000000001},"last":0.58199999999999996}]},{"osd":3,"last update":"Fri Oct 6 01:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.54700000000000004,"15min":0.55300000000000005},"min":{"1min":0.32600000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.64500000000000002,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.70399999999999996,"15min":0.72499999999999998},"min":{"1min":0.441,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.73999999999999999,"5min":3.6509999999999998,"15min":3.6509999999999998},"last":0.53300000000000003}]},{"osd":4,"last update":"Fri Oct 6 01:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.48899999999999999,"15min":0.48799999999999999},"min":{"1min":0.33900000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.77400000000000002,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.53400000000000003,"15min":0.52800000000000002},"min":{"1min":0.42499999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.64000000000000001}]},{"osd":5,"last update":"Fri Oct 6 01:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.59199999999999997,"15min":0.59799999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.86899999999999999,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.629,"15min":0.63600000000000001},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.79800000000000004,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":0.66000000000000003}]},{"osd":6,"last update":"Fri Oct 6 01:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.58999999999999997,"15min":0.59499999999999997},"min":{"1min":0.40799999999999997,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.77700000000000002,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":0.623},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.56599999999999995,"15min":0.56999999999999995},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.69999999999999996,"5min":0.878,"15min":0.878},"last":0.69499999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574883,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297964,"kb_used_data":676,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073876,"statfs":{"total":96636764160,"available":96331649024,"internally_reserved":0,"allocated":692224,"data_stored":322509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.49399999999999999,"15min":0.496},"min":{"1min":0.34999999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.495,"5min":0.48399999999999999,"15min":0.48199999999999998},"min":{"1min":0.35599999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.46100000000000002}]},{"osd":1,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.40799999999999997,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.55700000000000005,"15min":0.55900000000000005},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.68400000000000005,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.56999999999999995}]},{"osd":2,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.54200000000000004,"15min":0.54600000000000004},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.70899999999999996,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.56000000000000005,"15min":0.56200000000000006},"min":{"1min":0.40200000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.69399999999999995,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.38400000000000001}]},{"osd":3,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.55400000000000005,"15min":0.55700000000000005},"min":{"1min":0.36899999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.72199999999999998,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.432},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.56000000000000005,"15min":0.56200000000000006},"min":{"1min":0.432,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.79000000000000004,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.54400000000000004}]},{"osd":4,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.51300000000000001,"15min":0.52000000000000002},"min":{"1min":0.312,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.61099999999999999,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.5,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.74299999999999999,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.51700000000000002}]},{"osd":5,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.53300000000000003,"15min":0.53100000000000003},"min":{"1min":0.38900000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.66900000000000004,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.36099999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.72999999999999998,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.63900000000000001}]},{"osd":7,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.56699999999999995,"15min":0.56299999999999994},"min":{"1min":0.47499999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.69399999999999995,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.438,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.67200000000000004,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.625}]}]},{"osd":1,"up_from":13,"seq":55834574883,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297968,"kb_used_data":680,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073872,"statfs":{"total":96636764160,"available":96331644928,"internally_reserved":0,"allocated":696320,"data_stored":322599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.86099999999999999,"15min":0.95099999999999996},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.56100000000000005,"5min":11.957000000000001,"15min":11.957000000000001},"last":0.217},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.877,"15min":0.96399999999999997},"min":{"1min":0.28999999999999998,"5min":0.252,"15min":0.252},"max":{"1min":0.47899999999999998,"5min":11.917,"15min":11.917},"last":0.28599999999999998}]},{"osd":2,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.36399999999999999,"15min":0.372},"min":{"1min":0.253,"5min":0.251,"15min":0.251},"max":{"1min":0.441,"5min":1.125,"15min":1.125},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.32900000000000001,"5min":0.375,"15min":0.38300000000000001},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.45100000000000001,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.253}]},{"osd":3,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.67200000000000004,"15min":0.71999999999999997},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.53000000000000003,"5min":6.2450000000000001,"15min":6.2450000000000001},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.64800000000000002,"15min":0.69799999999999995},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.52300000000000002,"5min":6.2939999999999996,"15min":6.2939999999999996},"last":0.32700000000000001}]},{"osd":4,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.86299999999999999,"15min":0.90700000000000003},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.84599999999999997,"5min":6.1669999999999998,"15min":6.1669999999999998},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.61099999999999999,"15min":0.61499999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.875,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.41999999999999998}]},{"osd":5,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.83899999999999997,"15min":0.877},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.91900000000000004,"5min":6.2619999999999996,"15min":6.2619999999999996},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.625,"5min":0.873,"15min":0.91400000000000003},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.86799999999999999,"5min":6.2350000000000003,"15min":6.2350000000000003},"last":0.33900000000000002}]},{"osd":6,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.80700000000000005,"15min":0.84899999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.83599999999999997,"5min":6.141,"15min":6.141},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.84599999999999997,"15min":0.89100000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.74299999999999999,"5min":6.2069999999999999,"15min":6.2069999999999999},"last":0.36299999999999999}]},{"osd":7,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.64200000000000002,"15min":0.64900000000000002},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.90700000000000003,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.85699999999999998,"15min":0.90000000000000002},"min":{"1min":0.442,"5min":0.44,"15min":0.44},"max":{"1min":0.72399999999999998,"5min":6.1040000000000001,"15min":6.1040000000000001},"last":0.434}]}]},{"osd":0,"up_from":13,"seq":55834574883,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298564,"kb_used_data":1276,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073276,"statfs":{"total":96636764160,"available":96331034624,"internally_reserved":0,"allocated":1306624,"data_stored":923159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 01:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.36899999999999999,"15min":0.374},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.46500000000000002,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.308},{"interface":"front","average":{"1min":0.318,"5min":0.46100000000000002,"15min":0.48499999999999999},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.38600000000000001,"5min":3.9129999999999998,"15min":3.9129999999999998},"last":0.36499999999999999}]},{"osd":2,"last update":"Fri Oct 6 01:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.86199999999999999,"15min":0.94799999999999995},"min":{"1min":0.23699999999999999,"5min":0.216,"15min":0.216},"max":{"1min":0.47199999999999998,"5min":15.237,"15min":15.237},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.48899999999999999,"15min":0.50900000000000001},"min":{"1min":0.28399999999999997,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.49199999999999999,"5min":3.7959999999999998,"15min":3.7959999999999998},"last":0.28399999999999997}]},{"osd":3,"last update":"Fri Oct 6 01:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.51900000000000002,"15min":0.54600000000000004},"min":{"1min":0.29999999999999999,"5min":0.252,"15min":0.252},"max":{"1min":0.48799999999999999,"5min":5.2850000000000001,"15min":5.2850000000000001},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.90500000000000003,"15min":0.99099999999999999},"min":{"1min":0.29399999999999998,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.51200000000000001,"5min":15.263,"15min":15.263},"last":0.34699999999999998}]},{"osd":4,"last update":"Fri Oct 6 01:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.77300000000000002,"15min":0.80100000000000005},"min":{"1min":0.46500000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.73299999999999998,"5min":5.2590000000000003,"15min":5.2590000000000003},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":1.115,"15min":1.1990000000000001},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.84799999999999998,"5min":15.211,"15min":15.211},"last":0.63300000000000001}]},{"osd":5,"last update":"Fri Oct 6 01:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.69099999999999995,"15min":0.71099999999999997},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.81100000000000005,"5min":3.8839999999999999,"15min":3.8839999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.748,"15min":0.78000000000000003},"min":{"1min":0.438,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.63200000000000001,"5min":5.2309999999999999,"15min":5.2309999999999999},"last":0.64600000000000002}]},{"osd":6,"last update":"Fri Oct 6 01:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":1.091,"15min":1.171},"min":{"1min":0.43099999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.82799999999999996,"5min":15.175000000000001,"15min":15.175000000000001},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.71599999999999997,"15min":0.73899999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.75,"5min":3.859,"15min":3.859},"last":0.60299999999999998}]},{"osd":7,"last update":"Fri Oct 6 01:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.71799999999999997,"15min":0.73999999999999999},"min":{"1min":0.434,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.71599999999999997,"5min":3.831,"15min":3.831},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.748,"15min":0.77400000000000002},"min":{"1min":0.46500000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.76300000000000001,"5min":5.1959999999999997,"15min":5.1959999999999997},"last":0.624}]}]},{"osd":2,"up_from":13,"seq":55834574883,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297972,"kb_used_data":684,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073868,"statfs":{"total":96636764160,"available":96331640832,"internally_reserved":0,"allocated":700416,"data_stored":322565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:42:10 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.33700000000000002,"15min":0.33600000000000002},"min":{"1min":0.22800000000000001,"5min":0.216,"15min":0.216},"max":{"1min":0.46500000000000002,"5min":0.48199999999999998,"15min":0.48199999999999998},"last":0.314},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.34999999999999998,"15min":0.35399999999999998},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.46200000000000002,"5min":0.51400000000000001,"15min":0.51400000000000001},"last":0.28100000000000003}]},{"osd":1,"last update":"Fri Oct 6 01:42:10 2023","interfaces":[{"interface":"back","average":{"1min":0.314,"5min":0.311,"15min":0.311},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.441,"5min":0.47299999999999998,"15min":0.47299999999999998},"last":0.23999999999999999},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.36899999999999999,"15min":0.371},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.52400000000000002,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.36099999999999999}]},{"osd":3,"last update":"Fri Oct 6 01:42:10 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35799999999999998,"15min":0.35899999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.47899999999999998,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.374,"5min":0.38,"15min":0.38100000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.48899999999999999,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.39700000000000002}]},{"osd":4,"last update":"Fri Oct 6 01:42:10 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.53300000000000003,"15min":0.53400000000000003},"min":{"1min":0.39900000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.68400000000000005,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.55600000000000005,"15min":0.55400000000000005},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.79800000000000004,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.54400000000000004}]},{"osd":5,"last update":"Fri Oct 6 01:42:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.75600000000000001,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.57899999999999996,"15min":0.58099999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.77900000000000003,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.51900000000000002}]},{"osd":6,"last update":"Fri Oct 6 01:42:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55700000000000005,"15min":0.55800000000000005},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.81799999999999995,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.495},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57599999999999996,"15min":0.57699999999999996},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.84499999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.48599999999999999}]},{"osd":7,"last update":"Fri Oct 6 01:42:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56200000000000006,"15min":0.56299999999999994},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.82599999999999996,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.58299999999999996,"15min":0.58499999999999996},"min":{"1min":0.42699999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.72099999999999997,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.50900000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574883,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297972,"kb_used_data":684,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073868,"statfs":{"total":96636764160,"available":96331640832,"internally_reserved":0,"allocated":700416,"data_stored":322565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":0.34399999999999997,"15min":0.35199999999999998},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.41599999999999998,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.36299999999999999,"15min":0.36699999999999999},"min":{"1min":0.249,"5min":0.246,"15min":0.246},"max":{"1min":0.52500000000000002,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.34999999999999998}]},{"osd":1,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.34899999999999998,"15min":0.35199999999999998},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.45500000000000002,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.39100000000000001,"15min":0.39900000000000002},"min":{"1min":0.26700000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.49399999999999999,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.316}]},{"osd":2,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.40200000000000002,"15min":0.40999999999999998},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.51100000000000001,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.41599999999999998,"15min":0.42499999999999999},"min":{"1min":0.29899999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.54000000000000004,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.36399999999999999}]},{"osd":4,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54400000000000004,"15min":0.54600000000000004},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.57599999999999996,"15min":0.57899999999999996},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.752,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.63900000000000001}]},{"osd":5,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.56100000000000005,"15min":0.56499999999999995},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.55900000000000005,"15min":0.56299999999999994},"min":{"1min":0.377,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.72599999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.66200000000000003}]},{"osd":6,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.57799999999999996,"15min":0.58699999999999997},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.73799999999999999,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.56699999999999995,"15min":0.56899999999999995},"min":{"1min":0.38400000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.55000000000000004}]},{"osd":7,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.57899999999999996,"15min":0.58299999999999996},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.61699999999999999,"15min":0.62},"min":{"1min":0.45300000000000001,"5min":0.442,"15min":0.442},"max":{"1min":0.76700000000000002,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.70099999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574883,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297984,"kb_used_data":696,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073856,"statfs":{"total":96636764160,"available":96331628544,"internally_reserved":0,"allocated":712704,"data_stored":333198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.54500000000000004,"15min":0.54000000000000004},"min":{"1min":0.33400000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.046,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.434},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.55400000000000005,"15min":0.54800000000000004},"min":{"1min":0.39500000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.90000000000000002,"5min":1.016,"15min":1.016},"last":0.53800000000000003}]},{"osd":1,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.66200000000000003,"15min":0.67700000000000005},"min":{"1min":0.42699999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.92000000000000004,"5min":4.0780000000000003,"15min":4.0780000000000003},"last":0.502},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.68200000000000005,"15min":0.70399999999999996},"min":{"1min":0.36299999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.0129999999999999,"5min":4.1050000000000004,"15min":4.1050000000000004},"last":0.49299999999999999}]},{"osd":2,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.55500000000000005,"15min":0.55300000000000005},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.57499999999999996,"15min":0.57099999999999995},"min":{"1min":0.41099999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.93799999999999994,"5min":1.022,"15min":1.022},"last":0.39000000000000001}]},{"osd":3,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.56100000000000005,"15min":0.55600000000000005},"min":{"1min":0.40600000000000003,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.94799999999999995,"5min":1.149,"15min":1.149},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.443,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.95999999999999996,"5min":1.159,"15min":1.159},"last":0.46300000000000002}]},{"osd":5,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.45400000000000001,"15min":0.442},"min":{"1min":0.316,"5min":0.307,"15min":0.307},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.624,"5min":0.54900000000000004,"15min":0.53700000000000003},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.58699999999999997}]},{"osd":6,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.47199999999999998,"15min":0.46200000000000002},"min":{"1min":0.39100000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.53300000000000003,"15min":0.52200000000000002},"min":{"1min":0.39600000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.52400000000000002}]},{"osd":7,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.54400000000000004,"15min":0.53600000000000003},"min":{"1min":0.36899999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.995,"5min":1.014,"15min":1.014},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.54600000000000004,"15min":0.53800000000000003},"min":{"1min":0.44700000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.55100000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574883,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297976,"kb_used_data":688,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073864,"statfs":{"total":96636764160,"available":96331636736,"internally_reserved":0,"allocated":704512,"data_stored":323210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.55100000000000005,"15min":0.51700000000000002},"min":{"1min":0.314,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":5.867,"5min":5.867,"15min":5.867},"last":0.307},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.501,"15min":0.499},"min":{"1min":0.34000000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.42599999999999999}]},{"osd":1,"last update":"Fri Oct 6 01:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.52300000000000002,"15min":0.51900000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.497},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.754,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.39100000000000001}]},{"osd":2,"last update":"Fri Oct 6 01:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.56399999999999995,"15min":0.57099999999999995},"min":{"1min":0.36799999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.72499999999999998,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.53900000000000003,"15min":0.54200000000000004},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.81599999999999995,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.45200000000000001}]},{"osd":3,"last update":"Fri Oct 6 01:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.56699999999999995,"15min":0.56100000000000005},"min":{"1min":0.36899999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.9199999999999999,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.58899999999999997,"15min":0.58099999999999996},"min":{"1min":0.39100000000000001,"5min":0.37,"15min":0.37},"max":{"1min":1.9370000000000001,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":0.54600000000000004}]},{"osd":4,"last update":"Fri Oct 6 01:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48299999999999998,"15min":0.48199999999999998},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.55300000000000005,"15min":0.55400000000000005},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.80300000000000005,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.55500000000000005}]},{"osd":6,"last update":"Fri Oct 6 01:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.52800000000000002,"15min":0.51400000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.978,"5min":1.978,"15min":1.978},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.55500000000000005,"15min":0.54900000000000004},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.51000000000000001}]},{"osd":7,"last update":"Fri Oct 6 01:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.58999999999999997,"15min":0.59399999999999997},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.873,"5min":1.821,"15min":1.821},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.56699999999999995,"15min":0.56299999999999994},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.56899999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T01:42:49.991 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-06T01:42:49.991 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T01:42:50.106 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.105+0000 7f87cfb6c700 1 Processor -- start 2023-10-06T01:42:50.106 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.105+0000 7f87cfb6c700 1 -- start start 2023-10-06T01:42:50.118 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.106+0000 7f87cfb6c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f87c80af8b0 0x7f87c815d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:50.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.106+0000 7f87cfb6c700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87c815e190 con 0x7f87c80af4e0 2023-10-06T01:42:50.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.106+0000 7f87cfb6c700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87c80cb650 con 0x7f87c80b27f0 2023-10-06T01:42:50.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.106+0000 7f87cfb6c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87c80b1910 con 0x7f87c80af8b0 2023-10-06T01:42:50.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.106+0000 7f87cd908700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f87c80af4e0 0x7f87c80b20e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:53436/0 (socket says 172.21.15.71:53436) 2023-10-06T01:42:50.119 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.106+0000 7f87cd908700 1 -- 172.21.15.71:0/1520280549 learned_addr learned my addr 172.21.15.71:0/1520280549 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:42:50.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.107+0000 7f87cc906700 1 -- 172.21.15.71:0/1520280549 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2156388551 0 0) 0x7f87c815e190 con 0x7f87c80af4e0 2023-10-06T01:42:50.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.107+0000 7f87cc906700 1 -- 172.21.15.71:0/1520280549 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87b4003570 con 0x7f87c80af4e0 2023-10-06T01:42:50.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.107+0000 7f87cd107700 1 --2- 172.21.15.71:0/1520280549 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f87c80af8b0 0x7f87c815d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:50.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.107+0000 7f87cc906700 1 -- 172.21.15.71:0/1520280549 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 647007702 0 0) 0x7f87b4003570 con 0x7f87c80af4e0 2023-10-06T01:42:50.120 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.107+0000 7f87cc906700 1 -- 172.21.15.71:0/1520280549 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f87c80af8b0 msgr2=0x7f87c815d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:50.121 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.107+0000 7f87cc906700 1 --2- 172.21.15.71:0/1520280549 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f87c80af8b0 0x7f87c815d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:50.121 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.107+0000 7f87cc906700 1 -- 172.21.15.71:0/1520280549 >> v1:172.21.15.72:6789/0 conn(0x7f87c80b27f0 legacy=0x7f87c815d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:50.121 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.107+0000 7f87cc906700 1 -- 172.21.15.71:0/1520280549 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87c80ccaf0 con 0x7f87c80af4e0 2023-10-06T01:42:50.121 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.107+0000 7f87cc906700 1 -- 172.21.15.71:0/1520280549 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1184243524 0 0) 0x7f87c4001470 con 0x7f87c80af4e0 2023-10-06T01:42:50.121 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.107+0000 7f87cc906700 1 -- 172.21.15.71:0/1520280549 >> v1:172.21.15.71:6789/0 conn(0x7f87c80af4e0 legacy=0x7f87c80b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:50.121 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.107+0000 7f87cc906700 1 --2- 172.21.15.71:0/1520280549 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f87b4003a90 0x7f87b4003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:50.122 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.107+0000 7f87cc906700 1 --2- 172.21.15.71:0/1520280549 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87b4004810 0x7f87b4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:50.122 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.107+0000 7f87cc906700 1 --2- 172.21.15.71:0/1520280549 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f87c80af8b0 0x7f87b40051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:50.122 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.107+0000 7f87cc906700 1 -- 172.21.15.71:0/1520280549 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c80b1910 con 0x7f87b4003a90 2023-10-06T01:42:50.122 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.107+0000 7f87cc906700 1 -- 172.21.15.71:0/1520280549 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87b400bbc0 con 0x7f87b4004810 2023-10-06T01:42:50.122 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.107+0000 7f87cc906700 1 -- 172.21.15.71:0/1520280549 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87b400bd80 con 0x7f87c80af8b0 2023-10-06T01:42:50.122 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.107+0000 7f87cd908700 1 --2- 172.21.15.71:0/1520280549 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f87b4003a90 0x7f87b4003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:50.123 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.107+0000 7f87cd107700 1 --2- 172.21.15.71:0/1520280549 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87b4004810 0x7f87b4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:50.123 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.107+0000 7f87ce109700 1 --2- 172.21.15.71:0/1520280549 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f87c80af8b0 0x7f87b40051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:50.123 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.107+0000 7f87cd908700 1 -- 172.21.15.71:0/1520280549 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f87c80af8b0 msgr2=0x7f87b40051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:50.123 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.107+0000 7f87cd908700 1 --2- 172.21.15.71:0/1520280549 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f87c80af8b0 0x7f87b40051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:50.123 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.107+0000 7f87cd908700 1 -- 172.21.15.71:0/1520280549 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87b4004810 msgr2=0x7f87b4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:50.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.107+0000 7f87cd908700 1 --2- 172.21.15.71:0/1520280549 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87b4004810 0x7f87b4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:50.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.107+0000 7f87cd908700 1 -- 172.21.15.71:0/1520280549 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87b4003570 con 0x7f87b4003a90 2023-10-06T01:42:50.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.108+0000 7f87cd908700 1 --2- 172.21.15.71:0/1520280549 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f87b4003a90 0x7f87b4003ea0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f87c400c390 tx=0x7f87c80cb5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=446e5fe942fd4124 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:50.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.108+0000 7f87cc906700 1 -- 172.21.15.71:0/1520280549 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c400cc60 con 0x7f87b4003a90 2023-10-06T01:42:50.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.108+0000 7f87cc906700 1 -- 172.21.15.71:0/1520280549 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87c400cdc0 con 0x7f87b4003a90 2023-10-06T01:42:50.124 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.108+0000 7f87cc906700 1 -- 172.21.15.71:0/1520280549 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c4005b70 con 0x7f87b4003a90 2023-10-06T01:42:50.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.108+0000 7f87cfb6c700 1 -- 172.21.15.71:0/1520280549 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f87b4003a90 msgr2=0x7f87b4003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:50.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.108+0000 7f87cfb6c700 1 --2- 172.21.15.71:0/1520280549 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f87b4003a90 0x7f87b4003ea0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f87c400c390 tx=0x7f87c80cb5c0 comp rx=0 tx=0).stop 2023-10-06T01:42:50.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.108+0000 7f87ce109700 1 -- 172.21.15.71:0/1520280549 reap_dead start 2023-10-06T01:42:50.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.108+0000 7f87cfb6c700 1 -- 172.21.15.71:0/1520280549 shutdown_connections 2023-10-06T01:42:50.125 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.108+0000 7f87cfb6c700 1 -- 172.21.15.71:0/1520280549 >> 172.21.15.71:0/1520280549 conn(0x7f87c8068680 msgr2=0x7f87c8068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:50.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.108+0000 7f87cfb6c700 1 -- 172.21.15.71:0/1520280549 shutdown_connections 2023-10-06T01:42:50.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.108+0000 7f87cfb6c700 1 -- 172.21.15.71:0/1520280549 wait complete. 2023-10-06T01:42:50.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.109+0000 7f87cfb6c700 1 Processor -- start 2023-10-06T01:42:50.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.109+0000 7f87cfb6c700 1 -- start start 2023-10-06T01:42:50.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.110+0000 7f87cfb6c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f87b4003a90 0x7f87c8169eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:50.126 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.110+0000 7f87cfb6c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87c80ae660 0x7f87c8159870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:50.127 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.110+0000 7f87cfb6c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f87c80a88a0 0x7f87c80a8d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:50.127 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.110+0000 7f87cfb6c700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c80a9280 con 0x7f87c80a88a0 2023-10-06T01:42:50.127 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.110+0000 7f87cfb6c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c80a7050 con 0x7f87c80ae660 2023-10-06T01:42:50.127 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.110+0000 7f87cfb6c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87c80a6d20 con 0x7f87b4003a90 2023-10-06T01:42:50.127 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.110+0000 7f87ce109700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f87c80a88a0 0x7f87c80a8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:50.128 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.110+0000 7f87ce109700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f87c80a88a0 0x7f87c80a8d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41296/0 (socket says 172.21.15.71:41296) 2023-10-06T01:42:50.128 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.110+0000 7f87ce109700 1 -- 172.21.15.71:0/3693472522 learned_addr learned my addr 172.21.15.71:0/3693472522 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:50.128 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.110+0000 7f87cd107700 1 --2- 172.21.15.71:0/3693472522 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87c80ae660 0x7f87c8159870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:50.128 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.110+0000 7f87cd908700 1 --2- 172.21.15.71:0/3693472522 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f87b4003a90 0x7f87c8169eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:50.128 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.110+0000 7f87ce109700 1 -- 172.21.15.71:0/3693472522 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f87b4003a90 msgr2=0x7f87c8169eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:50.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.110+0000 7f87ce109700 1 --2- 172.21.15.71:0/3693472522 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f87b4003a90 0x7f87c8169eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:50.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.110+0000 7f87ce109700 1 -- 172.21.15.71:0/3693472522 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87c80ae660 msgr2=0x7f87c8159870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:50.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.110+0000 7f87ce109700 1 --2- 172.21.15.71:0/3693472522 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87c80ae660 0x7f87c8159870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:50.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.110+0000 7f87ce109700 1 -- 172.21.15.71:0/3693472522 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87c816a6e0 con 0x7f87c80a88a0 2023-10-06T01:42:50.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.110+0000 7f87cd107700 1 --2- 172.21.15.71:0/3693472522 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87c80ae660 0x7f87c8159870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:42:50.129 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.110+0000 7f87cd908700 1 --2- 172.21.15.71:0/3693472522 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f87b4003a90 0x7f87c8169eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:42:50.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.111+0000 7f87ce109700 1 --2- 172.21.15.71:0/3693472522 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f87c80a88a0 0x7f87c80a8d40 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f87c80b2bc0 tx=0x7f87c0001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:50.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.111+0000 7f87bdffb700 1 -- 172.21.15.71:0/3693472522 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c0018070 con 0x7f87c80a88a0 2023-10-06T01:42:50.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.111+0000 7f87bdffb700 1 -- 172.21.15.71:0/3693472522 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87c0006ba0 con 0x7f87c80a88a0 2023-10-06T01:42:50.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.111+0000 7f87cfb6c700 1 -- 172.21.15.71:0/3693472522 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87c816a9c0 con 0x7f87c80a88a0 2023-10-06T01:42:50.130 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.111+0000 7f87bdffb700 1 -- 172.21.15.71:0/3693472522 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c000c7b0 con 0x7f87c80a88a0 2023-10-06T01:42:50.131 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.111+0000 7f87cfb6c700 1 -- 172.21.15.71:0/3693472522 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87c816a3f0 con 0x7f87c80a88a0 2023-10-06T01:42:50.131 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.112+0000 7f87cfb6c700 1 -- 172.21.15.71:0/3693472522 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87c80a7200 con 0x7f87c80a88a0 2023-10-06T01:42:50.131 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.112+0000 7f87bdffb700 1 -- 172.21.15.71:0/3693472522 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f87c000cba0 con 0x7f87c80a88a0 2023-10-06T01:42:50.131 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.113+0000 7f87bdffb700 1 --2- 172.21.15.71:0/3693472522 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f87ac066f30 0x7f87ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:50.131 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.113+0000 7f87bdffb700 1 -- 172.21.15.71:0/3693472522 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f87c00842f0 con 0x7f87c80a88a0 2023-10-06T01:42:50.131 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.113+0000 7f87cd908700 1 --2- 172.21.15.71:0/3693472522 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f87ac066f30 0x7f87ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:50.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.113+0000 7f87cd908700 1 --2- 172.21.15.71:0/3693472522 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f87ac066f30 0x7f87ac0693e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f87c400c1a0 tx=0x7f87c4015000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:50.132 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.117+0000 7f87bdffb700 1 -- 172.21.15.71:0/3693472522 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f87c80a7200 con 0x7f87c80a88a0 2023-10-06T01:42:50.296 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.296+0000 7f87cfb6c700 1 -- 172.21.15.71:0/3693472522 --> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f87c80a71c0 con 0x7f87ac066f30 2023-10-06T01:42:50.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.298+0000 7f87bdffb700 1 -- 172.21.15.71:0/3693472522 <== mgr.4107 v2:172.21.15.71:6832/90436 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+72841 (secure 0 0 0) 0x7f87c80a71c0 con 0x7f87ac066f30 2023-10-06T01:42:50.300 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:42:50.302 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.301+0000 7f87cfb6c700 1 -- 172.21.15.71:0/3693472522 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f87ac066f30 msgr2=0x7f87ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:50.302 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.301+0000 7f87cfb6c700 1 --2- 172.21.15.71:0/3693472522 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f87ac066f30 0x7f87ac0693e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f87c400c1a0 tx=0x7f87c4015000 comp rx=0 tx=0).stop 2023-10-06T01:42:50.302 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.301+0000 7f87cfb6c700 1 -- 172.21.15.71:0/3693472522 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f87c80a88a0 msgr2=0x7f87c80a8d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:50.302 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.301+0000 7f87cfb6c700 1 --2- 172.21.15.71:0/3693472522 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f87c80a88a0 0x7f87c80a8d40 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f87c80b2bc0 tx=0x7f87c0001640 comp rx=0 tx=0).stop 2023-10-06T01:42:50.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.301+0000 7f87cfb6c700 1 -- 172.21.15.71:0/3693472522 shutdown_connections 2023-10-06T01:42:50.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.301+0000 7f87cfb6c700 1 --2- 172.21.15.71:0/3693472522 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f87c80a88a0 0x7f87c80a8d40 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:50.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.301+0000 7f87cfb6c700 1 --2- 172.21.15.71:0/3693472522 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f87b4003a90 0x7f87c8169eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:50.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.301+0000 7f87cfb6c700 1 --2- 172.21.15.71:0/3693472522 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f87ac066f30 0x7f87ac0693e0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:50.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.301+0000 7f87cfb6c700 1 --2- 172.21.15.71:0/3693472522 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87c80ae660 0x7f87c8159870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:50.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.301+0000 7f87cfb6c700 1 -- 172.21.15.71:0/3693472522 >> 172.21.15.71:0/3693472522 conn(0x7f87c8068680 msgr2=0x7f87c806a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:50.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.301+0000 7f87cfb6c700 1 -- 172.21.15.71:0/3693472522 shutdown_connections 2023-10-06T01:42:50.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.301+0000 7f87cfb6c700 1 -- 172.21.15.71:0/3693472522 wait complete. 2023-10-06T01:42:50.304 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2023-10-06T01:42:50.313 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":134,"stamp":"2023-10-06T01:42:48.595901+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2384956,"kb_used_data":6652,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752589764,"statfs":{"total":773094113280,"available":770651918336,"internally_reserved":0,"allocated":6811648,"data_stored":3782919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-11379,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-49,"num_read_kb":-60,"num_write":-62,"num_write_kb":-31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001017"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":44,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T01:42:35.032246+0000","last_change":"2023-10-06T01:40:16.930992+0000","last_active":"2023-10-06T01:42:35.032246+0000","last_peered":"2023-10-06T01:42:35.032246+0000","last_clean":"2023-10-06T01:42:35.032246+0000","last_became_active":"2023-10-06T01:40:16.930707+0000","last_became_peered":"2023-10-06T01:40:16.930707+0000","last_unstale":"2023-10-06T01:42:35.032246+0000","last_undegraded":"2023-10-06T01:42:35.032246+0000","last_fullsized":"2023-10-06T01:42:35.032246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:52:43.316071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":43,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T01:42:34.783844+0000","last_change":"2023-10-06T01:40:16.651019+0000","last_active":"2023-10-06T01:42:34.783844+0000","last_peered":"2023-10-06T01:42:34.783844+0000","last_clean":"2023-10-06T01:42:34.783844+0000","last_became_active":"2023-10-06T01:40:16.650628+0000","last_became_peered":"2023-10-06T01:40:16.650628+0000","last_unstale":"2023-10-06T01:42:34.783844+0000","last_undegraded":"2023-10-06T01:42:34.783844+0000","last_fullsized":"2023-10-06T01:42:34.783844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:11:57.218984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":40,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T01:42:01.656770+0000","last_change":"2023-10-06T01:40:16.781596+0000","last_active":"2023-10-06T01:42:01.656770+0000","last_peered":"2023-10-06T01:42:01.656770+0000","last_clean":"2023-10-06T01:42:01.656770+0000","last_became_active":"2023-10-06T01:40:16.781352+0000","last_became_peered":"2023-10-06T01:40:16.781352+0000","last_unstale":"2023-10-06T01:42:01.656770+0000","last_undegraded":"2023-10-06T01:42:01.656770+0000","last_fullsized":"2023-10-06T01:42:01.656770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:52:43.316071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":43,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T01:42:34.783978+0000","last_change":"2023-10-06T01:40:16.650826+0000","last_active":"2023-10-06T01:42:34.783978+0000","last_peered":"2023-10-06T01:42:34.783978+0000","last_clean":"2023-10-06T01:42:34.783978+0000","last_became_active":"2023-10-06T01:40:16.650469+0000","last_became_peered":"2023-10-06T01:40:16.650469+0000","last_unstale":"2023-10-06T01:42:34.783978+0000","last_undegraded":"2023-10-06T01:42:34.783978+0000","last_fullsized":"2023-10-06T01:42:34.783978+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:50:23.628212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":195,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T01:42:34.186634+0000","last_change":"2023-10-06T01:40:10.645512+0000","last_active":"2023-10-06T01:42:34.186634+0000","last_peered":"2023-10-06T01:42:34.186634+0000","last_clean":"2023-10-06T01:42:34.186634+0000","last_became_active":"2023-10-06T01:40:10.644601+0000","last_became_peered":"2023-10-06T01:40:10.644601+0000","last_unstale":"2023-10-06T01:42:34.186634+0000","last_undegraded":"2023-10-06T01:42:34.186634+0000","last_fullsized":"2023-10-06T01:42:34.186634+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:09.580865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:09.580865+0000","last_clean_scrub_stamp":"2023-10-06T01:40:09.580865+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:05:28.268591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":42,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T01:42:34.186708+0000","last_change":"2023-10-06T01:40:16.651332+0000","last_active":"2023-10-06T01:42:34.186708+0000","last_peered":"2023-10-06T01:42:34.186708+0000","last_clean":"2023-10-06T01:42:34.186708+0000","last_became_active":"2023-10-06T01:40:16.651049+0000","last_became_peered":"2023-10-06T01:40:16.651049+0000","last_unstale":"2023-10-06T01:42:34.186708+0000","last_undegraded":"2023-10-06T01:42:34.186708+0000","last_fullsized":"2023-10-06T01:42:34.186708+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:11:57.218984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":42,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T01:42:34.187121+0000","last_change":"2023-10-06T01:40:16.931106+0000","last_active":"2023-10-06T01:42:34.187121+0000","last_peered":"2023-10-06T01:42:34.187121+0000","last_clean":"2023-10-06T01:42:34.187121+0000","last_became_active":"2023-10-06T01:40:16.930830+0000","last_became_peered":"2023-10-06T01:40:16.930830+0000","last_unstale":"2023-10-06T01:42:34.187121+0000","last_undegraded":"2023-10-06T01:42:34.187121+0000","last_fullsized":"2023-10-06T01:42:34.187121+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:50:23.628212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":44,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T01:42:35.032529+0000","last_change":"2023-10-06T01:40:16.649379+0000","last_active":"2023-10-06T01:42:35.032529+0000","last_peered":"2023-10-06T01:42:35.032529+0000","last_clean":"2023-10-06T01:42:35.032529+0000","last_became_active":"2023-10-06T01:40:16.649147+0000","last_became_peered":"2023-10-06T01:40:16.649147+0000","last_unstale":"2023-10-06T01:42:35.032529+0000","last_undegraded":"2023-10-06T01:42:35.032529+0000","last_fullsized":"2023-10-06T01:42:35.032529+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:11:57.218984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":44,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T01:42:34.029893+0000","last_change":"2023-10-06T01:40:16.651477+0000","last_active":"2023-10-06T01:42:34.029893+0000","last_peered":"2023-10-06T01:42:34.029893+0000","last_clean":"2023-10-06T01:42:34.029893+0000","last_became_active":"2023-10-06T01:40:16.651190+0000","last_became_peered":"2023-10-06T01:40:16.651190+0000","last_unstale":"2023-10-06T01:42:34.029893+0000","last_undegraded":"2023-10-06T01:42:34.029893+0000","last_fullsized":"2023-10-06T01:42:34.029893+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:45:47.422876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574883,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298556,"kb_used_data":1268,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073284,"statfs":{"total":96636764160,"available":96331042816,"internally_reserved":0,"allocated":1298432,"data_stored":913114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.64400000000000002,"15min":0.66600000000000004},"min":{"1min":0.32800000000000001,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.72799999999999998,"5min":3.6920000000000002,"15min":3.6920000000000002},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.64800000000000002,"15min":0.67000000000000004},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.69199999999999995,"5min":3.629,"15min":3.629},"last":0.48799999999999999}]},{"osd":1,"last update":"Fri Oct 6 01:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.83899999999999997,"15min":0.89500000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.70499999999999996,"5min":10.029999999999999,"15min":10.029999999999999},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.56699999999999995,"15min":0.57299999999999995},"min":{"1min":0.378,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.68799999999999994,"5min":1.544,"15min":1.544},"last":0.435}]},{"osd":2,"last update":"Fri Oct 6 01:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.53800000000000003,"15min":0.54400000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.746,"5min":1.091,"15min":1.091},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.92000000000000004,"15min":0.97799999999999998},"min":{"1min":0.45300000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.71099999999999997,"5min":10.710000000000001,"15min":10.710000000000001},"last":0.58199999999999996}]},{"osd":3,"last update":"Fri Oct 6 01:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.54700000000000004,"15min":0.55300000000000005},"min":{"1min":0.32600000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.64500000000000002,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.70399999999999996,"15min":0.72499999999999998},"min":{"1min":0.441,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.73999999999999999,"5min":3.6509999999999998,"15min":3.6509999999999998},"last":0.53300000000000003}]},{"osd":4,"last update":"Fri Oct 6 01:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.48899999999999999,"15min":0.48799999999999999},"min":{"1min":0.33900000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.77400000000000002,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.53400000000000003,"15min":0.52800000000000002},"min":{"1min":0.42499999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.64000000000000001}]},{"osd":5,"last update":"Fri Oct 6 01:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.59199999999999997,"15min":0.59799999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.86899999999999999,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.629,"15min":0.63600000000000001},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.79800000000000004,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":0.66000000000000003}]},{"osd":6,"last update":"Fri Oct 6 01:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.58999999999999997,"15min":0.59499999999999997},"min":{"1min":0.40799999999999997,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.77700000000000002,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":0.623},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.56599999999999995,"15min":0.56999999999999995},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.69999999999999996,"5min":0.878,"15min":0.878},"last":0.69499999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574883,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297964,"kb_used_data":676,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073876,"statfs":{"total":96636764160,"available":96331649024,"internally_reserved":0,"allocated":692224,"data_stored":322509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.49399999999999999,"15min":0.496},"min":{"1min":0.34999999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.495,"5min":0.48399999999999999,"15min":0.48199999999999998},"min":{"1min":0.35599999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.46100000000000002}]},{"osd":1,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.40799999999999997,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.55700000000000005,"15min":0.55900000000000005},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.68400000000000005,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.56999999999999995}]},{"osd":2,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.54200000000000004,"15min":0.54600000000000004},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.70899999999999996,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.56000000000000005,"15min":0.56200000000000006},"min":{"1min":0.40200000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.69399999999999995,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.38400000000000001}]},{"osd":3,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.55400000000000005,"15min":0.55700000000000005},"min":{"1min":0.36899999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.72199999999999998,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.432},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.56000000000000005,"15min":0.56200000000000006},"min":{"1min":0.432,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.79000000000000004,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.54400000000000004}]},{"osd":4,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.51300000000000001,"15min":0.52000000000000002},"min":{"1min":0.312,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.61099999999999999,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.5,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.74299999999999999,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.51700000000000002}]},{"osd":5,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.53300000000000003,"15min":0.53100000000000003},"min":{"1min":0.38900000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.66900000000000004,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.36099999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.72999999999999998,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.63900000000000001}]},{"osd":7,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.56699999999999995,"15min":0.56299999999999994},"min":{"1min":0.47499999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.69399999999999995,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.438,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.67200000000000004,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.625}]}]},{"osd":1,"up_from":13,"seq":55834574883,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297968,"kb_used_data":680,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073872,"statfs":{"total":96636764160,"available":96331644928,"internally_reserved":0,"allocated":696320,"data_stored":322599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.86099999999999999,"15min":0.95099999999999996},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.56100000000000005,"5min":11.957000000000001,"15min":11.957000000000001},"last":0.217},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.877,"15min":0.96399999999999997},"min":{"1min":0.28999999999999998,"5min":0.252,"15min":0.252},"max":{"1min":0.47899999999999998,"5min":11.917,"15min":11.917},"last":0.28599999999999998}]},{"osd":2,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.36399999999999999,"15min":0.372},"min":{"1min":0.253,"5min":0.251,"15min":0.251},"max":{"1min":0.441,"5min":1.125,"15min":1.125},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.32900000000000001,"5min":0.375,"15min":0.38300000000000001},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.45100000000000001,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.253}]},{"osd":3,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.67200000000000004,"15min":0.71999999999999997},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.53000000000000003,"5min":6.2450000000000001,"15min":6.2450000000000001},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.64800000000000002,"15min":0.69799999999999995},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.52300000000000002,"5min":6.2939999999999996,"15min":6.2939999999999996},"last":0.32700000000000001}]},{"osd":4,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.86299999999999999,"15min":0.90700000000000003},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.84599999999999997,"5min":6.1669999999999998,"15min":6.1669999999999998},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.61099999999999999,"15min":0.61499999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.875,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.41999999999999998}]},{"osd":5,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.83899999999999997,"15min":0.877},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.91900000000000004,"5min":6.2619999999999996,"15min":6.2619999999999996},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.625,"5min":0.873,"15min":0.91400000000000003},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.86799999999999999,"5min":6.2350000000000003,"15min":6.2350000000000003},"last":0.33900000000000002}]},{"osd":6,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.80700000000000005,"15min":0.84899999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.83599999999999997,"5min":6.141,"15min":6.141},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.84599999999999997,"15min":0.89100000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.74299999999999999,"5min":6.2069999999999999,"15min":6.2069999999999999},"last":0.36299999999999999}]},{"osd":7,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.64200000000000002,"15min":0.64900000000000002},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.90700000000000003,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.85699999999999998,"15min":0.90000000000000002},"min":{"1min":0.442,"5min":0.44,"15min":0.44},"max":{"1min":0.72399999999999998,"5min":6.1040000000000001,"15min":6.1040000000000001},"last":0.434}]}]},{"osd":0,"up_from":13,"seq":55834574883,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298564,"kb_used_data":1276,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073276,"statfs":{"total":96636764160,"available":96331034624,"internally_reserved":0,"allocated":1306624,"data_stored":923159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 01:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.36899999999999999,"15min":0.374},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.46500000000000002,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.308},{"interface":"front","average":{"1min":0.318,"5min":0.46100000000000002,"15min":0.48499999999999999},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.38600000000000001,"5min":3.9129999999999998,"15min":3.9129999999999998},"last":0.36499999999999999}]},{"osd":2,"last update":"Fri Oct 6 01:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.86199999999999999,"15min":0.94799999999999995},"min":{"1min":0.23699999999999999,"5min":0.216,"15min":0.216},"max":{"1min":0.47199999999999998,"5min":15.237,"15min":15.237},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.48899999999999999,"15min":0.50900000000000001},"min":{"1min":0.28399999999999997,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.49199999999999999,"5min":3.7959999999999998,"15min":3.7959999999999998},"last":0.28399999999999997}]},{"osd":3,"last update":"Fri Oct 6 01:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.51900000000000002,"15min":0.54600000000000004},"min":{"1min":0.29999999999999999,"5min":0.252,"15min":0.252},"max":{"1min":0.48799999999999999,"5min":5.2850000000000001,"15min":5.2850000000000001},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.90500000000000003,"15min":0.99099999999999999},"min":{"1min":0.29399999999999998,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.51200000000000001,"5min":15.263,"15min":15.263},"last":0.34699999999999998}]},{"osd":4,"last update":"Fri Oct 6 01:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.77300000000000002,"15min":0.80100000000000005},"min":{"1min":0.46500000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.73299999999999998,"5min":5.2590000000000003,"15min":5.2590000000000003},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":1.115,"15min":1.1990000000000001},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.84799999999999998,"5min":15.211,"15min":15.211},"last":0.63300000000000001}]},{"osd":5,"last update":"Fri Oct 6 01:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.69099999999999995,"15min":0.71099999999999997},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.81100000000000005,"5min":3.8839999999999999,"15min":3.8839999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.748,"15min":0.78000000000000003},"min":{"1min":0.438,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.63200000000000001,"5min":5.2309999999999999,"15min":5.2309999999999999},"last":0.64600000000000002}]},{"osd":6,"last update":"Fri Oct 6 01:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":1.091,"15min":1.171},"min":{"1min":0.43099999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.82799999999999996,"5min":15.175000000000001,"15min":15.175000000000001},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.71599999999999997,"15min":0.73899999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.75,"5min":3.859,"15min":3.859},"last":0.60299999999999998}]},{"osd":7,"last update":"Fri Oct 6 01:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.71799999999999997,"15min":0.73999999999999999},"min":{"1min":0.434,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.71599999999999997,"5min":3.831,"15min":3.831},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.748,"15min":0.77400000000000002},"min":{"1min":0.46500000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.76300000000000001,"5min":5.1959999999999997,"15min":5.1959999999999997},"last":0.624}]}]},{"osd":2,"up_from":13,"seq":55834574883,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297972,"kb_used_data":684,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073868,"statfs":{"total":96636764160,"available":96331640832,"internally_reserved":0,"allocated":700416,"data_stored":322565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:42:10 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.33700000000000002,"15min":0.33600000000000002},"min":{"1min":0.22800000000000001,"5min":0.216,"15min":0.216},"max":{"1min":0.46500000000000002,"5min":0.48199999999999998,"15min":0.48199999999999998},"last":0.314},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.34999999999999998,"15min":0.35399999999999998},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.46200000000000002,"5min":0.51400000000000001,"15min":0.51400000000000001},"last":0.28100000000000003}]},{"osd":1,"last update":"Fri Oct 6 01:42:10 2023","interfaces":[{"interface":"back","average":{"1min":0.314,"5min":0.311,"15min":0.311},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.441,"5min":0.47299999999999998,"15min":0.47299999999999998},"last":0.23999999999999999},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.36899999999999999,"15min":0.371},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.52400000000000002,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.36099999999999999}]},{"osd":3,"last update":"Fri Oct 6 01:42:10 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35799999999999998,"15min":0.35899999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.47899999999999998,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.374,"5min":0.38,"15min":0.38100000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.48899999999999999,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.39700000000000002}]},{"osd":4,"last update":"Fri Oct 6 01:42:10 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.53300000000000003,"15min":0.53400000000000003},"min":{"1min":0.39900000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.68400000000000005,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.55600000000000005,"15min":0.55400000000000005},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.79800000000000004,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.54400000000000004}]},{"osd":5,"last update":"Fri Oct 6 01:42:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.75600000000000001,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.57899999999999996,"15min":0.58099999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.77900000000000003,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.51900000000000002}]},{"osd":6,"last update":"Fri Oct 6 01:42:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55700000000000005,"15min":0.55800000000000005},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.81799999999999995,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.495},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57599999999999996,"15min":0.57699999999999996},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.84499999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.48599999999999999}]},{"osd":7,"last update":"Fri Oct 6 01:42:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56200000000000006,"15min":0.56299999999999994},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.82599999999999996,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.58299999999999996,"15min":0.58499999999999996},"min":{"1min":0.42699999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.72099999999999997,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.50900000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574883,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297972,"kb_used_data":684,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073868,"statfs":{"total":96636764160,"available":96331640832,"internally_reserved":0,"allocated":700416,"data_stored":322565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":0.34399999999999997,"15min":0.35199999999999998},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.41599999999999998,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.36299999999999999,"15min":0.36699999999999999},"min":{"1min":0.249,"5min":0.246,"15min":0.246},"max":{"1min":0.52500000000000002,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.34999999999999998}]},{"osd":1,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.34899999999999998,"15min":0.35199999999999998},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.45500000000000002,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.39100000000000001,"15min":0.39900000000000002},"min":{"1min":0.26700000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.49399999999999999,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.316}]},{"osd":2,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.40200000000000002,"15min":0.40999999999999998},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.51100000000000001,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.41599999999999998,"15min":0.42499999999999999},"min":{"1min":0.29899999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.54000000000000004,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.36399999999999999}]},{"osd":4,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54400000000000004,"15min":0.54600000000000004},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.57599999999999996,"15min":0.57899999999999996},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.752,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.63900000000000001}]},{"osd":5,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.56100000000000005,"15min":0.56499999999999995},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.55900000000000005,"15min":0.56299999999999994},"min":{"1min":0.377,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.72599999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.66200000000000003}]},{"osd":6,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.57799999999999996,"15min":0.58699999999999997},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.73799999999999999,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.56699999999999995,"15min":0.56899999999999995},"min":{"1min":0.38400000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.55000000000000004}]},{"osd":7,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.57899999999999996,"15min":0.58299999999999996},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.61699999999999999,"15min":0.62},"min":{"1min":0.45300000000000001,"5min":0.442,"15min":0.442},"max":{"1min":0.76700000000000002,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.70099999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574883,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297984,"kb_used_data":696,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073856,"statfs":{"total":96636764160,"available":96331628544,"internally_reserved":0,"allocated":712704,"data_stored":333198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.54500000000000004,"15min":0.54000000000000004},"min":{"1min":0.33400000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.046,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.434},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.55400000000000005,"15min":0.54800000000000004},"min":{"1min":0.39500000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.90000000000000002,"5min":1.016,"15min":1.016},"last":0.53800000000000003}]},{"osd":1,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.66200000000000003,"15min":0.67700000000000005},"min":{"1min":0.42699999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.92000000000000004,"5min":4.0780000000000003,"15min":4.0780000000000003},"last":0.502},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.68200000000000005,"15min":0.70399999999999996},"min":{"1min":0.36299999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.0129999999999999,"5min":4.1050000000000004,"15min":4.1050000000000004},"last":0.49299999999999999}]},{"osd":2,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.55500000000000005,"15min":0.55300000000000005},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.57499999999999996,"15min":0.57099999999999995},"min":{"1min":0.41099999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.93799999999999994,"5min":1.022,"15min":1.022},"last":0.39000000000000001}]},{"osd":3,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.56100000000000005,"15min":0.55600000000000005},"min":{"1min":0.40600000000000003,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.94799999999999995,"5min":1.149,"15min":1.149},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.443,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.95999999999999996,"5min":1.159,"15min":1.159},"last":0.46300000000000002}]},{"osd":5,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.45400000000000001,"15min":0.442},"min":{"1min":0.316,"5min":0.307,"15min":0.307},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.624,"5min":0.54900000000000004,"15min":0.53700000000000003},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.58699999999999997}]},{"osd":6,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.47199999999999998,"15min":0.46200000000000002},"min":{"1min":0.39100000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.53300000000000003,"15min":0.52200000000000002},"min":{"1min":0.39600000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.52400000000000002}]},{"osd":7,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.54400000000000004,"15min":0.53600000000000003},"min":{"1min":0.36899999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.995,"5min":1.014,"15min":1.014},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.54600000000000004,"15min":0.53800000000000003},"min":{"1min":0.44700000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.55100000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574883,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297976,"kb_used_data":688,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073864,"statfs":{"total":96636764160,"available":96331636736,"internally_reserved":0,"allocated":704512,"data_stored":323210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.55100000000000005,"15min":0.51700000000000002},"min":{"1min":0.314,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":5.867,"5min":5.867,"15min":5.867},"last":0.307},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.501,"15min":0.499},"min":{"1min":0.34000000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.42599999999999999}]},{"osd":1,"last update":"Fri Oct 6 01:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.52300000000000002,"15min":0.51900000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.497},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.754,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.39100000000000001}]},{"osd":2,"last update":"Fri Oct 6 01:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.56399999999999995,"15min":0.57099999999999995},"min":{"1min":0.36799999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.72499999999999998,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.53900000000000003,"15min":0.54200000000000004},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.81599999999999995,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.45200000000000001}]},{"osd":3,"last update":"Fri Oct 6 01:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.56699999999999995,"15min":0.56100000000000005},"min":{"1min":0.36899999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.9199999999999999,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.58899999999999997,"15min":0.58099999999999996},"min":{"1min":0.39100000000000001,"5min":0.37,"15min":0.37},"max":{"1min":1.9370000000000001,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":0.54600000000000004}]},{"osd":4,"last update":"Fri Oct 6 01:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48299999999999998,"15min":0.48199999999999998},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.55300000000000005,"15min":0.55400000000000005},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.80300000000000005,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.55500000000000005}]},{"osd":6,"last update":"Fri Oct 6 01:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.52800000000000002,"15min":0.51400000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.978,"5min":1.978,"15min":1.978},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.55500000000000005,"15min":0.54900000000000004},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.51000000000000001}]},{"osd":7,"last update":"Fri Oct 6 01:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.58999999999999997,"15min":0.59399999999999997},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.873,"5min":1.821,"15min":1.821},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.56699999999999995,"15min":0.56299999999999994},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.56899999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T01:42:50.316 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:42:50.430 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.430+0000 7fa266ae1700 1 Processor -- start 2023-10-06T01:42:50.431 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.430+0000 7fa266ae1700 1 -- start start 2023-10-06T01:42:50.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.431+0000 7fa266ae1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa2600b27f0 0x7fa26015db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:50.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.431+0000 7fa266ae1700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa26015e190 con 0x7fa2600af8b0 2023-10-06T01:42:50.433 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.431+0000 7fa266ae1700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2600cb650 con 0x7fa2600af4e0 2023-10-06T01:42:50.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.431+0000 7fa266ae1700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2600b1910 con 0x7fa2600b27f0 2023-10-06T01:42:50.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.431+0000 7fa25ffff700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fa2600af8b0 0x7fa26015d460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:53450/0 (socket says 172.21.15.71:53450) 2023-10-06T01:42:50.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.431+0000 7fa25ffff700 1 -- 172.21.15.71:0/3605183052 learned_addr learned my addr 172.21.15.71:0/3605183052 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:42:50.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.431+0000 7fa26507e700 1 --2- 172.21.15.71:0/3605183052 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa2600b27f0 0x7fa26015db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:50.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.431+0000 7fa25f7fe700 1 -- 172.21.15.71:0/3605183052 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2142605865 0 0) 0x7fa26015e190 con 0x7fa2600af8b0 2023-10-06T01:42:50.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.431+0000 7fa25f7fe700 1 -- 172.21.15.71:0/3605183052 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa250003570 con 0x7fa2600af8b0 2023-10-06T01:42:50.434 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.431+0000 7fa25f7fe700 1 -- 172.21.15.71:0/3605183052 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 793516269 0 0) 0x7fa2600cb650 con 0x7fa2600af4e0 2023-10-06T01:42:50.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.431+0000 7fa25f7fe700 1 -- 172.21.15.71:0/3605183052 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa26015e190 con 0x7fa2600af4e0 2023-10-06T01:42:50.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.431+0000 7fa26507e700 1 -- 172.21.15.71:0/3605183052 >> v1:172.21.15.72:6789/0 conn(0x7fa2600af4e0 legacy=0x7fa2600b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:50.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.431+0000 7fa25f7fe700 1 -- 172.21.15.71:0/3605183052 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 437283862 0 0) 0x7fa250003570 con 0x7fa2600af8b0 2023-10-06T01:42:50.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.431+0000 7fa26507e700 1 -- 172.21.15.71:0/3605183052 >> v1:172.21.15.71:6789/0 conn(0x7fa2600af8b0 legacy=0x7fa26015d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:50.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.431+0000 7fa26507e700 1 -- 172.21.15.71:0/3605183052 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2600ccaf0 con 0x7fa2600b27f0 2023-10-06T01:42:50.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.432+0000 7fa26507e700 1 --2- 172.21.15.71:0/3605183052 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa2600b27f0 0x7fa26015db70 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa258009e90 tx=0x7fa258009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b99ef4447ef474e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:50.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.432+0000 7fa25f7fe700 1 -- 172.21.15.71:0/3605183052 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa25800e070 con 0x7fa2600b27f0 2023-10-06T01:42:50.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.432+0000 7fa25f7fe700 1 -- 172.21.15.71:0/3605183052 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa25800b870 con 0x7fa2600b27f0 2023-10-06T01:42:50.435 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.432+0000 7fa25f7fe700 1 -- 172.21.15.71:0/3605183052 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa24c001470 con 0x7fa2600b27f0 2023-10-06T01:42:50.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.432+0000 7fa266ae1700 1 -- 172.21.15.71:0/3605183052 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa2600b27f0 msgr2=0x7fa26015db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:50.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.432+0000 7fa266ae1700 1 --2- 172.21.15.71:0/3605183052 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa2600b27f0 0x7fa26015db70 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa258009e90 tx=0x7fa258009780 comp rx=0 tx=0).stop 2023-10-06T01:42:50.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.432+0000 7fa266ae1700 1 -- 172.21.15.71:0/3605183052 shutdown_connections 2023-10-06T01:42:50.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.432+0000 7fa266ae1700 1 --2- 172.21.15.71:0/3605183052 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa2600b27f0 0x7fa26015db70 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:50.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.432+0000 7fa266ae1700 1 -- 172.21.15.71:0/3605183052 >> 172.21.15.71:0/3605183052 conn(0x7fa260068680 msgr2=0x7fa260068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:50.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.432+0000 7fa266ae1700 1 -- 172.21.15.71:0/3605183052 shutdown_connections 2023-10-06T01:42:50.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.432+0000 7fa266ae1700 1 -- 172.21.15.71:0/3605183052 wait complete. 2023-10-06T01:42:50.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.433+0000 7fa266ae1700 1 Processor -- start 2023-10-06T01:42:50.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.434+0000 7fa266ae1700 1 -- start start 2023-10-06T01:42:50.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.434+0000 7fa266ae1700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa2600af4e0 0x7fa260150a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:50.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.434+0000 7fa266ae1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa2600af8b0 0x7fa26016a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:50.441 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.434+0000 7fa266ae1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa2600b27f0 0x7fa2600cbf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:50.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.434+0000 7fa266ae1700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2600c8e10 con 0x7fa2600af4e0 2023-10-06T01:42:50.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.434+0000 7fa266ae1700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa260150f50 con 0x7fa2600b27f0 2023-10-06T01:42:50.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.434+0000 7fa266ae1700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa26016aa50 con 0x7fa2600af8b0 2023-10-06T01:42:50.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.434+0000 7fa26487d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa2600af4e0 0x7fa260150a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:50.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.434+0000 7fa26487d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa2600af4e0 0x7fa260150a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41308/0 (socket says 172.21.15.71:41308) 2023-10-06T01:42:50.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.434+0000 7fa26487d700 1 -- 172.21.15.71:0/3293575597 learned_addr learned my addr 172.21.15.71:0/3293575597 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:50.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.435+0000 7fa25ffff700 1 --2- 172.21.15.71:0/3293575597 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa2600af8b0 0x7fa26016a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:50.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.435+0000 7fa26507e700 1 --2- 172.21.15.71:0/3293575597 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa2600b27f0 0x7fa2600cbf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:50.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.435+0000 7fa26487d700 1 -- 172.21.15.71:0/3293575597 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa2600af8b0 msgr2=0x7fa26016a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:50.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.435+0000 7fa26487d700 1 --2- 172.21.15.71:0/3293575597 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa2600af8b0 0x7fa26016a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:50.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.435+0000 7fa26487d700 1 -- 172.21.15.71:0/3293575597 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa2600b27f0 msgr2=0x7fa2600cbf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:50.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.435+0000 7fa26487d700 1 --2- 172.21.15.71:0/3293575597 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa2600b27f0 0x7fa2600cbf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:50.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.435+0000 7fa26487d700 1 -- 172.21.15.71:0/3293575597 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa258009a20 con 0x7fa2600af4e0 2023-10-06T01:42:50.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.435+0000 7fa26507e700 1 --2- 172.21.15.71:0/3293575597 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa2600b27f0 0x7fa2600cbf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:42:50.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.435+0000 7fa26487d700 1 --2- 172.21.15.71:0/3293575597 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa2600af4e0 0x7fa260150a10 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fa25400c580 tx=0x7fa254007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:50.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.435+0000 7fa25cff9700 1 -- 172.21.15.71:0/3293575597 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa254010510 con 0x7fa2600af4e0 2023-10-06T01:42:50.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.435+0000 7fa25cff9700 1 -- 172.21.15.71:0/3293575597 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa254010670 con 0x7fa2600af4e0 2023-10-06T01:42:50.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.435+0000 7fa266ae1700 1 -- 172.21.15.71:0/3293575597 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2600c8200 con 0x7fa2600af4e0 2023-10-06T01:42:50.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.435+0000 7fa25cff9700 1 -- 172.21.15.71:0/3293575597 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa254010a30 con 0x7fa2600af4e0 2023-10-06T01:42:50.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.435+0000 7fa266ae1700 1 -- 172.21.15.71:0/3293575597 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2600c87c0 con 0x7fa2600af4e0 2023-10-06T01:42:50.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.436+0000 7fa266ae1700 1 -- 172.21.15.71:0/3293575597 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa260088aa0 con 0x7fa2600af4e0 2023-10-06T01:42:50.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.436+0000 7fa25cff9700 1 -- 172.21.15.71:0/3293575597 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa25401b400 con 0x7fa2600af4e0 2023-10-06T01:42:50.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.437+0000 7fa25cff9700 1 --2- 172.21.15.71:0/3293575597 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fa244066f30 0x7fa2440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:50.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.437+0000 7fa25cff9700 1 -- 172.21.15.71:0/3293575597 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5698+0+0 (secure 0 0 0) 0x7fa254084180 con 0x7fa2600af4e0 2023-10-06T01:42:50.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.437+0000 7fa25ffff700 1 --2- 172.21.15.71:0/3293575597 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fa244066f30 0x7fa2440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:50.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.437+0000 7fa25ffff700 1 --2- 172.21.15.71:0/3293575597 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fa244066f30 0x7fa2440693e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fa260158900 tx=0x7fa24c0011a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:50.448 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.441+0000 7fa25cff9700 1 -- 172.21.15.71:0/3293575597 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa2540513f0 con 0x7fa2600af4e0 2023-10-06T01:42:50.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.627+0000 7fa266ae1700 1 -- 172.21.15.71:0/3293575597 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa2600cad20 con 0x7fa2600af4e0 2023-10-06T01:42:50.628 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.627+0000 7fa25cff9700 1 -- 172.21.15.71:0/3293575597 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+14064 (secure 0 0 0) 0x7fa254054a10 con 0x7fa2600af4e0 2023-10-06T01:42:50.628 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:42:50.628 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":61,"fsid":"1fbf1bd2-f9b4-4599-bea2-f4aa920e9a56","created":"2023-10-06T01:39:57.016957+0000","modified":"2023-10-06T01:42:47.318013+0000","last_up_change":"2023-10-06T01:40:08.571643+0000","last_in_change":"2023-10-06T01:39:59.462741+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T01:40:08.610349+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T01:40:15.387434+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"cf059188-fb20-4dbf-95db-dcf57b213d03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":90670},{"type":"v1","addr":"172.21.15.71:6817","nonce":90670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":90670},{"type":"v1","addr":"172.21.15.71:6819","nonce":90670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":90670},{"type":"v1","addr":"172.21.15.71:6823","nonce":90670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":90670},{"type":"v1","addr":"172.21.15.71:6821","nonce":90670}]},"public_addr":"172.21.15.71:6817/90670","cluster_addr":"172.21.15.71:6819/90670","heartbeat_back_addr":"172.21.15.71:6823/90670","heartbeat_front_addr":"172.21.15.71:6821/90670","state":["exists","up"]},{"osd":1,"uuid":"0cff0aae-1799-4fe0-b610-54cf0813c0e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":90669},{"type":"v1","addr":"172.21.15.71:6809","nonce":90669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":90669},{"type":"v1","addr":"172.21.15.71:6811","nonce":90669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":90669},{"type":"v1","addr":"172.21.15.71:6815","nonce":90669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":90669},{"type":"v1","addr":"172.21.15.71:6813","nonce":90669}]},"public_addr":"172.21.15.71:6809/90669","cluster_addr":"172.21.15.71:6811/90669","heartbeat_back_addr":"172.21.15.71:6815/90669","heartbeat_front_addr":"172.21.15.71:6813/90669","state":["exists","up"]},{"osd":2,"uuid":"88d61ddc-9031-44e1-ba8c-546a41e7c8ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":90679},{"type":"v1","addr":"172.21.15.71:6825","nonce":90679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":90679},{"type":"v1","addr":"172.21.15.71:6827","nonce":90679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":90679},{"type":"v1","addr":"172.21.15.71:6831","nonce":90679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":90679},{"type":"v1","addr":"172.21.15.71:6829","nonce":90679}]},"public_addr":"172.21.15.71:6825/90679","cluster_addr":"172.21.15.71:6827/90679","heartbeat_back_addr":"172.21.15.71:6831/90679","heartbeat_front_addr":"172.21.15.71:6829/90679","state":["exists","up"]},{"osd":3,"uuid":"11ed92b7-960b-4a30-a889-a61d3eeb86f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":90668},{"type":"v1","addr":"172.21.15.71:6801","nonce":90668}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":90668},{"type":"v1","addr":"172.21.15.71:6803","nonce":90668}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":90668},{"type":"v1","addr":"172.21.15.71:6807","nonce":90668}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":90668},{"type":"v1","addr":"172.21.15.71:6805","nonce":90668}]},"public_addr":"172.21.15.71:6801/90668","cluster_addr":"172.21.15.71:6803/90668","heartbeat_back_addr":"172.21.15.71:6807/90668","heartbeat_front_addr":"172.21.15.71:6805/90668","state":["exists","up"]},{"osd":4,"uuid":"ae4df784-abdf-4ddf-aefa-780f3ddafef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":90917},{"type":"v1","addr":"172.21.15.72:6801","nonce":90917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":90917},{"type":"v1","addr":"172.21.15.72:6803","nonce":90917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":90917},{"type":"v1","addr":"172.21.15.72:6807","nonce":90917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":90917},{"type":"v1","addr":"172.21.15.72:6805","nonce":90917}]},"public_addr":"172.21.15.72:6801/90917","cluster_addr":"172.21.15.72:6803/90917","heartbeat_back_addr":"172.21.15.72:6807/90917","heartbeat_front_addr":"172.21.15.72:6805/90917","state":["exists","up"]},{"osd":5,"uuid":"5ef0790f-001e-458f-a05b-efae216cf435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":90941},{"type":"v1","addr":"172.21.15.72:6817","nonce":90941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":90941},{"type":"v1","addr":"172.21.15.72:6819","nonce":90941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6825","nonce":90941},{"type":"v1","addr":"172.21.15.72:6827","nonce":90941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":90941},{"type":"v1","addr":"172.21.15.72:6823","nonce":90941}]},"public_addr":"172.21.15.72:6817/90941","cluster_addr":"172.21.15.72:6819/90941","heartbeat_back_addr":"172.21.15.72:6827/90941","heartbeat_front_addr":"172.21.15.72:6823/90941","state":["exists","up"]},{"osd":6,"uuid":"8705aef1-9ae8-4e54-a3c4-c2909fa0ceb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":90918},{"type":"v1","addr":"172.21.15.72:6809","nonce":90918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":90918},{"type":"v1","addr":"172.21.15.72:6811","nonce":90918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":90918},{"type":"v1","addr":"172.21.15.72:6815","nonce":90918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":90918},{"type":"v1","addr":"172.21.15.72:6813","nonce":90918}]},"public_addr":"172.21.15.72:6809/90918","cluster_addr":"172.21.15.72:6811/90918","heartbeat_back_addr":"172.21.15.72:6815/90918","heartbeat_front_addr":"172.21.15.72:6813/90918","state":["exists","up"]},{"osd":7,"uuid":"364c5119-6b13-4c75-b3f0-15e165eff86a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":90948},{"type":"v1","addr":"172.21.15.72:6822","nonce":90948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":90948},{"type":"v1","addr":"172.21.15.72:6826","nonce":90948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":90948},{"type":"v1","addr":"172.21.15.72:6831","nonce":90948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":90948},{"type":"v1","addr":"172.21.15.72:6829","nonce":90948}]},"public_addr":"172.21.15.72:6822/90948","cluster_addr":"172.21.15.72:6826/90948","heartbeat_back_addr":"172.21.15.72:6831/90948","heartbeat_front_addr":"172.21.15.72:6829/90948","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.642976+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.645372+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.619116+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.663042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.599163+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.646411+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.631545+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:40:04.669821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.71:6837/2318258263":"2023-10-07T01:42:44.309559+0000","172.21.15.71:6836/2318258263":"2023-10-07T01:42:44.309559+0000","172.21.15.72:6835/627948818":"2023-10-07T01:42:34.014707+0000","172.21.15.72:6833/627948818":"2023-10-07T01:42:34.014707+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:42:50.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.630+0000 7fa266ae1700 1 -- 172.21.15.71:0/3293575597 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fa244066f30 msgr2=0x7fa2440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:50.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.630+0000 7fa266ae1700 1 --2- 172.21.15.71:0/3293575597 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fa244066f30 0x7fa2440693e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fa260158900 tx=0x7fa24c0011a0 comp rx=0 tx=0).stop 2023-10-06T01:42:50.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.630+0000 7fa266ae1700 1 -- 172.21.15.71:0/3293575597 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa2600af4e0 msgr2=0x7fa260150a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:50.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.630+0000 7fa266ae1700 1 --2- 172.21.15.71:0/3293575597 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa2600af4e0 0x7fa260150a10 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fa25400c580 tx=0x7fa254007e10 comp rx=0 tx=0).stop 2023-10-06T01:42:50.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.630+0000 7fa266ae1700 1 -- 172.21.15.71:0/3293575597 shutdown_connections 2023-10-06T01:42:50.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.630+0000 7fa266ae1700 1 --2- 172.21.15.71:0/3293575597 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fa244066f30 0x7fa2440693e0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:50.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.630+0000 7fa266ae1700 1 --2- 172.21.15.71:0/3293575597 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa2600b27f0 0x7fa2600cbf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:50.631 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.630+0000 7fa266ae1700 1 --2- 172.21.15.71:0/3293575597 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa2600af4e0 0x7fa260150a10 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:50.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.630+0000 7fa266ae1700 1 --2- 172.21.15.71:0/3293575597 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa2600af8b0 0x7fa26016a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:50.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.630+0000 7fa266ae1700 1 -- 172.21.15.71:0/3293575597 >> 172.21.15.71:0/3293575597 conn(0x7fa260068680 msgr2=0x7fa2600b5560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:50.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.630+0000 7fa266ae1700 1 -- 172.21.15.71:0/3293575597 shutdown_connections 2023-10-06T01:42:50.632 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:50.630+0000 7fa266ae1700 1 -- 172.21.15.71:0/3293575597 wait complete. 2023-10-06T01:42:51.644 INFO:tasks.ceph:Scrubbing osd.0 2023-10-06T01:42:51.644 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-10-06T01:42:51.663 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T01:42:51.690 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T01:42:51.771 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.771+0000 7f9c1f541700 1 Processor -- start 2023-10-06T01:42:51.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.771+0000 7f9c1f541700 1 -- start start 2023-10-06T01:42:51.774 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.772+0000 7f9c1f541700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9c180b5d70 0x7f9c181593a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:51.774 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.772+0000 7f9c1f541700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9c180ce5d0 0x7f9c180ce9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:51.774 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.772+0000 7f9c1f541700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c180cf400 con 0x7f9c180b59a0 2023-10-06T01:42:51.774 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.772+0000 7f9c1f541700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c180cf6e0 con 0x7f9c180b5d70 2023-10-06T01:42:51.775 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.772+0000 7f9c1f541700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c180cf9c0 con 0x7f9c180ce5d0 2023-10-06T01:42:51.775 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.772+0000 7f9c1e53f700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f9c180b59a0 0x7f9c18158c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:53462/0 (socket says 172.21.15.71:53462) 2023-10-06T01:42:51.775 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.772+0000 7f9c1dd3e700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f9c180b5d70 0x7f9c181593a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:51.775 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.772+0000 7f9c1e53f700 1 -- 172.21.15.71:0/3015977858 learned_addr learned my addr 172.21.15.71:0/3015977858 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:42:51.775 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.772+0000 7f9c1ed40700 1 --2- 172.21.15.71:0/3015977858 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9c180ce5d0 0x7f9c180ce9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:51.775 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.772+0000 7f9c1dd3e700 1 -- 172.21.15.71:0/3015977858 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9c180ce5d0 msgr2=0x7f9c180ce9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:51.775 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.772+0000 7f9c1dd3e700 1 --2- 172.21.15.71:0/3015977858 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9c180ce5d0 0x7f9c180ce9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:51.775 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.772+0000 7f9c1dd3e700 1 -- 172.21.15.71:0/3015977858 >> v1:172.21.15.71:6789/0 conn(0x7f9c180b59a0 legacy=0x7f9c18158c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:51.775 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.772+0000 7f9c1dd3e700 1 -- 172.21.15.71:0/3015977858 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c180cfca0 con 0x7f9c180b5d70 2023-10-06T01:42:51.775 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.772+0000 7f9c1d53d700 1 -- 172.21.15.71:0/3015977858 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 404003242 0 0) 0x7f9c180cf400 con 0x7f9c180b59a0 2023-10-06T01:42:51.775 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.773+0000 7f9c1dd3e700 1 --2- 172.21.15.71:0/3015977858 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9c180b5d70 0x7f9c181593a0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f9c080098e0 tx=0x7f9c080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=813248649396aa9e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:51.775 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.773+0000 7f9c1d53d700 1 -- 172.21.15.71:0/3015977858 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c08009e80 con 0x7f9c180b5d70 2023-10-06T01:42:51.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.773+0000 7f9c1d53d700 1 -- 172.21.15.71:0/3015977858 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c0800b860 con 0x7f9c180b5d70 2023-10-06T01:42:51.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.773+0000 7f9c1d53d700 1 -- 172.21.15.71:0/3015977858 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c0800bbe0 con 0x7f9c180b5d70 2023-10-06T01:42:51.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.773+0000 7f9c1f541700 1 -- 172.21.15.71:0/3015977858 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9c180b5d70 msgr2=0x7f9c181593a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:51.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.773+0000 7f9c1f541700 1 --2- 172.21.15.71:0/3015977858 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9c180b5d70 0x7f9c181593a0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f9c080098e0 tx=0x7f9c080091a0 comp rx=0 tx=0).stop 2023-10-06T01:42:51.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.773+0000 7f9c1f541700 1 -- 172.21.15.71:0/3015977858 shutdown_connections 2023-10-06T01:42:51.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.773+0000 7f9c1f541700 1 --2- 172.21.15.71:0/3015977858 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9c180ce5d0 0x7f9c180ce9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:51.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.773+0000 7f9c1f541700 1 --2- 172.21.15.71:0/3015977858 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9c180b5d70 0x7f9c181593a0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:51.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.773+0000 7f9c1f541700 1 -- 172.21.15.71:0/3015977858 >> 172.21.15.71:0/3015977858 conn(0x7f9c18069150 msgr2=0x7f9c180b1b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:51.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.773+0000 7f9c1f541700 1 -- 172.21.15.71:0/3015977858 shutdown_connections 2023-10-06T01:42:51.776 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.773+0000 7f9c1f541700 1 -- 172.21.15.71:0/3015977858 wait complete. 2023-10-06T01:42:51.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.774+0000 7f9c1f541700 1 Processor -- start 2023-10-06T01:42:51.779 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.774+0000 7f9c1f541700 1 -- start start 2023-10-06T01:42:51.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.775+0000 7f9c1f541700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9c180b59a0 0x7f9c18143830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:51.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.775+0000 7f9c1f541700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c180b5d70 0x7f9c1815ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:51.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.775+0000 7f9c1f541700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9c180ce5d0 0x7f9c1815d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:51.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.775+0000 7f9c1f541700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c180a9ca0 con 0x7f9c180b59a0 2023-10-06T01:42:51.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.775+0000 7f9c1f541700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c180aa130 con 0x7f9c180b5d70 2023-10-06T01:42:51.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.775+0000 7f9c1f541700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c180a9090 con 0x7f9c180ce5d0 2023-10-06T01:42:51.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.775+0000 7f9c1e53f700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9c180b59a0 0x7f9c18143830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:51.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.775+0000 7f9c1e53f700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9c180b59a0 0x7f9c18143830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41332/0 (socket says 172.21.15.71:41332) 2023-10-06T01:42:51.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.775+0000 7f9c1e53f700 1 -- 172.21.15.71:0/128660699 learned_addr learned my addr 172.21.15.71:0/128660699 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:51.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.775+0000 7f9c1dd3e700 1 --2- 172.21.15.71:0/128660699 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c180b5d70 0x7f9c1815ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:51.780 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.775+0000 7f9c1e53f700 1 -- 172.21.15.71:0/128660699 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9c180ce5d0 msgr2=0x7f9c1815d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:51.781 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.775+0000 7f9c1e53f700 1 --2- 172.21.15.71:0/128660699 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9c180ce5d0 0x7f9c1815d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:51.781 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.775+0000 7f9c1e53f700 1 -- 172.21.15.71:0/128660699 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c180b5d70 msgr2=0x7f9c1815ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:51.781 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.775+0000 7f9c1e53f700 1 --2- 172.21.15.71:0/128660699 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c180b5d70 0x7f9c1815ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:51.781 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.775+0000 7f9c1e53f700 1 -- 172.21.15.71:0/128660699 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c08009420 con 0x7f9c180b59a0 2023-10-06T01:42:51.781 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.776+0000 7f9c1e53f700 1 --2- 172.21.15.71:0/128660699 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9c180b59a0 0x7f9c18143830 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f9c1400c7e0 tx=0x7f9c14007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:51.781 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.776+0000 7f9c0e7fc700 1 -- 172.21.15.71:0/128660699 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c14005b30 con 0x7f9c180b59a0 2023-10-06T01:42:51.781 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.776+0000 7f9c0e7fc700 1 -- 172.21.15.71:0/128660699 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c14005c90 con 0x7f9c180b59a0 2023-10-06T01:42:51.781 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.776+0000 7f9c1f541700 1 -- 172.21.15.71:0/128660699 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c180a9370 con 0x7f9c180b59a0 2023-10-06T01:42:51.781 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.776+0000 7f9c0e7fc700 1 -- 172.21.15.71:0/128660699 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c14007300 con 0x7f9c180b59a0 2023-10-06T01:42:51.781 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.776+0000 7f9c1f541700 1 -- 172.21.15.71:0/128660699 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c180a9930 con 0x7f9c180b59a0 2023-10-06T01:42:51.781 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.776+0000 7f9c1f541700 1 -- 172.21.15.71:0/128660699 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9c18088650 con 0x7f9c180b59a0 2023-10-06T01:42:51.781 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.777+0000 7f9c0e7fc700 1 -- 172.21.15.71:0/128660699 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9c14025430 con 0x7f9c180b59a0 2023-10-06T01:42:51.782 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.777+0000 7f9c0e7fc700 1 --2- 172.21.15.71:0/128660699 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f9bfc066f30 0x7f9bfc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:51.782 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.777+0000 7f9c0e7fc700 1 -- 172.21.15.71:0/128660699 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f9c14084b60 con 0x7f9c180b59a0 2023-10-06T01:42:51.782 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.778+0000 7f9c1dd3e700 1 --2- 172.21.15.71:0/128660699 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f9bfc066f30 0x7f9bfc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:51.782 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.778+0000 7f9c0e7fc700 1 --2- 172.21.15.71:0/128660699 >> [v2:172.21.15.71:6816/90670,v1:172.21.15.71:6817/90670] conn(0x7f9bfc06d8f0 0x7f9bfc06fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:51.782 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.778+0000 7f9c0e7fc700 1 -- 172.21.15.71:0/128660699 --> [v2:172.21.15.71:6816/90670,v1:172.21.15.71:6817/90670] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9bfc0703f0 con 0x7f9bfc06d8f0 2023-10-06T01:42:51.782 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.778+0000 7f9c0e7fc700 1 -- 172.21.15.71:0/128660699 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_get_version_reply(handle=1 version=61) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9c14084f30 con 0x7f9c180b59a0 2023-10-06T01:42:51.782 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.778+0000 7f9c1ed40700 1 --2- 172.21.15.71:0/128660699 >> [v2:172.21.15.71:6816/90670,v1:172.21.15.71:6817/90670] conn(0x7f9bfc06d8f0 0x7f9bfc06fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:51.782 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.778+0000 7f9c1dd3e700 1 --2- 172.21.15.71:0/128660699 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f9bfc066f30 0x7f9bfc0693e0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f9c180aa3c0 tx=0x7f9c08017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:51.782 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.778+0000 7f9c1ed40700 1 --2- 172.21.15.71:0/128660699 >> [v2:172.21.15.71:6816/90670,v1:172.21.15.71:6817/90670] conn(0x7f9bfc06d8f0 0x7f9bfc06fd20 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:51.782 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.779+0000 7f9c0e7fc700 1 -- 172.21.15.71:0/128660699 <== osd.0 v2:172.21.15.71:6816/90670 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f9bfc0703f0 con 0x7f9bfc06d8f0 2023-10-06T01:42:51.793 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.792+0000 7f9c1f541700 1 -- 172.21.15.71:0/128660699 --> [v2:172.21.15.71:6816/90670,v1:172.21.15.71:6817/90670] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f9c18068420 con 0x7f9bfc06d8f0 2023-10-06T01:42:51.793 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.792+0000 7f9c0e7fc700 1 -- 172.21.15.71:0/128660699 <== osd.0 v2:172.21.15.71:6816/90670 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f9c18068420 con 0x7f9bfc06d8f0 2023-10-06T01:42:51.793 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2023-10-06T01:42:51.793 INFO:teuthology.orchestra.run.smithi071.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T01:42:51.793 INFO:teuthology.orchestra.run.smithi071.stdout:} 2023-10-06T01:42:51.794 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.793+0000 7f9c1f541700 1 -- 172.21.15.71:0/128660699 >> [v2:172.21.15.71:6816/90670,v1:172.21.15.71:6817/90670] conn(0x7f9bfc06d8f0 msgr2=0x7f9bfc06fd20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:51.794 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.793+0000 7f9c1f541700 1 --2- 172.21.15.71:0/128660699 >> [v2:172.21.15.71:6816/90670,v1:172.21.15.71:6817/90670] conn(0x7f9bfc06d8f0 0x7f9bfc06fd20 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:51.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.793+0000 7f9c1f541700 1 -- 172.21.15.71:0/128660699 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f9bfc066f30 msgr2=0x7f9bfc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:51.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.793+0000 7f9c1f541700 1 --2- 172.21.15.71:0/128660699 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f9bfc066f30 0x7f9bfc0693e0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f9c180aa3c0 tx=0x7f9c08017000 comp rx=0 tx=0).stop 2023-10-06T01:42:51.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.793+0000 7f9c1f541700 1 -- 172.21.15.71:0/128660699 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9c180b59a0 msgr2=0x7f9c18143830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:51.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.793+0000 7f9c1f541700 1 --2- 172.21.15.71:0/128660699 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9c180b59a0 0x7f9c18143830 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f9c1400c7e0 tx=0x7f9c14007df0 comp rx=0 tx=0).stop 2023-10-06T01:42:51.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.793+0000 7f9c1ed40700 1 -- 172.21.15.71:0/128660699 reap_dead start 2023-10-06T01:42:51.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.793+0000 7f9c1f541700 1 -- 172.21.15.71:0/128660699 shutdown_connections 2023-10-06T01:42:51.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.793+0000 7f9c1f541700 1 -- 172.21.15.71:0/128660699 >> 172.21.15.71:0/128660699 conn(0x7f9c18069150 msgr2=0x7f9c18155d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:51.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.793+0000 7f9c1f541700 1 -- 172.21.15.71:0/128660699 shutdown_connections 2023-10-06T01:42:51.795 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.793+0000 7f9c1f541700 1 -- 172.21.15.71:0/128660699 wait complete. 2023-10-06T01:42:51.805 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-10-06T01:42:51.960 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.959+0000 7f5ab6044700 1 Processor -- start 2023-10-06T01:42:51.960 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.959+0000 7f5ab6044700 1 -- start start 2023-10-06T01:42:51.962 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.960+0000 7f5ab6044700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f5ab015a030 0x7f5ab015a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:51.962 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.960+0000 7f5ab6044700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ab00afc50 con 0x7f5ab015a940 2023-10-06T01:42:51.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.960+0000 7f5ab6044700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ab00aff30 con 0x7f5ab0087700 2023-10-06T01:42:51.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.960+0000 7f5ab6044700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ab00b0cf0 con 0x7f5ab015a030 2023-10-06T01:42:51.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.960+0000 7f5aaf7fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f5ab015a030 0x7f5ab015a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:51.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.960+0000 7f5aaf7fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f5ab015a030 0x7f5ab015a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41348/0 (socket says 172.21.15.71:41348) 2023-10-06T01:42:51.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.960+0000 7f5aaeffd700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f5ab015a940 0x7f5ab0086ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:53470/0 (socket says 172.21.15.71:53470) 2023-10-06T01:42:51.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.960+0000 7f5aaf7fe700 1 -- 172.21.15.71:0/2996048326 learned_addr learned my addr 172.21.15.71:0/2996048326 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:51.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.960+0000 7f5aaf7fe700 1 -- 172.21.15.71:0/2996048326 >> v1:172.21.15.72:6789/0 conn(0x7f5ab0087700 legacy=0x7f5ab00b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:51.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.960+0000 7f5aaf7fe700 1 -- 172.21.15.71:0/2996048326 >> v1:172.21.15.71:6789/0 conn(0x7f5ab015a940 legacy=0x7f5ab0086ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:51.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.960+0000 7f5aaf7fe700 1 -- 172.21.15.71:0/2996048326 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ab00b0210 con 0x7f5ab015a030 2023-10-06T01:42:51.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.961+0000 7f5aaf7fe700 1 --2- 172.21.15.71:0/2996048326 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ab015a030 0x7f5ab015a400 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f5aa0009f20 tx=0x7f5aa0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daa73f65c9ccf642 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:51.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.961+0000 7f5aae7fc700 1 -- 172.21.15.71:0/2996048326 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa000e070 con 0x7f5ab015a030 2023-10-06T01:42:51.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.961+0000 7f5aae7fc700 1 -- 172.21.15.71:0/2996048326 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aa000ba80 con 0x7f5ab015a030 2023-10-06T01:42:51.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.961+0000 7f5aae7fc700 1 -- 172.21.15.71:0/2996048326 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa00092e0 con 0x7f5ab015a030 2023-10-06T01:42:51.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.961+0000 7f5ab6044700 1 -- 172.21.15.71:0/2996048326 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ab015a030 msgr2=0x7f5ab015a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:51.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.961+0000 7f5ab6044700 1 --2- 172.21.15.71:0/2996048326 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ab015a030 0x7f5ab015a400 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f5aa0009f20 tx=0x7f5aa0009840 comp rx=0 tx=0).stop 2023-10-06T01:42:51.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.961+0000 7f5ab6044700 1 -- 172.21.15.71:0/2996048326 shutdown_connections 2023-10-06T01:42:51.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.961+0000 7f5ab6044700 1 --2- 172.21.15.71:0/2996048326 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ab015a030 0x7f5ab015a400 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:51.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.961+0000 7f5ab6044700 1 -- 172.21.15.71:0/2996048326 >> 172.21.15.71:0/2996048326 conn(0x7f5ab0068680 msgr2=0x7f5ab0068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:51.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.961+0000 7f5ab6044700 1 -- 172.21.15.71:0/2996048326 shutdown_connections 2023-10-06T01:42:51.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.961+0000 7f5ab6044700 1 -- 172.21.15.71:0/2996048326 wait complete. 2023-10-06T01:42:51.967 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.963+0000 7f5ab6044700 1 Processor -- start 2023-10-06T01:42:51.967 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.963+0000 7f5ab6044700 1 -- start start 2023-10-06T01:42:51.967 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.963+0000 7f5ab6044700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5ab0087700 0x7f5ab0156830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:51.967 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.963+0000 7f5ab6044700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ab015a030 0x7f5ab00c3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:51.967 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.963+0000 7f5ab6044700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ab015a940 0x7f5ab00cc870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:51.967 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.963+0000 7f5ab6044700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab00c5220 con 0x7f5ab015a940 2023-10-06T01:42:51.967 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.963+0000 7f5ab6044700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab00c46a0 con 0x7f5ab015a030 2023-10-06T01:42:51.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.963+0000 7f5ab6044700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab00c4980 con 0x7f5ab0087700 2023-10-06T01:42:51.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.963+0000 7f5aaffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ab015a940 0x7f5ab00cc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:51.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.963+0000 7f5aaffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ab015a940 0x7f5ab00cc870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41356/0 (socket says 172.21.15.71:41356) 2023-10-06T01:42:51.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.963+0000 7f5aaffff700 1 -- 172.21.15.71:0/804137964 learned_addr learned my addr 172.21.15.71:0/804137964 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:51.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.964+0000 7f5aaeffd700 1 --2- 172.21.15.71:0/804137964 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ab015a030 0x7f5ab00c3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:51.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.964+0000 7f5aaffff700 1 -- 172.21.15.71:0/804137964 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5ab0087700 msgr2=0x7f5ab0156830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:51.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.964+0000 7f5aaffff700 1 --2- 172.21.15.71:0/804137964 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5ab0087700 0x7f5ab0156830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:51.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.964+0000 7f5aaffff700 1 -- 172.21.15.71:0/804137964 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ab015a030 msgr2=0x7f5ab00c3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:51.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.964+0000 7f5aaffff700 1 --2- 172.21.15.71:0/804137964 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ab015a030 0x7f5ab00c3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:51.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.964+0000 7f5aaffff700 1 -- 172.21.15.71:0/804137964 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aa0009ae0 con 0x7f5ab015a940 2023-10-06T01:42:51.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.964+0000 7f5aaeffd700 1 --2- 172.21.15.71:0/804137964 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ab015a030 0x7f5ab00c3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:42:51.968 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.964+0000 7f5aaffff700 1 --2- 172.21.15.71:0/804137964 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ab015a940 0x7f5ab00cc870 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f5aa800c560 tx=0x7f5aa8007e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:51.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.964+0000 7f5a977fe700 1 -- 172.21.15.71:0/804137964 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa8011590 con 0x7f5ab015a940 2023-10-06T01:42:51.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.964+0000 7f5a977fe700 1 -- 172.21.15.71:0/804137964 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aa80116f0 con 0x7f5ab015a940 2023-10-06T01:42:51.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.964+0000 7f5ab6044700 1 -- 172.21.15.71:0/804137964 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ab00c4c60 con 0x7f5ab015a940 2023-10-06T01:42:51.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.964+0000 7f5a977fe700 1 -- 172.21.15.71:0/804137964 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa8011ab0 con 0x7f5ab015a940 2023-10-06T01:42:51.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.964+0000 7f5ab6044700 1 -- 172.21.15.71:0/804137964 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ab00c5df0 con 0x7f5ab015a940 2023-10-06T01:42:51.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.965+0000 7f5ab6044700 1 -- 172.21.15.71:0/804137964 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ab00c7380 con 0x7f5ab015a940 2023-10-06T01:42:51.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.965+0000 7f5a977fe700 1 -- 172.21.15.71:0/804137964 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5aa801b3b0 con 0x7f5ab015a940 2023-10-06T01:42:51.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.966+0000 7f5a977fe700 1 --2- 172.21.15.71:0/804137964 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f5a9c066f30 0x7f5a9c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:51.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.966+0000 7f5a977fe700 1 -- 172.21.15.71:0/804137964 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f5aa8083910 con 0x7f5ab015a940 2023-10-06T01:42:51.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.966+0000 7f5aaf7fe700 1 --2- 172.21.15.71:0/804137964 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f5a9c066f30 0x7f5a9c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:51.969 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.966+0000 7f5aaf7fe700 1 --2- 172.21.15.71:0/804137964 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f5a9c066f30 0x7f5a9c0693e0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f5aa0009880 tx=0x7f5aa0018000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:51.970 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:51.970+0000 7f5a977fe700 1 -- 172.21.15.71:0/804137964 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5aa8050b80 con 0x7f5ab015a940 2023-10-06T01:42:52.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.154+0000 7f5ab6044700 1 -- 172.21.15.71:0/804137964 --> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f5ab00b04f0 con 0x7f5a9c066f30 2023-10-06T01:42:52.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.154+0000 7f5a977fe700 1 -- 172.21.15.71:0/804137964 <== mgr.4107 v2:172.21.15.71:6832/90436 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f5ab00b04f0 con 0x7f5a9c066f30 2023-10-06T01:42:52.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.156+0000 7f5ab6044700 1 -- 172.21.15.71:0/804137964 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f5a9c066f30 msgr2=0x7f5a9c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:52.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.156+0000 7f5ab6044700 1 --2- 172.21.15.71:0/804137964 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f5a9c066f30 0x7f5a9c0693e0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f5aa0009880 tx=0x7f5aa0018000 comp rx=0 tx=0).stop 2023-10-06T01:42:52.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.156+0000 7f5ab6044700 1 -- 172.21.15.71:0/804137964 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ab015a940 msgr2=0x7f5ab00cc870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:52.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.156+0000 7f5ab6044700 1 --2- 172.21.15.71:0/804137964 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ab015a940 0x7f5ab00cc870 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f5aa800c560 tx=0x7f5aa8007e90 comp rx=0 tx=0).stop 2023-10-06T01:42:52.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.156+0000 7f5ab6044700 1 -- 172.21.15.71:0/804137964 shutdown_connections 2023-10-06T01:42:52.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.156+0000 7f5ab6044700 1 --2- 172.21.15.71:0/804137964 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ab015a940 0x7f5ab00cc870 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:52.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.156+0000 7f5ab6044700 1 --2- 172.21.15.71:0/804137964 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5ab0087700 0x7f5ab0156830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:52.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.156+0000 7f5ab6044700 1 --2- 172.21.15.71:0/804137964 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f5a9c066f30 0x7f5a9c0693e0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:52.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.156+0000 7f5ab6044700 1 --2- 172.21.15.71:0/804137964 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ab015a030 0x7f5ab00c3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:52.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.156+0000 7f5ab6044700 1 -- 172.21.15.71:0/804137964 >> 172.21.15.71:0/804137964 conn(0x7f5ab0068680 msgr2=0x7f5ab00b50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:52.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.156+0000 7f5ab6044700 1 -- 172.21.15.71:0/804137964 shutdown_connections 2023-10-06T01:42:52.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.156+0000 7f5ab6044700 1 -- 172.21.15.71:0/804137964 wait complete. 2023-10-06T01:42:52.158 INFO:teuthology.orchestra.run.smithi071.stderr:instructed osd(s) 0 to deep-scrub 2023-10-06T01:42:52.168 INFO:tasks.ceph:Scrubbing osd.1 2023-10-06T01:42:52.169 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-10-06T01:42:52.287 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.286+0000 7f682e11e700 1 Processor -- start 2023-10-06T01:42:52.287 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.286+0000 7f682e11e700 1 -- start start 2023-10-06T01:42:52.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.287+0000 7f682e11e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6828155f80 0x7f68280b0810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:52.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.287+0000 7f682e11e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6828156350 0x7f68280aecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:52.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.287+0000 7f682e11e700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f68280af1f0 0x7f68280b0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:52.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.287+0000 7f682e11e700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68280af770 con 0x7f68280af1f0 2023-10-06T01:42:52.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.287+0000 7f682e11e700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68280afa50 con 0x7f6828156350 2023-10-06T01:42:52.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.287+0000 7f682e11e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68280afd30 con 0x7f6828155f80 2023-10-06T01:42:52.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.287+0000 7f6827fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f68280af1f0 0x7f68280b0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:52.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.287+0000 7f6827fff700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f68280af1f0 0x7f68280b0fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41360/0 (socket says 172.21.15.71:41360) 2023-10-06T01:42:52.290 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.287+0000 7f6827fff700 1 -- 172.21.15.71:0/4236805135 learned_addr learned my addr 172.21.15.71:0/4236805135 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:52.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.288+0000 7f6826ffd700 1 --2- 172.21.15.71:0/4236805135 >> v2:172.21.15.72:3300/0 conn(0x7f6828156350 0x7f68280aecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:52.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.288+0000 7f68277fe700 1 --2- 172.21.15.71:0/4236805135 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6828155f80 0x7f68280b0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:52.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.288+0000 7f6827fff700 1 -- 172.21.15.71:0/4236805135 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6828155f80 msgr2=0x7f68280b0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:52.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.288+0000 7f6827fff700 1 --2- 172.21.15.71:0/4236805135 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6828155f80 0x7f68280b0810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:52.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.288+0000 7f6827fff700 1 -- 172.21.15.71:0/4236805135 >> v2:172.21.15.72:3300/0 conn(0x7f6828156350 msgr2=0x7f68280aecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:52.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.288+0000 7f6827fff700 1 --2- 172.21.15.71:0/4236805135 >> v2:172.21.15.72:3300/0 conn(0x7f6828156350 0x7f68280aecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:52.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.288+0000 7f6827fff700 1 -- 172.21.15.71:0/4236805135 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68280b0010 con 0x7f68280af1f0 2023-10-06T01:42:52.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.288+0000 7f68277fe700 1 --2- 172.21.15.71:0/4236805135 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6828155f80 0x7f68280b0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:42:52.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.288+0000 7f6827fff700 1 --2- 172.21.15.71:0/4236805135 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68280af1f0 0x7f68280b0fe0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f682806dd00 tx=0x7f6820009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb9a06c5ac0066ec server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:52.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.288+0000 7f68267fc700 1 -- 172.21.15.71:0/4236805135 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f682000e070 con 0x7f68280af1f0 2023-10-06T01:42:52.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.288+0000 7f68267fc700 1 -- 172.21.15.71:0/4236805135 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f682000ba50 con 0x7f68280af1f0 2023-10-06T01:42:52.291 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.288+0000 7f68267fc700 1 -- 172.21.15.71:0/4236805135 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68200092e0 con 0x7f68280af1f0 2023-10-06T01:42:52.292 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.289+0000 7f682e11e700 1 -- 172.21.15.71:0/4236805135 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68280af1f0 msgr2=0x7f68280b0fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:52.292 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.289+0000 7f682e11e700 1 --2- 172.21.15.71:0/4236805135 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68280af1f0 0x7f68280b0fe0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f682806dd00 tx=0x7f6820009840 comp rx=0 tx=0).stop 2023-10-06T01:42:52.292 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.289+0000 7f682e11e700 1 -- 172.21.15.71:0/4236805135 shutdown_connections 2023-10-06T01:42:52.292 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.289+0000 7f682e11e700 1 --2- 172.21.15.71:0/4236805135 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68280af1f0 0x7f68280b0fe0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:52.292 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.289+0000 7f682e11e700 1 --2- 172.21.15.71:0/4236805135 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6828155f80 0x7f68280b0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:52.292 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.289+0000 7f682e11e700 1 --2- 172.21.15.71:0/4236805135 >> v2:172.21.15.72:3300/0 conn(0x7f6828156350 0x7f68280aecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:52.292 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.289+0000 7f682e11e700 1 -- 172.21.15.71:0/4236805135 >> 172.21.15.71:0/4236805135 conn(0x7f68280cbef0 msgr2=0x7f68280cc2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:52.292 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.289+0000 7f682e11e700 1 -- 172.21.15.71:0/4236805135 shutdown_connections 2023-10-06T01:42:52.292 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.289+0000 7f682e11e700 1 -- 172.21.15.71:0/4236805135 wait complete. 2023-10-06T01:42:52.295 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.290+0000 7f682e11e700 1 Processor -- start 2023-10-06T01:42:52.295 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.290+0000 7f682e11e700 1 -- start start 2023-10-06T01:42:52.295 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.291+0000 7f682e11e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68280af1f0 0x7f6828152ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:52.295 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.291+0000 7f682e11e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6828155f80 0x7f68280aac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:52.296 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.291+0000 7f682e11e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6828156350 0x7f682814e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:52.296 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.291+0000 7f682e11e700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6828148ea0 con 0x7f6828156350 2023-10-06T01:42:52.296 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.291+0000 7f682e11e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6828145300 con 0x7f68280af1f0 2023-10-06T01:42:52.296 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.291+0000 7f682e11e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68280ab1b0 con 0x7f6828155f80 2023-10-06T01:42:52.296 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.291+0000 7f6827fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6828156350 0x7f682814e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:52.296 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.291+0000 7f6827fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6828156350 0x7f682814e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41366/0 (socket says 172.21.15.71:41366) 2023-10-06T01:42:52.296 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.291+0000 7f6827fff700 1 -- 172.21.15.71:0/3001566288 learned_addr learned my addr 172.21.15.71:0/3001566288 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:52.296 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.291+0000 7f68277fe700 1 --2- 172.21.15.71:0/3001566288 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68280af1f0 0x7f6828152ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:52.296 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.291+0000 7f6826ffd700 1 --2- 172.21.15.71:0/3001566288 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6828155f80 0x7f68280aac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:52.296 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.291+0000 7f6827fff700 1 -- 172.21.15.71:0/3001566288 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6828155f80 msgr2=0x7f68280aac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:52.296 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.291+0000 7f6827fff700 1 --2- 172.21.15.71:0/3001566288 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6828155f80 0x7f68280aac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:52.296 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.291+0000 7f6827fff700 1 -- 172.21.15.71:0/3001566288 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68280af1f0 msgr2=0x7f6828152ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:52.297 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.291+0000 7f6827fff700 1 --2- 172.21.15.71:0/3001566288 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68280af1f0 0x7f6828152ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:52.297 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.291+0000 7f6827fff700 1 -- 172.21.15.71:0/3001566288 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6820009ae0 con 0x7f6828156350 2023-10-06T01:42:52.297 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.291+0000 7f68277fe700 1 --2- 172.21.15.71:0/3001566288 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68280af1f0 0x7f6828152ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:42:52.297 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.291+0000 7f6827fff700 1 --2- 172.21.15.71:0/3001566288 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6828156350 0x7f682814e920 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f6820007940 tx=0x7f6820018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:52.297 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.291+0000 7f680f7fe700 1 -- 172.21.15.71:0/3001566288 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6820007e90 con 0x7f6828156350 2023-10-06T01:42:52.297 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.291+0000 7f680f7fe700 1 -- 172.21.15.71:0/3001566288 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6820007000 con 0x7f6828156350 2023-10-06T01:42:52.297 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.291+0000 7f682e11e700 1 -- 172.21.15.71:0/3001566288 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68280ab430 con 0x7f6828156350 2023-10-06T01:42:52.297 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.291+0000 7f680f7fe700 1 -- 172.21.15.71:0/3001566288 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f682001d670 con 0x7f6828156350 2023-10-06T01:42:52.297 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.291+0000 7f682e11e700 1 -- 172.21.15.71:0/3001566288 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6828149f30 con 0x7f6828156350 2023-10-06T01:42:52.297 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.292+0000 7f682e11e700 1 -- 172.21.15.71:0/3001566288 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f682806be60 con 0x7f6828156350 2023-10-06T01:42:52.297 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.293+0000 7f680f7fe700 1 -- 172.21.15.71:0/3001566288 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6820003050 con 0x7f6828156350 2023-10-06T01:42:52.297 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.293+0000 7f680f7fe700 1 --2- 172.21.15.71:0/3001566288 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f6814066f30 0x7f68140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:52.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.293+0000 7f680f7fe700 1 -- 172.21.15.71:0/3001566288 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f6820086300 con 0x7f6828156350 2023-10-06T01:42:52.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.293+0000 7f68277fe700 1 --2- 172.21.15.71:0/3001566288 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f6814066f30 0x7f68140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:52.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.293+0000 7f680f7fe700 1 --2- 172.21.15.71:0/3001566288 >> [v2:172.21.15.71:6808/90669,v1:172.21.15.71:6809/90669] conn(0x7f681406d780 0x7f681406fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:52.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.293+0000 7f680f7fe700 1 -- 172.21.15.71:0/3001566288 --> [v2:172.21.15.71:6808/90669,v1:172.21.15.71:6809/90669] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6814070280 con 0x7f681406d780 2023-10-06T01:42:52.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.293+0000 7f680f7fe700 1 -- 172.21.15.71:0/3001566288 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_get_version_reply(handle=1 version=61) v2 ==== 24+0+0 (secure 0 0 0) 0x7f68200888e0 con 0x7f6828156350 2023-10-06T01:42:52.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.293+0000 7f6826ffd700 1 --2- 172.21.15.71:0/3001566288 >> [v2:172.21.15.71:6808/90669,v1:172.21.15.71:6809/90669] conn(0x7f681406d780 0x7f681406fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:52.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.293+0000 7f68277fe700 1 --2- 172.21.15.71:0/3001566288 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f6814066f30 0x7f68140693e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f681800ac10 tx=0x7f6818006f90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:52.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.294+0000 7f6826ffd700 1 --2- 172.21.15.71:0/3001566288 >> [v2:172.21.15.71:6808/90669,v1:172.21.15.71:6809/90669] conn(0x7f681406d780 0x7f681406fbb0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:52.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.294+0000 7f680f7fe700 1 -- 172.21.15.71:0/3001566288 <== osd.1 v2:172.21.15.71:6808/90669 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f6814070280 con 0x7f681406d780 2023-10-06T01:42:52.308 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.308+0000 7f682e11e700 1 -- 172.21.15.71:0/3001566288 --> [v2:172.21.15.71:6808/90669,v1:172.21.15.71:6809/90669] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f68280b02f0 con 0x7f681406d780 2023-10-06T01:42:52.308 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.308+0000 7f680f7fe700 1 -- 172.21.15.71:0/3001566288 <== osd.1 v2:172.21.15.71:6808/90669 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f68280b02f0 con 0x7f681406d780 2023-10-06T01:42:52.309 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2023-10-06T01:42:52.309 INFO:teuthology.orchestra.run.smithi071.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T01:42:52.309 INFO:teuthology.orchestra.run.smithi071.stdout:} 2023-10-06T01:42:52.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.308+0000 7f682e11e700 1 -- 172.21.15.71:0/3001566288 >> [v2:172.21.15.71:6808/90669,v1:172.21.15.71:6809/90669] conn(0x7f681406d780 msgr2=0x7f681406fbb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:52.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.308+0000 7f682e11e700 1 --2- 172.21.15.71:0/3001566288 >> [v2:172.21.15.71:6808/90669,v1:172.21.15.71:6809/90669] conn(0x7f681406d780 0x7f681406fbb0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:52.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.308+0000 7f682e11e700 1 -- 172.21.15.71:0/3001566288 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f6814066f30 msgr2=0x7f68140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:52.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.308+0000 7f682e11e700 1 --2- 172.21.15.71:0/3001566288 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f6814066f30 0x7f68140693e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f681800ac10 tx=0x7f6818006f90 comp rx=0 tx=0).stop 2023-10-06T01:42:52.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.308+0000 7f682e11e700 1 -- 172.21.15.71:0/3001566288 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6828156350 msgr2=0x7f682814e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:52.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.308+0000 7f682e11e700 1 --2- 172.21.15.71:0/3001566288 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6828156350 0x7f682814e920 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f6820007940 tx=0x7f6820018000 comp rx=0 tx=0).stop 2023-10-06T01:42:52.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.308+0000 7f6827fff700 1 -- 172.21.15.71:0/3001566288 reap_dead start 2023-10-06T01:42:52.310 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.308+0000 7f682e11e700 1 -- 172.21.15.71:0/3001566288 shutdown_connections 2023-10-06T01:42:52.311 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.308+0000 7f682e11e700 1 -- 172.21.15.71:0/3001566288 >> 172.21.15.71:0/3001566288 conn(0x7f68280cbef0 msgr2=0x7f682806a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:52.311 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.308+0000 7f682e11e700 1 -- 172.21.15.71:0/3001566288 shutdown_connections 2023-10-06T01:42:52.311 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.308+0000 7f682e11e700 1 -- 172.21.15.71:0/3001566288 wait complete. 2023-10-06T01:42:52.320 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-10-06T01:42:52.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.435+0000 7f2b3abe7700 1 Processor -- start 2023-10-06T01:42:52.436 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.435+0000 7f2b3abe7700 1 -- start start 2023-10-06T01:42:52.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.436+0000 7f2b3abe7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2b34159320 0x7f2b340adb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:52.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.436+0000 7f2b3abe7700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2b340b0380 0x7f2b3406a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:52.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.436+0000 7f2b3abe7700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b340ae720 con 0x7f2b340ae080 2023-10-06T01:42:52.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.436+0000 7f2b3abe7700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b340cdb10 con 0x7f2b340b0380 2023-10-06T01:42:52.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.436+0000 7f2b3abe7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3406a160 con 0x7f2b34159320 2023-10-06T01:42:52.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.436+0000 7f2b3a3e6700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2b340b0380 0x7f2b3406a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:52.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.436+0000 7f2b39be5700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2b34159320 0x7f2b340adb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:52.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.436+0000 7f2b3a3e6700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2b340b0380 0x7f2b3406a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.71:39750/0 (socket says 172.21.15.71:39750) 2023-10-06T01:42:52.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.436+0000 7f2b39be5700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2b34159320 0x7f2b340adb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.71:48568/0 (socket says 172.21.15.71:48568) 2023-10-06T01:42:52.438 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.436+0000 7f2b3a3e6700 1 -- 172.21.15.71:0/362416007 learned_addr learned my addr 172.21.15.71:0/362416007 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:52.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.436+0000 7f2b393e4700 1 --1- 172.21.15.71:0/362416007 >> v1:172.21.15.72:6789/0 conn(0x7f2b340ae080 0x7f2b340afc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.71:60406/0 (socket says 172.21.15.71:60406) 2023-10-06T01:42:52.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.437+0000 7f2b39be5700 1 -- 172.21.15.71:0/362416007 >> v2:172.21.15.72:3300/0 conn(0x7f2b340b0380 msgr2=0x7f2b3406a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:52.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.437+0000 7f2b39be5700 1 --2- 172.21.15.71:0/362416007 >> v2:172.21.15.72:3300/0 conn(0x7f2b340b0380 0x7f2b3406a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:52.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.437+0000 7f2b39be5700 1 -- 172.21.15.71:0/362416007 >> v1:172.21.15.72:6789/0 conn(0x7f2b340ae080 legacy=0x7f2b340afc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:52.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.437+0000 7f2b39be5700 1 -- 172.21.15.71:0/362416007 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b340ae4d0 con 0x7f2b34159320 2023-10-06T01:42:52.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.437+0000 7f2b3a3e6700 1 --2- 172.21.15.71:0/362416007 >> v2:172.21.15.72:3300/0 conn(0x7f2b340b0380 0x7f2b3406a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:42:52.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.437+0000 7f2b39be5700 1 --2- 172.21.15.71:0/362416007 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2b34159320 0x7f2b340adb40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2b300098e0 tx=0x7f2b300091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6c1a00c68e171c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:52.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.437+0000 7f2b38be3700 1 -- 172.21.15.71:0/362416007 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b3000b6d0 con 0x7f2b34159320 2023-10-06T01:42:52.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.437+0000 7f2b38be3700 1 -- 172.21.15.71:0/362416007 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b3000b830 con 0x7f2b34159320 2023-10-06T01:42:52.439 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.437+0000 7f2b38be3700 1 -- 172.21.15.71:0/362416007 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b3000bbd0 con 0x7f2b34159320 2023-10-06T01:42:52.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.438+0000 7f2b3abe7700 1 -- 172.21.15.71:0/362416007 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2b34159320 msgr2=0x7f2b340adb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:52.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.438+0000 7f2b3abe7700 1 --2- 172.21.15.71:0/362416007 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2b34159320 0x7f2b340adb40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2b300098e0 tx=0x7f2b300091a0 comp rx=0 tx=0).stop 2023-10-06T01:42:52.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.438+0000 7f2b3abe7700 1 -- 172.21.15.71:0/362416007 shutdown_connections 2023-10-06T01:42:52.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.438+0000 7f2b3abe7700 1 --2- 172.21.15.71:0/362416007 >> v2:172.21.15.72:3300/0 conn(0x7f2b340b0380 0x7f2b3406a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:52.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.438+0000 7f2b3abe7700 1 --2- 172.21.15.71:0/362416007 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2b34159320 0x7f2b340adb40 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:52.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.438+0000 7f2b3abe7700 1 -- 172.21.15.71:0/362416007 >> 172.21.15.71:0/362416007 conn(0x7f2b34067130 msgr2=0x7f2b34067530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:52.442 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.438+0000 7f2b3abe7700 1 -- 172.21.15.71:0/362416007 shutdown_connections 2023-10-06T01:42:52.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.438+0000 7f2b3abe7700 1 -- 172.21.15.71:0/362416007 wait complete. 2023-10-06T01:42:52.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.439+0000 7f2b3abe7700 1 Processor -- start 2023-10-06T01:42:52.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.439+0000 7f2b3abe7700 1 -- start start 2023-10-06T01:42:52.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.440+0000 7f2b3abe7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b340ae080 0x7f2b3415a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:52.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.440+0000 7f2b3abe7700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b340b0380 0x7f2b34156590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:52.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.440+0000 7f2b3abe7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2b34159320 0x7f2b3409a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:52.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.440+0000 7f2b3abe7700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b34156ad0 con 0x7f2b340b0380 2023-10-06T01:42:52.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.440+0000 7f2b3abe7700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3416df00 con 0x7f2b340ae080 2023-10-06T01:42:52.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.440+0000 7f2b3abe7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b340962c0 con 0x7f2b34159320 2023-10-06T01:42:52.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.440+0000 7f2b393e4700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b340b0380 0x7f2b34156590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:52.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.440+0000 7f2b39be5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b340ae080 0x7f2b3415a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:52.443 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.440+0000 7f2b393e4700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b340b0380 0x7f2b34156590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41380/0 (socket says 172.21.15.71:41380) 2023-10-06T01:42:52.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.440+0000 7f2b393e4700 1 -- 172.21.15.71:0/2489788056 learned_addr learned my addr 172.21.15.71:0/2489788056 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:52.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.440+0000 7f2b3a3e6700 1 --2- 172.21.15.71:0/2489788056 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2b34159320 0x7f2b3409a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:52.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.440+0000 7f2b393e4700 1 -- 172.21.15.71:0/2489788056 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2b34159320 msgr2=0x7f2b3409a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:52.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.440+0000 7f2b393e4700 1 --2- 172.21.15.71:0/2489788056 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2b34159320 0x7f2b3409a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:52.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.440+0000 7f2b393e4700 1 -- 172.21.15.71:0/2489788056 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b340ae080 msgr2=0x7f2b3415a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:52.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.440+0000 7f2b393e4700 1 --2- 172.21.15.71:0/2489788056 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b340ae080 0x7f2b3415a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:52.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.440+0000 7f2b393e4700 1 -- 172.21.15.71:0/2489788056 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b2c009ae0 con 0x7f2b340b0380 2023-10-06T01:42:52.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.440+0000 7f2b39be5700 1 --2- 172.21.15.71:0/2489788056 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b340ae080 0x7f2b3415a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:42:52.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.440+0000 7f2b393e4700 1 --2- 172.21.15.71:0/2489788056 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b340b0380 0x7f2b34156590 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f2b2400c7f0 tx=0x7f2b24007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:52.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.440+0000 7f2b29ffb700 1 -- 172.21.15.71:0/2489788056 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b24005a70 con 0x7f2b340b0380 2023-10-06T01:42:52.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.440+0000 7f2b29ffb700 1 -- 172.21.15.71:0/2489788056 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b24005bf0 con 0x7f2b340b0380 2023-10-06T01:42:52.444 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.440+0000 7f2b3abe7700 1 -- 172.21.15.71:0/2489788056 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b30009420 con 0x7f2b340b0380 2023-10-06T01:42:52.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.440+0000 7f2b29ffb700 1 -- 172.21.15.71:0/2489788056 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b240070d0 con 0x7f2b340b0380 2023-10-06T01:42:52.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.441+0000 7f2b3abe7700 1 -- 172.21.15.71:0/2489788056 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b340965a0 con 0x7f2b340b0380 2023-10-06T01:42:52.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.442+0000 7f2b3abe7700 1 -- 172.21.15.71:0/2489788056 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b34096730 con 0x7f2b340b0380 2023-10-06T01:42:52.445 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.442+0000 7f2b29ffb700 1 -- 172.21.15.71:0/2489788056 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2b24007440 con 0x7f2b340b0380 2023-10-06T01:42:52.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.442+0000 7f2b29ffb700 1 --2- 172.21.15.71:0/2489788056 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f2b18066f30 0x7f2b180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:52.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.442+0000 7f2b29ffb700 1 -- 172.21.15.71:0/2489788056 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f2b24083960 con 0x7f2b340b0380 2023-10-06T01:42:52.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.442+0000 7f2b39be5700 1 --2- 172.21.15.71:0/2489788056 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f2b18066f30 0x7f2b180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:52.446 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.443+0000 7f2b39be5700 1 --2- 172.21.15.71:0/2489788056 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f2b18066f30 0x7f2b180693e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f2b300093f0 tx=0x7f2b30017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:52.447 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.446+0000 7f2b29ffb700 1 -- 172.21.15.71:0/2489788056 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2b24050bd0 con 0x7f2b340b0380 2023-10-06T01:42:52.630 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.629+0000 7f2b3abe7700 1 -- 172.21.15.71:0/2489788056 --> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f2b34098dd0 con 0x7f2b18066f30 2023-10-06T01:42:52.630 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.630+0000 7f2b29ffb700 1 -- 172.21.15.71:0/2489788056 <== mgr.4107 v2:172.21.15.71:6832/90436 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f2b3001b570 con 0x7f2b18066f30 2023-10-06T01:42:52.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.632+0000 7f2b3abe7700 1 -- 172.21.15.71:0/2489788056 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f2b18066f30 msgr2=0x7f2b180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:52.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.632+0000 7f2b3abe7700 1 --2- 172.21.15.71:0/2489788056 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f2b18066f30 0x7f2b180693e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f2b300093f0 tx=0x7f2b30017000 comp rx=0 tx=0).stop 2023-10-06T01:42:52.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.632+0000 7f2b3abe7700 1 -- 172.21.15.71:0/2489788056 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b340b0380 msgr2=0x7f2b34156590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:52.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.632+0000 7f2b3abe7700 1 --2- 172.21.15.71:0/2489788056 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b340b0380 0x7f2b34156590 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f2b2400c7f0 tx=0x7f2b24007f70 comp rx=0 tx=0).stop 2023-10-06T01:42:52.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.632+0000 7f2b3abe7700 1 -- 172.21.15.71:0/2489788056 shutdown_connections 2023-10-06T01:42:52.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.632+0000 7f2b3abe7700 1 --2- 172.21.15.71:0/2489788056 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2b34159320 0x7f2b3409a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:52.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.632+0000 7f2b3abe7700 1 --2- 172.21.15.71:0/2489788056 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f2b18066f30 0x7f2b180693e0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:52.633 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.632+0000 7f2b3abe7700 1 --2- 172.21.15.71:0/2489788056 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2b340ae080 0x7f2b3415a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:52.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.632+0000 7f2b3abe7700 1 --2- 172.21.15.71:0/2489788056 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b340b0380 0x7f2b34156590 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:52.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.632+0000 7f2b3abe7700 1 -- 172.21.15.71:0/2489788056 >> 172.21.15.71:0/2489788056 conn(0x7f2b34067130 msgr2=0x7f2b34067500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:52.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.632+0000 7f2b3abe7700 1 -- 172.21.15.71:0/2489788056 shutdown_connections 2023-10-06T01:42:52.634 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.632+0000 7f2b3abe7700 1 -- 172.21.15.71:0/2489788056 wait complete. 2023-10-06T01:42:52.634 INFO:teuthology.orchestra.run.smithi071.stderr:instructed osd(s) 1 to deep-scrub 2023-10-06T01:42:52.644 INFO:tasks.ceph:Scrubbing osd.2 2023-10-06T01:42:52.645 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-10-06T01:42:52.762 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.761+0000 7f09fb2a1700 1 Processor -- start 2023-10-06T01:42:52.762 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.761+0000 7f09fb2a1700 1 -- start start 2023-10-06T01:42:52.764 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.762+0000 7f09fb2a1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f09f4142df0 0x7f09f40cc350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:52.764 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.762+0000 7f09fb2a1700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f09f40d0970 0x7f09f40cfa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:52.764 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.762+0000 7f09fb2a1700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09f415a710 con 0x7f09f40cc890 2023-10-06T01:42:52.765 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.762+0000 7f09fb2a1700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09f4159b40 con 0x7f09f40d0970 2023-10-06T01:42:52.765 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.762+0000 7f09fb2a1700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09f4159de0 con 0x7f09f4142df0 2023-10-06T01:42:52.765 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.763+0000 7f09f903d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f09f4142df0 0x7f09f40cc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:52.765 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.763+0000 7f09f983e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f09f40d0970 0x7f09f40cfa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:52.765 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.763+0000 7f09f903d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f09f4142df0 0x7f09f40cc350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.71:48576/0 (socket says 172.21.15.71:48576) 2023-10-06T01:42:52.765 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.763+0000 7f09f903d700 1 -- 172.21.15.71:0/1186602825 learned_addr learned my addr 172.21.15.71:0/1186602825 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:52.765 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.763+0000 7f09f883c700 1 --1- 172.21.15.71:0/1186602825 >> v1:172.21.15.72:6789/0 conn(0x7f09f40cc890 0x7f09f40d0260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.71:60422/0 (socket says 172.21.15.71:60422) 2023-10-06T01:42:52.765 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.763+0000 7f09f903d700 1 -- 172.21.15.71:0/1186602825 >> v2:172.21.15.72:3300/0 conn(0x7f09f40d0970 msgr2=0x7f09f40cfa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:52.765 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.763+0000 7f09f903d700 1 --2- 172.21.15.71:0/1186602825 >> v2:172.21.15.72:3300/0 conn(0x7f09f40d0970 0x7f09f40cfa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:52.765 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.763+0000 7f09f903d700 1 -- 172.21.15.71:0/1186602825 >> v1:172.21.15.72:6789/0 conn(0x7f09f40cc890 legacy=0x7f09f40d0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:52.765 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.763+0000 7f09f903d700 1 -- 172.21.15.71:0/1186602825 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09f415a0c0 con 0x7f09f4142df0 2023-10-06T01:42:52.766 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.763+0000 7f09f903d700 1 --2- 172.21.15.71:0/1186602825 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f09f4142df0 0x7f09f40cc350 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f09f00099b0 tx=0x7f09f0009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44b0abc042f6328e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:52.766 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.763+0000 7f09ebfff700 1 -- 172.21.15.71:0/1186602825 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f0009ea0 con 0x7f09f4142df0 2023-10-06T01:42:52.766 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.763+0000 7f09ebfff700 1 -- 172.21.15.71:0/1186602825 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09f000b860 con 0x7f09f4142df0 2023-10-06T01:42:52.766 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.763+0000 7f09ebfff700 1 -- 172.21.15.71:0/1186602825 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f000bc00 con 0x7f09f4142df0 2023-10-06T01:42:52.766 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.764+0000 7f09fb2a1700 1 -- 172.21.15.71:0/1186602825 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f09f4142df0 msgr2=0x7f09f40cc350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:52.766 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.764+0000 7f09fb2a1700 1 --2- 172.21.15.71:0/1186602825 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f09f4142df0 0x7f09f40cc350 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f09f00099b0 tx=0x7f09f0009250 comp rx=0 tx=0).stop 2023-10-06T01:42:52.766 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.764+0000 7f09fb2a1700 1 -- 172.21.15.71:0/1186602825 shutdown_connections 2023-10-06T01:42:52.766 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.764+0000 7f09fb2a1700 1 --2- 172.21.15.71:0/1186602825 >> v2:172.21.15.72:3300/0 conn(0x7f09f40d0970 0x7f09f40cfa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:52.766 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.764+0000 7f09fb2a1700 1 --2- 172.21.15.71:0/1186602825 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f09f4142df0 0x7f09f40cc350 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:52.766 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.764+0000 7f09fb2a1700 1 -- 172.21.15.71:0/1186602825 >> 172.21.15.71:0/1186602825 conn(0x7f09f40690f0 msgr2=0x7f09f406a340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:52.766 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.764+0000 7f09fb2a1700 1 -- 172.21.15.71:0/1186602825 shutdown_connections 2023-10-06T01:42:52.767 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.764+0000 7f09fb2a1700 1 -- 172.21.15.71:0/1186602825 wait complete. 2023-10-06T01:42:52.769 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.765+0000 7f09fb2a1700 1 Processor -- start 2023-10-06T01:42:52.769 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.765+0000 7f09fb2a1700 1 -- start start 2023-10-06T01:42:52.770 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.766+0000 7f09fb2a1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09f40cc890 0x7f09f40b1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:52.770 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.766+0000 7f09fb2a1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f09f40d0970 0x7f09f413edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:52.770 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.766+0000 7f09fb2a1700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09f4142df0 0x7f09f415e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:52.770 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.766+0000 7f09fb2a1700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f413f2f0 con 0x7f09f4142df0 2023-10-06T01:42:52.770 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.766+0000 7f09fb2a1700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f40b0b40 con 0x7f09f40cc890 2023-10-06T01:42:52.770 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.766+0000 7f09fb2a1700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09f40b0e20 con 0x7f09f40d0970 2023-10-06T01:42:52.770 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.766+0000 7f09f983e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09f4142df0 0x7f09f415e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:52.770 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.766+0000 7f09f983e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09f4142df0 0x7f09f415e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41396/0 (socket says 172.21.15.71:41396) 2023-10-06T01:42:52.770 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.766+0000 7f09f983e700 1 -- 172.21.15.71:0/3462654975 learned_addr learned my addr 172.21.15.71:0/3462654975 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:52.770 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.766+0000 7f09f903d700 1 --2- 172.21.15.71:0/3462654975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09f40cc890 0x7f09f40b1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:52.771 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.766+0000 7f09f883c700 1 --2- 172.21.15.71:0/3462654975 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f09f40d0970 0x7f09f413edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:52.771 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.766+0000 7f09f983e700 1 -- 172.21.15.71:0/3462654975 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f09f40d0970 msgr2=0x7f09f413edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:52.771 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.766+0000 7f09f983e700 1 --2- 172.21.15.71:0/3462654975 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f09f40d0970 0x7f09f413edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:52.771 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.766+0000 7f09f983e700 1 -- 172.21.15.71:0/3462654975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09f40cc890 msgr2=0x7f09f40b1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:52.771 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.766+0000 7f09f983e700 1 --2- 172.21.15.71:0/3462654975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f09f40cc890 0x7f09f40b1be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:52.771 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.766+0000 7f09f983e700 1 -- 172.21.15.71:0/3462654975 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09f00094f0 con 0x7f09f4142df0 2023-10-06T01:42:52.771 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.766+0000 7f09f983e700 1 --2- 172.21.15.71:0/3462654975 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09f4142df0 0x7f09f415e760 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f09ec009e90 tx=0x7f09ec00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:52.771 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.767+0000 7f09e97fa700 1 -- 172.21.15.71:0/3462654975 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09ec00cb70 con 0x7f09f4142df0 2023-10-06T01:42:52.771 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.767+0000 7f09e97fa700 1 -- 172.21.15.71:0/3462654975 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09ec00f040 con 0x7f09f4142df0 2023-10-06T01:42:52.771 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.767+0000 7f09fb2a1700 1 -- 172.21.15.71:0/3462654975 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09f40b1100 con 0x7f09f4142df0 2023-10-06T01:42:52.771 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.767+0000 7f09e97fa700 1 -- 172.21.15.71:0/3462654975 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09ec014480 con 0x7f09f4142df0 2023-10-06T01:42:52.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.767+0000 7f09fb2a1700 1 -- 172.21.15.71:0/3462654975 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09f40b16c0 con 0x7f09f4142df0 2023-10-06T01:42:52.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.767+0000 7f09fb2a1700 1 -- 172.21.15.71:0/3462654975 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f09f4088ad0 con 0x7f09f4142df0 2023-10-06T01:42:52.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.768+0000 7f09e97fa700 1 -- 172.21.15.71:0/3462654975 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f09ec0147f0 con 0x7f09f4142df0 2023-10-06T01:42:52.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.768+0000 7f09e97fa700 1 --2- 172.21.15.71:0/3462654975 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f09d8066f30 0x7f09d80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:52.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.769+0000 7f09e97fa700 1 -- 172.21.15.71:0/3462654975 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f09ec085bb0 con 0x7f09f4142df0 2023-10-06T01:42:52.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.769+0000 7f09f903d700 1 --2- 172.21.15.71:0/3462654975 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f09d8066f30 0x7f09d80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:52.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.769+0000 7f09e97fa700 1 --2- 172.21.15.71:0/3462654975 >> [v2:172.21.15.71:6824/90679,v1:172.21.15.71:6825/90679] conn(0x7f09d806d8f0 0x7f09d806fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:52.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.769+0000 7f09e97fa700 1 -- 172.21.15.71:0/3462654975 --> [v2:172.21.15.71:6824/90679,v1:172.21.15.71:6825/90679] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f09d80703f0 con 0x7f09d806d8f0 2023-10-06T01:42:52.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.769+0000 7f09e97fa700 1 -- 172.21.15.71:0/3462654975 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_get_version_reply(handle=1 version=61) v2 ==== 24+0+0 (secure 0 0 0) 0x7f09ec085f80 con 0x7f09f4142df0 2023-10-06T01:42:52.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.769+0000 7f09f883c700 1 --2- 172.21.15.71:0/3462654975 >> [v2:172.21.15.71:6824/90679,v1:172.21.15.71:6825/90679] conn(0x7f09d806d8f0 0x7f09d806fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:52.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.769+0000 7f09f903d700 1 --2- 172.21.15.71:0/3462654975 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f09d8066f30 0x7f09d80693e0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f09f00099b0 tx=0x7f09f0017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:52.772 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.769+0000 7f09f883c700 1 --2- 172.21.15.71:0/3462654975 >> [v2:172.21.15.71:6824/90679,v1:172.21.15.71:6825/90679] conn(0x7f09d806d8f0 0x7f09d806fd20 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:52.773 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.770+0000 7f09e97fa700 1 -- 172.21.15.71:0/3462654975 <== osd.2 v2:172.21.15.71:6824/90679 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f09d80703f0 con 0x7f09d806d8f0 2023-10-06T01:42:52.784 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.783+0000 7f09fb2a1700 1 -- 172.21.15.71:0/3462654975 --> [v2:172.21.15.71:6824/90679,v1:172.21.15.71:6825/90679] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f09f415a3a0 con 0x7f09d806d8f0 2023-10-06T01:42:52.784 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.783+0000 7f09e97fa700 1 -- 172.21.15.71:0/3462654975 <== osd.2 v2:172.21.15.71:6824/90679 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f09f415a3a0 con 0x7f09d806d8f0 2023-10-06T01:42:52.784 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2023-10-06T01:42:52.784 INFO:teuthology.orchestra.run.smithi071.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T01:42:52.784 INFO:teuthology.orchestra.run.smithi071.stdout:} 2023-10-06T01:42:52.785 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.783+0000 7f09fb2a1700 1 -- 172.21.15.71:0/3462654975 >> [v2:172.21.15.71:6824/90679,v1:172.21.15.71:6825/90679] conn(0x7f09d806d8f0 msgr2=0x7f09d806fd20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:52.785 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.783+0000 7f09fb2a1700 1 --2- 172.21.15.71:0/3462654975 >> [v2:172.21.15.71:6824/90679,v1:172.21.15.71:6825/90679] conn(0x7f09d806d8f0 0x7f09d806fd20 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:52.785 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.784+0000 7f09fb2a1700 1 -- 172.21.15.71:0/3462654975 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f09d8066f30 msgr2=0x7f09d80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:52.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.784+0000 7f09fb2a1700 1 --2- 172.21.15.71:0/3462654975 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f09d8066f30 0x7f09d80693e0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f09f00099b0 tx=0x7f09f0017000 comp rx=0 tx=0).stop 2023-10-06T01:42:52.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.784+0000 7f09fb2a1700 1 -- 172.21.15.71:0/3462654975 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09f4142df0 msgr2=0x7f09f415e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:52.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.784+0000 7f09fb2a1700 1 --2- 172.21.15.71:0/3462654975 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09f4142df0 0x7f09f415e760 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f09ec009e90 tx=0x7f09ec00b040 comp rx=0 tx=0).stop 2023-10-06T01:42:52.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.784+0000 7f09f983e700 1 -- 172.21.15.71:0/3462654975 reap_dead start 2023-10-06T01:42:52.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.784+0000 7f09fb2a1700 1 -- 172.21.15.71:0/3462654975 shutdown_connections 2023-10-06T01:42:52.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.784+0000 7f09fb2a1700 1 -- 172.21.15.71:0/3462654975 >> 172.21.15.71:0/3462654975 conn(0x7f09f40690f0 msgr2=0x7f09f4140b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:52.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.784+0000 7f09fb2a1700 1 -- 172.21.15.71:0/3462654975 shutdown_connections 2023-10-06T01:42:52.786 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.784+0000 7f09fb2a1700 1 -- 172.21.15.71:0/3462654975 wait complete. 2023-10-06T01:42:52.796 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-10-06T01:42:52.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.911+0000 7f83bd089700 1 Processor -- start 2023-10-06T01:42:52.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.911+0000 7f83bd089700 1 -- start start 2023-10-06T01:42:52.914 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.912+0000 7f83bd089700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f83b80cf1a0 0x7f83b80cfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:52.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.912+0000 7f83bd089700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f83b81597d0 0x7f83b80d0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:52.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.912+0000 7f83bd089700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83b80b3560 con 0x7f83b8159400 2023-10-06T01:42:52.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.912+0000 7f83bd089700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83b80cf6f0 con 0x7f83b80cf1a0 2023-10-06T01:42:52.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.912+0000 7f83bd089700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83b80cf9d0 con 0x7f83b81597d0 2023-10-06T01:42:52.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.912+0000 7f83b77fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f83b80cf1a0 0x7f83b80cfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:52.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.912+0000 7f83b77fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f83b80cf1a0 0x7f83b80cfec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41410/0 (socket says 172.21.15.71:41410) 2023-10-06T01:42:52.915 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.912+0000 7f83b77fe700 1 -- 172.21.15.71:0/1552743099 learned_addr learned my addr 172.21.15.71:0/1552743099 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:52.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.912+0000 7f83bc888700 1 --2- 172.21.15.71:0/1552743099 >> v2:172.21.15.72:3300/0 conn(0x7f83b81597d0 0x7f83b80d0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:52.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.912+0000 7f83b77fe700 1 -- 172.21.15.71:0/1552743099 >> v2:172.21.15.72:3300/0 conn(0x7f83b81597d0 msgr2=0x7f83b80d0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:52.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.912+0000 7f83b77fe700 1 --2- 172.21.15.71:0/1552743099 >> v2:172.21.15.72:3300/0 conn(0x7f83b81597d0 0x7f83b80d0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:52.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.912+0000 7f83b77fe700 1 -- 172.21.15.71:0/1552743099 >> v1:172.21.15.72:6789/0 conn(0x7f83b8159400 legacy=0x7f83b80ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:52.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.912+0000 7f83b77fe700 1 -- 172.21.15.71:0/1552743099 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83b80b2f10 con 0x7f83b80cf1a0 2023-10-06T01:42:52.916 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.913+0000 7f83b77fe700 1 --2- 172.21.15.71:0/1552743099 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f83b80cf1a0 0x7f83b80cfec0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f83b8069710 tx=0x7f83ac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8548c20c42568fba server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:52.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.913+0000 7f83b6ffd700 1 -- 172.21.15.71:0/1552743099 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ac009e70 con 0x7f83b80cf1a0 2023-10-06T01:42:52.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.913+0000 7f83b6ffd700 1 -- 172.21.15.71:0/1552743099 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83ac00b860 con 0x7f83b80cf1a0 2023-10-06T01:42:52.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.913+0000 7f83b6ffd700 1 -- 172.21.15.71:0/1552743099 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ac00bc00 con 0x7f83b80cf1a0 2023-10-06T01:42:52.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.913+0000 7f83bd089700 1 -- 172.21.15.71:0/1552743099 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f83b80cf1a0 msgr2=0x7f83b80cfec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:52.917 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.913+0000 7f83bd089700 1 --2- 172.21.15.71:0/1552743099 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f83b80cf1a0 0x7f83b80cfec0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f83b8069710 tx=0x7f83ac009250 comp rx=0 tx=0).stop 2023-10-06T01:42:52.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.913+0000 7f83bd089700 1 -- 172.21.15.71:0/1552743099 shutdown_connections 2023-10-06T01:42:52.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.913+0000 7f83bd089700 1 --2- 172.21.15.71:0/1552743099 >> v2:172.21.15.72:3300/0 conn(0x7f83b81597d0 0x7f83b80d0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:52.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.913+0000 7f83bd089700 1 --2- 172.21.15.71:0/1552743099 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f83b80cf1a0 0x7f83b80cfec0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:52.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.913+0000 7f83bd089700 1 -- 172.21.15.71:0/1552743099 >> 172.21.15.71:0/1552743099 conn(0x7f83b806ac10 msgr2=0x7f83b8068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:52.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.913+0000 7f83bd089700 1 -- 172.21.15.71:0/1552743099 shutdown_connections 2023-10-06T01:42:52.918 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.913+0000 7f83bd089700 1 -- 172.21.15.71:0/1552743099 wait complete. 2023-10-06T01:42:52.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.914+0000 7f83bd089700 1 Processor -- start 2023-10-06T01:42:52.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.915+0000 7f83bd089700 1 -- start start 2023-10-06T01:42:52.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.915+0000 7f83bd089700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83b80cf1a0 0x7f83b80b0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:52.921 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.915+0000 7f83bd089700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f83b8159400 0x7f83b80b1040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:52.922 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.915+0000 7f83bd089700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f83b81597d0 0x7f83b8157510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:52.922 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.915+0000 7f83bd089700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83b80b1620 con 0x7f83b8159400 2023-10-06T01:42:52.922 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.915+0000 7f83bd089700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83b80b1900 con 0x7f83b80cf1a0 2023-10-06T01:42:52.922 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.915+0000 7f83bd089700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83b8153df0 con 0x7f83b81597d0 2023-10-06T01:42:52.922 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.915+0000 7f83b77fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f83b8159400 0x7f83b80b1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:52.922 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.915+0000 7f83b77fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f83b8159400 0x7f83b80b1040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41426/0 (socket says 172.21.15.71:41426) 2023-10-06T01:42:52.922 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.915+0000 7f83b77fe700 1 -- 172.21.15.71:0/868873534 learned_addr learned my addr 172.21.15.71:0/868873534 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:52.922 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.915+0000 7f83b7fff700 1 --2- 172.21.15.71:0/868873534 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83b80cf1a0 0x7f83b80b0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:52.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.915+0000 7f83bc888700 1 --2- 172.21.15.71:0/868873534 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f83b81597d0 0x7f83b8157510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:52.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.916+0000 7f83b77fe700 1 -- 172.21.15.71:0/868873534 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f83b81597d0 msgr2=0x7f83b8157510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:52.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.916+0000 7f83b77fe700 1 --2- 172.21.15.71:0/868873534 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f83b81597d0 0x7f83b8157510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:52.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.916+0000 7f83b77fe700 1 -- 172.21.15.71:0/868873534 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83b80cf1a0 msgr2=0x7f83b80b0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:52.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.916+0000 7f83b77fe700 1 --2- 172.21.15.71:0/868873534 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83b80cf1a0 0x7f83b80b0b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:52.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.916+0000 7f83b77fe700 1 -- 172.21.15.71:0/868873534 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83ac0094f0 con 0x7f83b8159400 2023-10-06T01:42:52.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.916+0000 7f83b77fe700 1 --2- 172.21.15.71:0/868873534 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f83b8159400 0x7f83b80b1040 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f83b80b2b80 tx=0x7f83ac017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:52.923 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.916+0000 7f839ffff700 1 -- 172.21.15.71:0/868873534 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ac011420 con 0x7f83b8159400 2023-10-06T01:42:52.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.916+0000 7f839ffff700 1 -- 172.21.15.71:0/868873534 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83ac0115a0 con 0x7f83b8159400 2023-10-06T01:42:52.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.916+0000 7f839ffff700 1 -- 172.21.15.71:0/868873534 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ac011960 con 0x7f83b8159400 2023-10-06T01:42:52.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.916+0000 7f83bd089700 1 -- 172.21.15.71:0/868873534 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83b81540d0 con 0x7f83b8159400 2023-10-06T01:42:52.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.916+0000 7f83bd089700 1 -- 172.21.15.71:0/868873534 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83b8153290 con 0x7f83b8159400 2023-10-06T01:42:52.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.917+0000 7f83bd089700 1 -- 172.21.15.71:0/868873534 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83b81542e0 con 0x7f83b8159400 2023-10-06T01:42:52.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.917+0000 7f839ffff700 1 -- 172.21.15.71:0/868873534 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f83ac0253f0 con 0x7f83b8159400 2023-10-06T01:42:52.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.918+0000 7f839ffff700 1 --2- 172.21.15.71:0/868873534 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f83a4066f30 0x7f83a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:52.924 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.918+0000 7f839ffff700 1 -- 172.21.15.71:0/868873534 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f83ac085ee0 con 0x7f83b8159400 2023-10-06T01:42:52.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.918+0000 7f83b7fff700 1 --2- 172.21.15.71:0/868873534 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f83a4066f30 0x7f83a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:52.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.918+0000 7f83b7fff700 1 --2- 172.21.15.71:0/868873534 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f83a4066f30 0x7f83a40693e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f83b80cd850 tx=0x7f83a8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:52.925 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:52.922+0000 7f839ffff700 1 -- 172.21.15.71:0/868873534 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f83ac053150 con 0x7f83b8159400 2023-10-06T01:42:53.105 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.104+0000 7f83bd089700 1 -- 172.21.15.71:0/868873534 --> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f83b80ccaf0 con 0x7f83a4066f30 2023-10-06T01:42:53.106 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.105+0000 7f839ffff700 1 -- 172.21.15.71:0/868873534 <== mgr.4107 v2:172.21.15.71:6832/90436 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f83b80ccaf0 con 0x7f83a4066f30 2023-10-06T01:42:53.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.107+0000 7f83bd089700 1 -- 172.21.15.71:0/868873534 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f83a4066f30 msgr2=0x7f83a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:53.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.107+0000 7f83bd089700 1 --2- 172.21.15.71:0/868873534 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f83a4066f30 0x7f83a40693e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f83b80cd850 tx=0x7f83a8009040 comp rx=0 tx=0).stop 2023-10-06T01:42:53.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.107+0000 7f83bd089700 1 -- 172.21.15.71:0/868873534 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f83b8159400 msgr2=0x7f83b80b1040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:53.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.107+0000 7f83bd089700 1 --2- 172.21.15.71:0/868873534 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f83b8159400 0x7f83b80b1040 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f83b80b2b80 tx=0x7f83ac017000 comp rx=0 tx=0).stop 2023-10-06T01:42:53.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.107+0000 7f83bd089700 1 -- 172.21.15.71:0/868873534 shutdown_connections 2023-10-06T01:42:53.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.107+0000 7f83bd089700 1 --2- 172.21.15.71:0/868873534 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f83b81597d0 0x7f83b8157510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:53.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.107+0000 7f83bd089700 1 --2- 172.21.15.71:0/868873534 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f83a4066f30 0x7f83a40693e0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:53.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.107+0000 7f83bd089700 1 --2- 172.21.15.71:0/868873534 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83b80cf1a0 0x7f83b80b0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:53.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.107+0000 7f83bd089700 1 --2- 172.21.15.71:0/868873534 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f83b8159400 0x7f83b80b1040 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:53.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.107+0000 7f83bd089700 1 -- 172.21.15.71:0/868873534 >> 172.21.15.71:0/868873534 conn(0x7f83b806ac10 msgr2=0x7f83b8155d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:53.108 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.107+0000 7f83bd089700 1 -- 172.21.15.71:0/868873534 shutdown_connections 2023-10-06T01:42:53.109 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.107+0000 7f83bd089700 1 -- 172.21.15.71:0/868873534 wait complete. 2023-10-06T01:42:53.109 INFO:teuthology.orchestra.run.smithi071.stderr:instructed osd(s) 2 to deep-scrub 2023-10-06T01:42:53.119 INFO:tasks.ceph:Scrubbing osd.3 2023-10-06T01:42:53.119 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-10-06T01:42:53.237 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.237+0000 7ffbce4ee700 1 Processor -- start 2023-10-06T01:42:53.238 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.237+0000 7ffbce4ee700 1 -- start start 2023-10-06T01:42:53.240 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.238+0000 7ffbce4ee700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffbc8142df0 0x7ffbc80cc350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:53.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.238+0000 7ffbce4ee700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ffbc80cc890 0x7ffbc80d0260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:53.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.238+0000 7ffbce4ee700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbc815a710 con 0x7ffbc80d07a0 2023-10-06T01:42:53.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.238+0000 7ffbce4ee700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbc80d0c40 con 0x7ffbc80cc890 2023-10-06T01:42:53.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.238+0000 7ffbce4ee700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc8159b40 con 0x7ffbc8142df0 2023-10-06T01:42:53.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.238+0000 7ffbc77fe700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7ffbc80cc890 0x7ffbc80d0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:53.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.238+0000 7ffbcca8b700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7ffbc80d07a0 0x7ffbc80cea80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:53482/0 (socket says 172.21.15.71:53482) 2023-10-06T01:42:53.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.238+0000 7ffbcca8b700 1 -- 172.21.15.71:0/425873975 learned_addr learned my addr 172.21.15.71:0/425873975 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:42:53.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.238+0000 7ffbc7fff700 1 --2- 172.21.15.71:0/425873975 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffbc8142df0 0x7ffbc80cc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:53.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.238+0000 7ffbc77fe700 1 -- 172.21.15.71:0/425873975 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffbc8142df0 msgr2=0x7ffbc80cc350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:53.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.238+0000 7ffbc77fe700 1 --2- 172.21.15.71:0/425873975 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffbc8142df0 0x7ffbc80cc350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:53.241 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.238+0000 7ffbc77fe700 1 -- 172.21.15.71:0/425873975 >> v1:172.21.15.71:6789/0 conn(0x7ffbc80d07a0 legacy=0x7ffbc80cea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:53.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.238+0000 7ffbc77fe700 1 -- 172.21.15.71:0/425873975 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbc8159de0 con 0x7ffbc80cc890 2023-10-06T01:42:53.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.238+0000 7ffbc6ffd700 1 -- 172.21.15.71:0/425873975 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 709831459 0 0) 0x7ffbc815a710 con 0x7ffbc80d07a0 2023-10-06T01:42:53.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.238+0000 7ffbc7fff700 1 --2- 172.21.15.71:0/425873975 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffbc8142df0 0x7ffbc80cc350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:42:53.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.238+0000 7ffbc77fe700 1 --2- 172.21.15.71:0/425873975 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffbc80cc890 0x7ffbc80d0260 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7ffbb80098e0 tx=0x7ffbb80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2314757d9c3bd79 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:53.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.238+0000 7ffbc6ffd700 1 -- 172.21.15.71:0/425873975 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb8009e80 con 0x7ffbc80cc890 2023-10-06T01:42:53.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.238+0000 7ffbc6ffd700 1 -- 172.21.15.71:0/425873975 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbb800b860 con 0x7ffbc80cc890 2023-10-06T01:42:53.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.238+0000 7ffbc6ffd700 1 -- 172.21.15.71:0/425873975 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb800bbe0 con 0x7ffbc80cc890 2023-10-06T01:42:53.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.239+0000 7ffbce4ee700 1 -- 172.21.15.71:0/425873975 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffbc80cc890 msgr2=0x7ffbc80d0260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:53.242 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.239+0000 7ffbce4ee700 1 --2- 172.21.15.71:0/425873975 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffbc80cc890 0x7ffbc80d0260 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7ffbb80098e0 tx=0x7ffbb80091a0 comp rx=0 tx=0).stop 2023-10-06T01:42:53.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.239+0000 7ffbce4ee700 1 -- 172.21.15.71:0/425873975 shutdown_connections 2023-10-06T01:42:53.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.239+0000 7ffbce4ee700 1 --2- 172.21.15.71:0/425873975 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffbc8142df0 0x7ffbc80cc350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:53.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.239+0000 7ffbce4ee700 1 --2- 172.21.15.71:0/425873975 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffbc80cc890 0x7ffbc80d0260 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:53.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.239+0000 7ffbce4ee700 1 -- 172.21.15.71:0/425873975 >> 172.21.15.71:0/425873975 conn(0x7ffbc80690f0 msgr2=0x7ffbc806a340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:53.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.239+0000 7ffbce4ee700 1 -- 172.21.15.71:0/425873975 shutdown_connections 2023-10-06T01:42:53.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.239+0000 7ffbce4ee700 1 -- 172.21.15.71:0/425873975 wait complete. 2023-10-06T01:42:53.243 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.240+0000 7ffbce4ee700 1 Processor -- start 2023-10-06T01:42:53.244 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.240+0000 7ffbce4ee700 1 -- start start 2023-10-06T01:42:53.246 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.241+0000 7ffbce4ee700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffbc80cc890 0x7ffbc81535f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:53.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.241+0000 7ffbce4ee700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffbc80d07a0 0x7ffbc815e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:53.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.241+0000 7ffbce4ee700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffbc8142df0 0x7ffbc815e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:53.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.241+0000 7ffbce4ee700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc8169af0 con 0x7ffbc80d07a0 2023-10-06T01:42:53.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.241+0000 7ffbce4ee700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc8156010 con 0x7ffbc8142df0 2023-10-06T01:42:53.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.241+0000 7ffbce4ee700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc81562f0 con 0x7ffbc80cc890 2023-10-06T01:42:53.247 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.241+0000 7ffbc77fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffbc80d07a0 0x7ffbc815e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:53.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.241+0000 7ffbc77fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffbc80d07a0 0x7ffbc815e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41448/0 (socket says 172.21.15.71:41448) 2023-10-06T01:42:53.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.241+0000 7ffbc77fe700 1 -- 172.21.15.71:0/173848996 learned_addr learned my addr 172.21.15.71:0/173848996 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:53.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.241+0000 7ffbcca8b700 1 --2- 172.21.15.71:0/173848996 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffbc8142df0 0x7ffbc815e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:53.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.241+0000 7ffbc77fe700 1 -- 172.21.15.71:0/173848996 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffbc80cc890 msgr2=0x7ffbc81535f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:53.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.241+0000 7ffbc77fe700 1 --2- 172.21.15.71:0/173848996 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffbc80cc890 0x7ffbc81535f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:53.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.241+0000 7ffbc77fe700 1 -- 172.21.15.71:0/173848996 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffbc8142df0 msgr2=0x7ffbc815e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:53.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.241+0000 7ffbc77fe700 1 --2- 172.21.15.71:0/173848996 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffbc8142df0 0x7ffbc815e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:53.248 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.241+0000 7ffbc77fe700 1 -- 172.21.15.71:0/173848996 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbb8009420 con 0x7ffbc80d07a0 2023-10-06T01:42:53.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.241+0000 7ffbc77fe700 1 --2- 172.21.15.71:0/173848996 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffbc80d07a0 0x7ffbc815e160 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7ffbb8013000 tx=0x7ffbb8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:53.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.242+0000 7ffbaffff700 1 -- 172.21.15.71:0/173848996 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb800b9d0 con 0x7ffbc80d07a0 2023-10-06T01:42:53.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.242+0000 7ffbaffff700 1 -- 172.21.15.71:0/173848996 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbb800bb30 con 0x7ffbc80d07a0 2023-10-06T01:42:53.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.242+0000 7ffbce4ee700 1 -- 172.21.15.71:0/173848996 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbc81565d0 con 0x7ffbc80d07a0 2023-10-06T01:42:53.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.242+0000 7ffbaffff700 1 -- 172.21.15.71:0/173848996 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb8025650 con 0x7ffbc80d07a0 2023-10-06T01:42:53.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.242+0000 7ffbce4ee700 1 -- 172.21.15.71:0/173848996 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbc8153b30 con 0x7ffbc80d07a0 2023-10-06T01:42:53.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.242+0000 7ffbce4ee700 1 -- 172.21.15.71:0/173848996 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ffbc8088ad0 con 0x7ffbc80d07a0 2023-10-06T01:42:53.249 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.243+0000 7ffbaffff700 1 -- 172.21.15.71:0/173848996 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ffbb8023070 con 0x7ffbc80d07a0 2023-10-06T01:42:53.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.243+0000 7ffbaffff700 1 --2- 172.21.15.71:0/173848996 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7ffbb4066f30 0x7ffbb40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:53.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.243+0000 7ffbaffff700 1 -- 172.21.15.71:0/173848996 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5698+0+0 (secure 0 0 0) 0x7ffbb8086160 con 0x7ffbc80d07a0 2023-10-06T01:42:53.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.243+0000 7ffbc7fff700 1 --2- 172.21.15.71:0/173848996 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7ffbb4066f30 0x7ffbb40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:53.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.243+0000 7ffbaffff700 1 --2- 172.21.15.71:0/173848996 >> [v2:172.21.15.71:6800/90668,v1:172.21.15.71:6801/90668] conn(0x7ffbb406d8f0 0x7ffbb406fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:53.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.243+0000 7ffbaffff700 1 -- 172.21.15.71:0/173848996 --> [v2:172.21.15.71:6800/90668,v1:172.21.15.71:6801/90668] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ffbb40703f0 con 0x7ffbb406d8f0 2023-10-06T01:42:53.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.243+0000 7ffbaffff700 1 -- 172.21.15.71:0/173848996 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_get_version_reply(handle=1 version=61) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffbb8086530 con 0x7ffbc80d07a0 2023-10-06T01:42:53.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.244+0000 7ffbcca8b700 1 --2- 172.21.15.71:0/173848996 >> [v2:172.21.15.71:6800/90668,v1:172.21.15.71:6801/90668] conn(0x7ffbb406d8f0 0x7ffbb406fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:53.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.244+0000 7ffbc7fff700 1 --2- 172.21.15.71:0/173848996 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7ffbb4066f30 0x7ffbb40693e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc006fd0 tx=0x7ffbbc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:53.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.244+0000 7ffbcca8b700 1 --2- 172.21.15.71:0/173848996 >> [v2:172.21.15.71:6800/90668,v1:172.21.15.71:6801/90668] conn(0x7ffbb406d8f0 0x7ffbb406fd20 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:53.250 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.244+0000 7ffbaffff700 1 -- 172.21.15.71:0/173848996 <== osd.3 v2:172.21.15.71:6800/90668 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7ffbb40703f0 con 0x7ffbb406d8f0 2023-10-06T01:42:53.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.258+0000 7ffbce4ee700 1 -- 172.21.15.71:0/173848996 --> [v2:172.21.15.71:6800/90668,v1:172.21.15.71:6801/90668] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ffbc815a0c0 con 0x7ffbb406d8f0 2023-10-06T01:42:53.259 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.258+0000 7ffbaffff700 1 -- 172.21.15.71:0/173848996 <== osd.3 v2:172.21.15.71:6800/90668 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7ffbc815a0c0 con 0x7ffbb406d8f0 2023-10-06T01:42:53.260 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2023-10-06T01:42:53.260 INFO:teuthology.orchestra.run.smithi071.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T01:42:53.260 INFO:teuthology.orchestra.run.smithi071.stdout:} 2023-10-06T01:42:53.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.258+0000 7ffbce4ee700 1 -- 172.21.15.71:0/173848996 >> [v2:172.21.15.71:6800/90668,v1:172.21.15.71:6801/90668] conn(0x7ffbb406d8f0 msgr2=0x7ffbb406fd20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:53.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.258+0000 7ffbce4ee700 1 --2- 172.21.15.71:0/173848996 >> [v2:172.21.15.71:6800/90668,v1:172.21.15.71:6801/90668] conn(0x7ffbb406d8f0 0x7ffbb406fd20 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:53.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.259+0000 7ffbce4ee700 1 -- 172.21.15.71:0/173848996 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7ffbb4066f30 msgr2=0x7ffbb40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:53.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.259+0000 7ffbce4ee700 1 --2- 172.21.15.71:0/173848996 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7ffbb4066f30 0x7ffbb40693e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc006fd0 tx=0x7ffbbc008040 comp rx=0 tx=0).stop 2023-10-06T01:42:53.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.259+0000 7ffbce4ee700 1 -- 172.21.15.71:0/173848996 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffbc80d07a0 msgr2=0x7ffbc815e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:53.262 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.259+0000 7ffbce4ee700 1 --2- 172.21.15.71:0/173848996 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffbc80d07a0 0x7ffbc815e160 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7ffbb8013000 tx=0x7ffbb8017000 comp rx=0 tx=0).stop 2023-10-06T01:42:53.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.259+0000 7ffbcca8b700 1 -- 172.21.15.71:0/173848996 reap_dead start 2023-10-06T01:42:53.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.259+0000 7ffbce4ee700 1 -- 172.21.15.71:0/173848996 shutdown_connections 2023-10-06T01:42:53.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.259+0000 7ffbce4ee700 1 -- 172.21.15.71:0/173848996 >> 172.21.15.71:0/173848996 conn(0x7ffbc80690f0 msgr2=0x7ffbc80af2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:53.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.259+0000 7ffbce4ee700 1 -- 172.21.15.71:0/173848996 shutdown_connections 2023-10-06T01:42:53.263 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.259+0000 7ffbce4ee700 1 -- 172.21.15.71:0/173848996 wait complete. 2023-10-06T01:42:53.271 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-10-06T01:42:53.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.385+0000 7fb12faac700 1 Processor -- start 2023-10-06T01:42:53.386 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.385+0000 7fb12faac700 1 -- start start 2023-10-06T01:42:53.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.386+0000 7fb12faac700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb128086ff0 0x7fb128087470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:53.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.386+0000 7fb12faac700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb1280b21b0 0x7fb1280b2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:53.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.386+0000 7fb12faac700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1280b2b70 con 0x7fb12815a030 2023-10-06T01:42:53.389 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.386+0000 7fb12faac700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1280b0cf0 con 0x7fb128086ff0 2023-10-06T01:42:53.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.386+0000 7fb12faac700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1280879b0 con 0x7fb1280b21b0 2023-10-06T01:42:53.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.386+0000 7fb12d848700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fb12815a030 0x7fb12815a400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.71:60450/0 (socket says 172.21.15.71:60450) 2023-10-06T01:42:53.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.386+0000 7fb12d848700 1 -- 172.21.15.71:0/835431259 learned_addr learned my addr 172.21.15.71:0/835431259 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:42:53.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.386+0000 7fb12e049700 1 --2- 172.21.15.71:0/835431259 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb1280b21b0 0x7fb1280b2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:53.390 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.386+0000 7fb12d047700 1 --2- 172.21.15.71:0/835431259 >> v2:172.21.15.72:3300/0 conn(0x7fb128086ff0 0x7fb128087470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:53.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.386+0000 7fb12c846700 1 -- 172.21.15.71:0/835431259 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 424506580 0 0) 0x7fb1280b2b70 con 0x7fb12815a030 2023-10-06T01:42:53.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.387+0000 7fb12c846700 1 -- 172.21.15.71:0/835431259 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb110003570 con 0x7fb12815a030 2023-10-06T01:42:53.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.387+0000 7fb12e049700 1 -- 172.21.15.71:0/835431259 >> v2:172.21.15.72:3300/0 conn(0x7fb128086ff0 msgr2=0x7fb128087470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:53.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.387+0000 7fb12e049700 1 --2- 172.21.15.71:0/835431259 >> v2:172.21.15.72:3300/0 conn(0x7fb128086ff0 0x7fb128087470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:53.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.387+0000 7fb12e049700 1 -- 172.21.15.71:0/835431259 >> v1:172.21.15.72:6789/0 conn(0x7fb12815a030 legacy=0x7fb12815a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:53.391 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.387+0000 7fb12e049700 1 -- 172.21.15.71:0/835431259 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1280afc50 con 0x7fb1280b21b0 2023-10-06T01:42:53.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.387+0000 7fb12d047700 1 --2- 172.21.15.71:0/835431259 >> v2:172.21.15.72:3300/0 conn(0x7fb128086ff0 0x7fb128087470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:42:53.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.387+0000 7fb12e049700 1 --2- 172.21.15.71:0/835431259 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb1280b21b0 0x7fb1280b2630 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb120009e60 tx=0x7fb120009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2508459570004700 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:53.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.387+0000 7fb12c846700 1 -- 172.21.15.71:0/835431259 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb12000e070 con 0x7fb1280b21b0 2023-10-06T01:42:53.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.387+0000 7fb12c846700 1 -- 172.21.15.71:0/835431259 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb12000bab0 con 0x7fb1280b21b0 2023-10-06T01:42:53.392 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.387+0000 7fb12c846700 1 -- 172.21.15.71:0/835431259 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb12000be70 con 0x7fb1280b21b0 2023-10-06T01:42:53.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.387+0000 7fb12faac700 1 -- 172.21.15.71:0/835431259 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb1280b21b0 msgr2=0x7fb1280b2630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:53.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.387+0000 7fb12faac700 1 --2- 172.21.15.71:0/835431259 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb1280b21b0 0x7fb1280b2630 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb120009e60 tx=0x7fb120009780 comp rx=0 tx=0).stop 2023-10-06T01:42:53.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.387+0000 7fb12faac700 1 -- 172.21.15.71:0/835431259 shutdown_connections 2023-10-06T01:42:53.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.387+0000 7fb12faac700 1 --2- 172.21.15.71:0/835431259 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb1280b21b0 0x7fb1280b2630 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:53.393 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.387+0000 7fb12faac700 1 --2- 172.21.15.71:0/835431259 >> v2:172.21.15.72:3300/0 conn(0x7fb128086ff0 0x7fb128087470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:53.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.388+0000 7fb12faac700 1 -- 172.21.15.71:0/835431259 >> 172.21.15.71:0/835431259 conn(0x7fb128068680 msgr2=0x7fb128068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:53.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.388+0000 7fb12faac700 1 -- 172.21.15.71:0/835431259 shutdown_connections 2023-10-06T01:42:53.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.388+0000 7fb12faac700 1 -- 172.21.15.71:0/835431259 wait complete. 2023-10-06T01:42:53.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.389+0000 7fb12faac700 1 Processor -- start 2023-10-06T01:42:53.394 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.389+0000 7fb12faac700 1 -- start start 2023-10-06T01:42:53.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.389+0000 7fb12faac700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb128086ff0 0x7fb1281559c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:53.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.389+0000 7fb12faac700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb1280b21b0 0x7fb12815c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:53.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.389+0000 7fb12faac700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb12815a030 0x7fb1280ceee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:53.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.389+0000 7fb12faac700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb12815d110 con 0x7fb12815a030 2023-10-06T01:42:53.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.389+0000 7fb12faac700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1280b4a90 con 0x7fb128086ff0 2023-10-06T01:42:53.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.389+0000 7fb12faac700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1280b3e80 con 0x7fb1280b21b0 2023-10-06T01:42:53.397 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.390+0000 7fb12e049700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb12815a030 0x7fb1280ceee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:53.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.390+0000 7fb12e049700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb12815a030 0x7fb1280ceee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41454/0 (socket says 172.21.15.71:41454) 2023-10-06T01:42:53.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.390+0000 7fb12e049700 1 -- 172.21.15.71:0/2876038953 learned_addr learned my addr 172.21.15.71:0/2876038953 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:53.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.390+0000 7fb12d848700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb128086ff0 0x7fb1281559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:53.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.390+0000 7fb12d047700 1 --2- 172.21.15.71:0/2876038953 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb1280b21b0 0x7fb12815c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:53.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.390+0000 7fb12e049700 1 -- 172.21.15.71:0/2876038953 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb1280b21b0 msgr2=0x7fb12815c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:53.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.390+0000 7fb12e049700 1 --2- 172.21.15.71:0/2876038953 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb1280b21b0 0x7fb12815c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:53.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.390+0000 7fb12e049700 1 -- 172.21.15.71:0/2876038953 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb128086ff0 msgr2=0x7fb1281559c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:53.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.390+0000 7fb12e049700 1 --2- 172.21.15.71:0/2876038953 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb128086ff0 0x7fb1281559c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:53.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.390+0000 7fb12e049700 1 -- 172.21.15.71:0/2876038953 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb11c009420 con 0x7fb12815a030 2023-10-06T01:42:53.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.390+0000 7fb12e049700 1 --2- 172.21.15.71:0/2876038953 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb12815a030 0x7fb1280ceee0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fb1280891b0 tx=0x7fb120019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:53.398 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.390+0000 7fb125ffb700 1 -- 172.21.15.71:0/2876038953 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb120012e10 con 0x7fb12815a030 2023-10-06T01:42:53.399 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.390+0000 7fb125ffb700 1 -- 172.21.15.71:0/2876038953 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb120027470 con 0x7fb12815a030 2023-10-06T01:42:53.399 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.390+0000 7fb12faac700 1 -- 172.21.15.71:0/2876038953 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb120009a20 con 0x7fb12815a030 2023-10-06T01:42:53.399 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.390+0000 7fb125ffb700 1 -- 172.21.15.71:0/2876038953 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb120027830 con 0x7fb12815a030 2023-10-06T01:42:53.399 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.390+0000 7fb12faac700 1 -- 172.21.15.71:0/2876038953 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1280b4440 con 0x7fb12815a030 2023-10-06T01:42:53.399 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.391+0000 7fb12faac700 1 -- 172.21.15.71:0/2876038953 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb128088700 con 0x7fb12815a030 2023-10-06T01:42:53.399 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.392+0000 7fb125ffb700 1 -- 172.21.15.71:0/2876038953 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb120024070 con 0x7fb12815a030 2023-10-06T01:42:53.399 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.392+0000 7fb125ffb700 1 --2- 172.21.15.71:0/2876038953 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fb114066f30 0x7fb1140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:53.399 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.393+0000 7fb125ffb700 1 -- 172.21.15.71:0/2876038953 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5698+0+0 (secure 0 0 0) 0x7fb120087350 con 0x7fb12815a030 2023-10-06T01:42:53.399 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.393+0000 7fb12d848700 1 --2- 172.21.15.71:0/2876038953 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fb114066f30 0x7fb1140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:53.399 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.393+0000 7fb12d848700 1 --2- 172.21.15.71:0/2876038953 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fb114066f30 0x7fb1140693e0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fb118007fd0 tx=0x7fb118009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:53.399 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.396+0000 7fb125ffb700 1 -- 172.21.15.71:0/2876038953 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb1200545a0 con 0x7fb12815a030 2023-10-06T01:42:53.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.580+0000 7fb12faac700 1 -- 172.21.15.71:0/2876038953 --> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7fb1280aff30 con 0x7fb114066f30 2023-10-06T01:42:53.581 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.580+0000 7fb125ffb700 1 -- 172.21.15.71:0/2876038953 <== mgr.4107 v2:172.21.15.71:6832/90436 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb1280aff30 con 0x7fb114066f30 2023-10-06T01:42:53.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.583+0000 7fb12faac700 1 -- 172.21.15.71:0/2876038953 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fb114066f30 msgr2=0x7fb1140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:53.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.583+0000 7fb12faac700 1 --2- 172.21.15.71:0/2876038953 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fb114066f30 0x7fb1140693e0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fb118007fd0 tx=0x7fb118009040 comp rx=0 tx=0).stop 2023-10-06T01:42:53.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.583+0000 7fb12faac700 1 -- 172.21.15.71:0/2876038953 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb12815a030 msgr2=0x7fb1280ceee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:53.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.583+0000 7fb12faac700 1 --2- 172.21.15.71:0/2876038953 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb12815a030 0x7fb1280ceee0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fb1280891b0 tx=0x7fb120019000 comp rx=0 tx=0).stop 2023-10-06T01:42:53.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.583+0000 7fb12faac700 1 -- 172.21.15.71:0/2876038953 shutdown_connections 2023-10-06T01:42:53.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.583+0000 7fb12faac700 1 --2- 172.21.15.71:0/2876038953 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb12815a030 0x7fb1280ceee0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:53.584 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.583+0000 7fb12faac700 1 --2- 172.21.15.71:0/2876038953 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fb114066f30 0x7fb1140693e0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:53.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.583+0000 7fb12faac700 1 --2- 172.21.15.71:0/2876038953 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb128086ff0 0x7fb1281559c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:53.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.583+0000 7fb12faac700 1 --2- 172.21.15.71:0/2876038953 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb1280b21b0 0x7fb12815c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:53.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.583+0000 7fb12faac700 1 -- 172.21.15.71:0/2876038953 >> 172.21.15.71:0/2876038953 conn(0x7fb128068680 msgr2=0x7fb12815d900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:53.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.583+0000 7fb12faac700 1 -- 172.21.15.71:0/2876038953 shutdown_connections 2023-10-06T01:42:53.585 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.583+0000 7fb12faac700 1 -- 172.21.15.71:0/2876038953 wait complete. 2023-10-06T01:42:53.585 INFO:teuthology.orchestra.run.smithi071.stderr:instructed osd(s) 3 to deep-scrub 2023-10-06T01:42:53.595 INFO:tasks.ceph:Scrubbing osd.4 2023-10-06T01:42:53.596 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-10-06T01:42:53.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.713+0000 7fef43883700 1 Processor -- start 2023-10-06T01:42:53.714 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.713+0000 7fef43883700 1 -- start start 2023-10-06T01:42:53.716 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.714+0000 7fef43883700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef3c0cfa90 0x7fef3c0d0260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:53.717 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.714+0000 7fef43883700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef3c15a710 con 0x7fef3c142df0 2023-10-06T01:42:53.717 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.714+0000 7fef43883700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef3c159b40 con 0x7fef3c0d07a0 2023-10-06T01:42:53.717 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.714+0000 7fef43883700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef3c0d0c20 con 0x7fef3c0cfa90 2023-10-06T01:42:53.717 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.714+0000 7fef4161f700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fef3c142df0 0x7fef3c0cc350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:53488/0 (socket says 172.21.15.71:53488) 2023-10-06T01:42:53.717 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.714+0000 7fef4161f700 1 -- 172.21.15.71:0/279400594 learned_addr learned my addr 172.21.15.71:0/279400594 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:42:53.718 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.714+0000 7fef40e1e700 1 --2- 172.21.15.71:0/279400594 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef3c0cfa90 0x7fef3c0d0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:53.718 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.715+0000 7fef33fff700 1 -- 172.21.15.71:0/279400594 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1228801326 0 0) 0x7fef3c15a710 con 0x7fef3c142df0 2023-10-06T01:42:53.718 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.715+0000 7fef33fff700 1 -- 172.21.15.71:0/279400594 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef28003570 con 0x7fef3c142df0 2023-10-06T01:42:53.718 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.715+0000 7fef33fff700 1 -- 172.21.15.71:0/279400594 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3670814965 0 0) 0x7fef3c159b40 con 0x7fef3c0d07a0 2023-10-06T01:42:53.718 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.715+0000 7fef33fff700 1 -- 172.21.15.71:0/279400594 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef3c15a710 con 0x7fef3c0d07a0 2023-10-06T01:42:53.718 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.715+0000 7fef40e1e700 1 -- 172.21.15.71:0/279400594 >> v1:172.21.15.72:6789/0 conn(0x7fef3c0d07a0 legacy=0x7fef3c163060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:53.718 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.715+0000 7fef40e1e700 1 -- 172.21.15.71:0/279400594 >> v1:172.21.15.71:6789/0 conn(0x7fef3c142df0 legacy=0x7fef3c0cc350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:53.718 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.715+0000 7fef40e1e700 1 -- 172.21.15.71:0/279400594 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef3c159de0 con 0x7fef3c0cfa90 2023-10-06T01:42:53.718 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.715+0000 7fef40e1e700 1 --2- 172.21.15.71:0/279400594 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef3c0cfa90 0x7fef3c0d0260 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fef2c009910 tx=0x7fef2c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e733b5b34af0de08 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:53.718 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.715+0000 7fef33fff700 1 -- 172.21.15.71:0/279400594 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef2c011630 con 0x7fef3c0cfa90 2023-10-06T01:42:53.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.715+0000 7fef33fff700 1 -- 172.21.15.71:0/279400594 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef2c011790 con 0x7fef3c0cfa90 2023-10-06T01:42:53.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.715+0000 7fef33fff700 1 -- 172.21.15.71:0/279400594 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef2c011b30 con 0x7fef3c0cfa90 2023-10-06T01:42:53.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.716+0000 7fef43883700 1 -- 172.21.15.71:0/279400594 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef3c0cfa90 msgr2=0x7fef3c0d0260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:53.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.716+0000 7fef43883700 1 --2- 172.21.15.71:0/279400594 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef3c0cfa90 0x7fef3c0d0260 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fef2c009910 tx=0x7fef2c0091a0 comp rx=0 tx=0).stop 2023-10-06T01:42:53.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.716+0000 7fef43883700 1 -- 172.21.15.71:0/279400594 shutdown_connections 2023-10-06T01:42:53.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.716+0000 7fef43883700 1 --2- 172.21.15.71:0/279400594 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef3c0cfa90 0x7fef3c0d0260 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:53.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.716+0000 7fef43883700 1 -- 172.21.15.71:0/279400594 >> 172.21.15.71:0/279400594 conn(0x7fef3c0690f0 msgr2=0x7fef3c06a340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:53.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.716+0000 7fef43883700 1 -- 172.21.15.71:0/279400594 shutdown_connections 2023-10-06T01:42:53.719 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.716+0000 7fef43883700 1 -- 172.21.15.71:0/279400594 wait complete. 2023-10-06T01:42:53.722 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.717+0000 7fef43883700 1 Processor -- start 2023-10-06T01:42:53.722 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.717+0000 7fef43883700 1 -- start start 2023-10-06T01:42:53.722 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.718+0000 7fef43883700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef3c0cfa90 0x7fef3c1564d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:53.723 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.718+0000 7fef43883700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef3c0d07a0 0x7fef3c0afe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:53.723 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.718+0000 7fef43883700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef3c142df0 0x7fef3c0b0360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:53.723 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.718+0000 7fef43883700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef3c156040 con 0x7fef3c0cfa90 2023-10-06T01:42:53.723 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.718+0000 7fef43883700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef3c155710 con 0x7fef3c142df0 2023-10-06T01:42:53.723 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.718+0000 7fef43883700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef3c1559f0 con 0x7fef3c0d07a0 2023-10-06T01:42:53.723 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.718+0000 7fef4161f700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef3c0cfa90 0x7fef3c1564d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:53.723 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.718+0000 7fef4161f700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef3c0cfa90 0x7fef3c1564d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41458/0 (socket says 172.21.15.71:41458) 2023-10-06T01:42:53.723 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.718+0000 7fef4161f700 1 -- 172.21.15.71:0/2780562794 learned_addr learned my addr 172.21.15.71:0/2780562794 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:53.723 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.718+0000 7fef40e1e700 1 --2- 172.21.15.71:0/2780562794 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef3c0d07a0 0x7fef3c0afe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:53.723 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.718+0000 7fef41e20700 1 --2- 172.21.15.71:0/2780562794 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef3c142df0 0x7fef3c0b0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:53.723 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.718+0000 7fef4161f700 1 -- 172.21.15.71:0/2780562794 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef3c0d07a0 msgr2=0x7fef3c0afe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:53.724 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.718+0000 7fef4161f700 1 --2- 172.21.15.71:0/2780562794 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fef3c0d07a0 0x7fef3c0afe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:53.724 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.718+0000 7fef4161f700 1 -- 172.21.15.71:0/2780562794 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef3c142df0 msgr2=0x7fef3c0b0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:53.724 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.718+0000 7fef4161f700 1 --2- 172.21.15.71:0/2780562794 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fef3c142df0 0x7fef3c0b0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:53.724 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.718+0000 7fef4161f700 1 -- 172.21.15.71:0/2780562794 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef2c009420 con 0x7fef3c0cfa90 2023-10-06T01:42:53.724 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.718+0000 7fef4161f700 1 --2- 172.21.15.71:0/2780562794 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef3c0cfa90 0x7fef3c1564d0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fef3800c790 tx=0x7fef38007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:53.724 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.718+0000 7fef317fa700 1 -- 172.21.15.71:0/2780562794 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef38005b30 con 0x7fef3c0cfa90 2023-10-06T01:42:53.724 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.718+0000 7fef317fa700 1 -- 172.21.15.71:0/2780562794 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef38005c90 con 0x7fef3c0cfa90 2023-10-06T01:42:53.724 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.718+0000 7fef43883700 1 -- 172.21.15.71:0/2780562794 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef3c155cd0 con 0x7fef3c0cfa90 2023-10-06T01:42:53.724 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.718+0000 7fef317fa700 1 -- 172.21.15.71:0/2780562794 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef38007300 con 0x7fef3c0cfa90 2023-10-06T01:42:53.724 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.718+0000 7fef43883700 1 -- 172.21.15.71:0/2780562794 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef3c141660 con 0x7fef3c0cfa90 2023-10-06T01:42:53.724 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.719+0000 7fef43883700 1 -- 172.21.15.71:0/2780562794 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fef3c141850 con 0x7fef3c0cfa90 2023-10-06T01:42:53.724 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.720+0000 7fef317fa700 1 -- 172.21.15.71:0/2780562794 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fef3801b3b0 con 0x7fef3c0cfa90 2023-10-06T01:42:53.725 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.720+0000 7fef317fa700 1 --2- 172.21.15.71:0/2780562794 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fef20066f30 0x7fef200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:53.725 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.720+0000 7fef317fa700 1 -- 172.21.15.71:0/2780562794 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5698+0+0 (secure 0 0 0) 0x7fef38083a90 con 0x7fef3c0cfa90 2023-10-06T01:42:53.725 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.720+0000 7fef40e1e700 1 --2- 172.21.15.71:0/2780562794 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fef20066f30 0x7fef200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:53.725 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.720+0000 7fef317fa700 1 --2- 172.21.15.71:0/2780562794 >> [v2:172.21.15.72:6800/90917,v1:172.21.15.72:6801/90917] conn(0x7fef2006d870 0x7fef2006fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:53.725 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.720+0000 7fef317fa700 1 -- 172.21.15.71:0/2780562794 --> [v2:172.21.15.72:6800/90917,v1:172.21.15.72:6801/90917] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fef20070370 con 0x7fef2006d870 2023-10-06T01:42:53.725 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.720+0000 7fef317fa700 1 -- 172.21.15.71:0/2780562794 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_get_version_reply(handle=1 version=61) v2 ==== 24+0+0 (secure 0 0 0) 0x7fef38088240 con 0x7fef3c0cfa90 2023-10-06T01:42:53.725 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.721+0000 7fef41e20700 1 --2- 172.21.15.71:0/2780562794 >> [v2:172.21.15.72:6800/90917,v1:172.21.15.72:6801/90917] conn(0x7fef2006d870 0x7fef2006fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:53.725 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.721+0000 7fef40e1e700 1 --2- 172.21.15.71:0/2780562794 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fef20066f30 0x7fef200693e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fef2c0091e0 tx=0x7fef2c017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:53.725 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.721+0000 7fef41e20700 1 --2- 172.21.15.71:0/2780562794 >> [v2:172.21.15.72:6800/90917,v1:172.21.15.72:6801/90917] conn(0x7fef2006d870 0x7fef2006fca0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:53.725 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.722+0000 7fef317fa700 1 -- 172.21.15.71:0/2780562794 <== osd.4 v2:172.21.15.72:6800/90917 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fef20070370 con 0x7fef2006d870 2023-10-06T01:42:53.736 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.735+0000 7fef43883700 1 -- 172.21.15.71:0/2780562794 --> [v2:172.21.15.72:6800/90917,v1:172.21.15.72:6801/90917] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fef3c155880 con 0x7fef2006d870 2023-10-06T01:42:53.737 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.736+0000 7fef317fa700 1 -- 172.21.15.71:0/2780562794 <== osd.4 v2:172.21.15.72:6800/90917 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fef3c155880 con 0x7fef2006d870 2023-10-06T01:42:53.737 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2023-10-06T01:42:53.737 INFO:teuthology.orchestra.run.smithi071.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T01:42:53.737 INFO:teuthology.orchestra.run.smithi071.stdout:} 2023-10-06T01:42:53.738 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.736+0000 7fef43883700 1 -- 172.21.15.71:0/2780562794 >> [v2:172.21.15.72:6800/90917,v1:172.21.15.72:6801/90917] conn(0x7fef2006d870 msgr2=0x7fef2006fca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:53.738 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.736+0000 7fef43883700 1 --2- 172.21.15.71:0/2780562794 >> [v2:172.21.15.72:6800/90917,v1:172.21.15.72:6801/90917] conn(0x7fef2006d870 0x7fef2006fca0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:53.738 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.737+0000 7fef43883700 1 -- 172.21.15.71:0/2780562794 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fef20066f30 msgr2=0x7fef200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:53.738 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.737+0000 7fef43883700 1 --2- 172.21.15.71:0/2780562794 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fef20066f30 0x7fef200693e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fef2c0091e0 tx=0x7fef2c017000 comp rx=0 tx=0).stop 2023-10-06T01:42:53.738 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.737+0000 7fef43883700 1 -- 172.21.15.71:0/2780562794 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef3c0cfa90 msgr2=0x7fef3c1564d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:53.739 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.737+0000 7fef43883700 1 --2- 172.21.15.71:0/2780562794 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef3c0cfa90 0x7fef3c1564d0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fef3800c790 tx=0x7fef38007ea0 comp rx=0 tx=0).stop 2023-10-06T01:42:53.739 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.737+0000 7fef41e20700 1 -- 172.21.15.71:0/2780562794 reap_dead start 2023-10-06T01:42:53.739 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.737+0000 7fef43883700 1 -- 172.21.15.71:0/2780562794 shutdown_connections 2023-10-06T01:42:53.739 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.737+0000 7fef43883700 1 -- 172.21.15.71:0/2780562794 >> 172.21.15.71:0/2780562794 conn(0x7fef3c0690f0 msgr2=0x7fef3c0b3fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:53.739 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.737+0000 7fef43883700 1 -- 172.21.15.71:0/2780562794 shutdown_connections 2023-10-06T01:42:53.739 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.737+0000 7fef43883700 1 -- 172.21.15.71:0/2780562794 wait complete. 2023-10-06T01:42:53.750 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-10-06T01:42:53.865 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.865+0000 7fb78fc4e700 1 Processor -- start 2023-10-06T01:42:53.866 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.865+0000 7fb78fc4e700 1 -- start start 2023-10-06T01:42:53.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.866+0000 7fb78fc4e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb7880af3f0 0x7fb78815a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:53.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.866+0000 7fb78fc4e700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fb7880af7c0 0x7fb78815d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:53.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.866+0000 7fb78fc4e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb788159960 0x7fb78815d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:53.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.866+0000 7fb78fc4e700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb78815a170 con 0x7fb7880af7c0 2023-10-06T01:42:53.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.866+0000 7fb78fc4e700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7880caeb0 con 0x7fb788159960 2023-10-06T01:42:53.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.866+0000 7fb78fc4e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb78815db80 con 0x7fb7880af3f0 2023-10-06T01:42:53.868 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.866+0000 7fb78d1e9700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fb7880af7c0 0x7fb78815d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:53.869 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.866+0000 7fb78d1e9700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fb7880af7c0 0x7fb78815d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41472/0 (socket says 172.21.15.71:41472) 2023-10-06T01:42:53.869 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.866+0000 7fb78d1e9700 1 -- 172.21.15.71:0/3441581695 learned_addr learned my addr 172.21.15.71:0/3441581695 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:53.869 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.866+0000 7fb78e1eb700 1 --2- 172.21.15.71:0/3441581695 >> v2:172.21.15.72:3300/0 conn(0x7fb788159960 0x7fb78815d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:53.869 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.866+0000 7fb78d9ea700 1 --2- 172.21.15.71:0/3441581695 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb7880af3f0 0x7fb78815a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:53.869 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.866+0000 7fb78d1e9700 1 -- 172.21.15.71:0/3441581695 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb7880af3f0 msgr2=0x7fb78815a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:53.869 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.866+0000 7fb78d1e9700 1 --2- 172.21.15.71:0/3441581695 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb7880af3f0 0x7fb78815a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:53.869 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.866+0000 7fb78d1e9700 1 -- 172.21.15.71:0/3441581695 >> v2:172.21.15.72:3300/0 conn(0x7fb788159960 msgr2=0x7fb78815d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:53.869 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.866+0000 7fb78d1e9700 1 --2- 172.21.15.71:0/3441581695 >> v2:172.21.15.72:3300/0 conn(0x7fb788159960 0x7fb78815d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:53.869 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.866+0000 7fb78d1e9700 1 -- 172.21.15.71:0/3441581695 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb78815de60 con 0x7fb7880af7c0 2023-10-06T01:42:53.869 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.866+0000 7fb78e1eb700 1 --2- 172.21.15.71:0/3441581695 >> v2:172.21.15.72:3300/0 conn(0x7fb788159960 0x7fb78815d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:42:53.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.866+0000 7fb78d1e9700 1 --2- 172.21.15.71:0/3441581695 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb7880af7c0 0x7fb78815d030 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fb78806e070 tx=0x7fb778009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c404f9d33550b12 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:53.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.867+0000 7fb78c9e8700 1 -- 172.21.15.71:0/3441581695 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb77800b860 con 0x7fb7880af7c0 2023-10-06T01:42:53.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.867+0000 7fb78c9e8700 1 -- 172.21.15.71:0/3441581695 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb77800b9c0 con 0x7fb7880af7c0 2023-10-06T01:42:53.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.867+0000 7fb78c9e8700 1 -- 172.21.15.71:0/3441581695 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb77800bd60 con 0x7fb7880af7c0 2023-10-06T01:42:53.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.867+0000 7fb78fc4e700 1 -- 172.21.15.71:0/3441581695 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb7880af7c0 msgr2=0x7fb78815d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:53.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.867+0000 7fb78fc4e700 1 --2- 172.21.15.71:0/3441581695 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb7880af7c0 0x7fb78815d030 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fb78806e070 tx=0x7fb778009250 comp rx=0 tx=0).stop 2023-10-06T01:42:53.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.867+0000 7fb78fc4e700 1 -- 172.21.15.71:0/3441581695 shutdown_connections 2023-10-06T01:42:53.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.867+0000 7fb78fc4e700 1 --2- 172.21.15.71:0/3441581695 >> v2:172.21.15.72:3300/0 conn(0x7fb788159960 0x7fb78815d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:53.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.867+0000 7fb78fc4e700 1 --2- 172.21.15.71:0/3441581695 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb7880af3f0 0x7fb78815a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:53.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.867+0000 7fb78fc4e700 1 --2- 172.21.15.71:0/3441581695 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb7880af7c0 0x7fb78815d030 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:53.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.867+0000 7fb78fc4e700 1 -- 172.21.15.71:0/3441581695 >> 172.21.15.71:0/3441581695 conn(0x7fb78806a260 msgr2=0x7fb7880cd030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:53.870 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.867+0000 7fb78fc4e700 1 -- 172.21.15.71:0/3441581695 shutdown_connections 2023-10-06T01:42:53.871 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.867+0000 7fb78fc4e700 1 -- 172.21.15.71:0/3441581695 wait complete. 2023-10-06T01:42:53.873 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.868+0000 7fb78fc4e700 1 Processor -- start 2023-10-06T01:42:53.873 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.868+0000 7fb78fc4e700 1 -- start start 2023-10-06T01:42:53.873 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.869+0000 7fb78fc4e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb7880af3f0 0x7fb7880c6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:53.873 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.869+0000 7fb78fc4e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb788159960 0x7fb78814ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:53.874 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.869+0000 7fb78fc4e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7880c40e0 0x7fb7881586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:53.874 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.869+0000 7fb78fc4e700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb78814b150 con 0x7fb788159960 2023-10-06T01:42:53.874 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.869+0000 7fb78fc4e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb78816a760 con 0x7fb7880c40e0 2023-10-06T01:42:53.874 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.869+0000 7fb78fc4e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb788169e30 con 0x7fb7880af3f0 2023-10-06T01:42:53.874 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.869+0000 7fb78d1e9700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb788159960 0x7fb78814ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:53.874 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.869+0000 7fb78d1e9700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb788159960 0x7fb78814ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41478/0 (socket says 172.21.15.71:41478) 2023-10-06T01:42:53.874 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.869+0000 7fb78d1e9700 1 -- 172.21.15.71:0/2002590922 learned_addr learned my addr 172.21.15.71:0/2002590922 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:53.874 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.869+0000 7fb78d9ea700 1 --2- 172.21.15.71:0/2002590922 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb7880af3f0 0x7fb7880c6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:53.874 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.869+0000 7fb78e1eb700 1 --2- 172.21.15.71:0/2002590922 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7880c40e0 0x7fb7881586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:53.874 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.869+0000 7fb78d1e9700 1 -- 172.21.15.71:0/2002590922 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb7880af3f0 msgr2=0x7fb7880c6ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:53.874 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.869+0000 7fb78d1e9700 1 --2- 172.21.15.71:0/2002590922 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb7880af3f0 0x7fb7880c6ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:53.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.869+0000 7fb78d1e9700 1 -- 172.21.15.71:0/2002590922 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7880c40e0 msgr2=0x7fb7881586a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:53.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.869+0000 7fb78d1e9700 1 --2- 172.21.15.71:0/2002590922 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7880c40e0 0x7fb7881586a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:53.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.869+0000 7fb78d1e9700 1 -- 172.21.15.71:0/2002590922 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7780094f0 con 0x7fb788159960 2023-10-06T01:42:53.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.870+0000 7fb78d1e9700 1 --2- 172.21.15.71:0/2002590922 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb788159960 0x7fb78814ac10 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fb778009290 tx=0x7fb778017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:53.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.870+0000 7fb77dffb700 1 -- 172.21.15.71:0/2002590922 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb778011e40 con 0x7fb788159960 2023-10-06T01:42:53.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.870+0000 7fb77dffb700 1 -- 172.21.15.71:0/2002590922 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb77801f070 con 0x7fb788159960 2023-10-06T01:42:53.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.870+0000 7fb78fc4e700 1 -- 172.21.15.71:0/2002590922 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb78816a110 con 0x7fb788159960 2023-10-06T01:42:53.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.870+0000 7fb77dffb700 1 -- 172.21.15.71:0/2002590922 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7780266d0 con 0x7fb788159960 2023-10-06T01:42:53.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.870+0000 7fb78fc4e700 1 -- 172.21.15.71:0/2002590922 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb788169aa0 con 0x7fb788159960 2023-10-06T01:42:53.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.871+0000 7fb78fc4e700 1 -- 172.21.15.71:0/2002590922 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb78816aaf0 con 0x7fb788159960 2023-10-06T01:42:53.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.871+0000 7fb77dffb700 1 -- 172.21.15.71:0/2002590922 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb778026a40 con 0x7fb788159960 2023-10-06T01:42:53.875 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.872+0000 7fb77dffb700 1 --2- 172.21.15.71:0/2002590922 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fb76c066f30 0x7fb76c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:53.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.872+0000 7fb77dffb700 1 -- 172.21.15.71:0/2002590922 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5698+0+0 (secure 0 0 0) 0x7fb778021070 con 0x7fb788159960 2023-10-06T01:42:53.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.872+0000 7fb78d9ea700 1 --2- 172.21.15.71:0/2002590922 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fb76c066f30 0x7fb76c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:53.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.872+0000 7fb78d9ea700 1 --2- 172.21.15.71:0/2002590922 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fb76c066f30 0x7fb76c0693e0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fb780009fd0 tx=0x7fb780009880 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:53.876 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:53.876+0000 7fb77dffb700 1 -- 172.21.15.71:0/2002590922 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb78816aaf0 con 0x7fb788159960 2023-10-06T01:42:54.061 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.060+0000 7fb78fc4e700 1 -- 172.21.15.71:0/2002590922 --> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fb78816aaf0 con 0x7fb76c066f30 2023-10-06T01:42:54.061 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.060+0000 7fb77dffb700 1 -- 172.21.15.71:0/2002590922 <== mgr.4107 v2:172.21.15.71:6832/90436 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb78816aaf0 con 0x7fb76c066f30 2023-10-06T01:42:54.063 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.062+0000 7fb78fc4e700 1 -- 172.21.15.71:0/2002590922 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fb76c066f30 msgr2=0x7fb76c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:54.063 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.062+0000 7fb78fc4e700 1 --2- 172.21.15.71:0/2002590922 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fb76c066f30 0x7fb76c0693e0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fb780009fd0 tx=0x7fb780009880 comp rx=0 tx=0).stop 2023-10-06T01:42:54.063 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.062+0000 7fb78fc4e700 1 -- 172.21.15.71:0/2002590922 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb788159960 msgr2=0x7fb78814ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:54.064 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.062+0000 7fb78fc4e700 1 --2- 172.21.15.71:0/2002590922 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb788159960 0x7fb78814ac10 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fb778009290 tx=0x7fb778017000 comp rx=0 tx=0).stop 2023-10-06T01:42:54.064 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.062+0000 7fb78fc4e700 1 -- 172.21.15.71:0/2002590922 shutdown_connections 2023-10-06T01:42:54.064 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.062+0000 7fb78fc4e700 1 --2- 172.21.15.71:0/2002590922 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fb76c066f30 0x7fb76c0693e0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:54.064 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.062+0000 7fb78fc4e700 1 --2- 172.21.15.71:0/2002590922 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7880c40e0 0x7fb7881586a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:54.064 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.062+0000 7fb78fc4e700 1 --2- 172.21.15.71:0/2002590922 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb7880af3f0 0x7fb7880c6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:54.064 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.062+0000 7fb78fc4e700 1 --2- 172.21.15.71:0/2002590922 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb788159960 0x7fb78814ac10 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:54.064 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.062+0000 7fb78fc4e700 1 -- 172.21.15.71:0/2002590922 >> 172.21.15.71:0/2002590922 conn(0x7fb78806a260 msgr2=0x7fb78806d940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:54.064 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.063+0000 7fb78fc4e700 1 -- 172.21.15.71:0/2002590922 shutdown_connections 2023-10-06T01:42:54.064 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.063+0000 7fb78fc4e700 1 -- 172.21.15.71:0/2002590922 wait complete. 2023-10-06T01:42:54.065 INFO:teuthology.orchestra.run.smithi071.stderr:instructed osd(s) 4 to deep-scrub 2023-10-06T01:42:54.075 INFO:tasks.ceph:Scrubbing osd.5 2023-10-06T01:42:54.075 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-10-06T01:42:54.193 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.193+0000 7f1fa759e700 1 Processor -- start 2023-10-06T01:42:54.194 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.193+0000 7f1fa759e700 1 -- start start 2023-10-06T01:42:54.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.194+0000 7f1fa759e700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f1fa80b59a0 0x7f1fa8158c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:54.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.194+0000 7f1fa759e700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fa80cf400 con 0x7f1fa80ce5d0 2023-10-06T01:42:54.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.194+0000 7f1fa759e700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fa80cf6e0 con 0x7f1fa80b5d70 2023-10-06T01:42:54.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.194+0000 7f1fa759e700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fa80cf9c0 con 0x7f1fa80b59a0 2023-10-06T01:42:54.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.194+0000 7f1fa659c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f1fa80b59a0 0x7f1fa8158c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:54.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.194+0000 7f1fa659c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f1fa80b59a0 0x7f1fa8158c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41484/0 (socket says 172.21.15.71:41484) 2023-10-06T01:42:54.196 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.194+0000 7f1fa659c700 1 -- 172.21.15.71:0/3631022501 learned_addr learned my addr 172.21.15.71:0/3631022501 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:54.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.194+0000 7f1fa6d9d700 1 --1- 172.21.15.71:0/3631022501 >> v1:172.21.15.71:6789/0 conn(0x7f1fa80ce5d0 0x7f1fa80ce9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:53496/0 (socket says 172.21.15.71:53496) 2023-10-06T01:42:54.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.194+0000 7f1fa659c700 1 -- 172.21.15.71:0/3631022501 >> v1:172.21.15.72:6789/0 conn(0x7f1fa80b5d70 legacy=0x7f1fa81591d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:54.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.194+0000 7f1fa659c700 1 -- 172.21.15.71:0/3631022501 >> v1:172.21.15.71:6789/0 conn(0x7f1fa80ce5d0 legacy=0x7f1fa80ce9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:54.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.194+0000 7f1fa5d9b700 1 -- 172.21.15.71:0/3631022501 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4165981704 0 0) 0x7f1fa80cf400 con 0x7f1fa80ce5d0 2023-10-06T01:42:54.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.194+0000 7f1fa659c700 1 -- 172.21.15.71:0/3631022501 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fa80cfca0 con 0x7f1fa80b59a0 2023-10-06T01:42:54.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.194+0000 7f1fa659c700 1 --2- 172.21.15.71:0/3631022501 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1fa80b59a0 0x7f1fa8158c90 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f1f980099b0 tx=0x7f1f98009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95e4edabf9ce1d04 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:54.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.194+0000 7f1fa5d9b700 1 -- 172.21.15.71:0/3631022501 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f9800b860 con 0x7f1fa80b59a0 2023-10-06T01:42:54.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.194+0000 7f1fa5d9b700 1 -- 172.21.15.71:0/3631022501 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f9800b9c0 con 0x7f1fa80b59a0 2023-10-06T01:42:54.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.194+0000 7f1fa5d9b700 1 -- 172.21.15.71:0/3631022501 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f9800bd60 con 0x7f1fa80b59a0 2023-10-06T01:42:54.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.195+0000 7f1fa759e700 1 -- 172.21.15.71:0/3631022501 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1fa80b59a0 msgr2=0x7f1fa8158c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:54.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.195+0000 7f1fa759e700 1 --2- 172.21.15.71:0/3631022501 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1fa80b59a0 0x7f1fa8158c90 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f1f980099b0 tx=0x7f1f98009250 comp rx=0 tx=0).stop 2023-10-06T01:42:54.197 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.195+0000 7f1fa759e700 1 -- 172.21.15.71:0/3631022501 shutdown_connections 2023-10-06T01:42:54.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.195+0000 7f1fa759e700 1 --2- 172.21.15.71:0/3631022501 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1fa80b59a0 0x7f1fa8158c90 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:54.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.195+0000 7f1fa759e700 1 -- 172.21.15.71:0/3631022501 >> 172.21.15.71:0/3631022501 conn(0x7f1fa8069150 msgr2=0x7f1fa80b1b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:54.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.195+0000 7f1fa759e700 1 -- 172.21.15.71:0/3631022501 shutdown_connections 2023-10-06T01:42:54.198 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.195+0000 7f1fa759e700 1 -- 172.21.15.71:0/3631022501 wait complete. 2023-10-06T01:42:54.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.196+0000 7f1fa759e700 1 Processor -- start 2023-10-06T01:42:54.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.196+0000 7f1fa759e700 1 -- start start 2023-10-06T01:42:54.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.197+0000 7f1fa759e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1fa80b59a0 0x7f1fa81550d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:54.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.197+0000 7f1fa759e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1fa80b5d70 0x7f1fa815c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:54.201 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.197+0000 7f1fa759e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1fa80ce5d0 0x7f1fa815c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:54.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.197+0000 7f1fa759e700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa8155610 con 0x7f1fa80ce5d0 2023-10-06T01:42:54.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.197+0000 7f1fa759e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa80c7050 con 0x7f1fa80b5d70 2023-10-06T01:42:54.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.197+0000 7f1fa759e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa80cc6f0 con 0x7f1fa80b59a0 2023-10-06T01:42:54.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.197+0000 7f1fa6d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1fa80ce5d0 0x7f1fa815c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:54.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.197+0000 7f1fa6d9d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1fa80ce5d0 0x7f1fa815c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41498/0 (socket says 172.21.15.71:41498) 2023-10-06T01:42:54.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.197+0000 7f1fa6d9d700 1 -- 172.21.15.71:0/676284807 learned_addr learned my addr 172.21.15.71:0/676284807 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:54.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.197+0000 7f1f9ffff700 1 --2- 172.21.15.71:0/676284807 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1fa80b5d70 0x7f1fa815c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:54.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.197+0000 7f1fa659c700 1 --2- 172.21.15.71:0/676284807 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1fa80b59a0 0x7f1fa81550d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:54.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.197+0000 7f1fa6d9d700 1 -- 172.21.15.71:0/676284807 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1fa80b59a0 msgr2=0x7f1fa81550d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:54.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.197+0000 7f1fa6d9d700 1 --2- 172.21.15.71:0/676284807 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1fa80b59a0 0x7f1fa81550d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:54.202 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.197+0000 7f1fa6d9d700 1 -- 172.21.15.71:0/676284807 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1fa80b5d70 msgr2=0x7f1fa815c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:54.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.197+0000 7f1fa6d9d700 1 --2- 172.21.15.71:0/676284807 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1fa80b5d70 0x7f1fa815c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:54.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.197+0000 7f1fa6d9d700 1 -- 172.21.15.71:0/676284807 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f980094f0 con 0x7f1fa80ce5d0 2023-10-06T01:42:54.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.197+0000 7f1f9ffff700 1 --2- 172.21.15.71:0/676284807 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1fa80b5d70 0x7f1fa815c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:42:54.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.197+0000 7f1fa6d9d700 1 --2- 172.21.15.71:0/676284807 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1fa80ce5d0 0x7f1fa815c780 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f1fa000cd30 tx=0x7f1fa0001ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:54.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.197+0000 7f1f9e7fc700 1 -- 172.21.15.71:0/676284807 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa0005df0 con 0x7f1fa80ce5d0 2023-10-06T01:42:54.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.198+0000 7f1f9e7fc700 1 -- 172.21.15.71:0/676284807 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fa000a920 con 0x7f1fa80ce5d0 2023-10-06T01:42:54.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.198+0000 7f1fa759e700 1 -- 172.21.15.71:0/676284807 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fa80cc9d0 con 0x7f1fa80ce5d0 2023-10-06T01:42:54.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.198+0000 7f1f9e7fc700 1 -- 172.21.15.71:0/676284807 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa000ace0 con 0x7f1fa80ce5d0 2023-10-06T01:42:54.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.198+0000 7f1fa759e700 1 -- 172.21.15.71:0/676284807 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fa80c6ce0 con 0x7f1fa80ce5d0 2023-10-06T01:42:54.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.198+0000 7f1fa759e700 1 -- 172.21.15.71:0/676284807 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1fa8088650 con 0x7f1fa80ce5d0 2023-10-06T01:42:54.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.199+0000 7f1f9e7fc700 1 -- 172.21.15.71:0/676284807 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1fa0007300 con 0x7f1fa80ce5d0 2023-10-06T01:42:54.203 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.199+0000 7f1f9e7fc700 1 --2- 172.21.15.71:0/676284807 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f1f88066f30 0x7f1f880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:54.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.199+0000 7f1f9e7fc700 1 -- 172.21.15.71:0/676284807 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f1fa0084780 con 0x7f1fa80ce5d0 2023-10-06T01:42:54.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.199+0000 7f1fa659c700 1 --2- 172.21.15.71:0/676284807 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f1f88066f30 0x7f1f880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:54.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.199+0000 7f1f9e7fc700 1 --2- 172.21.15.71:0/676284807 >> [v2:172.21.15.72:6816/90941,v1:172.21.15.72:6817/90941] conn(0x7f1f8806d8f0 0x7f1f8806fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:54.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.199+0000 7f1f9e7fc700 1 -- 172.21.15.71:0/676284807 --> [v2:172.21.15.72:6816/90941,v1:172.21.15.72:6817/90941] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1f880703f0 con 0x7f1f8806d8f0 2023-10-06T01:42:54.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.199+0000 7f1f9e7fc700 1 -- 172.21.15.71:0/676284807 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_get_version_reply(handle=1 version=61) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1fa0086ce0 con 0x7f1fa80ce5d0 2023-10-06T01:42:54.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.200+0000 7f1fa659c700 1 --2- 172.21.15.71:0/676284807 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f1f88066f30 0x7f1f880693e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f1f980099b0 tx=0x7f1f98017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:54.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.200+0000 7f1f9ffff700 1 --2- 172.21.15.71:0/676284807 >> [v2:172.21.15.72:6816/90941,v1:172.21.15.72:6817/90941] conn(0x7f1f8806d8f0 0x7f1f8806fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:54.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.200+0000 7f1f9ffff700 1 --2- 172.21.15.71:0/676284807 >> [v2:172.21.15.72:6816/90941,v1:172.21.15.72:6817/90941] conn(0x7f1f8806d8f0 0x7f1f8806fd20 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:54.204 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.201+0000 7f1f9e7fc700 1 -- 172.21.15.71:0/676284807 <== osd.5 v2:172.21.15.72:6816/90941 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f1f880703f0 con 0x7f1f8806d8f0 2023-10-06T01:42:54.215 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.214+0000 7f1fa759e700 1 -- 172.21.15.71:0/676284807 --> [v2:172.21.15.72:6816/90941,v1:172.21.15.72:6817/90941] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f1fa8068420 con 0x7f1f8806d8f0 2023-10-06T01:42:54.215 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.215+0000 7f1f9e7fc700 1 -- 172.21.15.71:0/676284807 <== osd.5 v2:172.21.15.72:6816/90941 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f1fa8068420 con 0x7f1f8806d8f0 2023-10-06T01:42:54.216 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2023-10-06T01:42:54.216 INFO:teuthology.orchestra.run.smithi071.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T01:42:54.216 INFO:teuthology.orchestra.run.smithi071.stdout:} 2023-10-06T01:42:54.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.215+0000 7f1fa759e700 1 -- 172.21.15.71:0/676284807 >> [v2:172.21.15.72:6816/90941,v1:172.21.15.72:6817/90941] conn(0x7f1f8806d8f0 msgr2=0x7f1f8806fd20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:54.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.215+0000 7f1fa759e700 1 --2- 172.21.15.71:0/676284807 >> [v2:172.21.15.72:6816/90941,v1:172.21.15.72:6817/90941] conn(0x7f1f8806d8f0 0x7f1f8806fd20 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:54.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.215+0000 7f1fa759e700 1 -- 172.21.15.71:0/676284807 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f1f88066f30 msgr2=0x7f1f880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:54.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.215+0000 7f1fa759e700 1 --2- 172.21.15.71:0/676284807 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f1f88066f30 0x7f1f880693e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f1f980099b0 tx=0x7f1f98017000 comp rx=0 tx=0).stop 2023-10-06T01:42:54.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.215+0000 7f1fa759e700 1 -- 172.21.15.71:0/676284807 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1fa80ce5d0 msgr2=0x7f1fa815c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:54.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.215+0000 7f1fa759e700 1 --2- 172.21.15.71:0/676284807 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1fa80ce5d0 0x7f1fa815c780 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f1fa000cd30 tx=0x7f1fa0001ac0 comp rx=0 tx=0).stop 2023-10-06T01:42:54.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.215+0000 7f1fa6d9d700 1 -- 172.21.15.71:0/676284807 reap_dead start 2023-10-06T01:42:54.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.215+0000 7f1fa759e700 1 -- 172.21.15.71:0/676284807 shutdown_connections 2023-10-06T01:42:54.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.215+0000 7f1fa759e700 1 -- 172.21.15.71:0/676284807 >> 172.21.15.71:0/676284807 conn(0x7f1fa8069150 msgr2=0x7f1fa8156090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:54.217 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.215+0000 7f1fa759e700 1 -- 172.21.15.71:0/676284807 shutdown_connections 2023-10-06T01:42:54.218 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.215+0000 7f1fa759e700 1 -- 172.21.15.71:0/676284807 wait complete. 2023-10-06T01:42:54.227 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-10-06T01:42:54.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.342+0000 7fd195b54700 1 Processor -- start 2023-10-06T01:42:54.343 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.342+0000 7fd195b54700 1 -- start start 2023-10-06T01:42:54.346 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.343+0000 7fd195b54700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd190159400 0x7fd1900ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:54.346 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.343+0000 7fd195b54700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd1900cd030 0x7fd1900cfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:54.346 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.343+0000 7fd195b54700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1900b3560 con 0x7fd1900cf1a0 2023-10-06T01:42:54.346 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.343+0000 7fd195b54700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1900cf6f0 con 0x7fd190159400 2023-10-06T01:42:54.346 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.343+0000 7fd195b54700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1900cf9d0 con 0x7fd1900cd030 2023-10-06T01:42:54.346 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.343+0000 7fd195353700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fd1900cf1a0 0x7fd1900b5240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:53510/0 (socket says 172.21.15.71:53510) 2023-10-06T01:42:54.346 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.343+0000 7fd195353700 1 -- 172.21.15.71:0/2430089112 learned_addr learned my addr 172.21.15.71:0/2430089112 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:42:54.346 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.343+0000 7fd194b52700 1 --2- 172.21.15.71:0/2430089112 >> v2:172.21.15.72:3300/0 conn(0x7fd190159400 0x7fd1900ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:54.346 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.343+0000 7fd18ffff700 1 --2- 172.21.15.71:0/2430089112 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd1900cd030 0x7fd1900cfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:54.346 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.343+0000 7fd18f7fe700 1 -- 172.21.15.71:0/2430089112 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3299375680 0 0) 0x7fd1900b3560 con 0x7fd1900cf1a0 2023-10-06T01:42:54.346 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.343+0000 7fd18f7fe700 1 -- 172.21.15.71:0/2430089112 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd180003570 con 0x7fd1900cf1a0 2023-10-06T01:42:54.347 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.343+0000 7fd194b52700 1 -- 172.21.15.71:0/2430089112 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd1900cd030 msgr2=0x7fd1900cfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:54.347 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.343+0000 7fd194b52700 1 --2- 172.21.15.71:0/2430089112 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd1900cd030 0x7fd1900cfec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:54.347 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.343+0000 7fd194b52700 1 -- 172.21.15.71:0/2430089112 >> v1:172.21.15.71:6789/0 conn(0x7fd1900cf1a0 legacy=0x7fd1900b5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:54.347 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.343+0000 7fd194b52700 1 -- 172.21.15.71:0/2430089112 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1900b2f10 con 0x7fd190159400 2023-10-06T01:42:54.347 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.343+0000 7fd18ffff700 1 --2- 172.21.15.71:0/2430089112 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd1900cd030 0x7fd1900cfec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:42:54.347 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.344+0000 7fd194b52700 1 --2- 172.21.15.71:0/2430089112 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd190159400 0x7fd1900ccaf0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd1840098d0 tx=0x7fd184009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ca1acca6229edd5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:54.347 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.344+0000 7fd18f7fe700 1 -- 172.21.15.71:0/2430089112 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd184005c10 con 0x7fd190159400 2023-10-06T01:42:54.347 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.344+0000 7fd18f7fe700 1 -- 172.21.15.71:0/2430089112 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd184005d70 con 0x7fd190159400 2023-10-06T01:42:54.347 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.344+0000 7fd18f7fe700 1 -- 172.21.15.71:0/2430089112 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd184006260 con 0x7fd190159400 2023-10-06T01:42:54.347 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.344+0000 7fd195b54700 1 -- 172.21.15.71:0/2430089112 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd190159400 msgr2=0x7fd1900ccaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:54.347 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.344+0000 7fd195b54700 1 --2- 172.21.15.71:0/2430089112 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd190159400 0x7fd1900ccaf0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd1840098d0 tx=0x7fd184009120 comp rx=0 tx=0).stop 2023-10-06T01:42:54.348 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.344+0000 7fd195b54700 1 -- 172.21.15.71:0/2430089112 shutdown_connections 2023-10-06T01:42:54.348 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.344+0000 7fd195b54700 1 --2- 172.21.15.71:0/2430089112 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd190159400 0x7fd1900ccaf0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:54.348 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.344+0000 7fd195b54700 1 --2- 172.21.15.71:0/2430089112 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd1900cd030 0x7fd1900cfec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:54.348 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.344+0000 7fd195b54700 1 -- 172.21.15.71:0/2430089112 >> 172.21.15.71:0/2430089112 conn(0x7fd19006ac10 msgr2=0x7fd190068680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:54.348 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.344+0000 7fd195b54700 1 -- 172.21.15.71:0/2430089112 shutdown_connections 2023-10-06T01:42:54.348 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.344+0000 7fd195b54700 1 -- 172.21.15.71:0/2430089112 wait complete. 2023-10-06T01:42:54.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.345+0000 7fd195b54700 1 Processor -- start 2023-10-06T01:42:54.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.346+0000 7fd195b54700 1 -- start start 2023-10-06T01:42:54.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.346+0000 7fd195b54700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1900cd030 0x7fd19013fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:54.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.346+0000 7fd195b54700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1900cf1a0 0x7fd19015b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:54.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.346+0000 7fd195b54700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd190159400 0x7fd19015b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:54.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.346+0000 7fd195b54700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1901562b0 con 0x7fd1900cf1a0 2023-10-06T01:42:54.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.346+0000 7fd195b54700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1901403e0 con 0x7fd1900cd030 2023-10-06T01:42:54.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.346+0000 7fd195b54700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1901556a0 con 0x7fd190159400 2023-10-06T01:42:54.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.346+0000 7fd18ffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1900cf1a0 0x7fd19015b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:54.351 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.346+0000 7fd18ffff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1900cf1a0 0x7fd19015b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41514/0 (socket says 172.21.15.71:41514) 2023-10-06T01:42:54.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.347+0000 7fd18ffff700 1 -- 172.21.15.71:0/265737453 learned_addr learned my addr 172.21.15.71:0/265737453 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:54.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.347+0000 7fd194b52700 1 --2- 172.21.15.71:0/265737453 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1900cd030 0x7fd19013fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:54.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.347+0000 7fd195353700 1 --2- 172.21.15.71:0/265737453 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd190159400 0x7fd19015b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:54.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.347+0000 7fd18ffff700 1 -- 172.21.15.71:0/265737453 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd190159400 msgr2=0x7fd19015b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:54.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.347+0000 7fd18ffff700 1 --2- 172.21.15.71:0/265737453 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd190159400 0x7fd19015b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:54.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.347+0000 7fd18ffff700 1 -- 172.21.15.71:0/265737453 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1900cd030 msgr2=0x7fd19013fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:54.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.347+0000 7fd18ffff700 1 --2- 172.21.15.71:0/265737453 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1900cd030 0x7fd19013fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:54.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.347+0000 7fd18ffff700 1 -- 172.21.15.71:0/265737453 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd17c009420 con 0x7fd1900cf1a0 2023-10-06T01:42:54.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.347+0000 7fd194b52700 1 --2- 172.21.15.71:0/265737453 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1900cd030 0x7fd19013fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:42:54.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.347+0000 7fd195353700 1 --2- 172.21.15.71:0/265737453 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd190159400 0x7fd19015b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:42:54.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.347+0000 7fd18ffff700 1 --2- 172.21.15.71:0/265737453 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1900cf1a0 0x7fd19015b080 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fd17c00ec80 tx=0x7fd17c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:54.352 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.347+0000 7fd18cff9700 1 -- 172.21.15.71:0/265737453 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd17c00c9d0 con 0x7fd1900cf1a0 2023-10-06T01:42:54.353 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.347+0000 7fd18cff9700 1 -- 172.21.15.71:0/265737453 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd17c00cb30 con 0x7fd1900cf1a0 2023-10-06T01:42:54.353 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.347+0000 7fd195b54700 1 -- 172.21.15.71:0/265737453 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1840093c0 con 0x7fd1900cf1a0 2023-10-06T01:42:54.353 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.347+0000 7fd18cff9700 1 -- 172.21.15.71:0/265737453 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd17c00ceb0 con 0x7fd1900cf1a0 2023-10-06T01:42:54.353 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.347+0000 7fd195b54700 1 -- 172.21.15.71:0/265737453 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd190155c60 con 0x7fd1900cf1a0 2023-10-06T01:42:54.353 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.348+0000 7fd195b54700 1 -- 172.21.15.71:0/265737453 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd190156420 con 0x7fd1900cf1a0 2023-10-06T01:42:54.353 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.348+0000 7fd18cff9700 1 -- 172.21.15.71:0/265737453 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd17c013680 con 0x7fd1900cf1a0 2023-10-06T01:42:54.353 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.349+0000 7fd18cff9700 1 --2- 172.21.15.71:0/265737453 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fd174066f30 0x7fd1740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:54.353 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.349+0000 7fd18cff9700 1 -- 172.21.15.71:0/265737453 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5698+0+0 (secure 0 0 0) 0x7fd17c084990 con 0x7fd1900cf1a0 2023-10-06T01:42:54.353 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.349+0000 7fd194b52700 1 --2- 172.21.15.71:0/265737453 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fd174066f30 0x7fd1740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:54.353 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.349+0000 7fd194b52700 1 --2- 172.21.15.71:0/265737453 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fd174066f30 0x7fd1740693e0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fd184009160 tx=0x7fd184016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:54.354 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.353+0000 7fd18cff9700 1 -- 172.21.15.71:0/265737453 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd17c051c00 con 0x7fd1900cf1a0 2023-10-06T01:42:54.536 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.536+0000 7fd195b54700 1 -- 172.21.15.71:0/265737453 --> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fd190159860 con 0x7fd174066f30 2023-10-06T01:42:54.537 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.536+0000 7fd18cff9700 1 -- 172.21.15.71:0/265737453 <== mgr.4107 v2:172.21.15.71:6832/90436 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd190159860 con 0x7fd174066f30 2023-10-06T01:42:54.539 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.538+0000 7fd195b54700 1 -- 172.21.15.71:0/265737453 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fd174066f30 msgr2=0x7fd1740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:54.539 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.538+0000 7fd195b54700 1 --2- 172.21.15.71:0/265737453 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fd174066f30 0x7fd1740693e0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fd184009160 tx=0x7fd184016000 comp rx=0 tx=0).stop 2023-10-06T01:42:54.539 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.538+0000 7fd195b54700 1 -- 172.21.15.71:0/265737453 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1900cf1a0 msgr2=0x7fd19015b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:54.539 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.538+0000 7fd195b54700 1 --2- 172.21.15.71:0/265737453 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1900cf1a0 0x7fd19015b080 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fd17c00ec80 tx=0x7fd17c0091a0 comp rx=0 tx=0).stop 2023-10-06T01:42:54.539 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.538+0000 7fd195b54700 1 -- 172.21.15.71:0/265737453 shutdown_connections 2023-10-06T01:42:54.539 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.538+0000 7fd195b54700 1 --2- 172.21.15.71:0/265737453 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd190159400 0x7fd19015b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:54.539 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.538+0000 7fd195b54700 1 --2- 172.21.15.71:0/265737453 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fd174066f30 0x7fd1740693e0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:54.539 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.538+0000 7fd195b54700 1 --2- 172.21.15.71:0/265737453 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1900cd030 0x7fd19013fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:54.540 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.538+0000 7fd195b54700 1 --2- 172.21.15.71:0/265737453 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1900cf1a0 0x7fd19015b080 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:54.540 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.538+0000 7fd195b54700 1 -- 172.21.15.71:0/265737453 >> 172.21.15.71:0/265737453 conn(0x7fd19006ac10 msgr2=0x7fd1900b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:54.540 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.538+0000 7fd195b54700 1 -- 172.21.15.71:0/265737453 shutdown_connections 2023-10-06T01:42:54.540 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.538+0000 7fd195b54700 1 -- 172.21.15.71:0/265737453 wait complete. 2023-10-06T01:42:54.540 INFO:teuthology.orchestra.run.smithi071.stderr:instructed osd(s) 5 to deep-scrub 2023-10-06T01:42:54.551 INFO:tasks.ceph:Scrubbing osd.6 2023-10-06T01:42:54.551 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-10-06T01:42:54.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.669+0000 7fe0e974c700 1 Processor -- start 2023-10-06T01:42:54.670 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.669+0000 7fe0e974c700 1 -- start start 2023-10-06T01:42:54.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.670+0000 7fe0e974c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe0e41598b0 0x7fe0e40afef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:54.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.670+0000 7fe0e974c700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0e40afa60 con 0x7fe0e40b0430 2023-10-06T01:42:54.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.670+0000 7fe0e974c700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0e40af440 con 0x7fe0e415b940 2023-10-06T01:42:54.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.670+0000 7fe0e974c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e415ab00 con 0x7fe0e41598b0 2023-10-06T01:42:54.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.670+0000 7fe0da7fc700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fe0e40b0430 0x7fe0e415b230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:53516/0 (socket says 172.21.15.71:53516) 2023-10-06T01:42:54.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.670+0000 7fe0da7fc700 1 -- 172.21.15.71:0/515906049 learned_addr learned my addr 172.21.15.71:0/515906049 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:42:54.674 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.670+0000 7fe0e2ffd700 1 --2- 172.21.15.71:0/515906049 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe0e41598b0 0x7fe0e40afef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:54.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.670+0000 7fe0e27fc700 1 -- 172.21.15.71:0/515906049 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 508608292 0 0) 0x7fe0e40afa60 con 0x7fe0e40b0430 2023-10-06T01:42:54.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.671+0000 7fe0e27fc700 1 -- 172.21.15.71:0/515906049 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0d0003570 con 0x7fe0e40b0430 2023-10-06T01:42:54.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.671+0000 7fe0e27fc700 1 -- 172.21.15.71:0/515906049 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 126395494 0 0) 0x7fe0d0003570 con 0x7fe0e40b0430 2023-10-06T01:42:54.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.671+0000 7fe0e27fc700 1 -- 172.21.15.71:0/515906049 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe0e41598b0 msgr2=0x7fe0e40afef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:54.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.671+0000 7fe0e27fc700 1 --2- 172.21.15.71:0/515906049 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe0e41598b0 0x7fe0e40afef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:54.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.671+0000 7fe0e27fc700 1 -- 172.21.15.71:0/515906049 >> v1:172.21.15.72:6789/0 conn(0x7fe0e415b940 legacy=0x7fe0e4159c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:54.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.671+0000 7fe0e27fc700 1 -- 172.21.15.71:0/515906049 --> v1:172.21.15.71:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0e415ade0 con 0x7fe0e40b0430 2023-10-06T01:42:54.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.671+0000 7fe0e27fc700 1 -- 172.21.15.71:0/515906049 <== mon.0 v1:172.21.15.71:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1184243524 0 0) 0x7fe0cc001470 con 0x7fe0e40b0430 2023-10-06T01:42:54.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.671+0000 7fe0e27fc700 1 -- 172.21.15.71:0/515906049 >> v1:172.21.15.71:6789/0 conn(0x7fe0e40b0430 legacy=0x7fe0e415b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:54.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.671+0000 7fe0e27fc700 1 --2- 172.21.15.71:0/515906049 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0d0003a90 0x7fe0d0003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:54.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.671+0000 7fe0e27fc700 1 --2- 172.21.15.71:0/515906049 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0d0004810 0x7fe0d0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:54.675 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.671+0000 7fe0e27fc700 1 --2- 172.21.15.71:0/515906049 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe0e41598b0 0x7fe0d00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:54.676 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.671+0000 7fe0e27fc700 1 -- 172.21.15.71:0/515906049 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e415ab00 con 0x7fe0d0004810 2023-10-06T01:42:54.676 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.671+0000 7fe0e27fc700 1 -- 172.21.15.71:0/515906049 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d000bb40 con 0x7fe0d0003a90 2023-10-06T01:42:54.676 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.671+0000 7fe0e27fc700 1 -- 172.21.15.71:0/515906049 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d000bd00 con 0x7fe0e41598b0 2023-10-06T01:42:54.676 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.671+0000 7fe0da7fc700 1 --2- 172.21.15.71:0/515906049 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0d0004810 0x7fe0d0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:54.676 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.671+0000 7fe0e2ffd700 1 --2- 172.21.15.71:0/515906049 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0d0003a90 0x7fe0d0003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:54.676 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.671+0000 7fe0e37fe700 1 --2- 172.21.15.71:0/515906049 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe0e41598b0 0x7fe0d00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:54.676 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.671+0000 7fe0da7fc700 1 -- 172.21.15.71:0/515906049 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe0e41598b0 msgr2=0x7fe0d00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:54.676 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.671+0000 7fe0da7fc700 1 --2- 172.21.15.71:0/515906049 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe0e41598b0 0x7fe0d00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:54.676 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.671+0000 7fe0da7fc700 1 -- 172.21.15.71:0/515906049 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0d0003a90 msgr2=0x7fe0d0003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:54.676 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.671+0000 7fe0da7fc700 1 --2- 172.21.15.71:0/515906049 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0d0003a90 0x7fe0d0003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:54.676 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.671+0000 7fe0da7fc700 1 -- 172.21.15.71:0/515906049 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0d0003570 con 0x7fe0d0004810 2023-10-06T01:42:54.677 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.671+0000 7fe0e37fe700 1 --2- 172.21.15.71:0/515906049 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe0e41598b0 0x7fe0d00051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:42:54.677 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.671+0000 7fe0da7fc700 1 --2- 172.21.15.71:0/515906049 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0d0004810 0x7fe0d0004c80 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc00c2a0 tx=0x7fe0cc001da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5d3948ab42f8d6a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:54.677 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.671+0000 7fe0e27fc700 1 -- 172.21.15.71:0/515906049 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0cc00cb70 con 0x7fe0d0004810 2023-10-06T01:42:54.677 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.671+0000 7fe0e27fc700 1 -- 172.21.15.71:0/515906049 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0cc00ccd0 con 0x7fe0d0004810 2023-10-06T01:42:54.677 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.672+0000 7fe0e27fc700 1 -- 172.21.15.71:0/515906049 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0cc005b70 con 0x7fe0d0004810 2023-10-06T01:42:54.677 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.672+0000 7fe0e974c700 1 -- 172.21.15.71:0/515906049 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0d0004810 msgr2=0x7fe0d0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:54.677 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.672+0000 7fe0e974c700 1 --2- 172.21.15.71:0/515906049 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0d0004810 0x7fe0d0004c80 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc00c2a0 tx=0x7fe0cc001da0 comp rx=0 tx=0).stop 2023-10-06T01:42:54.677 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.672+0000 7fe0e37fe700 1 -- 172.21.15.71:0/515906049 reap_dead start 2023-10-06T01:42:54.677 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.672+0000 7fe0e974c700 1 -- 172.21.15.71:0/515906049 shutdown_connections 2023-10-06T01:42:54.677 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.672+0000 7fe0e974c700 1 -- 172.21.15.71:0/515906049 >> 172.21.15.71:0/515906049 conn(0x7fe0e4067910 msgr2=0x7fe0e40ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:54.677 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.672+0000 7fe0e974c700 1 -- 172.21.15.71:0/515906049 shutdown_connections 2023-10-06T01:42:54.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.672+0000 7fe0e974c700 1 -- 172.21.15.71:0/515906049 wait complete. 2023-10-06T01:42:54.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.673+0000 7fe0e974c700 1 Processor -- start 2023-10-06T01:42:54.678 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.673+0000 7fe0e974c700 1 -- start start 2023-10-06T01:42:54.680 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.674+0000 7fe0e974c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe0d0004810 0x7fe0e409b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:54.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.674+0000 7fe0e974c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0e4099b20 0x7fe0e4099f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:54.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.674+0000 7fe0e974c700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0e409a4d0 0x7fe0e409a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:54.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.674+0000 7fe0e974c700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e409bd50 con 0x7fe0e409a4d0 2023-10-06T01:42:54.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.674+0000 7fe0e974c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e409aeb0 con 0x7fe0e4099b20 2023-10-06T01:42:54.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.674+0000 7fe0e974c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e409bab0 con 0x7fe0d0004810 2023-10-06T01:42:54.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.674+0000 7fe0e37fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0e409a4d0 0x7fe0e409a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:54.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.674+0000 7fe0e37fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0e409a4d0 0x7fe0e409a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41520/0 (socket says 172.21.15.71:41520) 2023-10-06T01:42:54.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.674+0000 7fe0e37fe700 1 -- 172.21.15.71:0/1492612962 learned_addr learned my addr 172.21.15.71:0/1492612962 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:54.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.674+0000 7fe0e2ffd700 1 --2- 172.21.15.71:0/1492612962 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe0d0004810 0x7fe0e409b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:54.681 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.674+0000 7fe0da7fc700 1 --2- 172.21.15.71:0/1492612962 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0e4099b20 0x7fe0e4099f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:54.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.674+0000 7fe0e37fe700 1 -- 172.21.15.71:0/1492612962 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe0d0004810 msgr2=0x7fe0e409b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:54.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.674+0000 7fe0e37fe700 1 --2- 172.21.15.71:0/1492612962 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe0d0004810 0x7fe0e409b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:54.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.674+0000 7fe0e37fe700 1 -- 172.21.15.71:0/1492612962 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0e4099b20 msgr2=0x7fe0e4099f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:54.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.674+0000 7fe0e37fe700 1 --2- 172.21.15.71:0/1492612962 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0e4099b20 0x7fe0e4099f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:54.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.674+0000 7fe0e37fe700 1 -- 172.21.15.71:0/1492612962 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0e4098d60 con 0x7fe0e409a4d0 2023-10-06T01:42:54.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.674+0000 7fe0e37fe700 1 --2- 172.21.15.71:0/1492612962 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0e409a4d0 0x7fe0e409a970 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fe0e4087630 tx=0x7fe0dc009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:54.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.675+0000 7fe0db7fe700 1 -- 172.21.15.71:0/1492612962 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0dc013630 con 0x7fe0e409a4d0 2023-10-06T01:42:54.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.675+0000 7fe0db7fe700 1 -- 172.21.15.71:0/1492612962 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0dc0137b0 con 0x7fe0e409a4d0 2023-10-06T01:42:54.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.675+0000 7fe0e974c700 1 -- 172.21.15.71:0/1492612962 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0e4099040 con 0x7fe0e409a4d0 2023-10-06T01:42:54.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.675+0000 7fe0db7fe700 1 -- 172.21.15.71:0/1492612962 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0dc013b70 con 0x7fe0e409a4d0 2023-10-06T01:42:54.682 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.675+0000 7fe0e974c700 1 -- 172.21.15.71:0/1492612962 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0e4099600 con 0x7fe0e409a4d0 2023-10-06T01:42:54.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.675+0000 7fe0e974c700 1 -- 172.21.15.71:0/1492612962 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe0e404bb80 con 0x7fe0e409a4d0 2023-10-06T01:42:54.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.676+0000 7fe0db7fe700 1 -- 172.21.15.71:0/1492612962 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe0dc003030 con 0x7fe0e409a4d0 2023-10-06T01:42:54.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.676+0000 7fe0db7fe700 1 --2- 172.21.15.71:0/1492612962 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fe0c4066f30 0x7fe0c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:54.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.676+0000 7fe0db7fe700 1 -- 172.21.15.71:0/1492612962 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5698+0+0 (secure 0 0 0) 0x7fe0dc0844e0 con 0x7fe0e409a4d0 2023-10-06T01:42:54.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.676+0000 7fe0e2ffd700 1 --2- 172.21.15.71:0/1492612962 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fe0c4066f30 0x7fe0c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:54.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.677+0000 7fe0db7fe700 1 --2- 172.21.15.71:0/1492612962 >> [v2:172.21.15.72:6808/90918,v1:172.21.15.72:6809/90918] conn(0x7fe0c406d8f0 0x7fe0c406fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:54.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.677+0000 7fe0db7fe700 1 -- 172.21.15.71:0/1492612962 --> [v2:172.21.15.72:6808/90918,v1:172.21.15.72:6809/90918] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe0c40703f0 con 0x7fe0c406d8f0 2023-10-06T01:42:54.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.677+0000 7fe0db7fe700 1 -- 172.21.15.71:0/1492612962 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_get_version_reply(handle=1 version=61) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe0dc086b20 con 0x7fe0e409a4d0 2023-10-06T01:42:54.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.677+0000 7fe0da7fc700 1 --2- 172.21.15.71:0/1492612962 >> [v2:172.21.15.72:6808/90918,v1:172.21.15.72:6809/90918] conn(0x7fe0c406d8f0 0x7fe0c406fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:54.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.677+0000 7fe0e2ffd700 1 --2- 172.21.15.71:0/1492612962 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fe0c4066f30 0x7fe0c40693e0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fe0d4006aa0 tx=0x7fe0d4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:54.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.677+0000 7fe0da7fc700 1 --2- 172.21.15.71:0/1492612962 >> [v2:172.21.15.72:6808/90918,v1:172.21.15.72:6809/90918] conn(0x7fe0c406d8f0 0x7fe0c406fd20 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:54.683 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.678+0000 7fe0db7fe700 1 -- 172.21.15.71:0/1492612962 <== osd.6 v2:172.21.15.72:6808/90918 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fe0c40703f0 con 0x7fe0c406d8f0 2023-10-06T01:42:54.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.691+0000 7fe0e974c700 1 -- 172.21.15.71:0/1492612962 --> [v2:172.21.15.72:6808/90918,v1:172.21.15.72:6809/90918] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe0e40b0890 con 0x7fe0c406d8f0 2023-10-06T01:42:54.692 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.692+0000 7fe0db7fe700 1 -- 172.21.15.71:0/1492612962 <== osd.6 v2:172.21.15.72:6808/90918 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fe0e40b0890 con 0x7fe0c406d8f0 2023-10-06T01:42:54.693 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2023-10-06T01:42:54.693 INFO:teuthology.orchestra.run.smithi071.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T01:42:54.693 INFO:teuthology.orchestra.run.smithi071.stdout:} 2023-10-06T01:42:54.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.692+0000 7fe0e974c700 1 -- 172.21.15.71:0/1492612962 >> [v2:172.21.15.72:6808/90918,v1:172.21.15.72:6809/90918] conn(0x7fe0c406d8f0 msgr2=0x7fe0c406fd20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:54.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.692+0000 7fe0e974c700 1 --2- 172.21.15.71:0/1492612962 >> [v2:172.21.15.72:6808/90918,v1:172.21.15.72:6809/90918] conn(0x7fe0c406d8f0 0x7fe0c406fd20 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:54.694 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.692+0000 7fe0e974c700 1 -- 172.21.15.71:0/1492612962 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fe0c4066f30 msgr2=0x7fe0c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:54.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.692+0000 7fe0e974c700 1 --2- 172.21.15.71:0/1492612962 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fe0c4066f30 0x7fe0c40693e0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fe0d4006aa0 tx=0x7fe0d4008040 comp rx=0 tx=0).stop 2023-10-06T01:42:54.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.692+0000 7fe0e974c700 1 -- 172.21.15.71:0/1492612962 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0e409a4d0 msgr2=0x7fe0e409a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:54.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.692+0000 7fe0e974c700 1 --2- 172.21.15.71:0/1492612962 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0e409a4d0 0x7fe0e409a970 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fe0e4087630 tx=0x7fe0dc009040 comp rx=0 tx=0).stop 2023-10-06T01:42:54.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.692+0000 7fe0e37fe700 1 -- 172.21.15.71:0/1492612962 reap_dead start 2023-10-06T01:42:54.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.692+0000 7fe0e974c700 1 -- 172.21.15.71:0/1492612962 shutdown_connections 2023-10-06T01:42:54.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.692+0000 7fe0e974c700 1 -- 172.21.15.71:0/1492612962 >> 172.21.15.71:0/1492612962 conn(0x7fe0e4067910 msgr2=0x7fe0e4158770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:54.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.693+0000 7fe0e974c700 1 -- 172.21.15.71:0/1492612962 shutdown_connections 2023-10-06T01:42:54.695 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.693+0000 7fe0e974c700 1 -- 172.21.15.71:0/1492612962 wait complete. 2023-10-06T01:42:54.705 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-10-06T01:42:54.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.819+0000 7f0fe3a6e700 1 Processor -- start 2023-10-06T01:42:54.820 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.819+0000 7f0fe3a6e700 1 -- start start 2023-10-06T01:42:54.822 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.820+0000 7f0fe3a6e700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f0fdc0b28c0 0x7f0fdc087470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:54.822 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.820+0000 7f0fe3a6e700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fdc0afc50 con 0x7f0fdc086ff0 2023-10-06T01:42:54.822 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.820+0000 7f0fe3a6e700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fdc0aff30 con 0x7f0fdc15a030 2023-10-06T01:42:54.823 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.820+0000 7f0fe3a6e700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fdc0b0cf0 con 0x7f0fdc0b28c0 2023-10-06T01:42:54.823 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.820+0000 7f0fe200b700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f0fdc0b28c0 0x7f0fdc087470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:54.823 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.820+0000 7f0fe1009700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f0fdc086ff0 0x7f0fdc0b21b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:53530/0 (socket says 172.21.15.71:53530) 2023-10-06T01:42:54.823 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.820+0000 7f0fe1009700 1 -- 172.21.15.71:0/380206263 learned_addr learned my addr 172.21.15.71:0/380206263 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:42:54.823 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.821+0000 7f0fe200b700 1 -- 172.21.15.71:0/380206263 >> v1:172.21.15.72:6789/0 conn(0x7f0fdc15a030 legacy=0x7f0fdc15a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:54.823 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.821+0000 7f0fe200b700 1 -- 172.21.15.71:0/380206263 >> v1:172.21.15.71:6789/0 conn(0x7f0fdc086ff0 legacy=0x7f0fdc0b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:54.823 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.821+0000 7f0fe200b700 1 -- 172.21.15.71:0/380206263 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fdc0b0210 con 0x7f0fdc0b28c0 2023-10-06T01:42:54.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.821+0000 7f0fe0808700 1 -- 172.21.15.71:0/380206263 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2909046272 0 0) 0x7f0fdc0afc50 con 0x7f0fdc086ff0 2023-10-06T01:42:54.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.821+0000 7f0fe200b700 1 --2- 172.21.15.71:0/380206263 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0fdc0b28c0 0x7f0fdc087470 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f0fd40098e0 tx=0x7f0fd40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=740a78c466d53593 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:54.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.821+0000 7f0fe0808700 1 -- 172.21.15.71:0/380206263 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fd4009e80 con 0x7f0fdc0b28c0 2023-10-06T01:42:54.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.821+0000 7f0fe0808700 1 -- 172.21.15.71:0/380206263 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fd400b820 con 0x7f0fdc0b28c0 2023-10-06T01:42:54.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.821+0000 7f0fe0808700 1 -- 172.21.15.71:0/380206263 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fd400bba0 con 0x7f0fdc0b28c0 2023-10-06T01:42:54.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.822+0000 7f0fe3a6e700 1 -- 172.21.15.71:0/380206263 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0fdc0b28c0 msgr2=0x7f0fdc087470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:54.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.822+0000 7f0fe3a6e700 1 --2- 172.21.15.71:0/380206263 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0fdc0b28c0 0x7f0fdc087470 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f0fd40098e0 tx=0x7f0fd40091a0 comp rx=0 tx=0).stop 2023-10-06T01:42:54.824 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.822+0000 7f0fe3a6e700 1 -- 172.21.15.71:0/380206263 shutdown_connections 2023-10-06T01:42:54.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.822+0000 7f0fe3a6e700 1 --2- 172.21.15.71:0/380206263 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0fdc0b28c0 0x7f0fdc087470 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:54.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.822+0000 7f0fe3a6e700 1 -- 172.21.15.71:0/380206263 >> 172.21.15.71:0/380206263 conn(0x7f0fdc068680 msgr2=0x7f0fdc068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:54.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.822+0000 7f0fe3a6e700 1 -- 172.21.15.71:0/380206263 shutdown_connections 2023-10-06T01:42:54.825 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.822+0000 7f0fe3a6e700 1 -- 172.21.15.71:0/380206263 wait complete. 2023-10-06T01:42:54.827 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.823+0000 7f0fe3a6e700 1 Processor -- start 2023-10-06T01:42:54.828 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.823+0000 7f0fe3a6e700 1 -- start start 2023-10-06T01:42:54.828 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.823+0000 7f0fe3a6e700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0fdc086ff0 0x7f0fdc15ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:54.828 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.823+0000 7f0fe3a6e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fdc0b28c0 0x7f0fdc0b5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:54.828 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.823+0000 7f0fe3a6e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fdc15a030 0x7f0fdc1552c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:54.828 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.823+0000 7f0fe3a6e700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fdc0c72f0 con 0x7f0fdc086ff0 2023-10-06T01:42:54.828 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.823+0000 7f0fe3a6e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fdc0b6130 con 0x7f0fdc0b28c0 2023-10-06T01:42:54.828 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.823+0000 7f0fe3a6e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fdc15c080 con 0x7f0fdc15a030 2023-10-06T01:42:54.829 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.823+0000 7f0fe180a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0fdc086ff0 0x7f0fdc15ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:54.829 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.824+0000 7f0fe180a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0fdc086ff0 0x7f0fdc15ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41538/0 (socket says 172.21.15.71:41538) 2023-10-06T01:42:54.829 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.824+0000 7f0fe180a700 1 -- 172.21.15.71:0/2360254659 learned_addr learned my addr 172.21.15.71:0/2360254659 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:54.829 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.824+0000 7f0fe180a700 1 -- 172.21.15.71:0/2360254659 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fdc15a030 msgr2=0x7f0fdc1552c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:54.829 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.824+0000 7f0fe180a700 1 --2- 172.21.15.71:0/2360254659 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fdc15a030 0x7f0fdc1552c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:54.829 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.824+0000 7f0fe180a700 1 -- 172.21.15.71:0/2360254659 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fdc0b28c0 msgr2=0x7f0fdc0b5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:54.829 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.824+0000 7f0fe180a700 1 --2- 172.21.15.71:0/2360254659 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fdc0b28c0 0x7f0fdc0b5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:54.829 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.824+0000 7f0fe180a700 1 -- 172.21.15.71:0/2360254659 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fd4009420 con 0x7f0fdc086ff0 2023-10-06T01:42:54.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.824+0000 7f0fe180a700 1 --2- 172.21.15.71:0/2360254659 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0fdc086ff0 0x7f0fdc15ca80 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f0fd800c950 tx=0x7f0fd8002760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:54.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.824+0000 7f0fd1ffb700 1 -- 172.21.15.71:0/2360254659 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fd800a7e0 con 0x7f0fdc086ff0 2023-10-06T01:42:54.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.824+0000 7f0fd1ffb700 1 -- 172.21.15.71:0/2360254659 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fd800a960 con 0x7f0fdc086ff0 2023-10-06T01:42:54.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.824+0000 7f0fe3a6e700 1 -- 172.21.15.71:0/2360254659 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fdc15c360 con 0x7f0fdc086ff0 2023-10-06T01:42:54.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.824+0000 7f0fd1ffb700 1 -- 172.21.15.71:0/2360254659 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fd800ad20 con 0x7f0fdc086ff0 2023-10-06T01:42:54.830 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.824+0000 7f0fe3a6e700 1 -- 172.21.15.71:0/2360254659 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fdc15bd90 con 0x7f0fdc086ff0 2023-10-06T01:42:54.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.825+0000 7f0fe3a6e700 1 -- 172.21.15.71:0/2360254659 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fdc088700 con 0x7f0fdc086ff0 2023-10-06T01:42:54.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.826+0000 7f0fd1ffb700 1 -- 172.21.15.71:0/2360254659 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0fd8012630 con 0x7f0fdc086ff0 2023-10-06T01:42:54.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.826+0000 7f0fd1ffb700 1 --2- 172.21.15.71:0/2360254659 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f0fc0066f30 0x7f0fc00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:54.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.826+0000 7f0fd1ffb700 1 -- 172.21.15.71:0/2360254659 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f0fd8084990 con 0x7f0fdc086ff0 2023-10-06T01:42:54.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.826+0000 7f0fe1009700 1 --2- 172.21.15.71:0/2360254659 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f0fc0066f30 0x7f0fc00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:54.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.826+0000 7f0fe1009700 1 --2- 172.21.15.71:0/2360254659 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f0fc0066f30 0x7f0fc00693e0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f0fdc0ca540 tx=0x7f0fcc007bd0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:54.831 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:54.830+0000 7f0fd1ffb700 1 -- 172.21.15.71:0/2360254659 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0fd8051c00 con 0x7f0fdc086ff0 2023-10-06T01:42:55.014 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.014+0000 7f0fe3a6e700 1 -- 172.21.15.71:0/2360254659 --> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f0fdc0cfbb0 con 0x7f0fc0066f30 2023-10-06T01:42:55.015 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.014+0000 7f0fd1ffb700 1 -- 172.21.15.71:0/2360254659 <== mgr.4107 v2:172.21.15.71:6832/90436 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f0fdc0cfbb0 con 0x7f0fc0066f30 2023-10-06T01:42:55.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.016+0000 7f0fe3a6e700 1 -- 172.21.15.71:0/2360254659 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f0fc0066f30 msgr2=0x7f0fc00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:55.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.016+0000 7f0fe3a6e700 1 --2- 172.21.15.71:0/2360254659 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f0fc0066f30 0x7f0fc00693e0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f0fdc0ca540 tx=0x7f0fcc007bd0 comp rx=0 tx=0).stop 2023-10-06T01:42:55.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.016+0000 7f0fe3a6e700 1 -- 172.21.15.71:0/2360254659 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0fdc086ff0 msgr2=0x7f0fdc15ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:55.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.016+0000 7f0fe3a6e700 1 --2- 172.21.15.71:0/2360254659 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0fdc086ff0 0x7f0fdc15ca80 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f0fd800c950 tx=0x7f0fd8002760 comp rx=0 tx=0).stop 2023-10-06T01:42:55.017 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.016+0000 7f0fe3a6e700 1 -- 172.21.15.71:0/2360254659 shutdown_connections 2023-10-06T01:42:55.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.016+0000 7f0fe3a6e700 1 --2- 172.21.15.71:0/2360254659 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fdc15a030 0x7f0fdc1552c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:55.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.016+0000 7f0fe3a6e700 1 --2- 172.21.15.71:0/2360254659 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0fdc086ff0 0x7f0fdc15ca80 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:55.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.016+0000 7f0fe3a6e700 1 --2- 172.21.15.71:0/2360254659 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f0fc0066f30 0x7f0fc00693e0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:55.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.016+0000 7f0fe3a6e700 1 --2- 172.21.15.71:0/2360254659 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fdc0b28c0 0x7f0fdc0b5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:55.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.016+0000 7f0fe3a6e700 1 -- 172.21.15.71:0/2360254659 >> 172.21.15.71:0/2360254659 conn(0x7f0fdc068680 msgr2=0x7f0fdc0cc780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:55.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.016+0000 7f0fe3a6e700 1 -- 172.21.15.71:0/2360254659 shutdown_connections 2023-10-06T01:42:55.018 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.016+0000 7f0fe3a6e700 1 -- 172.21.15.71:0/2360254659 wait complete. 2023-10-06T01:42:55.018 INFO:teuthology.orchestra.run.smithi071.stderr:instructed osd(s) 6 to deep-scrub 2023-10-06T01:42:55.028 INFO:tasks.ceph:Scrubbing osd.7 2023-10-06T01:42:55.029 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-10-06T01:42:55.146 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.146+0000 7f2f015e0700 1 Processor -- start 2023-10-06T01:42:55.147 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.146+0000 7f2f015e0700 1 -- start start 2023-10-06T01:42:55.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.146+0000 7f2f015e0700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2efc0688d0 0x7f2efc0af4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:55.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.146+0000 7f2f015e0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2efc0afdf0 0x7f2efc159180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:55.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.146+0000 7f2f015e0700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2efc0adba0 con 0x7f2efc068ca0 2023-10-06T01:42:55.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.146+0000 7f2f015e0700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2efc0ad2b0 con 0x7f2efc0688d0 2023-10-06T01:42:55.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.146+0000 7f2f015e0700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2efc0b02d0 con 0x7f2efc0afdf0 2023-10-06T01:42:55.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.147+0000 7f2ef27fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2efc0afdf0 0x7f2efc159180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:55.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.147+0000 7f2ef27fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2efc0afdf0 0x7f2efc159180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.71:48742/0 (socket says 172.21.15.71:48742) 2023-10-06T01:42:55.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.147+0000 7f2ef27fc700 1 -- 172.21.15.71:0/2674920036 learned_addr learned my addr 172.21.15.71:0/2674920036 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:55.150 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.147+0000 7f2efaffd700 1 --2- 172.21.15.71:0/2674920036 >> v2:172.21.15.72:3300/0 conn(0x7f2efc0688d0 0x7f2efc0af4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:55.150 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.147+0000 7f2ef27fc700 1 -- 172.21.15.71:0/2674920036 >> v2:172.21.15.72:3300/0 conn(0x7f2efc0688d0 msgr2=0x7f2efc0af4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:55.150 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.147+0000 7f2ef27fc700 1 --2- 172.21.15.71:0/2674920036 >> v2:172.21.15.72:3300/0 conn(0x7f2efc0688d0 0x7f2efc0af4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:55.150 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.147+0000 7f2ef27fc700 1 -- 172.21.15.71:0/2674920036 >> v1:172.21.15.72:6789/0 conn(0x7f2efc068ca0 legacy=0x7f2efc1596c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:55.150 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.147+0000 7f2ef27fc700 1 -- 172.21.15.71:0/2674920036 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2efc0ad550 con 0x7f2efc0afdf0 2023-10-06T01:42:55.150 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.147+0000 7f2efaffd700 1 --2- 172.21.15.71:0/2674920036 >> v2:172.21.15.72:3300/0 conn(0x7f2efc0688d0 0x7f2efc0af4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:42:55.150 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.147+0000 7f2ef27fc700 1 --2- 172.21.15.71:0/2674920036 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2efc0afdf0 0x7f2efc159180 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2ee40099b0 tx=0x7f2ee4009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ddad0a05202929f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:55.150 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.147+0000 7f2efa7fc700 1 -- 172.21.15.71:0/2674920036 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee4009ea0 con 0x7f2efc0afdf0 2023-10-06T01:42:55.150 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.147+0000 7f2efa7fc700 1 -- 172.21.15.71:0/2674920036 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ee400b860 con 0x7f2efc0afdf0 2023-10-06T01:42:55.150 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.147+0000 7f2efa7fc700 1 -- 172.21.15.71:0/2674920036 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee400bc00 con 0x7f2efc0afdf0 2023-10-06T01:42:55.150 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.148+0000 7f2f015e0700 1 -- 172.21.15.71:0/2674920036 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2efc0afdf0 msgr2=0x7f2efc159180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:55.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.148+0000 7f2f015e0700 1 --2- 172.21.15.71:0/2674920036 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2efc0afdf0 0x7f2efc159180 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2ee40099b0 tx=0x7f2ee4009250 comp rx=0 tx=0).stop 2023-10-06T01:42:55.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.148+0000 7f2f015e0700 1 -- 172.21.15.71:0/2674920036 shutdown_connections 2023-10-06T01:42:55.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.148+0000 7f2f015e0700 1 --2- 172.21.15.71:0/2674920036 >> v2:172.21.15.72:3300/0 conn(0x7f2efc0688d0 0x7f2efc0af4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:55.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.148+0000 7f2f015e0700 1 --2- 172.21.15.71:0/2674920036 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2efc0afdf0 0x7f2efc159180 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:55.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.148+0000 7f2f015e0700 1 -- 172.21.15.71:0/2674920036 >> 172.21.15.71:0/2674920036 conn(0x7f2efc0963e0 msgr2=0x7f2efc069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:55.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.148+0000 7f2f015e0700 1 -- 172.21.15.71:0/2674920036 shutdown_connections 2023-10-06T01:42:55.151 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.148+0000 7f2f015e0700 1 -- 172.21.15.71:0/2674920036 wait complete. 2023-10-06T01:42:55.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.149+0000 7f2f015e0700 1 Processor -- start 2023-10-06T01:42:55.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.149+0000 7f2f015e0700 1 -- start start 2023-10-06T01:42:55.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.150+0000 7f2f015e0700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2efc0688d0 0x7f2efc14a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:55.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.150+0000 7f2f015e0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2efc068ca0 0x7f2efc0cca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:55.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.150+0000 7f2f015e0700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2efc0afdf0 0x7f2efc16cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:55.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.150+0000 7f2f015e0700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2efc0cd260 con 0x7f2efc0afdf0 2023-10-06T01:42:55.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.150+0000 7f2f015e0700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2efc15dbc0 con 0x7f2efc0688d0 2023-10-06T01:42:55.154 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.150+0000 7f2f015e0700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2efc15cff0 con 0x7f2efc068ca0 2023-10-06T01:42:55.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.150+0000 7f2efb7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2efc0afdf0 0x7f2efc16cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:55.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.150+0000 7f2efb7fe700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2efc0afdf0 0x7f2efc16cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41550/0 (socket says 172.21.15.71:41550) 2023-10-06T01:42:55.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.150+0000 7f2efb7fe700 1 -- 172.21.15.71:0/721707701 learned_addr learned my addr 172.21.15.71:0/721707701 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:55.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.150+0000 7f2efaffd700 1 --2- 172.21.15.71:0/721707701 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2efc0688d0 0x7f2efc14a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:55.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.150+0000 7f2ef27fc700 1 --2- 172.21.15.71:0/721707701 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2efc068ca0 0x7f2efc0cca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:55.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.150+0000 7f2efb7fe700 1 -- 172.21.15.71:0/721707701 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2efc068ca0 msgr2=0x7f2efc0cca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:55.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.150+0000 7f2efb7fe700 1 --2- 172.21.15.71:0/721707701 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2efc068ca0 0x7f2efc0cca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:55.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.150+0000 7f2efb7fe700 1 -- 172.21.15.71:0/721707701 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2efc0688d0 msgr2=0x7f2efc14a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:55.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.150+0000 7f2efb7fe700 1 --2- 172.21.15.71:0/721707701 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2efc0688d0 0x7f2efc14a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:55.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.150+0000 7f2efb7fe700 1 -- 172.21.15.71:0/721707701 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eec009420 con 0x7f2efc0afdf0 2023-10-06T01:42:55.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.151+0000 7f2efb7fe700 1 --2- 172.21.15.71:0/721707701 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2efc0afdf0 0x7f2efc16cc90 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f2ef400c8e0 tx=0x7f2ef4001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:55.155 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.151+0000 7f2ef37fe700 1 -- 172.21.15.71:0/721707701 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef4012630 con 0x7f2efc0afdf0 2023-10-06T01:42:55.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.151+0000 7f2ef37fe700 1 -- 172.21.15.71:0/721707701 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ef4012790 con 0x7f2efc0afdf0 2023-10-06T01:42:55.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.151+0000 7f2f015e0700 1 -- 172.21.15.71:0/721707701 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ee40094f0 con 0x7f2efc0afdf0 2023-10-06T01:42:55.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.151+0000 7f2ef37fe700 1 -- 172.21.15.71:0/721707701 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef4012b50 con 0x7f2efc0afdf0 2023-10-06T01:42:55.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.151+0000 7f2f015e0700 1 -- 172.21.15.71:0/721707701 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2efc15d570 con 0x7f2efc0afdf0 2023-10-06T01:42:55.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.152+0000 7f2f015e0700 1 -- 172.21.15.71:0/721707701 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2efc06d590 con 0x7f2efc0afdf0 2023-10-06T01:42:55.156 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.152+0000 7f2ef37fe700 1 -- 172.21.15.71:0/721707701 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2ef4024430 con 0x7f2efc0afdf0 2023-10-06T01:42:55.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.152+0000 7f2ef37fe700 1 --2- 172.21.15.71:0/721707701 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f2edc066f30 0x7f2edc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:55.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.153+0000 7f2ef37fe700 1 -- 172.21.15.71:0/721707701 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f2ef4084f10 con 0x7f2efc0afdf0 2023-10-06T01:42:55.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.153+0000 7f2efaffd700 1 --2- 172.21.15.71:0/721707701 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f2edc066f30 0x7f2edc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:55.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.153+0000 7f2ef37fe700 1 --2- 172.21.15.71:0/721707701 >> [v2:172.21.15.72:6820/90948,v1:172.21.15.72:6822/90948] conn(0x7f2edc06d8f0 0x7f2edc06fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:55.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.153+0000 7f2ef37fe700 1 -- 172.21.15.71:0/721707701 --> [v2:172.21.15.72:6820/90948,v1:172.21.15.72:6822/90948] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2edc0703f0 con 0x7f2edc06d8f0 2023-10-06T01:42:55.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.153+0000 7f2ef37fe700 1 -- 172.21.15.71:0/721707701 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_get_version_reply(handle=1 version=61) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2ef4085240 con 0x7f2efc0afdf0 2023-10-06T01:42:55.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.153+0000 7f2ef27fc700 1 --2- 172.21.15.71:0/721707701 >> [v2:172.21.15.72:6820/90948,v1:172.21.15.72:6822/90948] conn(0x7f2edc06d8f0 0x7f2edc06fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:55.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.153+0000 7f2efaffd700 1 --2- 172.21.15.71:0/721707701 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f2edc066f30 0x7f2edc0693e0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f2eec009f40 tx=0x7f2eec0091a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:55.157 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.153+0000 7f2ef27fc700 1 --2- 172.21.15.71:0/721707701 >> [v2:172.21.15.72:6820/90948,v1:172.21.15.72:6822/90948] conn(0x7f2edc06d8f0 0x7f2edc06fd20 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:55.158 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.154+0000 7f2ef37fe700 1 -- 172.21.15.71:0/721707701 <== osd.7 v2:172.21.15.72:6820/90948 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f2edc0703f0 con 0x7f2edc06d8f0 2023-10-06T01:42:55.168 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.167+0000 7f2f015e0700 1 -- 172.21.15.71:0/721707701 --> [v2:172.21.15.72:6820/90948,v1:172.21.15.72:6822/90948] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f2efc04bb80 con 0x7f2edc06d8f0 2023-10-06T01:42:55.169 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.168+0000 7f2ef37fe700 1 -- 172.21.15.71:0/721707701 <== osd.7 v2:172.21.15.72:6820/90948 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f2efc04bb80 con 0x7f2edc06d8f0 2023-10-06T01:42:55.169 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2023-10-06T01:42:55.169 INFO:teuthology.orchestra.run.smithi071.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T01:42:55.169 INFO:teuthology.orchestra.run.smithi071.stdout:} 2023-10-06T01:42:55.170 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.169+0000 7f2f015e0700 1 -- 172.21.15.71:0/721707701 >> [v2:172.21.15.72:6820/90948,v1:172.21.15.72:6822/90948] conn(0x7f2edc06d8f0 msgr2=0x7f2edc06fd20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:55.170 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.169+0000 7f2f015e0700 1 --2- 172.21.15.71:0/721707701 >> [v2:172.21.15.72:6820/90948,v1:172.21.15.72:6822/90948] conn(0x7f2edc06d8f0 0x7f2edc06fd20 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:55.171 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.169+0000 7f2f015e0700 1 -- 172.21.15.71:0/721707701 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f2edc066f30 msgr2=0x7f2edc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:55.171 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.169+0000 7f2f015e0700 1 --2- 172.21.15.71:0/721707701 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f2edc066f30 0x7f2edc0693e0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f2eec009f40 tx=0x7f2eec0091a0 comp rx=0 tx=0).stop 2023-10-06T01:42:55.171 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.169+0000 7f2f015e0700 1 -- 172.21.15.71:0/721707701 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2efc0afdf0 msgr2=0x7f2efc16cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:55.171 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.169+0000 7f2f015e0700 1 --2- 172.21.15.71:0/721707701 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2efc0afdf0 0x7f2efc16cc90 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f2ef400c8e0 tx=0x7f2ef4001710 comp rx=0 tx=0).stop 2023-10-06T01:42:55.171 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.169+0000 7f2efb7fe700 1 -- 172.21.15.71:0/721707701 reap_dead start 2023-10-06T01:42:55.171 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.169+0000 7f2f015e0700 1 -- 172.21.15.71:0/721707701 shutdown_connections 2023-10-06T01:42:55.171 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.169+0000 7f2f015e0700 1 -- 172.21.15.71:0/721707701 >> 172.21.15.71:0/721707701 conn(0x7f2efc0963e0 msgr2=0x7f2efc0975e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:55.171 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.169+0000 7f2f015e0700 1 -- 172.21.15.71:0/721707701 shutdown_connections 2023-10-06T01:42:55.171 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.169+0000 7f2f015e0700 1 -- 172.21.15.71:0/721707701 wait complete. 2023-10-06T01:42:55.181 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-10-06T01:42:55.295 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.295+0000 7fe7dbfed700 1 Processor -- start 2023-10-06T01:42:55.295 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.295+0000 7fe7dbfed700 1 -- start start 2023-10-06T01:42:55.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.296+0000 7fe7dbfed700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fe7d415a030 0x7fe7d415a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:55.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.296+0000 7fe7dbfed700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7d40afc50 con 0x7fe7d415a940 2023-10-06T01:42:55.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.296+0000 7fe7dbfed700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7d40aff30 con 0x7fe7d4087700 2023-10-06T01:42:55.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.296+0000 7fe7dbfed700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7d40b0cf0 con 0x7fe7d415a030 2023-10-06T01:42:55.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.296+0000 7fe7d9d89700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fe7d415a030 0x7fe7d415a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:55.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.296+0000 7fe7d9588700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7fe7d415a940 0x7fe7d4086ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:53534/0 (socket says 172.21.15.71:53534) 2023-10-06T01:42:55.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.296+0000 7fe7d9d89700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7fe7d415a030 0x7fe7d415a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41554/0 (socket says 172.21.15.71:41554) 2023-10-06T01:42:55.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.296+0000 7fe7d9588700 1 -- 172.21.15.71:0/3859606527 learned_addr learned my addr 172.21.15.71:0/3859606527 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:42:55.298 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.296+0000 7fe7d9d89700 1 -- 172.21.15.71:0/3859606527 >> v1:172.21.15.72:6789/0 conn(0x7fe7d4087700 legacy=0x7fe7d40b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:55.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.296+0000 7fe7d9d89700 1 -- 172.21.15.71:0/3859606527 >> v1:172.21.15.71:6789/0 conn(0x7fe7d415a940 legacy=0x7fe7d4086ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:55.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.296+0000 7fe7d9d89700 1 -- 172.21.15.71:0/3859606527 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7d40b0210 con 0x7fe7d415a030 2023-10-06T01:42:55.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.296+0000 7fe7d8d87700 1 -- 172.21.15.71:0/3859606527 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 839108424 0 0) 0x7fe7d40afc50 con 0x7fe7d415a940 2023-10-06T01:42:55.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.296+0000 7fe7d9d89700 1 --2- 172.21.15.71:0/3859606527 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7d415a030 0x7fe7d415a400 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fe7d00098e0 tx=0x7fe7d00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e86dc7d8dd034ea1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:55.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.296+0000 7fe7d8d87700 1 -- 172.21.15.71:0/3859606527 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d0009e80 con 0x7fe7d415a030 2023-10-06T01:42:55.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.296+0000 7fe7d8d87700 1 -- 172.21.15.71:0/3859606527 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7d000b860 con 0x7fe7d415a030 2023-10-06T01:42:55.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.296+0000 7fe7d8d87700 1 -- 172.21.15.71:0/3859606527 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d000bbe0 con 0x7fe7d415a030 2023-10-06T01:42:55.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.297+0000 7fe7dbfed700 1 -- 172.21.15.71:0/3859606527 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7d415a030 msgr2=0x7fe7d415a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:55.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.297+0000 7fe7dbfed700 1 --2- 172.21.15.71:0/3859606527 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7d415a030 0x7fe7d415a400 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fe7d00098e0 tx=0x7fe7d00091a0 comp rx=0 tx=0).stop 2023-10-06T01:42:55.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.297+0000 7fe7dbfed700 1 -- 172.21.15.71:0/3859606527 shutdown_connections 2023-10-06T01:42:55.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.297+0000 7fe7dbfed700 1 --2- 172.21.15.71:0/3859606527 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7d415a030 0x7fe7d415a400 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:55.299 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.297+0000 7fe7dbfed700 1 -- 172.21.15.71:0/3859606527 >> 172.21.15.71:0/3859606527 conn(0x7fe7d4068680 msgr2=0x7fe7d4068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:55.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.297+0000 7fe7dbfed700 1 -- 172.21.15.71:0/3859606527 shutdown_connections 2023-10-06T01:42:55.300 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.297+0000 7fe7dbfed700 1 -- 172.21.15.71:0/3859606527 wait complete. 2023-10-06T01:42:55.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.298+0000 7fe7dbfed700 1 Processor -- start 2023-10-06T01:42:55.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.298+0000 7fe7dbfed700 1 -- start start 2023-10-06T01:42:55.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.299+0000 7fe7dbfed700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe7d4087700 0x7fe7d40b3a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:55.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.299+0000 7fe7dbfed700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7d415a030 0x7fe7d40c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:55.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.299+0000 7fe7dbfed700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7d415a940 0x7fe7d40c9390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:55.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.299+0000 7fe7dbfed700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d40c42a0 con 0x7fe7d415a940 2023-10-06T01:42:55.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.299+0000 7fe7dbfed700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d416a090 con 0x7fe7d415a030 2023-10-06T01:42:55.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.299+0000 7fe7dbfed700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d40b42f0 con 0x7fe7d4087700 2023-10-06T01:42:55.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.299+0000 7fe7da58a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7d415a940 0x7fe7d40c9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:55.303 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.299+0000 7fe7da58a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7d415a940 0x7fe7d40c9390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41562/0 (socket says 172.21.15.71:41562) 2023-10-06T01:42:55.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.299+0000 7fe7da58a700 1 -- 172.21.15.71:0/767654371 learned_addr learned my addr 172.21.15.71:0/767654371 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:55.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.299+0000 7fe7d9d89700 1 --2- 172.21.15.71:0/767654371 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe7d4087700 0x7fe7d40b3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:55.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.299+0000 7fe7d9588700 1 --2- 172.21.15.71:0/767654371 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7d415a030 0x7fe7d40c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:55.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.299+0000 7fe7da58a700 1 -- 172.21.15.71:0/767654371 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe7d4087700 msgr2=0x7fe7d40b3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:55.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.299+0000 7fe7da58a700 1 --2- 172.21.15.71:0/767654371 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe7d4087700 0x7fe7d40b3a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:55.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.299+0000 7fe7da58a700 1 -- 172.21.15.71:0/767654371 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7d415a030 msgr2=0x7fe7d40c8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:55.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.299+0000 7fe7da58a700 1 --2- 172.21.15.71:0/767654371 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7d415a030 0x7fe7d40c8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:55.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.299+0000 7fe7da58a700 1 -- 172.21.15.71:0/767654371 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7d0009420 con 0x7fe7d415a940 2023-10-06T01:42:55.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.299+0000 7fe7d9d89700 1 --2- 172.21.15.71:0/767654371 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe7d4087700 0x7fe7d40b3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:42:55.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.299+0000 7fe7da58a700 1 --2- 172.21.15.71:0/767654371 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7d415a940 0x7fe7d40c9390 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc00c910 tx=0x7fe7cc0016b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:55.304 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.299+0000 7fe7c9ffb700 1 -- 172.21.15.71:0/767654371 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7cc00ce50 con 0x7fe7d415a940 2023-10-06T01:42:55.305 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.299+0000 7fe7c9ffb700 1 -- 172.21.15.71:0/767654371 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7cc00a7e0 con 0x7fe7d415a940 2023-10-06T01:42:55.305 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.299+0000 7fe7c9ffb700 1 -- 172.21.15.71:0/767654371 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7cc00ab80 con 0x7fe7d415a940 2023-10-06T01:42:55.305 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.299+0000 7fe7dbfed700 1 -- 172.21.15.71:0/767654371 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7d40b45d0 con 0x7fe7d415a940 2023-10-06T01:42:55.305 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.300+0000 7fe7dbfed700 1 -- 172.21.15.71:0/767654371 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7d40c3f30 con 0x7fe7d415a940 2023-10-06T01:42:55.305 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.300+0000 7fe7dbfed700 1 -- 172.21.15.71:0/767654371 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7d4088700 con 0x7fe7d415a940 2023-10-06T01:42:55.305 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.301+0000 7fe7c9ffb700 1 -- 172.21.15.71:0/767654371 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe7cc012420 con 0x7fe7d415a940 2023-10-06T01:42:55.305 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.301+0000 7fe7c9ffb700 1 --2- 172.21.15.71:0/767654371 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fe7b8066f30 0x7fe7b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:55.305 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.301+0000 7fe7c9ffb700 1 -- 172.21.15.71:0/767654371 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5698+0+0 (secure 0 0 0) 0x7fe7cc084810 con 0x7fe7d415a940 2023-10-06T01:42:55.305 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.301+0000 7fe7d9d89700 1 --2- 172.21.15.71:0/767654371 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fe7b8066f30 0x7fe7b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:55.305 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.302+0000 7fe7d9d89700 1 --2- 172.21.15.71:0/767654371 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fe7b8066f30 0x7fe7b80693e0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fe7d00097b0 tx=0x7fe7d0017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:55.306 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.305+0000 7fe7c9ffb700 1 -- 172.21.15.71:0/767654371 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe7cc051a80 con 0x7fe7d415a940 2023-10-06T01:42:55.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.487+0000 7fe7dbfed700 1 -- 172.21.15.71:0/767654371 --> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fe7d40c43e0 con 0x7fe7b8066f30 2023-10-06T01:42:55.488 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.488+0000 7fe7c9ffb700 1 -- 172.21.15.71:0/767654371 <== mgr.4107 v2:172.21.15.71:6832/90436 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fe7d40c43e0 con 0x7fe7b8066f30 2023-10-06T01:42:55.491 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.490+0000 7fe7dbfed700 1 -- 172.21.15.71:0/767654371 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fe7b8066f30 msgr2=0x7fe7b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:55.491 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.490+0000 7fe7dbfed700 1 --2- 172.21.15.71:0/767654371 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fe7b8066f30 0x7fe7b80693e0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fe7d00097b0 tx=0x7fe7d0017000 comp rx=0 tx=0).stop 2023-10-06T01:42:55.491 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.490+0000 7fe7dbfed700 1 -- 172.21.15.71:0/767654371 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7d415a940 msgr2=0x7fe7d40c9390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:55.491 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.490+0000 7fe7dbfed700 1 --2- 172.21.15.71:0/767654371 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7d415a940 0x7fe7d40c9390 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc00c910 tx=0x7fe7cc0016b0 comp rx=0 tx=0).stop 2023-10-06T01:42:55.492 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.490+0000 7fe7dbfed700 1 -- 172.21.15.71:0/767654371 shutdown_connections 2023-10-06T01:42:55.492 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.490+0000 7fe7dbfed700 1 --2- 172.21.15.71:0/767654371 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe7d415a940 0x7fe7d40c9390 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:55.492 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.490+0000 7fe7dbfed700 1 --2- 172.21.15.71:0/767654371 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe7d4087700 0x7fe7d40b3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:55.492 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.490+0000 7fe7dbfed700 1 --2- 172.21.15.71:0/767654371 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7fe7b8066f30 0x7fe7b80693e0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:55.492 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.490+0000 7fe7dbfed700 1 --2- 172.21.15.71:0/767654371 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7d415a030 0x7fe7d40c8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:55.492 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.490+0000 7fe7dbfed700 1 -- 172.21.15.71:0/767654371 >> 172.21.15.71:0/767654371 conn(0x7fe7d4068680 msgr2=0x7fe7d40b21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:55.492 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.490+0000 7fe7dbfed700 1 -- 172.21.15.71:0/767654371 shutdown_connections 2023-10-06T01:42:55.492 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.490+0000 7fe7dbfed700 1 -- 172.21.15.71:0/767654371 wait complete. 2023-10-06T01:42:55.493 INFO:teuthology.orchestra.run.smithi071.stderr:instructed osd(s) 7 to deep-scrub 2023-10-06T01:42:55.503 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T01:42:55.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.616+0000 7ff7a7fff700 1 Processor -- start 2023-10-06T01:42:55.617 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.616+0000 7ff7a7fff700 1 -- start start 2023-10-06T01:42:55.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.617+0000 7ff7a7fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff7a8159320 0x7ff7a80adb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:55.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.617+0000 7ff7a7fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff7a80ae080 0x7ff7a80afc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:55.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.617+0000 7ff7a7fff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7a80ae720 con 0x7ff7a80b01b0 2023-10-06T01:42:55.619 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.617+0000 7ff7a7fff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7a80cdb10 con 0x7ff7a8159320 2023-10-06T01:42:55.620 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.617+0000 7ff7a7fff700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a806a160 con 0x7ff7a80ae080 2023-10-06T01:42:55.620 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.617+0000 7ff7a67fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff7a80ae080 0x7ff7a80afc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:55.620 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.617+0000 7ff7a67fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff7a80ae080 0x7ff7a80afc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.71:48754/0 (socket says 172.21.15.71:48754) 2023-10-06T01:42:55.620 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.617+0000 7ff7a67fc700 1 -- 172.21.15.71:0/359832671 learned_addr learned my addr 172.21.15.71:0/359832671 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:55.620 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.617+0000 7ff7a6ffd700 1 --2- 172.21.15.71:0/359832671 >> v2:172.21.15.72:3300/0 conn(0x7ff7a8159320 0x7ff7a80adb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:55.620 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.617+0000 7ff7a67fc700 1 -- 172.21.15.71:0/359832671 >> v2:172.21.15.72:3300/0 conn(0x7ff7a8159320 msgr2=0x7ff7a80adb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:42:55.620 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.617+0000 7ff7a67fc700 1 --2- 172.21.15.71:0/359832671 >> v2:172.21.15.72:3300/0 conn(0x7ff7a8159320 0x7ff7a80adb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:55.620 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.617+0000 7ff7a67fc700 1 -- 172.21.15.71:0/359832671 >> v1:172.21.15.72:6789/0 conn(0x7ff7a80b01b0 legacy=0x7ff7a80b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:55.620 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.617+0000 7ff7a67fc700 1 -- 172.21.15.71:0/359832671 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7a80ae4d0 con 0x7ff7a80ae080 2023-10-06T01:42:55.620 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.617+0000 7ff7a5ffb700 1 -- 172.21.15.71:0/359832671 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2639896245 0 0) 0x7ff7a80ae720 con 0x7ff7a80b01b0 2023-10-06T01:42:55.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.618+0000 7ff7a67fc700 1 --2- 172.21.15.71:0/359832671 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff7a80ae080 0x7ff7a80afc70 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff79c0099b0 tx=0x7ff79c009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8602ed623c5561a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:55.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.618+0000 7ff7a5ffb700 1 -- 172.21.15.71:0/359832671 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff79c009ea0 con 0x7ff7a80ae080 2023-10-06T01:42:55.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.618+0000 7ff7a5ffb700 1 -- 172.21.15.71:0/359832671 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff79c00b8f0 con 0x7ff7a80ae080 2023-10-06T01:42:55.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.618+0000 7ff7a5ffb700 1 -- 172.21.15.71:0/359832671 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff79c00bc90 con 0x7ff7a80ae080 2023-10-06T01:42:55.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.618+0000 7ff7a7fff700 1 -- 172.21.15.71:0/359832671 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff7a80ae080 msgr2=0x7ff7a80afc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:55.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.618+0000 7ff7a7fff700 1 --2- 172.21.15.71:0/359832671 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff7a80ae080 0x7ff7a80afc70 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff79c0099b0 tx=0x7ff79c009250 comp rx=0 tx=0).stop 2023-10-06T01:42:55.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.618+0000 7ff7a7fff700 1 -- 172.21.15.71:0/359832671 shutdown_connections 2023-10-06T01:42:55.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.618+0000 7ff7a7fff700 1 --2- 172.21.15.71:0/359832671 >> v2:172.21.15.72:3300/0 conn(0x7ff7a8159320 0x7ff7a80adb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:55.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.618+0000 7ff7a7fff700 1 --2- 172.21.15.71:0/359832671 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff7a80ae080 0x7ff7a80afc70 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:55.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.618+0000 7ff7a7fff700 1 -- 172.21.15.71:0/359832671 >> 172.21.15.71:0/359832671 conn(0x7ff7a8067130 msgr2=0x7ff7a8067530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:55.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.618+0000 7ff7a7fff700 1 -- 172.21.15.71:0/359832671 shutdown_connections 2023-10-06T01:42:55.621 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.618+0000 7ff7a7fff700 1 -- 172.21.15.71:0/359832671 wait complete. 2023-10-06T01:42:55.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.620+0000 7ff7a7fff700 1 Processor -- start 2023-10-06T01:42:55.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.620+0000 7ff7a7fff700 1 -- start start 2023-10-06T01:42:55.624 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.620+0000 7ff7a7fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7a80ae080 0x7ff7a8096b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:55.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.620+0000 7ff7a7fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff7a80b01b0 0x7ff7a809af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:55.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.620+0000 7ff7a7fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7a8159320 0x7ff7a8156500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:55.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.620+0000 7ff7a7fff700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a809b750 con 0x7ff7a80ae080 2023-10-06T01:42:55.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.620+0000 7ff7a7fff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a8099920 con 0x7ff7a8159320 2023-10-06T01:42:55.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.620+0000 7ff7a7fff700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a809b4b0 con 0x7ff7a80b01b0 2023-10-06T01:42:55.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.621+0000 7ff7a6ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7a80ae080 0x7ff7a8096b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:55.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.621+0000 7ff7a6ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7a80ae080 0x7ff7a8096b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41578/0 (socket says 172.21.15.71:41578) 2023-10-06T01:42:55.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.621+0000 7ff7a6ffd700 1 -- 172.21.15.71:0/1136508010 learned_addr learned my addr 172.21.15.71:0/1136508010 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:42:55.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.621+0000 7ff7a67fc700 1 --2- 172.21.15.71:0/1136508010 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff7a80b01b0 0x7ff7a809af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:55.625 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.621+0000 7ff7a77fe700 1 --2- 172.21.15.71:0/1136508010 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7a8159320 0x7ff7a8156500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:55.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.621+0000 7ff7a6ffd700 1 -- 172.21.15.71:0/1136508010 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff7a80b01b0 msgr2=0x7ff7a809af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:55.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.621+0000 7ff7a6ffd700 1 --2- 172.21.15.71:0/1136508010 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff7a80b01b0 0x7ff7a809af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:55.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.621+0000 7ff7a6ffd700 1 -- 172.21.15.71:0/1136508010 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7a8159320 msgr2=0x7ff7a8156500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:55.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.621+0000 7ff7a6ffd700 1 --2- 172.21.15.71:0/1136508010 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7a8159320 0x7ff7a8156500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:55.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.621+0000 7ff7a6ffd700 1 -- 172.21.15.71:0/1136508010 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff79c0094f0 con 0x7ff7a80ae080 2023-10-06T01:42:55.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.621+0000 7ff7a77fe700 1 --2- 172.21.15.71:0/1136508010 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7a8159320 0x7ff7a8156500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:42:55.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.621+0000 7ff7a6ffd700 1 --2- 172.21.15.71:0/1136508010 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7a80ae080 0x7ff7a8096b40 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7ff798009e50 tx=0x7ff79800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:55.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.621+0000 7ff78effd700 1 -- 172.21.15.71:0/1136508010 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff79800cc20 con 0x7ff7a80ae080 2023-10-06T01:42:55.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.621+0000 7ff78effd700 1 -- 172.21.15.71:0/1136508010 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff79800f040 con 0x7ff7a80ae080 2023-10-06T01:42:55.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.621+0000 7ff7a7fff700 1 -- 172.21.15.71:0/1136508010 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7a8156a40 con 0x7ff7a80ae080 2023-10-06T01:42:55.626 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.621+0000 7ff78effd700 1 -- 172.21.15.71:0/1136508010 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff798014480 con 0x7ff7a80ae080 2023-10-06T01:42:55.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.621+0000 7ff7a7fff700 1 -- 172.21.15.71:0/1136508010 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7a80992d0 con 0x7ff7a80ae080 2023-10-06T01:42:55.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.622+0000 7ff7a7fff700 1 -- 172.21.15.71:0/1136508010 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7a806f3c0 con 0x7ff7a80ae080 2023-10-06T01:42:55.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.622+0000 7ff78effd700 1 -- 172.21.15.71:0/1136508010 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff7980147f0 con 0x7ff7a80ae080 2023-10-06T01:42:55.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.623+0000 7ff78effd700 1 --2- 172.21.15.71:0/1136508010 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7ff794066f30 0x7ff7940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:42:55.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.623+0000 7ff78effd700 1 -- 172.21.15.71:0/1136508010 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5698+0+0 (secure 0 0 0) 0x7ff798084f70 con 0x7ff7a80ae080 2023-10-06T01:42:55.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.623+0000 7ff7a67fc700 1 --2- 172.21.15.71:0/1136508010 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7ff794066f30 0x7ff7940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:42:55.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.623+0000 7ff7a67fc700 1 --2- 172.21.15.71:0/1136508010 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7ff794066f30 0x7ff7940693e0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7ff79c0099b0 tx=0x7ff79c017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:42:55.627 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.627+0000 7ff78effd700 1 -- 172.21.15.71:0/1136508010 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff7980521e0 con 0x7ff7a80ae080 2023-10-06T01:42:55.804 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.803+0000 7ff7a7fff700 1 -- 172.21.15.71:0/1136508010 --> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff7a8099a60 con 0x7ff794066f30 2023-10-06T01:42:55.806 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.806+0000 7ff78effd700 1 -- 172.21.15.71:0/1136508010 <== mgr.4107 v2:172.21.15.71:6832/90436 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+72595 (secure 0 0 0) 0x7ff79c00ba60 con 0x7ff794066f30 2023-10-06T01:42:55.807 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:42:55.809 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.808+0000 7ff7a7fff700 1 -- 172.21.15.71:0/1136508010 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7ff794066f30 msgr2=0x7ff7940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:55.809 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.808+0000 7ff7a7fff700 1 --2- 172.21.15.71:0/1136508010 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7ff794066f30 0x7ff7940693e0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7ff79c0099b0 tx=0x7ff79c017000 comp rx=0 tx=0).stop 2023-10-06T01:42:55.809 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.808+0000 7ff7a7fff700 1 -- 172.21.15.71:0/1136508010 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7a80ae080 msgr2=0x7ff7a8096b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:42:55.809 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.808+0000 7ff7a7fff700 1 --2- 172.21.15.71:0/1136508010 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7a80ae080 0x7ff7a8096b40 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7ff798009e50 tx=0x7ff79800b040 comp rx=0 tx=0).stop 2023-10-06T01:42:55.809 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.808+0000 7ff7a7fff700 1 -- 172.21.15.71:0/1136508010 shutdown_connections 2023-10-06T01:42:55.809 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.808+0000 7ff7a7fff700 1 --2- 172.21.15.71:0/1136508010 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7ff794066f30 0x7ff7940693e0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:55.809 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.808+0000 7ff7a7fff700 1 --2- 172.21.15.71:0/1136508010 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7a8159320 0x7ff7a8156500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:55.809 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.808+0000 7ff7a7fff700 1 --2- 172.21.15.71:0/1136508010 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7a80ae080 0x7ff7a8096b40 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:55.810 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.808+0000 7ff7a7fff700 1 --2- 172.21.15.71:0/1136508010 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff7a80b01b0 0x7ff7a809af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:42:55.810 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.808+0000 7ff7a7fff700 1 -- 172.21.15.71:0/1136508010 >> 172.21.15.71:0/1136508010 conn(0x7ff7a8067130 msgr2=0x7ff7a81571c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:42:55.810 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.808+0000 7ff7a7fff700 1 -- 172.21.15.71:0/1136508010 shutdown_connections 2023-10-06T01:42:55.810 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:42:55.808+0000 7ff7a7fff700 1 -- 172.21.15.71:0/1136508010 wait complete. 2023-10-06T01:42:55.810 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2023-10-06T01:42:55.820 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":137,"stamp":"2023-10-06T01:42:54.596791+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2385220,"kb_used_data":6916,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752589500,"statfs":{"total":773094113280,"available":770651648000,"internally_reserved":0,"allocated":7081984,"data_stored":3918967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-77,"num_objects":-1,"num_object_clones":0,"num_object_copies":-2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-1,"num_write_kb":-1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.278489"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":47,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T01:42:49.191830+0000","last_change":"2023-10-06T01:40:16.930992+0000","last_active":"2023-10-06T01:42:49.191830+0000","last_peered":"2023-10-06T01:42:49.191830+0000","last_clean":"2023-10-06T01:42:49.191830+0000","last_became_active":"2023-10-06T01:40:16.930707+0000","last_became_peered":"2023-10-06T01:40:16.930707+0000","last_unstale":"2023-10-06T01:42:49.191830+0000","last_undegraded":"2023-10-06T01:42:49.191830+0000","last_fullsized":"2023-10-06T01:42:49.191830+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":46,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T01:42:48.785698+0000","last_change":"2023-10-06T01:40:16.651019+0000","last_active":"2023-10-06T01:42:48.785698+0000","last_peered":"2023-10-06T01:42:48.785698+0000","last_clean":"2023-10-06T01:42:48.785698+0000","last_became_active":"2023-10-06T01:40:16.650628+0000","last_became_peered":"2023-10-06T01:40:16.650628+0000","last_unstale":"2023-10-06T01:42:48.785698+0000","last_undegraded":"2023-10-06T01:42:48.785698+0000","last_fullsized":"2023-10-06T01:42:48.785698+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":44,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T01:42:47.323993+0000","last_change":"2023-10-06T01:40:16.781596+0000","last_active":"2023-10-06T01:42:47.323993+0000","last_peered":"2023-10-06T01:42:47.323993+0000","last_clean":"2023-10-06T01:42:47.323993+0000","last_became_active":"2023-10-06T01:40:16.781352+0000","last_became_peered":"2023-10-06T01:40:16.781352+0000","last_unstale":"2023-10-06T01:42:47.323993+0000","last_undegraded":"2023-10-06T01:42:47.323993+0000","last_fullsized":"2023-10-06T01:42:47.323993+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":46,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T01:42:48.785020+0000","last_change":"2023-10-06T01:40:16.650826+0000","last_active":"2023-10-06T01:42:48.785020+0000","last_peered":"2023-10-06T01:42:48.785020+0000","last_clean":"2023-10-06T01:42:48.785020+0000","last_became_active":"2023-10-06T01:40:16.650469+0000","last_became_peered":"2023-10-06T01:40:16.650469+0000","last_unstale":"2023-10-06T01:42:48.785020+0000","last_undegraded":"2023-10-06T01:42:48.785020+0000","last_fullsized":"2023-10-06T01:42:48.785020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":196,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-10-06T01:42:44.564193+0000","last_change":"2023-10-06T01:40:10.645512+0000","last_active":"2023-10-06T01:42:44.564193+0000","last_peered":"2023-10-06T01:42:44.564193+0000","last_clean":"2023-10-06T01:42:44.564193+0000","last_became_active":"2023-10-06T01:40:10.644601+0000","last_became_peered":"2023-10-06T01:40:10.644601+0000","last_unstale":"2023-10-06T01:42:44.564193+0000","last_undegraded":"2023-10-06T01:42:44.564193+0000","last_fullsized":"2023-10-06T01:42:44.564193+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:09.580865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:09.580865+0000","last_clean_scrub_stamp":"2023-10-06T01:40:09.580865+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:05:28.268591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":43,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-10-06T01:42:44.564297+0000","last_change":"2023-10-06T01:40:16.651332+0000","last_active":"2023-10-06T01:42:44.564297+0000","last_peered":"2023-10-06T01:42:44.564297+0000","last_clean":"2023-10-06T01:42:44.564297+0000","last_became_active":"2023-10-06T01:40:16.651049+0000","last_became_peered":"2023-10-06T01:40:16.651049+0000","last_unstale":"2023-10-06T01:42:44.564297+0000","last_undegraded":"2023-10-06T01:42:44.564297+0000","last_fullsized":"2023-10-06T01:42:44.564297+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:11:57.218984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":43,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-10-06T01:42:44.565023+0000","last_change":"2023-10-06T01:40:16.931106+0000","last_active":"2023-10-06T01:42:44.565023+0000","last_peered":"2023-10-06T01:42:44.565023+0000","last_clean":"2023-10-06T01:42:44.565023+0000","last_became_active":"2023-10-06T01:40:16.930830+0000","last_became_peered":"2023-10-06T01:40:16.930830+0000","last_unstale":"2023-10-06T01:42:44.565023+0000","last_undegraded":"2023-10-06T01:42:44.565023+0000","last_fullsized":"2023-10-06T01:42:44.565023+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:50:23.628212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":47,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T01:42:49.191847+0000","last_change":"2023-10-06T01:40:16.649379+0000","last_active":"2023-10-06T01:42:49.191847+0000","last_peered":"2023-10-06T01:42:49.191847+0000","last_clean":"2023-10-06T01:42:49.191847+0000","last_became_active":"2023-10-06T01:40:16.649147+0000","last_became_peered":"2023-10-06T01:40:16.649147+0000","last_unstale":"2023-10-06T01:42:49.191847+0000","last_undegraded":"2023-10-06T01:42:49.191847+0000","last_fullsized":"2023-10-06T01:42:49.191847+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":46,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-06T01:42:46.320303+0000","last_change":"2023-10-06T01:40:16.651477+0000","last_active":"2023-10-06T01:42:46.320303+0000","last_peered":"2023-10-06T01:42:46.320303+0000","last_clean":"2023-10-06T01:42:46.320303+0000","last_became_active":"2023-10-06T01:40:16.651190+0000","last_became_peered":"2023-10-06T01:40:16.651190+0000","last_unstale":"2023-10-06T01:42:46.320303+0000","last_undegraded":"2023-10-06T01:42:46.320303+0000","last_fullsized":"2023-10-06T01:42:46.320303+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.633394+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.633394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:45:47.422876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574885,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298588,"kb_used_data":1300,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073252,"statfs":{"total":96636764160,"available":96331010048,"internally_reserved":0,"allocated":1331200,"data_stored":932767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.64400000000000002,"15min":0.66600000000000004},"min":{"1min":0.32800000000000001,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.72799999999999998,"5min":3.6920000000000002,"15min":3.6920000000000002},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.64800000000000002,"15min":0.67000000000000004},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.69199999999999995,"5min":3.629,"15min":3.629},"last":0.52800000000000002}]},{"osd":1,"last update":"Fri Oct 6 01:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.83899999999999997,"15min":0.89500000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.70499999999999996,"5min":10.029999999999999,"15min":10.029999999999999},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.56699999999999995,"15min":0.57299999999999995},"min":{"1min":0.378,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.68799999999999994,"5min":1.544,"15min":1.544},"last":0.41499999999999998}]},{"osd":2,"last update":"Fri Oct 6 01:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.53800000000000003,"15min":0.54400000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.746,"5min":1.091,"15min":1.091},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.92000000000000004,"15min":0.97799999999999998},"min":{"1min":0.45300000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.71099999999999997,"5min":10.710000000000001,"15min":10.710000000000001},"last":0.438}]},{"osd":3,"last update":"Fri Oct 6 01:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.54700000000000004,"15min":0.55300000000000005},"min":{"1min":0.32600000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.64500000000000002,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.70399999999999996,"15min":0.72499999999999998},"min":{"1min":0.441,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.73999999999999999,"5min":3.6509999999999998,"15min":3.6509999999999998},"last":0.48799999999999999}]},{"osd":4,"last update":"Fri Oct 6 01:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.48899999999999999,"15min":0.48799999999999999},"min":{"1min":0.33900000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.77400000000000002,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.53400000000000003,"15min":0.52800000000000002},"min":{"1min":0.42499999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.55400000000000005}]},{"osd":5,"last update":"Fri Oct 6 01:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.59199999999999997,"15min":0.59799999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.86899999999999999,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.629,"15min":0.63600000000000001},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.79800000000000004,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":0.61499999999999999}]},{"osd":6,"last update":"Fri Oct 6 01:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.58999999999999997,"15min":0.59499999999999997},"min":{"1min":0.40799999999999997,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.77700000000000002,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.56599999999999995,"15min":0.56999999999999995},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.69999999999999996,"5min":0.878,"15min":0.878},"last":0.50600000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574885,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298008,"kb_used_data":720,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073832,"statfs":{"total":96636764160,"available":96331603968,"internally_reserved":0,"allocated":737280,"data_stored":342399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.49399999999999999,"15min":0.496},"min":{"1min":0.34999999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.442},{"interface":"front","average":{"1min":0.495,"5min":0.48399999999999999,"15min":0.48199999999999998},"min":{"1min":0.35599999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.315}]},{"osd":1,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.40799999999999997,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.55700000000000005,"15min":0.55900000000000005},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.68400000000000005,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.49199999999999999}]},{"osd":2,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.54200000000000004,"15min":0.54600000000000004},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.70899999999999996,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.56000000000000005,"15min":0.56200000000000006},"min":{"1min":0.40200000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.69399999999999995,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.36499999999999999}]},{"osd":3,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.55400000000000005,"15min":0.55700000000000005},"min":{"1min":0.36899999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.72199999999999998,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.56000000000000005,"15min":0.56200000000000006},"min":{"1min":0.432,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.79000000000000004,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.46100000000000002}]},{"osd":4,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.51300000000000001,"15min":0.52000000000000002},"min":{"1min":0.312,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.61099999999999999,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.5,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.74299999999999999,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.52000000000000002}]},{"osd":5,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.53300000000000003,"15min":0.53100000000000003},"min":{"1min":0.38900000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.66900000000000004,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.377},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.36099999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.72999999999999998,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.53300000000000003}]},{"osd":7,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.56699999999999995,"15min":0.56299999999999994},"min":{"1min":0.47499999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.69399999999999995,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.438,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.67200000000000004,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.50700000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574885,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298008,"kb_used_data":720,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073832,"statfs":{"total":96636764160,"available":96331603968,"internally_reserved":0,"allocated":737280,"data_stored":342399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.86099999999999999,"15min":0.95099999999999996},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.56100000000000005,"5min":11.957000000000001,"15min":11.957000000000001},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.877,"15min":0.96399999999999997},"min":{"1min":0.28999999999999998,"5min":0.252,"15min":0.252},"max":{"1min":0.47899999999999998,"5min":11.917,"15min":11.917},"last":0.34999999999999998}]},{"osd":2,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.36399999999999999,"15min":0.372},"min":{"1min":0.253,"5min":0.251,"15min":0.251},"max":{"1min":0.441,"5min":1.125,"15min":1.125},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.32900000000000001,"5min":0.375,"15min":0.38300000000000001},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.45100000000000001,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.27200000000000002}]},{"osd":3,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.67200000000000004,"15min":0.71999999999999997},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.53000000000000003,"5min":6.2450000000000001,"15min":6.2450000000000001},"last":0.309},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.64800000000000002,"15min":0.69799999999999995},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.52300000000000002,"5min":6.2939999999999996,"15min":6.2939999999999996},"last":0.38800000000000001}]},{"osd":4,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.86299999999999999,"15min":0.90700000000000003},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.84599999999999997,"5min":6.1669999999999998,"15min":6.1669999999999998},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.61099999999999999,"15min":0.61499999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.875,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.66800000000000004}]},{"osd":5,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.83899999999999997,"15min":0.877},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.91900000000000004,"5min":6.2619999999999996,"15min":6.2619999999999996},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.625,"5min":0.873,"15min":0.91400000000000003},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.86799999999999999,"5min":6.2350000000000003,"15min":6.2350000000000003},"last":0.65800000000000003}]},{"osd":6,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.80700000000000005,"15min":0.84899999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.83599999999999997,"5min":6.141,"15min":6.141},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.84599999999999997,"15min":0.89100000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.74299999999999999,"5min":6.2069999999999999,"15min":6.2069999999999999},"last":0.63300000000000001}]},{"osd":7,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.64200000000000002,"15min":0.64900000000000002},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.90700000000000003,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.85699999999999998,"15min":0.90000000000000002},"min":{"1min":0.442,"5min":0.44,"15min":0.44},"max":{"1min":0.72399999999999998,"5min":6.1040000000000001,"15min":6.1040000000000001},"last":0.61799999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574885,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298584,"kb_used_data":1296,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073256,"statfs":{"total":96636764160,"available":96331014144,"internally_reserved":0,"allocated":1327104,"data_stored":931806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 01:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.36899999999999999,"15min":0.374},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.46500000000000002,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.318,"5min":0.46100000000000002,"15min":0.48499999999999999},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.38600000000000001,"5min":3.9129999999999998,"15min":3.9129999999999998},"last":0.29699999999999999}]},{"osd":2,"last update":"Fri Oct 6 01:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.86199999999999999,"15min":0.94799999999999995},"min":{"1min":0.23699999999999999,"5min":0.216,"15min":0.216},"max":{"1min":0.47199999999999998,"5min":15.237,"15min":15.237},"last":0.308},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.48899999999999999,"15min":0.50900000000000001},"min":{"1min":0.28399999999999997,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.49199999999999999,"5min":3.7959999999999998,"15min":3.7959999999999998},"last":0.39200000000000002}]},{"osd":3,"last update":"Fri Oct 6 01:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.51900000000000002,"15min":0.54600000000000004},"min":{"1min":0.29999999999999999,"5min":0.252,"15min":0.252},"max":{"1min":0.48799999999999999,"5min":5.2850000000000001,"15min":5.2850000000000001},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.90500000000000003,"15min":0.99099999999999999},"min":{"1min":0.29399999999999998,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.51200000000000001,"5min":15.263,"15min":15.263},"last":0.379}]},{"osd":4,"last update":"Fri Oct 6 01:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.77300000000000002,"15min":0.80100000000000005},"min":{"1min":0.46500000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.73299999999999998,"5min":5.2590000000000003,"15min":5.2590000000000003},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.60799999999999998,"5min":1.115,"15min":1.1990000000000001},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.84799999999999998,"5min":15.211,"15min":15.211},"last":0.60999999999999999}]},{"osd":5,"last update":"Fri Oct 6 01:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.69099999999999995,"15min":0.71099999999999997},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.81100000000000005,"5min":3.8839999999999999,"15min":3.8839999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.748,"15min":0.78000000000000003},"min":{"1min":0.438,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.63200000000000001,"5min":5.2309999999999999,"15min":5.2309999999999999},"last":0.63300000000000001}]},{"osd":6,"last update":"Fri Oct 6 01:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":1.091,"15min":1.171},"min":{"1min":0.43099999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.82799999999999996,"5min":15.175000000000001,"15min":15.175000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.71599999999999997,"15min":0.73899999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.75,"5min":3.859,"15min":3.859},"last":0.51200000000000001}]},{"osd":7,"last update":"Fri Oct 6 01:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.71799999999999997,"15min":0.73999999999999999},"min":{"1min":0.434,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.71599999999999997,"5min":3.831,"15min":3.831},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.748,"15min":0.77400000000000002},"min":{"1min":0.46500000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.76300000000000001,"5min":5.1959999999999997,"15min":5.1959999999999997},"last":0.59399999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574885,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298008,"kb_used_data":720,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073832,"statfs":{"total":96636764160,"available":96331603968,"internally_reserved":0,"allocated":737280,"data_stored":342399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:42:10 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.33700000000000002,"15min":0.33600000000000002},"min":{"1min":0.22800000000000001,"5min":0.216,"15min":0.216},"max":{"1min":0.46500000000000002,"5min":0.48199999999999998,"15min":0.48199999999999998},"last":0.23499999999999999},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.34999999999999998,"15min":0.35399999999999998},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.46200000000000002,"5min":0.51400000000000001,"15min":0.51400000000000001},"last":0.33200000000000002}]},{"osd":1,"last update":"Fri Oct 6 01:42:10 2023","interfaces":[{"interface":"back","average":{"1min":0.314,"5min":0.311,"15min":0.311},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.441,"5min":0.47299999999999998,"15min":0.47299999999999998},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.36899999999999999,"15min":0.371},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.52400000000000002,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.35899999999999999}]},{"osd":3,"last update":"Fri Oct 6 01:42:10 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35799999999999998,"15min":0.35899999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.47899999999999998,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.374,"5min":0.38,"15min":0.38100000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.48899999999999999,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.29399999999999998}]},{"osd":4,"last update":"Fri Oct 6 01:42:10 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.53300000000000003,"15min":0.53400000000000003},"min":{"1min":0.39900000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.68400000000000005,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.55600000000000005,"15min":0.55400000000000005},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.79800000000000004,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.54400000000000004}]},{"osd":5,"last update":"Fri Oct 6 01:42:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.75600000000000001,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.57899999999999996,"15min":0.58099999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.77900000000000003,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.55300000000000005}]},{"osd":6,"last update":"Fri Oct 6 01:42:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55700000000000005,"15min":0.55800000000000005},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.81799999999999995,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57599999999999996,"15min":0.57699999999999996},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.84499999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.50800000000000001}]},{"osd":7,"last update":"Fri Oct 6 01:42:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56200000000000006,"15min":0.56299999999999994},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.82599999999999996,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.58299999999999996,"15min":0.58499999999999996},"min":{"1min":0.42699999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.72099999999999997,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.59399999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574885,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298008,"kb_used_data":720,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073832,"statfs":{"total":96636764160,"available":96331603968,"internally_reserved":0,"allocated":737280,"data_stored":342399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":0.34399999999999997,"15min":0.35199999999999998},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.41599999999999998,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.36299999999999999,"15min":0.36699999999999999},"min":{"1min":0.249,"5min":0.246,"15min":0.246},"max":{"1min":0.52500000000000002,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.31900000000000001}]},{"osd":1,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.34899999999999998,"15min":0.35199999999999998},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.45500000000000002,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.39100000000000001,"15min":0.39900000000000002},"min":{"1min":0.26700000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.49399999999999999,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.35199999999999998}]},{"osd":2,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.40200000000000002,"15min":0.40999999999999998},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.51100000000000001,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.41599999999999998,"15min":0.42499999999999999},"min":{"1min":0.29899999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.54000000000000004,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.40699999999999997}]},{"osd":4,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54400000000000004,"15min":0.54600000000000004},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.443},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.57599999999999996,"15min":0.57899999999999996},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.752,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.432}]},{"osd":5,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.56100000000000005,"15min":0.56499999999999995},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.55900000000000005,"15min":0.56299999999999994},"min":{"1min":0.377,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.72599999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.47199999999999998}]},{"osd":6,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.57799999999999996,"15min":0.58699999999999997},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.73799999999999999,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.56699999999999995,"15min":0.56899999999999995},"min":{"1min":0.38400000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.48399999999999999}]},{"osd":7,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.57899999999999996,"15min":0.58299999999999996},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.61699999999999999,"15min":0.62},"min":{"1min":0.45300000000000001,"5min":0.442,"15min":0.442},"max":{"1min":0.76700000000000002,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.497}]}]},{"osd":4,"up_from":13,"seq":55834574885,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":298008,"kb_used_data":720,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073832,"statfs":{"total":96636764160,"available":96331603968,"internally_reserved":0,"allocated":737280,"data_stored":342399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.54500000000000004,"15min":0.54000000000000004},"min":{"1min":0.33400000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.046,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.55400000000000005,"15min":0.54800000000000004},"min":{"1min":0.39500000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.90000000000000002,"5min":1.016,"15min":1.016},"last":0.54000000000000004}]},{"osd":1,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.66200000000000003,"15min":0.67700000000000005},"min":{"1min":0.42699999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.92000000000000004,"5min":4.0780000000000003,"15min":4.0780000000000003},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.68200000000000005,"15min":0.70399999999999996},"min":{"1min":0.36299999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.0129999999999999,"5min":4.1050000000000004,"15min":4.1050000000000004},"last":0.59399999999999997}]},{"osd":2,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.55500000000000005,"15min":0.55300000000000005},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.5},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.57499999999999996,"15min":0.57099999999999995},"min":{"1min":0.41099999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.93799999999999994,"5min":1.022,"15min":1.022},"last":0.55900000000000005}]},{"osd":3,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.56100000000000005,"15min":0.55600000000000005},"min":{"1min":0.40600000000000003,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.94799999999999995,"5min":1.149,"15min":1.149},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.443,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.95999999999999996,"5min":1.159,"15min":1.159},"last":0.45300000000000001}]},{"osd":5,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.45400000000000001,"15min":0.442},"min":{"1min":0.316,"5min":0.307,"15min":0.307},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.624,"5min":0.54900000000000004,"15min":0.53700000000000003},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.58099999999999996}]},{"osd":6,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.47199999999999998,"15min":0.46200000000000002},"min":{"1min":0.39100000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.53300000000000003,"15min":0.52200000000000002},"min":{"1min":0.39600000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.46899999999999997}]},{"osd":7,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.54400000000000004,"15min":0.53600000000000003},"min":{"1min":0.36899999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.995,"5min":1.014,"15min":1.014},"last":0.438},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.54600000000000004,"15min":0.53800000000000003},"min":{"1min":0.44700000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.48399999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574885,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298008,"kb_used_data":720,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073832,"statfs":{"total":96636764160,"available":96331603968,"internally_reserved":0,"allocated":737280,"data_stored":342399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.55100000000000005,"15min":0.51700000000000002},"min":{"1min":0.314,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":5.867,"5min":5.867,"15min":5.867},"last":0.443},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.501,"15min":0.499},"min":{"1min":0.34000000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.35299999999999998}]},{"osd":1,"last update":"Fri Oct 6 01:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.52300000000000002,"15min":0.51900000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.754,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.5}]},{"osd":2,"last update":"Fri Oct 6 01:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.56399999999999995,"15min":0.57099999999999995},"min":{"1min":0.36799999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.72499999999999998,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.53900000000000003,"15min":0.54200000000000004},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.81599999999999995,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.46300000000000002}]},{"osd":3,"last update":"Fri Oct 6 01:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.56699999999999995,"15min":0.56100000000000005},"min":{"1min":0.36899999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.9199999999999999,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.58899999999999997,"15min":0.58099999999999996},"min":{"1min":0.39100000000000001,"5min":0.37,"15min":0.37},"max":{"1min":1.9370000000000001,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":0.51200000000000001}]},{"osd":4,"last update":"Fri Oct 6 01:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48299999999999998,"15min":0.48199999999999998},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.379},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.55300000000000005,"15min":0.55400000000000005},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.80300000000000005,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.48099999999999998}]},{"osd":6,"last update":"Fri Oct 6 01:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.52800000000000002,"15min":0.51400000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.978,"5min":1.978,"15min":1.978},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.55500000000000005,"15min":0.54900000000000004},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.53600000000000003}]},{"osd":7,"last update":"Fri Oct 6 01:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.58999999999999997,"15min":0.59399999999999997},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.873,"5min":1.821,"15min":1.821},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.56699999999999995,"15min":0.56299999999999994},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.58099999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T01:42:55.825 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-06T01:40:15.633394+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=1, tm_min=40, tm_sec=15, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=1, tm_min=42, tm_sec=50, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T01:42:55.825 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-10-06T01:40:15.633394+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=1, tm_min=40, tm_sec=15, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=1, tm_min=42, tm_sec=50, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T01:42:55.825 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-10-06T01:40:15.633394+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=1, tm_min=40, tm_sec=15, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=1, tm_min=42, tm_sec=50, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T01:42:55.825 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-06T01:40:15.633394+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=1, tm_min=40, tm_sec=15, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=1, tm_min=42, tm_sec=50, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T01:42:55.825 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-06T01:40:09.580865+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=1, tm_min=40, tm_sec=9, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=1, tm_min=42, tm_sec=50, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T01:42:55.826 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-10-06T01:40:15.633394+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=1, tm_min=40, tm_sec=15, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=1, tm_min=42, tm_sec=50, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T01:42:55.826 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-06T01:40:15.633394+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=1, tm_min=40, tm_sec=15, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=1, tm_min=42, tm_sec=50, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T01:42:55.826 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-06T01:40:15.633394+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=1, tm_min=40, tm_sec=15, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=1, tm_min=42, tm_sec=50, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T01:42:55.826 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-06T01:40:15.633394+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=1, tm_min=40, tm_sec=15, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=1, tm_min=42, tm_sec=50, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T01:42:55.826 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-06T01:43:15.827 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T01:43:15.954 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:15.954+0000 7f474384d700 1 Processor -- start 2023-10-06T01:43:15.955 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:15.954+0000 7f474384d700 1 -- start start 2023-10-06T01:43:15.957 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:15.955+0000 7f474384d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f473c0abd80 0x7f473c15a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:43:15.957 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:15.955+0000 7f474384d700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f473c0ac150 0x7f473c157bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:43:15.957 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:15.955+0000 7f474384d700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f473c0c3220 con 0x7f473c0c1de0 2023-10-06T01:43:15.957 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:15.955+0000 7f474384d700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f473c15aed0 con 0x7f473c0ac150 2023-10-06T01:43:15.957 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:15.955+0000 7f474384d700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f473c159dd0 con 0x7f473c0abd80 2023-10-06T01:43:15.958 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:15.955+0000 7f4740de8700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f473c0ac150 0x7f473c157bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:43:15.958 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:15.955+0000 7f4740de8700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f473c0ac150 0x7f473c157bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51704/0 (socket says 172.21.15.71:51704) 2023-10-06T01:43:15.958 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:15.955+0000 7f4740de8700 1 -- 172.21.15.71:0/1517280509 learned_addr learned my addr 172.21.15.71:0/1517280509 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:43:15.958 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:15.955+0000 7f47415e9700 1 --2- 172.21.15.71:0/1517280509 >> v2:172.21.15.72:3300/0 conn(0x7f473c0abd80 0x7f473c15a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:43:15.958 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:15.955+0000 7f4740de8700 1 -- 172.21.15.71:0/1517280509 >> v2:172.21.15.72:3300/0 conn(0x7f473c0abd80 msgr2=0x7f473c15a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:43:15.958 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:15.955+0000 7f4740de8700 1 --2- 172.21.15.71:0/1517280509 >> v2:172.21.15.72:3300/0 conn(0x7f473c0abd80 0x7f473c15a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:43:15.958 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:15.955+0000 7f4740de8700 1 -- 172.21.15.71:0/1517280509 >> v1:172.21.15.72:6789/0 conn(0x7f473c0c1de0 legacy=0x7f473c068680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:43:15.958 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:15.955+0000 7f4740de8700 1 -- 172.21.15.71:0/1517280509 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f473c0ccfd0 con 0x7f473c0ac150 2023-10-06T01:43:15.958 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:15.955+0000 7f4740de8700 1 --2- 172.21.15.71:0/1517280509 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f473c0ac150 0x7f473c157bb0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f473c063ba0 tx=0x7f472c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7cbb1dffcea682e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:43:15.958 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:15.956+0000 7f4733fff700 1 -- 172.21.15.71:0/1517280509 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f472c009e70 con 0x7f473c0ac150 2023-10-06T01:43:15.959 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:15.956+0000 7f4733fff700 1 -- 172.21.15.71:0/1517280509 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f472c00b860 con 0x7f473c0ac150 2023-10-06T01:43:15.959 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:15.956+0000 7f4733fff700 1 -- 172.21.15.71:0/1517280509 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f472c00bc00 con 0x7f473c0ac150 2023-10-06T01:43:15.959 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:15.956+0000 7f474384d700 1 -- 172.21.15.71:0/1517280509 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f473c0ac150 msgr2=0x7f473c157bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:43:15.959 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:15.956+0000 7f474384d700 1 --2- 172.21.15.71:0/1517280509 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f473c0ac150 0x7f473c157bb0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f473c063ba0 tx=0x7f472c009250 comp rx=0 tx=0).stop 2023-10-06T01:43:15.959 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:15.956+0000 7f474384d700 1 -- 172.21.15.71:0/1517280509 shutdown_connections 2023-10-06T01:43:15.959 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:15.956+0000 7f474384d700 1 --2- 172.21.15.71:0/1517280509 >> v2:172.21.15.72:3300/0 conn(0x7f473c0abd80 0x7f473c15a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:43:15.959 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:15.956+0000 7f474384d700 1 --2- 172.21.15.71:0/1517280509 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f473c0ac150 0x7f473c157bb0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:43:15.959 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:15.956+0000 7f474384d700 1 -- 172.21.15.71:0/1517280509 >> 172.21.15.71:0/1517280509 conn(0x7f473c069790 msgr2=0x7f473c069b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:43:15.959 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:15.956+0000 7f474384d700 1 -- 172.21.15.71:0/1517280509 shutdown_connections 2023-10-06T01:43:15.959 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:15.956+0000 7f474384d700 1 -- 172.21.15.71:0/1517280509 wait complete. 2023-10-06T01:43:15.962 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:15.957+0000 7f474384d700 1 Processor -- start 2023-10-06T01:43:15.962 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:15.958+0000 7f474384d700 1 -- start start 2023-10-06T01:43:15.962 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:15.958+0000 7f474384d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f473c0abd80 0x7f473c0aaf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:43:15.962 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:15.958+0000 7f474384d700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f473c0ac150 0x7f473c0cba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:43:15.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:15.958+0000 7f474384d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f473c0c1de0 0x7f473c16d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:43:15.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:15.958+0000 7f474384d700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f473c0b2540 con 0x7f473c0ac150 2023-10-06T01:43:15.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:15.958+0000 7f474384d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f473c0b2820 con 0x7f473c0abd80 2023-10-06T01:43:15.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:15.958+0000 7f474384d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f473c0b2b00 con 0x7f473c0c1de0 2023-10-06T01:43:15.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:15.959+0000 7f4740de8700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f473c0ac150 0x7f473c0cba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:43:15.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:15.959+0000 7f4740de8700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f473c0ac150 0x7f473c0cba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51706/0 (socket says 172.21.15.71:51706) 2023-10-06T01:43:15.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:15.959+0000 7f4740de8700 1 -- 172.21.15.71:0/2903351443 learned_addr learned my addr 172.21.15.71:0/2903351443 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:43:15.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:15.959+0000 7f47415e9700 1 --2- 172.21.15.71:0/2903351443 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f473c0abd80 0x7f473c0aaf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:43:15.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:15.959+0000 7f4740de8700 1 -- 172.21.15.71:0/2903351443 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f473c0c1de0 msgr2=0x7f473c16d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:43:15.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:15.959+0000 7f4741dea700 1 --2- 172.21.15.71:0/2903351443 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f473c0c1de0 0x7f473c16d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:43:15.963 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:15.959+0000 7f4740de8700 1 --2- 172.21.15.71:0/2903351443 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f473c0c1de0 0x7f473c16d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:43:15.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:15.959+0000 7f4740de8700 1 -- 172.21.15.71:0/2903351443 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f473c0abd80 msgr2=0x7f473c0aaf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:43:15.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:15.959+0000 7f4740de8700 1 --2- 172.21.15.71:0/2903351443 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f473c0abd80 0x7f473c0aaf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:43:15.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:15.959+0000 7f4740de8700 1 -- 172.21.15.71:0/2903351443 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f472c0094f0 con 0x7f473c0ac150 2023-10-06T01:43:15.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:15.959+0000 7f47415e9700 1 --2- 172.21.15.71:0/2903351443 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f473c0abd80 0x7f473c0aaf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:43:15.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:15.959+0000 7f4740de8700 1 --2- 172.21.15.71:0/2903351443 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f473c0ac150 0x7f473c0cba00 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f473c063db0 tx=0x7f472c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:43:15.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:15.959+0000 7f47317fa700 1 -- 172.21.15.71:0/2903351443 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f472c011420 con 0x7f473c0ac150 2023-10-06T01:43:15.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:15.959+0000 7f47317fa700 1 -- 172.21.15.71:0/2903351443 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f472c0115a0 con 0x7f473c0ac150 2023-10-06T01:43:15.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:15.959+0000 7f47317fa700 1 -- 172.21.15.71:0/2903351443 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f472c011960 con 0x7f473c0ac150 2023-10-06T01:43:15.964 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:15.959+0000 7f474384d700 1 -- 172.21.15.71:0/2903351443 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f473c0aff80 con 0x7f473c0ac150 2023-10-06T01:43:15.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:15.959+0000 7f474384d700 1 -- 172.21.15.71:0/2903351443 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f473c0c40f0 con 0x7f473c0ac150 2023-10-06T01:43:15.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:15.960+0000 7f474384d700 1 -- 172.21.15.71:0/2903351443 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f473c0afde0 con 0x7f473c0ac150 2023-10-06T01:43:15.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:15.961+0000 7f47317fa700 1 -- 172.21.15.71:0/2903351443 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f472c0253f0 con 0x7f473c0ac150 2023-10-06T01:43:15.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:15.961+0000 7f47317fa700 1 --2- 172.21.15.71:0/2903351443 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f4720066f30 0x7f47200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:43:15.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:15.961+0000 7f47317fa700 1 -- 172.21.15.71:0/2903351443 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f472c085ef0 con 0x7f473c0ac150 2023-10-06T01:43:15.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:15.961+0000 7f47415e9700 1 --2- 172.21.15.71:0/2903351443 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f4720066f30 0x7f47200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:43:15.965 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:15.961+0000 7f47415e9700 1 --2- 172.21.15.71:0/2903351443 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f4720066f30 0x7f47200693e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4738006f00 tx=0x7f4738008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:43:15.966 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:15.965+0000 7f47317fa700 1 -- 172.21.15.71:0/2903351443 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f473c0afde0 con 0x7f473c0ac150 2023-10-06T01:43:16.143 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.143+0000 7f474384d700 1 -- 172.21.15.71:0/2903351443 --> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f473c0afde0 con 0x7f4720066f30 2023-10-06T01:43:16.146 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.145+0000 7f47317fa700 1 -- 172.21.15.71:0/2903351443 <== mgr.4107 v2:172.21.15.71:6832/90436 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+72864 (secure 0 0 0) 0x7f473c0afde0 con 0x7f4720066f30 2023-10-06T01:43:16.147 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:43:16.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.147+0000 7f474384d700 1 -- 172.21.15.71:0/2903351443 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f4720066f30 msgr2=0x7f47200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:43:16.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.147+0000 7f474384d700 1 --2- 172.21.15.71:0/2903351443 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f4720066f30 0x7f47200693e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4738006f00 tx=0x7f4738008040 comp rx=0 tx=0).stop 2023-10-06T01:43:16.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.147+0000 7f474384d700 1 -- 172.21.15.71:0/2903351443 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f473c0ac150 msgr2=0x7f473c0cba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:43:16.148 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.147+0000 7f474384d700 1 --2- 172.21.15.71:0/2903351443 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f473c0ac150 0x7f473c0cba00 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f473c063db0 tx=0x7f472c017000 comp rx=0 tx=0).stop 2023-10-06T01:43:16.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.147+0000 7f474384d700 1 -- 172.21.15.71:0/2903351443 shutdown_connections 2023-10-06T01:43:16.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.147+0000 7f474384d700 1 --2- 172.21.15.71:0/2903351443 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f473c0c1de0 0x7f473c16d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:43:16.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.147+0000 7f474384d700 1 --2- 172.21.15.71:0/2903351443 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f4720066f30 0x7f47200693e0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:43:16.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.147+0000 7f474384d700 1 --2- 172.21.15.71:0/2903351443 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f473c0abd80 0x7f473c0aaf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:43:16.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.147+0000 7f474384d700 1 --2- 172.21.15.71:0/2903351443 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f473c0ac150 0x7f473c0cba00 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:43:16.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.147+0000 7f474384d700 1 -- 172.21.15.71:0/2903351443 >> 172.21.15.71:0/2903351443 conn(0x7f473c069790 msgr2=0x7f473c140a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:43:16.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.147+0000 7f474384d700 1 -- 172.21.15.71:0/2903351443 shutdown_connections 2023-10-06T01:43:16.149 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.147+0000 7f474384d700 1 -- 172.21.15.71:0/2903351443 wait complete. 2023-10-06T01:43:16.149 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2023-10-06T01:43:16.160 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":147,"stamp":"2023-10-06T01:43:14.600310+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2385220,"kb_used_data":6916,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752589500,"statfs":{"total":773094113280,"available":770651648000,"internally_reserved":0,"allocated":7081984,"data_stored":3918967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002181"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":57,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T01:42:57.170853+0000","last_change":"2023-10-06T01:42:57.170825+0000","last_active":"2023-10-06T01:42:57.170853+0000","last_peered":"2023-10-06T01:42:57.170853+0000","last_clean":"2023-10-06T01:42:57.170853+0000","last_became_active":"2023-10-06T01:40:16.930707+0000","last_became_peered":"2023-10-06T01:40:16.930707+0000","last_unstale":"2023-10-06T01:42:57.170853+0000","last_undegraded":"2023-10-06T01:42:57.170853+0000","last_fullsized":"2023-10-06T01:42:57.170853+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:42:57.170722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:42:57.170722+0000","last_clean_scrub_stamp":"2023-10-06T01:42:57.170722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:49:49.015358+0000","scrub_duration":0.0014690339999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":56,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T01:42:54.977198+0000","last_change":"2023-10-06T01:42:54.977166+0000","last_active":"2023-10-06T01:42:54.977198+0000","last_peered":"2023-10-06T01:42:54.977198+0000","last_clean":"2023-10-06T01:42:54.977198+0000","last_became_active":"2023-10-06T01:40:16.650628+0000","last_became_peered":"2023-10-06T01:40:16.650628+0000","last_unstale":"2023-10-06T01:42:54.977198+0000","last_undegraded":"2023-10-06T01:42:54.977198+0000","last_fullsized":"2023-10-06T01:42:54.977198+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:42:54.977076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:42:54.977076+0000","last_clean_scrub_stamp":"2023-10-06T01:42:54.977076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:31:06.615845+0000","scrub_duration":0.0016402249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":54,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T01:42:54.518763+0000","last_change":"2023-10-06T01:42:54.518731+0000","last_active":"2023-10-06T01:42:54.518763+0000","last_peered":"2023-10-06T01:42:54.518763+0000","last_clean":"2023-10-06T01:42:54.518763+0000","last_became_active":"2023-10-06T01:40:16.781352+0000","last_became_peered":"2023-10-06T01:40:16.781352+0000","last_unstale":"2023-10-06T01:42:54.518763+0000","last_undegraded":"2023-10-06T01:42:54.518763+0000","last_fullsized":"2023-10-06T01:42:54.518763+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:42:54.518606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:42:54.518606+0000","last_clean_scrub_stamp":"2023-10-06T01:42:54.518606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:33:44.763574+0000","scrub_duration":0.00133497,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":56,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T01:42:56.021732+0000","last_change":"2023-10-06T01:42:56.021703+0000","last_active":"2023-10-06T01:42:56.021732+0000","last_peered":"2023-10-06T01:42:56.021732+0000","last_clean":"2023-10-06T01:42:56.021732+0000","last_became_active":"2023-10-06T01:40:16.650469+0000","last_became_peered":"2023-10-06T01:40:16.650469+0000","last_unstale":"2023-10-06T01:42:56.021732+0000","last_undegraded":"2023-10-06T01:42:56.021732+0000","last_fullsized":"2023-10-06T01:42:56.021732+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:42:56.021608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:42:56.021608+0000","last_clean_scrub_stamp":"2023-10-06T01:42:56.021608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:06:53.925230+0000","scrub_duration":0.001564408,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"61'119","reported_seq":209,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T01:43:00.590395+0000","last_change":"2023-10-06T01:43:00.590350+0000","last_active":"2023-10-06T01:43:00.590395+0000","last_peered":"2023-10-06T01:43:00.590395+0000","last_clean":"2023-10-06T01:43:00.590395+0000","last_became_active":"2023-10-06T01:40:10.644601+0000","last_became_peered":"2023-10-06T01:40:10.644601+0000","last_unstale":"2023-10-06T01:43:00.590395+0000","last_undegraded":"2023-10-06T01:43:00.590395+0000","last_fullsized":"2023-10-06T01:43:00.590395+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'119","last_scrub_stamp":"2023-10-06T01:43:00.590245+0000","last_deep_scrub":"61'119","last_deep_scrub_stamp":"2023-10-06T01:43:00.590245+0000","last_clean_scrub_stamp":"2023-10-06T01:43:00.590245+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:08:20.918312+0000","scrub_duration":0.0056739549999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":54,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T01:43:03.689603+0000","last_change":"2023-10-06T01:43:03.689577+0000","last_active":"2023-10-06T01:43:03.689603+0000","last_peered":"2023-10-06T01:43:03.689603+0000","last_clean":"2023-10-06T01:43:03.689603+0000","last_became_active":"2023-10-06T01:40:16.651049+0000","last_became_peered":"2023-10-06T01:40:16.651049+0000","last_unstale":"2023-10-06T01:43:03.689603+0000","last_undegraded":"2023-10-06T01:43:03.689603+0000","last_fullsized":"2023-10-06T01:43:03.689603+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:43:03.689482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:43:03.689482+0000","last_clean_scrub_stamp":"2023-10-06T01:43:03.689482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:33:04.236475+0000","scrub_duration":0.002265665,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":54,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T01:43:05.705702+0000","last_change":"2023-10-06T01:43:05.705670+0000","last_active":"2023-10-06T01:43:05.705702+0000","last_peered":"2023-10-06T01:43:05.705702+0000","last_clean":"2023-10-06T01:43:05.705702+0000","last_became_active":"2023-10-06T01:40:16.930830+0000","last_became_peered":"2023-10-06T01:40:16.930830+0000","last_unstale":"2023-10-06T01:43:05.705702+0000","last_undegraded":"2023-10-06T01:43:05.705702+0000","last_fullsized":"2023-10-06T01:43:05.705702+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:43:05.705574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:43:05.705574+0000","last_clean_scrub_stamp":"2023-10-06T01:43:05.705574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:40:42.922309+0000","scrub_duration":0.0021295149999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":57,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T01:42:55.205480+0000","last_change":"2023-10-06T01:42:55.205460+0000","last_active":"2023-10-06T01:42:55.205480+0000","last_peered":"2023-10-06T01:42:55.205480+0000","last_clean":"2023-10-06T01:42:55.205480+0000","last_became_active":"2023-10-06T01:40:16.649147+0000","last_became_peered":"2023-10-06T01:40:16.649147+0000","last_unstale":"2023-10-06T01:42:55.205480+0000","last_undegraded":"2023-10-06T01:42:55.205480+0000","last_fullsized":"2023-10-06T01:42:55.205480+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:42:55.205385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:42:55.205385+0000","last_clean_scrub_stamp":"2023-10-06T01:42:55.205385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:53:52.188250+0000","scrub_duration":0.0017071829999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":57,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-06T01:43:05.239549+0000","last_change":"2023-10-06T01:43:05.239518+0000","last_active":"2023-10-06T01:43:05.239549+0000","last_peered":"2023-10-06T01:43:05.239549+0000","last_clean":"2023-10-06T01:43:05.239549+0000","last_became_active":"2023-10-06T01:40:16.651190+0000","last_became_peered":"2023-10-06T01:40:16.651190+0000","last_unstale":"2023-10-06T01:43:05.239549+0000","last_undegraded":"2023-10-06T01:43:05.239549+0000","last_fullsized":"2023-10-06T01:43:05.239549+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:43:05.239412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:43:05.239412+0000","last_clean_scrub_stamp":"2023-10-06T01:43:05.239412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:02:13.328737+0000","scrub_duration":0.001498192,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574889,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298588,"kb_used_data":1300,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073252,"statfs":{"total":96636764160,"available":96331010048,"internally_reserved":0,"allocated":1331200,"data_stored":932767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.61599999999999999,"15min":0.65700000000000003},"min":{"1min":0.38600000000000001,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.70599999999999996,"5min":3.6920000000000002,"15min":3.6920000000000002},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.61899999999999999,"15min":0.66100000000000003},"min":{"1min":0.40500000000000003,"5min":0.311,"15min":0.311},"max":{"1min":0.73999999999999999,"5min":3.629,"15min":3.629},"last":0.5}]},{"osd":1,"last update":"Fri Oct 6 01:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.76200000000000001,"15min":0.86899999999999999},"min":{"1min":0.35099999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.74199999999999999,"5min":10.029999999999999,"15min":10.029999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.55900000000000005,"15min":0.57099999999999995},"min":{"1min":0.41499999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.68300000000000005,"5min":1.544,"15min":1.544},"last":0.58499999999999996}]},{"osd":2,"last update":"Fri Oct 6 01:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.53200000000000003,"15min":0.54200000000000004},"min":{"1min":0.36799999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.72799999999999998,"5min":1.091,"15min":1.091},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.83399999999999996,"15min":0.94899999999999995},"min":{"1min":0.35399999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.74199999999999999,"5min":10.710000000000001,"15min":10.710000000000001},"last":0.57599999999999996}]},{"osd":3,"last update":"Fri Oct 6 01:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.54700000000000004,"15min":0.55300000000000005},"min":{"1min":0.40300000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.73099999999999998,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.66700000000000004,"15min":0.71299999999999997},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.76600000000000001,"5min":3.6509999999999998,"15min":3.6509999999999998},"last":0.48699999999999999}]},{"osd":4,"last update":"Fri Oct 6 01:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.49199999999999999,"15min":0.48899999999999999},"min":{"1min":0.33900000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.80200000000000005,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.54000000000000004,"15min":0.53000000000000003},"min":{"1min":0.41599999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.68100000000000005,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.52000000000000002}]},{"osd":5,"last update":"Fri Oct 6 01:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.57599999999999996,"15min":0.59199999999999997},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.84599999999999997,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.61799999999999999,"15min":0.63200000000000001},"min":{"1min":0.40500000000000003,"5min":0.31,"15min":0.31},"max":{"1min":0.82999999999999996,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":0.54800000000000004}]},{"osd":6,"last update":"Fri Oct 6 01:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.57499999999999996,"15min":0.58999999999999997},"min":{"1min":0.378,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.86299999999999999,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.56000000000000005,"15min":0.56799999999999995},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.76900000000000002,"5min":0.878,"15min":0.878},"last":0.45900000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574889,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298008,"kb_used_data":720,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073832,"statfs":{"total":96636764160,"available":96331603968,"internally_reserved":0,"allocated":737280,"data_stored":342399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:43:13 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.497,"15min":0.497},"min":{"1min":0.36399999999999999,"5min":0.313,"15min":0.313},"max":{"1min":0.69099999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.48899999999999999,"15min":0.48399999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.70499999999999996,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.497}]},{"osd":1,"last update":"Fri Oct 6 01:43:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.51800000000000002,"15min":0.51500000000000001},"min":{"1min":0.40200000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.65600000000000003,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55500000000000005,"15min":0.55800000000000005},"min":{"1min":0.48099999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.72899999999999998,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.54700000000000004}]},{"osd":2,"last update":"Fri Oct 6 01:43:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54100000000000004,"15min":0.54600000000000004},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.69299999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.76700000000000002,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.55900000000000005}]},{"osd":3,"last update":"Fri Oct 6 01:43:13 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55300000000000005,"15min":0.55700000000000005},"min":{"1min":0.38,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.74299999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55800000000000005,"15min":0.56100000000000005},"min":{"1min":0.443,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.67900000000000005,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.48499999999999999}]},{"osd":4,"last update":"Fri Oct 6 01:43:13 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.495,"15min":0.51400000000000001},"min":{"1min":0.33000000000000002,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.622,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.58499999999999996,"15min":0.59099999999999997},"min":{"1min":0.36799999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.65300000000000002,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.44700000000000001}]},{"osd":5,"last update":"Fri Oct 6 01:43:13 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.51500000000000001,"15min":0.52500000000000002},"min":{"1min":0.34100000000000003,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.55700000000000005,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.496,"5min":0.55000000000000004,"15min":0.56000000000000005},"min":{"1min":0.34200000000000003,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.63900000000000001,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.46800000000000003}]},{"osd":7,"last update":"Fri Oct 6 01:43:13 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.55600000000000005,"15min":0.56000000000000005},"min":{"1min":0.377,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.68300000000000005,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.377},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.56699999999999995,"15min":0.57499999999999996},"min":{"1min":0.39400000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.67000000000000004,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.40200000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574889,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298008,"kb_used_data":720,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073832,"statfs":{"total":96636764160,"available":96331603968,"internally_reserved":0,"allocated":737280,"data_stored":342399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.86099999999999999,"15min":0.95099999999999996},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.56100000000000005,"5min":11.957000000000001,"15min":11.957000000000001},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.877,"15min":0.96399999999999997},"min":{"1min":0.28999999999999998,"5min":0.252,"15min":0.252},"max":{"1min":0.47899999999999998,"5min":11.917,"15min":11.917},"last":0.373}]},{"osd":2,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.36399999999999999,"15min":0.372},"min":{"1min":0.253,"5min":0.251,"15min":0.251},"max":{"1min":0.441,"5min":1.125,"15min":1.125},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.32900000000000001,"5min":0.375,"15min":0.38300000000000001},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.45100000000000001,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.40100000000000002}]},{"osd":3,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.67200000000000004,"15min":0.71999999999999997},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.53000000000000003,"5min":6.2450000000000001,"15min":6.2450000000000001},"last":0.437},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.64800000000000002,"15min":0.69799999999999995},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.52300000000000002,"5min":6.2939999999999996,"15min":6.2939999999999996},"last":0.42699999999999999}]},{"osd":4,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.86299999999999999,"15min":0.90700000000000003},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.84599999999999997,"5min":6.1669999999999998,"15min":6.1669999999999998},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.61099999999999999,"15min":0.61499999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.875,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.66300000000000003}]},{"osd":5,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.83899999999999997,"15min":0.877},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.91900000000000004,"5min":6.2619999999999996,"15min":6.2619999999999996},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.625,"5min":0.873,"15min":0.91400000000000003},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.86799999999999999,"5min":6.2350000000000003,"15min":6.2350000000000003},"last":0.63500000000000001}]},{"osd":6,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.80700000000000005,"15min":0.84899999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.83599999999999997,"5min":6.141,"15min":6.141},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.84599999999999997,"15min":0.89100000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.74299999999999999,"5min":6.2069999999999999,"15min":6.2069999999999999},"last":0.67100000000000004}]},{"osd":7,"last update":"Fri Oct 6 01:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.64200000000000002,"15min":0.64900000000000002},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.90700000000000003,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.85699999999999998,"15min":0.90000000000000002},"min":{"1min":0.442,"5min":0.44,"15min":0.44},"max":{"1min":0.72399999999999998,"5min":6.1040000000000001,"15min":6.1040000000000001},"last":0.65200000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574889,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298584,"kb_used_data":1296,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073256,"statfs":{"total":96636764160,"available":96331014144,"internally_reserved":0,"allocated":1327104,"data_stored":931806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 01:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.36899999999999999,"15min":0.374},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.46500000000000002,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.318,"5min":0.46100000000000002,"15min":0.48499999999999999},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.38600000000000001,"5min":3.9129999999999998,"15min":3.9129999999999998},"last":0.54400000000000004}]},{"osd":2,"last update":"Fri Oct 6 01:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.86199999999999999,"15min":0.94799999999999995},"min":{"1min":0.23699999999999999,"5min":0.216,"15min":0.216},"max":{"1min":0.47199999999999998,"5min":15.237,"15min":15.237},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.48899999999999999,"15min":0.50900000000000001},"min":{"1min":0.28399999999999997,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.49199999999999999,"5min":3.7959999999999998,"15min":3.7959999999999998},"last":0.47799999999999998}]},{"osd":3,"last update":"Fri Oct 6 01:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.51900000000000002,"15min":0.54600000000000004},"min":{"1min":0.29999999999999999,"5min":0.252,"15min":0.252},"max":{"1min":0.48799999999999999,"5min":5.2850000000000001,"15min":5.2850000000000001},"last":0.376},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.90500000000000003,"15min":0.99099999999999999},"min":{"1min":0.29399999999999998,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.51200000000000001,"5min":15.263,"15min":15.263},"last":0.51500000000000001}]},{"osd":4,"last update":"Fri Oct 6 01:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.77300000000000002,"15min":0.80100000000000005},"min":{"1min":0.46500000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.73299999999999998,"5min":5.2590000000000003,"15min":5.2590000000000003},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.60799999999999998,"5min":1.115,"15min":1.1990000000000001},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.84799999999999998,"5min":15.211,"15min":15.211},"last":0.81599999999999995}]},{"osd":5,"last update":"Fri Oct 6 01:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.69099999999999995,"15min":0.71099999999999997},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.81100000000000005,"5min":3.8839999999999999,"15min":3.8839999999999999},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.748,"15min":0.78000000000000003},"min":{"1min":0.438,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.63200000000000001,"5min":5.2309999999999999,"15min":5.2309999999999999},"last":0.877}]},{"osd":6,"last update":"Fri Oct 6 01:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":1.091,"15min":1.171},"min":{"1min":0.43099999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.82799999999999996,"5min":15.175000000000001,"15min":15.175000000000001},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.71599999999999997,"15min":0.73899999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.75,"5min":3.859,"15min":3.859},"last":0.745}]},{"osd":7,"last update":"Fri Oct 6 01:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.71799999999999997,"15min":0.73999999999999999},"min":{"1min":0.434,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.71599999999999997,"5min":3.831,"15min":3.831},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.748,"15min":0.77400000000000002},"min":{"1min":0.46500000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.76300000000000001,"5min":5.1959999999999997,"15min":5.1959999999999997},"last":0.73099999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574889,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298008,"kb_used_data":720,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073832,"statfs":{"total":96636764160,"available":96331603968,"internally_reserved":0,"allocated":737280,"data_stored":342399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:43:11 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.34399999999999997,"15min":0.33800000000000002},"min":{"1min":0.23499999999999999,"5min":0.216,"15min":0.216},"max":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.373,"5min":0.35399999999999998,"15min":0.35499999999999998},"min":{"1min":0.28100000000000003,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.36599999999999999}]},{"osd":1,"last update":"Fri Oct 6 01:43:11 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.316,"15min":0.312},"min":{"1min":0.23999999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.376,"5min":0.36899999999999999,"15min":0.371},"min":{"1min":0.28199999999999997,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.627,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.441}]},{"osd":3,"last update":"Fri Oct 6 01:43:11 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.36699999999999999,"15min":0.36199999999999999},"min":{"1min":0.29899999999999999,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.57699999999999996,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.38600000000000001,"15min":0.38300000000000001},"min":{"1min":0.29399999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.47599999999999998}]},{"osd":4,"last update":"Fri Oct 6 01:43:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.54600000000000004,"15min":0.53800000000000003},"min":{"1min":0.42399999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.80400000000000005,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.56399999999999995,"15min":0.55600000000000005},"min":{"1min":0.40500000000000003,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.79000000000000004,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.505}]},{"osd":5,"last update":"Fri Oct 6 01:43:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.56299999999999994,"15min":0.55700000000000005},"min":{"1min":0.43099999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.90000000000000002,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.58399999999999996,"15min":0.58299999999999996},"min":{"1min":0.47999999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.78400000000000003,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.51700000000000002}]},{"osd":6,"last update":"Fri Oct 6 01:43:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.56599999999999995,"15min":0.56100000000000005},"min":{"1min":0.44700000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.73899999999999999,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.627,"5min":0.58599999999999997,"15min":0.57999999999999996},"min":{"1min":0.48599999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.87,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.56899999999999995}]},{"osd":7,"last update":"Fri Oct 6 01:43:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.56899999999999995,"15min":0.56499999999999995},"min":{"1min":0.41399999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.72799999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.59299999999999997,"15min":0.58899999999999997},"min":{"1min":0.42799999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.85999999999999999,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.63700000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574889,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298008,"kb_used_data":720,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073832,"statfs":{"total":96636764160,"available":96331603968,"internally_reserved":0,"allocated":737280,"data_stored":342399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:43:11 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.34499999999999997,"15min":0.35199999999999998},"min":{"1min":0.23699999999999999,"5min":0.214,"15min":0.214},"max":{"1min":0.53400000000000003,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.37},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.37,"15min":0.37},"min":{"1min":0.27300000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.52400000000000002,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.46000000000000002}]},{"osd":1,"last update":"Fri Oct 6 01:43:11 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.35799999999999998,"15min":0.35499999999999998},"min":{"1min":0.28399999999999997,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.55700000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.442,"5min":0.39900000000000002,"15min":0.40200000000000002},"min":{"1min":0.316,"5min":0.253,"15min":0.253},"max":{"1min":0.58499999999999996,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.41499999999999998}]},{"osd":2,"last update":"Fri Oct 6 01:43:11 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.40699999999999997,"15min":0.41199999999999998},"min":{"1min":0.34599999999999997,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.57199999999999995,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.443},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.41999999999999998,"15min":0.42599999999999999},"min":{"1min":0.308,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.63200000000000001,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.308}]},{"osd":4,"last update":"Fri Oct 6 01:43:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.54900000000000004,"15min":0.54800000000000004},"min":{"1min":0.40999999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.70699999999999996,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.58199999999999996,"15min":0.58099999999999996},"min":{"1min":0.432,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.72899999999999998,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.628}]},{"osd":5,"last update":"Fri Oct 6 01:43:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.38800000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.69099999999999995,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.56599999999999995,"15min":0.56499999999999995},"min":{"1min":0.44,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.68500000000000005,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.68300000000000005}]},{"osd":6,"last update":"Fri Oct 6 01:43:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.57599999999999996,"15min":0.58599999999999997},"min":{"1min":0.45700000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.67400000000000004,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.57599999999999996,"15min":0.57199999999999995},"min":{"1min":0.48399999999999999,"5min":0.373,"15min":0.373},"max":{"1min":0.72999999999999998,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.59799999999999998}]},{"osd":7,"last update":"Fri Oct 6 01:43:11 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.58199999999999996,"15min":0.58399999999999996},"min":{"1min":0.50900000000000001,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.71899999999999997,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.622,"15min":0.622},"min":{"1min":0.47199999999999998,"5min":0.442,"15min":0.442},"max":{"1min":0.74299999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.66900000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574889,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":298008,"kb_used_data":720,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073832,"statfs":{"total":96636764160,"available":96331603968,"internally_reserved":0,"allocated":737280,"data_stored":342399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:43:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.54500000000000004,"15min":0.54000000000000004},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.68600000000000005,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.56399999999999995,"15min":0.55200000000000005},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.748,"5min":1.016,"15min":1.016},"last":0.67900000000000005}]},{"osd":1,"last update":"Fri Oct 6 01:43:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.63800000000000001,"15min":0.66900000000000004},"min":{"1min":0.38500000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.70899999999999996,"5min":4.0780000000000003,"15min":4.0780000000000003},"last":0.63},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.65900000000000003,"15min":0.69599999999999995},"min":{"1min":0.41299999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.76200000000000001,"5min":4.1050000000000004,"15min":4.1050000000000004},"last":0.64300000000000002}]},{"osd":2,"last update":"Fri Oct 6 01:43:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55800000000000005,"15min":0.55400000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.70699999999999996,"5min":1.069,"15min":1.069},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.58199999999999996,"15min":0.57399999999999995},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.75900000000000001,"5min":1.022,"15min":1.022},"last":0.66900000000000004}]},{"osd":3,"last update":"Fri Oct 6 01:43:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.56999999999999995,"15min":0.55900000000000005},"min":{"1min":0.39900000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.78400000000000003,"5min":1.149,"15min":1.149},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.57899999999999996,"15min":0.57799999999999996},"min":{"1min":0.44800000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.73799999999999999,"5min":1.159,"15min":1.159},"last":0.58199999999999996}]},{"osd":5,"last update":"Fri Oct 6 01:43:11 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.46200000000000002,"15min":0.44500000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.80200000000000005,"5min":0.879,"15min":0.879},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.55700000000000005,"15min":0.53900000000000003},"min":{"1min":0.44600000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.86199999999999999,"5min":1.034,"15min":1.034},"last":0.59899999999999998}]},{"osd":6,"last update":"Fri Oct 6 01:43:11 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.47899999999999998,"15min":0.46500000000000002},"min":{"1min":0.34999999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.76600000000000001,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.53400000000000003,"15min":0.52200000000000002},"min":{"1min":0.375,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.84899999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.56100000000000005}]},{"osd":7,"last update":"Fri Oct 6 01:43:11 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54500000000000004,"15min":0.53700000000000003},"min":{"1min":0.39700000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.94499999999999995,"5min":1.014,"15min":1.014},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.54700000000000004,"15min":0.53800000000000003},"min":{"1min":0.41499999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.82699999999999996,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.54400000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574889,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298008,"kb_used_data":720,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073832,"statfs":{"total":96636764160,"available":96331603968,"internally_reserved":0,"allocated":737280,"data_stored":342399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.55100000000000005,"15min":0.51700000000000002},"min":{"1min":0.314,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":5.867,"5min":5.867,"15min":5.867},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.501,"15min":0.499},"min":{"1min":0.34000000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.70899999999999996}]},{"osd":1,"last update":"Fri Oct 6 01:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.52300000000000002,"15min":0.51900000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.754,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.69199999999999995}]},{"osd":2,"last update":"Fri Oct 6 01:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.56399999999999995,"15min":0.57099999999999995},"min":{"1min":0.36799999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.72499999999999998,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.53900000000000003,"15min":0.54200000000000004},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.81599999999999995,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.72999999999999998}]},{"osd":3,"last update":"Fri Oct 6 01:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.56699999999999995,"15min":0.56100000000000005},"min":{"1min":0.36899999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.9199999999999999,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.58899999999999997,"15min":0.58099999999999996},"min":{"1min":0.39100000000000001,"5min":0.37,"15min":0.37},"max":{"1min":1.9370000000000001,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":0.80100000000000005}]},{"osd":4,"last update":"Fri Oct 6 01:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48299999999999998,"15min":0.48199999999999998},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.627},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.55300000000000005,"15min":0.55400000000000005},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.80300000000000005,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.57999999999999996}]},{"osd":6,"last update":"Fri Oct 6 01:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.52800000000000002,"15min":0.51400000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.978,"5min":1.978,"15min":1.978},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.55500000000000005,"15min":0.54900000000000004},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.751}]},{"osd":7,"last update":"Fri Oct 6 01:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.58999999999999997,"15min":0.59399999999999997},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.873,"5min":1.821,"15min":1.821},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.56699999999999995,"15min":0.56299999999999994},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.67600000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T01:43:16.163 DEBUG:teuthology.orchestra.run.smithi071:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-10-06T01:43:16.275 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.275+0000 7ff65938a700 1 Processor -- start 2023-10-06T01:43:16.276 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.275+0000 7ff65938a700 1 -- start start 2023-10-06T01:43:16.278 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.276+0000 7ff65938a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff654086ff0 0x7ff654087440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:43:16.278 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.276+0000 7ff65938a700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff654087980 con 0x7ff6540b21b0 2023-10-06T01:43:16.278 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.276+0000 7ff65938a700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6540afc50 con 0x7ff65415a030 2023-10-06T01:43:16.278 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.276+0000 7ff65938a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6540b0cf0 con 0x7ff654086ff0 2023-10-06T01:43:16.278 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.276+0000 7ff6537fe700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7ff6540b21b0 0x7ff6540b25f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:52412/0 (socket says 172.21.15.71:52412) 2023-10-06T01:43:16.278 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.276+0000 7ff6537fe700 1 -- 172.21.15.71:0/1866403242 learned_addr learned my addr 172.21.15.71:0/1866403242 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:43:16.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.276+0000 7ff6527fc700 1 --2- 172.21.15.71:0/1866403242 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff654086ff0 0x7ff654087440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:43:16.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.276+0000 7ff651ffb700 1 -- 172.21.15.71:0/1866403242 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1457510323 0 0) 0x7ff654087980 con 0x7ff6540b21b0 2023-10-06T01:43:16.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.276+0000 7ff651ffb700 1 -- 172.21.15.71:0/1866403242 --> v1:172.21.15.71:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff63c003570 con 0x7ff6540b21b0 2023-10-06T01:43:16.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.276+0000 7ff651ffb700 1 -- 172.21.15.71:0/1866403242 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 493703958 0 0) 0x7ff6540afc50 con 0x7ff65415a030 2023-10-06T01:43:16.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.276+0000 7ff651ffb700 1 -- 172.21.15.71:0/1866403242 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff654087980 con 0x7ff65415a030 2023-10-06T01:43:16.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.276+0000 7ff6527fc700 1 -- 172.21.15.71:0/1866403242 >> v1:172.21.15.72:6789/0 conn(0x7ff65415a030 legacy=0x7ff65415a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:43:16.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.276+0000 7ff6527fc700 1 -- 172.21.15.71:0/1866403242 >> v1:172.21.15.71:6789/0 conn(0x7ff6540b21b0 legacy=0x7ff6540b25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:43:16.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.276+0000 7ff651ffb700 1 -- 172.21.15.71:0/1866403242 <== mon.0 v1:172.21.15.71:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2204989373 0 0) 0x7ff63c003570 con 0x7ff6540b21b0 2023-10-06T01:43:16.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.276+0000 7ff6527fc700 1 -- 172.21.15.71:0/1866403242 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6540aff30 con 0x7ff654086ff0 2023-10-06T01:43:16.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.276+0000 7ff6527fc700 1 --2- 172.21.15.71:0/1866403242 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff654086ff0 0x7ff654087440 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff648009910 tx=0x7ff6480091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f39a02ce39fa547 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:43:16.279 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.277+0000 7ff651ffb700 1 -- 172.21.15.71:0/1866403242 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff644001470 con 0x7ff654086ff0 2023-10-06T01:43:16.280 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.277+0000 7ff651ffb700 1 -- 172.21.15.71:0/1866403242 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff648011420 con 0x7ff654086ff0 2023-10-06T01:43:16.280 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.277+0000 7ff651ffb700 1 -- 172.21.15.71:0/1866403242 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6480117c0 con 0x7ff654086ff0 2023-10-06T01:43:16.280 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.277+0000 7ff65938a700 1 -- 172.21.15.71:0/1866403242 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff654086ff0 msgr2=0x7ff654087440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:43:16.280 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.277+0000 7ff65938a700 1 --2- 172.21.15.71:0/1866403242 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff654086ff0 0x7ff654087440 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff648009910 tx=0x7ff6480091a0 comp rx=0 tx=0).stop 2023-10-06T01:43:16.280 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.277+0000 7ff65938a700 1 -- 172.21.15.71:0/1866403242 shutdown_connections 2023-10-06T01:43:16.280 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.277+0000 7ff65938a700 1 --2- 172.21.15.71:0/1866403242 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff654086ff0 0x7ff654087440 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:43:16.280 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.277+0000 7ff65938a700 1 -- 172.21.15.71:0/1866403242 >> 172.21.15.71:0/1866403242 conn(0x7ff654068680 msgr2=0x7ff654068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:43:16.280 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.277+0000 7ff65938a700 1 -- 172.21.15.71:0/1866403242 shutdown_connections 2023-10-06T01:43:16.280 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.277+0000 7ff65938a700 1 -- 172.21.15.71:0/1866403242 wait complete. 2023-10-06T01:43:16.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.278+0000 7ff65938a700 1 Processor -- start 2023-10-06T01:43:16.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.278+0000 7ff65938a700 1 -- start start 2023-10-06T01:43:16.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.279+0000 7ff65938a700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff654086ff0 0x7ff65416e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:43:16.283 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.279+0000 7ff65938a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff6540b21b0 0x7ff6540c8410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:43:16.284 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.279+0000 7ff65938a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff65415a030 0x7ff65415c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:43:16.284 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.279+0000 7ff65938a700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6540c8950 con 0x7ff654086ff0 2023-10-06T01:43:16.284 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.279+0000 7ff65938a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff65415c600 con 0x7ff65415a030 2023-10-06T01:43:16.284 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.279+0000 7ff65938a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff65415a4a0 con 0x7ff6540b21b0 2023-10-06T01:43:16.284 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.279+0000 7ff652ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff654086ff0 0x7ff65416e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:43:16.284 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.279+0000 7ff652ffd700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff654086ff0 0x7ff65416e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51714/0 (socket says 172.21.15.71:51714) 2023-10-06T01:43:16.284 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.279+0000 7ff652ffd700 1 -- 172.21.15.71:0/1515277411 learned_addr learned my addr 172.21.15.71:0/1515277411 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:43:16.284 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.279+0000 7ff6527fc700 1 --2- 172.21.15.71:0/1515277411 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff6540b21b0 0x7ff6540c8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:43:16.284 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.279+0000 7ff6537fe700 1 --2- 172.21.15.71:0/1515277411 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff65415a030 0x7ff65415c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:43:16.284 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.279+0000 7ff652ffd700 1 -- 172.21.15.71:0/1515277411 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff6540b21b0 msgr2=0x7ff6540c8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:43:16.284 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.279+0000 7ff652ffd700 1 --2- 172.21.15.71:0/1515277411 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff6540b21b0 0x7ff6540c8410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:43:16.284 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.279+0000 7ff652ffd700 1 -- 172.21.15.71:0/1515277411 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff65415a030 msgr2=0x7ff65415c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:43:16.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.279+0000 7ff652ffd700 1 --2- 172.21.15.71:0/1515277411 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff65415a030 0x7ff65415c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:43:16.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.279+0000 7ff652ffd700 1 -- 172.21.15.71:0/1515277411 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff648009420 con 0x7ff654086ff0 2023-10-06T01:43:16.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.279+0000 7ff6537fe700 1 --2- 172.21.15.71:0/1515277411 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff65415a030 0x7ff65415c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:43:16.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.280+0000 7ff652ffd700 1 --2- 172.21.15.71:0/1515277411 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff654086ff0 0x7ff65416e3b0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7ff64c00c900 tx=0x7ff64c002780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:43:16.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.280+0000 7ff63affd700 1 -- 172.21.15.71:0/1515277411 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff64c00cea0 con 0x7ff654086ff0 2023-10-06T01:43:16.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.280+0000 7ff63affd700 1 -- 172.21.15.71:0/1515277411 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff64c00a7e0 con 0x7ff654086ff0 2023-10-06T01:43:16.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.280+0000 7ff65938a700 1 -- 172.21.15.71:0/1515277411 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff65415c880 con 0x7ff654086ff0 2023-10-06T01:43:16.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.280+0000 7ff63affd700 1 -- 172.21.15.71:0/1515277411 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff64c00aba0 con 0x7ff654086ff0 2023-10-06T01:43:16.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.280+0000 7ff65938a700 1 -- 172.21.15.71:0/1515277411 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff65415cec0 con 0x7ff654086ff0 2023-10-06T01:43:16.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.281+0000 7ff65938a700 1 -- 172.21.15.71:0/1515277411 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff65415a660 con 0x7ff654086ff0 2023-10-06T01:43:16.285 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.281+0000 7ff63affd700 1 -- 172.21.15.71:0/1515277411 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff64c012420 con 0x7ff654086ff0 2023-10-06T01:43:16.286 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.281+0000 7ff63affd700 1 --2- 172.21.15.71:0/1515277411 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7ff640066f30 0x7ff6400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:43:16.286 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.282+0000 7ff63affd700 1 -- 172.21.15.71:0/1515277411 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5698+0+0 (secure 0 0 0) 0x7ff64c084950 con 0x7ff654086ff0 2023-10-06T01:43:16.286 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.282+0000 7ff6527fc700 1 --2- 172.21.15.71:0/1515277411 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7ff640066f30 0x7ff6400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:43:16.286 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.282+0000 7ff6527fc700 1 --2- 172.21.15.71:0/1515277411 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7ff640066f30 0x7ff6400693e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7ff648009860 tx=0x7ff648016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:43:16.286 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.286+0000 7ff63affd700 1 -- 172.21.15.71:0/1515277411 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff64c051bc0 con 0x7ff654086ff0 2023-10-06T01:43:16.470 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.469+0000 7ff65938a700 1 -- 172.21.15.71:0/1515277411 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7ff6540b0210 con 0x7ff654086ff0 2023-10-06T01:43:16.473 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.473+0000 7ff63affd700 1 -- 172.21.15.71:0/1515277411 <== mon.0 v2:172.21.15.71:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7ff64c051bc0 con 0x7ff654086ff0 2023-10-06T01:43:16.473 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.473+0000 7ff63affd700 1 -- 172.21.15.71:0/1515277411 <== mon.0 v2:172.21.15.71:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v14)=0 v14) v1 ==== 123+0+0 (secure 0 0 0) 0x7ff64c0551e0 con 0x7ff654086ff0 2023-10-06T01:43:16.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.476+0000 7ff65938a700 1 -- 172.21.15.71:0/1515277411 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7ff640066f30 msgr2=0x7ff6400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:43:16.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.476+0000 7ff65938a700 1 --2- 172.21.15.71:0/1515277411 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7ff640066f30 0x7ff6400693e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7ff648009860 tx=0x7ff648016000 comp rx=0 tx=0).stop 2023-10-06T01:43:16.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.476+0000 7ff65938a700 1 -- 172.21.15.71:0/1515277411 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff654086ff0 msgr2=0x7ff65416e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:43:16.477 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.476+0000 7ff65938a700 1 --2- 172.21.15.71:0/1515277411 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff654086ff0 0x7ff65416e3b0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7ff64c00c900 tx=0x7ff64c002780 comp rx=0 tx=0).stop 2023-10-06T01:43:16.478 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.476+0000 7ff65938a700 1 -- 172.21.15.71:0/1515277411 shutdown_connections 2023-10-06T01:43:16.478 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.476+0000 7ff65938a700 1 --2- 172.21.15.71:0/1515277411 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7ff640066f30 0x7ff6400693e0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:43:16.478 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.476+0000 7ff65938a700 1 --2- 172.21.15.71:0/1515277411 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff65415a030 0x7ff65415c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:43:16.478 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.476+0000 7ff65938a700 1 --2- 172.21.15.71:0/1515277411 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff654086ff0 0x7ff65416e3b0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:43:16.478 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.476+0000 7ff65938a700 1 --2- 172.21.15.71:0/1515277411 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff6540b21b0 0x7ff6540c8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:43:16.478 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.476+0000 7ff65938a700 1 -- 172.21.15.71:0/1515277411 >> 172.21.15.71:0/1515277411 conn(0x7ff654068680 msgr2=0x7ff6540b50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:43:16.478 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.476+0000 7ff65938a700 1 -- 172.21.15.71:0/1515277411 shutdown_connections 2023-10-06T01:43:16.478 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.476+0000 7ff65938a700 1 -- 172.21.15.71:0/1515277411 wait complete. 2023-10-06T01:43:16.488 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T01:43:16.489 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T01:43:16.602 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.602+0000 7f9160b44700 1 Processor -- start 2023-10-06T01:43:16.603 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.602+0000 7f9160b44700 1 -- start start 2023-10-06T01:43:16.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.603+0000 7f9160b44700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f915c0af4e0 0x7f915c0b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:43:16.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.603+0000 7f9160b44700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f915c0af8b0 0x7f915c0b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:43:16.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.603+0000 7f9160b44700 1 -- --> v1:172.21.15.71:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f915c15e190 con 0x7f915c15d460 2023-10-06T01:43:16.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.603+0000 7f9160b44700 1 -- --> v2:172.21.15.71:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f915c0b1910 con 0x7f915c0af4e0 2023-10-06T01:43:16.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.603+0000 7f9160b44700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f915c15dfb0 con 0x7f915c0af8b0 2023-10-06T01:43:16.605 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.603+0000 7f915a59c700 1 --2- >> v2:172.21.15.71:3300/0 conn(0x7f915c0af4e0 0x7f915c0b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:43:16.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.603+0000 7f915ad9d700 1 --1- >> v1:172.21.15.71:6789/0 conn(0x7f915c15d460 0x7f915c15d8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.71:6789/0 says I am v1:172.21.15.71:52414/0 (socket says 172.21.15.71:52414) 2023-10-06T01:43:16.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.603+0000 7f915ad9d700 1 -- 172.21.15.71:0/2292012493 learned_addr learned my addr 172.21.15.71:0/2292012493 (peer_addr_for_me v1:172.21.15.71:0/0) 2023-10-06T01:43:16.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.603+0000 7f9153fff700 1 --2- 172.21.15.71:0/2292012493 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f915c0af8b0 0x7f915c0b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:43:16.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.603+0000 7f915a59c700 1 -- 172.21.15.71:0/2292012493 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f915c0af8b0 msgr2=0x7f915c0b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:43:16.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.603+0000 7f915a59c700 1 --2- 172.21.15.71:0/2292012493 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f915c0af8b0 0x7f915c0b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:43:16.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.603+0000 7f915a59c700 1 -- 172.21.15.71:0/2292012493 >> v1:172.21.15.71:6789/0 conn(0x7f915c15d460 legacy=0x7f915c15d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:43:16.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.603+0000 7f9159d9b700 1 -- 172.21.15.71:0/2292012493 <== mon.0 v1:172.21.15.71:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3415646957 0 0) 0x7f915c15e190 con 0x7f915c15d460 2023-10-06T01:43:16.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.603+0000 7f915a59c700 1 -- 172.21.15.71:0/2292012493 --> v2:172.21.15.71:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f915c0cb650 con 0x7f915c0af4e0 2023-10-06T01:43:16.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.603+0000 7f915a59c700 1 --2- 172.21.15.71:0/2292012493 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f915c0af4e0 0x7f915c0b20e0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f914c0098e0 tx=0x7f914c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f40c81ba7203bbe1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:43:16.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.603+0000 7f9159d9b700 1 -- 172.21.15.71:0/2292012493 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f914c009e80 con 0x7f915c0af4e0 2023-10-06T01:43:16.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.603+0000 7f9159d9b700 1 -- 172.21.15.71:0/2292012493 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f914c00b860 con 0x7f915c0af4e0 2023-10-06T01:43:16.606 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.603+0000 7f9159d9b700 1 -- 172.21.15.71:0/2292012493 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f914c00bc00 con 0x7f915c0af4e0 2023-10-06T01:43:16.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.604+0000 7f9160b44700 1 -- 172.21.15.71:0/2292012493 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f915c0af4e0 msgr2=0x7f915c0b20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:43:16.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.604+0000 7f9160b44700 1 --2- 172.21.15.71:0/2292012493 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f915c0af4e0 0x7f915c0b20e0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f914c0098e0 tx=0x7f914c0091a0 comp rx=0 tx=0).stop 2023-10-06T01:43:16.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.604+0000 7f9160b44700 1 -- 172.21.15.71:0/2292012493 shutdown_connections 2023-10-06T01:43:16.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.604+0000 7f9160b44700 1 --2- 172.21.15.71:0/2292012493 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f915c0af4e0 0x7f915c0b20e0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:43:16.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.604+0000 7f9160b44700 1 --2- 172.21.15.71:0/2292012493 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f915c0af8b0 0x7f915c0b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:43:16.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.604+0000 7f9160b44700 1 -- 172.21.15.71:0/2292012493 >> 172.21.15.71:0/2292012493 conn(0x7f915c068680 msgr2=0x7f915c068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:43:16.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.604+0000 7f9160b44700 1 -- 172.21.15.71:0/2292012493 shutdown_connections 2023-10-06T01:43:16.607 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.604+0000 7f9160b44700 1 -- 172.21.15.71:0/2292012493 wait complete. 2023-10-06T01:43:16.610 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.605+0000 7f9160b44700 1 Processor -- start 2023-10-06T01:43:16.610 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.605+0000 7f9160b44700 1 -- start start 2023-10-06T01:43:16.610 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.606+0000 7f9160b44700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f915c0af4e0 0x7f915c16aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:43:16.610 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.606+0000 7f9160b44700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f915c0af8b0 0x7f915c0ce7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:43:16.610 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.606+0000 7f9160b44700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f915c15d460 0x7f915c0c9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:43:16.610 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.606+0000 7f9160b44700 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f915c0cf7d0 con 0x7f915c0af8b0 2023-10-06T01:43:16.610 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.606+0000 7f9160b44700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f915c0ced20 con 0x7f915c15d460 2023-10-06T01:43:16.610 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.606+0000 7f9160b44700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f915c0cef30 con 0x7f915c0af4e0 2023-10-06T01:43:16.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.606+0000 7f9153fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f915c0af8b0 0x7f915c0ce7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:43:16.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.606+0000 7f9153fff700 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f915c0af8b0 0x7f915c0ce7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51724/0 (socket says 172.21.15.71:51724) 2023-10-06T01:43:16.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.606+0000 7f9153fff700 1 -- 172.21.15.71:0/3730384605 learned_addr learned my addr 172.21.15.71:0/3730384605 (peer_addr_for_me v2:172.21.15.71:0/0) 2023-10-06T01:43:16.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.606+0000 7f915ad9d700 1 --2- 172.21.15.71:0/3730384605 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f915c15d460 0x7f915c0c9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:43:16.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.606+0000 7f915a59c700 1 --2- 172.21.15.71:0/3730384605 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f915c0af4e0 0x7f915c16aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:43:16.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.606+0000 7f9153fff700 1 -- 172.21.15.71:0/3730384605 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f915c0af4e0 msgr2=0x7f915c16aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:43:16.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.606+0000 7f9153fff700 1 --2- 172.21.15.71:0/3730384605 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f915c0af4e0 0x7f915c16aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:43:16.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.606+0000 7f9153fff700 1 -- 172.21.15.71:0/3730384605 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f915c15d460 msgr2=0x7f915c0c9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:43:16.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.606+0000 7f9153fff700 1 --2- 172.21.15.71:0/3730384605 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f915c15d460 0x7f915c0c9bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:43:16.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.606+0000 7f9153fff700 1 -- 172.21.15.71:0/3730384605 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f914c009420 con 0x7f915c0af8b0 2023-10-06T01:43:16.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.606+0000 7f9153fff700 1 --2- 172.21.15.71:0/3730384605 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f915c0af8b0 0x7f915c0ce7e0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f914400d860 tx=0x7f9144008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:43:16.611 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.606+0000 7f91527fc700 1 -- 172.21.15.71:0/3730384605 <== mon.0 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9144009610 con 0x7f915c0af8b0 2023-10-06T01:43:16.612 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.606+0000 7f91527fc700 1 -- 172.21.15.71:0/3730384605 <== mon.0 v2:172.21.15.71:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f9144009770 con 0x7f915c0af8b0 2023-10-06T01:43:16.612 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.607+0000 7f9160b44700 1 -- 172.21.15.71:0/3730384605 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f915c0cf210 con 0x7f915c0af8b0 2023-10-06T01:43:16.612 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.607+0000 7f91527fc700 1 -- 172.21.15.71:0/3730384605 <== mon.0 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9144009b50 con 0x7f915c0af8b0 2023-10-06T01:43:16.612 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.607+0000 7f9160b44700 1 -- 172.21.15.71:0/3730384605 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f915c16b240 con 0x7f915c0af8b0 2023-10-06T01:43:16.612 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.608+0000 7f9160b44700 1 -- 172.21.15.71:0/3730384605 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f915c0c6d90 con 0x7f915c0af8b0 2023-10-06T01:43:16.612 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.608+0000 7f91527fc700 1 -- 172.21.15.71:0/3730384605 <== mon.0 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f914401e460 con 0x7f915c0af8b0 2023-10-06T01:43:16.612 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.608+0000 7f91527fc700 1 --2- 172.21.15.71:0/3730384605 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f913c066f30 0x7f913c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:43:16.612 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.608+0000 7f91527fc700 1 -- 172.21.15.71:0/3730384605 <== mon.0 v2:172.21.15.71:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5698+0+0 (secure 0 0 0) 0x7f9144084b30 con 0x7f915c0af8b0 2023-10-06T01:43:16.612 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.608+0000 7f915a59c700 1 --2- 172.21.15.71:0/3730384605 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f913c066f30 0x7f913c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:43:16.612 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.609+0000 7f915a59c700 1 --2- 172.21.15.71:0/3730384605 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f913c066f30 0x7f913c0693e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f915c0cfa30 tx=0x7f914c0091a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:43:16.613 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.612+0000 7f91527fc700 1 -- 172.21.15.71:0/3730384605 <== mon.0 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9144051e20 con 0x7f915c0af8b0 2023-10-06T01:43:16.838 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.837+0000 7f9160b44700 1 -- 172.21.15.71:0/3730384605 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f915c16b460 con 0x7f915c0af8b0 2023-10-06T01:43:16.838 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.838+0000 7f91527fc700 1 -- 172.21.15.71:0/3730384605 <== mon.0 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+3523 (secure 0 0 0) 0x7f9144055440 con 0x7f915c0af8b0 2023-10-06T01:43:16.839 INFO:teuthology.orchestra.run.smithi071.stdout: 2023-10-06T01:43:16.839 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":41,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5171,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/3015768753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":3015768753},{"type":"v1","addr":"172.21.15.72:6835","nonce":3015768753}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5572,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6833/698854056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":698854056},{"type":"v1","addr":"172.21.15.72:6833","nonce":698854056}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":5811,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/2808450062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":2808450062},{"type":"v1","addr":"172.21.15.71:6835","nonce":2808450062}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":5952,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/940801523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":940801523},{"type":"v1","addr":"172.21.15.71:6837","nonce":940801523}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41}],"filesystems":[]} 2023-10-06T01:43:16.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.839+0000 7f9160b44700 1 -- 172.21.15.71:0/3730384605 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f913c066f30 msgr2=0x7f913c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:43:16.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.839+0000 7f9160b44700 1 --2- 172.21.15.71:0/3730384605 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f913c066f30 0x7f913c0693e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f915c0cfa30 tx=0x7f914c0091a0 comp rx=0 tx=0).stop 2023-10-06T01:43:16.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.840+0000 7f9160b44700 1 -- 172.21.15.71:0/3730384605 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f915c0af8b0 msgr2=0x7f915c0ce7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:43:16.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.840+0000 7f9160b44700 1 --2- 172.21.15.71:0/3730384605 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f915c0af8b0 0x7f915c0ce7e0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f914400d860 tx=0x7f9144008040 comp rx=0 tx=0).stop 2023-10-06T01:43:16.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.840+0000 7f9160b44700 1 -- 172.21.15.71:0/3730384605 shutdown_connections 2023-10-06T01:43:16.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.840+0000 7f9160b44700 1 --2- 172.21.15.71:0/3730384605 >> [v2:172.21.15.71:6832/90436,v1:172.21.15.71:6833/90436] conn(0x7f913c066f30 0x7f913c0693e0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:43:16.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.840+0000 7f9160b44700 1 --2- 172.21.15.71:0/3730384605 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f915c15d460 0x7f915c0c9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:43:16.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.840+0000 7f9160b44700 1 --2- 172.21.15.71:0/3730384605 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f915c0af4e0 0x7f915c16aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:43:16.841 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.840+0000 7f9160b44700 1 --2- 172.21.15.71:0/3730384605 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f915c0af8b0 0x7f915c0ce7e0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:43:16.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.840+0000 7f9160b44700 1 -- 172.21.15.71:0/3730384605 >> 172.21.15.71:0/3730384605 conn(0x7f915c068680 msgr2=0x7f915c0b4380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:43:16.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.840+0000 7f9160b44700 1 -- 172.21.15.71:0/3730384605 shutdown_connections 2023-10-06T01:43:16.842 INFO:teuthology.orchestra.run.smithi071.stderr:2023-10-06T01:43:16.840+0000 7f9160b44700 1 -- 172.21.15.71:0/3730384605 wait complete. 2023-10-06T01:43:16.842 INFO:teuthology.orchestra.run.smithi071.stderr:dumped fsmap epoch 41 2023-10-06T01:43:16.852 DEBUG:tasks.cephfs.filesystem:already dead... 2023-10-06T01:43:16.852 INFO:teuthology.misc:Shutting down mds daemons... 2023-10-06T01:43:16.853 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T01:43:16.853 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T01:43:16.861 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T01:43:16.861 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T01:43:16.861 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T01:43:16.910 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T01:43:16.911 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T01:43:16.911 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T01:43:16.921 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T01:43:16.922 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T01:43:16.922 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T01:43:16.973 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T01:43:16.973 INFO:teuthology.misc:Shutting down osd daemons... 2023-10-06T01:43:16.973 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-06T01:43:16.973 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T01:43:17.003 INFO:tasks.ceph.osd.0:Stopped 2023-10-06T01:43:17.003 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-10-06T01:43:17.003 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T01:43:17.067 INFO:tasks.ceph.osd.1:Stopped 2023-10-06T01:43:17.068 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-10-06T01:43:17.068 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T01:43:17.140 INFO:tasks.ceph.osd.2:Stopped 2023-10-06T01:43:17.140 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-10-06T01:43:17.140 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T01:43:17.174 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2023-10-06T01:43:17.174 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2023-10-06T01:43:17.174 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-10-06T01:43:17.174 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2023-10-06T01:43:17.209 INFO:tasks.ceph.osd.3:Stopped 2023-10-06T01:43:17.209 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-10-06T01:43:17.209 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T01:43:17.247 INFO:tasks.ceph.osd.4:Stopped 2023-10-06T01:43:17.247 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-10-06T01:43:17.248 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T01:43:17.318 INFO:tasks.ceph.osd.5:Stopped 2023-10-06T01:43:17.319 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-10-06T01:43:17.319 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T01:43:17.394 INFO:tasks.ceph.osd.6:Stopped 2023-10-06T01:43:17.395 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-10-06T01:43:17.395 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T01:43:17.460 INFO:tasks.ceph.osd.7:Stopped 2023-10-06T01:43:17.460 INFO:teuthology.misc:Shutting down mgr daemons... 2023-10-06T01:43:17.461 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-10-06T01:43:17.461 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T01:43:17.485 INFO:tasks.ceph.mgr.y:Stopped 2023-10-06T01:43:17.485 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-06T01:43:17.485 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T01:43:17.526 INFO:tasks.ceph.mgr.x:Stopped 2023-10-06T01:43:17.526 INFO:teuthology.misc:Shutting down mon daemons... 2023-10-06T01:43:17.527 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-10-06T01:43:17.527 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T01:43:17.537 INFO:tasks.ceph.mon.a:Stopped 2023-10-06T01:43:17.537 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-10-06T01:43:17.537 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T01:43:17.578 INFO:tasks.ceph.mon.b:Stopped 2023-10-06T01:43:17.579 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-10-06T01:43:17.579 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T01:43:17.631 INFO:tasks.ceph.mon.c:Stopped 2023-10-06T01:43:17.631 INFO:tasks.ceph:Checking cluster log for badness... 2023-10-06T01:43:17.631 DEBUG:teuthology.orchestra.run.smithi071:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'force file system read-only' | egrep -v 'bad backtrace' | egrep -v 'MDS in read-only mode' | egrep -v '\(MDS_READ_ONLY\)' | head -n 1 2023-10-06T01:43:17.659 INFO:teuthology.orchestra.run.smithi071.stdout:1696556410.591198 mon.a (mon.0) 107 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-06T01:43:17.659 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2023-10-06T01:43:17.660 DEBUG:teuthology.orchestra.run.smithi071:> sudo egrep '\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'force file system read-only' | egrep -v 'bad backtrace' | egrep -v 'MDS in read-only mode' | egrep -v '\(MDS_READ_ONLY\)' | head -n 1 2023-10-06T01:43:17.728 DEBUG:teuthology.orchestra.run.smithi071:> sudo egrep '\[ERR\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'force file system read-only' | egrep -v 'bad backtrace' | egrep -v 'MDS in read-only mode' | egrep -v '\(MDS_READ_ONLY\)' | head -n 1 2023-10-06T01:43:17.797 DEBUG:teuthology.orchestra.run.smithi071:> sudo egrep '\[WRN\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'force file system read-only' | egrep -v 'bad backtrace' | egrep -v 'MDS in read-only mode' | egrep -v '\(MDS_READ_ONLY\)' | head -n 1 2023-10-06T01:43:17.865 INFO:teuthology.orchestra.run.smithi071.stdout:1696556410.591198 mon.a (mon.0) 107 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-06T01:43:17.865 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi071.front.sepia.ceph.com 2023-10-06T01:43:17.865 DEBUG:teuthology.orchestra.run.smithi071:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-10-06T01:43:18.128 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi071.front.sepia.ceph.com 2023-10-06T01:43:18.128 DEBUG:teuthology.orchestra.run.smithi071:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-10-06T01:43:18.223 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi071.front.sepia.ceph.com 2023-10-06T01:43:18.223 DEBUG:teuthology.orchestra.run.smithi071:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-10-06T01:43:18.310 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi071.front.sepia.ceph.com 2023-10-06T01:43:18.310 DEBUG:teuthology.orchestra.run.smithi071:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-10-06T01:43:18.384 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi072.front.sepia.ceph.com 2023-10-06T01:43:18.384 DEBUG:teuthology.orchestra.run.smithi072:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-10-06T01:43:18.574 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi072.front.sepia.ceph.com 2023-10-06T01:43:18.574 DEBUG:teuthology.orchestra.run.smithi072:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-10-06T01:43:18.670 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi072.front.sepia.ceph.com 2023-10-06T01:43:18.670 DEBUG:teuthology.orchestra.run.smithi072:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-10-06T01:43:18.763 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi072.front.sepia.ceph.com 2023-10-06T01:43:18.763 DEBUG:teuthology.orchestra.run.smithi072:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-10-06T01:43:18.829 INFO:tasks.ceph:Archiving mon data... 2023-10-06T01:43:18.830 DEBUG:teuthology.misc:Transferring archived files from smithi071:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412092/data/mon.a.tgz 2023-10-06T01:43:18.830 DEBUG:teuthology.orchestra.run.smithi071:> mktemp 2023-10-06T01:43:18.845 INFO:teuthology.orchestra.run.smithi071.stdout:/tmp/tmp.iPJ4e7V489 2023-10-06T01:43:18.845 DEBUG:teuthology.orchestra.run.smithi071:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.iPJ4e7V489 2023-10-06T01:43:18.990 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 0666 /tmp/tmp.iPJ4e7V489 2023-10-06T01:43:19.070 DEBUG:teuthology.orchestra.remote:smithi071:/tmp/tmp.iPJ4e7V489 is 354KB 2023-10-06T01:43:19.166 DEBUG:teuthology.orchestra.run.smithi071:> rm -fr /tmp/tmp.iPJ4e7V489 2023-10-06T01:43:19.180 DEBUG:teuthology.misc:Transferring archived files from smithi072:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412092/data/mon.b.tgz 2023-10-06T01:43:19.180 DEBUG:teuthology.orchestra.run.smithi072:> mktemp 2023-10-06T01:43:19.195 INFO:teuthology.orchestra.run.smithi072.stdout:/tmp/tmp.e0BNjhE7o4 2023-10-06T01:43:19.195 DEBUG:teuthology.orchestra.run.smithi072:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.e0BNjhE7o4 2023-10-06T01:43:19.375 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 0666 /tmp/tmp.e0BNjhE7o4 2023-10-06T01:43:19.456 DEBUG:teuthology.orchestra.remote:smithi072:/tmp/tmp.e0BNjhE7o4 is 465KB 2023-10-06T01:43:19.583 DEBUG:teuthology.orchestra.run.smithi072:> rm -fr /tmp/tmp.e0BNjhE7o4 2023-10-06T01:43:19.597 DEBUG:teuthology.misc:Transferring archived files from smithi072:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412092/data/mon.c.tgz 2023-10-06T01:43:19.597 DEBUG:teuthology.orchestra.run.smithi072:> mktemp 2023-10-06T01:43:19.651 INFO:teuthology.orchestra.run.smithi072.stdout:/tmp/tmp.Ts1LrIDcxk 2023-10-06T01:43:19.652 DEBUG:teuthology.orchestra.run.smithi072:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.Ts1LrIDcxk 2023-10-06T01:43:19.803 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 0666 /tmp/tmp.Ts1LrIDcxk 2023-10-06T01:43:19.884 DEBUG:teuthology.orchestra.remote:smithi072:/tmp/tmp.Ts1LrIDcxk is 465KB 2023-10-06T01:43:19.981 DEBUG:teuthology.orchestra.run.smithi072:> rm -fr /tmp/tmp.Ts1LrIDcxk 2023-10-06T01:43:19.995 INFO:tasks.ceph:Cleaning ceph cluster... 2023-10-06T01:43:19.995 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-06T01:43:19.998 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-06T01:43:20.058 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-10-06T01:43:20.059 DEBUG:teuthology.orchestra.run.smithi071:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-06T01:43:20.064 DEBUG:teuthology.orchestra.run.smithi072:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-06T01:43:20.088 INFO:teuthology.orchestra.run.smithi071.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-06T01:43:20.123 INFO:teuthology.orchestra.run.smithi072.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-06T01:43:20.129 INFO:tasks.ceph:Archiving crash dumps... 2023-10-06T01:43:20.131 DEBUG:teuthology.misc:Transferring archived files from smithi071:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412092/remote/smithi071/crash 2023-10-06T01:43:20.131 DEBUG:teuthology.orchestra.run.smithi071:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-06T01:43:20.161 DEBUG:teuthology.misc:Transferring archived files from smithi072:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412092/remote/smithi072/crash 2023-10-06T01:43:20.162 DEBUG:teuthology.orchestra.run.smithi072:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-06T01:43:20.193 INFO:tasks.ceph:Shutting down logrotate 2023-10-06T01:43:20.193 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T01:43:20.206 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T01:43:20.292 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-06T01:43:20.317 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-06T01:43:20.341 INFO:tasks.ceph:Compressing logs... 2023-10-06T01:43:20.341 DEBUG:teuthology.orchestra.run.smithi071:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T01:43:20.360 DEBUG:teuthology.orchestra.run.smithi072:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T01:43:22.176 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2023-10-06T01:43:22.176 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2023-10-06T01:43:22.176 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2023-10-06T01:43:22.176 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2023-10-06T01:43:24.052 INFO:tasks.ceph:Archiving logs... 2023-10-06T01:43:24.052 DEBUG:teuthology.misc:Transferring archived files from smithi071:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412092/remote/smithi071/log 2023-10-06T01:43:24.054 DEBUG:teuthology.orchestra.run.smithi071:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-06T01:43:24.729 DEBUG:teuthology.misc:Transferring archived files from smithi072:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412092/remote/smithi072/log 2023-10-06T01:43:24.730 DEBUG:teuthology.orchestra.run.smithi072:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-06T01:43:25.135 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-06T01:43:25.148 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-06T01:43:25.148 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-06T01:43:25.151 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-06T01:43:25.230 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-06T01:43:25.239 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-06T01:43:25.239 DEBUG:teuthology.orchestra.run.smithi071:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T01:43:25.241 DEBUG:teuthology.orchestra.run.smithi072:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T01:43:25.254 INFO:teuthology.orchestra.run.smithi071.stderr:bash: ntpq: command not found 2023-10-06T01:43:25.255 INFO:teuthology.orchestra.run.smithi072.stderr:bash: ntpq: command not found 2023-10-06T01:43:25.258 INFO:teuthology.orchestra.run.smithi071.stdout:210 Number of sources = 4 2023-10-06T01:43:25.258 INFO:teuthology.orchestra.run.smithi071.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-06T01:43:25.258 INFO:teuthology.orchestra.run.smithi071.stdout:=============================================================================== 2023-10-06T01:43:25.258 INFO:teuthology.orchestra.run.smithi071.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 54 +44us[ +46us] +/- 77ms 2023-10-06T01:43:25.258 INFO:teuthology.orchestra.run.smithi071.stdout:^* hv02.front.sepia.ceph.com 3 6 377 53 -408us[ -406us] +/- 64ms 2023-10-06T01:43:25.258 INFO:teuthology.orchestra.run.smithi071.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 55 +434us[ +436us] +/- 72ms 2023-10-06T01:43:25.258 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T01:43:25.259 INFO:teuthology.orchestra.run.smithi072.stdout:210 Number of sources = 4 2023-10-06T01:43:25.259 INFO:teuthology.orchestra.run.smithi072.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-06T01:43:25.259 INFO:teuthology.orchestra.run.smithi072.stdout:=============================================================================== 2023-10-06T01:43:25.260 INFO:teuthology.orchestra.run.smithi072.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 53 +46us[ +46us] +/- 77ms 2023-10-06T01:43:25.260 INFO:teuthology.orchestra.run.smithi072.stdout:^* hv02.front.sepia.ceph.com 3 6 377 55 -399us[ -389us] +/- 64ms 2023-10-06T01:43:25.260 INFO:teuthology.orchestra.run.smithi072.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 53 +450us[ +450us] +/- 72ms 2023-10-06T01:43:25.260 INFO:teuthology.orchestra.run.smithi072.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T01:43:25.260 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-06T01:43:25.268 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-06T01:43:25.269 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-06T01:43:25.285 DEBUG:teuthology.orchestra.run.smithi071:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-06T01:43:25.398 DEBUG:teuthology.orchestra.run.smithi072:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-06T01:43:25.488 DEBUG:teuthology.orchestra.run.smithi071:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-06T01:43:25.517 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T01:43:25.518 DEBUG:teuthology.orchestra.run.smithi072:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-06T01:43:25.546 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T01:43:25.547 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-06T01:43:25.556 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-06T01:43:25.580 INFO:teuthology.task.internal:Duration was 1017.881096 seconds 2023-10-06T01:43:25.580 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-06T01:43:25.632 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-06T01:43:25.632 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-06T01:43:25.634 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-06T01:43:25.676 INFO:teuthology.orchestra.run.smithi071.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-06T01:43:25.677 INFO:teuthology.orchestra.run.smithi072.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-06T01:43:25.941 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-06T01:43:25.941 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi071.front.sepia.ceph.com 2023-10-06T01:43:25.941 DEBUG:teuthology.orchestra.run.smithi071:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-06T01:43:26.000 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi072.front.sepia.ceph.com 2023-10-06T01:43:26.001 DEBUG:teuthology.orchestra.run.smithi072:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-06T01:43:26.019 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-06T01:43:26.019 DEBUG:teuthology.orchestra.run.smithi071:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T01:43:26.043 DEBUG:teuthology.orchestra.run.smithi072:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T01:43:26.098 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-06T01:43:26.098 DEBUG:teuthology.orchestra.run.smithi071:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-06T01:43:26.125 DEBUG:teuthology.orchestra.run.smithi072:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-06T01:43:26.211 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-06T01:43:26.223 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-06T01:43:26.224 DEBUG:teuthology.orchestra.run.smithi071:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-06T01:43:26.247 DEBUG:teuthology.orchestra.run.smithi072:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-06T01:43:26.271 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-06T01:43:26.281 DEBUG:teuthology.orchestra.run.smithi071:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-06T01:43:26.291 DEBUG:teuthology.orchestra.run.smithi072:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-06T01:43:26.311 INFO:teuthology.orchestra.run.smithi071.stdout:kernel.core_pattern = core 2023-10-06T01:43:26.335 INFO:teuthology.orchestra.run.smithi072.stdout:kernel.core_pattern = core 2023-10-06T01:43:26.348 DEBUG:teuthology.orchestra.run.smithi071:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-06T01:43:26.379 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T01:43:26.379 DEBUG:teuthology.orchestra.run.smithi072:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-06T01:43:26.402 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T01:43:26.402 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-06T01:43:26.412 INFO:teuthology.task.internal:Transferring archived files... 2023-10-06T01:43:26.412 DEBUG:teuthology.misc:Transferring archived files from smithi071:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412092/remote/smithi071 2023-10-06T01:43:26.412 DEBUG:teuthology.orchestra.run.smithi071:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-06T01:43:26.455 DEBUG:teuthology.misc:Transferring archived files from smithi072:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412092/remote/smithi072 2023-10-06T01:43:26.455 DEBUG:teuthology.orchestra.run.smithi072:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-06T01:43:26.490 INFO:teuthology.task.internal:Removing archive directory... 2023-10-06T01:43:26.490 DEBUG:teuthology.orchestra.run.smithi071:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-06T01:43:26.493 DEBUG:teuthology.orchestra.run.smithi072:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-06T01:43:26.538 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-06T01:43:26.549 INFO:teuthology.task.internal:Not uploading archives. 2023-10-06T01:43:26.549 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-06T01:43:26.558 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-06T01:43:26.559 DEBUG:teuthology.orchestra.run.smithi071:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-06T01:43:26.561 DEBUG:teuthology.orchestra.run.smithi072:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-06T01:43:26.572 INFO:teuthology.orchestra.run.smithi071.stdout: 263007 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 6 01:43 /home/ubuntu/cephtest 2023-10-06T01:43:26.592 INFO:teuthology.orchestra.run.smithi072.stdout: 262183 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 6 01:43 /home/ubuntu/cephtest 2023-10-06T01:43:26.594 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-06T01:43:26.603 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-06T01:43:26.668 INFO:teuthology.nuke:Checking targets against current locks 2023-10-06T01:43:26.689 DEBUG:teuthology.nuke:shortname: smithi071 2023-10-06T01:43:26.689 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T01:43:26.715 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi071.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412092', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 01:18:43.447708', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOARrpVsuelpPHrKQz9fgxjsSMLYVQZw9/j/SJSe42xtgeMSaokhcXmBhEqsLpgD7mrfjvBYaajAwxC9YbyrVCo='} 2023-10-06T01:43:26.717 DEBUG:teuthology.nuke:shortname: smithi072 2023-10-06T01:43:26.717 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T01:43:26.741 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi072.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412092', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 01:18:43.449718', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKAOUnKDmq8dM80lRaXjuGcm/tuYAcwg0zb0tU+4ZiSl9leZ0oV3Z9l2uUo7fyq2Bii/XYSJgbx9T/lUp4hASiI='} 2023-10-06T01:43:26.769 INFO:teuthology.orchestra.console.smithi071:Power off 2023-10-06T01:43:26.769 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-06T01:43:26.785 INFO:teuthology.orchestra.console.smithi072:Power off 2023-10-06T01:43:26.786 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-06T01:43:26.795 DEBUG:teuthology.orchestra.console.smithi071:power off output: Chassis Power Control: Down/Off 2023-10-06T01:43:26.795 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T01:43:26.807 DEBUG:teuthology.orchestra.console.smithi072:power off output: Chassis Power Control: Down/Off 2023-10-06T01:43:26.807 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T01:43:26.817 DEBUG:teuthology.orchestra.console.smithi071:check power output: Chassis Power is on 2023-10-06T01:43:26.828 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on 2023-10-06T01:43:30.818 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T01:43:30.830 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T01:43:30.927 DEBUG:teuthology.orchestra.console.smithi071:check power output: Chassis Power is on 2023-10-06T01:43:30.938 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on 2023-10-06T01:43:34.930 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T01:43:34.939 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T01:43:35.041 DEBUG:teuthology.orchestra.console.smithi071:check power output: Chassis Power is on 2023-10-06T01:43:35.049 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is off 2023-10-06T01:43:35.149 INFO:teuthology.orchestra.console.smithi072:Power off completed 2023-10-06T01:43:39.042 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T01:43:39.152 DEBUG:teuthology.orchestra.console.smithi071:check power output: Chassis Power is off 2023-10-06T01:43:39.252 INFO:teuthology.orchestra.console.smithi071:Power off completed 2023-10-06T01:43:39.359 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/auto-repair} duration: 1017.881096124649 failure_reason: '"1696556410.591198 mon.a (mon.0) 107 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log' flavor: default owner: scheduled_yuriw@teuthology success: false 2023-10-06T01:43:39.360 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T01:43:39.447 INFO:teuthology.run:FAIL